Random Access9 charts
Random Access Performance
#1lance2.56 ms1.00x
#2vortex-file-compressed7.84 ms3.07x
#3parquet8.57 s3352.56x
Random access time | Ratio to fastest (lower is better)
Compression25 charts
Compression Throughput vs Parquet
⚡Write Speed (Compression)2.24x
📤Scan Speed (Decompression)17.21x
Inverse geomean of Vortex/Parquet ratios (higher is better)
TPC-H l_comment canonical
TPC-H l_comment chunked
arade
bimbo
cmsprovider
euro2016
food
hashtags
public-bi/Arade
public-bi/Bimbo
public-bi/CMSprovider
public-bi/Euro2016
public-bi/Food
public-bi/HashTags
taxi
tpc-h l_comment canonical
tpc-h l_comment chunked
wide table cols=10 chunks=1 rows=1000
wide table cols=10 chunks=50 rows=1000
wide table cols=100 chunks=1 rows=1000
wide table cols=100 chunks=50 rows=1000
wide table cols=1000 chunks=1 rows=1000
wide table cols=1000 chunks=50 rows=1000
wide table cols=10000 chunks=1 rows=1000
wide table cols=10000 chunks=50 rows=1000
Compression Size33 charts
Compression Size Summary
⬇️Min Size Ratio0.56x
📊Mean Size Ratio1.09x
⬆️Max Size Ratio1.47x
Geomean of Vortex/Parquet size ratios (lower is better)
TPC-H l_comment canonical
TPC-H l_comment chunked
arade
bimbo
clickbench
cmsprovider
euro2016
fineweb
food
hashtags
polarsignals/1000000
public-bi/Arade
public-bi/Bimbo
public-bi/CMSprovider
public-bi/Euro2016
public-bi/Food
public-bi/HashTags
statpopgen/100000
taxi
tpc-h l_comment canonical
tpc-h l_comment chunked
tpcds
tpch
tpch/10
tpch/100
wide table cols=10 chunks=1 rows=1000
wide table cols=10 chunks=50 rows=1000
wide table cols=100 chunks=1 rows=1000
wide table cols=100 chunks=50 rows=1000
wide table cols=1000 chunks=1 rows=1000
wide table cols=1000 chunks=50 rows=1000
wide table cols=10000 chunks=1 rows=1000
wide table cols=10000 chunks=50 rows=1000
Clickbench43 charts
Performance Summary
#1duckdb:vortex-file-compressed1.17x13.88 s
#2datafusion:vortex-file-compressed1.38x19.92 s
#3duckdb:vortex-compact1.52x17.10 s
#4duckdb:parquet1.59x18.06 s
#5duckdb:duckdb1.73x21.12 s
#6datafusion:vortex-compact1.73x23.29 s
#7datafusion:parquet1.89x25.65 s
#8datafusion:lance10.27x90.21 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (NVMe) (SF=1)22 charts
Performance Summary
#1duckdb:duckdb1.09x557.08 ms
#2duckdb:vortex-file-compressed1.59x789.15 ms
#3datafusion:vortex-file-compressed1.69x848.91 ms
#4datafusion:vortex-compact1.90x939.60 ms
#5duckdb:vortex-compact1.91x921.01 ms
#6datafusion:arrow2.22x1.21 s
#7duckdb:parquet3.45x1.82 s
#8datafusion:parquet4.24x2.06 s
#9datafusion:lance5.26x2.92 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=1)22 charts
Performance Summary
#1datafusion:lance1.19x7.69 s
#2datafusion:parquet1.37x8.64 s
#3datafusion:vortex-compact1.42x8.87 s
#4datafusion:vortex-file-compressed1.49x9.22 s
#5duckdb:vortex-compact2.22x13.84 s
#6duckdb:vortex-file-compressed2.31x14.36 s
#7duckdb:parquet3.53x21.89 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (NVMe) (SF=10)22 charts
Performance Summary
#1duckdb:duckdb1.06x2.63 s
#2duckdb:vortex-file-compressed1.27x3.26 s
#3duckdb:vortex-compact1.58x3.90 s
#4datafusion:vortex-file-compressed2.01x5.94 s
#5duckdb:parquet2.18x5.42 s
#6datafusion:vortex-compact2.27x6.31 s
#7datafusion:parquet3.29x8.13 s
#8datafusion:arrow5.60x16.34 s
#9datafusion:lance10.67x30.59 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=10)22 charts
Performance Summary
#1datafusion:vortex-compact1.11x18.45 s
#2datafusion:vortex-file-compressed1.21x20.06 s
#3duckdb:vortex-compact1.26x20.21 s
#4duckdb:vortex-file-compressed1.38x22.34 s
#5datafusion:parquet1.49x25.21 s
#6duckdb:parquet2.06x34.09 s
#7datafusion:lance2.20x43.02 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (NVMe) (SF=100)22 charts
Performance Summary
#1duckdb:vortex-file-compressed1.05x29.95 s
#2duckdb:parquet1.37x36.51 s
#3datafusion:vortex-file-compressed1.79x62.96 s
#4datafusion:parquet2.44x72.97 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=100)22 charts
Performance Summary
#1datafusion:vortex-file-compressed1.09x120.43 s
#2duckdb:vortex-file-compressed1.15x124.35 s
#3datafusion:parquet1.46x160.74 s
#4duckdb:parquet1.54x162.97 s
Geomean of query time ratio to fastest (lower is better)
TPC-DS (NVMe) (SF=1)99 charts
Performance Summary
#1duckdb:duckdb1.08x2.98 s
#2duckdb:parquet1.41x3.52 s
#3duckdb:vortex-file-compressed1.66x3.88 s
#4datafusion:parquet2.27x6.51 s
#5duckdb:vortex-compact2.27x5.12 s
#6datafusion:vortex-file-compressed2.27x8.11 s
#7datafusion:vortex-compact2.72x8.73 s
Geomean of query time ratio to fastest (lower is better)
TPC-DS (NVMe) (SF=1.0)99 charts
Performance Summary
#1duckdb:duckdb1.08x2.99 s
#2duckdb:parquet1.42x3.63 s
#3duckdb:vortex-file-compressed1.63x3.90 s
#4datafusion:parquet2.16x6.34 s
#5datafusion:vortex-file-compressed2.17x7.60 s
#6duckdb:vortex-compact2.28x5.23 s
#7datafusion:vortex-compact2.80x9.15 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (NVMe) (SF=1.0)22 charts
Performance Summary
#1duckdb:duckdb1.09x556.33 ms
#2duckdb:vortex-file-compressed1.51x742.26 ms
#3datafusion:vortex-file-compressed1.70x848.66 ms
#4datafusion:vortex-compact1.80x886.21 ms
#5duckdb:vortex-compact1.85x882.60 ms
#6datafusion:arrow2.27x1.23 s
#7duckdb:parquet3.47x1.81 s
#8datafusion:parquet3.94x1.93 s
#9datafusion:lance5.49x2.98 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (NVMe) (SF=10.0)22 charts
Performance Summary
#1duckdb:duckdb1.05x2.66 s
#2duckdb:vortex-file-compressed1.27x3.29 s
#3duckdb:vortex-compact1.57x3.94 s
#4datafusion:vortex-file-compressed2.00x6.00 s
#5duckdb:parquet2.17x5.43 s
#6datafusion:vortex-compact2.25x6.35 s
#7datafusion:parquet3.14x7.92 s
#8datafusion:arrow5.65x16.63 s
#9datafusion:lance10.98x31.21 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=1.0)22 charts
Performance Summary
#1datafusion:parquet1.10x7.16 s
#2datafusion:vortex-compact1.30x8.29 s
#3datafusion:vortex-file-compressed1.41x9.05 s
#4duckdb:vortex-file-compressed2.03x13.10 s
#5duckdb:vortex-compact2.06x13.31 s
#6duckdb:parquet2.99x18.72 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=10.0)22 charts
Performance Summary
#1datafusion:vortex-compact1.17x19.65 s
#2datafusion:vortex-file-compressed1.22x20.76 s
#3duckdb:vortex-compact1.25x20.65 s
#4duckdb:vortex-file-compressed1.38x22.58 s
#5datafusion:parquet1.50x26.77 s
#6duckdb:parquet2.07x34.52 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=100.0)22 charts
Performance Summary
#1datafusion:vortex-file-compressed1.12x125.29 s
#2duckdb:vortex-file-compressed1.16x126.63 s
#3datafusion:parquet1.52x170.86 s
#4duckdb:parquet1.53x162.72 s
Geomean of query time ratio to fastest (lower is better)
fineweb [nvme]9 charts
fineweb [s3]9 charts
polarsignals [nvme]10 charts
Performance Summary
#1datafusion:vortex-file-compressed1.00x1.18 s
Geomean of query time ratio to fastest (lower is better)
statpopgen [nvme]11 charts
Performance Summary
#1duckdb:vortex-file-compressed1.42x19.61 s
#2duckdb:vortex-compact2.33x24.39 s
#3duckdb:parquet2.40x14.09 s
Geomean of query time ratio to fastest (lower is better)