Skip to content

perf: optimize iterative exe#7501

Draft
joseph-isaacs wants to merge 19 commits intodevelopfrom
ji/chunked-exe-faster
Draft

perf: optimize iterative exe#7501
joseph-isaacs wants to merge 19 commits intodevelopfrom
ji/chunked-exe-faster

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Apr 16, 2026

chunked...

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 16, 2026

Merging this PR will degrade performance by 34.88%

⚡ 7 improved benchmarks
❌ 46 regressed benchmarks
✅ 1110 untouched benchmarks
⏩ 808 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(10, 1000)] 955 µs 1,072.1 µs -10.93%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 100, 10)] 95.8 µs 133.7 µs -28.34%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 10, 100)] 703.9 µs 1,034.8 µs -31.98%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 1000, 10)] 114.3 µs 149.5 µs -23.52%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 10, 10)] 94.5 µs 131.8 µs -28.27%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 1000, 100)] 884.7 µs 1,213.5 µs -27.1%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 10, 10)] 121.8 µs 175.8 µs -30.74%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 100, 10)] 125.5 µs 179.6 µs -30.16%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 10, 100)] 961.8 µs 1,477 µs -34.88%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 100, 100)] 996 µs 1,512 µs -34.13%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 1000, 10)] 160 µs 212 µs -24.54%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 100, 100)] 719.2 µs 1,039.7 µs -30.83%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 10, 100)] 695.7 µs 1,023.1 µs -32.01%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 1000, 100)] 1.3 ms 1.8 ms -28.42%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 10, 10)] 115.8 µs 129.7 µs -10.76%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 1000, 10)] 111.2 µs 148.7 µs -25.23%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 100, 100)] 711.9 µs 1,050.8 µs -32.25%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 100, 10)] 95 µs 131.9 µs -28%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 1000, 100)] 874.8 µs 1,205.4 µs -27.43%
Simulation chunked_dict_primitive_into_canonical[u64, (1000, 10, 100)] 963.4 µs 1,477.1 µs -34.78%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/chunked-exe-faster (9fac461) with develop (f152281)

Open in CodSpeed

Footnotes

  1. 808 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/array/erased.rs
#	vortex-array/src/array/mod.rs
#	vortex-array/src/executor.rs
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the do not merge Pull requests that are not intended to merge label Apr 20, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/arrays/chunked/vtable/canonical.rs
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/arrays/scalar_fn/rules.rs
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 22, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9fac461 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.085x ➖


datafusion / vortex-file-compressed (1.085x ➖, 1↑ 3↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 121423975 120188414 1.01
polarsignals_q01/datafusion:vortex-file-compressed 🚨 369884044 268531054 1.38
polarsignals_q02/datafusion:vortex-file-compressed 25177597 23772525 1.06
polarsignals_q03/datafusion:vortex-file-compressed 🚨 394010990 251165106 1.57
polarsignals_q04/datafusion:vortex-file-compressed 11602527 12548434 0.92
polarsignals_q05/datafusion:vortex-file-compressed 15751018 16467461 0.96
polarsignals_q06/datafusion:vortex-file-compressed 18311799 19260872 0.95
polarsignals_q07/datafusion:vortex-file-compressed 13786411 13888537 0.99
polarsignals_q08/datafusion:vortex-file-compressed 🚨 455149592 348255745 1.31
polarsignals_q09/datafusion:vortex-file-compressed 🚀 10059043 11214817 0.90

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.3%
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.6%


datafusion / vortex-file-compressed (0.968x ➖, 2↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 3986541 5339579 0.75
fineweb_q01/datafusion:vortex-file-compressed 21011045 20540029 1.02
fineweb_q02/datafusion:vortex-file-compressed 22191552 23526405 0.94
fineweb_q03/datafusion:vortex-file-compressed 🚀 69271254 77276448 0.90
fineweb_q04/datafusion:vortex-file-compressed 231156722 230779870 1.00
fineweb_q05/datafusion:vortex-file-compressed 216940387 212396701 1.02
fineweb_q06/datafusion:vortex-file-compressed 52290354 52213689 1.00
fineweb_q07/datafusion:vortex-file-compressed 🚨 65603301 58615461 1.12
fineweb_q08/datafusion:vortex-file-compressed 21863242 21679243 1.01
datafusion / vortex-compact (1.250x ❌, 1↑ 7↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5013499 5893614 0.85
fineweb_q01/datafusion:vortex-compact 🚨 162551985 124818483 1.30
fineweb_q02/datafusion:vortex-compact 🚨 161885881 128193806 1.26
fineweb_q03/datafusion:vortex-compact 🚨 1491435299 1043536568 1.43
fineweb_q04/datafusion:vortex-compact 🚨 1593358121 1106354367 1.44
fineweb_q05/datafusion:vortex-compact 🚨 1246859001 945432423 1.32
fineweb_q06/datafusion:vortex-compact 🚨 693451010 514214946 1.35
fineweb_q07/datafusion:vortex-compact 🚨 733984876 534164467 1.37
fineweb_q08/datafusion:vortex-compact 18898092 17879515 1.06
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6892939 6809827 1.01
fineweb_q01/datafusion:parquet 282724409 282885324 1.00
fineweb_q02/datafusion:parquet 288747036 289504070 1.00
fineweb_q03/datafusion:parquet 294998325 277236734 1.06
fineweb_q04/datafusion:parquet 294586902 293782817 1.00
fineweb_q05/datafusion:parquet 294623164 292577587 1.01
fineweb_q06/datafusion:parquet 280619821 294862399 0.95
fineweb_q07/datafusion:parquet 282962785 278364738 1.02
fineweb_q08/datafusion:parquet 276395273 271928239 1.02
duckdb / vortex-file-compressed (0.982x ➖, 1↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3368173 3414763 0.99
fineweb_q01/duckdb:vortex-file-compressed 22745042 21919823 1.04
fineweb_q02/duckdb:vortex-file-compressed 23841981 23628749 1.01
fineweb_q03/duckdb:vortex-file-compressed 🚀 128867635 154576976 0.83
fineweb_q04/duckdb:vortex-file-compressed 220011648 224263743 0.98
fineweb_q05/duckdb:vortex-file-compressed 213374711 212127602 1.01
fineweb_q06/duckdb:vortex-file-compressed 51056800 52508470 0.97
fineweb_q07/duckdb:vortex-file-compressed 55034527 55506988 0.99
fineweb_q08/duckdb:vortex-file-compressed 22731749 21936810 1.04
duckdb / vortex-compact (0.982x ➖, 1↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3919045 3963090 0.99
fineweb_q01/duckdb:vortex-compact 🚨 114047351 103662029 1.10
fineweb_q02/duckdb:vortex-compact 109513478 111576185 0.98
fineweb_q03/duckdb:vortex-compact 862204423 851179536 1.01
fineweb_q04/duckdb:vortex-compact 914619742 899409809 1.02
fineweb_q05/duckdb:vortex-compact 805372490 814135630 0.99
fineweb_q06/duckdb:vortex-compact 452948971 458955108 0.99
fineweb_q07/duckdb:vortex-compact 467853765 464924177 1.01
fineweb_q08/duckdb:vortex-compact 🚀 19044384 24320671 0.78
duckdb / parquet (1.004x ➖, 0↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 26786203 28748792 0.93
fineweb_q01/duckdb:parquet 82238589 83757471 0.98
fineweb_q02/duckdb:parquet 82694980 84055163 0.98
fineweb_q03/duckdb:parquet 307570525 307338750 1.00
fineweb_q04/duckdb:parquet 438892969 437282720 1.00
fineweb_q05/duckdb:parquet 408823584 407444909 1.00
fineweb_q06/duckdb:parquet 197167553 196918606 1.00
fineweb_q07/duckdb:parquet 208959038 208309227 1.00
fineweb_q08/duckdb:parquet 🚨 32467882 28461435 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -14.9% -2.9% -12.4% +50.0% ➖ noise
0 datafusion:vortex-file-compressed -25.3% -2.9% -23.1% +50.3% ➖ noise
0 duckdb:vortex-compact -1.1% -2.9% +1.8% +80.8% ➖ noise
0 duckdb:vortex-file-compressed -1.4% -2.9% +1.6% +80.8% ➖ noise
1 datafusion:vortex-compact +30.2% -0.9% +31.5% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed +2.3% -0.9% +3.3% +36.1% ➖ noise
1 duckdb:vortex-compact +10.0% -0.9% +11.1% +20.1% ➖ noise
1 duckdb:vortex-file-compressed +3.8% -0.9% +4.7% +66.4% ➖ noise
2 datafusion:vortex-compact +26.3% -0.9% +27.5% +10.0% 🚨 regression
2 datafusion:vortex-file-compressed -5.7% -0.9% -4.8% +11.9% ➖ noise
2 duckdb:vortex-compact -1.8% -0.9% -0.9% +10.9% ➖ noise
2 duckdb:vortex-file-compressed +0.9% -0.9% +1.9% +13.6% ➖ noise
3 datafusion:vortex-compact +42.9% +3.2% +38.5% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed -10.4% +3.2% -13.1% +37.4% ➖ noise
3 duckdb:vortex-compact +1.3% +3.2% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -16.6% +3.2% -19.2% +30.4% ➖ noise
4 datafusion:vortex-compact +44.0% +0.3% +43.6% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +0.2% +0.3% -0.2% +10.9% ➖ noise
4 duckdb:vortex-compact +1.7% +0.3% +1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.9% +0.3% -2.2% +10.0% ➖ noise
5 datafusion:vortex-compact +31.9% +0.5% +31.2% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed +2.1% +0.5% +1.6% +10.0% ➖ noise
5 duckdb:vortex-compact -1.1% +0.5% -1.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.6% +0.5% +0.1% +10.1% ➖ noise
6 datafusion:vortex-compact +34.9% -2.4% +38.1% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +0.1% -2.4% +2.6% +10.0% ➖ noise
6 duckdb:vortex-compact -1.3% -2.4% +1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.8% -2.4% -0.4% +10.0% ➖ noise
7 datafusion:vortex-compact +37.4% +1.0% +36.1% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +11.9% +1.0% +10.8% +32.6% ➖ noise
7 duckdb:vortex-compact +0.6% +1.0% -0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.9% +1.0% -1.8% +12.5% ➖ noise
8 datafusion:vortex-compact +5.7% +7.7% -1.8% +17.2% ➖ noise
8 datafusion:vortex-file-compressed +0.8% +7.7% -6.3% +15.8% ➖ noise
8 duckdb:vortex-compact -21.7% +7.7% -27.3% +36.1% ✅ faster
8 duckdb:vortex-file-compressed +3.6% +7.7% -3.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.6%
Vortex (geomean): 0.973x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.7%


datafusion / vortex-file-compressed (0.931x ➖, 5↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 46964032 49979341 0.94
tpch_q02/datafusion:vortex-file-compressed 27610607 28062717 0.98
tpch_q03/datafusion:vortex-file-compressed 🚀 25965044 28867540 0.90
tpch_q04/datafusion:vortex-file-compressed 🚀 18417340 21316412 0.86
tpch_q05/datafusion:vortex-file-compressed 48098586 49472877 0.97
tpch_q06/datafusion:vortex-file-compressed 🚀 10865566 13363544 0.81
tpch_q07/datafusion:vortex-file-compressed 59135306 60960859 0.97
tpch_q08/datafusion:vortex-file-compressed 38798635 41447250 0.94
tpch_q09/datafusion:vortex-file-compressed 52507072 54612656 0.96
tpch_q10/datafusion:vortex-file-compressed 41279234 44247180 0.93
tpch_q11/datafusion:vortex-file-compressed 15354757 16012507 0.96
tpch_q12/datafusion:vortex-file-compressed 24336386 26556345 0.92
tpch_q13/datafusion:vortex-file-compressed 25850502 25650363 1.01
tpch_q14/datafusion:vortex-file-compressed 🚀 15008288 17259873 0.87
tpch_q15/datafusion:vortex-file-compressed 🚀 23105450 27366368 0.84
tpch_q16/datafusion:vortex-file-compressed 20775930 21128223 0.98
tpch_q17/datafusion:vortex-file-compressed 62496059 67731111 0.92
tpch_q18/datafusion:vortex-file-compressed 76956230 79834003 0.96
tpch_q19/datafusion:vortex-file-compressed 23660171 24995810 0.95
tpch_q20/datafusion:vortex-file-compressed 29272511 30579456 0.96
tpch_q21/datafusion:vortex-file-compressed 68668330 75429461 0.91
tpch_q22/datafusion:vortex-file-compressed 13719880 14430616 0.95
datafusion / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58696919 58580814 1.00
tpch_q02/datafusion:vortex-compact 31609607 31709997 1.00
tpch_q03/datafusion:vortex-compact 28562784 31735190 0.90
tpch_q04/datafusion:vortex-compact 23082212 24760494 0.93
tpch_q05/datafusion:vortex-compact 52441635 52839313 0.99
tpch_q06/datafusion:vortex-compact 13907149 15119871 0.92
tpch_q07/datafusion:vortex-compact 64972029 66463523 0.98
tpch_q08/datafusion:vortex-compact 45487548 46229186 0.98
tpch_q09/datafusion:vortex-compact 58735397 60227692 0.98
tpch_q10/datafusion:vortex-compact 49032729 49916420 0.98
tpch_q11/datafusion:vortex-compact 17518510 17034832 1.03
tpch_q12/datafusion:vortex-compact 33741740 33243719 1.01
tpch_q13/datafusion:vortex-compact 34427233 31716935 1.09
tpch_q14/datafusion:vortex-compact 20271231 20400249 0.99
tpch_q15/datafusion:vortex-compact 33587562 33015381 1.02
tpch_q16/datafusion:vortex-compact 24813606 24803441 1.00
tpch_q17/datafusion:vortex-compact 67217330 70346168 0.96
tpch_q18/datafusion:vortex-compact 82748375 85972495 0.96
tpch_q19/datafusion:vortex-compact 33617322 31732599 1.06
tpch_q20/datafusion:vortex-compact 36174730 35136541 1.03
tpch_q21/datafusion:vortex-compact 80196268 82628729 0.97
tpch_q22/datafusion:vortex-compact 14546709 15331292 0.95
datafusion / parquet (1.009x ➖, 0↑ 2↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 134731278 106632839 1.26
tpch_q02/datafusion:parquet 62863691 62788182 1.00
tpch_q03/datafusion:parquet 73444699 74004704 0.99
tpch_q04/datafusion:parquet 44902220 45992323 0.98
tpch_q05/datafusion:parquet 93099166 95334749 0.98
tpch_q06/datafusion:parquet 41004811 40964580 1.00
tpch_q07/datafusion:parquet 104945585 104782789 1.00
tpch_q08/datafusion:parquet 97645349 99485382 0.98
tpch_q09/datafusion:parquet 129193327 130284912 0.99
tpch_q10/datafusion:parquet 109146026 111285118 0.98
tpch_q11/datafusion:parquet 41378170 41437373 1.00
tpch_q12/datafusion:parquet 88370036 90322967 0.98
tpch_q13/datafusion:parquet 186445991 187906734 0.99
tpch_q14/datafusion:parquet 46571843 50449850 0.92
tpch_q15/datafusion:parquet 59059548 60838780 0.97
tpch_q16/datafusion:parquet 43772010 43767970 1.00
tpch_q17/datafusion:parquet 131674945 127411747 1.03
tpch_q18/datafusion:parquet 160502971 156287068 1.03
tpch_q19/datafusion:parquet 🚨 81321355 70527198 1.15
tpch_q20/datafusion:parquet 70373819 70645653 1.00
tpch_q21/datafusion:parquet 136060945 135815081 1.00
tpch_q22/datafusion:parquet 30946746 31128399 0.99
datafusion / arrow (0.992x ➖, 1↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 55007202 52927415 1.04
tpch_q02/datafusion:arrow 17622931 18642898 0.95
tpch_q03/datafusion:arrow 29114786 29437669 0.99
tpch_q04/datafusion:arrow 25606103 25165171 1.02
tpch_q05/datafusion:arrow 🚨 81444761 73062565 1.11
tpch_q06/datafusion:arrow 20512213 19636665 1.04
tpch_q07/datafusion:arrow 98035319 99346972 0.99
tpch_q08/datafusion:arrow 41144503 40220830 1.02
tpch_q09/datafusion:arrow 🚀 61179858 68156740 0.90
tpch_q10/datafusion:arrow 45061495 48819419 0.92
tpch_q11/datafusion:arrow 8548078 8966757 0.95
tpch_q12/datafusion:arrow 51112076 50533983 1.01
tpch_q13/datafusion:arrow 47825309 47147369 1.01
tpch_q14/datafusion:arrow 21143807 21477715 0.98
tpch_q15/datafusion:arrow 42458048 41370599 1.03
tpch_q16/datafusion:arrow 18611813 18729331 0.99
tpch_q17/datafusion:arrow 66263264 66666612 0.99
tpch_q18/datafusion:arrow 131533257 132470500 0.99
tpch_q19/datafusion:arrow 35646290 36913196 0.97
tpch_q20/datafusion:arrow 33342696 34649483 0.96
tpch_q21/datafusion:arrow 146135618 148001225 0.99
tpch_q22/datafusion:arrow 17080719 17489270 0.98
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31203076 31314996 1.00
tpch_q02/duckdb:vortex-file-compressed 24561691 25002672 0.98
tpch_q03/duckdb:vortex-file-compressed 29018464 29607208 0.98
tpch_q04/duckdb:vortex-file-compressed 29337357 30087128 0.98
tpch_q05/duckdb:vortex-file-compressed 32395188 33376426 0.97
tpch_q06/duckdb:vortex-file-compressed 10462294 10724127 0.98
tpch_q07/duckdb:vortex-file-compressed 35410617 37534577 0.94
tpch_q08/duckdb:vortex-file-compressed 38480675 39404630 0.98
tpch_q09/duckdb:vortex-file-compressed 71785388 70279665 1.02
tpch_q10/duckdb:vortex-file-compressed 34736641 34581245 1.00
tpch_q11/duckdb:vortex-file-compressed 14527336 14634434 0.99
tpch_q12/duckdb:vortex-file-compressed 21600821 22104216 0.98
tpch_q13/duckdb:vortex-file-compressed 34529737 35224501 0.98
tpch_q14/duckdb:vortex-file-compressed 20711171 21139118 0.98
tpch_q15/duckdb:vortex-file-compressed 16604985 16454700 1.01
tpch_q16/duckdb:vortex-file-compressed 28335978 28214723 1.00
tpch_q17/duckdb:vortex-file-compressed 25001993 25283367 0.99
tpch_q18/duckdb:vortex-file-compressed 49169887 50936484 0.97
tpch_q19/duckdb:vortex-file-compressed 28937780 29714713 0.97
tpch_q20/duckdb:vortex-file-compressed 33875444 33658792 1.01
tpch_q21/duckdb:vortex-file-compressed 103813487 106521780 0.97
tpch_q22/duckdb:vortex-file-compressed 16853446 16823649 1.00
duckdb / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38340702 38536938 0.99
tpch_q02/duckdb:vortex-compact 34785196 35149211 0.99
tpch_q03/duckdb:vortex-compact 32024122 32469028 0.99
tpch_q04/duckdb:vortex-compact 34467661 34224983 1.01
tpch_q05/duckdb:vortex-compact 37471300 37389334 1.00
tpch_q06/duckdb:vortex-compact 15734095 15225756 1.03
tpch_q07/duckdb:vortex-compact 42177583 42205764 1.00
tpch_q08/duckdb:vortex-compact 44678736 46314325 0.96
tpch_q09/duckdb:vortex-compact 84393428 83157526 1.01
tpch_q10/duckdb:vortex-compact 38578668 39659695 0.97
tpch_q11/duckdb:vortex-compact 19392116 19680309 0.99
tpch_q12/duckdb:vortex-compact 34999818 35157800 1.00
tpch_q13/duckdb:vortex-compact 44323084 44343228 1.00
tpch_q14/duckdb:vortex-compact 29019789 29762095 0.98
tpch_q15/duckdb:vortex-compact 19198909 19644787 0.98
tpch_q16/duckdb:vortex-compact 34558075 35082448 0.99
tpch_q17/duckdb:vortex-compact 29942572 30651488 0.98
tpch_q18/duckdb:vortex-compact 49750467 51577798 0.96
tpch_q19/duckdb:vortex-compact 34543364 34451934 1.00
tpch_q20/duckdb:vortex-compact 42082481 43065992 0.98
tpch_q21/duckdb:vortex-compact 110363469 109235994 1.01
tpch_q22/duckdb:vortex-compact 19395976 19913073 0.97
duckdb / parquet (1.006x ➖, 1↑ 3↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 85941153 81527173 1.05
tpch_q02/duckdb:parquet 38448454 38582243 1.00
tpch_q03/duckdb:parquet 69440930 68708592 1.01
tpch_q04/duckdb:parquet 46277686 46783720 0.99
tpch_q05/duckdb:parquet 66045537 65959349 1.00
tpch_q06/duckdb:parquet 20213013 19855745 1.02
tpch_q07/duckdb:parquet 🚨 80022815 68420383 1.17
tpch_q08/duckdb:parquet 78711102 79838491 0.99
tpch_q09/duckdb:parquet 🚀 130615886 154387186 0.85
tpch_q10/duckdb:parquet 114802343 114165645 1.01
tpch_q11/duckdb:parquet 22176567 22315685 0.99
tpch_q12/duckdb:parquet 🚨 50130647 45544389 1.10
tpch_q13/duckdb:parquet 247111447 247753514 1.00
tpch_q14/duckdb:parquet 47930650 52274907 0.92
tpch_q15/duckdb:parquet 🚨 27952422 25104633 1.11
tpch_q16/duckdb:parquet 54431280 55494603 0.98
tpch_q17/duckdb:parquet 52654053 55555644 0.95
tpch_q18/duckdb:parquet 113766608 110781512 1.03
tpch_q19/duckdb:parquet 64535752 65192353 0.99
tpch_q20/duckdb:parquet 63333764 63363355 1.00
tpch_q21/duckdb:parquet 168364896 164298785 1.02
tpch_q22/duckdb:parquet 51245536 51000658 1.00
duckdb / duckdb (1.005x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15769842 15909584 0.99
tpch_q02/duckdb:duckdb 13026047 12275317 1.06
tpch_q03/duckdb:duckdb 18972299 18717461 1.01
tpch_q04/duckdb:duckdb 19115769 19163291 1.00
tpch_q05/duckdb:duckdb 19466613 20111975 0.97
tpch_q06/duckdb:duckdb 5196267 5238535 0.99
tpch_q07/duckdb:duckdb 22009686 21034338 1.05
tpch_q08/duckdb:duckdb 20552220 20376086 1.01
tpch_q09/duckdb:duckdb 54754250 54142237 1.01
tpch_q10/duckdb:duckdb 42744661 43697329 0.98
tpch_q11/duckdb:duckdb 5738782 5639865 1.02
tpch_q12/duckdb:duckdb 13695685 13806804 0.99
tpch_q13/duckdb:duckdb 38759935 36987096 1.05
tpch_q14/duckdb:duckdb 17281662 17366633 1.00
tpch_q15/duckdb:duckdb 11752474 11715916 1.00
tpch_q16/duckdb:duckdb 23437487 23991915 0.98
tpch_q17/duckdb:duckdb 13536348 13474493 1.00
tpch_q18/duckdb:duckdb 38581832 38770628 1.00
tpch_q19/duckdb:duckdb 27466795 26903984 1.02
tpch_q20/duckdb:duckdb 22374026 22487982 0.99
tpch_q21/duckdb:duckdb 56121856 55688087 1.01
tpch_q22/duckdb:duckdb 23906625 24303904 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.9% +15.4% -9.9% +20.7% ➖ noise
1 datafusion:vortex-compact +0.2% +15.4% -13.2% +17.6% ➖ noise
1 datafusion:vortex-file-compressed -6.0% +15.4% -18.6% +18.2% ✅ faster
1 duckdb:duckdb -0.9% +15.4% -14.1% +18.0% ➖ noise
1 duckdb:vortex-compact -0.5% +15.4% -13.8% +17.6% ➖ noise
1 duckdb:vortex-file-compressed -0.4% +15.4% -13.7% +20.0% ➖ noise
2 datafusion:arrow -5.5% -0.1% -5.4% +13.3% ➖ noise
2 datafusion:vortex-compact -0.3% -0.1% -0.2% +13.3% ➖ noise
2 datafusion:vortex-file-compressed -1.6% -0.1% -1.5% +13.3% ➖ noise
2 duckdb:duckdb +6.1% -0.1% +6.2% +13.3% ➖ noise
2 duckdb:vortex-compact -1.0% -0.1% -0.9% +13.3% ➖ noise
2 duckdb:vortex-file-compressed -1.8% -0.1% -1.7% +13.3% ➖ noise
3 datafusion:arrow -1.1% +0.2% -1.2% +13.3% ➖ noise
3 datafusion:vortex-compact -10.0% +0.2% -10.1% +13.3% ➖ noise
3 datafusion:vortex-file-compressed -10.1% +0.2% -10.2% +13.3% ➖ noise
3 duckdb:duckdb +1.4% +0.2% +1.2% +13.3% ➖ noise
3 duckdb:vortex-compact -1.4% +0.2% -1.5% +13.3% ➖ noise
3 duckdb:vortex-file-compressed -2.0% +0.2% -2.1% +14.8% ➖ noise
4 datafusion:arrow +1.8% -1.7% +3.5% +13.3% ➖ noise
4 datafusion:vortex-compact -6.8% -1.7% -5.1% +13.3% ➖ noise
4 datafusion:vortex-file-compressed -13.6% -1.7% -12.1% +13.3% ✅ faster
4 duckdb:duckdb -0.2% -1.7% +1.5% +13.3% ➖ noise
4 duckdb:vortex-compact +0.7% -1.7% +2.5% +13.3% ➖ noise
4 duckdb:vortex-file-compressed -2.5% -1.7% -0.8% +13.3% ➖ noise
5 datafusion:arrow +11.5% -1.1% +12.7% +13.3% ➖ noise
5 datafusion:vortex-compact -0.8% -1.1% +0.4% +13.3% ➖ noise
5 datafusion:vortex-file-compressed -2.8% -1.1% -1.7% +13.3% ➖ noise
5 duckdb:duckdb -3.2% -1.1% -2.1% +13.3% ➖ noise
5 duckdb:vortex-compact +0.2% -1.1% +1.3% +13.3% ➖ noise
5 duckdb:vortex-file-compressed -2.9% -1.1% -1.8% +13.3% ➖ noise
6 datafusion:arrow +4.5% +0.9% +3.5% +13.3% ➖ noise
6 datafusion:vortex-compact -8.0% +0.9% -8.9% +15.0% ➖ noise
6 datafusion:vortex-file-compressed -18.7% +0.9% -19.5% +14.3% ✅ faster
6 duckdb:duckdb -0.8% +0.9% -1.7% +15.3% ➖ noise
6 duckdb:vortex-compact +3.3% +0.9% +2.4% +16.8% ➖ noise
6 duckdb:vortex-file-compressed -2.4% +0.9% -3.4% +15.9% ➖ noise
7 datafusion:arrow -1.3% +8.2% -8.8% +13.3% ➖ noise
7 datafusion:vortex-compact -2.2% +8.2% -9.7% +13.3% ➖ noise
7 datafusion:vortex-file-compressed -3.0% +8.2% -10.4% +13.3% ➖ noise
7 duckdb:duckdb +4.6% +8.2% -3.3% +13.3% ➖ noise
7 duckdb:vortex-compact -0.1% +8.2% -7.7% +13.3% ➖ noise
7 duckdb:vortex-file-compressed -5.7% +8.2% -12.8% +13.3% ✅ faster
8 datafusion:arrow +2.3% -1.6% +4.0% +13.3% ➖ noise
8 datafusion:vortex-compact -1.6% -1.6% +0.0% +13.3% ➖ noise
8 datafusion:vortex-file-compressed -6.4% -1.6% -4.8% +13.3% ➖ noise
8 duckdb:duckdb +0.9% -1.6% +2.5% +13.3% ➖ noise
8 duckdb:vortex-compact -3.5% -1.6% -1.9% +13.3% ➖ noise
8 duckdb:vortex-file-compressed -2.3% -1.6% -0.7% +13.3% ➖ noise
9 datafusion:arrow -10.2% -8.4% -2.0% +13.3% ➖ noise
9 datafusion:vortex-compact -2.5% -8.4% +6.5% +13.3% ➖ noise
9 datafusion:vortex-file-compressed -3.9% -8.4% +5.0% +13.3% ➖ noise
9 duckdb:duckdb +1.1% -8.4% +10.4% +13.3% ➖ noise
9 duckdb:vortex-compact +1.5% -8.4% +10.8% +13.3% ➖ noise
9 duckdb:vortex-file-compressed +2.1% -8.4% +11.5% +13.3% ➖ noise
10 datafusion:arrow -7.7% -0.7% -7.1% +13.3% ➖ noise
10 datafusion:vortex-compact -1.8% -0.7% -1.1% +13.3% ➖ noise
10 datafusion:vortex-file-compressed -6.7% -0.7% -6.1% +13.3% ➖ noise
10 duckdb:duckdb -2.2% -0.7% -1.5% +13.3% ➖ noise
10 duckdb:vortex-compact -2.7% -0.7% -2.0% +13.3% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -0.7% +1.1% +13.3% ➖ noise
11 datafusion:arrow -4.7% -0.4% -4.3% +13.3% ➖ noise
11 datafusion:vortex-compact +2.8% -0.4% +3.2% +13.3% ➖ noise
11 datafusion:vortex-file-compressed -4.1% -0.4% -3.7% +13.3% ➖ noise
11 duckdb:duckdb +1.8% -0.4% +2.1% +13.3% ➖ noise
11 duckdb:vortex-compact -1.5% -0.4% -1.1% +13.3% ➖ noise
11 duckdb:vortex-file-compressed -0.7% -0.4% -0.3% +13.3% ➖ noise
12 datafusion:arrow +1.1% +3.8% -2.5% +20.0% ➖ noise
12 datafusion:vortex-compact +1.5% +3.8% -2.2% +13.3% ➖ noise
12 datafusion:vortex-file-compressed -8.4% +3.8% -11.7% +13.3% ➖ noise
12 duckdb:duckdb -0.8% +3.8% -4.4% +13.3% ➖ noise
12 duckdb:vortex-compact -0.4% +3.8% -4.1% +13.3% ➖ noise
12 duckdb:vortex-file-compressed -2.3% +3.8% -5.8% +13.3% ➖ noise
13 datafusion:arrow +1.4% -0.5% +2.0% +13.3% ➖ noise
13 datafusion:vortex-compact +8.5% -0.5% +9.1% +13.3% ➖ noise
13 datafusion:vortex-file-compressed +0.8% -0.5% +1.3% +13.3% ➖ noise
13 duckdb:duckdb +4.8% -0.5% +5.3% +13.3% ➖ noise
13 duckdb:vortex-compact -0.0% -0.5% +0.5% +13.3% ➖ noise
13 duckdb:vortex-file-compressed -2.0% -0.5% -1.5% +13.3% ➖ noise
14 datafusion:arrow -1.6% -8.0% +7.0% +29.0% ➖ noise
14 datafusion:vortex-compact -0.6% -8.0% +8.0% +13.3% ➖ noise
14 datafusion:vortex-file-compressed -13.0% -8.0% -5.5% +13.3% ➖ noise
14 duckdb:duckdb -0.5% -8.0% +8.2% +16.7% ➖ noise
14 duckdb:vortex-compact -2.5% -8.0% +6.0% +13.3% ➖ noise
14 duckdb:vortex-file-compressed -2.0% -8.0% +6.5% +13.3% ➖ noise
15 datafusion:arrow +2.6% +4.0% -1.3% +13.3% ➖ noise
15 datafusion:vortex-compact +1.7% +4.0% -2.1% +13.3% ➖ noise
15 datafusion:vortex-file-compressed -15.6% +4.0% -18.8% +13.5% ✅ faster
15 duckdb:duckdb +0.3% +4.0% -3.5% +13.3% ➖ noise
15 duckdb:vortex-compact -2.3% +4.0% -6.0% +13.7% ➖ noise
15 duckdb:vortex-file-compressed +0.9% +4.0% -2.9% +13.3% ➖ noise
16 datafusion:arrow -0.6% -1.0% +0.3% +13.3% ➖ noise
16 datafusion:vortex-compact +0.0% -1.0% +1.0% +13.3% ➖ noise
16 datafusion:vortex-file-compressed -1.7% -1.0% -0.7% +13.3% ➖ noise
16 duckdb:duckdb -2.3% -1.0% -1.4% +13.3% ➖ noise
16 duckdb:vortex-compact -1.5% -1.0% -0.5% +13.3% ➖ noise
16 duckdb:vortex-file-compressed +0.4% -1.0% +1.4% +13.3% ➖ noise
17 datafusion:arrow -0.6% -1.0% +0.4% +13.3% ➖ noise
17 datafusion:vortex-compact -4.4% -1.0% -3.5% +13.3% ➖ noise
17 datafusion:vortex-file-compressed -7.7% -1.0% -6.8% +13.3% ➖ noise
17 duckdb:duckdb +0.5% -1.0% +1.5% +15.7% ➖ noise
17 duckdb:vortex-compact -2.3% -1.0% -1.3% +13.3% ➖ noise
17 duckdb:vortex-file-compressed -1.1% -1.0% -0.1% +13.3% ➖ noise
18 datafusion:arrow -0.7% +2.7% -3.3% +13.3% ➖ noise
18 datafusion:vortex-compact -3.8% +2.7% -6.3% +13.3% ➖ noise
18 datafusion:vortex-file-compressed -3.6% +2.7% -6.1% +13.3% ➖ noise
18 duckdb:duckdb -0.5% +2.7% -3.1% +13.3% ➖ noise
18 duckdb:vortex-compact -3.5% +2.7% -6.1% +13.3% ➖ noise
18 duckdb:vortex-file-compressed -3.5% +2.7% -6.0% +13.3% ➖ noise
19 datafusion:arrow -3.4% +6.8% -9.6% +14.1% ➖ noise
19 datafusion:vortex-compact +5.9% +6.8% -0.8% +13.3% ➖ noise
19 datafusion:vortex-file-compressed -5.3% +6.8% -11.4% +13.3% ➖ noise
19 duckdb:duckdb +2.1% +6.8% -4.4% +13.7% ➖ noise
19 duckdb:vortex-compact +0.3% +6.8% -6.2% +13.3% ➖ noise
19 duckdb:vortex-file-compressed -2.6% +6.8% -8.8% +13.3% ➖ noise
20 datafusion:arrow -3.8% -0.2% -3.6% +13.3% ➖ noise
20 datafusion:vortex-compact +3.0% -0.2% +3.2% +13.3% ➖ noise
20 datafusion:vortex-file-compressed -4.3% -0.2% -4.1% +13.3% ➖ noise
20 duckdb:duckdb -0.5% -0.2% -0.3% +13.3% ➖ noise
20 duckdb:vortex-compact -2.3% -0.2% -2.1% +13.3% ➖ noise
20 duckdb:vortex-file-compressed +0.6% -0.2% +0.9% +13.3% ➖ noise
21 datafusion:arrow -1.3% +1.3% -2.5% +13.3% ➖ noise
21 datafusion:vortex-compact -2.9% +1.3% -4.2% +13.3% ➖ noise
21 datafusion:vortex-file-compressed -9.0% +1.3% -10.2% +13.3% ➖ noise
21 duckdb:duckdb +0.8% +1.3% -0.5% +13.3% ➖ noise
21 duckdb:vortex-compact +1.0% +1.3% -0.3% +13.3% ➖ noise
21 duckdb:vortex-file-compressed -2.5% +1.3% -3.8% +13.3% ➖ noise
22 datafusion:arrow -2.3% -0.1% -2.3% +13.3% ➖ noise
22 datafusion:vortex-compact -5.1% -0.1% -5.1% +13.3% ➖ noise
22 datafusion:vortex-file-compressed -4.9% -0.1% -4.9% +13.3% ➖ noise
22 duckdb:duckdb -1.6% -0.1% -1.6% +13.3% ➖ noise
22 duckdb:vortex-compact -2.6% -0.1% -2.5% +13.3% ➖ noise
22 duckdb:vortex-file-compressed +0.2% -0.1% +0.2% +13.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +1.0%


datafusion / vortex-file-compressed (0.936x ➖, 23↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 20318739 27107815 0.75
tpcds_q02/datafusion:vortex-file-compressed 49774001 49581921 1.00
tpcds_q03/datafusion:vortex-file-compressed 17299443 18214880 0.95
tpcds_q04/datafusion:vortex-file-compressed 272297807 278564120 0.98
tpcds_q05/datafusion:vortex-file-compressed 44583970 44545204 1.00
tpcds_q06/datafusion:vortex-file-compressed 41832745 44560986 0.94
tpcds_q07/datafusion:vortex-file-compressed 44357394 46596729 0.95
tpcds_q08/datafusion:vortex-file-compressed 29378984 31574250 0.93
tpcds_q09/datafusion:vortex-file-compressed 46761324 46896556 1.00
tpcds_q10/datafusion:vortex-file-compressed 🚀 36532802 41298085 0.88
tpcds_q11/datafusion:vortex-file-compressed 153010785 154665346 0.99
tpcds_q12/datafusion:vortex-file-compressed 🚀 19639276 22132761 0.89
tpcds_q13/datafusion:vortex-file-compressed 47964416 47865053 1.00
tpcds_q14/datafusion:vortex-file-compressed 171353935 179567475 0.95
tpcds_q15/datafusion:vortex-file-compressed 30128649 31482502 0.96
tpcds_q16/datafusion:vortex-file-compressed 🚀 25120268 31622625 0.79
tpcds_q17/datafusion:vortex-file-compressed 60752931 66311334 0.92
tpcds_q18/datafusion:vortex-file-compressed 68645326 73315298 0.94
tpcds_q19/datafusion:vortex-file-compressed 24406852 26511900 0.92
tpcds_q20/datafusion:vortex-file-compressed 22004993 23563838 0.93
tpcds_q21/datafusion:vortex-file-compressed 129239024 128631571 1.00
tpcds_q22/datafusion:vortex-file-compressed 55598850 58386911 0.95
tpcds_q23/datafusion:vortex-file-compressed 132289618 133776075 0.99
tpcds_q24/datafusion:vortex-file-compressed 100936316 103438327 0.98
tpcds_q25/datafusion:vortex-file-compressed 61122716 67871651 0.90
tpcds_q26/datafusion:vortex-file-compressed 🚀 33471950 37503988 0.89
tpcds_q27/datafusion:vortex-file-compressed 106439253 103148517 1.03
tpcds_q28/datafusion:vortex-file-compressed 44094017 41985564 1.05
tpcds_q29/datafusion:vortex-file-compressed 🚀 62191802 69148090 0.90
tpcds_q30/datafusion:vortex-file-compressed 24124992 23793540 1.01
tpcds_q31/datafusion:vortex-file-compressed 81017944 89204542 0.91
tpcds_q32/datafusion:vortex-file-compressed 🚀 18092487 21758397 0.83
tpcds_q33/datafusion:vortex-file-compressed 29158681 31233397 0.93
tpcds_q34/datafusion:vortex-file-compressed 27421171 29212387 0.94
tpcds_q35/datafusion:vortex-file-compressed 🚀 44390437 51063392 0.87
tpcds_q36/datafusion:vortex-file-compressed 64507441 65984188 0.98
tpcds_q37/datafusion:vortex-file-compressed 30264901 30655094 0.99
tpcds_q38/datafusion:vortex-file-compressed 🚀 45480116 52011129 0.87
tpcds_q39/datafusion:vortex-file-compressed 🚀 124302693 139566777 0.89
tpcds_q40/datafusion:vortex-file-compressed 47648048 49830705 0.96
tpcds_q41/datafusion:vortex-file-compressed 16433730 17688491 0.93
tpcds_q42/datafusion:vortex-file-compressed 🚀 15258587 17078340 0.89
tpcds_q43/datafusion:vortex-file-compressed 29078831 29950895 0.97
tpcds_q44/datafusion:vortex-file-compressed 🚀 33864739 37960957 0.89
tpcds_q45/datafusion:vortex-file-compressed 30114351 32667352 0.92
tpcds_q46/datafusion:vortex-file-compressed 39982107 43181549 0.93
tpcds_q47/datafusion:vortex-file-compressed 190685902 194402803 0.98
tpcds_q48/datafusion:vortex-file-compressed 40553560 41232336 0.98
tpcds_q49/datafusion:vortex-file-compressed 59341804 60807585 0.98
tpcds_q50/datafusion:vortex-file-compressed 39441039 43221712 0.91
tpcds_q51/datafusion:vortex-file-compressed 86766387 93195278 0.93
tpcds_q52/datafusion:vortex-file-compressed 🚀 15339430 18631976 0.82
tpcds_q53/datafusion:vortex-file-compressed 🚀 20271956 22786851 0.89
tpcds_q54/datafusion:vortex-file-compressed 34985338 38781226 0.90
tpcds_q55/datafusion:vortex-file-compressed 14827168 16275598 0.91
tpcds_q56/datafusion:vortex-file-compressed 30566276 33068423 0.92
tpcds_q57/datafusion:vortex-file-compressed 117046901 121904010 0.96
tpcds_q58/datafusion:vortex-file-compressed 62121791 65874115 0.94
tpcds_q59/datafusion:vortex-file-compressed 64869630 68311626 0.95
tpcds_q60/datafusion:vortex-file-compressed 31485686 33764450 0.93
tpcds_q61/datafusion:vortex-file-compressed 39657781 43679898 0.91
tpcds_q62/datafusion:vortex-file-compressed 28601828 29930319 0.96
tpcds_q63/datafusion:vortex-file-compressed 🚀 20175718 22653306 0.89
tpcds_q64/datafusion:vortex-file-compressed 428005307 439673639 0.97
tpcds_q65/datafusion:vortex-file-compressed 🚀 40717743 45386021 0.90
tpcds_q66/datafusion:vortex-file-compressed 83752387 84041555 1.00
tpcds_q67/datafusion:vortex-file-compressed 109951255 113381230 0.97
tpcds_q68/datafusion:vortex-file-compressed 39129780 40668475 0.96
tpcds_q69/datafusion:vortex-file-compressed 🚀 34183999 38654637 0.88
tpcds_q70/datafusion:vortex-file-compressed 103230792 103942288 0.99
tpcds_q71/datafusion:vortex-file-compressed 26103490 26448610 0.99
tpcds_q72/datafusion:vortex-file-compressed 2447013001 2401972500 1.02
tpcds_q73/datafusion:vortex-file-compressed 26536673 27391151 0.97
tpcds_q74/datafusion:vortex-file-compressed 103834059 103551481 1.00
tpcds_q75/datafusion:vortex-file-compressed 112851014 111820273 1.01
tpcds_q76/datafusion:vortex-file-compressed 27704915 27880216 0.99
tpcds_q77/datafusion:vortex-file-compressed 40058825 42314750 0.95
tpcds_q78/datafusion:vortex-file-compressed 117266587 127452399 0.92
tpcds_q79/datafusion:vortex-file-compressed 31871676 34615782 0.92
tpcds_q80/datafusion:vortex-file-compressed 97811336 97347192 1.00
tpcds_q81/datafusion:vortex-file-compressed 29894861 28624493 1.04
tpcds_q82/datafusion:vortex-file-compressed 31967964 32159551 0.99
tpcds_q83/datafusion:vortex-file-compressed 39786094 44064126 0.90
tpcds_q84/datafusion:vortex-file-compressed 12392067 13533599 0.92
tpcds_q85/datafusion:vortex-file-compressed 87862465 93215746 0.94
tpcds_q86/datafusion:vortex-file-compressed 16884917 18428444 0.92
tpcds_q87/datafusion:vortex-file-compressed 🚀 45677387 51506753 0.89
tpcds_q88/datafusion:vortex-file-compressed 57167431 60337938 0.95
tpcds_q89/datafusion:vortex-file-compressed 32504885 33534178 0.97
tpcds_q90/datafusion:vortex-file-compressed 14122466 15234266 0.93
tpcds_q91/datafusion:vortex-file-compressed 21424476 22178610 0.97
tpcds_q92/datafusion:vortex-file-compressed 🚀 16442099 20947235 0.78
tpcds_q93/datafusion:vortex-file-compressed 🚀 30052427 34128459 0.88
tpcds_q94/datafusion:vortex-file-compressed 🚀 19924830 25254295 0.79
tpcds_q95/datafusion:vortex-file-compressed 🚀 52256191 60566533 0.86
tpcds_q96/datafusion:vortex-file-compressed 12723763 13943116 0.91
tpcds_q97/datafusion:vortex-file-compressed 🚀 27816880 33161173 0.84
tpcds_q98/datafusion:vortex-file-compressed 28249324 28881131 0.98
tpcds_q99/datafusion:vortex-file-compressed 44878174 41337222 1.09
datafusion / vortex-compact (1.083x ➖, 2↑ 36↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 28780205 31773289 0.91
tpcds_q02/datafusion:vortex-compact 56872946 54182866 1.05
tpcds_q03/datafusion:vortex-compact 23824016 24013985 0.99
tpcds_q04/datafusion:vortex-compact 305013939 304811165 1.00
tpcds_q05/datafusion:vortex-compact 🚨 55863229 50386655 1.11
tpcds_q06/datafusion:vortex-compact 49593920 46906394 1.06
tpcds_q07/datafusion:vortex-compact 🚨 61885022 56060946 1.10
tpcds_q08/datafusion:vortex-compact 39927167 38509676 1.04
tpcds_q09/datafusion:vortex-compact 63454170 63282417 1.00
tpcds_q10/datafusion:vortex-compact 58645142 54058030 1.08
tpcds_q11/datafusion:vortex-compact 174996136 176959192 0.99
tpcds_q12/datafusion:vortex-compact 🚀 23014213 25721729 0.89
tpcds_q13/datafusion:vortex-compact 🚨 118721575 97308495 1.22
tpcds_q14/datafusion:vortex-compact 🚨 232205124 210325771 1.10
tpcds_q15/datafusion:vortex-compact 34942478 34399528 1.02
tpcds_q16/datafusion:vortex-compact 34571571 34260614 1.01
tpcds_q17/datafusion:vortex-compact 86611938 79003114 1.10
tpcds_q18/datafusion:vortex-compact 77254186 80628498 0.96
tpcds_q19/datafusion:vortex-compact 🚨 40150435 33437909 1.20
tpcds_q20/datafusion:vortex-compact 27280963 26848451 1.02
tpcds_q21/datafusion:vortex-compact 133137592 134986344 0.99
tpcds_q22/datafusion:vortex-compact 61232523 60525252 1.01
tpcds_q23/datafusion:vortex-compact 🚨 171895974 150654503 1.14
tpcds_q24/datafusion:vortex-compact 129675560 120466447 1.08
tpcds_q25/datafusion:vortex-compact 88508348 81346883 1.09
tpcds_q26/datafusion:vortex-compact 43328410 47400451 0.91
tpcds_q27/datafusion:vortex-compact 🚨 149351346 128303677 1.16
tpcds_q28/datafusion:vortex-compact 84451357 78795290 1.07
tpcds_q29/datafusion:vortex-compact 85701791 80264638 1.07
tpcds_q30/datafusion:vortex-compact 28837645 28365484 1.02
tpcds_q31/datafusion:vortex-compact 🚨 128665815 113917903 1.13
tpcds_q32/datafusion:vortex-compact 🚀 23986719 27188260 0.88
tpcds_q33/datafusion:vortex-compact 🚨 47945671 37655418 1.27
tpcds_q34/datafusion:vortex-compact 🚨 47356247 36679525 1.29
tpcds_q35/datafusion:vortex-compact 🚨 63917053 56601841 1.13
tpcds_q36/datafusion:vortex-compact 🚨 92684890 83326605 1.11
tpcds_q37/datafusion:vortex-compact 43985715 45200974 0.97
tpcds_q38/datafusion:vortex-compact 63359103 58694442 1.08
tpcds_q39/datafusion:vortex-compact 146000841 137868606 1.06
tpcds_q40/datafusion:vortex-compact 51719605 52074214 0.99
tpcds_q41/datafusion:vortex-compact 18502621 18919023 0.98
tpcds_q42/datafusion:vortex-compact 22025331 20760094 1.06
tpcds_q43/datafusion:vortex-compact 35683787 33836975 1.05
tpcds_q44/datafusion:vortex-compact 🚨 69074761 52608838 1.31
tpcds_q45/datafusion:vortex-compact 35408357 37673019 0.94
tpcds_q46/datafusion:vortex-compact 🚨 67963932 51718740 1.31
tpcds_q47/datafusion:vortex-compact 217980661 205050697 1.06
tpcds_q48/datafusion:vortex-compact 🚨 91146991 77649276 1.17
tpcds_q49/datafusion:vortex-compact 🚨 81115426 69804746 1.16
tpcds_q50/datafusion:vortex-compact 🚨 60152886 51756826 1.16
tpcds_q51/datafusion:vortex-compact 96568638 98859816 0.98
tpcds_q52/datafusion:vortex-compact 21795613 20880193 1.04
tpcds_q53/datafusion:vortex-compact 🚨 33545655 29397145 1.14
tpcds_q54/datafusion:vortex-compact 🚨 54061157 45454634 1.19
tpcds_q55/datafusion:vortex-compact 21053458 21385932 0.98
tpcds_q56/datafusion:vortex-compact 🚨 48407016 38953672 1.24
tpcds_q57/datafusion:vortex-compact 136203101 130467808 1.04
tpcds_q58/datafusion:vortex-compact 75168911 74750428 1.01
tpcds_q59/datafusion:vortex-compact 83016160 76182047 1.09
tpcds_q60/datafusion:vortex-compact 🚨 49317937 39917212 1.24
tpcds_q61/datafusion:vortex-compact 🚨 65463518 57742057 1.13
tpcds_q62/datafusion:vortex-compact 32394985 31775969 1.02
tpcds_q63/datafusion:vortex-compact 31728095 28976398 1.09
tpcds_q64/datafusion:vortex-compact 513634233 483011813 1.06
tpcds_q65/datafusion:vortex-compact 🚨 66262438 57816062 1.15
tpcds_q66/datafusion:vortex-compact 91971271 86440724 1.06
tpcds_q67/datafusion:vortex-compact 124705101 114744356 1.09
tpcds_q68/datafusion:vortex-compact 🚨 66744920 52648349 1.27
tpcds_q69/datafusion:vortex-compact 🚨 55974754 50033000 1.12
tpcds_q70/datafusion:vortex-compact 119043506 114529479 1.04
tpcds_q71/datafusion:vortex-compact 🚨 44600211 33887980 1.32
tpcds_q72/datafusion:vortex-compact 2480866148 2451604666 1.01
tpcds_q73/datafusion:vortex-compact 🚨 46487681 36325672 1.28
tpcds_q74/datafusion:vortex-compact 127397539 121131662 1.05
tpcds_q75/datafusion:vortex-compact 🚨 154756535 134764048 1.15
tpcds_q76/datafusion:vortex-compact 🚨 47289407 37529307 1.26
tpcds_q77/datafusion:vortex-compact 56948399 54049164 1.05
tpcds_q78/datafusion:vortex-compact 144967797 141823705 1.02
tpcds_q79/datafusion:vortex-compact 🚨 57647999 43919684 1.31
tpcds_q80/datafusion:vortex-compact 🚨 119295487 108293791 1.10
tpcds_q81/datafusion:vortex-compact 35215353 32840264 1.07
tpcds_q82/datafusion:vortex-compact 47942371 45734023 1.05
tpcds_q83/datafusion:vortex-compact 46819001 48336389 0.97
tpcds_q84/datafusion:vortex-compact 15663875 16858166 0.93
tpcds_q85/datafusion:vortex-compact 113973905 116757686 0.98
tpcds_q86/datafusion:vortex-compact 20584628 21924507 0.94
tpcds_q87/datafusion:vortex-compact 🚨 65998372 59558348 1.11
tpcds_q88/datafusion:vortex-compact 🚨 130884643 79009433 1.66
tpcds_q89/datafusion:vortex-compact 41719859 38092536 1.10
tpcds_q90/datafusion:vortex-compact 🚨 22009196 16053773 1.37
tpcds_q91/datafusion:vortex-compact 37018490 36335188 1.02
tpcds_q92/datafusion:vortex-compact 24877349 25983867 0.96
tpcds_q93/datafusion:vortex-compact 🚨 42806462 38789483 1.10
tpcds_q94/datafusion:vortex-compact 27119583 26573743 1.02
tpcds_q95/datafusion:vortex-compact 66256684 65907528 1.01
tpcds_q96/datafusion:vortex-compact 🚨 24442016 18102185 1.35
tpcds_q97/datafusion:vortex-compact 40870915 38283475 1.07
tpcds_q98/datafusion:vortex-compact 35426808 33479178 1.06
tpcds_q99/datafusion:vortex-compact 45673254 45052842 1.01
datafusion / parquet (1.004x ➖, 1↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30810549 32220694 0.96
tpcds_q02/datafusion:parquet 43731012 43437615 1.01
tpcds_q03/datafusion:parquet 14386315 15387462 0.93
tpcds_q04/datafusion:parquet 273620481 272487910 1.00
tpcds_q05/datafusion:parquet 42794342 43591942 0.98
tpcds_q06/datafusion:parquet 58789492 59468271 0.99
tpcds_q07/datafusion:parquet 82085195 81142814 1.01
tpcds_q08/datafusion:parquet 27128485 26806586 1.01
tpcds_q09/datafusion:parquet 47261019 45677245 1.03
tpcds_q10/datafusion:parquet 76967908 73907252 1.04
tpcds_q11/datafusion:parquet 151571850 154899206 0.98
tpcds_q12/datafusion:parquet 18298353 17379657 1.05
tpcds_q13/datafusion:parquet 77145797 75911026 1.02
tpcds_q14/datafusion:parquet 164054599 167825125 0.98
tpcds_q15/datafusion:parquet 21535090 22128298 0.97
tpcds_q16/datafusion:parquet 24941522 25825717 0.97
tpcds_q17/datafusion:parquet 64501096 66069296 0.98
tpcds_q18/datafusion:parquet 116237307 116283484 1.00
tpcds_q19/datafusion:parquet 22894551 22611905 1.01
tpcds_q20/datafusion:parquet 16139579 17463101 0.92
tpcds_q21/datafusion:parquet 19599183 19514735 1.00
tpcds_q22/datafusion:parquet 142364732 131121952 1.09
tpcds_q23/datafusion:parquet 145413183 150455161 0.97
tpcds_q24/datafusion:parquet 91130283 94351360 0.97
tpcds_q25/datafusion:parquet 63766420 64656309 0.99
tpcds_q26/datafusion:parquet 66496230 68012761 0.98
tpcds_q27/datafusion:parquet 150180921 152428207 0.99
tpcds_q28/datafusion:parquet 46011505 46051196 1.00
tpcds_q29/datafusion:parquet 66124050 66623450 0.99
tpcds_q30/datafusion:parquet 35925256 35125786 1.02
tpcds_q31/datafusion:parquet 67058467 66656805 1.01
tpcds_q32/datafusion:parquet 18935929 18744032 1.01
tpcds_q33/datafusion:parquet 28883829 27036653 1.07
tpcds_q34/datafusion:parquet 22560490 22652089 1.00
tpcds_q35/datafusion:parquet 72267377 70934926 1.02
tpcds_q36/datafusion:parquet 57435522 56047175 1.02
tpcds_q37/datafusion:parquet 19955803 19687054 1.01
tpcds_q38/datafusion:parquet 41904121 41746691 1.00
tpcds_q39/datafusion:parquet 72188881 73171321 0.99
tpcds_q40/datafusion:parquet 23666983 23533474 1.01
tpcds_q41/datafusion:parquet 13622689 13427420 1.01
tpcds_q42/datafusion:parquet 12930262 12100355 1.07
tpcds_q43/datafusion:parquet 17053857 17213382 0.99
tpcds_q44/datafusion:parquet 34336648 33789779 1.02
tpcds_q45/datafusion:parquet 28139161 28515465 0.99
tpcds_q46/datafusion:parquet 32017964 32097409 1.00
tpcds_q47/datafusion:parquet 128778706 127592535 1.01
tpcds_q48/datafusion:parquet 71306067 72471320 0.98
tpcds_q49/datafusion:parquet 56382287 56927044 0.99
tpcds_q50/datafusion:parquet 43939038 45047809 0.98
tpcds_q51/datafusion:parquet 87022921 89226324 0.98
tpcds_q52/datafusion:parquet 11815806 12172492 0.97
tpcds_q53/datafusion:parquet 18549580 18366309 1.01
tpcds_q54/datafusion:parquet 34194854 34589972 0.99
tpcds_q55/datafusion:parquet 12627776 11759602 1.07
tpcds_q56/datafusion:parquet 27479691 28094928 0.98
tpcds_q57/datafusion:parquet 🚀 91042637 101443321 0.90
tpcds_q58/datafusion:parquet 51247668 50371602 1.02
tpcds_q59/datafusion:parquet 53291244 55013791 0.97
tpcds_q60/datafusion:parquet 28014178 28476422 0.98
tpcds_q61/datafusion:parquet 43369262 42295774 1.03
tpcds_q62/datafusion:parquet 🚨 25186134 19913414 1.26
tpcds_q63/datafusion:parquet 18088934 18442432 0.98
tpcds_q64/datafusion:parquet 521307550 531471811 0.98
tpcds_q65/datafusion:parquet 37839167 38238785 0.99
tpcds_q66/datafusion:parquet 73243529 67127913 1.09
tpcds_q67/datafusion:parquet 145200916 142952552 1.02
tpcds_q68/datafusion:parquet 33515479 33212456 1.01
tpcds_q69/datafusion:parquet 71907746 70870288 1.01
tpcds_q70/datafusion:parquet 89151662 86609170 1.03
tpcds_q71/datafusion:parquet 22995177 22539909 1.02
tpcds_q72/datafusion:parquet 601807498 610619236 0.99
tpcds_q73/datafusion:parquet 22416206 21496308 1.04
tpcds_q74/datafusion:parquet 86812523 84214392 1.03
tpcds_q75/datafusion:parquet 100297127 101103324 0.99
tpcds_q76/datafusion:parquet 31469952 30486267 1.03
tpcds_q77/datafusion:parquet 39109474 39836773 0.98
tpcds_q78/datafusion:parquet 115019077 112438518 1.02
tpcds_q79/datafusion:parquet 27230793 28068884 0.97
tpcds_q80/datafusion:parquet 80593810 78298321 1.03
tpcds_q81/datafusion:parquet 31425573 33185701 0.95
tpcds_q82/datafusion:parquet 19589400 19742042 0.99
tpcds_q83/datafusion:parquet 37513300 38381032 0.98
tpcds_q84/datafusion:parquet 39908277 40211179 0.99
tpcds_q85/datafusion:parquet 150974452 151390298 1.00
tpcds_q86/datafusion:parquet 16218787 15805622 1.03
tpcds_q87/datafusion:parquet 44010713 41859996 1.05
tpcds_q88/datafusion:parquet 59536232 60069390 0.99
tpcds_q89/datafusion:parquet 21473243 21618600 0.99
tpcds_q90/datafusion:parquet 14902241 14284018 1.04
tpcds_q91/datafusion:parquet 61205613 61142724 1.00
tpcds_q92/datafusion:parquet 20074410 18463578 1.09
tpcds_q93/datafusion:parquet 31750352 32211611 0.99
tpcds_q94/datafusion:parquet 22399868 20497020 1.09
tpcds_q95/datafusion:parquet 58170007 58848636 0.99
tpcds_q96/datafusion:parquet 12379730 12933754 0.96
tpcds_q97/datafusion:parquet 30475612 30802741 0.99
tpcds_q98/datafusion:parquet 22164433 22038003 1.01
tpcds_q99/datafusion:parquet 25105372 25280261 0.99
duckdb / vortex-file-compressed (1.020x ➖, 0↑ 5↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22734880 21637019 1.05
tpcds_q02/duckdb:vortex-file-compressed 34387516 33675549 1.02
tpcds_q03/duckdb:vortex-file-compressed 32471862 32068453 1.01
tpcds_q04/duckdb:vortex-file-compressed 103251677 102717043 1.01
tpcds_q05/duckdb:vortex-file-compressed 38437938 38411676 1.00
tpcds_q06/duckdb:vortex-file-compressed 33091436 33795236 0.98
tpcds_q07/duckdb:vortex-file-compressed 20155750 19769678 1.02
tpcds_q08/duckdb:vortex-file-compressed 29175749 29511872 0.99
tpcds_q09/duckdb:vortex-file-compressed 38984136 37671636 1.03
tpcds_q10/duckdb:vortex-file-compressed 42046088 41520139 1.01
tpcds_q11/duckdb:vortex-file-compressed 62028506 61149802 1.01
tpcds_q12/duckdb:vortex-file-compressed 15499360 15264401 1.02
tpcds_q13/duckdb:vortex-file-compressed 34822654 34396555 1.01
tpcds_q14/duckdb:vortex-file-compressed 110410585 107440608 1.03
tpcds_q15/duckdb:vortex-file-compressed 27890182 27079102 1.03
tpcds_q16/duckdb:vortex-file-compressed 28128931 27510917 1.02
tpcds_q17/duckdb:vortex-file-compressed 47072016 45629709 1.03
tpcds_q18/duckdb:vortex-file-compressed 47391120 46831212 1.01
tpcds_q19/duckdb:vortex-file-compressed 33856864 33375935 1.01
tpcds_q20/duckdb:vortex-file-compressed 16195486 15793797 1.03
tpcds_q21/duckdb:vortex-file-compressed 17400339 17546594 0.99
tpcds_q22/duckdb:vortex-file-compressed 75769498 71720338 1.06
tpcds_q23/duckdb:vortex-file-compressed 108699542 109154344 1.00
tpcds_q24/duckdb:vortex-file-compressed 51083405 50264241 1.02
tpcds_q25/duckdb:vortex-file-compressed 51230488 51671099 0.99
tpcds_q26/duckdb:vortex-file-compressed 39759056 41237624 0.96
tpcds_q27/duckdb:vortex-file-compressed 50551846 48880023 1.03
tpcds_q28/duckdb:vortex-file-compressed 35730451 35240468 1.01
tpcds_q29/duckdb:vortex-file-compressed 44025799 42628799 1.03
tpcds_q30/duckdb:vortex-file-compressed 26190607 26337237 0.99
tpcds_q31/duckdb:vortex-file-compressed 37194650 36615472 1.02
tpcds_q32/duckdb:vortex-file-compressed 14751184 14599581 1.01
tpcds_q33/duckdb:vortex-file-compressed 24948308 25040853 1.00
tpcds_q34/duckdb:vortex-file-compressed 25986034 23689202 1.10
tpcds_q35/duckdb:vortex-file-compressed 67058243 63753873 1.05
tpcds_q36/duckdb:vortex-file-compressed 24944025 25159953 0.99
tpcds_q37/duckdb:vortex-file-compressed 16108675 16424328 0.98
tpcds_q38/duckdb:vortex-file-compressed 🚨 40441869 36011372 1.12
tpcds_q39/duckdb:vortex-file-compressed 35407267 35058197 1.01
tpcds_q40/duckdb:vortex-file-compressed 19473762 20491781 0.95
tpcds_q41/duckdb:vortex-file-compressed 13581179 13135895 1.03
tpcds_q42/duckdb:vortex-file-compressed 13186012 12551529 1.05
tpcds_q43/duckdb:vortex-file-compressed 🚨 23641488 21341983 1.11
tpcds_q44/duckdb:vortex-file-compressed 22470605 22835997 0.98
tpcds_q45/duckdb:vortex-file-compressed 30107362 29704725 1.01
tpcds_q46/duckdb:vortex-file-compressed 52372533 51177066 1.02
tpcds_q47/duckdb:vortex-file-compressed 49285409 47371719 1.04
tpcds_q48/duckdb:vortex-file-compressed 31745415 31634933 1.00
tpcds_q49/duckdb:vortex-file-compressed 34260069 33405318 1.03
tpcds_q50/duckdb:vortex-file-compressed 34632463 34015268 1.02
tpcds_q51/duckdb:vortex-file-compressed 100082058 102061971 0.98
tpcds_q52/duckdb:vortex-file-compressed 12925871 13022930 0.99
tpcds_q53/duckdb:vortex-file-compressed 24704120 22879753 1.08
tpcds_q54/duckdb:vortex-file-compressed 30823765 28963603 1.06
tpcds_q55/duckdb:vortex-file-compressed 13941829 14957854 0.93
tpcds_q56/duckdb:vortex-file-compressed 25429014 25376559 1.00
tpcds_q57/duckdb:vortex-file-compressed 38509655 38895412 0.99
tpcds_q58/duckdb:vortex-file-compressed 31821224 31426300 1.01
tpcds_q59/duckdb:vortex-file-compressed 66695754 68742049 0.97
tpcds_q60/duckdb:vortex-file-compressed 26569977 26364755 1.01
tpcds_q61/duckdb:vortex-file-compressed 33550556 31937308 1.05
tpcds_q62/duckdb:vortex-file-compressed 19008189 17508677 1.09
tpcds_q63/duckdb:vortex-file-compressed 23713064 23496248 1.01
tpcds_q64/duckdb:vortex-file-compressed 88183098 83393215 1.06
tpcds_q65/duckdb:vortex-file-compressed 🚨 25160520 22383180 1.12
tpcds_q66/duckdb:vortex-file-compressed 30905506 31399656 0.98
tpcds_q67/duckdb:vortex-file-compressed 141765906 141479564 1.00
tpcds_q68/duckdb:vortex-file-compressed 41065843 41714451 0.98
tpcds_q69/duckdb:vortex-file-compressed 43568728 42678533 1.02
tpcds_q70/duckdb:vortex-file-compressed 27865108 26378972 1.06
tpcds_q71/duckdb:vortex-file-compressed 22728005 22403563 1.01
tpcds_q72/duckdb:vortex-file-compressed 172578271 170573117 1.01
tpcds_q73/duckdb:vortex-file-compressed 25163446 24023141 1.05
tpcds_q74/duckdb:vortex-file-compressed 🚨 84051496 70993736 1.18
tpcds_q75/duckdb:vortex-file-compressed 59256135 56749140 1.04
tpcds_q76/duckdb:vortex-file-compressed 19393534 18463967 1.05
tpcds_q77/duckdb:vortex-file-compressed 25791542 27101119 0.95
tpcds_q78/duckdb:vortex-file-compressed 73335159 76944718 0.95
tpcds_q79/duckdb:vortex-file-compressed 33576582 33735163 1.00
tpcds_q80/duckdb:vortex-file-compressed 49156178 47811838 1.03
tpcds_q81/duckdb:vortex-file-compressed 27518494 29630663 0.93
tpcds_q82/duckdb:vortex-file-compressed 16599198 17250698 0.96
tpcds_q83/duckdb:vortex-file-compressed 25129307 24204076 1.04
tpcds_q84/duckdb:vortex-file-compressed 20402146 19669940 1.04
tpcds_q85/duckdb:vortex-file-compressed 47347990 44759906 1.06
tpcds_q86/duckdb:vortex-file-compressed 17219703 16862120 1.02
tpcds_q87/duckdb:vortex-file-compressed 41213802 40136387 1.03
tpcds_q88/duckdb:vortex-file-compressed 34499062 34040100 1.01
tpcds_q89/duckdb:vortex-file-compressed 24156256 22572051 1.07
tpcds_q90/duckdb:vortex-file-compressed 13068350 12980870 1.01
tpcds_q91/duckdb:vortex-file-compressed 32439006 33694002 0.96
tpcds_q92/duckdb:vortex-file-compressed 🚨 22856277 18933619 1.21
tpcds_q93/duckdb:vortex-file-compressed 26599055 29107134 0.91
tpcds_q94/duckdb:vortex-file-compressed 24856365 23853401 1.04
tpcds_q95/duckdb:vortex-file-compressed 151791732 139106723 1.09
tpcds_q96/duckdb:vortex-file-compressed 14504238 13688659 1.06
tpcds_q97/duckdb:vortex-file-compressed 39040697 39553046 0.99
tpcds_q98/duckdb:vortex-file-compressed 18690683 18886230 0.99
tpcds_q99/duckdb:vortex-file-compressed 29267748 28114396 1.04
duckdb / vortex-compact (1.006x ➖, 1↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24260143 24071707 1.01
tpcds_q02/duckdb:vortex-compact 41890857 43645300 0.96
tpcds_q03/duckdb:vortex-compact 57244707 56276163 1.02
tpcds_q04/duckdb:vortex-compact 123438603 120280174 1.03
tpcds_q05/duckdb:vortex-compact 53166159 52073165 1.02
tpcds_q06/duckdb:vortex-compact 43067504 41129436 1.05
tpcds_q07/duckdb:vortex-compact 35108176 34678996 1.01
tpcds_q08/duckdb:vortex-compact 46519950 46401657 1.00
tpcds_q09/duckdb:vortex-compact 58800015 59514599 0.99
tpcds_q10/duckdb:vortex-compact 63766751 62979739 1.01
tpcds_q11/duckdb:vortex-compact 71956885 71790082 1.00
tpcds_q12/duckdb:vortex-compact 24077212 23449214 1.03
tpcds_q13/duckdb:vortex-compact 60411023 61771562 0.98
tpcds_q14/duckdb:vortex-compact 137288098 128865052 1.07
tpcds_q15/duckdb:vortex-compact 32200064 31205078 1.03
tpcds_q16/duckdb:vortex-compact 32084011 31588388 1.02
tpcds_q17/duckdb:vortex-compact 57018342 54714955 1.04
tpcds_q18/duckdb:vortex-compact 59824709 61408068 0.97
tpcds_q19/duckdb:vortex-compact 53027752 50463132 1.05
tpcds_q20/duckdb:vortex-compact 20923121 20912020 1.00
tpcds_q21/duckdb:vortex-compact 🚀 19176792 21694815 0.88
tpcds_q22/duckdb:vortex-compact 79751243 75577650 1.06
tpcds_q23/duckdb:vortex-compact 136390632 125291063 1.09
tpcds_q24/duckdb:vortex-compact 64623193 62043097 1.04
tpcds_q25/duckdb:vortex-compact 79816532 84666371 0.94
tpcds_q26/duckdb:vortex-compact 54515982 51415933 1.06
tpcds_q27/duckdb:vortex-compact 69927691 70507035 0.99
tpcds_q28/duckdb:vortex-compact 86930418 83713267 1.04
tpcds_q29/duckdb:vortex-compact 55603198 53609138 1.04
tpcds_q30/duckdb:vortex-compact 31178686 32542373 0.96
tpcds_q31/duckdb:vortex-compact 49810325 48625222 1.02
tpcds_q32/duckdb:vortex-compact 23407220 23161819 1.01
tpcds_q33/duckdb:vortex-compact 36144841 36888276 0.98
tpcds_q34/duckdb:vortex-compact 39546477 40232306 0.98
tpcds_q35/duckdb:vortex-compact 82231978 84308561 0.98
tpcds_q36/duckdb:vortex-compact 41449403 42816417 0.97
tpcds_q37/duckdb:vortex-compact 25333781 24492292 1.03
tpcds_q38/duckdb:vortex-compact 50804459 48228102 1.05
tpcds_q39/duckdb:vortex-compact 37291738 37766956 0.99
tpcds_q40/duckdb:vortex-compact 25110959 26253444 0.96
tpcds_q41/duckdb:vortex-compact 16379244 16566031 0.99
tpcds_q42/duckdb:vortex-compact 22302546 22839703 0.98
tpcds_q43/duckdb:vortex-compact 36468267 34810271 1.05
tpcds_q44/duckdb:vortex-compact 30134709 31213864 0.97
tpcds_q45/duckdb:vortex-compact 39489128 39970743 0.99
tpcds_q46/duckdb:vortex-compact 74961468 73855245 1.01
tpcds_q47/duckdb:vortex-compact 63493887 63853445 0.99
tpcds_q48/duckdb:vortex-compact 53974610 54591632 0.99
tpcds_q49/duckdb:vortex-compact 58196280 61392658 0.95
tpcds_q50/duckdb:vortex-compact 49558401 48211963 1.03
tpcds_q51/duckdb:vortex-compact 108314876 109166862 0.99
tpcds_q52/duckdb:vortex-compact 22450219 23464569 0.96
tpcds_q53/duckdb:vortex-compact 40070662 39552113 1.01
tpcds_q54/duckdb:vortex-compact 43433646 40960763 1.06
tpcds_q55/duckdb:vortex-compact 23800130 23863335 1.00
tpcds_q56/duckdb:vortex-compact 37583141 35692623 1.05
tpcds_q57/duckdb:vortex-compact 43933808 44389938 0.99
tpcds_q58/duckdb:vortex-compact 39756160 43439835 0.92
tpcds_q59/duckdb:vortex-compact 86196978 87745980 0.98
tpcds_q60/duckdb:vortex-compact 40155889 38876331 1.03
tpcds_q61/duckdb:vortex-compact 65372425 67021606 0.98
tpcds_q62/duckdb:vortex-compact 29626813 26973562 1.10
tpcds_q63/duckdb:vortex-compact 40025403 37762344 1.06
tpcds_q64/duckdb:vortex-compact 123126877 119281778 1.03
tpcds_q65/duckdb:vortex-compact 33595170 33810891 0.99
tpcds_q66/duckdb:vortex-compact 40157227 41223604 0.97
tpcds_q67/duckdb:vortex-compact 156009575 151267797 1.03
tpcds_q68/duckdb:vortex-compact 62216088 63963065 0.97
tpcds_q69/duckdb:vortex-compact 63481499 64153198 0.99
tpcds_q70/duckdb:vortex-compact 37424172 37885397 0.99
tpcds_q71/duckdb:vortex-compact 35583245 34267751 1.04
tpcds_q72/duckdb:vortex-compact 192720685 194358751 0.99
tpcds_q73/duckdb:vortex-compact 38988792 38017793 1.03
tpcds_q74/duckdb:vortex-compact 97850615 103352907 0.95
tpcds_q75/duckdb:vortex-compact 73638991 75824073 0.97
tpcds_q76/duckdb:vortex-compact 36126518 35603009 1.01
tpcds_q77/duckdb:vortex-compact 44276645 41434816 1.07
tpcds_q78/duckdb:vortex-compact 83199652 91364188 0.91
tpcds_q79/duckdb:vortex-compact 57978537 55477958 1.05
tpcds_q80/duckdb:vortex-compact 78702551 81948499 0.96
tpcds_q81/duckdb:vortex-compact 34078420 34339875 0.99
tpcds_q82/duckdb:vortex-compact 28134011 26723686 1.05
tpcds_q83/duckdb:vortex-compact 33726803 33218791 1.02
tpcds_q84/duckdb:vortex-compact 27706862 27947135 0.99
tpcds_q85/duckdb:vortex-compact 59773951 57669595 1.04
tpcds_q86/duckdb:vortex-compact 🚨 25269938 22922069 1.10
tpcds_q87/duckdb:vortex-compact 54392023 51942332 1.05
tpcds_q88/duckdb:vortex-compact 42294460 41968341 1.01
tpcds_q89/duckdb:vortex-compact 39456825 38021069 1.04
tpcds_q90/duckdb:vortex-compact 15800070 15822968 1.00
tpcds_q91/duckdb:vortex-compact 52433337 53133856 0.99
tpcds_q92/duckdb:vortex-compact 55955468 52842407 1.06
tpcds_q93/duckdb:vortex-compact 29509189 31241283 0.94
tpcds_q94/duckdb:vortex-compact 32150547 31318098 1.03
tpcds_q95/duckdb:vortex-compact 154960236 166119034 0.93
tpcds_q96/duckdb:vortex-compact 18456497 18816171 0.98
tpcds_q97/duckdb:vortex-compact 45258839 44328354 1.02
tpcds_q98/duckdb:vortex-compact 29581113 28755975 1.03
tpcds_q99/duckdb:vortex-compact 32540549 31587650 1.03
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28626261 28517898 1.00
tpcds_q02/duckdb:parquet 22256632 22805453 0.98
tpcds_q03/duckdb:parquet 11439399 11011040 1.04
tpcds_q04/duckdb:parquet 166402202 164349286 1.01
tpcds_q05/duckdb:parquet 29340490 29038090 1.01
tpcds_q06/duckdb:parquet 27398132 27949183 0.98
tpcds_q07/duckdb:parquet 20643805 20811432 0.99
tpcds_q08/duckdb:parquet 26574158 26457677 1.00
tpcds_q09/duckdb:parquet 39339924 39720210 0.99
tpcds_q10/duckdb:parquet 32669132 32369867 1.01
tpcds_q11/duckdb:parquet 89865398 85770807 1.05
tpcds_q12/duckdb:parquet 14505479 14223420 1.02
tpcds_q13/duckdb:parquet 32095271 32517290 0.99
tpcds_q14/duckdb:parquet 97234987 99942123 0.97
tpcds_q15/duckdb:parquet 30714633 29058069 1.06
tpcds_q16/duckdb:parquet 21282838 21013885 1.01
tpcds_q17/duckdb:parquet 39331525 36254822 1.08
tpcds_q18/duckdb:parquet 47029464 44462975 1.06
tpcds_q19/duckdb:parquet 27751662 28097050 0.99
tpcds_q20/duckdb:parquet 15620960 15618044 1.00
tpcds_q21/duckdb:parquet 10089950 9899883 1.02
tpcds_q22/duckdb:parquet 69853872 72000306 0.97
tpcds_q23/duckdb:parquet 79570918 79618822 1.00
tpcds_q24/duckdb:parquet 43990200 42842947 1.03
tpcds_q25/duckdb:parquet 33346081 32499650 1.03
tpcds_q26/duckdb:parquet 34023742 35219276 0.97
tpcds_q27/duckdb:parquet 49031719 46916632 1.05
tpcds_q28/duckdb:parquet 37588205 37590905 1.00
tpcds_q29/duckdb:parquet 34802549 35001337 0.99
tpcds_q30/duckdb:parquet 34582172 34734889 1.00
tpcds_q31/duckdb:parquet 23951856 24448477 0.98
tpcds_q32/duckdb:parquet 11713653 11718280 1.00
tpcds_q33/duckdb:parquet 21070944 20380920 1.03
tpcds_q34/duckdb:parquet 20331280 20374068 1.00
tpcds_q35/duckdb:parquet 57555530 58170861 0.99
tpcds_q36/duckdb:parquet 19800229 20613672 0.96
tpcds_q37/duckdb:parquet 13220031 12152963 1.09
tpcds_q38/duckdb:parquet 33746684 33350203 1.01
tpcds_q39/duckdb:parquet 28604892 28674430 1.00
tpcds_q40/duckdb:parquet 17343939 17269632 1.00
tpcds_q41/duckdb:parquet 7557238 7583078 1.00
tpcds_q42/duckdb:parquet 10028962 9508426 1.05
tpcds_q43/duckdb:parquet 14891462 15254778 0.98
tpcds_q44/duckdb:parquet 23177355 22112363 1.05
tpcds_q45/duckdb:parquet 27501191 26749989 1.03
tpcds_q46/duckdb:parquet 45249914 43826520 1.03
tpcds_q47/duckdb:parquet 43255875 44639180 0.97
tpcds_q48/duckdb:parquet 29228681 29143196 1.00
tpcds_q49/duckdb:parquet 24450281 24036009 1.02
tpcds_q50/duckdb:parquet 24866838 23756045 1.05
tpcds_q51/duckdb:parquet 95930409 95438466 1.01
tpcds_q52/duckdb:parquet 10485103 10359056 1.01
tpcds_q53/duckdb:parquet 14969507 14911693 1.00
tpcds_q54/duckdb:parquet 25290778 25597631 0.99
tpcds_q55/duckdb:parquet 9909371 10442124 0.95
tpcds_q56/duckdb:parquet 21720437 20904975 1.04
tpcds_q57/duckdb:parquet 34504573 33468536 1.03
tpcds_q58/duckdb:parquet 22962489 21799561 1.05
tpcds_q59/duckdb:parquet 35983374 35272110 1.02
tpcds_q60/duckdb:parquet 21360576 21703340 0.98
tpcds_q61/duckdb:parquet 31518758 30114569 1.05
tpcds_q62/duckdb:parquet 12132871 11497574 1.06
tpcds_q63/duckdb:parquet 13899817 14048208 0.99
tpcds_q64/duckdb:parquet 76418240 72418244 1.06
tpcds_q65/duckdb:parquet 20897404 20517231 1.02
tpcds_q66/duckdb:parquet 28637952 28741501 1.00
tpcds_q67/duckdb:parquet 135210688 135198761 1.00
tpcds_q68/duckdb:parquet 36133260 36101628 1.00
tpcds_q69/duckdb:parquet 35405005 35426838 1.00
tpcds_q70/duckdb:parquet 19357513 18902427 1.02
tpcds_q71/duckdb:parquet 19374221 19100860 1.01
tpcds_q72/duckdb:parquet 165663329 164077069 1.01
tpcds_q73/duckdb:parquet 17729599 17553333 1.01
tpcds_q74/duckdb:parquet 128968489 128161547 1.01
tpcds_q75/duckdb:parquet 53030213 54547156 0.97
tpcds_q76/duckdb:parquet 19857635 20086416 0.99
tpcds_q77/duckdb:parquet 22249882 21870554 1.02
tpcds_q78/duckdb:parquet 75456159 74067397 1.02
tpcds_q79/duckdb:parquet 27239955 26418640 1.03
tpcds_q80/duckdb:parquet 40536047 40893903 0.99
tpcds_q81/duckdb:parquet 32690702 30359394 1.08
tpcds_q82/duckdb:parquet 13465047 13825884 0.97
tpcds_q83/duckdb:parquet 16599328 16607646 1.00
tpcds_q84/duckdb:parquet 18450012 18723396 0.99
tpcds_q85/duckdb:parquet 38133136 39420442 0.97
tpcds_q86/duckdb:parquet 12024071 12966150 0.93
tpcds_q87/duckdb:parquet 36327068 36331632 1.00
tpcds_q88/duckdb:parquet 48962504 48838049 1.00
tpcds_q89/duckdb:parquet 15860077 15802429 1.00
tpcds_q90/duckdb:parquet 8008442 7360223 1.09
tpcds_q91/duckdb:parquet 21605810 22767269 0.95
tpcds_q92/duckdb:parquet 11656949 11495196 1.01
tpcds_q93/duckdb:parquet 30470637 29133184 1.05
tpcds_q94/duckdb:parquet 15768887 15664145 1.01
tpcds_q95/duckdb:parquet 143704797 143787122 1.00
tpcds_q96/duckdb:parquet 8624552 8828602 0.98
tpcds_q97/duckdb:parquet 36950853 34652918 1.07
tpcds_q98/duckdb:parquet 17306734 17462650 0.99
tpcds_q99/duckdb:parquet 19581597 20291327 0.97
duckdb / duckdb (1.018x ➖, 1↑ 2↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20434937 20489948 1.00
tpcds_q02/duckdb:duckdb 18839611 17747351 1.06
tpcds_q03/duckdb:duckdb 9348140 8804468 1.06
tpcds_q04/duckdb:duckdb 179399793 174881505 1.03
tpcds_q05/duckdb:duckdb 20511685 19242764 1.07
tpcds_q06/duckdb:duckdb 22659918 22747249 1.00
tpcds_q07/duckdb:duckdb 38141923 38777021 0.98
tpcds_q08/duckdb:duckdb 120286778 120026417 1.00
tpcds_q09/duckdb:duckdb 19960615 19937894 1.00
tpcds_q10/duckdb:duckdb 24434819 23200500 1.05
tpcds_q11/duckdb:duckdb 87810838 87720370 1.00
tpcds_q12/duckdb:duckdb 11304640 11274719 1.00
tpcds_q13/duckdb:duckdb 23925211 23877241 1.00
tpcds_q14/duckdb:duckdb 95396449 90325524 1.06
tpcds_q15/duckdb:duckdb 24336869 24613864 0.99
tpcds_q16/duckdb:duckdb 16888770 17699132 0.95
tpcds_q17/duckdb:duckdb 22201215 21481602 1.03
tpcds_q18/duckdb:duckdb 45153355 45053882 1.00
tpcds_q19/duckdb:duckdb 17110170 16933592 1.01
tpcds_q20/duckdb:duckdb 12209194 12050086 1.01
tpcds_q21/duckdb:duckdb 🚀 6808901 7918832 0.86
tpcds_q22/duckdb:duckdb 63955330 65040256 0.98
tpcds_q23/duckdb:duckdb 73821491 79692622 0.93
tpcds_q24/duckdb:duckdb 24867039 24444611 1.02
tpcds_q25/duckdb:duckdb 17103835 16464125 1.04
tpcds_q26/duckdb:duckdb 26362047 26175544 1.01
tpcds_q27/duckdb:duckdb 39576317 38520212 1.03
tpcds_q28/duckdb:duckdb 21733471 22273172 0.98
tpcds_q29/duckdb:duckdb 21115556 20171771 1.05
tpcds_q30/duckdb:duckdb 30214086 28902946 1.05
tpcds_q31/duckdb:duckdb 48808366 48588421 1.00
tpcds_q32/duckdb:duckdb 7499891 7283181 1.03
tpcds_q33/duckdb:duckdb 12696530 12534214 1.01
tpcds_q34/duckdb:duckdb 14593163 14593423 1.00
tpcds_q35/duckdb:duckdb 34035918 31900427 1.07
tpcds_q36/duckdb:duckdb 71474333 69896260 1.02
tpcds_q37/duckdb:duckdb 7831044 7870267 1.00
tpcds_q38/duckdb:duckdb 31790195 30698326 1.04
tpcds_q39/duckdb:duckdb 26845087 25203315 1.07
tpcds_q40/duckdb:duckdb 13500132 13889917 0.97
tpcds_q41/duckdb:duckdb 🚨 9114775 7930276 1.15
tpcds_q42/duckdb:duckdb 6600357 6516530 1.01
tpcds_q43/duckdb:duckdb 11591914 11111972 1.04
tpcds_q44/duckdb:duckdb 13462364 12758454 1.06
tpcds_q45/duckdb:duckdb 16775807 17572163 0.95
tpcds_q46/duckdb:duckdb 37719091 37147958 1.02
tpcds_q47/duckdb:duckdb 40942280 39951765 1.02
tpcds_q48/duckdb:duckdb 22073885 23302886 0.95
tpcds_q49/duckdb:duckdb 17195097 16562587 1.04
tpcds_q50/duckdb:duckdb 14819769 14410952 1.03
tpcds_q51/duckdb:duckdb 94922609 93203634 1.02
tpcds_q52/duckdb:duckdb 7338505 7359698 1.00
tpcds_q53/duckdb:duckdb 13226623 13315269 0.99
tpcds_q54/duckdb:duckdb 17524425 16193354 1.08
tpcds_q55/duckdb:duckdb 7572370 7159651 1.06
tpcds_q56/duckdb:duckdb 13605741 13074869 1.04
tpcds_q57/duckdb:duckdb 33461769 33023337 1.01
tpcds_q58/duckdb:duckdb 12728681 13432513 0.95
tpcds_q59/duckdb:duckdb 35367674 35217626 1.00
tpcds_q60/duckdb:duckdb 15365769 14040043 1.09
tpcds_q61/duckdb:duckdb 14555997 14279531 1.02
tpcds_q62/duckdb:duckdb 9814674 9216703 1.06
tpcds_q63/duckdb:duckdb 12372963 12223839 1.01
tpcds_q64/duckdb:duckdb 54694807 55059038 0.99
tpcds_q65/duckdb:duckdb 34686448 35093002 0.99
tpcds_q66/duckdb:duckdb 25684610 25640860 1.00
tpcds_q67/duckdb:duckdb 134586592 129226609 1.04
tpcds_q68/duckdb:duckdb 25713655 25358849 1.01
tpcds_q69/duckdb:duckdb 24035248 24439309 0.98
tpcds_q70/duckdb:duckdb 14875553 14334231 1.04
tpcds_q71/duckdb:duckdb 12759647 12982064 0.98
tpcds_q72/duckdb:duckdb 43346118 40470152 1.07
tpcds_q73/duckdb:duckdb 10768622 10823414 0.99
tpcds_q74/duckdb:duckdb 146557327 143279945 1.02
tpcds_q75/duckdb:duckdb 42618718 42666188 1.00
tpcds_q76/duckdb:duckdb 11631969 11222032 1.04
tpcds_q77/duckdb:duckdb 12324442 12112001 1.02
tpcds_q78/duckdb:duckdb 62761930 63965733 0.98
tpcds_q79/duckdb:duckdb 19192276 18826530 1.02
tpcds_q80/duckdb:duckdb 27901982 27174876 1.03
tpcds_q81/duckdb:duckdb 38200150 38616514 0.99
tpcds_q82/duckdb:duckdb 8290240 8528313 0.97
tpcds_q83/duckdb:duckdb 9828462 9436664 1.04
tpcds_q84/duckdb:duckdb 13546097 13060708 1.04
tpcds_q85/duckdb:duckdb 24161525 23880024 1.01
tpcds_q86/duckdb:duckdb 11092988 11437521 0.97
tpcds_q87/duckdb:duckdb 32609312 34411741 0.95
tpcds_q88/duckdb:duckdb 26871779 26153703 1.03
tpcds_q89/duckdb:duckdb 14823622 14506850 1.02
tpcds_q90/duckdb:duckdb 5722067 5417793 1.06
tpcds_q91/duckdb:duckdb 13249666 13042515 1.02
tpcds_q92/duckdb:duckdb 9287011 9176476 1.01
tpcds_q93/duckdb:duckdb 22740786 21792677 1.04
tpcds_q94/duckdb:duckdb 13514593 12432339 1.09
tpcds_q95/duckdb:duckdb 124812151 127468392 0.98
tpcds_q96/duckdb:duckdb 4718492 4661640 1.01
tpcds_q97/duckdb:duckdb 29029150 30237199 0.96
tpcds_q98/duckdb:duckdb 14433846 13753530 1.05
tpcds_q99/duckdb:duckdb 🚨 23086423 16634064 1.39
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -9.4% -2.0% -7.5% +22.0% ➖ noise
1 datafusion:vortex-file-compressed -25.0% -2.0% -23.5% +19.6% ✅ faster
1 duckdb:duckdb -0.3% -2.0% +1.8% +23.0% ➖ noise
1 duckdb:vortex-compact +0.8% -2.0% +2.9% +24.0% ➖ noise
1 duckdb:vortex-file-compressed +5.1% -2.0% +7.2% +34.5% ➖ noise
2 datafusion:vortex-compact +5.0% -0.9% +5.9% +10.7% ➖ noise
2 datafusion:vortex-file-compressed +0.4% -0.9% +1.3% +11.1% ➖ noise
2 duckdb:duckdb +6.2% -0.9% +7.1% +12.2% ➖ noise
2 duckdb:vortex-compact -4.0% -0.9% -3.2% +14.7% ➖ noise
2 duckdb:vortex-file-compressed +2.1% -0.9% +3.0% +33.1% ➖ noise
3 datafusion:vortex-compact -0.8% -1.4% +0.7% +16.1% ➖ noise
3 datafusion:vortex-file-compressed -5.0% -1.4% -3.6% +13.4% ➖ noise
3 duckdb:duckdb +6.2% -1.4% +7.7% +13.5% ➖ noise
3 duckdb:vortex-compact +1.7% -1.4% +3.2% +11.1% ➖ noise
3 duckdb:vortex-file-compressed +1.3% -1.4% +2.7% +11.4% ➖ noise
4 datafusion:vortex-compact +0.1% +0.8% -0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.2% +0.8% -3.1% +10.0% ➖ noise
4 duckdb:duckdb +2.6% +0.8% +1.7% +10.0% ➖ noise
4 duckdb:vortex-compact +2.6% +0.8% +1.8% +10.4% ➖ noise
4 duckdb:vortex-file-compressed +0.5% +0.8% -0.3% +10.0% ➖ noise
5 datafusion:vortex-compact +10.9% -0.4% +11.3% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed +0.1% -0.4% +0.5% +11.5% ➖ noise
5 duckdb:duckdb +6.6% -0.4% +7.0% +16.1% ➖ noise
5 duckdb:vortex-compact +2.1% -0.4% +2.5% +16.4% ➖ noise
5 duckdb:vortex-file-compressed +0.1% -0.4% +0.5% +15.0% ➖ noise
6 datafusion:vortex-compact +5.7% -1.6% +7.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% -1.6% -4.6% +10.0% ➖ noise
6 duckdb:duckdb -0.4% -1.6% +1.2% +13.4% ➖ noise
6 duckdb:vortex-compact +4.7% -1.6% +6.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.1% -1.6% -0.5% +10.0% ➖ noise
7 datafusion:vortex-compact +10.4% +0.2% +10.2% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed -4.8% +0.2% -5.0% +10.0% ➖ noise
7 duckdb:duckdb -1.6% +0.2% -1.8% +18.0% ➖ noise
7 duckdb:vortex-compact +1.2% +0.2% +1.1% +12.5% ➖ noise
7 duckdb:vortex-file-compressed +2.0% +0.2% +1.8% +30.5% ➖ noise
8 datafusion:vortex-compact +3.7% +0.8% +2.8% +12.2% ➖ noise
8 datafusion:vortex-file-compressed -7.0% +0.8% -7.7% +10.0% ➖ noise
8 duckdb:duckdb +0.2% +0.8% -0.6% +10.0% ➖ noise
8 duckdb:vortex-compact +0.3% +0.8% -0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.1% +0.8% -1.9% +10.0% ➖ noise
9 datafusion:vortex-compact +0.3% +1.2% -0.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.3% +1.2% -1.5% +10.0% ➖ noise
9 duckdb:duckdb +0.1% +1.2% -1.1% +10.0% ➖ noise
9 duckdb:vortex-compact -1.2% +1.2% -2.4% +11.2% ➖ noise
9 duckdb:vortex-file-compressed +3.5% +1.2% +2.2% +10.8% ➖ noise
10 datafusion:vortex-compact +8.5% +2.5% +5.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -11.5% +2.5% -13.7% +10.1% ✅ faster
10 duckdb:duckdb +5.3% +2.5% +2.7% +10.6% ➖ noise
10 duckdb:vortex-compact +1.2% +2.5% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.3% +2.5% -1.2% +10.0% ➖ noise
11 datafusion:vortex-compact -1.1% +1.3% -2.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.1% +1.3% -2.3% +10.0% ➖ noise
11 duckdb:duckdb +0.1% +1.3% -1.1% +10.0% ➖ noise
11 duckdb:vortex-compact +0.2% +1.3% -1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.4% +1.3% +0.2% +10.4% ➖ noise
12 datafusion:vortex-compact -10.5% +3.6% -13.7% +11.4% ✅ faster
12 datafusion:vortex-file-compressed -11.3% +3.6% -14.4% +12.8% ✅ faster
12 duckdb:duckdb +0.3% +3.6% -3.2% +12.9% ➖ noise
12 duckdb:vortex-compact +2.7% +3.6% -0.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.5% +3.6% -2.0% +10.0% ➖ noise
13 datafusion:vortex-compact +22.0% +0.2% +21.8% +11.7% 🚨 regression
13 datafusion:vortex-file-compressed +0.2% +0.2% +0.1% +10.0% ➖ noise
13 duckdb:duckdb +0.2% +0.2% +0.0% +10.0% ➖ noise
13 duckdb:vortex-compact -2.2% +0.2% -2.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.2% +0.2% +1.1% +10.0% ➖ noise
14 datafusion:vortex-compact +10.4% -2.5% +13.2% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed -4.6% -2.5% -2.1% +10.0% ➖ noise
14 duckdb:duckdb +5.6% -2.5% +8.3% +10.0% ➖ noise
14 duckdb:vortex-compact +6.5% -2.5% +9.2% +11.1% ➖ noise
14 duckdb:vortex-file-compressed +2.8% -2.5% +5.4% +10.0% ➖ noise
15 datafusion:vortex-compact +1.6% +1.4% +0.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.3% +1.4% -5.6% +10.0% ➖ noise
15 duckdb:duckdb -1.1% +1.4% -2.5% +10.0% ➖ noise
15 duckdb:vortex-compact +3.2% +1.4% +1.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.0% +1.4% +1.5% +10.0% ➖ noise
16 datafusion:vortex-compact +0.9% -1.1% +2.0% +13.3% ➖ noise
16 datafusion:vortex-file-compressed -20.6% -1.1% -19.7% +12.6% ✅ faster
16 duckdb:duckdb -4.6% -1.1% -3.5% +10.7% ➖ noise
16 duckdb:vortex-compact +1.6% -1.1% +2.7% +16.3% ➖ noise
16 duckdb:vortex-file-compressed +2.2% -1.1% +3.4% +10.0% ➖ noise
17 datafusion:vortex-compact +9.6% +2.9% +6.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -8.4% +2.9% -11.0% +10.0% ✅ faster
17 duckdb:duckdb +3.3% +2.9% +0.4% +10.0% ➖ noise
17 duckdb:vortex-compact +4.2% +2.9% +1.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.2% +2.9% +0.2% +18.9% ➖ noise
18 datafusion:vortex-compact -4.2% +2.8% -6.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -6.4% +2.8% -8.9% +10.0% ➖ noise
18 duckdb:duckdb +0.2% +2.8% -2.5% +11.6% ➖ noise
18 duckdb:vortex-compact -2.6% +2.8% -5.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.2% +2.8% -1.6% +10.0% ➖ noise
19 datafusion:vortex-compact +20.1% +0.0% +20.1% +11.2% 🚨 regression
19 datafusion:vortex-file-compressed -7.9% +0.0% -7.9% +10.0% ➖ noise
19 duckdb:duckdb +1.0% +0.0% +1.0% +13.5% ➖ noise
19 duckdb:vortex-compact +5.1% +0.0% +5.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.4% +0.0% +1.4% +10.0% ➖ noise
20 datafusion:vortex-compact +1.6% -3.9% +5.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.6% -3.9% -2.9% +12.1% ➖ noise
20 duckdb:duckdb +1.3% -3.9% +5.4% +10.5% ➖ noise
20 duckdb:vortex-compact +0.1% -3.9% +4.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +2.5% -3.9% +6.7% +12.1% ➖ noise
21 datafusion:vortex-compact -1.4% +1.2% -2.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.5% +1.2% -0.7% +10.3% ➖ noise
21 duckdb:duckdb -14.0% +1.2% -15.0% +15.0% ✅ faster
21 duckdb:vortex-compact -11.6% +1.2% -12.6% +10.1% ✅ faster
21 duckdb:vortex-file-compressed -0.8% +1.2% -2.0% +10.5% ➖ noise
22 datafusion:vortex-compact +1.2% +2.6% -1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.8% +2.6% -7.2% +10.7% ➖ noise
22 duckdb:duckdb -1.7% +2.6% -4.2% +10.0% ➖ noise
22 duckdb:vortex-compact +5.5% +2.6% +2.8% +10.1% ➖ noise
22 duckdb:vortex-file-compressed +5.6% +2.6% +2.9% +10.0% ➖ noise
23 datafusion:vortex-compact +14.1% -1.7% +16.1% +10.0% 🚨 regression
23 datafusion:vortex-file-compressed -1.1% -1.7% +0.6% +10.0% ➖ noise
23 duckdb:duckdb -7.4% -1.7% -5.7% +13.5% ➖ noise
23 duckdb:vortex-compact +8.9% -1.7% +10.8% +17.1% ➖ noise
23 duckdb:vortex-file-compressed -0.4% -1.7% +1.3% +10.0% ➖ noise
24 datafusion:vortex-compact +7.6% -0.4% +8.1% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.4% -0.4% -2.0% +10.0% ➖ noise
24 duckdb:duckdb +1.7% -0.4% +2.2% +10.0% ➖ noise
24 duckdb:vortex-compact +4.2% -0.4% +4.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.6% -0.4% +2.1% +10.0% ➖ noise
25 datafusion:vortex-compact +8.8% +0.6% +8.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -9.9% +0.6% -10.5% +10.0% ✅ faster
25 duckdb:duckdb +3.9% +0.6% +3.3% +11.0% ➖ noise
25 duckdb:vortex-compact -5.7% +0.6% -6.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.9% +0.6% -1.4% +10.0% ➖ noise
26 datafusion:vortex-compact -8.6% -2.8% -5.9% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -10.8% -2.8% -8.2% +11.4% ➖ noise
26 duckdb:duckdb +0.7% -2.8% +3.6% +12.9% ➖ noise
26 duckdb:vortex-compact +6.0% -2.8% +9.1% +11.8% ➖ noise
26 duckdb:vortex-file-compressed -3.6% -2.8% -0.8% +15.2% ➖ noise
27 datafusion:vortex-compact +16.4% +1.5% +14.7% +10.0% 🚨 regression
27 datafusion:vortex-file-compressed +3.2% +1.5% +1.7% +13.8% ➖ noise
27 duckdb:duckdb +2.7% +1.5% +1.3% +17.1% ➖ noise
27 duckdb:vortex-compact -0.8% +1.5% -2.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +3.4% +1.5% +1.9% +18.9% ➖ noise
28 datafusion:vortex-compact +7.2% -0.0% +7.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +5.0% -0.0% +5.1% +10.0% ➖ noise
28 duckdb:duckdb -2.4% -0.0% -2.4% +10.0% ➖ noise
28 duckdb:vortex-compact +3.8% -0.0% +3.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.4% -0.0% +1.4% +10.0% ➖ noise
29 datafusion:vortex-compact +6.8% -0.7% +7.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -10.1% -0.7% -9.5% +10.0% ✅ faster
29 duckdb:duckdb +4.7% -0.7% +5.4% +13.9% ➖ noise
29 duckdb:vortex-compact +3.7% -0.7% +4.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +3.3% -0.7% +4.0% +14.9% ➖ noise
30 datafusion:vortex-compact +1.7% +0.9% +0.7% +10.6% ➖ noise
30 datafusion:vortex-file-compressed +1.4% +0.9% +0.5% +10.0% ➖ noise
30 duckdb:duckdb +4.5% +0.9% +3.6% +10.0% ➖ noise
30 duckdb:vortex-compact -4.2% +0.9% -5.1% +11.8% ➖ noise
30 duckdb:vortex-file-compressed -0.6% +0.9% -1.5% +11.2% ➖ noise
31 datafusion:vortex-compact +12.9% -0.7% +13.8% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed -9.2% -0.7% -8.5% +10.0% ➖ noise
31 duckdb:duckdb +0.5% -0.7% +1.2% +10.4% ➖ noise
31 duckdb:vortex-compact +2.4% -0.7% +3.2% +13.8% ➖ noise
31 duckdb:vortex-file-compressed +1.6% -0.7% +2.3% +11.1% ➖ noise
32 datafusion:vortex-compact -11.8% +0.5% -12.2% +10.9% ✅ faster
32 datafusion:vortex-file-compressed -16.8% +0.5% -17.3% +10.0% ✅ faster
32 duckdb:duckdb +3.0% +0.5% +2.5% +14.8% ➖ noise
32 duckdb:vortex-compact +1.1% +0.5% +0.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.0% +0.5% +0.5% +10.0% ➖ noise
33 datafusion:vortex-compact +27.3% +5.1% +21.2% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed -6.6% +5.1% -11.2% +10.0% ✅ faster
33 duckdb:duckdb +1.3% +5.1% -3.6% +10.0% ➖ noise
33 duckdb:vortex-compact -2.0% +5.1% -6.8% +12.0% ➖ noise
33 duckdb:vortex-file-compressed -0.4% +5.1% -5.2% +10.0% ➖ noise
34 datafusion:vortex-compact +29.1% -0.3% +29.5% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed -6.1% -0.3% -5.8% +11.5% ➖ noise
34 duckdb:duckdb -0.0% -0.3% +0.3% +11.0% ➖ noise
34 duckdb:vortex-compact -1.7% -0.3% -1.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +9.7% -0.3% +10.0% +13.6% ➖ noise
35 datafusion:vortex-compact +12.9% +0.4% +12.5% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed -13.1% +0.4% -13.4% +10.0% ✅ faster
35 duckdb:duckdb +6.7% +0.4% +6.3% +12.8% ➖ noise
35 duckdb:vortex-compact -2.5% +0.4% -2.9% +10.7% ➖ noise
35 duckdb:vortex-file-compressed +5.2% +0.4% +4.8% +11.7% ➖ noise
36 datafusion:vortex-compact +11.2% -0.8% +12.1% +10.0% 🚨 regression
36 datafusion:vortex-file-compressed -2.2% -0.8% -1.5% +10.0% ➖ noise
36 duckdb:duckdb +2.3% -0.8% +3.1% +10.0% ➖ noise
36 duckdb:vortex-compact -3.2% -0.8% -2.4% +10.4% ➖ noise
36 duckdb:vortex-file-compressed -0.9% -0.8% -0.1% +10.0% ➖ noise
37 datafusion:vortex-compact -2.7% +5.0% -7.3% +11.3% ➖ noise
37 datafusion:vortex-file-compressed -1.3% +5.0% -6.0% +11.0% ➖ noise
37 duckdb:duckdb -0.5% +5.0% -5.2% +14.5% ➖ noise
37 duckdb:vortex-compact +3.4% +5.0% -1.5% +21.2% ➖ noise
37 duckdb:vortex-file-compressed -1.9% +5.0% -6.6% +10.0% ➖ noise
38 datafusion:vortex-compact +7.9% +0.8% +7.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -12.6% +0.8% -13.2% +10.0% ✅ faster
38 duckdb:duckdb +3.6% +0.8% +2.8% +10.0% ➖ noise
38 duckdb:vortex-compact +5.3% +0.8% +4.5% +13.0% ➖ noise
38 duckdb:vortex-file-compressed +12.3% +0.8% +11.4% +16.2% ➖ noise
39 datafusion:vortex-compact +5.9% -0.8% +6.7% +13.5% ➖ noise
39 datafusion:vortex-file-compressed -10.9% -0.8% -10.2% +14.5% ➖ noise
39 duckdb:duckdb +6.5% -0.8% +7.4% +18.4% ➖ noise
39 duckdb:vortex-compact -1.3% -0.8% -0.5% +15.6% ➖ noise
39 duckdb:vortex-file-compressed +1.0% -0.8% +1.8% +12.7% ➖ noise
40 datafusion:vortex-compact -0.7% +0.5% -1.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -4.4% +0.5% -4.9% +10.2% ➖ noise
40 duckdb:duckdb -2.8% +0.5% -3.3% +13.7% ➖ noise
40 duckdb:vortex-compact -4.4% +0.5% -4.8% +10.7% ➖ noise
40 duckdb:vortex-file-compressed -5.0% +0.5% -5.4% +10.8% ➖ noise
41 datafusion:vortex-compact -2.2% +0.6% -2.7% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -7.1% +0.6% -7.6% +10.0% ➖ noise
41 duckdb:duckdb +14.9% +0.6% +14.3% +10.2% 🚨 regression
41 duckdb:vortex-compact -1.1% +0.6% -1.7% +13.0% ➖ noise
41 duckdb:vortex-file-compressed +3.4% +0.6% +2.8% +10.0% ➖ noise
42 datafusion:vortex-compact +6.1% +6.2% -0.1% +20.4% ➖ noise
42 datafusion:vortex-file-compressed -10.7% +6.2% -15.8% +27.6% ➖ noise
42 duckdb:duckdb +1.3% +6.2% -4.6% +14.2% ➖ noise
42 duckdb:vortex-compact -2.4% +6.2% -8.0% +12.7% ➖ noise
42 duckdb:vortex-file-compressed +5.1% +6.2% -1.0% +10.0% ➖ noise
43 datafusion:vortex-compact +5.5% -1.7% +7.2% +12.3% ➖ noise
43 datafusion:vortex-file-compressed -2.9% -1.7% -1.3% +10.0% ➖ noise
43 duckdb:duckdb +4.3% -1.7% +6.1% +11.8% ➖ noise
43 duckdb:vortex-compact +4.8% -1.7% +6.5% +12.4% ➖ noise
43 duckdb:vortex-file-compressed +10.8% -1.7% +12.6% +19.0% ➖ noise
44 datafusion:vortex-compact +31.3% +3.2% +27.2% +10.0% 🚨 regression
44 datafusion:vortex-file-compressed -10.8% +3.2% -13.6% +12.1% ✅ faster
44 duckdb:duckdb +5.5% +3.2% +2.2% +12.5% ➖ noise
44 duckdb:vortex-compact -3.5% +3.2% -6.5% +11.1% ➖ noise
44 duckdb:vortex-file-compressed -1.6% +3.2% -4.7% +10.1% ➖ noise
45 datafusion:vortex-compact -6.0% +0.7% -6.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -7.8% +0.7% -8.5% +10.0% ➖ noise
45 duckdb:duckdb -4.5% +0.7% -5.2% +10.6% ➖ noise
45 duckdb:vortex-compact -1.2% +0.7% -1.9% +11.5% ➖ noise
45 duckdb:vortex-file-compressed +1.4% +0.7% +0.6% +11.1% ➖ noise
46 datafusion:vortex-compact +31.4% +1.5% +29.5% +10.0% 🚨 regression
46 datafusion:vortex-file-compressed -7.4% +1.5% -8.8% +10.0% ➖ noise
46 duckdb:duckdb +1.5% +1.5% +0.1% +10.0% ➖ noise
46 duckdb:vortex-compact +1.5% +1.5% +0.0% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +2.3% +1.5% +0.8% +10.0% ➖ noise
47 datafusion:vortex-compact +6.3% -1.1% +7.5% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -1.9% -1.1% -0.8% +10.0% ➖ noise
47 duckdb:duckdb +2.5% -1.1% +3.6% +10.0% ➖ noise
47 duckdb:vortex-compact -0.6% -1.1% +0.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +4.0% -1.1% +5.2% +11.5% ➖ noise
48 datafusion:vortex-compact +17.4% -0.7% +18.2% +10.0% 🚨 regression
48 datafusion:vortex-file-compressed -1.6% -0.7% -1.0% +10.0% ➖ noise
48 duckdb:duckdb -5.3% -0.7% -4.6% +10.0% ➖ noise
48 duckdb:vortex-compact -1.1% -0.7% -0.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +0.3% -0.7% +1.0% +10.0% ➖ noise
49 datafusion:vortex-compact +16.2% +0.4% +15.8% +15.0% 🚨 regression
49 datafusion:vortex-file-compressed -2.4% +0.4% -2.8% +13.6% ➖ noise
49 duckdb:duckdb +3.8% +0.4% +3.4% +16.4% ➖ noise
49 duckdb:vortex-compact -5.2% +0.4% -5.6% +15.9% ➖ noise
49 duckdb:vortex-file-compressed +2.6% +0.4% +2.2% +16.0% ➖ noise
50 datafusion:vortex-compact +16.2% +1.0% +15.0% +10.0% 🚨 regression
50 datafusion:vortex-file-compressed -8.7% +1.0% -9.7% +10.0% ✅ faster
50 duckdb:duckdb +2.8% +1.0% +1.8% +10.0% ➖ noise
50 duckdb:vortex-compact +2.8% +1.0% +1.7% +10.9% ➖ noise
50 duckdb:vortex-file-compressed +1.8% +1.0% +0.8% +10.0% ➖ noise
51 datafusion:vortex-compact -2.3% -1.0% -1.3% +12.3% ➖ noise
51 datafusion:vortex-file-compressed -6.9% -1.0% -6.0% +11.5% ➖ noise
51 duckdb:duckdb +1.8% -1.0% +2.9% +25.4% ➖ noise
51 duckdb:vortex-compact -0.8% -1.0% +0.2% +17.8% ➖ noise
51 duckdb:vortex-file-compressed -1.9% -1.0% -1.0% +15.7% ➖ noise
52 datafusion:vortex-compact +4.4% -0.9% +5.3% +10.1% ➖ noise
52 datafusion:vortex-file-compressed -17.7% -0.9% -16.9% +10.8% ✅ faster
52 duckdb:duckdb -0.3% -0.9% +0.6% +15.0% ➖ noise
52 duckdb:vortex-compact -4.3% -0.9% -3.5% +10.0% ➖ noise
52 duckdb:vortex-file-compressed -0.7% -0.9% +0.1% +10.4% ➖ noise
53 datafusion:vortex-compact +14.1% +0.7% +13.3% +10.0% 🚨 regression
53 datafusion:vortex-file-compressed -11.0% +0.7% -11.6% +11.6% ✅ faster
53 duckdb:duckdb -0.7% +0.7% -1.3% +10.8% ➖ noise
53 duckdb:vortex-compact +1.3% +0.7% +0.6% +14.2% ➖ noise
53 duckdb:vortex-file-compressed +8.0% +0.7% +7.2% +10.0% ➖ noise
54 datafusion:vortex-compact +18.9% -1.2% +20.3% +10.0% 🚨 regression
54 datafusion:vortex-file-compressed -9.8% -1.2% -8.7% +10.0% ➖ noise
54 duckdb:duckdb +8.2% -1.2% +9.5% +10.0% ➖ noise
54 duckdb:vortex-compact +6.0% -1.2% +7.3% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +6.4% -1.2% +7.7% +14.0% ➖ noise
55 datafusion:vortex-compact -1.6% +0.9% -2.5% +17.1% ➖ noise
55 datafusion:vortex-file-compressed -8.9% +0.9% -9.8% +10.7% ✅ faster
55 duckdb:duckdb +5.8% +0.9% +4.8% +14.5% ➖ noise
55 duckdb:vortex-compact -0.3% +0.9% -1.2% +15.7% ➖ noise
55 duckdb:vortex-file-compressed -6.8% +0.9% -7.7% +16.4% ➖ noise
56 datafusion:vortex-compact +24.3% +0.8% +23.3% +10.0% 🚨 regression
56 datafusion:vortex-file-compressed -7.6% +0.8% -8.3% +10.0% ➖ noise
56 duckdb:duckdb +4.1% +0.8% +3.2% +10.0% ➖ noise
56 duckdb:vortex-compact +5.3% +0.8% +4.5% +14.0% ➖ noise
56 duckdb:vortex-file-compressed +0.2% +0.8% -0.6% +10.0% ➖ noise
57 datafusion:vortex-compact +4.4% -3.8% +8.5% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -4.0% -3.8% -0.2% +10.0% ➖ noise
57 duckdb:duckdb +1.3% -3.8% +5.3% +26.2% ➖ noise
57 duckdb:vortex-compact -1.0% -3.8% +2.9% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -1.0% -3.8% +2.9% +10.9% ➖ noise
58 datafusion:vortex-compact +0.6% +3.5% -2.9% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -5.7% +3.5% -8.9% +10.0% ➖ noise
58 duckdb:duckdb -5.2% +3.5% -8.5% +13.4% ➖ noise
58 duckdb:vortex-compact -8.5% +3.5% -11.6% +15.3% ➖ noise
58 duckdb:vortex-file-compressed +1.3% +3.5% -2.2% +13.1% ➖ noise
59 datafusion:vortex-compact +9.0% -0.6% +9.6% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -5.0% -0.6% -4.5% +10.0% ➖ noise
59 duckdb:duckdb +0.4% -0.6% +1.0% +10.0% ➖ noise
59 duckdb:vortex-compact -1.8% -0.6% -1.2% +14.0% ➖ noise
59 duckdb:vortex-file-compressed -3.0% -0.6% -2.4% +10.0% ➖ noise
60 datafusion:vortex-compact +23.6% -1.6% +25.6% +10.7% 🚨 regression
60 datafusion:vortex-file-compressed -6.7% -1.6% -5.2% +13.1% ➖ noise
60 duckdb:duckdb +9.4% -1.6% +11.2% +13.1% ➖ noise
60 duckdb:vortex-compact +3.3% -1.6% +5.0% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +0.8% -1.6% +2.4% +11.7% ➖ noise
61 datafusion:vortex-compact +13.4% +3.6% +9.4% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -9.2% +3.6% -12.4% +11.2% ✅ faster
61 duckdb:duckdb +1.9% +3.6% -1.6% +10.0% ➖ noise
61 duckdb:vortex-compact -2.5% +3.6% -5.8% +11.8% ➖ noise
61 duckdb:vortex-file-compressed +5.1% +3.6% +1.4% +16.6% ➖ noise
62 datafusion:vortex-compact +1.9% +15.5% -11.8% +15.8% ➖ noise
62 datafusion:vortex-file-compressed -4.4% +15.5% -17.3% +16.0% ✅ faster
62 duckdb:duckdb +6.5% +15.5% -7.8% +15.0% ➖ noise
62 duckdb:vortex-compact +9.8% +15.5% -4.9% +21.0% ➖ noise
62 duckdb:vortex-file-compressed +8.6% +15.5% -6.0% +20.8% ➖ noise
63 datafusion:vortex-compact +9.5% -1.5% +11.1% +10.0% 🚨 regression
63 datafusion:vortex-file-compressed -10.9% -1.5% -9.6% +10.0% ✅ faster
63 duckdb:duckdb +1.2% -1.5% +2.7% +10.8% ➖ noise
63 duckdb:vortex-compact +6.0% -1.5% +7.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +0.9% -1.5% +2.4% +15.4% ➖ noise
64 datafusion:vortex-compact +6.3% +1.7% +4.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -2.7% +1.7% -4.3% +10.0% ➖ noise
64 duckdb:duckdb -0.7% +1.7% -2.4% +11.7% ➖ noise
64 duckdb:vortex-compact +3.2% +1.7% +1.5% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +5.7% +1.7% +3.9% +10.0% ➖ noise
65 datafusion:vortex-compact +14.6% +0.4% +14.2% +14.1% 🚨 regression
65 datafusion:vortex-file-compressed -10.3% +0.4% -10.6% +15.8% ➖ noise
65 duckdb:duckdb -1.2% +0.4% -1.5% +16.8% ➖ noise
65 duckdb:vortex-compact -0.6% +0.4% -1.0% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +12.4% +0.4% +12.0% +13.2% ➖ noise
66 datafusion:vortex-compact +6.4% +4.3% +2.0% +11.1% ➖ noise
66 datafusion:vortex-file-compressed -0.3% +4.3% -4.4% +12.8% ➖ noise
66 duckdb:duckdb +0.2% +4.3% -3.9% +19.7% ➖ noise
66 duckdb:vortex-compact -2.6% +4.3% -6.6% +10.7% ➖ noise
66 duckdb:vortex-file-compressed -1.6% +4.3% -5.6% +12.7% ➖ noise
67 datafusion:vortex-compact +8.7% +0.8% +7.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -3.0% +0.8% -3.8% +10.0% ➖ noise
67 duckdb:duckdb +4.1% +0.8% +3.3% +10.0% ➖ noise
67 duckdb:vortex-compact +3.1% +0.8% +2.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.2% +0.8% -0.6% +10.0% ➖ noise
68 datafusion:vortex-compact +26.8% +0.5% +26.1% +10.0% 🚨 regression
68 datafusion:vortex-file-compressed -3.8% +0.5% -4.3% +10.0% ➖ noise
68 duckdb:duckdb +1.4% +0.5% +0.9% +12.6% ➖ noise
68 duckdb:vortex-compact -2.7% +0.5% -3.2% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -1.6% +0.5% -2.0% +10.2% ➖ noise
69 datafusion:vortex-compact +11.9% +0.7% +11.1% +10.0% 🚨 regression
69 datafusion:vortex-file-compressed -11.6% +0.7% -12.2% +13.5% ✅ faster
69 duckdb:duckdb -1.7% +0.7% -2.3% +12.6% ➖ noise
69 duckdb:vortex-compact -1.0% +0.7% -1.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +2.1% +0.7% +1.4% +13.3% ➖ noise
70 datafusion:vortex-compact +3.9% +2.7% +1.2% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -0.7% +2.7% -3.3% +10.0% ➖ noise
70 duckdb:duckdb +3.8% +2.7% +1.1% +16.0% ➖ noise
70 duckdb:vortex-compact -1.2% +2.7% -3.8% +12.1% ➖ noise
70 duckdb:vortex-file-compressed +5.6% +2.7% +2.9% +21.5% ➖ noise
71 datafusion:vortex-compact +31.6% +1.7% +29.4% +10.0% 🚨 regression
71 datafusion:vortex-file-compressed -1.3% +1.7% -3.0% +10.0% ➖ noise
71 duckdb:duckdb -1.7% +1.7% -3.4% +15.6% ➖ noise
71 duckdb:vortex-compact +3.8% +1.7% +2.1% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +1.4% +1.7% -0.3% +15.6% ➖ noise
72 datafusion:vortex-compact +1.2% -0.2% +1.4% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.9% -0.2% +2.1% +10.0% ➖ noise
72 duckdb:duckdb +7.1% -0.2% +7.4% +10.0% ➖ noise
72 duckdb:vortex-compact -0.8% -0.2% -0.6% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.2% -0.2% +1.4% +10.0% ➖ noise
73 datafusion:vortex-compact +28.0% +2.6% +24.7% +12.6% 🚨 regression
73 datafusion:vortex-file-compressed -3.1% +2.6% -5.6% +41.1% ➖ noise
73 duckdb:duckdb -0.5% +2.6% -3.1% +15.5% ➖ noise
73 duckdb:vortex-compact +2.6% +2.6% -0.1% +11.8% ➖ noise
73 duckdb:vortex-file-compressed +4.7% +2.6% +2.1% +12.6% ➖ noise
74 datafusion:vortex-compact +5.2% +1.8% +3.3% +10.2% ➖ noise
74 datafusion:vortex-file-compressed +0.3% +1.8% -1.5% +11.4% ➖ noise
74 duckdb:duckdb +2.3% +1.8% +0.4% +10.0% ➖ noise
74 duckdb:vortex-compact -5.3% +1.8% -7.0% +27.0% ➖ noise
74 duckdb:vortex-file-compressed +18.4% +1.8% +16.2% +25.6% ➖ noise
75 datafusion:vortex-compact +14.8% -1.8% +16.9% +10.0% 🚨 regression
75 datafusion:vortex-file-compressed +0.9% -1.8% +2.8% +10.0% ➖ noise
75 duckdb:duckdb -0.1% -1.8% +1.7% +10.0% ➖ noise
75 duckdb:vortex-compact -2.9% -1.8% -1.1% +14.0% ➖ noise
75 duckdb:vortex-file-compressed +4.4% -1.8% +6.3% +11.3% ➖ noise
76 datafusion:vortex-compact +26.0% +1.0% +24.7% +10.0% 🚨 regression
76 datafusion:vortex-file-compressed -0.6% +1.0% -1.6% +10.0% ➖ noise
76 duckdb:duckdb +3.7% +1.0% +2.6% +19.0% ➖ noise
76 duckdb:vortex-compact +1.5% +1.0% +0.4% +11.5% ➖ noise
76 duckdb:vortex-file-compressed +5.0% +1.0% +4.0% +10.0% ➖ noise
77 datafusion:vortex-compact +5.4% -0.1% +5.4% +10.2% ➖ noise
77 datafusion:vortex-file-compressed -5.3% -0.1% -5.3% +10.8% ➖ noise
77 duckdb:duckdb +1.8% -0.1% +1.8% +11.9% ➖ noise
77 duckdb:vortex-compact +6.9% -0.1% +6.9% +13.7% ➖ noise
77 duckdb:vortex-file-compressed -4.8% -0.1% -4.8% +12.1% ➖ noise
78 datafusion:vortex-compact +2.2% +2.1% +0.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -8.0% +2.1% -9.9% +10.0% ✅ faster
78 duckdb:duckdb -1.9% +2.1% -3.9% +10.0% ➖ noise
78 duckdb:vortex-compact -8.9% +2.1% -10.8% +10.0% ✅ faster
78 duckdb:vortex-file-compressed -4.7% +2.1% -6.6% +10.0% ➖ noise
79 datafusion:vortex-compact +31.3% +0.0% +31.2% +10.0% 🚨 regression
79 datafusion:vortex-file-compressed -7.9% +0.0% -7.9% +10.0% ➖ noise
79 duckdb:duckdb +1.9% +0.0% +1.9% +10.0% ➖ noise
79 duckdb:vortex-compact +4.5% +0.0% +4.5% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.5% +0.0% -0.5% +10.0% ➖ noise
80 datafusion:vortex-compact +10.2% +1.0% +9.1% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
80 duckdb:duckdb +2.7% +1.0% +1.6% +11.8% ➖ noise
80 duckdb:vortex-compact -4.0% +1.0% -4.9% +11.5% ➖ noise
80 duckdb:vortex-file-compressed +2.8% +1.0% +1.8% +14.0% ➖ noise
81 datafusion:vortex-compact +7.2% +1.0% +6.2% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +4.4% +1.0% +3.4% +11.4% ➖ noise
81 duckdb:duckdb -1.1% +1.0% -2.0% +12.0% ➖ noise
81 duckdb:vortex-compact -0.8% +1.0% -1.7% +14.5% ➖ noise
81 duckdb:vortex-file-compressed -7.1% +1.0% -8.0% +12.8% ➖ noise
82 datafusion:vortex-compact +4.8% -1.7% +6.6% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.6% -1.7% +1.1% +10.5% ➖ noise
82 duckdb:duckdb -2.8% -1.7% -1.1% +12.0% ➖ noise
82 duckdb:vortex-compact +5.3% -1.7% +7.1% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -3.8% -1.7% -2.1% +10.0% ➖ noise
83 datafusion:vortex-compact -3.1% -1.2% -2.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -9.7% -1.2% -8.6% +10.6% ➖ noise
83 duckdb:duckdb +4.2% -1.2% +5.4% +10.4% ➖ noise
83 duckdb:vortex-compact +1.5% -1.2% +2.7% +10.8% ➖ noise
83 duckdb:vortex-file-compressed +3.8% -1.2% +5.0% +10.0% ➖ noise
84 datafusion:vortex-compact -7.1% -1.1% -6.0% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -8.4% -1.1% -7.4% +15.8% ➖ noise
84 duckdb:duckdb +3.7% -1.1% +4.9% +10.0% ➖ noise
84 duckdb:vortex-compact -0.9% -1.1% +0.3% +13.9% ➖ noise
84 duckdb:vortex-file-compressed +3.7% -1.1% +4.9% +10.0% ➖ noise
85 datafusion:vortex-compact -2.4% -1.8% -0.6% +10.5% ➖ noise
85 datafusion:vortex-file-compressed -5.7% -1.8% -4.0% +10.0% ➖ noise
85 duckdb:duckdb +1.2% -1.8% +3.0% +12.9% ➖ noise
85 duckdb:vortex-compact +3.6% -1.8% +5.5% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +5.8% -1.8% +7.7% +10.5% ➖ noise
86 datafusion:vortex-compact -6.1% -2.5% -3.8% +10.8% ➖ noise
86 datafusion:vortex-file-compressed -8.4% -2.5% -6.1% +13.0% ➖ noise
86 duckdb:duckdb -3.0% -2.5% -0.6% +14.3% ➖ noise
86 duckdb:vortex-compact +10.2% -2.5% +13.0% +11.1% 🚨 regression
86 duckdb:vortex-file-compressed +2.1% -2.5% +4.7% +11.8% ➖ noise
87 datafusion:vortex-compact +10.8% +2.5% +8.1% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -11.3% +2.5% -13.5% +10.0% ✅ faster
87 duckdb:duckdb -5.2% +2.5% -7.6% +15.0% ➖ noise
87 duckdb:vortex-compact +4.7% +2.5% +2.1% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +2.7% +2.5% +0.2% +10.8% ➖ noise
88 datafusion:vortex-compact +65.7% -0.3% +66.2% +10.0% 🚨 regression
88 datafusion:vortex-file-compressed -5.3% -0.3% -5.0% +10.0% ➖ noise
88 duckdb:duckdb +2.7% -0.3% +3.1% +10.0% ➖ noise
88 duckdb:vortex-compact +0.8% -0.3% +1.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +1.3% -0.3% +1.7% +10.0% ➖ noise
89 datafusion:vortex-compact +9.5% -0.2% +9.7% +14.0% ➖ noise
89 datafusion:vortex-file-compressed -3.1% -0.2% -2.9% +10.9% ➖ noise
89 duckdb:duckdb +2.2% -0.2% +2.3% +10.0% ➖ noise
89 duckdb:vortex-compact +3.8% -0.2% +3.9% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +7.0% -0.2% +7.2% +10.3% ➖ noise
90 datafusion:vortex-compact +37.1% +6.5% +28.7% +16.4% 🚨 regression
90 datafusion:vortex-file-compressed -7.3% +6.5% -13.0% +10.4% ✅ faster
90 duckdb:duckdb +5.6% +6.5% -0.9% +10.0% ➖ noise
90 duckdb:vortex-compact -0.1% +6.5% -6.3% +10.4% ➖ noise
90 duckdb:vortex-file-compressed +0.7% +6.5% -5.5% +10.6% ➖ noise
91 datafusion:vortex-compact +1.9% -2.5% +4.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -3.4% -2.5% -0.9% +10.0% ➖ noise
91 duckdb:duckdb +1.6% -2.5% +4.2% +12.6% ➖ noise
91 duckdb:vortex-compact -1.3% -2.5% +1.2% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -3.7% -2.5% -1.2% +10.0% ➖ noise
92 datafusion:vortex-compact -4.3% +5.0% -8.8% +15.1% ➖ noise
92 datafusion:vortex-file-compressed -21.5% +5.0% -25.2% +11.4% ✅ faster
92 duckdb:duckdb +1.2% +5.0% -3.6% +10.2% ➖ noise
92 duckdb:vortex-compact +5.9% +5.0% +0.8% +12.0% ➖ noise
92 duckdb:vortex-file-compressed +20.7% +5.0% +15.0% +18.9% ➖ noise
93 datafusion:vortex-compact +10.4% +1.5% +8.7% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -11.9% +1.5% -13.3% +10.0% ✅ faster
93 duckdb:duckdb +4.4% +1.5% +2.8% +12.6% ➖ noise
93 duckdb:vortex-compact -5.5% +1.5% -7.0% +10.6% ➖ noise
93 duckdb:vortex-file-compressed -8.6% +1.5% -10.0% +10.0% ✅ faster
94 datafusion:vortex-compact +2.1% +4.9% -2.7% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -21.1% +4.9% -24.8% +12.1% ✅ faster
94 duckdb:duckdb +8.7% +4.9% +3.6% +10.0% ➖ noise
94 duckdb:vortex-compact +2.7% +4.9% -2.1% +10.3% ➖ noise
94 duckdb:vortex-file-compressed +4.2% +4.9% -0.7% +11.3% ➖ noise
95 datafusion:vortex-compact +0.5% -0.6% +1.1% +12.5% ➖ noise
95 datafusion:vortex-file-compressed -13.7% -0.6% -13.2% +13.3% ✅ faster
95 duckdb:duckdb -2.1% -0.6% -1.5% +18.3% ➖ noise
95 duckdb:vortex-compact -6.7% -0.6% -6.1% +13.7% ➖ noise
95 duckdb:vortex-file-compressed +9.1% -0.6% +9.8% +15.8% ➖ noise
96 datafusion:vortex-compact +35.0% -3.3% +39.6% +10.0% 🚨 regression
96 datafusion:vortex-file-compressed -8.7% -3.3% -5.6% +10.0% ➖ noise
96 duckdb:duckdb +1.2% -3.3% +4.7% +15.1% ➖ noise
96 duckdb:vortex-compact -1.9% -3.3% +1.4% +17.8% ➖ noise
96 duckdb:vortex-file-compressed +6.0% -3.3% +9.6% +12.7% ➖ noise
97 datafusion:vortex-compact +6.8% +2.7% +3.9% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -16.1% +2.7% -18.3% +10.0% ✅ faster
97 duckdb:duckdb -4.0% +2.7% -6.5% +11.8% ➖ noise
97 duckdb:vortex-compact +2.1% +2.7% -0.6% +13.7% ➖ noise
97 duckdb:vortex-file-compressed -1.3% +2.7% -3.9% +10.4% ➖ noise
98 datafusion:vortex-compact +5.8% -0.2% +6.0% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -2.2% -0.2% -2.0% +10.0% ➖ noise
98 duckdb:duckdb +4.9% -0.2% +5.1% +13.4% ➖ noise
98 duckdb:vortex-compact +2.9% -0.2% +3.0% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -1.0% -0.2% -0.9% +10.0% ➖ noise
99 datafusion:vortex-compact +1.4% -2.1% +3.6% +17.7% ➖ noise
99 datafusion:vortex-file-compressed +8.6% -2.1% +10.9% +18.3% ➖ noise
99 duckdb:duckdb +38.8% -2.1% +41.8% +36.4% 🚨 regression
99 duckdb:vortex-compact +3.0% -2.1% +5.2% +22.9% ➖ noise
99 duckdb:vortex-file-compressed +4.1% -2.1% +6.3% +23.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.0%
Vortex (geomean): 1.045x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.3%


datafusion / vortex-file-compressed (1.070x ➖, 0↑ 2↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 35469386 39228831 0.90
fineweb_q01/datafusion:vortex-file-compressed 🚨 1007545220 559158516 1.80
fineweb_q02/datafusion:vortex-file-compressed 🚨 807436317 613150956 1.32
fineweb_q03/datafusion:vortex-file-compressed 1387890650 1488342651 0.93
fineweb_q04/datafusion:vortex-file-compressed 1349308528 1396552812 0.97
fineweb_q05/datafusion:vortex-file-compressed 1329494856 1358065182 0.98
fineweb_q06/datafusion:vortex-file-compressed 1452868540 1540777229 0.94
fineweb_q07/datafusion:vortex-file-compressed 1374990188 1326531160 1.04
fineweb_q08/datafusion:vortex-file-compressed 524210368 527395268 0.99
datafusion / vortex-compact (1.144x ➖, 0↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 38854343 34761586 1.12
fineweb_q01/datafusion:vortex-compact 567415648 604762754 0.94
fineweb_q02/datafusion:vortex-compact 🚨 701669255 524355844 1.34
fineweb_q03/datafusion:vortex-compact 1834166164 1456408706 1.26
fineweb_q04/datafusion:vortex-compact 2236160674 1815546024 1.23
fineweb_q05/datafusion:vortex-compact 1670966244 1452815731 1.15
fineweb_q06/datafusion:vortex-compact 1555691520 1354988327 1.15
fineweb_q07/datafusion:vortex-compact 1298599322 1190252514 1.09
fineweb_q08/datafusion:vortex-compact 408229775 381606044 1.07
datafusion / parquet (0.976x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1517832037 2039712867 0.74
fineweb_q01/datafusion:parquet 1761078455 2017705385 0.87
fineweb_q02/datafusion:parquet 1868499601 1751819489 1.07
fineweb_q03/datafusion:parquet 1761488460 1830046722 0.96
fineweb_q04/datafusion:parquet 1858313439 1789932797 1.04
fineweb_q05/datafusion:parquet 1828401699 1865896586 0.98
fineweb_q06/datafusion:parquet 1973509660 1853076604 1.06
fineweb_q07/datafusion:parquet 2041376235 2126716937 0.96
fineweb_q08/datafusion:parquet 2229284193 1924955745 1.16
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 84125534 86724022 0.97
fineweb_q01/duckdb:vortex-file-compressed 679876599 703847971 0.97
fineweb_q02/duckdb:vortex-file-compressed 503961365 467745977 1.08
fineweb_q03/duckdb:vortex-file-compressed 1516332058 1411372148 1.07
fineweb_q04/duckdb:vortex-file-compressed 1635882869 1500018484 1.09
fineweb_q05/duckdb:vortex-file-compressed 1512886114 1451562375 1.04
fineweb_q06/duckdb:vortex-file-compressed 1940919799 1612945635 1.20
fineweb_q07/duckdb:vortex-file-compressed 1454092656 1538506884 0.95
fineweb_q08/duckdb:vortex-file-compressed 679523465 721889386 0.94
duckdb / vortex-compact (0.946x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 96924109 86119286 1.13
fineweb_q01/duckdb:vortex-compact 550061726 577078836 0.95
fineweb_q02/duckdb:vortex-compact 591578536 844898069 0.70
fineweb_q03/duckdb:vortex-compact 1666698625 1687227987 0.99
fineweb_q04/duckdb:vortex-compact 1782170735 1741148360 1.02
fineweb_q05/duckdb:vortex-compact 1563662617 1586203593 0.99
fineweb_q06/duckdb:vortex-compact 1483588838 1515790680 0.98
fineweb_q07/duckdb:vortex-compact 1384716608 1339087926 1.03
fineweb_q08/duckdb:vortex-compact 474805198 590416133 0.80
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1073493040 1251357901 0.86
fineweb_q01/duckdb:parquet 1398215355 1371732779 1.02
fineweb_q02/duckdb:parquet 1334720388 1338768125 1.00
fineweb_q03/duckdb:parquet 3577666899 3515238227 1.02
fineweb_q04/duckdb:parquet 1884665253 1935961087 0.97
fineweb_q05/duckdb:parquet 2060551206 2074591994 0.99
fineweb_q06/duckdb:parquet 4181790736 4197256841 1.00
fineweb_q07/duckdb:parquet 2710863493 2671949178 1.01
fineweb_q08/duckdb:parquet 1179701348 1058702952 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +11.8% -20.1% +39.9% +199.6% ➖ noise
0 datafusion:vortex-file-compressed -9.6% -20.1% +13.2% +225.9% ➖ noise
0 duckdb:vortex-compact +12.5% -20.1% +40.9% +51.3% ➖ noise
0 duckdb:vortex-file-compressed -3.0% -20.1% +21.4% +62.9% ➖ noise
1 datafusion:vortex-compact -6.2% -5.7% -0.5% +103.5% ➖ noise
1 datafusion:vortex-file-compressed +80.2% -5.7% +91.0% +79.0% 🚨 regression
1 duckdb:vortex-compact -4.7% -5.7% +1.1% +94.1% ➖ noise
1 duckdb:vortex-file-compressed -3.4% -5.7% +2.4% +44.0% ➖ noise
2 datafusion:vortex-compact +33.8% +3.1% +29.8% +47.6% ➖ noise
2 datafusion:vortex-file-compressed +31.7% +3.1% +27.7% +65.3% ➖ noise
2 duckdb:vortex-compact -30.0% +3.1% -32.1% +37.8% ✅ faster
2 duckdb:vortex-file-compressed +7.7% +3.1% +4.5% +30.0% ➖ noise
3 datafusion:vortex-compact +25.9% -1.0% +27.2% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -6.7% -1.0% -5.8% +30.0% ➖ noise
3 duckdb:vortex-compact -1.2% -1.0% -0.2% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +7.4% -1.0% +8.5% +30.0% ➖ noise
4 datafusion:vortex-compact +23.2% +0.5% +22.5% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -3.4% +0.5% -3.9% +30.0% ➖ noise
4 duckdb:vortex-compact +2.4% +0.5% +1.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +9.1% +0.5% +8.5% +30.0% ➖ noise
5 datafusion:vortex-compact +15.0% -1.3% +16.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% -1.3% -0.8% +30.0% ➖ noise
5 duckdb:vortex-compact -1.4% -1.3% -0.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +4.2% -1.3% +5.6% +30.0% ➖ noise
6 datafusion:vortex-compact +14.8% +3.0% +11.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -5.7% +3.0% -8.5% +30.0% ➖ noise
6 duckdb:vortex-compact -2.1% +3.0% -5.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +20.3% +3.0% +16.8% +30.0% ➖ noise
7 datafusion:vortex-compact +9.1% -1.3% +10.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.7% -1.3% +5.0% +30.0% ➖ noise
7 duckdb:vortex-compact +3.4% -1.3% +4.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -5.5% -1.3% -4.2% +30.0% ➖ noise
8 datafusion:vortex-compact +7.0% +13.6% -5.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -0.6% +13.6% -12.5% +30.0% ➖ noise
8 duckdb:vortex-compact -19.6% +13.6% -29.2% +30.0% ✅ faster
8 duckdb:vortex-file-compressed -5.9% +13.6% -17.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.878x ✅
Parquet (geomean): 0.940x ➖


unknown / unknown (0.908x ➖, 20↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2231914 2840412 0.79
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀 1091296 1214066 0.90
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8420241508 8699537955 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8444126022 8602494929 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7711558 9185416 0.84
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 6997860 8089954 0.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚀 1283739 1525199 0.84
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀 1997431 2338746 0.85
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8540588847 8696373645 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8452278284 8676316454 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13028558 14070667 0.93
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12865044 13874805 0.93
random-access/lance-tokio-local-disk 695976 747102 0.93
random-access/lance-tokio-local-disk-footer 1193611 1319446 0.90
random-access/nested-lists/correlated/lance-tokio-local-disk 248259 260442 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚀 633347 720556 0.88
random-access/nested-lists/correlated/parquet-tokio-local-disk 131003788 136801090 0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 130503391 137652368 0.95
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 595005 716603 0.83
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 596637 722751 0.83
random-access/nested-lists/uniform/lance-tokio-local-disk 1074750 1147759 0.94
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1478351 1609744 0.92
random-access/nested-lists/uniform/parquet-tokio-local-disk 130229618 138664310 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130957087 138353260 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk 2132192 2309362 0.92
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2120287 2266044 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk 398891 431134 0.93
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 593171 644700 0.92
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 24815473 28804210 0.86
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 25422035 29042420 0.88
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 761143 874079 0.87
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 761658 805609 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk 2674214 2819752 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2874949 3082283 0.93
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 24822334 29022892 0.86
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 25665199 28620960 0.90
random-access/nested-structs/uniform/vortex-tokio-local-disk 1677081 1754915 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1636350 1788514 0.91
random-access/parquet-tokio-local-disk 177336215 186470244 0.95
random-access/parquet-tokio-local-disk-footer 176992752 184835066 0.96
random-access/taxi/correlated/lance-tokio-local-disk 914756 978773 0.93
random-access/taxi/correlated/lance-tokio-local-disk-footer 1480043 1602865 0.92
random-access/taxi/correlated/parquet-tokio-local-disk 265513427 273077272 0.97
random-access/taxi/correlated/parquet-tokio-local-disk-footer 265760910 274767703 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1550563 2036571 0.76
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1710024 2071106 0.83
random-access/taxi/uniform/lance-tokio-local-disk 7860459 8439494 0.93
random-access/taxi/uniform/lance-tokio-local-disk-footer 8373680 9009256 0.93
random-access/taxi/uniform/parquet-tokio-local-disk 280642305 294301692 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 278827695 294829972 0.95
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4454955 5050566 0.88
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4409967 4900528 0.90
random-access/vortex-tokio-local-disk 🚀 1190201 1402996 0.85
random-access/vortex-tokio-local-disk-footer 🚀 1218790 1421981 0.86

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.6%


duckdb / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11993898 11877893 1.01
statpopgen_q01/duckdb:vortex-file-compressed 27482332 26410807 1.04
statpopgen_q02/duckdb:vortex-file-compressed 1394366352 1377933986 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3132744618 3114783163 1.01
statpopgen_q04/duckdb:vortex-file-compressed 3203458293 3154771701 1.02
statpopgen_q05/duckdb:vortex-file-compressed 1463538352 1454236383 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2129766429 2151915454 0.99
statpopgen_q07/duckdb:vortex-file-compressed 226431831 223584672 1.01
statpopgen_q08/duckdb:vortex-file-compressed 264441670 263025235 1.01
statpopgen_q09/duckdb:vortex-file-compressed 2910121499 2893165500 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4682599184 4753842164 0.99
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11766564 11343005 1.04
statpopgen_q01/duckdb:vortex-compact 165652755 165902102 1.00
statpopgen_q02/duckdb:vortex-compact 1802349728 1806085880 1.00
statpopgen_q03/duckdb:vortex-compact 3474082573 3482392574 1.00
statpopgen_q04/duckdb:vortex-compact 3495619531 3481767199 1.00
statpopgen_q05/duckdb:vortex-compact 1845329331 1848710899 1.00
statpopgen_q06/duckdb:vortex-compact 2698903745 2660891506 1.01
statpopgen_q07/duckdb:vortex-compact 905542320 903562883 1.00
statpopgen_q08/duckdb:vortex-compact 942328320 927030731 1.02
statpopgen_q09/duckdb:vortex-compact 3288643294 3281020050 1.00
statpopgen_q10/duckdb:vortex-compact 5417197990 5310295332 1.02
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 323586773 329024381 0.98
statpopgen_q01/duckdb:parquet 408469584 405561120 1.01
statpopgen_q02/duckdb:parquet 986801886 993503418 0.99
statpopgen_q03/duckdb:parquet 1489838283 1505652547 0.99
statpopgen_q04/duckdb:parquet 1503314634 1498276171 1.00
statpopgen_q05/duckdb:parquet 1008870029 997296969 1.01
statpopgen_q06/duckdb:parquet 1482802142 1507823371 0.98
statpopgen_q07/duckdb:parquet 1305169386 1293782765 1.01
statpopgen_q08/duckdb:parquet 1326512159 1289218074 1.03
statpopgen_q09/duckdb:parquet 1388041363 1364451255 1.02
statpopgen_q10/duckdb:parquet 2701209643 2671077965 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.7% -1.7% +5.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +1.0% -1.7% +2.7% +11.6% ➖ noise
1 duckdb:vortex-compact -0.2% +0.7% -0.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +4.1% +0.7% +3.3% +189.5% ➖ noise
2 duckdb:vortex-compact -0.2% -0.7% +0.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.2% -0.7% +1.9% +10.0% ➖ noise
3 duckdb:vortex-compact -0.2% -1.1% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.6% -1.1% +1.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.4% +0.3% +0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.5% +0.3% +1.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.2% +1.2% -1.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.6% +1.2% -0.5% +10.0% ➖ noise
6 duckdb:vortex-compact +1.4% -1.7% +3.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.0% -1.7% +0.6% +10.0% ➖ noise
7 duckdb:vortex-compact +0.2% +0.9% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.3% +0.9% +0.4% +10.0% ➖ noise
8 duckdb:vortex-compact +1.7% +2.9% -1.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.5% +2.9% -2.3% +10.0% ➖ noise
9 duckdb:vortex-compact +0.2% +1.7% -1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.6% +1.7% -1.1% +10.0% ➖ noise
10 duckdb:vortex-compact +2.0% +1.1% +0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.5% +1.1% -2.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.9%


datafusion / vortex-file-compressed (0.961x ➖, 1↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 386160155 406649933 0.95
tpch_q02/datafusion:vortex-file-compressed 112928298 116645337 0.97
tpch_q03/datafusion:vortex-file-compressed 218085730 226594049 0.96
tpch_q04/datafusion:vortex-file-compressed 112631132 120118427 0.94
tpch_q05/datafusion:vortex-file-compressed 385194538 395524293 0.97
tpch_q06/datafusion:vortex-file-compressed 44435537 48435874 0.92
tpch_q07/datafusion:vortex-file-compressed 570257661 580635131 0.98
tpch_q08/datafusion:vortex-file-compressed 366082245 374690048 0.98
tpch_q09/datafusion:vortex-file-compressed 664256632 670491518 0.99
tpch_q10/datafusion:vortex-file-compressed 251706370 265156487 0.95
tpch_q11/datafusion:vortex-file-compressed 83390997 85673856 0.97
tpch_q12/datafusion:vortex-file-compressed 121422857 126603573 0.96
tpch_q13/datafusion:vortex-file-compressed 220657367 224519081 0.98
tpch_q14/datafusion:vortex-file-compressed 57580172 60273859 0.96
tpch_q15/datafusion:vortex-file-compressed 107452636 114798128 0.94
tpch_q16/datafusion:vortex-file-compressed 73991552 78429162 0.94
tpch_q17/datafusion:vortex-file-compressed 648246313 659188927 0.98
tpch_q18/datafusion:vortex-file-compressed 877136600 876866066 1.00
tpch_q19/datafusion:vortex-file-compressed 92890740 94837044 0.98
tpch_q20/datafusion:vortex-file-compressed 174907408 177363007 0.99
tpch_q21/datafusion:vortex-file-compressed 692584470 710599335 0.97
tpch_q22/datafusion:vortex-file-compressed 🚀 59154219 68127464 0.87
datafusion / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 442532610 452481948 0.98
tpch_q02/datafusion:vortex-compact 116317572 117358250 0.99
tpch_q03/datafusion:vortex-compact 222053415 226410170 0.98
tpch_q04/datafusion:vortex-compact 122053056 125956754 0.97
tpch_q05/datafusion:vortex-compact 394649459 397812262 0.99
tpch_q06/datafusion:vortex-compact 65008528 68228092 0.95
tpch_q07/datafusion:vortex-compact 587009231 590610369 0.99
tpch_q08/datafusion:vortex-compact 371053228 377273613 0.98
tpch_q09/datafusion:vortex-compact 664859951 675865499 0.98
tpch_q10/datafusion:vortex-compact 282081940 279941719 1.01
tpch_q11/datafusion:vortex-compact 87280879 87900310 0.99
tpch_q12/datafusion:vortex-compact 170440800 173444810 0.98
tpch_q13/datafusion:vortex-compact 274555589 275013788 1.00
tpch_q14/datafusion:vortex-compact 74542703 76159556 0.98
tpch_q15/datafusion:vortex-compact 165697712 169500415 0.98
tpch_q16/datafusion:vortex-compact 81646628 81688467 1.00
tpch_q17/datafusion:vortex-compact 661046719 660901757 1.00
tpch_q18/datafusion:vortex-compact 879187277 879463095 1.00
tpch_q19/datafusion:vortex-compact 133273006 135555095 0.98
tpch_q20/datafusion:vortex-compact 198690487 200230778 0.99
tpch_q21/datafusion:vortex-compact 698231905 715564825 0.98
tpch_q22/datafusion:vortex-compact 69905110 74876656 0.93
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 500858559 492481226 1.02
tpch_q02/datafusion:parquet 177334200 182917162 0.97
tpch_q03/datafusion:parquet 301260157 301275765 1.00
tpch_q04/datafusion:parquet 136619714 139280111 0.98
tpch_q05/datafusion:parquet 464380369 465980290 1.00
tpch_q06/datafusion:parquet 130996684 132425961 0.99
tpch_q07/datafusion:parquet 645970415 640769834 1.01
tpch_q08/datafusion:parquet 494481151 500147036 0.99
tpch_q09/datafusion:parquet 781554189 784441784 1.00
tpch_q10/datafusion:parquet 508439665 514058382 0.99
tpch_q11/datafusion:parquet 125644842 130063943 0.97
tpch_q12/datafusion:parquet 214221313 212382919 1.01
tpch_q13/datafusion:parquet 346677423 345385748 1.00
tpch_q14/datafusion:parquet 166145547 167415056 0.99
tpch_q15/datafusion:parquet 273793859 266078613 1.03
tpch_q16/datafusion:parquet 132113200 134758323 0.98
tpch_q17/datafusion:parquet 711126618 716480112 0.99
tpch_q18/datafusion:parquet 921681071 933529386 0.99
tpch_q19/datafusion:parquet 292746753 298378075 0.98
tpch_q20/datafusion:parquet 308951289 305910968 1.01
tpch_q21/datafusion:parquet 743897512 744083896 1.00
tpch_q22/datafusion:parquet 211720871 211689129 1.00
datafusion / arrow (0.983x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 615450771 626267681 0.98
tpch_q02/datafusion:arrow 162975458 171126667 0.95
tpch_q03/datafusion:arrow 482519842 491292842 0.98
tpch_q04/datafusion:arrow 363714209 364559285 1.00
tpch_q05/datafusion:arrow 971963156 972036631 1.00
tpch_q06/datafusion:arrow 292179123 293453615 1.00
tpch_q07/datafusion:arrow 1182212507 1203866960 0.98
tpch_q08/datafusion:arrow 1143251046 1180267050 0.97
tpch_q09/datafusion:arrow 1361512267 1369306224 0.99
tpch_q10/datafusion:arrow 616787353 619572251 1.00
tpch_q11/datafusion:arrow 139748555 142281188 0.98
tpch_q12/datafusion:arrow 794634619 827570826 0.96
tpch_q13/datafusion:arrow 510218211 510611837 1.00
tpch_q14/datafusion:arrow 329979868 336941506 0.98
tpch_q15/datafusion:arrow 728945005 732389802 1.00
tpch_q16/datafusion:arrow 104589938 109659774 0.95
tpch_q17/datafusion:arrow 1364036524 1382103884 0.99
tpch_q18/datafusion:arrow 1932111745 1965716492 0.98
tpch_q19/datafusion:arrow 512435821 512527311 1.00
tpch_q20/datafusion:arrow 508383533 508619933 1.00
tpch_q21/datafusion:arrow 3042130387 3081129499 0.99
tpch_q22/datafusion:arrow 131001841 136777872 0.96
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171583844 173421051 0.99
tpch_q02/duckdb:vortex-file-compressed 52102574 53464284 0.97
tpch_q03/duckdb:vortex-file-compressed 132711853 134676856 0.99
tpch_q04/duckdb:vortex-file-compressed 160141993 161192472 0.99
tpch_q05/duckdb:vortex-file-compressed 131883448 135797182 0.97
tpch_q06/duckdb:vortex-file-compressed 49590255 49667203 1.00
tpch_q07/duckdb:vortex-file-compressed 149225893 152149325 0.98
tpch_q08/duckdb:vortex-file-compressed 180167022 179152739 1.01
tpch_q09/duckdb:vortex-file-compressed 330036030 334359387 0.99
tpch_q10/duckdb:vortex-file-compressed 150615692 154453651 0.98
tpch_q11/duckdb:vortex-file-compressed 33778351 34692853 0.97
tpch_q12/duckdb:vortex-file-compressed 98114514 99457193 0.99
tpch_q13/duckdb:vortex-file-compressed 234325155 236176702 0.99
tpch_q14/duckdb:vortex-file-compressed 69051513 70430436 0.98
tpch_q15/duckdb:vortex-file-compressed 89003420 90722553 0.98
tpch_q16/duckdb:vortex-file-compressed 81678024 79852640 1.02
tpch_q17/duckdb:vortex-file-compressed 103135243 104067605 0.99
tpch_q18/duckdb:vortex-file-compressed 293953239 300798976 0.98
tpch_q19/duckdb:vortex-file-compressed 87236977 87242643 1.00
tpch_q20/duckdb:vortex-file-compressed 166606487 166202168 1.00
tpch_q21/duckdb:vortex-file-compressed 606120810 598591579 1.01
tpch_q22/duckdb:vortex-file-compressed 72754689 72665058 1.00
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230071330 233549136 0.99
tpch_q02/duckdb:vortex-compact 58185436 58212716 1.00
tpch_q03/duckdb:vortex-compact 142823147 143709120 0.99
tpch_q04/duckdb:vortex-compact 177352365 178127326 1.00
tpch_q05/duckdb:vortex-compact 147876003 148934821 0.99
tpch_q06/duckdb:vortex-compact 90601995 85692688 1.06
tpch_q07/duckdb:vortex-compact 204324579 205208578 1.00
tpch_q08/duckdb:vortex-compact 193988083 196135228 0.99
tpch_q09/duckdb:vortex-compact 358637022 363305952 0.99
tpch_q10/duckdb:vortex-compact 180971395 184397258 0.98
tpch_q11/duckdb:vortex-compact 41707168 42038104 0.99
tpch_q12/duckdb:vortex-compact 205541579 206232461 1.00
tpch_q13/duckdb:vortex-compact 283669295 286806693 0.99
tpch_q14/duckdb:vortex-compact 101566107 101043719 1.01
tpch_q15/duckdb:vortex-compact 116768728 116561460 1.00
tpch_q16/duckdb:vortex-compact 86371969 87159194 0.99
tpch_q17/duckdb:vortex-compact 116542532 115978831 1.00
tpch_q18/duckdb:vortex-compact 294010251 294517703 1.00
tpch_q19/duckdb:vortex-compact 109689145 109401327 1.00
tpch_q20/duckdb:vortex-compact 207716020 206142021 1.01
tpch_q21/duckdb:vortex-compact 632850074 638556565 0.99
tpch_q22/duckdb:vortex-compact 86359123 86945741 0.99
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256317731 260084650 0.99
tpch_q02/duckdb:parquet 97387862 103178206 0.94
tpch_q03/duckdb:parquet 210348336 207378240 1.01
tpch_q04/duckdb:parquet 132918927 135604730 0.98
tpch_q05/duckdb:parquet 217418124 218928263 0.99
tpch_q06/duckdb:parquet 68491034 67774706 1.01
tpch_q07/duckdb:parquet 184983370 182266048 1.01
tpch_q08/duckdb:parquet 255690150 260267671 0.98
tpch_q09/duckdb:parquet 508085344 510239752 1.00
tpch_q10/duckdb:parquet 620230950 625282148 0.99
tpch_q11/duckdb:parquet 59407900 59796629 0.99
tpch_q12/duckdb:parquet 127070574 125014247 1.02
tpch_q13/duckdb:parquet 456154857 453317647 1.01
tpch_q14/duckdb:parquet 175532020 174912805 1.00
tpch_q15/duckdb:parquet 98337995 97274968 1.01
tpch_q16/duckdb:parquet 162699308 161474512 1.01
tpch_q17/duckdb:parquet 174895317 175318656 1.00
tpch_q18/duckdb:parquet 358480435 357027951 1.00
tpch_q19/duckdb:parquet 287441510 284054908 1.01
tpch_q20/duckdb:parquet 232154824 231490076 1.00
tpch_q21/duckdb:parquet 572975148 573603020 1.00
tpch_q22/duckdb:parquet 291346871 289180594 1.01
duckdb / duckdb (0.994x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116104183 117394393 0.99
tpch_q02/duckdb:duckdb 49483299 48892205 1.01
tpch_q03/duckdb:duckdb 98373483 98663198 1.00
tpch_q04/duckdb:duckdb 135139721 135818165 1.00
tpch_q05/duckdb:duckdb 112902257 112883329 1.00
tpch_q06/duckdb:duckdb 37182225 37529486 0.99
tpch_q07/duckdb:duckdb 87811864 88188979 1.00
tpch_q08/duckdb:duckdb 111129060 112806220 0.99
tpch_q09/duckdb:duckdb 280079841 280468536 1.00
tpch_q10/duckdb:duckdb 209568252 211641005 0.99
tpch_q11/duckdb:duckdb 15890133 16478791 0.96
tpch_q12/duckdb:duckdb 86023124 85782076 1.00
tpch_q13/duckdb:duckdb 225321420 226954989 0.99
tpch_q14/duckdb:duckdb 71499323 72455054 0.99
tpch_q15/duckdb:duckdb 78599611 78388174 1.00
tpch_q16/duckdb:duckdb 75381160 74639554 1.01
tpch_q17/duckdb:duckdb 84788992 85803137 0.99
tpch_q18/duckdb:duckdb 213721771 215448411 0.99
tpch_q19/duckdb:duckdb 116792563 117342598 1.00
tpch_q20/duckdb:duckdb 112846398 112629307 1.00
tpch_q21/duckdb:duckdb 305544493 304409882 1.00
tpch_q22/duckdb:duckdb 67776485 69429228 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -1.7% +0.1% -1.8% +10.0% ➖ noise
1 datafusion:vortex-compact -2.2% +0.1% -2.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -5.0% +0.1% -5.1% +10.0% ➖ noise
1 duckdb:duckdb -1.1% +0.1% -1.2% +10.0% ➖ noise
1 duckdb:vortex-compact -1.5% +0.1% -1.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.1% +0.1% -1.2% +10.0% ➖ noise
2 datafusion:arrow -4.8% -4.3% -0.4% +10.0% ➖ noise
2 datafusion:vortex-compact -0.9% -4.3% +3.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -3.2% -4.3% +1.2% +10.0% ➖ noise
2 duckdb:duckdb +1.2% -4.3% +5.8% +10.0% ➖ noise
2 duckdb:vortex-compact -0.0% -4.3% +4.5% +13.1% ➖ noise
2 duckdb:vortex-file-compressed -2.5% -4.3% +1.9% +10.0% ➖ noise
3 datafusion:arrow -1.8% +0.7% -2.5% +10.0% ➖ noise
3 datafusion:vortex-compact -1.9% +0.7% -2.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -3.8% +0.7% -4.4% +10.0% ➖ noise
3 duckdb:duckdb -0.3% +0.7% -1.0% +10.0% ➖ noise
3 duckdb:vortex-compact -0.6% +0.7% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.5% +0.7% -2.2% +10.0% ➖ noise
4 datafusion:arrow -0.2% -1.9% +1.7% +10.0% ➖ noise
4 datafusion:vortex-compact -3.1% -1.9% -1.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -6.2% -1.9% -4.4% +10.0% ➖ noise
4 duckdb:duckdb -0.5% -1.9% +1.5% +10.0% ➖ noise
4 duckdb:vortex-compact -0.4% -1.9% +1.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -1.9% +1.3% +10.0% ➖ noise
5 datafusion:arrow -0.0% -0.5% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -0.8% -0.5% -0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.6% -0.5% -2.1% +10.0% ➖ noise
5 duckdb:duckdb +0.0% -0.5% +0.5% +10.0% ➖ noise
5 duckdb:vortex-compact -0.7% -0.5% -0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.9% -0.5% -2.4% +10.0% ➖ noise
6 datafusion:arrow -0.4% -0.0% -0.4% +10.0% ➖ noise
6 datafusion:vortex-compact -4.7% -0.0% -4.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -8.3% -0.0% -8.2% +10.0% ➖ noise
6 duckdb:duckdb -0.9% -0.0% -0.9% +10.0% ➖ noise
6 duckdb:vortex-compact +5.7% -0.0% +5.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.2% -0.0% -0.1% +10.0% ➖ noise
7 datafusion:arrow -1.8% +1.2% -2.9% +10.0% ➖ noise
7 datafusion:vortex-compact -0.6% +1.2% -1.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.8% +1.2% -2.9% +10.0% ➖ noise
7 duckdb:duckdb -0.4% +1.2% -1.6% +10.0% ➖ noise
7 duckdb:vortex-compact -0.4% +1.2% -1.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.9% +1.2% -3.0% +10.0% ➖ noise
8 datafusion:arrow -3.1% -1.4% -1.7% +10.0% ➖ noise
8 datafusion:vortex-compact -1.6% -1.4% -0.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.3% -1.4% -0.9% +10.0% ➖ noise
8 duckdb:duckdb -1.5% -1.4% -0.0% +10.0% ➖ noise
8 duckdb:vortex-compact -1.1% -1.4% +0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.6% -1.4% +2.0% +10.0% ➖ noise
9 datafusion:arrow -0.6% -0.4% -0.2% +10.0% ➖ noise
9 datafusion:vortex-compact -1.6% -0.4% -1.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
9 duckdb:duckdb -0.1% -0.4% +0.3% +10.0% ➖ noise
9 duckdb:vortex-compact -1.3% -0.4% -0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.3% -0.4% -0.9% +10.0% ➖ noise
10 datafusion:arrow -0.4% -1.0% +0.5% +10.0% ➖ noise
10 datafusion:vortex-compact +0.8% -1.0% +1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -5.1% -1.0% -4.2% +10.0% ➖ noise
10 duckdb:duckdb -1.0% -1.0% -0.0% +10.0% ➖ noise
10 duckdb:vortex-compact -1.9% -1.0% -0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.5% -1.0% -1.5% +10.0% ➖ noise
11 datafusion:arrow -1.8% -2.0% +0.3% +10.5% ➖ noise
11 datafusion:vortex-compact -0.7% -2.0% +1.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.7% -2.0% -0.6% +10.0% ➖ noise
11 duckdb:duckdb -3.6% -2.0% -1.6% +12.0% ➖ noise
11 duckdb:vortex-compact -0.8% -2.0% +1.3% +11.8% ➖ noise
11 duckdb:vortex-file-compressed -2.6% -2.0% -0.6% +13.2% ➖ noise
12 datafusion:arrow -4.0% +1.3% -5.2% +31.0% ➖ noise
12 datafusion:vortex-compact -1.7% +1.3% -2.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.1% +1.3% -5.3% +10.0% ➖ noise
12 duckdb:duckdb +0.3% +1.3% -1.0% +10.0% ➖ noise
12 duckdb:vortex-compact -0.3% +1.3% -1.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.4% +1.3% -2.6% +10.0% ➖ noise
13 datafusion:arrow -0.1% +0.5% -0.6% +10.0% ➖ noise
13 datafusion:vortex-compact -0.2% +0.5% -0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.7% +0.5% -2.2% +10.0% ➖ noise
13 duckdb:duckdb -0.7% +0.5% -1.2% +10.0% ➖ noise
13 duckdb:vortex-compact -1.1% +0.5% -1.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.8% +0.5% -1.3% +10.0% ➖ noise
14 datafusion:arrow -2.1% -0.2% -1.9% +10.0% ➖ noise
14 datafusion:vortex-compact -2.1% -0.2% -1.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -4.5% -0.2% -4.3% +10.0% ➖ noise
14 duckdb:duckdb -1.3% -0.2% -1.1% +10.0% ➖ noise
14 duckdb:vortex-compact +0.5% -0.2% +0.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.0% -0.2% -1.8% +10.0% ➖ noise
15 datafusion:arrow -0.5% +2.0% -2.4% +10.0% ➖ noise
15 datafusion:vortex-compact -2.2% +2.0% -4.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -6.4% +2.0% -8.2% +10.0% ➖ noise
15 duckdb:duckdb +0.3% +2.0% -1.7% +10.0% ➖ noise
15 duckdb:vortex-compact +0.2% +2.0% -1.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.9% +2.0% -3.8% +10.0% ➖ noise
16 datafusion:arrow -4.6% -0.6% -4.0% +10.0% ➖ noise
16 datafusion:vortex-compact -0.1% -0.6% +0.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -5.7% -0.6% -5.1% +10.0% ➖ noise
16 duckdb:duckdb +1.0% -0.6% +1.6% +10.0% ➖ noise
16 duckdb:vortex-compact -0.9% -0.6% -0.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.3% -0.6% +2.9% +10.0% ➖ noise
17 datafusion:arrow -1.3% -0.5% -0.8% +10.0% ➖ noise
17 datafusion:vortex-compact +0.0% -0.5% +0.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.7% -0.5% -1.2% +10.0% ➖ noise
17 duckdb:duckdb -1.2% -0.5% -0.7% +10.0% ➖ noise
17 duckdb:vortex-compact +0.5% -0.5% +1.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.9% -0.5% -0.4% +10.0% ➖ noise
18 datafusion:arrow -1.7% -0.4% -1.3% +10.0% ➖ noise
18 datafusion:vortex-compact -0.0% -0.4% +0.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.0% -0.4% +0.5% +10.0% ➖ noise
18 duckdb:duckdb -0.8% -0.4% -0.4% +10.0% ➖ noise
18 duckdb:vortex-compact -0.2% -0.4% +0.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.3% -0.4% -1.8% +10.0% ➖ noise
19 datafusion:arrow -0.0% -0.4% +0.3% +10.0% ➖ noise
19 datafusion:vortex-compact -1.7% -0.4% -1.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.1% -0.4% -1.7% +10.0% ➖ noise
19 duckdb:duckdb -0.5% -0.4% -0.1% +10.0% ➖ noise
19 duckdb:vortex-compact +0.3% -0.4% +0.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.0% -0.4% +0.4% +10.0% ➖ noise
20 datafusion:arrow -0.0% +0.6% -0.7% +10.0% ➖ noise
20 datafusion:vortex-compact -0.8% +0.6% -1.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.4% +0.6% -2.0% +10.0% ➖ noise
20 duckdb:duckdb +0.2% +0.6% -0.4% +10.0% ➖ noise
20 duckdb:vortex-compact +0.8% +0.6% +0.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.2% +0.6% -0.4% +10.0% ➖ noise
21 datafusion:arrow -1.3% -0.1% -1.2% +10.0% ➖ noise
21 datafusion:vortex-compact -2.4% -0.1% -2.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.5% -0.1% -2.5% +10.0% ➖ noise
21 duckdb:duckdb +0.4% -0.1% +0.4% +10.0% ➖ noise
21 duckdb:vortex-compact -0.9% -0.1% -0.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.3% -0.1% +1.3% +10.0% ➖ noise
22 datafusion:arrow -4.2% +0.4% -4.6% +10.0% ➖ noise
22 datafusion:vortex-compact -6.6% +0.4% -7.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -13.2% +0.4% -13.5% +10.0% ✅ faster
22 duckdb:duckdb -2.4% +0.4% -2.8% +10.0% ➖ noise
22 duckdb:vortex-compact -0.7% +0.4% -1.1% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.1% +0.4% -0.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.2%
Vortex (geomean): 0.976x ➖
Parquet (geomean): 1.030x ➖
Shifts: Parquet (control) +3.0% · Median polish +2.2%


datafusion / vortex-file-compressed (0.897x ✅, 15↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1756388 1626627 1.08
clickbench_q01/datafusion:vortex-file-compressed 🚀 14502626 36945786 0.39
clickbench_q02/datafusion:vortex-file-compressed 🚀 32310196 51146363 0.63
clickbench_q03/datafusion:vortex-file-compressed 🚀 37668418 55006784 0.68
clickbench_q04/datafusion:vortex-file-compressed 294913631 295481287 1.00
clickbench_q05/datafusion:vortex-file-compressed 306280005 305922103 1.00
clickbench_q06/datafusion:vortex-file-compressed 1720297 1700348 1.01
clickbench_q07/datafusion:vortex-file-compressed 🚀 17020792 41894382 0.41
clickbench_q08/datafusion:vortex-file-compressed 367508366 368847913 1.00
clickbench_q09/datafusion:vortex-file-compressed 571024185 548154146 1.04
clickbench_q10/datafusion:vortex-file-compressed 🚀 72875724 89262590 0.82
clickbench_q11/datafusion:vortex-file-compressed 🚀 84550166 99901000 0.85
clickbench_q12/datafusion:vortex-file-compressed 273667974 272028200 1.01
clickbench_q13/datafusion:vortex-file-compressed 419625010 416237681 1.01
clickbench_q14/datafusion:vortex-file-compressed 258203877 262546147 0.98
clickbench_q15/datafusion:vortex-file-compressed 335054968 340662774 0.98
clickbench_q16/datafusion:vortex-file-compressed 664841732 646431845 1.03
clickbench_q17/datafusion:vortex-file-compressed 660285072 641832158 1.03
clickbench_q18/datafusion:vortex-file-compressed 1339625374 1293912699 1.04
clickbench_q19/datafusion:vortex-file-compressed 🚀 26866066 49856796 0.54
clickbench_q20/datafusion:vortex-file-compressed 335493977 347646922 0.97
clickbench_q21/datafusion:vortex-file-compressed 376612377 386126914 0.98
clickbench_q22/datafusion:vortex-file-compressed 460313974 458353112 1.00
clickbench_q23/datafusion:vortex-file-compressed 667046233 661629143 1.01
clickbench_q24/datafusion:vortex-file-compressed 🚀 47217792 55595468 0.85
clickbench_q25/datafusion:vortex-file-compressed 🚀 67336691 86733893 0.78
clickbench_q26/datafusion:vortex-file-compressed 🚀 45087059 52452551 0.86
clickbench_q27/datafusion:vortex-file-compressed 723208645 714721362 1.01
clickbench_q28/datafusion:vortex-file-compressed 6630275330 6708908417 0.99
clickbench_q29/datafusion:vortex-file-compressed 🚀 229105260 257530768 0.89
clickbench_q30/datafusion:vortex-file-compressed 228308148 233526653 0.98
clickbench_q31/datafusion:vortex-file-compressed 264782286 262332169 1.01
clickbench_q32/datafusion:vortex-file-compressed 1142744368 1104267940 1.03
clickbench_q33/datafusion:vortex-file-compressed 1318229420 1273350522 1.04
clickbench_q34/datafusion:vortex-file-compressed 1330888470 1273712307 1.04
clickbench_q35/datafusion:vortex-file-compressed 487332675 486918684 1.00
clickbench_q36/datafusion:vortex-file-compressed 75542941 72036876 1.05
clickbench_q37/datafusion:vortex-file-compressed 36364976 38099911 0.95
clickbench_q38/datafusion:vortex-file-compressed 🚀 19870891 22459566 0.88
clickbench_q39/datafusion:vortex-file-compressed 133643775 131670541 1.01
clickbench_q40/datafusion:vortex-file-compressed 🚀 16436619 19181908 0.86
clickbench_q41/datafusion:vortex-file-compressed 🚀 15568574 18807077 0.83
clickbench_q42/datafusion:vortex-file-compressed 🚀 17802361 20623895 0.86
datafusion / parquet (1.047x ➖, 0↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1638988 1551382 1.06
clickbench_q01/datafusion:parquet 20043188 19403048 1.03
clickbench_q02/datafusion:parquet 47176772 46073379 1.02
clickbench_q03/datafusion:parquet 39177263 38276059 1.02
clickbench_q04/datafusion:parquet 299267728 298127924 1.00
clickbench_q05/datafusion:parquet 366811515 343447832 1.07
clickbench_q06/datafusion:parquet 1607556 1526024 1.05
clickbench_q07/datafusion:parquet 24129163 22156177 1.09
clickbench_q08/datafusion:parquet 380754448 363780121 1.05
clickbench_q09/datafusion:parquet 633175781 599811561 1.06
clickbench_q10/datafusion:parquet 116102561 110563172 1.05
clickbench_q11/datafusion:parquet 141647942 135010925 1.05
clickbench_q12/datafusion:parquet 361996151 340701402 1.06
clickbench_q13/datafusion:parquet 515685624 486467408 1.06
clickbench_q14/datafusion:parquet 350642481 340917736 1.03
clickbench_q15/datafusion:parquet 350264380 326824116 1.07
clickbench_q16/datafusion:parquet 689764281 645402033 1.07
clickbench_q17/datafusion:parquet 674988002 641830334 1.05
clickbench_q18/datafusion:parquet 1368020169 1288219701 1.06
clickbench_q19/datafusion:parquet 🚨 34981294 28884562 1.21
clickbench_q20/datafusion:parquet 631339641 598539452 1.05
clickbench_q21/datafusion:parquet 688822402 667986176 1.03
clickbench_q22/datafusion:parquet 995315760 966953089 1.03
clickbench_q23/datafusion:parquet 3860614983 3704042438 1.04
clickbench_q24/datafusion:parquet 89745802 83400559 1.08
clickbench_q25/datafusion:parquet 136520193 137147159 1.00
clickbench_q26/datafusion:parquet 87721490 82735886 1.06
clickbench_q27/datafusion:parquet 1069306169 1028239367 1.04
clickbench_q28/datafusion:parquet 6587703839 6557040336 1.00
clickbench_q29/datafusion:parquet 241581210 238811260 1.01
clickbench_q30/datafusion:parquet 345129970 328094178 1.05
clickbench_q31/datafusion:parquet 374867428 360408026 1.04
clickbench_q32/datafusion:parquet 1198277731 1198760920 1.00
clickbench_q33/datafusion:parquet 1525584747 1444431941 1.06
clickbench_q34/datafusion:parquet 1514604057 1466616020 1.03
clickbench_q35/datafusion:parquet 505684319 469790358 1.08
clickbench_q36/datafusion:parquet 141645348 135545671 1.05
clickbench_q37/datafusion:parquet 58414288 58776049 0.99
clickbench_q38/datafusion:parquet 89099046 82699523 1.08
clickbench_q39/datafusion:parquet 264140660 254975310 1.04
clickbench_q40/datafusion:parquet 31387810 29975434 1.05
clickbench_q41/datafusion:parquet 27773620 26657240 1.04
clickbench_q42/datafusion:parquet 29934018 28820315 1.04
duckdb / vortex-file-compressed (1.062x ➖, 1↑ 5↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6304484 5889363 1.07
clickbench_q01/duckdb:vortex-file-compressed 13995003 13730981 1.02
clickbench_q02/duckdb:vortex-file-compressed 26143107 26174130 1.00
clickbench_q03/duckdb:vortex-file-compressed 31132841 30021322 1.04
clickbench_q04/duckdb:vortex-file-compressed 186449048 177960779 1.05
clickbench_q05/duckdb:vortex-file-compressed 172771446 166923401 1.04
clickbench_q06/duckdb:vortex-file-compressed 19251698 17699630 1.09
clickbench_q07/duckdb:vortex-file-compressed 🚨 16439876 14850026 1.11
clickbench_q08/duckdb:vortex-file-compressed 258995231 254981943 1.02
clickbench_q09/duckdb:vortex-file-compressed 339377605 334455421 1.01
clickbench_q10/duckdb:vortex-file-compressed 71793683 67363223 1.07
clickbench_q11/duckdb:vortex-file-compressed 80410286 79151100 1.02
clickbench_q12/duckdb:vortex-file-compressed 196032501 188942199 1.04
clickbench_q13/duckdb:vortex-file-compressed 419306814 397186536 1.06
clickbench_q14/duckdb:vortex-file-compressed 234476455 222431085 1.05
clickbench_q15/duckdb:vortex-file-compressed 243928681 236181402 1.03
clickbench_q16/duckdb:vortex-file-compressed 604192976 593874792 1.02
clickbench_q17/duckdb:vortex-file-compressed 498101310 467254960 1.07
clickbench_q18/duckdb:vortex-file-compressed 1035407883 956377959 1.08
clickbench_q19/duckdb:vortex-file-compressed 21551805 21836887 0.99
clickbench_q20/duckdb:vortex-file-compressed 345814020 342337436 1.01
clickbench_q21/duckdb:vortex-file-compressed 385149524 369872531 1.04
clickbench_q22/duckdb:vortex-file-compressed 530678707 570108818 0.93
clickbench_q23/duckdb:vortex-file-compressed 🚨 1521159377 518463088 2.93
clickbench_q24/duckdb:vortex-file-compressed 🚨 44389453 38886901 1.14
clickbench_q25/duckdb:vortex-file-compressed 75674041 72292674 1.05
clickbench_q26/duckdb:vortex-file-compressed 🚀 41064847 46631785 0.88
clickbench_q27/duckdb:vortex-file-compressed 489647263 473254644 1.03
clickbench_q28/duckdb:vortex-file-compressed 2985907205 2951218417 1.01
clickbench_q29/duckdb:vortex-file-compressed 30368861 28644414 1.06
clickbench_q30/duckdb:vortex-file-compressed 197679021 188493960 1.05
clickbench_q31/duckdb:vortex-file-compressed 291071738 277200259 1.05
clickbench_q32/duckdb:vortex-file-compressed 🚨 1292130752 1121382617 1.15
clickbench_q33/duckdb:vortex-file-compressed 1260306568 1151536443 1.09
clickbench_q34/duckdb:vortex-file-compressed 1271511569 1226663715 1.04
clickbench_q35/duckdb:vortex-file-compressed 382649279 388470905 0.99
clickbench_q36/duckdb:vortex-file-compressed 30289059 28224352 1.07
clickbench_q37/duckdb:vortex-file-compressed 21158995 20891509 1.01
clickbench_q38/duckdb:vortex-file-compressed 23084273 23220417 0.99
clickbench_q39/duckdb:vortex-file-compressed 🚨 44583680 39478295 1.13
clickbench_q40/duckdb:vortex-file-compressed 21323608 22615837 0.94
clickbench_q41/duckdb:vortex-file-compressed 21861938 21822879 1.00
clickbench_q42/duckdb:vortex-file-compressed 22423653 21459314 1.04
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26095683 25473302 1.02
clickbench_q01/duckdb:parquet 27135832 28487314 0.95
clickbench_q02/duckdb:parquet 48433817 48064203 1.01
clickbench_q03/duckdb:parquet 38203369 38353756 1.00
clickbench_q04/duckdb:parquet 204161050 198657107 1.03
clickbench_q05/duckdb:parquet 274738837 263602191 1.04
clickbench_q06/duckdb:parquet 45726032 45674070 1.00
clickbench_q07/duckdb:parquet 29808446 29872198 1.00
clickbench_q08/duckdb:parquet 272740233 267009177 1.02
clickbench_q09/duckdb:parquet 399503673 395922758 1.01
clickbench_q10/duckdb:parquet 82129209 80166908 1.02
clickbench_q11/duckdb:parquet 99731806 97803696 1.02
clickbench_q12/duckdb:parquet 283700942 284511841 1.00
clickbench_q13/duckdb:parquet 492971256 480446631 1.03
clickbench_q14/duckdb:parquet 336469286 324322327 1.04
clickbench_q15/duckdb:parquet 259876952 255629467 1.02
clickbench_q16/duckdb:parquet 659550643 640681292 1.03
clickbench_q17/duckdb:parquet 546678948 534900569 1.02
clickbench_q18/duckdb:parquet 1088033143 1068431350 1.02
clickbench_q19/duckdb:parquet 25236601 26028448 0.97
clickbench_q20/duckdb:parquet 427310430 425386109 1.00
clickbench_q21/duckdb:parquet 544140345 547724490 0.99
clickbench_q22/duckdb:parquet 933426634 925817189 1.01
clickbench_q23/duckdb:parquet 318112728 311226330 1.02
clickbench_q24/duckdb:parquet 70332083 66833249 1.05
clickbench_q25/duckdb:parquet 159335317 155728942 1.02
clickbench_q26/duckdb:parquet 46918790 49154911 0.95
clickbench_q27/duckdb:parquet 651549458 644901529 1.01
clickbench_q28/duckdb:parquet 4834008093 4806977921 1.01
clickbench_q29/duckdb:parquet 40911227 40643522 1.01
clickbench_q30/duckdb:parquet 304509237 300177189 1.01
clickbench_q31/duckdb:parquet 367440452 359502465 1.02
clickbench_q32/duckdb:parquet 1237167243 1158196820 1.07
clickbench_q33/duckdb:parquet 1288431018 1259974464 1.02
clickbench_q34/duckdb:parquet 1333867624 1387408162 0.96
clickbench_q35/duckdb:parquet 366178454 363472334 1.01
clickbench_q36/duckdb:parquet 45641400 44682817 1.02
clickbench_q37/duckdb:parquet 33055830 30880859 1.07
clickbench_q38/duckdb:parquet 35367642 33955896 1.04
clickbench_q39/duckdb:parquet 75825913 80025079 0.95
clickbench_q40/duckdb:parquet 17542145 17274570 1.02
clickbench_q41/duckdb:parquet 19683664 18180418 1.08
clickbench_q42/duckdb:parquet 20445630 21508927 0.95
duckdb / duckdb (1.009x ➖, 6↑ 4↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 19511732 17000633 1.15
clickbench_q01/duckdb:duckdb 34405689 32438585 1.06
clickbench_q02/duckdb:duckdb 46788730 44389866 1.05
clickbench_q03/duckdb:duckdb 48361914 46255182 1.05
clickbench_q04/duckdb:duckdb 191151518 186825878 1.02
clickbench_q05/duckdb:duckdb 271043038 264876659 1.02
clickbench_q06/duckdb:duckdb 37841352 35203096 1.07
clickbench_q07/duckdb:duckdb 37909535 34763060 1.09
clickbench_q08/duckdb:duckdb 253667388 247182112 1.03
clickbench_q09/duckdb:duckdb 365993312 366460031 1.00
clickbench_q10/duckdb:duckdb 99268198 97434511 1.02
clickbench_q11/duckdb:duckdb 109274375 106819818 1.02
clickbench_q12/duckdb:duckdb 242414662 236471713 1.03
clickbench_q13/duckdb:duckdb 486158981 498751300 0.97
clickbench_q14/duckdb:duckdb 280436125 281252456 1.00
clickbench_q15/duckdb:duckdb 226335668 217184948 1.04
clickbench_q16/duckdb:duckdb 672420749 668064209 1.01
clickbench_q17/duckdb:duckdb 564360526 575834291 0.98
clickbench_q18/duckdb:duckdb 1261246894 1249119297 1.01
clickbench_q19/duckdb:duckdb 36671796 33802150 1.08
clickbench_q20/duckdb:duckdb 🚀 946340717 1102040147 0.86
clickbench_q21/duckdb:duckdb 🚀 940035548 1196005980 0.79
clickbench_q22/duckdb:duckdb 1024689433 1134482675 0.90
clickbench_q23/duckdb:duckdb 266465253 247855694 1.08
clickbench_q24/duckdb:duckdb 64906810 60750193 1.07
clickbench_q25/duckdb:duckdb 145064362 141826638 1.02
clickbench_q26/duckdb:duckdb 62035204 59966486 1.03
clickbench_q27/duckdb:duckdb 🚀 984913918 1167171313 0.84
clickbench_q28/duckdb:duckdb 4659042369 4582047010 1.02
clickbench_q29/duckdb:duckdb 51147698 48438077 1.06
clickbench_q30/duckdb:duckdb 262774140 261707471 1.00
clickbench_q31/duckdb:duckdb 🚀 406871047 462522003 0.88
clickbench_q32/duckdb:duckdb 🚀 1393641796 1669495903 0.83
clickbench_q33/duckdb:duckdb 1817106113 1952484334 0.93
clickbench_q34/duckdb:duckdb 🚀 2028929517 2266044112 0.90
clickbench_q35/duckdb:duckdb 286836169 284940671 1.01
clickbench_q36/duckdb:duckdb 41958234 39168155 1.07
clickbench_q37/duckdb:duckdb 33374477 31339938 1.06
clickbench_q38/duckdb:duckdb 32418512 30572501 1.06
clickbench_q39/duckdb:duckdb 🚨 69514633 61366682 1.13
clickbench_q40/duckdb:duckdb 🚨 33817889 30613282 1.10
clickbench_q41/duckdb:duckdb 🚨 33063341 30027774 1.10
clickbench_q42/duckdb:duckdb 33606594 31526741 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +8.0% +4.0% +3.8% +754.0% ➖ noise
0 duckdb:duckdb +14.8% +4.0% +10.3% +286.5% ➖ noise
0 duckdb:vortex-file-compressed +7.0% +4.0% +2.9% +478.3% ➖ noise
1 datafusion:vortex-file-compressed -60.7% -0.8% -60.4% +23.5% ✅ faster
1 duckdb:duckdb +6.1% -0.8% +6.9% +49.4% ➖ noise
1 duckdb:vortex-file-compressed +1.9% -0.8% +2.7% +23.1% ➖ noise
2 datafusion:vortex-file-compressed -36.8% +1.6% -37.8% +12.6% ✅ faster
2 duckdb:duckdb +5.4% +1.6% +3.8% +15.7% ➖ noise
2 duckdb:vortex-file-compressed -0.1% +1.6% -1.7% +12.8% ➖ noise
3 datafusion:vortex-file-compressed -31.5% +1.0% -32.2% +133.8% ➖ noise
3 duckdb:duckdb +4.6% +1.0% +3.5% +28.8% ➖ noise
3 duckdb:vortex-file-compressed +3.7% +1.0% +2.7% +116.0% ➖ noise
4 datafusion:vortex-file-compressed -0.2% +1.6% -1.7% +10.0% ➖ noise
4 duckdb:duckdb +2.3% +1.6% +0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.8% +1.6% +3.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +5.5% -5.1% +10.0% ➖ noise
5 duckdb:duckdb +2.3% +5.5% -3.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.5% +5.5% -1.9% +10.1% ➖ noise
6 datafusion:vortex-file-compressed +1.2% +2.7% -1.5% +38.9% ➖ noise
6 duckdb:duckdb +7.5% +2.7% +4.7% +28.2% ➖ noise
6 duckdb:vortex-file-compressed +8.8% +2.7% +5.9% +25.9% ➖ noise
7 datafusion:vortex-file-compressed -59.4% +4.2% -61.0% +14.7% ✅ faster
7 duckdb:duckdb +9.1% +4.2% +4.6% +12.7% ➖ noise
7 duckdb:vortex-file-compressed +10.7% +4.2% +6.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.4% +3.4% -3.6% +10.0% ➖ noise
8 duckdb:duckdb +2.6% +3.4% -0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.6% +3.4% -1.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.2% +3.2% +0.9% +10.0% ➖ noise
9 duckdb:duckdb -0.1% +3.2% -3.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.5% +3.2% -1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -18.4% +3.7% -21.3% +10.0% ✅ faster
10 duckdb:duckdb +1.9% +3.7% -1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +6.6% +3.7% +2.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -15.4% +3.4% -18.2% +10.0% ✅ faster
11 duckdb:duckdb +2.3% +3.4% -1.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.6% +3.4% -1.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.6% +2.9% -2.3% +10.0% ➖ noise
12 duckdb:duckdb +2.5% +2.9% -0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.8% +2.9% +0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.8% +4.3% -3.3% +10.0% ➖ noise
13 duckdb:duckdb -2.5% +4.3% -6.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +5.6% +4.3% +1.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.7% +3.3% -4.8% +10.0% ➖ noise
14 duckdb:duckdb -0.3% +3.3% -3.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.4% +3.3% +2.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.6% +4.4% -5.8% +10.0% ➖ noise
15 duckdb:duckdb +4.2% +4.4% -0.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.3% +4.4% -1.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.8% +4.9% -1.9% +10.0% ➖ noise
16 duckdb:duckdb +0.7% +4.9% -4.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.7% +4.9% -3.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.9% +3.7% -0.8% +10.0% ➖ noise
17 duckdb:duckdb -2.0% +3.7% -5.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +6.6% +3.7% +2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.5% +4.0% -0.4% +10.0% ➖ noise
18 duckdb:duckdb +1.0% +4.0% -2.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +8.3% +4.0% +4.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -46.1% +8.4% -50.3% +30.0% ✅ faster
19 duckdb:duckdb +8.5% +8.4% +0.1% +16.0% ➖ noise
19 duckdb:vortex-file-compressed -1.3% +8.4% -8.9% +16.5% ➖ noise
20 datafusion:vortex-file-compressed -3.5% +2.9% -6.2% +207.9% ➖ noise
20 duckdb:duckdb -14.1% +2.9% -16.6% +22.2% ➖ noise
20 duckdb:vortex-file-compressed +1.0% +2.9% -1.9% +108.8% ➖ noise
21 datafusion:vortex-file-compressed -2.5% +1.2% -3.6% +10.0% ➖ noise
21 duckdb:duckdb -21.4% +1.2% -22.3% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +4.1% +1.2% +2.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.4% +1.9% -1.4% +14.8% ➖ noise
22 duckdb:duckdb -9.7% +1.9% -11.3% +14.3% ➖ noise
22 duckdb:vortex-file-compressed -6.9% +1.9% -8.6% +19.2% ➖ noise
23 datafusion:vortex-file-compressed +0.8% +3.2% -2.3% +47.9% ➖ noise
23 duckdb:duckdb +7.5% +3.2% +4.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +193.4% +3.2% +184.3% +78.6% 🚨 regression
24 datafusion:vortex-file-compressed -15.1% +6.4% -20.2% +14.1% ✅ faster
24 duckdb:duckdb +6.8% +6.4% +0.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +14.2% +6.4% +7.3% +22.1% ➖ noise
25 datafusion:vortex-file-compressed -22.4% +0.9% -23.1% +10.0% ✅ faster
25 duckdb:duckdb +2.3% +0.9% +1.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +4.7% +0.9% +3.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -14.0% +0.6% -14.6% +21.1% ➖ noise
26 duckdb:duckdb +3.4% +0.6% +2.8% +13.6% ➖ noise
26 duckdb:vortex-file-compressed -11.9% +0.6% -12.5% +31.3% ➖ noise
27 datafusion:vortex-file-compressed +1.2% +2.5% -1.3% +10.0% ➖ noise
27 duckdb:duckdb -15.6% +2.5% -17.7% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +3.5% +2.5% +0.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.2% +0.5% -1.7% +10.0% ➖ noise
28 duckdb:duckdb +1.7% +0.5% +1.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.2% +0.5% +0.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -11.0% +0.9% -11.8% +10.0% ✅ faster
29 duckdb:duckdb +5.6% +0.9% +4.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +6.0% +0.9% +5.1% +15.0% ➖ noise
30 datafusion:vortex-file-compressed -2.2% +3.3% -5.4% +10.0% ➖ noise
30 duckdb:duckdb +0.4% +3.3% -2.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +4.9% +3.3% +1.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.9% +3.1% -2.1% +10.0% ➖ noise
31 duckdb:duckdb -12.0% +3.1% -14.7% +10.0% ✅ faster
31 duckdb:vortex-file-compressed +5.0% +3.1% +1.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +3.5% +3.3% +0.1% +10.0% ➖ noise
32 duckdb:duckdb -16.5% +3.3% -19.2% +10.0% ✅ faster
32 duckdb:vortex-file-compressed +15.2% +3.3% +11.5% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +3.5% +3.9% -0.4% +10.0% ➖ noise
33 duckdb:duckdb -6.9% +3.9% -10.4% +10.3% ✅ faster
33 duckdb:vortex-file-compressed +9.4% +3.9% +5.3% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +4.5% -0.4% +4.9% +10.0% ➖ noise
34 duckdb:duckdb -10.5% -0.4% -10.1% +10.0% ✅ faster
34 duckdb:vortex-file-compressed +3.7% -0.4% +4.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.1% +4.1% -3.9% +10.0% ➖ noise
35 duckdb:duckdb +0.7% +4.1% -3.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.5% +4.1% -5.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +4.9% +3.3% +1.5% +10.0% ➖ noise
36 duckdb:duckdb +7.1% +3.3% +3.7% +12.7% ➖ noise
36 duckdb:vortex-file-compressed +7.3% +3.3% +3.9% +10.7% ➖ noise
37 datafusion:vortex-file-compressed -4.6% +3.1% -7.5% +10.0% ➖ noise
37 duckdb:duckdb +6.5% +3.1% +3.2% +12.6% ➖ noise
37 duckdb:vortex-file-compressed +1.3% +3.1% -1.8% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -11.5% +5.9% -16.5% +11.6% ✅ faster
38 duckdb:duckdb +6.0% +5.9% +0.1% +10.4% ➖ noise
38 duckdb:vortex-file-compressed -0.6% +5.9% -6.2% +11.1% ➖ noise
39 datafusion:vortex-file-compressed +1.5% -0.9% +2.4% +10.0% ➖ noise
39 duckdb:duckdb +13.3% -0.9% +14.3% +20.8% ➖ noise
39 duckdb:vortex-file-compressed +12.9% -0.9% +14.0% +12.1% 🚨 regression
40 datafusion:vortex-file-compressed -14.3% +3.1% -16.9% +10.0% ✅ faster
40 duckdb:duckdb +10.5% +3.1% +7.1% +11.0% ➖ noise
40 duckdb:vortex-file-compressed -5.7% +3.1% -8.6% +10.7% ➖ noise
41 datafusion:vortex-file-compressed -17.2% +6.2% -22.1% +10.0% ✅ faster
41 duckdb:duckdb +10.1% +6.2% +3.7% +10.6% ➖ noise
41 duckdb:vortex-file-compressed +0.2% +6.2% -5.7% +10.2% ➖ noise
42 datafusion:vortex-file-compressed -13.7% -0.6% -13.1% +10.0% ✅ faster
42 duckdb:duckdb +6.6% -0.6% +7.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +4.5% -0.6% +5.2% +13.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (3 files changed, -0.0% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.64 MB 408 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB 360 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.3%
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.966x ➖
Shifts: Parquet (control) -3.4% · Median polish -6.6%


datafusion / vortex-file-compressed (0.949x ➖, 2↑ 3↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 260214044 259833208 1.00
tpch_q02/datafusion:vortex-file-compressed 🚨 695086351 470373225 1.48
tpch_q03/datafusion:vortex-file-compressed 🚨 647898880 452463271 1.43
tpch_q04/datafusion:vortex-file-compressed 287898537 259683472 1.11
tpch_q05/datafusion:vortex-file-compressed 🚨 716569526 417726411 1.72
tpch_q06/datafusion:vortex-file-compressed 349537721 377163349 0.93
tpch_q07/datafusion:vortex-file-compressed 509653410 403315430 1.26
tpch_q08/datafusion:vortex-file-compressed 596580627 655352653 0.91
tpch_q09/datafusion:vortex-file-compressed 432981385 493868193 0.88
tpch_q10/datafusion:vortex-file-compressed 516987852 624922317 0.83
tpch_q11/datafusion:vortex-file-compressed 291020840 287047600 1.01
tpch_q12/datafusion:vortex-file-compressed 402877046 494349443 0.81
tpch_q13/datafusion:vortex-file-compressed 193777269 149539156 1.30
tpch_q14/datafusion:vortex-file-compressed 🚀 183566078 368932574 0.50
tpch_q15/datafusion:vortex-file-compressed 🚀 302226610 521323397 0.58
tpch_q16/datafusion:vortex-file-compressed 196985624 238699987 0.83
tpch_q17/datafusion:vortex-file-compressed 377407763 493487009 0.76
tpch_q18/datafusion:vortex-file-compressed 316922543 386633640 0.82
tpch_q19/datafusion:vortex-file-compressed 364938045 458038546 0.80
tpch_q20/datafusion:vortex-file-compressed 371488115 470769769 0.79
tpch_q21/datafusion:vortex-file-compressed 519396860 545380335 0.95
tpch_q22/datafusion:vortex-file-compressed 205212983 193373153 1.06
datafusion / vortex-compact (1.156x ➖, 2↑ 6↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 411406751 424131066 0.97
tpch_q02/datafusion:vortex-compact 🚀 539149669 1061725313 0.51
tpch_q03/datafusion:vortex-compact 433925497 383475969 1.13
tpch_q04/datafusion:vortex-compact 231561610 205024656 1.13
tpch_q05/datafusion:vortex-compact 401892090 438270847 0.92
tpch_q06/datafusion:vortex-compact 322354726 346509047 0.93
tpch_q07/datafusion:vortex-compact 534106443 443559881 1.20
tpch_q08/datafusion:vortex-compact 🚨 821772999 509079312 1.61
tpch_q09/datafusion:vortex-compact 🚨 596071869 390234054 1.53
tpch_q10/datafusion:vortex-compact 672606052 738094762 0.91
tpch_q11/datafusion:vortex-compact 312153219 280853459 1.11
tpch_q12/datafusion:vortex-compact 587423804 490494944 1.20
tpch_q13/datafusion:vortex-compact 205897043 158476793 1.30
tpch_q14/datafusion:vortex-compact 🚨 329782405 240089326 1.37
tpch_q15/datafusion:vortex-compact 488969772 381811452 1.28
tpch_q16/datafusion:vortex-compact 242874651 246165237 0.99
tpch_q17/datafusion:vortex-compact 🚨 602162272 330841074 1.82
tpch_q18/datafusion:vortex-compact 🚨 430764504 254342643 1.69
tpch_q19/datafusion:vortex-compact 517652354 412097374 1.26
tpch_q20/datafusion:vortex-compact 🚨 598995621 381938893 1.57
tpch_q21/datafusion:vortex-compact 584491820 450065760 1.30
tpch_q22/datafusion:vortex-compact 🚀 145482476 208015892 0.70
datafusion / parquet (0.936x ➖, 4↑ 2↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 229801986 353537850 0.65
tpch_q02/datafusion:parquet 403016609 444217902 0.91
tpch_q03/datafusion:parquet 🚀 308407578 537420421 0.57
tpch_q04/datafusion:parquet 🚀 145734064 240883918 0.60
tpch_q05/datafusion:parquet 492921717 569321029 0.87
tpch_q06/datafusion:parquet 220433349 172252414 1.28
tpch_q07/datafusion:parquet 547077785 595126729 0.92
tpch_q08/datafusion:parquet 🚀 612114753 1119322677 0.55
tpch_q09/datafusion:parquet 463348415 481579060 0.96
tpch_q10/datafusion:parquet 546303537 535643848 1.02
tpch_q11/datafusion:parquet 🚨 472244189 330225647 1.43
tpch_q12/datafusion:parquet 219306854 270238314 0.81
tpch_q13/datafusion:parquet 433799960 424854217 1.02
tpch_q14/datafusion:parquet 166127959 175335707 0.95
tpch_q15/datafusion:parquet 282879970 291898564 0.97
tpch_q16/datafusion:parquet 167902940 190840468 0.88
tpch_q17/datafusion:parquet 369291463 375449318 0.98
tpch_q18/datafusion:parquet 434381982 435210617 1.00
tpch_q19/datafusion:parquet 385984270 365089405 1.06
tpch_q20/datafusion:parquet 388406687 380127363 1.02
tpch_q21/datafusion:parquet 662384438 562889619 1.18
tpch_q22/datafusion:parquet 🚨 279714147 160414143 1.74
duckdb / vortex-file-compressed (0.966x ➖, 0↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 281339024 281328987 1.00
tpch_q02/duckdb:vortex-file-compressed 1015449968 947234477 1.07
tpch_q03/duckdb:vortex-file-compressed 698092294 731414367 0.95
tpch_q04/duckdb:vortex-file-compressed 401542926 429671228 0.93
tpch_q05/duckdb:vortex-file-compressed 955553202 1026924288 0.93
tpch_q06/duckdb:vortex-file-compressed 426712062 441140852 0.97
tpch_q07/duckdb:vortex-file-compressed 831238111 913756933 0.91
tpch_q08/duckdb:vortex-file-compressed 965582115 1103726235 0.87
tpch_q09/duckdb:vortex-file-compressed 833979144 867795322 0.96
tpch_q10/duckdb:vortex-file-compressed 767970545 821308678 0.94
tpch_q11/duckdb:vortex-file-compressed 497978134 551222529 0.90
tpch_q12/duckdb:vortex-file-compressed 457981453 540663837 0.85
tpch_q13/duckdb:vortex-file-compressed 🚨 648455135 478025491 1.36
tpch_q14/duckdb:vortex-file-compressed 500175470 546035966 0.92
tpch_q15/duckdb:vortex-file-compressed 325538100 301391085 1.08
tpch_q16/duckdb:vortex-file-compressed 402764872 398267780 1.01
tpch_q17/duckdb:vortex-file-compressed 852500930 757960565 1.12
tpch_q18/duckdb:vortex-file-compressed 569196773 668440948 0.85
tpch_q19/duckdb:vortex-file-compressed 438072351 477069709 0.92
tpch_q20/duckdb:vortex-file-compressed 847941124 977253203 0.87
tpch_q21/duckdb:vortex-file-compressed 1166016771 1271215076 0.92
tpch_q22/duckdb:vortex-file-compressed 386704562 367831461 1.05
duckdb / vortex-compact (0.936x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 274479365 279028136 0.98
tpch_q02/duckdb:vortex-compact 909929245 956013225 0.95
tpch_q03/duckdb:vortex-compact 598031372 839098581 0.71
tpch_q04/duckdb:vortex-compact 334350762 411858751 0.81
tpch_q05/duckdb:vortex-compact 925468524 899816902 1.03
tpch_q06/duckdb:vortex-compact 372751791 391257628 0.95
tpch_q07/duckdb:vortex-compact 767690952 803485338 0.96
tpch_q08/duckdb:vortex-compact 1003660820 1017241284 0.99
tpch_q09/duckdb:vortex-compact 886643388 934743916 0.95
tpch_q10/duckdb:vortex-compact 722841118 649069722 1.11
tpch_q11/duckdb:vortex-compact 504209084 492772604 1.02
tpch_q12/duckdb:vortex-compact 460389019 456346300 1.01
tpch_q13/duckdb:vortex-compact 440364038 486569561 0.91
tpch_q14/duckdb:vortex-compact 416245029 500589200 0.83
tpch_q15/duckdb:vortex-compact 313301010 363828335 0.86
tpch_q16/duckdb:vortex-compact 385161630 381135526 1.01
tpch_q17/duckdb:vortex-compact 631305523 671538484 0.94
tpch_q18/duckdb:vortex-compact 489326201 575616157 0.85
tpch_q19/duckdb:vortex-compact 438629339 510790856 0.86
tpch_q20/duckdb:vortex-compact 785375571 813283783 0.97
tpch_q21/duckdb:vortex-compact 1084964136 1097678970 0.99
tpch_q22/duckdb:vortex-compact 374188101 377915788 0.99
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 520674142 449744303 1.16
tpch_q02/duckdb:parquet 1289088865 1207604966 1.07
tpch_q03/duckdb:parquet 1025195185 1015845673 1.01
tpch_q04/duckdb:parquet 650138224 673931020 0.96
tpch_q05/duckdb:parquet 1555129306 1547732862 1.00
tpch_q06/duckdb:parquet 401881292 478548600 0.84
tpch_q07/duckdb:parquet 1289807687 1322309716 0.98
tpch_q08/duckdb:parquet 1777908073 1812049388 0.98
tpch_q09/duckdb:parquet 1556213682 1567553288 0.99
tpch_q10/duckdb:parquet 1305841143 1310081038 1.00
tpch_q11/duckdb:parquet 894251999 931572578 0.96
tpch_q12/duckdb:parquet 799486020 693670244 1.15
tpch_q13/duckdb:parquet 931091789 941487179 0.99
tpch_q14/duckdb:parquet 662335490 741977347 0.89
tpch_q15/duckdb:parquet 606423217 544792238 1.11
tpch_q16/duckdb:parquet 632712228 632234732 1.00
tpch_q17/duckdb:parquet 953129868 847139625 1.13
tpch_q18/duckdb:parquet 884360753 950230471 0.93
tpch_q19/duckdb:parquet 835585081 887386364 0.94
tpch_q20/duckdb:parquet 1040565052 1175816636 0.88
tpch_q21/duckdb:parquet 1350214349 1195476411 1.13
tpch_q22/duckdb:parquet 564821295 618508554 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.0% -13.3% +11.8% +89.7% ➖ noise
1 datafusion:vortex-file-compressed +0.1% -13.3% +15.4% +71.8% ➖ noise
1 duckdb:vortex-compact -1.6% -13.3% +13.4% +48.3% ➖ noise
1 duckdb:vortex-file-compressed +0.0% -13.3% +15.3% +52.0% ➖ noise
2 datafusion:vortex-compact -49.2% -1.6% -48.4% +54.1% ✅ faster
2 datafusion:vortex-file-compressed +47.8% -1.6% +50.2% +40.6% 🚨 regression
2 duckdb:vortex-compact -4.8% -1.6% -3.3% +40.6% ➖ noise
2 duckdb:vortex-file-compressed +7.2% -1.6% +8.9% +40.6% ➖ noise
3 datafusion:vortex-compact +13.2% -23.9% +48.7% +62.9% ➖ noise
3 datafusion:vortex-file-compressed +43.2% -23.9% +88.2% +47.8% 🚨 regression
3 duckdb:vortex-compact -28.7% -23.9% -6.3% +40.6% ➖ noise
3 duckdb:vortex-file-compressed -4.6% -23.9% +25.4% +40.6% ➖ noise
4 datafusion:vortex-compact +12.9% -23.6% +47.8% +40.6% 🚨 regression
4 datafusion:vortex-file-compressed +10.9% -23.6% +45.1% +40.9% 🚨 regression
4 duckdb:vortex-compact -18.8% -23.6% +6.3% +44.4% ➖ noise
4 duckdb:vortex-file-compressed -6.5% -23.6% +22.3% +40.6% ➖ noise
5 datafusion:vortex-compact -8.3% -6.7% -1.7% +40.6% ➖ noise
5 datafusion:vortex-file-compressed +71.5% -6.7% +83.9% +40.6% 🚨 regression
5 duckdb:vortex-compact +2.9% -6.7% +10.3% +40.6% ➖ noise
5 duckdb:vortex-file-compressed -6.9% -6.7% -0.2% +40.6% ➖ noise
6 datafusion:vortex-compact -7.0% +3.7% -10.3% +40.6% ➖ noise
6 datafusion:vortex-file-compressed -7.3% +3.7% -10.6% +40.6% ➖ noise
6 duckdb:vortex-compact -4.7% +3.7% -8.1% +40.6% ➖ noise
6 duckdb:vortex-file-compressed -3.3% +3.7% -6.7% +40.6% ➖ noise
7 datafusion:vortex-compact +20.4% -5.3% +27.2% +40.6% ➖ noise
7 datafusion:vortex-file-compressed +26.4% -5.3% +33.4% +40.6% ➖ noise
7 duckdb:vortex-compact -4.5% -5.3% +0.9% +40.6% ➖ noise
7 duckdb:vortex-file-compressed -9.0% -5.3% -3.9% +40.6% ➖ noise
8 datafusion:vortex-compact +61.4% -26.7% +120.4% +40.6% 🚨 regression
8 datafusion:vortex-file-compressed -9.0% -26.7% +24.3% +40.6% ➖ noise
8 duckdb:vortex-compact -1.3% -26.7% +34.7% +40.6% ➖ noise
8 duckdb:vortex-file-compressed -12.5% -26.7% +19.4% +40.6% ➖ noise
9 datafusion:vortex-compact +52.7% -2.3% +56.3% +40.6% 🚨 regression
9 datafusion:vortex-file-compressed -12.3% -2.3% -10.3% +40.6% ➖ noise
9 duckdb:vortex-compact -5.1% -2.3% -2.9% +40.6% ➖ noise
9 duckdb:vortex-file-compressed -3.9% -2.3% -1.7% +40.6% ➖ noise
10 datafusion:vortex-compact -8.9% +0.8% -9.6% +40.6% ➖ noise
10 datafusion:vortex-file-compressed -17.3% +0.8% -17.9% +40.6% ➖ noise
10 duckdb:vortex-compact +11.4% +0.8% +10.5% +40.6% ➖ noise
10 duckdb:vortex-file-compressed -6.5% +0.8% -7.3% +40.6% ➖ noise
11 datafusion:vortex-compact +11.1% +17.2% -5.1% +44.7% ➖ noise
11 datafusion:vortex-file-compressed +1.4% +17.2% -13.5% +40.6% ➖ noise
11 duckdb:vortex-compact +2.3% +17.2% -12.7% +40.6% ➖ noise
11 duckdb:vortex-file-compressed -9.7% +17.2% -22.9% +40.6% ➖ noise
12 datafusion:vortex-compact +19.8% -3.3% +23.8% +40.6% ➖ noise
12 datafusion:vortex-file-compressed -18.5% -3.3% -15.7% +40.6% ➖ noise
12 duckdb:vortex-compact +0.9% -3.3% +4.3% +40.6% ➖ noise
12 duckdb:vortex-file-compressed -15.3% -3.3% -12.4% +40.6% ➖ noise
13 datafusion:vortex-compact +29.9% +0.5% +29.3% +72.9% ➖ noise
13 datafusion:vortex-file-compressed +29.6% +0.5% +29.0% +56.7% ➖ noise
13 duckdb:vortex-compact -9.5% +0.5% -9.9% +40.9% ➖ noise
13 duckdb:vortex-file-compressed +35.7% +0.5% +35.0% +40.6% ➖ noise
14 datafusion:vortex-compact +37.4% -8.0% +49.4% +40.6% 🚨 regression
14 datafusion:vortex-file-compressed -50.2% -8.0% -45.9% +40.6% ✅ faster
14 duckdb:vortex-compact -16.8% -8.0% -9.6% +40.6% ➖ noise
14 duckdb:vortex-file-compressed -8.4% -8.0% -0.4% +40.6% ➖ noise
15 datafusion:vortex-compact +28.1% +3.9% +23.3% +40.6% ➖ noise
15 datafusion:vortex-file-compressed -42.0% +3.9% -44.2% +40.6% ✅ faster
15 duckdb:vortex-compact -13.9% +3.9% -17.1% +40.6% ➖ noise
15 duckdb:vortex-file-compressed +8.0% +3.9% +4.0% +40.6% ➖ noise
16 datafusion:vortex-compact -1.3% -6.2% +5.1% +40.6% ➖ noise
16 datafusion:vortex-file-compressed -17.5% -6.2% -12.1% +40.6% ➖ noise
16 duckdb:vortex-compact +1.1% -6.2% +7.7% +40.6% ➖ noise
16 duckdb:vortex-file-compressed +1.1% -6.2% +7.8% +40.6% ➖ noise
17 datafusion:vortex-compact +82.0% +5.2% +73.0% +40.6% 🚨 regression
17 datafusion:vortex-file-compressed -23.5% +5.2% -27.3% +40.6% ➖ noise
17 duckdb:vortex-compact -6.0% +5.2% -10.6% +40.6% ➖ noise
17 duckdb:vortex-file-compressed +12.5% +5.2% +6.9% +40.6% ➖ noise
18 datafusion:vortex-compact +69.4% -3.6% +75.7% +40.6% 🚨 regression
18 datafusion:vortex-file-compressed -18.0% -3.6% -15.0% +40.6% ➖ noise
18 duckdb:vortex-compact -15.0% -3.6% -11.8% +40.6% ➖ noise
18 duckdb:vortex-file-compressed -14.8% -3.6% -11.6% +40.6% ➖ noise
19 datafusion:vortex-compact +25.6% -0.2% +25.9% +41.8% ➖ noise
19 datafusion:vortex-file-compressed -20.3% -0.2% -20.1% +40.6% ➖ noise
19 duckdb:vortex-compact -14.1% -0.2% -13.9% +40.6% ➖ noise
19 duckdb:vortex-file-compressed -8.2% -0.2% -8.0% +40.6% ➖ noise
20 datafusion:vortex-compact +56.8% -4.9% +64.9% +40.6% 🚨 regression
20 datafusion:vortex-file-compressed -21.1% -4.9% -17.0% +41.2% ➖ noise
20 duckdb:vortex-compact -3.4% -4.9% +1.6% +40.6% ➖ noise
20 duckdb:vortex-file-compressed -13.2% -4.9% -8.8% +40.6% ➖ noise
21 datafusion:vortex-compact +29.9% +15.3% +12.6% +184.0% ➖ noise
21 datafusion:vortex-file-compressed -4.8% +15.3% -17.4% +40.6% ➖ noise
21 duckdb:vortex-compact -1.2% +15.3% -14.3% +40.6% ➖ noise
21 duckdb:vortex-file-compressed -8.3% +15.3% -20.4% +40.6% ➖ noise
22 datafusion:vortex-compact -30.1% +26.2% -44.6% +40.6% ✅ faster
22 datafusion:vortex-file-compressed +6.1% +26.2% -15.9% +40.6% ➖ noise
22 duckdb:vortex-compact -1.0% +26.2% -21.5% +40.6% ➖ noise
22 duckdb:vortex-file-compressed +5.1% +26.2% -16.7% +40.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.975x ➖


unknown / unknown (0.966x ➖, 13↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
compress time/Arade 1149242612 1231299595 0.93
compress time/Bimbo 6608385734 7132309449 0.93
compress time/CMSprovider 2915566988 3062865121 0.95
compress time/Euro2016 437343078 459518337 0.95
compress time/Food 🚀 394455220 443011335 0.89
compress time/HashTags 839512224 877133213 0.96
compress time/TPC-H l_comment canonical 1316996975 1403643494 0.94
compress time/TPC-H l_comment chunked 1325013443 1405445757 0.94
compress time/taxi 695689651 770612475 0.90
compress time/wide table cols=100 chunks=1 rows=1000 11819706 12493722 0.95
compress time/wide table cols=100 chunks=50 rows=1000 12063963 12722130 0.95
compress time/wide table cols=1000 chunks=1 rows=1000 124076617 134588769 0.92
compress time/wide table cols=1000 chunks=50 rows=1000 129523520 135952658 0.95
compress time/wide table cols=10000 chunks=1 rows=1000 1440159514 1482131649 0.97
compress time/wide table cols=10000 chunks=50 rows=1000 1430952729 1513420728 0.95
decompress time/Arade 30552070 31254848 0.98
decompress time/Bimbo 🚀 93479338 108316342 0.86
decompress time/CMSprovider 89310014 94819168 0.94
decompress time/Euro2016 19322168 21217277 0.91
decompress time/Food 9652033 10679484 0.90
decompress time/HashTags 73972268 76908838 0.96
decompress time/TPC-H l_comment canonical 40768286 43776613 0.93
decompress time/TPC-H l_comment chunked 40154627 43924312 0.91
decompress time/taxi 🚀 15953227 19170715 0.83
decompress time/wide table cols=100 chunks=1 rows=1000 2624095 2844758 0.92
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2726873 3072883 0.89
decompress time/wide table cols=1000 chunks=1 rows=1000 24084055 25863501 0.93
decompress time/wide table cols=1000 chunks=50 rows=1000 24686225 24993068 0.99
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 266275388 298759957 0.89
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 260151867 303112353 0.86
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2860485815 3065173385 0.93
parquet_rs-zstd compress time/Bimbo 14574389111 15548743815 0.94
parquet_rs-zstd compress time/CMSprovider 7439742361 8213600183 0.91
parquet_rs-zstd compress time/Euro2016 1342625986 1431990290 0.94
parquet_rs-zstd compress time/Food 862347725 892964330 0.97
parquet_rs-zstd compress time/HashTags 🚀 2293471935 2576192290 0.89
parquet_rs-zstd compress time/TPC-H l_comment canonical 3089398304 3320223504 0.93
parquet_rs-zstd compress time/TPC-H l_comment chunked 3118850557 3333641009 0.94
parquet_rs-zstd compress time/taxi 1338942755 1440528832 0.93
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 7539168 8497033 0.89
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7608008 8303378 0.92
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 83412601 87428329 0.95
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85217280 87934640 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 854817459 903281877 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 872701714 901715466 0.97
parquet_rs-zstd decompress time/Arade 635039320 661993544 0.96
parquet_rs-zstd decompress time/Bimbo 1692830477 1805744028 0.94
parquet_rs-zstd decompress time/CMSprovider 1963028033 2089534644 0.94
parquet_rs-zstd decompress time/Euro2016 381588298 405313981 0.94
parquet_rs-zstd decompress time/Food 219684228 229540314 0.96
parquet_rs-zstd decompress time/HashTags 🚀 638424103 743600348 0.86
parquet_rs-zstd decompress time/TPC-H l_comment canonical 555169331 585828970 0.95
parquet_rs-zstd decompress time/TPC-H l_comment chunked 561370986 592995538 0.95
parquet_rs-zstd decompress time/taxi 248775462 258388149 0.96
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2746693 3167919 0.87
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2781035 3165616 0.88
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31779527 34659108 0.92
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32510118 35569493 0.91
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 336372204 362379163 0.93
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 338396964 352787807 0.96
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163599156 163393980 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 0.92
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.07
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.02
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.92
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.97
vortex:parquet-zstd ratio decompress time/Food 0 0 0.94
vortex:parquet-zstd ratio decompress time/HashTags 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.86
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 0 0 0.89
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +2.5%


datafusion / vortex-file-compressed (0.944x ➖, 3↑ 2↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 728953325 678176968 1.07
tpch_q02/datafusion:vortex-file-compressed 691798004 846677074 0.82
tpch_q03/datafusion:vortex-file-compressed 827916142 791390398 1.05
tpch_q04/datafusion:vortex-file-compressed 599066095 546801406 1.10
tpch_q05/datafusion:vortex-file-compressed 987168601 902321684 1.09
tpch_q06/datafusion:vortex-file-compressed 635394775 639105271 0.99
tpch_q07/datafusion:vortex-file-compressed 🚨 1299500222 993314143 1.31
tpch_q08/datafusion:vortex-file-compressed 1251664414 1399727136 0.89
tpch_q09/datafusion:vortex-file-compressed 1438308494 1450909878 0.99
tpch_q10/datafusion:vortex-file-compressed 1064688369 1232446480 0.86
tpch_q11/datafusion:vortex-file-compressed 563615413 464543904 1.21
tpch_q12/datafusion:vortex-file-compressed 959211634 1020211290 0.94
tpch_q13/datafusion:vortex-file-compressed 447982750 423922024 1.06
tpch_q14/datafusion:vortex-file-compressed 653564675 678609318 0.96
tpch_q15/datafusion:vortex-file-compressed 1447177917 1395588455 1.04
tpch_q16/datafusion:vortex-file-compressed 🚀 340309389 644112512 0.53
tpch_q17/datafusion:vortex-file-compressed 1252960331 1476064437 0.85
tpch_q18/datafusion:vortex-file-compressed 🚀 1221682126 1747728407 0.70
tpch_q19/datafusion:vortex-file-compressed 🚀 1042105414 1714541048 0.61
tpch_q20/datafusion:vortex-file-compressed 1124281394 1421478551 0.79
tpch_q21/datafusion:vortex-file-compressed 1742979198 1828268454 0.95
tpch_q22/datafusion:vortex-file-compressed 🚨 587578611 391964045 1.50
datafusion / vortex-compact (0.977x ➖, 1↑ 1↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 704326464 715609174 0.98
tpch_q02/datafusion:vortex-compact 620322782 656075776 0.95
tpch_q03/datafusion:vortex-compact 🚨 1163113999 809223757 1.44
tpch_q04/datafusion:vortex-compact 753177734 949595006 0.79
tpch_q05/datafusion:vortex-compact 1057647223 1274012436 0.83
tpch_q06/datafusion:vortex-compact 646381137 666919213 0.97
tpch_q07/datafusion:vortex-compact 1146569320 1004644236 1.14
tpch_q08/datafusion:vortex-compact 🚀 1187752348 1858512793 0.64
tpch_q09/datafusion:vortex-compact 1251610194 1598211104 0.78
tpch_q10/datafusion:vortex-compact 1110757184 939408101 1.18
tpch_q11/datafusion:vortex-compact 403015149 450332473 0.89
tpch_q12/datafusion:vortex-compact 876370492 784484032 1.12
tpch_q13/datafusion:vortex-compact 400818411 393918901 1.02
tpch_q14/datafusion:vortex-compact 578117359 637101449 0.91
tpch_q15/datafusion:vortex-compact 1280748475 1191326082 1.08
tpch_q16/datafusion:vortex-compact 374827097 358558973 1.05
tpch_q17/datafusion:vortex-compact 1181779762 1092507047 1.08
tpch_q18/datafusion:vortex-compact 1110472127 1072259337 1.04
tpch_q19/datafusion:vortex-compact 773028446 782070224 0.99
tpch_q20/datafusion:vortex-compact 884492842 904887430 0.98
tpch_q21/datafusion:vortex-compact 1419799784 1555811701 0.91
tpch_q22/datafusion:vortex-compact 449312525 446480479 1.01
datafusion / parquet (1.120x ➖, 1↑ 5↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 731890492 773584193 0.95
tpch_q02/datafusion:parquet 🚨 1396847293 1016497924 1.37
tpch_q03/datafusion:parquet 🚀 1015552635 1527649730 0.66
tpch_q04/datafusion:parquet 509360546 553533056 0.92
tpch_q05/datafusion:parquet 🚨 1784534399 1296985412 1.38
tpch_q06/datafusion:parquet 532630394 510870345 1.04
tpch_q07/datafusion:parquet 1363117956 1221341335 1.12
tpch_q08/datafusion:parquet 1679247750 1562743653 1.07
tpch_q09/datafusion:parquet 1680781916 1647071973 1.02
tpch_q10/datafusion:parquet 1920043355 1920506506 1.00
tpch_q11/datafusion:parquet 554367567 457528600 1.21
tpch_q12/datafusion:parquet 🚨 896247028 622711212 1.44
tpch_q13/datafusion:parquet 🚨 1393375758 745156538 1.87
tpch_q14/datafusion:parquet 🚨 1819716722 837866621 2.17
tpch_q15/datafusion:parquet 1356131296 1165900213 1.16
tpch_q16/datafusion:parquet 569648619 566069283 1.01
tpch_q17/datafusion:parquet 1311095086 1420125203 0.92
tpch_q18/datafusion:parquet 1471974168 1402213534 1.05
tpch_q19/datafusion:parquet 948943888 1088050810 0.87
tpch_q20/datafusion:parquet 1558770569 1229505120 1.27
tpch_q21/datafusion:parquet 1953818649 1679446323 1.16
tpch_q22/datafusion:parquet 639798457 761004292 0.84
duckdb / vortex-file-compressed (1.079x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 634682366 588242177 1.08
tpch_q02/duckdb:vortex-file-compressed 1107861452 1137315030 0.97
tpch_q03/duckdb:vortex-file-compressed 967424234 902559483 1.07
tpch_q04/duckdb:vortex-file-compressed 698593527 671845835 1.04
tpch_q05/duckdb:vortex-file-compressed 1078661782 1136769110 0.95
tpch_q06/duckdb:vortex-file-compressed 965549230 768932306 1.26
tpch_q07/duckdb:vortex-file-compressed 1175235492 1251431281 0.94
tpch_q08/duckdb:vortex-file-compressed 1673234386 1495284363 1.12
tpch_q09/duckdb:vortex-file-compressed 1673121601 1455583268 1.15
tpch_q10/duckdb:vortex-file-compressed 1366636865 1054528241 1.30
tpch_q11/duckdb:vortex-file-compressed 679934507 710128032 0.96
tpch_q12/duckdb:vortex-file-compressed 815235907 666294003 1.22
tpch_q13/duckdb:vortex-file-compressed 1052317626 938273731 1.12
tpch_q14/duckdb:vortex-file-compressed 984163275 857916911 1.15
tpch_q15/duckdb:vortex-file-compressed 570682583 526542851 1.08
tpch_q16/duckdb:vortex-file-compressed 517394953 552019699 0.94
tpch_q17/duckdb:vortex-file-compressed 1076892371 980286896 1.10
tpch_q18/duckdb:vortex-file-compressed 959464958 901851885 1.06
tpch_q19/duckdb:vortex-file-compressed 840710725 821408272 1.02
tpch_q20/duckdb:vortex-file-compressed 1441312909 1243445026 1.16
tpch_q21/duckdb:vortex-file-compressed 2098931174 2207970696 0.95
tpch_q22/duckdb:vortex-file-compressed 783758655 655286306 1.20
duckdb / vortex-compact (1.042x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 671675110 583608894 1.15
tpch_q02/duckdb:vortex-compact 1333413693 1157463956 1.15
tpch_q03/duckdb:vortex-compact 827045714 924620186 0.89
tpch_q04/duckdb:vortex-compact 655873310 610867621 1.07
tpch_q05/duckdb:vortex-compact 1154043204 1103229529 1.05
tpch_q06/duckdb:vortex-compact 767446558 725435648 1.06
tpch_q07/duckdb:vortex-compact 1113772365 1192610424 0.93
tpch_q08/duckdb:vortex-compact 1602640712 1397988841 1.15
tpch_q09/duckdb:vortex-compact 1483456551 1306243598 1.14
tpch_q10/duckdb:vortex-compact 1295478166 1147539047 1.13
tpch_q11/duckdb:vortex-compact 810527096 668968599 1.21
tpch_q12/duckdb:vortex-compact 709716005 690660000 1.03
tpch_q13/duckdb:vortex-compact 855169173 908699895 0.94
tpch_q14/duckdb:vortex-compact 812295128 908900448 0.89
tpch_q15/duckdb:vortex-compact 539808030 533468231 1.01
tpch_q16/duckdb:vortex-compact 505286460 500147367 1.01
tpch_q17/duckdb:vortex-compact 934374179 1034827394 0.90
tpch_q18/duckdb:vortex-compact 836407196 871678037 0.96
tpch_q19/duckdb:vortex-compact 802106420 739289197 1.08
tpch_q20/duckdb:vortex-compact 1223852845 1146661742 1.07
tpch_q21/duckdb:vortex-compact 1733629720 1636806578 1.06
tpch_q22/duckdb:vortex-compact 745701326 659225633 1.13
duckdb / parquet (0.957x ➖, 0↑ 0↓)
name PR 9fac461 (ns) base 30042ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 789406336 878954086 0.90
tpch_q02/duckdb:parquet 1501929914 1505941760 1.00
tpch_q03/duckdb:parquet 1829179527 1830379143 1.00
tpch_q04/duckdb:parquet 1072318963 1166862598 0.92
tpch_q05/duckdb:parquet 2196172872 2444562271 0.90
tpch_q06/duckdb:parquet 670973670 679808915 0.99
tpch_q07/duckdb:parquet 1777580591 2318578766 0.77
tpch_q08/duckdb:parquet 2732671242 3021538067 0.90
tpch_q09/duckdb:parquet 2756950408 2554805239 1.08
tpch_q10/duckdb:parquet 3335432973 3327866262 1.00
tpch_q11/duckdb:parquet 978259309 1108424081 0.88
tpch_q12/duckdb:parquet 1230042822 1418341692 0.87
tpch_q13/duckdb:parquet 1223326526 1286907447 0.95
tpch_q14/duckdb:parquet 1175682929 1180146894 1.00
tpch_q15/duckdb:parquet 850084381 901925540 0.94
tpch_q16/duckdb:parquet 958382050 916057457 1.05
tpch_q17/duckdb:parquet 1308118905 1350931908 0.97
tpch_q18/duckdb:parquet 1226938057 1354181146 0.91
tpch_q19/duckdb:parquet 1524940230 1445232452 1.06
tpch_q20/duckdb:parquet 1936773877 1841738952 1.05
tpch_q21/duckdb:parquet 1823639437 1858693905 0.98
tpch_q22/duckdb:parquet 1003303011 994818755 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.6% -7.8% +6.8% +48.9% ➖ noise
1 datafusion:vortex-file-compressed +7.5% -7.8% +16.6% +55.5% ➖ noise
1 duckdb:vortex-compact +15.1% -7.8% +24.9% +40.1% ➖ noise
1 duckdb:vortex-file-compressed +7.9% -7.8% +17.0% +42.3% ➖ noise
2 datafusion:vortex-compact -5.4% +17.1% -19.2% +49.3% ➖ noise
2 datafusion:vortex-file-compressed -18.3% +17.1% -30.2% +44.7% ➖ noise
2 duckdb:vortex-compact +15.2% +17.1% -1.6% +40.1% ➖ noise
2 duckdb:vortex-file-compressed -2.6% +17.1% -16.8% +40.1% ➖ noise
3 datafusion:vortex-compact +43.7% -18.5% +76.3% +43.3% 🚨 regression
3 datafusion:vortex-file-compressed +4.6% -18.5% +28.4% +50.0% ➖ noise
3 duckdb:vortex-compact -10.6% -18.5% +9.7% +40.1% ➖ noise
3 duckdb:vortex-file-compressed +7.2% -18.5% +31.5% +41.3% ➖ noise
4 datafusion:vortex-compact -20.7% -8.0% -13.7% +46.2% ➖ noise
4 datafusion:vortex-file-compressed +9.6% -8.0% +19.1% +40.1% ➖ noise
4 duckdb:vortex-compact +7.4% -8.0% +16.8% +40.8% ➖ noise
4 duckdb:vortex-file-compressed +4.0% -8.0% +13.1% +40.1% ➖ noise
5 datafusion:vortex-compact -17.0% +11.2% -25.3% +40.1% ➖ noise
5 datafusion:vortex-file-compressed +9.4% +11.2% -1.6% +40.1% ➖ noise
5 duckdb:vortex-compact +4.6% +11.2% -5.9% +40.1% ➖ noise
5 duckdb:vortex-file-compressed -5.1% +11.2% -14.7% +40.1% ➖ noise
6 datafusion:vortex-compact -3.1% +1.4% -4.5% +40.1% ➖ noise
6 datafusion:vortex-file-compressed -0.6% +1.4% -2.0% +40.1% ➖ noise
6 duckdb:vortex-compact +5.8% +1.4% +4.3% +40.1% ➖ noise
6 duckdb:vortex-file-compressed +25.6% +1.4% +23.8% +65.0% ➖ noise
7 datafusion:vortex-compact +14.1% -7.5% +23.4% +40.1% ➖ noise
7 datafusion:vortex-file-compressed +30.8% -7.5% +41.4% +40.1% 🚨 regression
7 duckdb:vortex-compact -6.6% -7.5% +1.0% +40.1% ➖ noise
7 duckdb:vortex-file-compressed -6.1% -7.5% +1.5% +40.1% ➖ noise
8 datafusion:vortex-compact -36.1% -1.4% -35.2% +40.1% ✅ faster
8 datafusion:vortex-file-compressed -10.6% -1.4% -9.3% +40.1% ➖ noise
8 duckdb:vortex-compact +14.6% -1.4% +16.3% +40.1% ➖ noise
8 duckdb:vortex-file-compressed +11.9% -1.4% +13.5% +40.1% ➖ noise
9 datafusion:vortex-compact -21.7% +4.9% -25.4% +40.1% ➖ noise
9 datafusion:vortex-file-compressed -0.9% +4.9% -5.5% +40.1% ➖ noise
9 duckdb:vortex-compact +13.6% +4.9% +8.2% +40.1% ➖ noise
9 duckdb:vortex-file-compressed +14.9% +4.9% +9.5% +40.1% ➖ noise
10 datafusion:vortex-compact +18.2% +0.1% +18.1% +40.1% ➖ noise
10 datafusion:vortex-file-compressed -13.6% +0.1% -13.7% +40.1% ➖ noise
10 duckdb:vortex-compact +12.9% +0.1% +12.8% +40.1% ➖ noise
10 duckdb:vortex-file-compressed +29.6% +0.1% +29.5% +40.1% ➖ noise
11 datafusion:vortex-compact -10.5% +3.4% -13.5% +40.1% ➖ noise
11 datafusion:vortex-file-compressed +21.3% +3.4% +17.3% +40.1% ➖ noise
11 duckdb:vortex-compact +21.2% +3.4% +17.2% +40.1% ➖ noise
11 duckdb:vortex-file-compressed -4.3% +3.4% -7.4% +40.1% ➖ noise
12 datafusion:vortex-compact +11.7% +11.7% -0.0% +40.1% ➖ noise
12 datafusion:vortex-file-compressed -6.0% +11.7% -15.8% +40.1% ➖ noise
12 duckdb:vortex-compact +2.8% +11.7% -8.0% +40.1% ➖ noise
12 duckdb:vortex-file-compressed +22.4% +11.7% +9.5% +40.1% ➖ noise
13 datafusion:vortex-compact +1.8% +33.3% -23.7% +40.1% ➖ noise
13 datafusion:vortex-file-compressed +5.7% +33.3% -20.7% +50.1% ➖ noise
13 duckdb:vortex-compact -5.9% +33.3% -29.4% +55.1% ➖ noise
13 duckdb:vortex-file-compressed +12.2% +33.3% -15.9% +40.1% ➖ noise
14 datafusion:vortex-compact -9.3% +47.1% -38.3% +40.1% ✅ faster
14 datafusion:vortex-file-compressed -3.7% +47.1% -34.5% +40.1% ✅ faster
14 duckdb:vortex-compact -10.6% +47.1% -39.2% +40.1% ✅ faster
14 duckdb:vortex-file-compressed +14.7% +47.1% -22.0% +40.1% ➖ noise
15 datafusion:vortex-compact +7.5% +4.7% +2.7% +40.1% ➖ noise
15 datafusion:vortex-file-compressed +3.7% +4.7% -1.0% +40.1% ➖ noise
15 duckdb:vortex-compact +1.2% +4.7% -3.4% +40.1% ➖ noise
15 duckdb:vortex-file-compressed +8.4% +4.7% +3.5% +40.1% ➖ noise
16 datafusion:vortex-compact +4.5% +2.6% +1.9% +40.1% ➖ noise
16 datafusion:vortex-file-compressed -47.2% +2.6% -48.5% +42.8% ✅ faster
16 duckdb:vortex-compact +1.0% +2.6% -1.5% +40.1% ➖ noise
16 duckdb:vortex-file-compressed -6.3% +2.6% -8.7% +40.1% ➖ noise
17 datafusion:vortex-compact +8.2% -5.5% +14.4% +40.1% ➖ noise
17 datafusion:vortex-file-compressed -15.1% -5.5% -10.2% +40.1% ➖ noise
17 duckdb:vortex-compact -9.7% -5.5% -4.5% +41.0% ➖ noise
17 duckdb:vortex-file-compressed +9.9% -5.5% +16.2% +40.1% ➖ noise
18 datafusion:vortex-compact +3.6% -2.5% +6.2% +40.1% ➖ noise
18 datafusion:vortex-file-compressed -30.1% -2.5% -28.3% +40.1% ➖ noise
18 duckdb:vortex-compact -4.0% -2.5% -1.6% +40.1% ➖ noise
18 duckdb:vortex-file-compressed +6.4% -2.5% +9.1% +40.1% ➖ noise
19 datafusion:vortex-compact -1.2% -4.1% +3.0% +49.6% ➖ noise
19 datafusion:vortex-file-compressed -39.2% -4.1% -36.6% +89.9% ➖ noise
19 duckdb:vortex-compact +8.5% -4.1% +13.1% +47.7% ➖ noise
19 duckdb:vortex-file-compressed +2.3% -4.1% +6.7% +57.8% ➖ noise
20 datafusion:vortex-compact -2.3% +15.5% -15.3% +40.1% ➖ noise
20 datafusion:vortex-file-compressed -20.9% +15.5% -31.5% +44.3% ✅ faster
20 duckdb:vortex-compact +6.7% +15.5% -7.6% +40.1% ➖ noise
20 duckdb:vortex-file-compressed +15.9% +15.5% +0.4% +40.1% ➖ noise
21 datafusion:vortex-compact -8.7% +6.8% -14.6% +40.1% ➖ noise
21 datafusion:vortex-file-compressed -4.7% +6.8% -10.8% +40.1% ➖ noise
21 duckdb:vortex-compact +5.9% +6.8% -0.9% +40.1% ➖ noise
21 duckdb:vortex-file-compressed -4.9% +6.8% -11.0% +40.1% ➖ noise
22 datafusion:vortex-compact +0.6% -7.9% +9.3% +40.1% ➖ noise
22 datafusion:vortex-file-compressed +49.9% -7.9% +62.8% +40.1% 🚨 regression
22 duckdb:vortex-compact +13.1% -7.9% +22.8% +40.1% ➖ noise
22 duckdb:vortex-file-compressed +19.6% -7.9% +29.9% +40.1% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

action/benchmark Trigger full benchmarks to run on this PR do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant