Skip to content

Implement compare/between for bitpacked arrays - improve performance by up to 2X#7279

Closed
AdamGS wants to merge 14 commits into
developfrom
adamg/bitpack-compare
Closed

Implement compare/between for bitpacked arrays - improve performance by up to 2X#7279
AdamGS wants to merge 14 commits into
developfrom
adamg/bitpack-compare

Conversation

@AdamGS

@AdamGS AdamGS commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

After some iterations, this seems to improve performance in any case we actually measure. It does require merging and releasing spiraldb/fastlanes#125.

@codspeed-hq

codspeed-hq Bot commented Apr 3, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 62.79%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 27 improved benchmarks
❌ 2 regressed benchmarks
✅ 1208 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 187.5 µs 224.9 µs -16.66%
Simulation new_alp_prim_test_between[f64, 2048] 70.6 µs 55.1 µs +28.16%
Simulation new_alp_prim_test_between[f64, 32768] 250.4 µs 117.9 µs ×2.1
Simulation new_bp_prim_test_between[i16, 16384] 82.2 µs 65 µs +26.35%
Simulation new_bp_prim_test_between[i16, 32768] 120.3 µs 93.2 µs +29.02%
Simulation new_bp_prim_test_between[i32, 2048] 53.4 µs 43.5 µs +22.93%
Simulation new_alp_prim_test_between[f32, 2048] 62.1 µs 51.5 µs +20.54%
Simulation new_bp_prim_test_between[i16, 2048] 48.8 µs 40.3 µs +21.24%
Simulation new_bp_prim_test_between[i32, 32768] 155.9 µs 98.7 µs +58.06%
Simulation new_alp_prim_test_between[f32, 32768] 153.3 µs 112 µs +36.87%
Simulation baseline_eq[4, 65536] 237.9 µs 179.9 µs +32.21%
Simulation fast_eq_out_of_range[4, 65536] 246 µs 85.4 µs ×2.9
Simulation baseline_lt[4, 65536] 251.9 µs 200.7 µs +25.52%
Simulation baseline_eq[16, 65536] 259.4 µs 202.3 µs +28.2%
Simulation new_bp_prim_test_between[i32, 16384] 101.2 µs 69.5 µs +45.55%
Simulation new_alp_prim_test_between[f32, 16384] 103.9 µs 79.6 µs +30.56%
Simulation new_alp_prim_test_between[f64, 16384] 146.9 µs 84.8 µs +73.13%
Simulation fast_lt_out_of_range[16, 1024] 67.9 µs 25.1 µs ×2.7
Simulation fast_lt_out_of_range[16, 65536] 306.3 µs 144.9 µs ×2.1
Simulation fast_lt_out_of_range[4, 1024] 87.5 µs 31.1 µs ×2.8
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/bitpack-compare (7a3b856) with develop (2fa51e2)

Open in CodSpeed

@AdamGS AdamGS added the changelog/performance A performance improvement label Apr 3, 2026
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from 74732ef to 8cddde0 Compare April 3, 2026 16:45
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7a3b856 1 Explore Profiling Data
Previous Runs (10)
Status Commit Job Attempt Link
🟢 Done 9177626 1 Explore Profiling Data
🟢 Done 083b4b4 1 Explore Profiling Data
🟢 Done 54608c5 2 Explore Profiling Data
🟢 Done dbe5a37 2 Explore Profiling Data
🟢 Done 54608c5 1 Explore Profiling Data
🟢 Done dbe5a37 1 Explore Profiling Data
🟢 Done db42e44 2 Explore Profiling Data
🟢 Done db42e44 1 Explore Profiling Data
🟢 Done 00d6bc4 1 Explore Profiling Data
🟢 Done abd15b8 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.970x ➖


datafusion / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 128349850 133643109 0.96
polarsignals_q01/datafusion:vortex-file-compressed 279228403 296590234 0.94
polarsignals_q02/datafusion:vortex-file-compressed 23787722 24454138 0.97
polarsignals_q03/datafusion:vortex-file-compressed 286288409 295396090 0.97
polarsignals_q04/datafusion:vortex-file-compressed 11297001 12395094 0.91
polarsignals_q05/datafusion:vortex-file-compressed 15254006 16266519 0.94
polarsignals_q06/datafusion:vortex-file-compressed 17920873 19299329 0.93
polarsignals_q07/datafusion:vortex-file-compressed 14183149 13985861 1.01
polarsignals_q08/datafusion:vortex-file-compressed 428502300 410641537 1.04
polarsignals_q09/datafusion:vortex-file-compressed 11257477 10952338 1.03

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.050x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +2.4%


datafusion / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53551989 53534238 1.00
tpch_q02/datafusion:vortex-file-compressed 23663711 23288298 1.02
tpch_q03/datafusion:vortex-file-compressed 29709507 30363377 0.98
tpch_q04/datafusion:vortex-file-compressed 21119158 21913419 0.96
tpch_q05/datafusion:vortex-file-compressed 49404424 52738108 0.94
tpch_q06/datafusion:vortex-file-compressed 10783734 11274553 0.96
tpch_q07/datafusion:vortex-file-compressed 59331396 58020637 1.02
tpch_q08/datafusion:vortex-file-compressed 41626961 42282899 0.98
tpch_q09/datafusion:vortex-file-compressed 55850835 55161423 1.01
tpch_q10/datafusion:vortex-file-compressed 40950983 41729583 0.98
tpch_q11/datafusion:vortex-file-compressed 16786903 16485992 1.02
tpch_q12/datafusion:vortex-file-compressed 25537787 24662151 1.04
tpch_q13/datafusion:vortex-file-compressed 25669083 26408891 0.97
tpch_q14/datafusion:vortex-file-compressed 16530686 17832626 0.93
tpch_q15/datafusion:vortex-file-compressed 25844068 25627693 1.01
tpch_q16/datafusion:vortex-file-compressed 21356418 20808282 1.03
tpch_q17/datafusion:vortex-file-compressed 71629801 74509558 0.96
tpch_q18/datafusion:vortex-file-compressed 86139711 85830030 1.00
tpch_q19/datafusion:vortex-file-compressed 20892491 21759483 0.96
tpch_q20/datafusion:vortex-file-compressed 30786836 30186575 1.02
tpch_q21/datafusion:vortex-file-compressed 75201867 76583627 0.98
tpch_q22/datafusion:vortex-file-compressed 13075915 12943793 1.01
datafusion / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58021732 60232011 0.96
tpch_q02/datafusion:vortex-compact 26464769 27129958 0.98
tpch_q03/datafusion:vortex-compact 31550549 30672394 1.03
tpch_q04/datafusion:vortex-compact 23495915 23374700 1.01
tpch_q05/datafusion:vortex-compact 54456064 53733928 1.01
tpch_q06/datafusion:vortex-compact 12891066 12947165 1.00
tpch_q07/datafusion:vortex-compact 62636050 64087018 0.98
tpch_q08/datafusion:vortex-compact 44724127 45226742 0.99
tpch_q09/datafusion:vortex-compact 58393901 60489239 0.97
tpch_q10/datafusion:vortex-compact 46719937 47295191 0.99
tpch_q11/datafusion:vortex-compact 17387942 17861826 0.97
tpch_q12/datafusion:vortex-compact 31813382 32186230 0.99
tpch_q13/datafusion:vortex-compact 32433966 32438028 1.00
tpch_q14/datafusion:vortex-compact 19548595 19982169 0.98
tpch_q15/datafusion:vortex-compact 31684844 31977889 0.99
tpch_q16/datafusion:vortex-compact 26012364 24915662 1.04
tpch_q17/datafusion:vortex-compact 73153444 76707891 0.95
tpch_q18/datafusion:vortex-compact 90293938 89651224 1.01
tpch_q19/datafusion:vortex-compact 32146087 31087898 1.03
tpch_q20/datafusion:vortex-compact 36908376 35957925 1.03
tpch_q21/datafusion:vortex-compact 81932052 78849556 1.04
tpch_q22/datafusion:vortex-compact 13596816 13116580 1.04
datafusion / parquet (0.991x ➖, 1↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 124117690 136629623 0.91
tpch_q02/datafusion:parquet 63695118 63448043 1.00
tpch_q03/datafusion:parquet 72412213 67457691 1.07
tpch_q04/datafusion:parquet 44240930 44562776 0.99
tpch_q05/datafusion:parquet 96118183 97897549 0.98
tpch_q06/datafusion:parquet 🚀 33837480 40084257 0.84
tpch_q07/datafusion:parquet 108197632 110825783 0.98
tpch_q08/datafusion:parquet 98288535 95361146 1.03
tpch_q09/datafusion:parquet 135931470 132714370 1.02
tpch_q10/datafusion:parquet 113392502 115152699 0.98
tpch_q11/datafusion:parquet 42076690 43064920 0.98
tpch_q12/datafusion:parquet 86493490 79303220 1.09
tpch_q13/datafusion:parquet 204624346 202387378 1.01
tpch_q14/datafusion:parquet 48262473 46456233 1.04
tpch_q15/datafusion:parquet 60673720 60947959 1.00
tpch_q16/datafusion:parquet 42370354 41211739 1.03
tpch_q17/datafusion:parquet 142133897 140672136 1.01
tpch_q18/datafusion:parquet 169780291 170441633 1.00
tpch_q19/datafusion:parquet 74545568 79402791 0.94
tpch_q20/datafusion:parquet 67919492 69603967 0.98
tpch_q21/datafusion:parquet 136006664 137271492 0.99
tpch_q22/datafusion:parquet 31180269 32787986 0.95
datafusion / arrow (0.992x ➖, 0↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56017408 62108033 0.90
tpch_q02/datafusion:arrow 19483855 19466581 1.00
tpch_q03/datafusion:arrow 31456292 31455127 1.00
tpch_q04/datafusion:arrow 27778138 26970343 1.03
tpch_q05/datafusion:arrow 86659936 79315675 1.09
tpch_q06/datafusion:arrow 🚨 22738686 20566934 1.11
tpch_q07/datafusion:arrow 107293693 108423699 0.99
tpch_q08/datafusion:arrow 45602964 46592737 0.98
tpch_q09/datafusion:arrow 67771407 70878900 0.96
tpch_q10/datafusion:arrow 48776891 50764342 0.96
tpch_q11/datafusion:arrow 9398740 9625829 0.98
tpch_q12/datafusion:arrow 54835971 55106207 1.00
tpch_q13/datafusion:arrow 47388866 47743907 0.99
tpch_q14/datafusion:arrow 23164840 23617729 0.98
tpch_q15/datafusion:arrow 44494746 44671928 1.00
tpch_q16/datafusion:arrow 19286613 19635335 0.98
tpch_q17/datafusion:arrow 71166386 72641746 0.98
tpch_q18/datafusion:arrow 147065981 146172387 1.01
tpch_q19/datafusion:arrow 36666841 37315012 0.98
tpch_q20/datafusion:arrow 36089751 37442093 0.96
tpch_q21/datafusion:arrow 159076535 162202572 0.98
tpch_q22/datafusion:arrow 18093666 18229888 0.99
duckdb / vortex-file-compressed (1.125x ❌, 0↑ 17↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33679465 31887337 1.06
tpch_q02/duckdb:vortex-file-compressed 🚨 26788837 23836565 1.12
tpch_q03/duckdb:vortex-file-compressed 🚨 34932428 30030323 1.16
tpch_q04/duckdb:vortex-file-compressed 🚨 31644143 28406273 1.11
tpch_q05/duckdb:vortex-file-compressed 🚨 41825277 37178103 1.12
tpch_q06/duckdb:vortex-file-compressed 🚨 9856635 8626637 1.14
tpch_q07/duckdb:vortex-file-compressed 🚨 37838596 33919850 1.12
tpch_q08/duckdb:vortex-file-compressed 🚨 39747186 35667667 1.11
tpch_q09/duckdb:vortex-file-compressed 🚨 67520093 59961844 1.13
tpch_q10/duckdb:vortex-file-compressed 🚨 48465578 42097275 1.15
tpch_q11/duckdb:vortex-file-compressed 15473766 14664106 1.06
tpch_q12/duckdb:vortex-file-compressed 24497610 22494539 1.09
tpch_q13/duckdb:vortex-file-compressed 🚨 39788999 36123601 1.10
tpch_q14/duckdb:vortex-file-compressed 22721782 21339236 1.06
tpch_q15/duckdb:vortex-file-compressed 🚨 19274996 16845522 1.14
tpch_q16/duckdb:vortex-file-compressed 29971241 27548824 1.09
tpch_q17/duckdb:vortex-file-compressed 🚨 27750256 24679662 1.12
tpch_q18/duckdb:vortex-file-compressed 🚨 57116775 49903057 1.14
tpch_q19/duckdb:vortex-file-compressed 🚨 34819843 29696475 1.17
tpch_q20/duckdb:vortex-file-compressed 🚨 37812134 32787133 1.15
tpch_q21/duckdb:vortex-file-compressed 🚨 119207070 97206876 1.23
tpch_q22/duckdb:vortex-file-compressed 🚨 18245492 15655044 1.17
duckdb / vortex-compact (1.092x ➖, 0↑ 11↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40505135 38193850 1.06
tpch_q02/duckdb:vortex-compact 33951911 33058632 1.03
tpch_q03/duckdb:vortex-compact 🚨 36772951 32687505 1.12
tpch_q04/duckdb:vortex-compact 33330381 31474917 1.06
tpch_q05/duckdb:vortex-compact 🚨 46233256 40643576 1.14
tpch_q06/duckdb:vortex-compact 11266870 11365588 0.99
tpch_q07/duckdb:vortex-compact 🚨 45290602 40341539 1.12
tpch_q08/duckdb:vortex-compact 43939128 42108766 1.04
tpch_q09/duckdb:vortex-compact 75906679 70181521 1.08
tpch_q10/duckdb:vortex-compact 🚨 52432225 47119888 1.11
tpch_q11/duckdb:vortex-compact 20284669 18552577 1.09
tpch_q12/duckdb:vortex-compact 🚨 33043990 29470497 1.12
tpch_q13/duckdb:vortex-compact 48930935 44692825 1.09
tpch_q14/duckdb:vortex-compact 🚨 29311721 26120938 1.12
tpch_q15/duckdb:vortex-compact 🚨 22575692 19802202 1.14
tpch_q16/duckdb:vortex-compact 🚨 34291883 30969863 1.11
tpch_q17/duckdb:vortex-compact 32163745 29900493 1.08
tpch_q18/duckdb:vortex-compact 56013417 53532359 1.05
tpch_q19/duckdb:vortex-compact 🚨 39345977 35523048 1.11
tpch_q20/duckdb:vortex-compact 44208143 40295038 1.10
tpch_q21/duckdb:vortex-compact 🚨 119224255 101826904 1.17
tpch_q22/duckdb:vortex-compact 🚨 20195566 18138789 1.11
duckdb / parquet (1.044x ➖, 0↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78962218 76099682 1.04
tpch_q02/duckdb:parquet 41320354 40107755 1.03
tpch_q03/duckdb:parquet 71362552 70221649 1.02
tpch_q04/duckdb:parquet 48811518 48074500 1.02
tpch_q05/duckdb:parquet 70068021 66454682 1.05
tpch_q06/duckdb:parquet 20944256 21031338 1.00
tpch_q07/duckdb:parquet 73725583 70222770 1.05
tpch_q08/duckdb:parquet 84355953 81334299 1.04
tpch_q09/duckdb:parquet 146623371 160245418 0.91
tpch_q10/duckdb:parquet 135375018 127569079 1.06
tpch_q11/duckdb:parquet 22913353 22277780 1.03
tpch_q12/duckdb:parquet 48829899 46329340 1.05
tpch_q13/duckdb:parquet 287786082 267238406 1.08
tpch_q14/duckdb:parquet 51555212 49823249 1.03
tpch_q15/duckdb:parquet 26153276 27626626 0.95
tpch_q16/duckdb:parquet 61486670 57186626 1.08
tpch_q17/duckdb:parquet 56006741 51241585 1.09
tpch_q18/duckdb:parquet 119682000 114999075 1.04
tpch_q19/duckdb:parquet 77495981 70565889 1.10
tpch_q20/duckdb:parquet 66072335 62351971 1.06
tpch_q21/duckdb:parquet 🚨 198734981 161809219 1.23
tpch_q22/duckdb:parquet 55216650 52261629 1.06
duckdb / duckdb (1.089x ➖, 0↑ 9↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16924898 16199620 1.04
tpch_q02/duckdb:duckdb 🚨 14712098 13088808 1.12
tpch_q03/duckdb:duckdb 21284814 19613324 1.09
tpch_q04/duckdb:duckdb 21133948 20081396 1.05
tpch_q05/duckdb:duckdb 22327844 20431586 1.09
tpch_q06/duckdb:duckdb 🚨 6059705 5493145 1.10
tpch_q07/duckdb:duckdb 🚨 26154878 22188826 1.18
tpch_q08/duckdb:duckdb 23153066 21403468 1.08
tpch_q09/duckdb:duckdb 🚨 64879155 55628504 1.17
tpch_q10/duckdb:duckdb 47372651 45038041 1.05
tpch_q11/duckdb:duckdb 🚨 6827680 6120926 1.12
tpch_q12/duckdb:duckdb 🚨 15739649 13965219 1.13
tpch_q13/duckdb:duckdb 40885146 38952653 1.05
tpch_q14/duckdb:duckdb 18360083 18900558 0.97
tpch_q15/duckdb:duckdb 13116199 12128071 1.08
tpch_q16/duckdb:duckdb 26118102 23744067 1.10
tpch_q17/duckdb:duckdb 🚨 15573462 14084577 1.11
tpch_q18/duckdb:duckdb 40834104 39543069 1.03
tpch_q19/duckdb:duckdb 🚨 32100247 27403127 1.17
tpch_q20/duckdb:duckdb 24613224 23519570 1.05
tpch_q21/duckdb:duckdb 🚨 65323946 58220031 1.12
tpch_q22/duckdb:duckdb 26420011 24314012 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -9.8% -2.9% -7.1% +20.3% ➖ noise
1 datafusion:vortex-compact -3.7% -2.9% -0.8% +18.9% ➖ noise
1 datafusion:vortex-file-compressed +0.0% -2.9% +3.0% +20.0% ➖ noise
1 duckdb:duckdb +4.5% -2.9% +7.6% +17.1% ➖ noise
1 duckdb:vortex-compact +6.1% -2.9% +9.2% +17.8% ➖ noise
1 duckdb:vortex-file-compressed +5.6% -2.9% +8.8% +20.5% ➖ noise
2 datafusion:arrow +0.1% +1.7% -1.6% +10.5% ➖ noise
2 datafusion:vortex-compact -2.5% +1.7% -4.1% +10.5% ➖ noise
2 datafusion:vortex-file-compressed +1.6% +1.7% -0.1% +10.5% ➖ noise
2 duckdb:duckdb +12.4% +1.7% +10.5% +10.9% ➖ noise
2 duckdb:vortex-compact +2.7% +1.7% +1.0% +10.5% ➖ noise
2 duckdb:vortex-file-compressed +12.4% +1.7% +10.5% +10.5% ➖ noise
3 datafusion:arrow +0.0% +4.4% -4.3% +10.5% ➖ noise
3 datafusion:vortex-compact +2.9% +4.4% -1.5% +10.6% ➖ noise
3 datafusion:vortex-file-compressed -2.2% +4.4% -6.3% +10.5% ➖ noise
3 duckdb:duckdb +8.5% +4.4% +3.9% +13.6% ➖ noise
3 duckdb:vortex-compact +12.5% +4.4% +7.7% +10.5% ➖ noise
3 duckdb:vortex-file-compressed +16.3% +4.4% +11.4% +10.6% 🚨 regression
4 datafusion:arrow +3.0% +0.4% +2.6% +10.5% ➖ noise
4 datafusion:vortex-compact +0.5% +0.4% +0.1% +10.5% ➖ noise
4 datafusion:vortex-file-compressed -3.6% +0.4% -4.0% +12.1% ➖ noise
4 duckdb:duckdb +5.2% +0.4% +4.8% +10.5% ➖ noise
4 duckdb:vortex-compact +5.9% +0.4% +5.5% +10.5% ➖ noise
4 duckdb:vortex-file-compressed +11.4% +0.4% +11.0% +10.5% 🚨 regression
5 datafusion:arrow +9.3% +1.7% +7.4% +10.5% ➖ noise
5 datafusion:vortex-compact +1.3% +1.7% -0.4% +10.5% ➖ noise
5 datafusion:vortex-file-compressed -6.3% +1.7% -7.9% +10.5% ➖ noise
5 duckdb:duckdb +9.3% +1.7% +7.4% +10.5% ➖ noise
5 duckdb:vortex-compact +13.8% +1.7% +11.8% +10.5% 🚨 regression
5 duckdb:vortex-file-compressed +12.5% +1.7% +10.6% +10.5% 🚨 regression
6 datafusion:arrow +10.6% -8.3% +20.6% +17.2% 🚨 regression
6 datafusion:vortex-compact -0.4% -8.3% +8.6% +16.1% ➖ noise
6 datafusion:vortex-file-compressed -4.4% -8.3% +4.3% +19.2% ➖ noise
6 duckdb:duckdb +10.3% -8.3% +20.3% +16.5% 🚨 regression
6 duckdb:vortex-compact -0.9% -8.3% +8.1% +19.0% ➖ noise
6 duckdb:vortex-file-compressed +14.3% -8.3% +24.6% +16.1% 🚨 regression
7 datafusion:arrow -1.0% +1.2% -2.3% +10.5% ➖ noise
7 datafusion:vortex-compact -2.3% +1.2% -3.5% +10.5% ➖ noise
7 datafusion:vortex-file-compressed +2.3% +1.2% +1.0% +10.5% ➖ noise
7 duckdb:duckdb +17.9% +1.2% +16.4% +10.9% 🚨 regression
7 duckdb:vortex-compact +12.3% +1.2% +10.9% +10.5% 🚨 regression
7 duckdb:vortex-file-compressed +11.6% +1.2% +10.2% +14.1% ➖ noise
8 datafusion:arrow -2.1% +3.4% -5.3% +10.5% ➖ noise
8 datafusion:vortex-compact -1.1% +3.4% -4.4% +10.5% ➖ noise
8 datafusion:vortex-file-compressed -1.6% +3.4% -4.8% +10.5% ➖ noise
8 duckdb:duckdb +8.2% +3.4% +4.6% +10.5% ➖ noise
8 duckdb:vortex-compact +4.3% +3.4% +0.9% +11.4% ➖ noise
8 duckdb:vortex-file-compressed +11.4% +3.4% +7.8% +11.2% ➖ noise
9 datafusion:arrow -4.4% -3.2% -1.2% +10.5% ➖ noise
9 datafusion:vortex-compact -3.5% -3.2% -0.3% +10.5% ➖ noise
9 datafusion:vortex-file-compressed +1.2% -3.2% +4.6% +10.5% ➖ noise
9 duckdb:duckdb +16.6% -3.2% +20.5% +10.5% 🚨 regression
9 duckdb:vortex-compact +8.2% -3.2% +11.7% +10.5% 🚨 regression
9 duckdb:vortex-file-compressed +12.6% -3.2% +16.3% +10.5% 🚨 regression
10 datafusion:arrow -3.9% +2.2% -6.0% +10.5% ➖ noise
10 datafusion:vortex-compact -1.2% +2.2% -3.4% +10.5% ➖ noise
10 datafusion:vortex-file-compressed -1.9% +2.2% -4.0% +10.5% ➖ noise
10 duckdb:duckdb +5.2% +2.2% +2.9% +12.0% ➖ noise
10 duckdb:vortex-compact +11.3% +2.2% +8.9% +10.5% ➖ noise
10 duckdb:vortex-file-compressed +15.1% +2.2% +12.6% +10.5% 🚨 regression
11 datafusion:arrow -2.4% +0.2% -2.6% +10.5% ➖ noise
11 datafusion:vortex-compact -2.7% +0.2% -2.9% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +1.8% +0.2% +1.6% +10.5% ➖ noise
11 duckdb:duckdb +11.5% +0.2% +11.3% +14.2% ➖ noise
11 duckdb:vortex-compact +9.3% +0.2% +9.1% +10.5% ➖ noise
11 duckdb:vortex-file-compressed +5.5% +0.2% +5.3% +14.8% ➖ noise
12 datafusion:arrow -0.5% +7.2% -7.2% +18.2% ➖ noise
12 datafusion:vortex-compact -1.2% +7.2% -7.8% +10.5% ➖ noise
12 datafusion:vortex-file-compressed +3.6% +7.2% -3.4% +11.0% ➖ noise
12 duckdb:duckdb +12.7% +7.2% +5.1% +11.7% ➖ noise
12 duckdb:vortex-compact +12.1% +7.2% +4.6% +10.5% ➖ noise
12 duckdb:vortex-file-compressed +8.9% +7.2% +1.6% +10.8% ➖ noise
13 datafusion:arrow -0.7% +4.3% -4.9% +10.5% ➖ noise
13 datafusion:vortex-compact -0.0% +4.3% -4.2% +10.5% ➖ noise
13 datafusion:vortex-file-compressed -2.8% +4.3% -6.8% +10.5% ➖ noise
13 duckdb:duckdb +5.0% +4.3% +0.6% +10.5% ➖ noise
13 duckdb:vortex-compact +9.5% +4.3% +4.9% +10.5% ➖ noise
13 duckdb:vortex-file-compressed +10.1% +4.3% +5.6% +10.5% ➖ noise
14 datafusion:arrow -1.9% +3.7% -5.4% +10.5% ➖ noise
14 datafusion:vortex-compact -2.2% +3.7% -5.6% +10.5% ➖ noise
14 datafusion:vortex-file-compressed -7.3% +3.7% -10.6% +10.5% ✅ faster
14 duckdb:duckdb -2.9% +3.7% -6.3% +17.5% ➖ noise
14 duckdb:vortex-compact +12.2% +3.7% +8.2% +10.5% ➖ noise
14 duckdb:vortex-file-compressed +6.5% +3.7% +2.7% +12.5% ➖ noise
15 datafusion:arrow -0.4% -2.9% +2.6% +13.5% ➖ noise
15 datafusion:vortex-compact -0.9% -2.9% +2.1% +12.1% ➖ noise
15 datafusion:vortex-file-compressed +0.8% -2.9% +3.9% +12.1% ➖ noise
15 duckdb:duckdb +8.1% -2.9% +11.4% +17.2% ➖ noise
15 duckdb:vortex-compact +14.0% -2.9% +17.4% +13.7% 🚨 regression
15 duckdb:vortex-file-compressed +14.4% -2.9% +17.9% +15.1% 🚨 regression
16 datafusion:arrow -1.8% +5.1% -6.6% +10.5% ➖ noise
16 datafusion:vortex-compact +4.4% +5.1% -0.7% +10.5% ➖ noise
16 datafusion:vortex-file-compressed +2.6% +5.1% -2.4% +10.5% ➖ noise
16 duckdb:duckdb +10.0% +5.1% +4.6% +11.0% ➖ noise
16 duckdb:vortex-compact +10.7% +5.1% +5.3% +10.5% ➖ noise
16 duckdb:vortex-file-compressed +8.8% +5.1% +3.5% +10.5% ➖ noise
17 datafusion:arrow -2.0% +5.1% -6.8% +13.9% ➖ noise
17 datafusion:vortex-compact -4.6% +5.1% -9.3% +10.5% ➖ noise
17 datafusion:vortex-file-compressed -3.9% +5.1% -8.5% +10.8% ➖ noise
17 duckdb:duckdb +10.6% +5.1% +5.2% +10.6% ➖ noise
17 duckdb:vortex-compact +7.6% +5.1% +2.4% +13.7% ➖ noise
17 duckdb:vortex-file-compressed +12.4% +5.1% +7.0% +13.8% ➖ noise
18 datafusion:arrow +0.6% +1.8% -1.2% +10.5% ➖ noise
18 datafusion:vortex-compact +0.7% +1.8% -1.1% +10.5% ➖ noise
18 datafusion:vortex-file-compressed +0.4% +1.8% -1.4% +10.5% ➖ noise
18 duckdb:duckdb +3.3% +1.8% +1.4% +10.5% ➖ noise
18 duckdb:vortex-compact +4.6% +1.8% +2.8% +10.5% ➖ noise
18 duckdb:vortex-file-compressed +14.5% +1.8% +12.4% +10.5% 🚨 regression
19 datafusion:arrow -1.7% +1.5% -3.2% +18.1% ➖ noise
19 datafusion:vortex-compact +3.4% +1.5% +1.8% +11.7% ➖ noise
19 datafusion:vortex-file-compressed -4.0% +1.5% -5.4% +14.3% ➖ noise
19 duckdb:duckdb +17.1% +1.5% +15.4% +12.5% 🚨 regression
19 duckdb:vortex-compact +10.8% +1.5% +9.1% +13.0% ➖ noise
19 duckdb:vortex-file-compressed +17.3% +1.5% +15.5% +11.3% 🚨 regression
20 datafusion:arrow -3.6% +1.7% -5.2% +10.5% ➖ noise
20 datafusion:vortex-compact +2.6% +1.7% +0.9% +10.5% ➖ noise
20 datafusion:vortex-file-compressed +2.0% +1.7% +0.3% +10.5% ➖ noise
20 duckdb:duckdb +4.6% +1.7% +2.9% +10.5% ➖ noise
20 duckdb:vortex-compact +9.7% +1.7% +7.9% +10.5% ➖ noise
20 duckdb:vortex-file-compressed +15.3% +1.7% +13.4% +10.5% 🚨 regression
21 datafusion:arrow -1.9% +10.3% -11.1% +10.5% ✅ faster
21 datafusion:vortex-compact +3.9% +10.3% -5.8% +10.5% ➖ noise
21 datafusion:vortex-file-compressed -1.8% +10.3% -11.0% +10.5% ✅ faster
21 duckdb:duckdb +12.2% +10.3% +1.7% +10.5% ➖ noise
21 duckdb:vortex-compact +17.1% +10.3% +6.1% +10.5% ➖ noise
21 duckdb:vortex-file-compressed +22.6% +10.3% +11.2% +10.5% 🚨 regression
22 datafusion:arrow -0.7% +0.2% -1.0% +10.5% ➖ noise
22 datafusion:vortex-compact +3.7% +0.2% +3.4% +10.5% ➖ noise
22 datafusion:vortex-file-compressed +1.0% +0.2% +0.8% +10.5% ➖ noise
22 duckdb:duckdb +8.7% +0.2% +8.4% +10.5% ➖ noise
22 duckdb:vortex-compact +11.3% +0.2% +11.1% +15.2% ➖ noise
22 duckdb:vortex-file-compressed +16.5% +0.2% +16.3% +10.5% 🚨 regression

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.936x ➖
Shifts: Parquet (control) -6.4% · Median polish -2.7%


datafusion / vortex-file-compressed (0.951x ➖, 1↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5193219 5522567 0.94
fineweb_q01/datafusion:vortex-file-compressed 🚀 20022702 23149814 0.86
fineweb_q02/datafusion:vortex-file-compressed 20518159 22369509 0.92
fineweb_q03/datafusion:vortex-file-compressed 79336887 79908676 0.99
fineweb_q04/datafusion:vortex-file-compressed 225745928 227673478 0.99
fineweb_q05/datafusion:vortex-file-compressed 214076592 218015401 0.98
fineweb_q06/datafusion:vortex-file-compressed 51272200 53467177 0.96
fineweb_q07/datafusion:vortex-file-compressed 56420032 58563732 0.96
fineweb_q08/datafusion:vortex-file-compressed 21034385 21982444 0.96
datafusion / vortex-compact (0.971x ➖, 1↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5465701 5678745 0.96
fineweb_q01/datafusion:vortex-compact 89595268 95672608 0.94
fineweb_q02/datafusion:vortex-compact 108813678 101840839 1.07
fineweb_q03/datafusion:vortex-compact 862130490 879067553 0.98
fineweb_q04/datafusion:vortex-compact 922278433 932770955 0.99
fineweb_q05/datafusion:vortex-compact 807470628 840244987 0.96
fineweb_q06/datafusion:vortex-compact 462307605 468029779 0.99
fineweb_q07/datafusion:vortex-compact 480672070 490047614 0.98
fineweb_q08/datafusion:vortex-compact 🚀 17813668 20216370 0.88
datafusion / parquet (0.928x ➖, 2↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6090837 7489131 0.81
fineweb_q01/datafusion:parquet 🚀 281815434 315011712 0.89
fineweb_q02/datafusion:parquet 285715326 307659400 0.93
fineweb_q03/datafusion:parquet 296236846 299487229 0.99
fineweb_q04/datafusion:parquet 295657768 308527414 0.96
fineweb_q05/datafusion:parquet 295571565 321033663 0.92
fineweb_q06/datafusion:parquet 287251368 304671400 0.94
fineweb_q07/datafusion:parquet 287296834 294229936 0.98
fineweb_q08/datafusion:parquet 276703988 293062643 0.94
duckdb / vortex-file-compressed (0.986x ➖, 1↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3520738 3418789 1.03
fineweb_q01/duckdb:vortex-file-compressed 21791166 22959642 0.95
fineweb_q02/duckdb:vortex-file-compressed 23020702 24391337 0.94
fineweb_q03/duckdb:vortex-file-compressed 🚨 157122247 129966896 1.21
fineweb_q04/duckdb:vortex-file-compressed 217376398 218319883 1.00
fineweb_q05/duckdb:vortex-file-compressed 213773280 209871152 1.02
fineweb_q06/duckdb:vortex-file-compressed 🚀 51069046 57880248 0.88
fineweb_q07/duckdb:vortex-file-compressed 53337015 56613135 0.94
fineweb_q08/duckdb:vortex-file-compressed 21918991 23314476 0.94
duckdb / vortex-compact (1.001x ➖, 0↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4203523 4151524 1.01
fineweb_q01/duckdb:vortex-compact 🚨 122664019 107984516 1.14
fineweb_q02/duckdb:vortex-compact 112213317 113199884 0.99
fineweb_q03/duckdb:vortex-compact 850276990 879779295 0.97
fineweb_q04/duckdb:vortex-compact 890570965 904097710 0.99
fineweb_q05/duckdb:vortex-compact 797465570 813564922 0.98
fineweb_q06/duckdb:vortex-compact 452952978 463703542 0.98
fineweb_q07/duckdb:vortex-compact 470398192 481656122 0.98
fineweb_q08/duckdb:vortex-compact 19555182 19704405 0.99
duckdb / parquet (0.943x ➖, 2↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 25898382 30854837 0.84
fineweb_q01/duckdb:parquet 84062009 84746770 0.99
fineweb_q02/duckdb:parquet 82967916 86384460 0.96
fineweb_q03/duckdb:parquet 307105745 317073942 0.97
fineweb_q04/duckdb:parquet 437254195 443998115 0.98
fineweb_q05/duckdb:parquet 408485865 417675407 0.98
fineweb_q06/duckdb:parquet 198433808 200968667 0.99
fineweb_q07/duckdb:parquet 208275015 213147121 0.98
fineweb_q08/duckdb:parquet 🚀 28419553 34697242 0.82
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -3.8% -17.4% +16.5% +52.1% ➖ noise
0 datafusion:vortex-file-compressed -6.0% -17.4% +13.8% +55.2% ➖ noise
0 duckdb:vortex-compact +1.3% -17.4% +22.5% +89.9% ➖ noise
0 duckdb:vortex-file-compressed +3.0% -17.4% +24.6% +83.1% ➖ noise
1 datafusion:vortex-compact -6.4% -5.8% -0.6% +15.8% ➖ noise
1 datafusion:vortex-file-compressed -13.5% -5.8% -8.2% +17.9% ➖ noise
1 duckdb:vortex-compact +13.6% -5.8% +20.6% +22.0% ➖ noise
1 duckdb:vortex-file-compressed -5.1% -5.8% +0.8% +66.4% ➖ noise
2 datafusion:vortex-compact +6.8% -5.6% +13.1% +15.8% ➖ noise
2 datafusion:vortex-file-compressed -8.3% -5.6% -2.9% +15.8% ➖ noise
2 duckdb:vortex-compact -0.9% -5.6% +5.0% +16.6% ➖ noise
2 duckdb:vortex-file-compressed -5.6% -5.6% -0.1% +15.8% ➖ noise
3 datafusion:vortex-compact -1.9% -2.1% +0.2% +15.8% ➖ noise
3 datafusion:vortex-file-compressed -0.7% -2.1% +1.4% +42.0% ➖ noise
3 duckdb:vortex-compact -3.4% -2.1% -1.3% +15.8% ➖ noise
3 duckdb:vortex-file-compressed +20.9% -2.1% +23.5% +37.8% ➖ noise
4 datafusion:vortex-compact -1.1% -2.9% +1.8% +15.8% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -2.9% +2.1% +15.8% ➖ noise
4 duckdb:vortex-compact -1.5% -2.9% +1.4% +15.8% ➖ noise
4 duckdb:vortex-file-compressed -0.4% -2.9% +2.5% +15.8% ➖ noise
5 datafusion:vortex-compact -3.9% -5.1% +1.3% +15.8% ➖ noise
5 datafusion:vortex-file-compressed -1.8% -5.1% +3.5% +15.8% ➖ noise
5 duckdb:vortex-compact -2.0% -5.1% +3.3% +15.8% ➖ noise
5 duckdb:vortex-file-compressed +1.9% -5.1% +7.3% +15.8% ➖ noise
6 datafusion:vortex-compact -1.2% -3.5% +2.4% +15.8% ➖ noise
6 datafusion:vortex-file-compressed -4.1% -3.5% -0.6% +15.8% ➖ noise
6 duckdb:vortex-compact -2.3% -3.5% +1.2% +15.8% ➖ noise
6 duckdb:vortex-file-compressed -11.8% -3.5% -8.6% +15.8% ➖ noise
7 datafusion:vortex-compact -1.9% -2.3% +0.4% +15.8% ➖ noise
7 datafusion:vortex-file-compressed -3.7% -2.3% -1.4% +15.8% ➖ noise
7 duckdb:vortex-compact -2.3% -2.3% -0.0% +15.8% ➖ noise
7 duckdb:vortex-file-compressed -5.8% -2.3% -3.5% +16.5% ➖ noise
8 datafusion:vortex-compact -11.9% -12.1% +0.2% +17.2% ➖ noise
8 datafusion:vortex-file-compressed -4.3% -12.1% +8.8% +15.8% ➖ noise
8 duckdb:vortex-compact -0.8% -12.1% +12.9% +17.4% ➖ noise
8 duckdb:vortex-file-compressed -6.0% -12.1% +6.9% +27.2% ➖ noise

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.5%


datafusion / vortex-file-compressed (1.022x ➖, 0↑ 2↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25036949 24705107 1.01
tpcds_q02/datafusion:vortex-file-compressed 46664740 46789917 1.00
tpcds_q03/datafusion:vortex-file-compressed 14953596 15626097 0.96
tpcds_q04/datafusion:vortex-file-compressed 248067458 248834960 1.00
tpcds_q05/datafusion:vortex-file-compressed 45039261 42437042 1.06
tpcds_q06/datafusion:vortex-file-compressed 59505851 58791925 1.01
tpcds_q07/datafusion:vortex-file-compressed 42832482 41019045 1.04
tpcds_q08/datafusion:vortex-file-compressed 29067922 28090106 1.03
tpcds_q09/datafusion:vortex-file-compressed 40017361 39144845 1.02
tpcds_q10/datafusion:vortex-file-compressed 38925213 37421635 1.04
tpcds_q11/datafusion:vortex-file-compressed 137314604 130635298 1.05
tpcds_q12/datafusion:vortex-file-compressed 20373104 18818449 1.08
tpcds_q13/datafusion:vortex-file-compressed 38598841 39244010 0.98
tpcds_q14/datafusion:vortex-file-compressed 172849129 173698256 1.00
tpcds_q15/datafusion:vortex-file-compressed 28043340 28135354 1.00
tpcds_q16/datafusion:vortex-file-compressed 28721452 28024811 1.02
tpcds_q17/datafusion:vortex-file-compressed 63631885 62926498 1.01
tpcds_q18/datafusion:vortex-file-compressed 70525310 67993385 1.04
tpcds_q19/datafusion:vortex-file-compressed 21985567 22419407 0.98
tpcds_q20/datafusion:vortex-file-compressed 21418308 20643908 1.04
tpcds_q21/datafusion:vortex-file-compressed 35184638 35197695 1.00
tpcds_q22/datafusion:vortex-file-compressed 118034879 120866751 0.98
tpcds_q23/datafusion:vortex-file-compressed 159294769 147613360 1.08
tpcds_q24/datafusion:vortex-file-compressed 82829307 82718553 1.00
tpcds_q25/datafusion:vortex-file-compressed 66173666 66855906 0.99
tpcds_q26/datafusion:vortex-file-compressed 34338898 33571545 1.02
tpcds_q27/datafusion:vortex-file-compressed 101471658 102973268 0.99
tpcds_q28/datafusion:vortex-file-compressed 33568640 33486723 1.00
tpcds_q29/datafusion:vortex-file-compressed 63852197 60233958 1.06
tpcds_q30/datafusion:vortex-file-compressed 23818933 23434954 1.02
tpcds_q31/datafusion:vortex-file-compressed 73325491 72476477 1.01
tpcds_q32/datafusion:vortex-file-compressed 19948800 20460755 0.97
tpcds_q33/datafusion:vortex-file-compressed 30204541 29382860 1.03
tpcds_q34/datafusion:vortex-file-compressed 24404220 24428134 1.00
tpcds_q35/datafusion:vortex-file-compressed 46765789 44986903 1.04
tpcds_q36/datafusion:vortex-file-compressed 57971368 55774503 1.04
tpcds_q37/datafusion:vortex-file-compressed 24877315 24250542 1.03
tpcds_q38/datafusion:vortex-file-compressed 42307951 42116173 1.00
tpcds_q39/datafusion:vortex-file-compressed 106756513 102316063 1.04
tpcds_q40/datafusion:vortex-file-compressed 33308747 32044974 1.04
tpcds_q41/datafusion:vortex-file-compressed 15300016 15146752 1.01
tpcds_q42/datafusion:vortex-file-compressed 14474574 13654207 1.06
tpcds_q43/datafusion:vortex-file-compressed 18844048 18384960 1.02
tpcds_q44/datafusion:vortex-file-compressed 31978596 31578010 1.01
tpcds_q45/datafusion:vortex-file-compressed 28145412 26773679 1.05
tpcds_q46/datafusion:vortex-file-compressed 35981266 36204357 0.99
tpcds_q47/datafusion:vortex-file-compressed 134617803 131510702 1.02
tpcds_q48/datafusion:vortex-file-compressed 36095554 35539532 1.02
tpcds_q49/datafusion:vortex-file-compressed 58996343 56479223 1.04
tpcds_q50/datafusion:vortex-file-compressed 39838835 38743513 1.03
tpcds_q51/datafusion:vortex-file-compressed 90233970 88347316 1.02
tpcds_q52/datafusion:vortex-file-compressed 14881783 14464534 1.03
tpcds_q53/datafusion:vortex-file-compressed 21809721 21112908 1.03
tpcds_q54/datafusion:vortex-file-compressed 35288855 35022404 1.01
tpcds_q55/datafusion:vortex-file-compressed 14424069 14039942 1.03
tpcds_q56/datafusion:vortex-file-compressed 29815052 29838463 1.00
tpcds_q57/datafusion:vortex-file-compressed 107263526 106651048 1.01
tpcds_q58/datafusion:vortex-file-compressed 52649377 53106870 0.99
tpcds_q59/datafusion:vortex-file-compressed 56846991 57078704 1.00
tpcds_q60/datafusion:vortex-file-compressed 30129921 30378158 0.99
tpcds_q61/datafusion:vortex-file-compressed 40917184 39908555 1.03
tpcds_q62/datafusion:vortex-file-compressed 23219775 21201398 1.10
tpcds_q63/datafusion:vortex-file-compressed 20808382 21489249 0.97
tpcds_q64/datafusion:vortex-file-compressed 416964955 409294270 1.02
tpcds_q65/datafusion:vortex-file-compressed 41227416 38909444 1.06
tpcds_q66/datafusion:vortex-file-compressed 73553612 68030434 1.08
tpcds_q67/datafusion:vortex-file-compressed 149418583 145657768 1.03
tpcds_q68/datafusion:vortex-file-compressed 32803516 31808273 1.03
tpcds_q69/datafusion:vortex-file-compressed 37491586 35362087 1.06
tpcds_q70/datafusion:vortex-file-compressed 84973044 84489321 1.01
tpcds_q71/datafusion:vortex-file-compressed 23644347 23101411 1.02
tpcds_q72/datafusion:vortex-file-compressed 2177248007 2088441782 1.04
tpcds_q73/datafusion:vortex-file-compressed 22744319 22672840 1.00
tpcds_q74/datafusion:vortex-file-compressed 82776393 80132692 1.03
tpcds_q75/datafusion:vortex-file-compressed 111539412 108182389 1.03
tpcds_q76/datafusion:vortex-file-compressed 24225455 24285546 1.00
tpcds_q77/datafusion:vortex-file-compressed 40540088 39203196 1.03
tpcds_q78/datafusion:vortex-file-compressed 126759964 122658087 1.03
tpcds_q79/datafusion:vortex-file-compressed 28291996 29210035 0.97
tpcds_q80/datafusion:vortex-file-compressed 93819404 93580082 1.00
tpcds_q81/datafusion:vortex-file-compressed 24238304 23874881 1.02
tpcds_q82/datafusion:vortex-file-compressed 25985412 24194264 1.07
tpcds_q83/datafusion:vortex-file-compressed 34011151 33029272 1.03
tpcds_q84/datafusion:vortex-file-compressed 13918868 13131441 1.06
tpcds_q85/datafusion:vortex-file-compressed 91933418 89390030 1.03
tpcds_q86/datafusion:vortex-file-compressed 16072235 15913542 1.01
tpcds_q87/datafusion:vortex-file-compressed 43263859 42940897 1.01
tpcds_q88/datafusion:vortex-file-compressed 55999198 56942340 0.98
tpcds_q89/datafusion:vortex-file-compressed 24893743 24942117 1.00
tpcds_q90/datafusion:vortex-file-compressed 🚨 15923425 14135811 1.13
tpcds_q91/datafusion:vortex-file-compressed 18551998 17780421 1.04
tpcds_q92/datafusion:vortex-file-compressed 18005718 17416801 1.03
tpcds_q93/datafusion:vortex-file-compressed 33433525 33706458 0.99
tpcds_q94/datafusion:vortex-file-compressed 23740967 22900542 1.04
tpcds_q95/datafusion:vortex-file-compressed 63996137 61105666 1.05
tpcds_q96/datafusion:vortex-file-compressed 13432472 13893986 0.97
tpcds_q97/datafusion:vortex-file-compressed 31729012 31698759 1.00
tpcds_q98/datafusion:vortex-file-compressed 25100190 24834899 1.01
tpcds_q99/datafusion:vortex-file-compressed 🚨 32248265 28648792 1.13
datafusion / vortex-compact (1.016x ➖, 1↑ 2↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25673946 25110099 1.02
tpcds_q02/datafusion:vortex-compact 54245895 52994033 1.02
tpcds_q03/datafusion:vortex-compact 19731463 20190819 0.98
tpcds_q04/datafusion:vortex-compact 295338767 277008276 1.07
tpcds_q05/datafusion:vortex-compact 50424794 47717104 1.06
tpcds_q06/datafusion:vortex-compact 62391924 62452399 1.00
tpcds_q07/datafusion:vortex-compact 53529993 54993187 0.97
tpcds_q08/datafusion:vortex-compact 35155394 35937541 0.98
tpcds_q09/datafusion:vortex-compact 54383165 52360496 1.04
tpcds_q10/datafusion:vortex-compact 49203979 49743685 0.99
tpcds_q11/datafusion:vortex-compact 155993115 151785020 1.03
tpcds_q12/datafusion:vortex-compact 26754861 24788360 1.08
tpcds_q13/datafusion:vortex-compact 126734997 123367106 1.03
tpcds_q14/datafusion:vortex-compact 202277401 195851533 1.03
tpcds_q15/datafusion:vortex-compact 31848273 30022916 1.06
tpcds_q16/datafusion:vortex-compact 32362290 32117285 1.01
tpcds_q17/datafusion:vortex-compact 76254873 73222453 1.04
tpcds_q18/datafusion:vortex-compact 80401811 78547326 1.02
tpcds_q19/datafusion:vortex-compact 30629820 29744994 1.03
tpcds_q20/datafusion:vortex-compact 26999007 26153230 1.03
tpcds_q21/datafusion:vortex-compact 39872148 39936687 1.00
tpcds_q22/datafusion:vortex-compact 116522028 115007139 1.01
tpcds_q23/datafusion:vortex-compact 166305507 162497052 1.02
tpcds_q24/datafusion:vortex-compact 98360041 95342886 1.03
tpcds_q25/datafusion:vortex-compact 77469006 79345201 0.98
tpcds_q26/datafusion:vortex-compact 44183205 43997963 1.00
tpcds_q27/datafusion:vortex-compact 125128638 127537209 0.98
tpcds_q28/datafusion:vortex-compact 98745369 99198226 1.00
tpcds_q29/datafusion:vortex-compact 73781117 74093332 1.00
tpcds_q30/datafusion:vortex-compact 27626736 27832963 0.99
tpcds_q31/datafusion:vortex-compact 96128857 97183438 0.99
tpcds_q32/datafusion:vortex-compact 24832250 24534716 1.01
tpcds_q33/datafusion:vortex-compact 36405674 36950815 0.99
tpcds_q34/datafusion:vortex-compact 33826332 32790269 1.03
tpcds_q35/datafusion:vortex-compact 54368116 51308052 1.06
tpcds_q36/datafusion:vortex-compact 78939387 75929095 1.04
tpcds_q37/datafusion:vortex-compact 33874210 36307236 0.93
tpcds_q38/datafusion:vortex-compact 51281686 51173090 1.00
tpcds_q39/datafusion:vortex-compact 112727869 112065047 1.01
tpcds_q40/datafusion:vortex-compact 36695060 37143738 0.99
tpcds_q41/datafusion:vortex-compact 18498503 17795117 1.04
tpcds_q42/datafusion:vortex-compact 18434186 18666162 0.99
tpcds_q43/datafusion:vortex-compact 24727616 25519098 0.97
tpcds_q44/datafusion:vortex-compact 49767399 48126072 1.03
tpcds_q45/datafusion:vortex-compact 31844504 29688129 1.07
tpcds_q46/datafusion:vortex-compact 45650187 44668260 1.02
tpcds_q47/datafusion:vortex-compact 151306589 149191005 1.01
tpcds_q48/datafusion:vortex-compact 80585241 82769790 0.97
tpcds_q49/datafusion:vortex-compact 70706592 69023746 1.02
tpcds_q50/datafusion:vortex-compact 47816084 47580956 1.00
tpcds_q51/datafusion:vortex-compact 95792121 95027640 1.01
tpcds_q52/datafusion:vortex-compact 18954285 18338154 1.03
tpcds_q53/datafusion:vortex-compact 29248229 27856286 1.05
tpcds_q54/datafusion:vortex-compact 42440127 42022620 1.01
tpcds_q55/datafusion:vortex-compact 18352383 17903934 1.03
tpcds_q56/datafusion:vortex-compact 37302352 35836043 1.04
tpcds_q57/datafusion:vortex-compact 118316217 118476046 1.00
tpcds_q58/datafusion:vortex-compact 66309386 60681801 1.09
tpcds_q59/datafusion:vortex-compact 69137301 69992796 0.99
tpcds_q60/datafusion:vortex-compact 38658053 35806902 1.08
tpcds_q61/datafusion:vortex-compact 56220767 55544083 1.01
tpcds_q62/datafusion:vortex-compact 🚀 24141334 28846737 0.84
tpcds_q63/datafusion:vortex-compact 27740255 27921272 0.99
tpcds_q64/datafusion:vortex-compact 461013667 450694846 1.02
tpcds_q65/datafusion:vortex-compact 53586742 53452687 1.00
tpcds_q66/datafusion:vortex-compact 77535084 75704992 1.02
tpcds_q67/datafusion:vortex-compact 149909150 150798068 0.99
tpcds_q68/datafusion:vortex-compact 43520076 45275976 0.96
tpcds_q69/datafusion:vortex-compact 46956526 47893325 0.98
tpcds_q70/datafusion:vortex-compact 96923455 97484218 0.99
tpcds_q71/datafusion:vortex-compact 29923551 30083769 0.99
tpcds_q72/datafusion:vortex-compact 2156142057 2102529545 1.03
tpcds_q73/datafusion:vortex-compact 30351288 30068131 1.01
tpcds_q74/datafusion:vortex-compact 98995152 96262207 1.03
tpcds_q75/datafusion:vortex-compact 129939615 127017967 1.02
tpcds_q76/datafusion:vortex-compact 33009120 32202488 1.03
tpcds_q77/datafusion:vortex-compact 51080506 50017288 1.02
tpcds_q78/datafusion:vortex-compact 141136981 137884689 1.02
tpcds_q79/datafusion:vortex-compact 41354939 38549022 1.07
tpcds_q80/datafusion:vortex-compact 106630480 105592253 1.01
tpcds_q81/datafusion:vortex-compact 🚨 33410199 27947512 1.20
tpcds_q82/datafusion:vortex-compact 35592637 34395956 1.03
tpcds_q83/datafusion:vortex-compact 36111206 34961403 1.03
tpcds_q84/datafusion:vortex-compact 14642998 13848422 1.06
tpcds_q85/datafusion:vortex-compact 149804882 155468238 0.96
tpcds_q86/datafusion:vortex-compact 🚨 22123062 18655366 1.19
tpcds_q87/datafusion:vortex-compact 51542454 49931509 1.03
tpcds_q88/datafusion:vortex-compact 76997686 79517524 0.97
tpcds_q89/datafusion:vortex-compact 32328782 31044466 1.04
tpcds_q90/datafusion:vortex-compact 15325970 14850277 1.03
tpcds_q91/datafusion:vortex-compact 33254735 32321955 1.03
tpcds_q92/datafusion:vortex-compact 24001186 23520718 1.02
tpcds_q93/datafusion:vortex-compact 40055164 38222076 1.05
tpcds_q94/datafusion:vortex-compact 26410222 25843369 1.02
tpcds_q95/datafusion:vortex-compact 67285878 63156627 1.07
tpcds_q96/datafusion:vortex-compact 17715557 17880550 0.99
tpcds_q97/datafusion:vortex-compact 35809702 37625528 0.95
tpcds_q98/datafusion:vortex-compact 30245740 30307367 1.00
tpcds_q99/datafusion:vortex-compact 32189540 34603743 0.93
datafusion / parquet (1.016x ➖, 0↑ 3↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29718789 30204736 0.98
tpcds_q02/datafusion:parquet 41650142 42593082 0.98
tpcds_q03/datafusion:parquet 13719482 13192612 1.04
tpcds_q04/datafusion:parquet 262474235 256025884 1.03
tpcds_q05/datafusion:parquet 40901403 39805997 1.03
tpcds_q06/datafusion:parquet 58445671 61505201 0.95
tpcds_q07/datafusion:parquet 78203093 74547421 1.05
tpcds_q08/datafusion:parquet 26400651 25382065 1.04
tpcds_q09/datafusion:parquet 45506503 43915990 1.04
tpcds_q10/datafusion:parquet 70501082 67874380 1.04
tpcds_q11/datafusion:parquet 154287165 143538437 1.07
tpcds_q12/datafusion:parquet 16277267 17704990 0.92
tpcds_q13/datafusion:parquet 75273032 75500826 1.00
tpcds_q14/datafusion:parquet 160561299 159853522 1.00
tpcds_q15/datafusion:parquet 20666760 20661385 1.00
tpcds_q16/datafusion:parquet 23853920 22561862 1.06
tpcds_q17/datafusion:parquet 62160516 64896837 0.96
tpcds_q18/datafusion:parquet 113600885 113444804 1.00
tpcds_q19/datafusion:parquet 🚨 24720965 21441323 1.15
tpcds_q20/datafusion:parquet 16446920 15928494 1.03
tpcds_q21/datafusion:parquet 18339879 17768131 1.03
tpcds_q22/datafusion:parquet 148011535 150051658 0.99
tpcds_q23/datafusion:parquet 148125817 150270885 0.99
tpcds_q24/datafusion:parquet 89408455 88036041 1.02
tpcds_q25/datafusion:parquet 65383592 64097709 1.02
tpcds_q26/datafusion:parquet 64531269 62608790 1.03
tpcds_q27/datafusion:parquet 143879626 144137206 1.00
tpcds_q28/datafusion:parquet 44788543 42497937 1.05
tpcds_q29/datafusion:parquet 🚨 70398889 63689776 1.11
tpcds_q30/datafusion:parquet 33697362 33297955 1.01
tpcds_q31/datafusion:parquet 63418107 62988966 1.01
tpcds_q32/datafusion:parquet 17505153 17472908 1.00
tpcds_q33/datafusion:parquet 27583412 26620440 1.04
tpcds_q34/datafusion:parquet 21747408 22708875 0.96
tpcds_q35/datafusion:parquet 66434654 67636155 0.98
tpcds_q36/datafusion:parquet 56828969 56567007 1.00
tpcds_q37/datafusion:parquet 19187738 19218212 1.00
tpcds_q38/datafusion:parquet 41850194 38871998 1.08
tpcds_q39/datafusion:parquet 73851651 71185145 1.04
tpcds_q40/datafusion:parquet 23925839 23798418 1.01
tpcds_q41/datafusion:parquet 13310622 13175946 1.01
tpcds_q42/datafusion:parquet 11280265 11518841 0.98
tpcds_q43/datafusion:parquet 16765254 16738847 1.00
tpcds_q44/datafusion:parquet 34214049 32765039 1.04
tpcds_q45/datafusion:parquet 27692148 27586579 1.00
tpcds_q46/datafusion:parquet 32658735 31856476 1.03
tpcds_q47/datafusion:parquet 124916615 125274201 1.00
tpcds_q48/datafusion:parquet 67785538 67326622 1.01
tpcds_q49/datafusion:parquet 54758090 54011545 1.01
tpcds_q50/datafusion:parquet 42230040 44288891 0.95
tpcds_q51/datafusion:parquet 86322434 82822681 1.04
tpcds_q52/datafusion:parquet 11714412 11328100 1.03
tpcds_q53/datafusion:parquet 18665775 17359129 1.08
tpcds_q54/datafusion:parquet 33437889 32706022 1.02
tpcds_q55/datafusion:parquet 11445097 10814408 1.06
tpcds_q56/datafusion:parquet 26281201 27928531 0.94
tpcds_q57/datafusion:parquet 95726504 91933203 1.04
tpcds_q58/datafusion:parquet 48458393 50219047 0.96
tpcds_q59/datafusion:parquet 57522492 55430891 1.04
tpcds_q60/datafusion:parquet 26412319 26723331 0.99
tpcds_q61/datafusion:parquet 42229862 42939863 0.98
tpcds_q62/datafusion:parquet 25272529 23540897 1.07
tpcds_q63/datafusion:parquet 17944809 17599055 1.02
tpcds_q64/datafusion:parquet 506265009 503354087 1.01
tpcds_q65/datafusion:parquet 36912605 36639618 1.01
tpcds_q66/datafusion:parquet 69823385 69487690 1.00
tpcds_q67/datafusion:parquet 142421302 146830681 0.97
tpcds_q68/datafusion:parquet 31913049 30695424 1.04
tpcds_q69/datafusion:parquet 64949764 62925186 1.03
tpcds_q70/datafusion:parquet 86565851 89044975 0.97
tpcds_q71/datafusion:parquet 22199024 22805261 0.97
tpcds_q72/datafusion:parquet 608343066 606381455 1.00
tpcds_q73/datafusion:parquet 19615442 19552391 1.00
tpcds_q74/datafusion:parquet 83765257 82609261 1.01
tpcds_q75/datafusion:parquet 99383092 96916191 1.03
tpcds_q76/datafusion:parquet 30465798 29321038 1.04
tpcds_q77/datafusion:parquet 38298096 37373424 1.02
tpcds_q78/datafusion:parquet 113941361 111235515 1.02
tpcds_q79/datafusion:parquet 27444099 25810729 1.06
tpcds_q80/datafusion:parquet 78922288 78944287 1.00
tpcds_q81/datafusion:parquet 30556351 30566006 1.00
tpcds_q82/datafusion:parquet 18736525 18651376 1.00
tpcds_q83/datafusion:parquet 36239372 35058309 1.03
tpcds_q84/datafusion:parquet 39652305 37690096 1.05
tpcds_q85/datafusion:parquet 148305661 147802163 1.00
tpcds_q86/datafusion:parquet 16538676 15533791 1.06
tpcds_q87/datafusion:parquet 40648486 39052923 1.04
tpcds_q88/datafusion:parquet 58603561 57402319 1.02
tpcds_q89/datafusion:parquet 22114743 20754882 1.07
tpcds_q90/datafusion:parquet 14004380 13427408 1.04
tpcds_q91/datafusion:parquet 58780731 58179653 1.01
tpcds_q92/datafusion:parquet 🚨 19934959 17490112 1.14
tpcds_q93/datafusion:parquet 31244414 31882808 0.98
tpcds_q94/datafusion:parquet 20257012 19518265 1.04
tpcds_q95/datafusion:parquet 57506257 58174355 0.99
tpcds_q96/datafusion:parquet 11332639 11741260 0.97
tpcds_q97/datafusion:parquet 28683890 28353939 1.01
tpcds_q98/datafusion:parquet 21014661 21107372 1.00
tpcds_q99/datafusion:parquet 25256147 25193070 1.00
duckdb / vortex-file-compressed (1.014x ➖, 2↑ 7↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23001897 22068011 1.04
tpcds_q02/duckdb:vortex-file-compressed 🚨 36171826 31501943 1.15
tpcds_q03/duckdb:vortex-file-compressed 🚀 18039965 25185639 0.72
tpcds_q04/duckdb:vortex-file-compressed 92998698 91462962 1.02
tpcds_q05/duckdb:vortex-file-compressed 32774894 31839108 1.03
tpcds_q06/duckdb:vortex-file-compressed 31465630 30867359 1.02
tpcds_q07/duckdb:vortex-file-compressed 18976694 19905619 0.95
tpcds_q08/duckdb:vortex-file-compressed 27509311 25338895 1.09
tpcds_q09/duckdb:vortex-file-compressed 15979275 16028176 1.00
tpcds_q10/duckdb:vortex-file-compressed 35874295 34916668 1.03
tpcds_q11/duckdb:vortex-file-compressed 60659626 61240776 0.99
tpcds_q12/duckdb:vortex-file-compressed 13598116 12966060 1.05
tpcds_q13/duckdb:vortex-file-compressed 31514244 32419042 0.97
tpcds_q14/duckdb:vortex-file-compressed 96445139 94445394 1.02
tpcds_q15/duckdb:vortex-file-compressed 26035025 25678675 1.01
tpcds_q16/duckdb:vortex-file-compressed 25626316 25437793 1.01
tpcds_q17/duckdb:vortex-file-compressed 46891799 44001806 1.07
tpcds_q18/duckdb:vortex-file-compressed 36682754 34910634 1.05
tpcds_q19/duckdb:vortex-file-compressed 31153300 29509547 1.06
tpcds_q20/duckdb:vortex-file-compressed 14183436 13966395 1.02
tpcds_q21/duckdb:vortex-file-compressed 16086964 15127786 1.06
tpcds_q22/duckdb:vortex-file-compressed 🚨 76862963 69013837 1.11
tpcds_q23/duckdb:vortex-file-compressed 113058414 105542404 1.07
tpcds_q24/duckdb:vortex-file-compressed 47654034 45785457 1.04
tpcds_q25/duckdb:vortex-file-compressed 48962034 49018631 1.00
tpcds_q26/duckdb:vortex-file-compressed 18797084 17881399 1.05
tpcds_q27/duckdb:vortex-file-compressed 20851855 19929768 1.05
tpcds_q28/duckdb:vortex-file-compressed 11739041 11998473 0.98
tpcds_q29/duckdb:vortex-file-compressed 🚨 44489422 38619799 1.15
tpcds_q30/duckdb:vortex-file-compressed 24374417 24629162 0.99
tpcds_q31/duckdb:vortex-file-compressed 26291251 24898307 1.06
tpcds_q32/duckdb:vortex-file-compressed 🚨 14696870 12524324 1.17
tpcds_q33/duckdb:vortex-file-compressed 22967587 21884573 1.05
tpcds_q34/duckdb:vortex-file-compressed 23854145 23340146 1.02
tpcds_q35/duckdb:vortex-file-compressed 60495637 63763453 0.95
tpcds_q36/duckdb:vortex-file-compressed 25450002 23353625 1.09
tpcds_q37/duckdb:vortex-file-compressed 18747450 18315840 1.02
tpcds_q38/duckdb:vortex-file-compressed 33614802 34664680 0.97
tpcds_q39/duckdb:vortex-file-compressed 32972183 32717540 1.01
tpcds_q40/duckdb:vortex-file-compressed 18589449 17321376 1.07
tpcds_q41/duckdb:vortex-file-compressed 9392742 9599745 0.98
tpcds_q42/duckdb:vortex-file-compressed 10823357 11625322 0.93
tpcds_q43/duckdb:vortex-file-compressed 21951802 20915521 1.05
tpcds_q44/duckdb:vortex-file-compressed 21436892 20681498 1.04
tpcds_q45/duckdb:vortex-file-compressed 27432539 26855810 1.02
tpcds_q46/duckdb:vortex-file-compressed 29822161 29812362 1.00
tpcds_q47/duckdb:vortex-file-compressed 47274534 46726916 1.01
tpcds_q48/duckdb:vortex-file-compressed 29874625 27268416 1.10
tpcds_q49/duckdb:vortex-file-compressed 30401862 29784927 1.02
tpcds_q50/duckdb:vortex-file-compressed 29580359 30483775 0.97
tpcds_q51/duckdb:vortex-file-compressed 🚀 96854287 121311377 0.80
tpcds_q52/duckdb:vortex-file-compressed 11443311 12533955 0.91
tpcds_q53/duckdb:vortex-file-compressed 21749585 21975310 0.99
tpcds_q54/duckdb:vortex-file-compressed 26496387 26214708 1.01
tpcds_q55/duckdb:vortex-file-compressed 11512715 11060782 1.04
tpcds_q56/duckdb:vortex-file-compressed 22219036 21940466 1.01
tpcds_q57/duckdb:vortex-file-compressed 38320348 38993050 0.98
tpcds_q58/duckdb:vortex-file-compressed 28187660 28821066 0.98
tpcds_q59/duckdb:vortex-file-compressed 66621283 65668394 1.01
tpcds_q60/duckdb:vortex-file-compressed 22819492 22862056 1.00
tpcds_q61/duckdb:vortex-file-compressed 27795085 30147815 0.92
tpcds_q62/duckdb:vortex-file-compressed 15448371 15531684 0.99
tpcds_q63/duckdb:vortex-file-compressed 19911115 19717493 1.01
tpcds_q64/duckdb:vortex-file-compressed 100363696 99630129 1.01
tpcds_q65/duckdb:vortex-file-compressed 20028321 20589388 0.97
tpcds_q66/duckdb:vortex-file-compressed 28451235 27216587 1.05
tpcds_q67/duckdb:vortex-file-compressed 136016659 138788696 0.98
tpcds_q68/duckdb:vortex-file-compressed 30337746 29865300 1.02
tpcds_q69/duckdb:vortex-file-compressed 37038362 38297922 0.97
tpcds_q70/duckdb:vortex-file-compressed 36815271 36538355 1.01
tpcds_q71/duckdb:vortex-file-compressed 19101098 18426393 1.04
tpcds_q72/duckdb:vortex-file-compressed 167262532 168396267 0.99
tpcds_q73/duckdb:vortex-file-compressed 22981181 23307546 0.99
tpcds_q74/duckdb:vortex-file-compressed 38769381 40056133 0.97
tpcds_q75/duckdb:vortex-file-compressed 47093968 46592673 1.01
tpcds_q76/duckdb:vortex-file-compressed 16296363 16672972 0.98
tpcds_q77/duckdb:vortex-file-compressed 23630760 21781955 1.08
tpcds_q78/duckdb:vortex-file-compressed 74491383 73028378 1.02
tpcds_q79/duckdb:vortex-file-compressed 25000194 24671224 1.01
tpcds_q80/duckdb:vortex-file-compressed 45534264 42972982 1.06
tpcds_q81/duckdb:vortex-file-compressed 🚨 30611384 25705758 1.19
tpcds_q82/duckdb:vortex-file-compressed 48896991 48366633 1.01
tpcds_q83/duckdb:vortex-file-compressed 28147029 26142314 1.08
tpcds_q84/duckdb:vortex-file-compressed 19981695 19198427 1.04
tpcds_q85/duckdb:vortex-file-compressed 42468780 43183139 0.98
tpcds_q86/duckdb:vortex-file-compressed 17992675 17141798 1.05
tpcds_q87/duckdb:vortex-file-compressed 39653786 38912243 1.02
tpcds_q88/duckdb:vortex-file-compressed 52169829 50105513 1.04
tpcds_q89/duckdb:vortex-file-compressed 20284479 20028231 1.01
tpcds_q90/duckdb:vortex-file-compressed 9577047 10100097 0.95
tpcds_q91/duckdb:vortex-file-compressed 23274921 24836636 0.94
tpcds_q92/duckdb:vortex-file-compressed 🚨 19023209 17093525 1.11
tpcds_q93/duckdb:vortex-file-compressed 27699764 27669078 1.00
tpcds_q94/duckdb:vortex-file-compressed 19938600 20059030 0.99
tpcds_q95/duckdb:vortex-file-compressed 138723106 150825229 0.92
tpcds_q96/duckdb:vortex-file-compressed 11747650 11605173 1.01
tpcds_q97/duckdb:vortex-file-compressed 37064758 36210430 1.02
tpcds_q98/duckdb:vortex-file-compressed 16916784 17129351 0.99
tpcds_q99/duckdb:vortex-file-compressed 🚨 28523180 24981334 1.14
duckdb / vortex-compact (1.018x ➖, 1↑ 3↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 25119717 22668853 1.11
tpcds_q02/duckdb:vortex-compact 40363101 41807587 0.97
tpcds_q03/duckdb:vortex-compact 49363693 48462329 1.02
tpcds_q04/duckdb:vortex-compact 100270379 98685618 1.02
tpcds_q05/duckdb:vortex-compact 🚀 37777588 42638510 0.89
tpcds_q06/duckdb:vortex-compact 38194720 35966722 1.06
tpcds_q07/duckdb:vortex-compact 33499392 33766367 0.99
tpcds_q08/duckdb:vortex-compact 39065971 39128155 1.00
tpcds_q09/duckdb:vortex-compact 20132300 20480068 0.98
tpcds_q10/duckdb:vortex-compact 52010777 48877586 1.06
tpcds_q11/duckdb:vortex-compact 71251414 67771771 1.05
tpcds_q12/duckdb:vortex-compact 21149002 20041219 1.06
tpcds_q13/duckdb:vortex-compact 55744034 52318142 1.07
tpcds_q14/duckdb:vortex-compact 118892155 114571592 1.04
tpcds_q15/duckdb:vortex-compact 🚨 32811304 28424853 1.15
tpcds_q16/duckdb:vortex-compact 28083351 25742671 1.09
tpcds_q17/duckdb:vortex-compact 54732046 54399563 1.01
tpcds_q18/duckdb:vortex-compact 48777509 46679271 1.04
tpcds_q19/duckdb:vortex-compact 41662743 41707913 1.00
tpcds_q20/duckdb:vortex-compact 18544787 18135861 1.02
tpcds_q21/duckdb:vortex-compact 17666082 16940181 1.04
tpcds_q22/duckdb:vortex-compact 73899653 73583408 1.00
tpcds_q23/duckdb:vortex-compact 123101882 128964691 0.95
tpcds_q24/duckdb:vortex-compact 54697518 57547564 0.95
tpcds_q25/duckdb:vortex-compact 80233392 80051702 1.00
tpcds_q26/duckdb:vortex-compact 31648914 31399196 1.01
tpcds_q27/duckdb:vortex-compact 34116979 35139676 0.97
tpcds_q28/duckdb:vortex-compact 33379271 33510337 1.00
tpcds_q29/duckdb:vortex-compact 52822592 52244461 1.01
tpcds_q30/duckdb:vortex-compact 28184355 28602716 0.99
tpcds_q31/duckdb:vortex-compact 30845856 31281348 0.99
tpcds_q32/duckdb:vortex-compact 19962732 19698363 1.01
tpcds_q33/duckdb:vortex-compact 34845945 32883600 1.06
tpcds_q34/duckdb:vortex-compact 30800922 29627977 1.04
tpcds_q35/duckdb:vortex-compact 71799282 71656465 1.00
tpcds_q36/duckdb:vortex-compact 37168545 36425496 1.02
tpcds_q37/duckdb:vortex-compact 22779715 21866184 1.04
tpcds_q38/duckdb:vortex-compact 39460448 37366543 1.06
tpcds_q39/duckdb:vortex-compact 36872008 35471753 1.04
tpcds_q40/duckdb:vortex-compact 24007660 22423914 1.07
tpcds_q41/duckdb:vortex-compact 11171222 10925993 1.02
tpcds_q42/duckdb:vortex-compact 19276028 18881127 1.02
tpcds_q43/duckdb:vortex-compact 29423870 29561329 1.00
tpcds_q44/duckdb:vortex-compact 28222329 28291200 1.00
tpcds_q45/duckdb:vortex-compact 35824952 35574815 1.01
tpcds_q46/duckdb:vortex-compact 45439435 46147963 0.98
tpcds_q47/duckdb:vortex-compact 58116975 56395674 1.03
tpcds_q48/duckdb:vortex-compact 47160992 46519375 1.01
tpcds_q49/duckdb:vortex-compact 47937237 48262509 0.99
tpcds_q50/duckdb:vortex-compact 37497371 36779939 1.02
tpcds_q51/duckdb:vortex-compact 107050825 104242189 1.03
tpcds_q52/duckdb:vortex-compact 18102908 18617187 0.97
tpcds_q53/duckdb:vortex-compact 32595935 31912996 1.02
tpcds_q54/duckdb:vortex-compact 37727543 36602588 1.03
tpcds_q55/duckdb:vortex-compact 18633547 18574743 1.00
tpcds_q56/duckdb:vortex-compact 31939688 31562710 1.01
tpcds_q57/duckdb:vortex-compact 41096351 40964870 1.00
tpcds_q58/duckdb:vortex-compact 37981199 37615312 1.01
tpcds_q59/duckdb:vortex-compact 84696690 87615725 0.97
tpcds_q60/duckdb:vortex-compact 35039471 33088839 1.06
tpcds_q61/duckdb:vortex-compact 51846954 52515253 0.99
tpcds_q62/duckdb:vortex-compact 20839019 20755545 1.00
tpcds_q63/duckdb:vortex-compact 31133573 31212924 1.00
tpcds_q64/duckdb:vortex-compact 133328467 128896333 1.03
tpcds_q65/duckdb:vortex-compact 30718936 28108576 1.09
tpcds_q66/duckdb:vortex-compact 33946860 34958239 0.97
tpcds_q67/duckdb:vortex-compact 151062253 149466391 1.01
tpcds_q68/duckdb:vortex-compact 44817536 45816474 0.98
tpcds_q69/duckdb:vortex-compact 54592861 51452990 1.06
tpcds_q70/duckdb:vortex-compact 58918916 60518119 0.97
tpcds_q71/duckdb:vortex-compact 27861703 27513968 1.01
tpcds_q72/duckdb:vortex-compact 187919825 184671635 1.02
tpcds_q73/duckdb:vortex-compact 29121504 26770702 1.09
tpcds_q74/duckdb:vortex-compact 47251722 47321267 1.00
tpcds_q75/duckdb:vortex-compact 61402684 59439375 1.03
tpcds_q76/duckdb:vortex-compact 28117145 28658031 0.98
tpcds_q77/duckdb:vortex-compact 36205421 35209483 1.03
tpcds_q78/duckdb:vortex-compact 84079635 77308557 1.09
tpcds_q79/duckdb:vortex-compact 41955266 42107572 1.00
tpcds_q80/duckdb:vortex-compact 69445903 65664248 1.06
tpcds_q81/duckdb:vortex-compact 32845230 31085317 1.06
tpcds_q82/duckdb:vortex-compact 52853945 51099602 1.03
tpcds_q83/duckdb:vortex-compact 34671279 35390187 0.98
tpcds_q84/duckdb:vortex-compact 27068593 27354692 0.99
tpcds_q85/duckdb:vortex-compact 59013744 57391758 1.03
tpcds_q86/duckdb:vortex-compact 21591782 19816679 1.09
tpcds_q87/duckdb:vortex-compact 41966563 42604717 0.99
tpcds_q88/duckdb:vortex-compact 77614578 75765578 1.02
tpcds_q89/duckdb:vortex-compact 30399072 29888806 1.02
tpcds_q90/duckdb:vortex-compact 10346615 10592358 0.98
tpcds_q91/duckdb:vortex-compact 42251168 43158582 0.98
tpcds_q92/duckdb:vortex-compact 🚨 46480863 40401706 1.15
tpcds_q93/duckdb:vortex-compact 31657288 30810914 1.03
tpcds_q94/duckdb:vortex-compact 25715647 25860344 0.99
tpcds_q95/duckdb:vortex-compact 153613988 145859433 1.05
tpcds_q96/duckdb:vortex-compact 15667665 16326407 0.96
tpcds_q97/duckdb:vortex-compact 39522599 40409663 0.98
tpcds_q98/duckdb:vortex-compact 26265389 24832553 1.06
tpcds_q99/duckdb:vortex-compact 28986355 27931513 1.04
duckdb / parquet (1.011x ➖, 0↑ 2↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨 28995628 25584848 1.13
tpcds_q02/duckdb:parquet 24122070 23551621 1.02
tpcds_q03/duckdb:parquet 11167720 11388057 0.98
tpcds_q04/duckdb:parquet 169823233 168074347 1.01
tpcds_q05/duckdb:parquet 28178152 28879247 0.98
tpcds_q06/duckdb:parquet 29294734 27778462 1.05
tpcds_q07/duckdb:parquet 21063309 21232421 0.99
tpcds_q08/duckdb:parquet 27595525 25999284 1.06
tpcds_q09/duckdb:parquet 40001379 39536297 1.01
tpcds_q10/duckdb:parquet 32605898 33183660 0.98
tpcds_q11/duckdb:parquet 89620138 90010558 1.00
tpcds_q12/duckdb:parquet 14866343 14375634 1.03
tpcds_q13/duckdb:parquet 32543759 33809389 0.96
tpcds_q14/duckdb:parquet 99483225 99213996 1.00
tpcds_q15/duckdb:parquet 30413776 29418960 1.03
tpcds_q16/duckdb:parquet 20151395 20645014 0.98
tpcds_q17/duckdb:parquet 38386014 37086373 1.04
tpcds_q18/duckdb:parquet 45835042 44693739 1.03
tpcds_q19/duckdb:parquet 28339345 28896423 0.98
tpcds_q20/duckdb:parquet 15350959 15359811 1.00
tpcds_q21/duckdb:parquet 10092658 9838129 1.03
tpcds_q22/duckdb:parquet 69212954 68582652 1.01
tpcds_q23/duckdb:parquet 83939535 82471629 1.02
tpcds_q24/duckdb:parquet 43794842 42983419 1.02
tpcds_q25/duckdb:parquet 32697641 32567003 1.00
tpcds_q26/duckdb:parquet 36909806 35209272 1.05
tpcds_q27/duckdb:parquet 48758226 48481325 1.01
tpcds_q28/duckdb:parquet 38108037 37014174 1.03
tpcds_q29/duckdb:parquet 34488872 34920624 0.99
tpcds_q30/duckdb:parquet 34098532 35219853 0.97
tpcds_q31/duckdb:parquet 23449120 22902180 1.02
tpcds_q32/duckdb:parquet 10963260 11257265 0.97
tpcds_q33/duckdb:parquet 21274740 19709784 1.08
tpcds_q34/duckdb:parquet 21273453 19574962 1.09
tpcds_q35/duckdb:parquet 56405214 55193751 1.02
tpcds_q36/duckdb:parquet 19581545 20941820 0.94
tpcds_q37/duckdb:parquet 13359553 12404011 1.08
tpcds_q38/duckdb:parquet 34340105 33148361 1.04
tpcds_q39/duckdb:parquet 28449004 29612619 0.96
tpcds_q40/duckdb:parquet 16873282 16299500 1.04
tpcds_q41/duckdb:parquet 7541902 7763407 0.97
tpcds_q42/duckdb:parquet 9525507 9259350 1.03
tpcds_q43/duckdb:parquet 15041844 15381471 0.98
tpcds_q44/duckdb:parquet 22130425 21978403 1.01
tpcds_q45/duckdb:parquet 26448394 26811873 0.99
tpcds_q46/duckdb:parquet 44980674 43559961 1.03
tpcds_q47/duckdb:parquet 45405013 44709096 1.02
tpcds_q48/duckdb:parquet 28680356 30819385 0.93
tpcds_q49/duckdb:parquet 24362304 25016751 0.97
tpcds_q50/duckdb:parquet 25056888 25311972 0.99
tpcds_q51/duckdb:parquet 94025189 93479682 1.01
tpcds_q52/duckdb:parquet 🚨 11355148 9847167 1.15
tpcds_q53/duckdb:parquet 14967146 15104524 0.99
tpcds_q54/duckdb:parquet 25690444 25164004 1.02
tpcds_q55/duckdb:parquet 10096005 9702682 1.04
tpcds_q56/duckdb:parquet 20918750 21304607 0.98
tpcds_q57/duckdb:parquet 34547554 34376879 1.00
tpcds_q58/duckdb:parquet 22241396 22442289 0.99
tpcds_q59/duckdb:parquet 35183582 35475158 0.99
tpcds_q60/duckdb:parquet 22050777 22271888 0.99
tpcds_q61/duckdb:parquet 30030187 30538374 0.98
tpcds_q62/duckdb:parquet 11503288 12630756 0.91
tpcds_q63/duckdb:parquet 13671540 14334843 0.95
tpcds_q64/duckdb:parquet 78471137 78224284 1.00
tpcds_q65/duckdb:parquet 21104542 19860969 1.06
tpcds_q66/duckdb:parquet 29980295 29666554 1.01
tpcds_q67/duckdb:parquet 132709654 132721039 1.00
tpcds_q68/duckdb:parquet 36482471 36466211 1.00
tpcds_q69/duckdb:parquet 35904484 35847670 1.00
tpcds_q70/duckdb:parquet 19218189 19691175 0.98
tpcds_q71/duckdb:parquet 20489049 19584051 1.05
tpcds_q72/duckdb:parquet 165740700 161910554 1.02
tpcds_q73/duckdb:parquet 17394673 16966880 1.03
tpcds_q74/duckdb:parquet 130806427 127761923 1.02
tpcds_q75/duckdb:parquet 51217045 51462684 1.00
tpcds_q76/duckdb:parquet 20011222 20343839 0.98
tpcds_q77/duckdb:parquet 21582102 21997731 0.98
tpcds_q78/duckdb:parquet 74084909 74480596 0.99
tpcds_q79/duckdb:parquet 28412147 26313067 1.08
tpcds_q80/duckdb:parquet 40430584 41508836 0.97
tpcds_q81/duckdb:parquet 30667360 30212911 1.02
tpcds_q82/duckdb:parquet 14401506 13168755 1.09
tpcds_q83/duckdb:parquet 16888066 15627706 1.08
tpcds_q84/duckdb:parquet 19062962 18607494 1.02
tpcds_q85/duckdb:parquet 37656289 37855377 0.99
tpcds_q86/duckdb:parquet 13068850 11967640 1.09
tpcds_q87/duckdb:parquet 36640388 36893715 0.99
tpcds_q88/duckdb:parquet 48294860 48433552 1.00
tpcds_q89/duckdb:parquet 17105541 15691679 1.09
tpcds_q90/duckdb:parquet 7191317 7345639 0.98
tpcds_q91/duckdb:parquet 22595470 23284743 0.97
tpcds_q92/duckdb:parquet 11248834 10821075 1.04
tpcds_q93/duckdb:parquet 30294744 28369133 1.07
tpcds_q94/duckdb:parquet 15880257 15836695 1.00
tpcds_q95/duckdb:parquet 140045749 141806642 0.99
tpcds_q96/duckdb:parquet 8598867 8340567 1.03
tpcds_q97/duckdb:parquet 34452485 34140446 1.01
tpcds_q98/duckdb:parquet 17477993 18182680 0.96
tpcds_q99/duckdb:parquet 20149619 19173413 1.05
duckdb / duckdb (1.021x ➖, 0↑ 7↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20721660 20698861 1.00
tpcds_q02/duckdb:duckdb 18365628 18761189 0.98
tpcds_q03/duckdb:duckdb 🚨 9185375 8338461 1.10
tpcds_q04/duckdb:duckdb 173601126 173814320 1.00
tpcds_q05/duckdb:duckdb 20461693 18844208 1.09
tpcds_q06/duckdb:duckdb 22499579 22357606 1.01
tpcds_q07/duckdb:duckdb 38444938 37322500 1.03
tpcds_q08/duckdb:duckdb 119679433 119933570 1.00
tpcds_q09/duckdb:duckdb 19679540 19942950 0.99
tpcds_q10/duckdb:duckdb 24399673 22192648 1.10
tpcds_q11/duckdb:duckdb 91585034 88008793 1.04
tpcds_q12/duckdb:duckdb 11540664 11975124 0.96
tpcds_q13/duckdb:duckdb 24080980 23322934 1.03
tpcds_q14/duckdb:duckdb 96034899 92610093 1.04
tpcds_q15/duckdb:duckdb 24056612 24470348 0.98
tpcds_q16/duckdb:duckdb 16489196 16865548 0.98
tpcds_q17/duckdb:duckdb 22910022 21527286 1.06
tpcds_q18/duckdb:duckdb 47077646 45305856 1.04
tpcds_q19/duckdb:duckdb 17338912 16502803 1.05
tpcds_q20/duckdb:duckdb 🚨 13013993 11670843 1.12
tpcds_q21/duckdb:duckdb 7248284 6608066 1.10
tpcds_q22/duckdb:duckdb 63066507 62304269 1.01
tpcds_q23/duckdb:duckdb 81173392 78951931 1.03
tpcds_q24/duckdb:duckdb 25131453 24872304 1.01
tpcds_q25/duckdb:duckdb 17379349 17521166 0.99
tpcds_q26/duckdb:duckdb 26372309 24891042 1.06
tpcds_q27/duckdb:duckdb 40230326 39702455 1.01
tpcds_q28/duckdb:duckdb 22512378 21861170 1.03
tpcds_q29/duckdb:duckdb 21363533 20285902 1.05
tpcds_q30/duckdb:duckdb 30083216 27590453 1.09
tpcds_q31/duckdb:duckdb 48738711 47556071 1.02
tpcds_q32/duckdb:duckdb 7380146 7190588 1.03
tpcds_q33/duckdb:duckdb 13018555 12371344 1.05
tpcds_q34/duckdb:duckdb 15594844 14626113 1.07
tpcds_q35/duckdb:duckdb 31859821 31654653 1.01
tpcds_q36/duckdb:duckdb 69562156 69405556 1.00
tpcds_q37/duckdb:duckdb 7942241 7649653 1.04
tpcds_q38/duckdb:duckdb 29843174 29550192 1.01
tpcds_q39/duckdb:duckdb 25128152 24323278 1.03
tpcds_q40/duckdb:duckdb 13128117 12827301 1.02
tpcds_q41/duckdb:duckdb 8586617 8720768 0.98
tpcds_q42/duckdb:duckdb 6625108 6512551 1.02
tpcds_q43/duckdb:duckdb 11629493 11612168 1.00
tpcds_q44/duckdb:duckdb 🚨 14443730 12971675 1.11
tpcds_q45/duckdb:duckdb 16902673 17218078 0.98
tpcds_q46/duckdb:duckdb 35713391 35194773 1.01
tpcds_q47/duckdb:duckdb 40913592 40651743 1.01
tpcds_q48/duckdb:duckdb 23369782 22974618 1.02
tpcds_q49/duckdb:duckdb 17637655 18212869 0.97
tpcds_q50/duckdb:duckdb 14461269 14457393 1.00
tpcds_q51/duckdb:duckdb 89605544 90957237 0.99
tpcds_q52/duckdb:duckdb 7264354 7489898 0.97
tpcds_q53/duckdb:duckdb 13653310 13040453 1.05
tpcds_q54/duckdb:duckdb 16322681 16077916 1.02
tpcds_q55/duckdb:duckdb 7188656 7655624 0.94
tpcds_q56/duckdb:duckdb 13432403 13753944 0.98
tpcds_q57/duckdb:duckdb 32566606 33166478 0.98
tpcds_q58/duckdb:duckdb 🚨 14523262 12622587 1.15
tpcds_q59/duckdb:duckdb 35041115 35045879 1.00
tpcds_q60/duckdb:duckdb 14715641 14398084 1.02
tpcds_q61/duckdb:duckdb 14580138 14479900 1.01
tpcds_q62/duckdb:duckdb 9646279 9415707 1.02
tpcds_q63/duckdb:duckdb 12223728 12244852 1.00
tpcds_q64/duckdb:duckdb 54342617 53157936 1.02
tpcds_q65/duckdb:duckdb 32374610 34293271 0.94
tpcds_q66/duckdb:duckdb 26316965 26920943 0.98
tpcds_q67/duckdb:duckdb 129630359 129550783 1.00
tpcds_q68/duckdb:duckdb 25414424 25003178 1.02
tpcds_q69/duckdb:duckdb 25461805 24901124 1.02
tpcds_q70/duckdb:duckdb 🚨 15895553 14147052 1.12
tpcds_q71/duckdb:duckdb 12410139 13152751 0.94
tpcds_q72/duckdb:duckdb 🚨 44330881 40039390 1.11
tpcds_q73/duckdb:duckdb 10852220 11331033 0.96
tpcds_q74/duckdb:duckdb 148747692 148707851 1.00
tpcds_q75/duckdb:duckdb 43647069 41251004 1.06
tpcds_q76/duckdb:duckdb 12128468 12024478 1.01
tpcds_q77/duckdb:duckdb 12928254 12702905 1.02
tpcds_q78/duckdb:duckdb 64317346 62253556 1.03
tpcds_q79/duckdb:duckdb 19409559 19067866 1.02
tpcds_q80/duckdb:duckdb 28453802 28312686 1.00
tpcds_q81/duckdb:duckdb 39820857 37952717 1.05
tpcds_q82/duckdb:duckdb 9023279 8361480 1.08
tpcds_q83/duckdb:duckdb 9166381 9390425 0.98
tpcds_q84/duckdb:duckdb 13212882 14180479 0.93
tpcds_q85/duckdb:duckdb 24212381 24392057 0.99
tpcds_q86/duckdb:duckdb 11015899 10635755 1.04
tpcds_q87/duckdb:duckdb 32420230 32542290 1.00
tpcds_q88/duckdb:duckdb 25964674 25782932 1.01
tpcds_q89/duckdb:duckdb 14512431 14285905 1.02
tpcds_q90/duckdb:duckdb 5546602 5394128 1.03
tpcds_q91/duckdb:duckdb 13529461 12719399 1.06
tpcds_q92/duckdb:duckdb 8868913 8631159 1.03
tpcds_q93/duckdb:duckdb 21960173 23135270 0.95
tpcds_q94/duckdb:duckdb 12751871 12502218 1.02
tpcds_q95/duckdb:duckdb 110378310 106727129 1.03
tpcds_q96/duckdb:duckdb 🚨 5079009 4493447 1.13
tpcds_q97/duckdb:duckdb 29965993 30952913 0.97
tpcds_q98/duckdb:duckdb 13800473 13613383 1.01
tpcds_q99/duckdb:duckdb 16917569 15691409 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.2% +5.6% -3.2% +21.8% ➖ noise
1 datafusion:vortex-file-compressed +1.3% +5.6% -4.0% +21.2% ➖ noise
1 duckdb:duckdb +0.1% +5.6% -5.2% +25.7% ➖ noise
1 duckdb:vortex-compact +10.8% +5.6% +4.9% +26.6% ➖ noise
1 duckdb:vortex-file-compressed +4.2% +5.6% -1.3% +38.1% ➖ noise
2 datafusion:vortex-compact +2.4% +0.1% +2.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.3% +0.1% -0.3% +10.0% ➖ noise
2 duckdb:duckdb -2.1% +0.1% -2.2% +14.7% ➖ noise
2 duckdb:vortex-compact -3.5% +0.1% -3.5% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +14.8% +0.1% +14.7% +29.8% ➖ noise
3 datafusion:vortex-compact -2.3% +1.0% -3.2% +10.7% ➖ noise
3 datafusion:vortex-file-compressed -4.3% +1.0% -5.2% +10.0% ➖ noise
3 duckdb:duckdb +10.2% +1.0% +9.1% +12.5% ➖ noise
3 duckdb:vortex-compact +1.9% +1.0% +0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -28.4% +1.0% -29.1% +11.0% ✅ faster
4 datafusion:vortex-compact +6.6% +1.8% +4.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.3% +1.8% -2.0% +10.0% ➖ noise
4 duckdb:duckdb -0.1% +1.8% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +1.6% +1.8% -0.2% +11.2% ➖ noise
4 duckdb:vortex-file-compressed +1.7% +1.8% -0.1% +11.6% ➖ noise
5 datafusion:vortex-compact +5.7% +0.1% +5.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +6.1% +0.1% +6.0% +10.0% ➖ noise
5 duckdb:duckdb +8.6% +0.1% +8.4% +12.9% ➖ noise
5 duckdb:vortex-compact -11.4% +0.1% -11.5% +10.9% ✅ faster
5 duckdb:vortex-file-compressed +2.9% +0.1% +2.8% +15.5% ➖ noise
6 datafusion:vortex-compact -0.1% +0.1% -0.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.2% +0.1% +1.1% +10.0% ➖ noise
6 duckdb:duckdb +0.6% +0.1% +0.5% +14.3% ➖ noise
6 duckdb:vortex-compact +6.2% +0.1% +6.1% +10.2% ➖ noise
6 duckdb:vortex-file-compressed +1.9% +0.1% +1.8% +15.2% ➖ noise
7 datafusion:vortex-compact -2.7% +2.0% -4.6% +11.7% ➖ noise
7 datafusion:vortex-file-compressed +4.4% +2.0% +2.4% +10.6% ➖ noise
7 duckdb:duckdb +3.0% +2.0% +1.0% +16.7% ➖ noise
7 duckdb:vortex-compact -0.8% +2.0% -2.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.7% +2.0% -6.5% +10.3% ➖ noise
8 datafusion:vortex-compact -2.2% +5.1% -6.9% +17.1% ➖ noise
8 datafusion:vortex-file-compressed +3.5% +5.1% -1.5% +10.0% ➖ noise
8 duckdb:duckdb -0.2% +5.1% -5.0% +10.0% ➖ noise
8 duckdb:vortex-compact -0.2% +5.1% -5.0% +12.1% ➖ noise
8 duckdb:vortex-file-compressed +8.6% +5.1% +3.3% +15.9% ➖ noise
9 datafusion:vortex-compact +3.9% +2.4% +1.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.2% +2.4% -0.2% +10.0% ➖ noise
9 duckdb:duckdb -1.3% +2.4% -3.6% +10.0% ➖ noise
9 duckdb:vortex-compact -1.7% +2.4% -4.0% +11.3% ➖ noise
9 duckdb:vortex-file-compressed -0.3% +2.4% -2.6% +12.9% ➖ noise
10 datafusion:vortex-compact -1.1% +1.0% -2.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.0% +1.0% +3.0% +10.0% ➖ noise
10 duckdb:duckdb +9.9% +1.0% +8.8% +10.0% ➖ noise
10 duckdb:vortex-compact +6.4% +1.0% +5.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.7% +1.0% +1.7% +17.4% ➖ noise
11 datafusion:vortex-compact +2.8% +3.5% -0.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.1% +3.5% +1.6% +10.0% ➖ noise
11 duckdb:duckdb +4.1% +3.5% +0.6% +14.0% ➖ noise
11 duckdb:vortex-compact +5.1% +3.5% +1.6% +10.9% ➖ noise
11 duckdb:vortex-file-compressed -0.9% +3.5% -4.3% +10.0% ➖ noise
12 datafusion:vortex-compact +7.9% -2.5% +10.7% +15.4% ➖ noise
12 datafusion:vortex-file-compressed +8.3% -2.5% +11.0% +13.9% ➖ noise
12 duckdb:duckdb -3.6% -2.5% -1.2% +11.6% ➖ noise
12 duckdb:vortex-compact +5.5% -2.5% +8.2% +19.0% ➖ noise
12 duckdb:vortex-file-compressed +4.9% -2.5% +7.6% +26.3% ➖ noise
13 datafusion:vortex-compact +2.7% -2.0% +4.9% +18.5% ➖ noise
13 datafusion:vortex-file-compressed -1.6% -2.0% +0.4% +10.0% ➖ noise
13 duckdb:duckdb +3.3% -2.0% +5.4% +10.0% ➖ noise
13 duckdb:vortex-compact +6.5% -2.0% +8.8% +10.6% ➖ noise
13 duckdb:vortex-file-compressed -2.8% -2.0% -0.8% +10.9% ➖ noise
14 datafusion:vortex-compact +3.3% +0.4% +2.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.5% +0.4% -0.8% +10.0% ➖ noise
14 duckdb:duckdb +3.7% +0.4% +3.3% +10.0% ➖ noise
14 duckdb:vortex-compact +3.8% +0.4% +3.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.1% +0.4% +1.8% +10.0% ➖ noise
15 datafusion:vortex-compact +6.1% +1.7% +4.3% +17.0% ➖ noise
15 datafusion:vortex-file-compressed -0.3% +1.7% -2.0% +10.0% ➖ noise
15 duckdb:duckdb -1.7% +1.7% -3.3% +10.0% ➖ noise
15 duckdb:vortex-compact +15.4% +1.7% +13.5% +14.2% ➖ noise
15 duckdb:vortex-file-compressed +1.4% +1.7% -0.3% +16.4% ➖ noise
16 datafusion:vortex-compact +0.8% +1.6% -0.8% +10.1% ➖ noise
16 datafusion:vortex-file-compressed +2.5% +1.6% +0.9% +10.0% ➖ noise
16 duckdb:duckdb -2.2% +1.6% -3.8% +11.7% ➖ noise
16 duckdb:vortex-compact +9.1% +1.6% +7.4% +12.2% ➖ noise
16 duckdb:vortex-file-compressed +0.7% +1.6% -0.8% +10.6% ➖ noise
17 datafusion:vortex-compact +4.1% -0.4% +4.6% +10.3% ➖ noise
17 datafusion:vortex-file-compressed +1.1% -0.4% +1.6% +10.0% ➖ noise
17 duckdb:duckdb +6.4% -0.4% +6.9% +12.8% ➖ noise
17 duckdb:vortex-compact +0.6% -0.4% +1.0% +18.0% ➖ noise
17 duckdb:vortex-file-compressed +6.6% -0.4% +7.0% +11.8% ➖ noise
18 datafusion:vortex-compact +2.4% +1.3% +1.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.7% +1.3% +2.4% +10.0% ➖ noise
18 duckdb:duckdb +3.9% +1.3% +2.5% +11.0% ➖ noise
18 duckdb:vortex-compact +4.5% +1.3% +3.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.1% +1.3% +3.7% +10.0% ➖ noise
19 datafusion:vortex-compact +3.0% +6.3% -3.2% +15.7% ➖ noise
19 datafusion:vortex-file-compressed -1.9% +6.3% -7.8% +10.9% ➖ noise
19 duckdb:duckdb +5.1% +6.3% -1.2% +11.9% ➖ noise
19 duckdb:vortex-compact -0.1% +6.3% -6.1% +10.4% ➖ noise
19 duckdb:vortex-file-compressed +5.6% +6.3% -0.7% +20.6% ➖ noise
20 datafusion:vortex-compact +3.2% +1.6% +1.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.8% +1.6% +2.1% +10.0% ➖ noise
20 duckdb:duckdb +11.5% +1.6% +9.8% +10.0% ➖ noise
20 duckdb:vortex-compact +2.3% +1.6% +0.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.6% +1.6% -0.0% +10.0% ➖ noise
21 datafusion:vortex-compact -0.2% +2.9% -3.0% +10.7% ➖ noise
21 datafusion:vortex-file-compressed -0.0% +2.9% -2.9% +11.6% ➖ noise
21 duckdb:duckdb +9.7% +2.9% +6.6% +16.7% ➖ noise
21 duckdb:vortex-compact +4.3% +2.9% +1.3% +21.8% ➖ noise
21 duckdb:vortex-file-compressed +6.3% +2.9% +3.3% +16.3% ➖ noise
22 datafusion:vortex-compact +1.3% -0.2% +1.5% +30.4% ➖ noise
22 datafusion:vortex-file-compressed -2.3% -0.2% -2.1% +29.6% ➖ noise
22 duckdb:duckdb +1.2% -0.2% +1.5% +13.7% ➖ noise
22 duckdb:vortex-compact +0.4% -0.2% +0.7% +10.9% ➖ noise
22 duckdb:vortex-file-compressed +11.4% -0.2% +11.6% +13.2% ➖ noise
23 datafusion:vortex-compact +2.3% +0.2% +2.2% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +7.9% +0.2% +7.7% +10.0% ➖ noise
23 duckdb:duckdb +2.8% +0.2% +2.6% +10.0% ➖ noise
23 duckdb:vortex-compact -4.5% +0.2% -4.7% +20.5% ➖ noise
23 duckdb:vortex-file-compressed +7.1% +0.2% +6.9% +21.1% ➖ noise
24 datafusion:vortex-compact +3.2% +1.7% +1.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +0.1% +1.7% -1.6% +10.0% ➖ noise
24 duckdb:duckdb +1.0% +1.7% -0.7% +12.3% ➖ noise
24 duckdb:vortex-compact -5.0% +1.7% -6.6% +10.6% ➖ noise
24 duckdb:vortex-file-compressed +4.1% +1.7% +2.3% +13.5% ➖ noise
25 datafusion:vortex-compact -2.4% +1.2% -3.5% +10.3% ➖ noise
25 datafusion:vortex-file-compressed -1.0% +1.2% -2.2% +10.0% ➖ noise
25 duckdb:duckdb -0.8% +1.2% -2.0% +16.0% ➖ noise
25 duckdb:vortex-compact +0.2% +1.2% -1.0% +10.1% ➖ noise
25 duckdb:vortex-file-compressed -0.1% +1.2% -1.3% +10.0% ➖ noise
26 datafusion:vortex-compact +0.4% +3.9% -3.4% +11.0% ➖ noise
26 datafusion:vortex-file-compressed +2.3% +3.9% -1.6% +11.7% ➖ noise
26 duckdb:duckdb +6.0% +3.9% +1.9% +17.4% ➖ noise
26 duckdb:vortex-compact +0.8% +3.9% -3.0% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +5.1% +3.9% +1.1% +11.1% ➖ noise
27 datafusion:vortex-compact -1.9% +0.2% -2.1% +11.3% ➖ noise
27 datafusion:vortex-file-compressed -1.5% +0.2% -1.7% +10.1% ➖ noise
27 duckdb:duckdb +1.3% +0.2% +1.1% +19.0% ➖ noise
27 duckdb:vortex-compact -2.9% +0.2% -3.1% +10.6% ➖ noise
27 duckdb:vortex-file-compressed +4.6% +0.2% +4.4% +13.2% ➖ noise
28 datafusion:vortex-compact -0.5% +4.2% -4.4% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.2% +4.2% -3.8% +10.0% ➖ noise
28 duckdb:duckdb +3.0% +4.2% -1.1% +10.0% ➖ noise
28 duckdb:vortex-compact -0.4% +4.2% -4.4% +26.3% ➖ noise
28 duckdb:vortex-file-compressed -2.2% +4.2% -6.1% +13.2% ➖ noise
29 datafusion:vortex-compact -0.4% +4.5% -4.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +6.0% +4.5% +1.5% +12.0% ➖ noise
29 duckdb:duckdb +5.3% +4.5% +0.8% +10.0% ➖ noise
29 duckdb:vortex-compact +1.1% +4.5% -3.2% +16.0% ➖ noise
29 duckdb:vortex-file-compressed +15.2% +4.5% +10.3% +16.4% ➖ noise
30 datafusion:vortex-compact -0.7% -1.0% +0.3% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +1.6% -1.0% +2.7% +11.4% ➖ noise
30 duckdb:duckdb +9.0% -1.0% +10.2% +11.5% ➖ noise
30 duckdb:vortex-compact -1.5% -1.0% -0.5% +10.5% ➖ noise
30 duckdb:vortex-file-compressed -1.0% -1.0% -0.0% +24.9% ➖ noise
31 datafusion:vortex-compact -1.1% +1.5% -2.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.2% +1.5% -0.4% +10.0% ➖ noise
31 duckdb:duckdb +2.5% +1.5% +0.9% +10.0% ➖ noise
31 duckdb:vortex-compact -1.4% +1.5% -2.9% +13.4% ➖ noise
31 duckdb:vortex-file-compressed +5.6% +1.5% +4.0% +14.1% ➖ noise
32 datafusion:vortex-compact +1.2% -1.2% +2.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -2.5% -1.2% -1.3% +10.4% ➖ noise
32 duckdb:duckdb +2.6% -1.2% +3.9% +12.6% ➖ noise
32 duckdb:vortex-compact +1.3% -1.2% +2.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +17.3% -1.2% +18.8% +14.7% 🚨 regression
33 datafusion:vortex-compact -1.5% +5.8% -6.8% +10.4% ➖ noise
33 datafusion:vortex-file-compressed +2.8% +5.8% -2.8% +10.0% ➖ noise
33 duckdb:duckdb +5.2% +5.8% -0.5% +13.5% ➖ noise
33 duckdb:vortex-compact +6.0% +5.8% +0.2% +17.4% ➖ noise
33 duckdb:vortex-file-compressed +4.9% +5.8% -0.8% +13.0% ➖ noise
34 datafusion:vortex-compact +3.2% +2.0% +1.1% +12.5% ➖ noise
34 datafusion:vortex-file-compressed -0.1% +2.0% -2.1% +10.0% ➖ noise
34 duckdb:duckdb +6.6% +2.0% +4.5% +17.4% ➖ noise
34 duckdb:vortex-compact +4.0% +2.0% +1.9% +10.4% ➖ noise
34 duckdb:vortex-file-compressed +2.2% +2.0% +0.2% +18.0% ➖ noise
35 datafusion:vortex-compact +6.0% +0.2% +5.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +4.0% +0.2% +3.8% +10.0% ➖ noise
35 duckdb:duckdb +0.6% +0.2% +0.5% +13.6% ➖ noise
35 duckdb:vortex-compact +0.2% +0.2% +0.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -5.1% +0.2% -5.3% +10.0% ➖ noise
36 datafusion:vortex-compact +4.0% -3.1% +7.3% +11.7% ➖ noise
36 datafusion:vortex-file-compressed +3.9% -3.1% +7.2% +12.6% ➖ noise
36 duckdb:duckdb +0.2% -3.1% +3.4% +10.6% ➖ noise
36 duckdb:vortex-compact +2.0% -3.1% +5.3% +18.2% ➖ noise
36 duckdb:vortex-file-compressed +9.0% -3.1% +12.4% +15.4% ➖ noise
37 datafusion:vortex-compact -6.7% +3.7% -10.0% +12.0% ➖ noise
37 datafusion:vortex-file-compressed +2.6% +3.7% -1.1% +12.7% ➖ noise
37 duckdb:duckdb +3.8% +3.7% +0.1% +13.5% ➖ noise
37 duckdb:vortex-compact +4.2% +3.7% +0.5% +14.3% ➖ noise
37 duckdb:vortex-file-compressed +2.4% +3.7% -1.3% +11.6% ➖ noise
38 datafusion:vortex-compact +0.2% +5.6% -5.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +0.5% +5.6% -4.9% +10.3% ➖ noise
38 duckdb:duckdb +1.0% +5.6% -4.4% +10.5% ➖ noise
38 duckdb:vortex-compact +5.6% +5.6% -0.0% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -3.0% +5.6% -8.2% +29.2% ➖ noise
39 datafusion:vortex-compact +0.6% -0.2% +0.8% +13.6% ➖ noise
39 datafusion:vortex-file-compressed +4.3% -0.2% +4.5% +13.1% ➖ noise
39 duckdb:duckdb +3.3% -0.2% +3.5% +13.9% ➖ noise
39 duckdb:vortex-compact +3.9% -0.2% +4.1% +14.7% ➖ noise
39 duckdb:vortex-file-compressed +0.8% -0.2% +0.9% +16.3% ➖ noise
40 datafusion:vortex-compact -1.2% +2.0% -3.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +3.9% +2.0% +1.9% +10.0% ➖ noise
40 duckdb:duckdb +2.3% +2.0% +0.3% +10.1% ➖ noise
40 duckdb:vortex-compact +7.1% +2.0% +4.9% +13.7% ➖ noise
40 duckdb:vortex-file-compressed +7.3% +2.0% +5.2% +10.3% ➖ noise
41 datafusion:vortex-compact +4.0% -0.9% +4.9% +14.0% ➖ noise
41 datafusion:vortex-file-compressed +1.0% -0.9% +2.0% +10.9% ➖ noise
41 duckdb:duckdb -1.5% -0.9% -0.6% +11.9% ➖ noise
41 duckdb:vortex-compact +2.2% -0.9% +3.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -2.2% -0.9% -1.2% +10.0% ➖ noise
42 datafusion:vortex-compact -1.2% +0.4% -1.6% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +6.0% +0.4% +5.6% +10.0% ➖ noise
42 duckdb:duckdb +1.7% +0.4% +1.4% +16.1% ➖ noise
42 duckdb:vortex-compact +2.1% +0.4% +1.7% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -6.9% +0.4% -7.2% +10.0% ➖ noise
43 datafusion:vortex-compact -3.1% -1.0% -2.1% +12.1% ➖ noise
43 datafusion:vortex-file-compressed +2.5% -1.0% +3.6% +10.0% ➖ noise
43 duckdb:duckdb +0.1% -1.0% +1.2% +14.4% ➖ noise
43 duckdb:vortex-compact -0.5% -1.0% +0.6% +18.9% ➖ noise
43 duckdb:vortex-file-compressed +5.0% -1.0% +6.0% +17.1% ➖ noise
44 datafusion:vortex-compact +3.4% +2.5% +0.8% +10.6% ➖ noise
44 datafusion:vortex-file-compressed +1.3% +2.5% -1.2% +11.3% ➖ noise
44 duckdb:duckdb +11.3% +2.5% +8.6% +11.4% ➖ noise
44 duckdb:vortex-compact -0.2% +2.5% -2.7% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +3.7% +2.5% +1.1% +10.0% ➖ noise
45 datafusion:vortex-compact +7.3% -0.5% +7.8% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +5.1% -0.5% +5.6% +10.0% ➖ noise
45 duckdb:duckdb -1.8% -0.5% -1.3% +11.4% ➖ noise
45 duckdb:vortex-compact +0.7% -0.5% +1.2% +11.8% ➖ noise
45 duckdb:vortex-file-compressed +2.1% -0.5% +2.7% +10.0% ➖ noise
46 datafusion:vortex-compact +2.2% +2.9% -0.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -0.6% +2.9% -3.4% +10.0% ➖ noise
46 duckdb:duckdb +1.5% +2.9% -1.4% +10.0% ➖ noise
46 duckdb:vortex-compact -1.5% +2.9% -4.3% +10.6% ➖ noise
46 duckdb:vortex-file-compressed +0.0% +2.9% -2.8% +12.4% ➖ noise
47 datafusion:vortex-compact +1.4% +0.6% +0.8% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +2.4% +0.6% +1.7% +10.0% ➖ noise
47 duckdb:duckdb +0.6% +0.6% +0.0% +10.0% ➖ noise
47 duckdb:vortex-compact +3.1% +0.6% +2.4% +11.2% ➖ noise
47 duckdb:vortex-file-compressed +1.2% +0.6% +0.5% +13.9% ➖ noise
48 datafusion:vortex-compact -2.6% -3.2% +0.6% +18.4% ➖ noise
48 datafusion:vortex-file-compressed +1.6% -3.2% +4.9% +10.0% ➖ noise
48 duckdb:duckdb +1.7% -3.2% +5.1% +10.0% ➖ noise
48 duckdb:vortex-compact +1.4% -3.2% +4.7% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +9.6% -3.2% +13.2% +10.0% 🚨 regression
49 datafusion:vortex-compact +2.4% -0.6% +3.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +4.5% -0.6% +5.1% +10.0% ➖ noise
49 duckdb:duckdb -3.2% -0.6% -2.5% +17.1% ➖ noise
49 duckdb:vortex-compact -0.7% -0.6% -0.0% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +2.1% -0.6% +2.7% +18.3% ➖ noise
50 datafusion:vortex-compact +0.5% -2.8% +3.4% +10.3% ➖ noise
50 datafusion:vortex-file-compressed +2.8% -2.8% +5.8% +10.4% ➖ noise
50 duckdb:duckdb +0.0% -2.8% +3.0% +11.7% ➖ noise
50 duckdb:vortex-compact +2.0% -2.8% +4.9% +10.2% ➖ noise
50 duckdb:vortex-file-compressed -3.0% -2.8% -0.1% +10.0% ➖ noise
51 datafusion:vortex-compact +0.8% +2.4% -1.5% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +2.1% +2.4% -0.2% +10.0% ➖ noise
51 duckdb:duckdb -1.5% +2.4% -3.8% +18.4% ➖ noise
51 duckdb:vortex-compact +2.7% +2.4% +0.3% +13.2% ➖ noise
51 duckdb:vortex-file-compressed -20.2% +2.4% -22.0% +17.8% ✅ faster
52 datafusion:vortex-compact +3.4% +9.2% -5.3% +22.7% ➖ noise
52 datafusion:vortex-file-compressed +2.9% +9.2% -5.8% +13.5% ➖ noise
52 duckdb:duckdb -3.0% +9.2% -11.2% +17.2% ➖ noise
52 duckdb:vortex-compact -2.8% +9.2% -11.0% +21.4% ➖ noise
52 duckdb:vortex-file-compressed -8.7% +9.2% -16.4% +16.6% ✅ faster
53 datafusion:vortex-compact +5.0% +3.2% +1.7% +10.3% ➖ noise
53 datafusion:vortex-file-compressed +3.3% +3.2% +0.1% +10.2% ➖ noise
53 duckdb:duckdb +4.7% +3.2% +1.4% +13.1% ➖ noise
53 duckdb:vortex-compact +2.1% +3.2% -1.0% +14.8% ➖ noise
53 duckdb:vortex-file-compressed -1.0% +3.2% -4.1% +10.0% ➖ noise
54 datafusion:vortex-compact +1.0% +2.2% -1.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +0.8% +2.2% -1.4% +10.0% ➖ noise
54 duckdb:duckdb +1.5% +2.2% -0.6% +10.0% ➖ noise
54 duckdb:vortex-compact +3.1% +2.2% +0.9% +13.7% ➖ noise
54 duckdb:vortex-file-compressed +1.1% +2.2% -1.1% +10.0% ➖ noise
55 datafusion:vortex-compact +2.5% +4.9% -2.3% +11.8% ➖ noise
55 datafusion:vortex-file-compressed +2.7% +4.9% -2.1% +13.1% ➖ noise
55 duckdb:duckdb -6.1% +4.9% -10.5% +16.5% ➖ noise
55 duckdb:vortex-compact +0.3% +4.9% -4.4% +28.2% ➖ noise
55 duckdb:vortex-file-compressed +4.1% +4.9% -0.8% +28.3% ➖ noise
56 datafusion:vortex-compact +4.1% -3.9% +8.3% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.1% -3.9% +4.0% +10.0% ➖ noise
56 duckdb:duckdb -2.3% -3.9% +1.6% +14.6% ➖ noise
56 duckdb:vortex-compact +1.2% -3.9% +5.3% +11.8% ➖ noise
56 duckdb:vortex-file-compressed +1.3% -3.9% +5.4% +10.0% ➖ noise
57 datafusion:vortex-compact -0.1% +2.3% -2.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +0.6% +2.3% -1.7% +10.0% ➖ noise
57 duckdb:duckdb -1.8% +2.3% -4.0% +10.0% ➖ noise
57 duckdb:vortex-compact +0.3% +2.3% -1.9% +12.3% ➖ noise
57 duckdb:vortex-file-compressed -1.7% +2.3% -3.9% +11.5% ➖ noise
58 datafusion:vortex-compact +9.3% -2.2% +11.7% +10.0% 🚨 regression
58 datafusion:vortex-file-compressed -0.9% -2.2% +1.4% +10.0% ➖ noise
58 duckdb:duckdb +15.1% -2.2% +17.7% +17.8% ➖ noise
58 duckdb:vortex-compact +1.0% -2.2% +3.3% +10.9% ➖ noise
58 duckdb:vortex-file-compressed -2.2% -2.2% +0.0% +12.6% ➖ noise
59 datafusion:vortex-compact -1.2% +1.4% -2.6% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.4% +1.4% -1.8% +10.0% ➖ noise
59 duckdb:duckdb -0.0% +1.4% -1.4% +12.8% ➖ noise
59 duckdb:vortex-compact -3.3% +1.4% -4.7% +15.1% ➖ noise
59 duckdb:vortex-file-compressed +1.5% +1.4% +0.0% +12.9% ➖ noise
60 datafusion:vortex-compact +8.0% -1.1% +9.1% +11.1% ➖ noise
60 datafusion:vortex-file-compressed -0.8% -1.1% +0.3% +15.5% ➖ noise
60 duckdb:duckdb +2.2% -1.1% +3.3% +12.8% ➖ noise
60 duckdb:vortex-compact +5.9% -1.1% +7.0% +13.0% ➖ noise
60 duckdb:vortex-file-compressed -0.2% -1.1% +0.9% +10.4% ➖ noise
61 datafusion:vortex-compact +1.2% -1.7% +2.9% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +2.5% -1.7% +4.3% +10.0% ➖ noise
61 duckdb:duckdb +0.7% -1.7% +2.4% +12.6% ➖ noise
61 duckdb:vortex-compact -1.3% -1.7% +0.4% +12.1% ➖ noise
61 duckdb:vortex-file-compressed -7.8% -1.7% -6.2% +19.7% ➖ noise
62 datafusion:vortex-compact -16.3% -1.1% -15.4% +29.3% ➖ noise
62 datafusion:vortex-file-compressed +9.5% -1.1% +10.8% +31.2% ➖ noise
62 duckdb:duckdb +2.4% -1.1% +3.6% +16.0% ➖ noise
62 duckdb:vortex-compact +0.4% -1.1% +1.5% +25.1% ➖ noise
62 duckdb:vortex-file-compressed -0.5% -1.1% +0.6% +18.3% ➖ noise
63 datafusion:vortex-compact -0.6% -1.4% +0.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -3.2% -1.4% -1.8% +10.0% ➖ noise
63 duckdb:duckdb -0.2% -1.4% +1.2% +15.5% ➖ noise
63 duckdb:vortex-compact -0.3% -1.4% +1.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +1.0% -1.4% +2.4% +10.0% ➖ noise
64 datafusion:vortex-compact +2.3% +0.4% +1.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +1.9% +0.4% +1.4% +10.0% ➖ noise
64 duckdb:duckdb +2.2% +0.4% +1.8% +10.0% ➖ noise
64 duckdb:vortex-compact +3.4% +0.4% +3.0% +11.7% ➖ noise
64 duckdb:vortex-file-compressed +0.7% +0.4% +0.3% +10.0% ➖ noise
65 datafusion:vortex-compact +0.3% +3.5% -3.1% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +6.0% +3.5% +2.4% +12.9% ➖ noise
65 duckdb:duckdb -5.6% +3.5% -8.8% +17.4% ➖ noise
65 duckdb:vortex-compact +9.3% +3.5% +5.6% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -2.7% +3.5% -6.0% +12.0% ➖ noise
66 datafusion:vortex-compact +2.4% +0.8% +1.6% +12.6% ➖ noise
66 datafusion:vortex-file-compressed +8.1% +0.8% +7.3% +11.9% ➖ noise
66 duckdb:duckdb -2.2% +0.8% -3.0% +13.1% ➖ noise
66 duckdb:vortex-compact -2.9% +0.8% -3.6% +18.2% ➖ noise
66 duckdb:vortex-file-compressed +4.5% +0.8% +3.7% +13.8% ➖ noise
67 datafusion:vortex-compact -0.6% -1.5% +0.9% +13.3% ➖ noise
67 datafusion:vortex-file-compressed +2.6% -1.5% +4.2% +10.0% ➖ noise
67 duckdb:duckdb +0.1% -1.5% +1.6% +10.0% ➖ noise
67 duckdb:vortex-compact +1.1% -1.5% +2.6% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -2.0% -1.5% -0.5% +10.0% ➖ noise
68 datafusion:vortex-compact -3.9% +2.0% -5.8% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +3.1% +2.0% +1.1% +23.4% ➖ noise
68 duckdb:duckdb +1.6% +2.0% -0.3% +10.0% ➖ noise
68 duckdb:vortex-compact -2.2% +2.0% -4.1% +11.2% ➖ noise
68 duckdb:vortex-file-compressed +1.6% +2.0% -0.4% +12.8% ➖ noise
69 datafusion:vortex-compact -2.0% +1.7% -3.6% +15.3% ➖ noise
69 datafusion:vortex-file-compressed +6.0% +1.7% +4.3% +10.0% ➖ noise
69 duckdb:duckdb +2.3% +1.7% +0.6% +10.0% ➖ noise
69 duckdb:vortex-compact +6.1% +1.7% +4.4% +10.7% ➖ noise
69 duckdb:vortex-file-compressed -3.3% +1.7% -4.9% +11.4% ➖ noise
70 datafusion:vortex-compact -0.6% -2.6% +2.1% +11.6% ➖ noise
70 datafusion:vortex-file-compressed +0.6% -2.6% +3.3% +16.6% ➖ noise
70 duckdb:duckdb +12.4% -2.6% +15.4% +15.1% 🚨 regression
70 duckdb:vortex-compact -2.6% -2.6% -0.1% +10.4% ➖ noise
70 duckdb:vortex-file-compressed +0.8% -2.6% +3.4% +10.0% ➖ noise
71 datafusion:vortex-compact -0.5% +0.9% -1.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +2.4% +0.9% +1.4% +10.0% ➖ noise
71 duckdb:duckdb -5.6% +0.9% -6.5% +17.3% ➖ noise
71 duckdb:vortex-compact +1.3% +0.9% +0.3% +11.0% ➖ noise
71 duckdb:vortex-file-compressed +3.7% +0.9% +2.7% +14.5% ➖ noise
72 datafusion:vortex-compact +2.5% +1.3% +1.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +4.3% +1.3% +2.9% +10.0% ➖ noise
72 duckdb:duckdb +10.7% +1.3% +9.3% +12.6% ➖ noise
72 duckdb:vortex-compact +1.8% +1.3% +0.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.7% +1.3% -2.0% +10.0% ➖ noise
73 datafusion:vortex-compact +0.9% +1.4% -0.5% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +0.3% +1.4% -1.1% +10.0% ➖ noise
73 duckdb:duckdb -4.2% +1.4% -5.6% +13.8% ➖ noise
73 duckdb:vortex-compact +8.8% +1.4% +7.3% +13.5% ➖ noise
73 duckdb:vortex-file-compressed -1.4% +1.4% -2.8% +13.0% ➖ noise
74 datafusion:vortex-compact +2.8% +1.9% +0.9% +13.0% ➖ noise
74 datafusion:vortex-file-compressed +3.3% +1.9% +1.4% +15.0% ➖ noise
74 duckdb:duckdb +0.0% +1.9% -1.8% +10.0% ➖ noise
74 duckdb:vortex-compact -0.1% +1.9% -2.0% +16.3% ➖ noise
74 duckdb:vortex-file-compressed -3.2% +1.9% -5.0% +12.5% ➖ noise
75 datafusion:vortex-compact +2.3% +1.0% +1.3% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +3.1% +1.0% +2.1% +10.0% ➖ noise
75 duckdb:duckdb +5.8% +1.0% +4.7% +10.0% ➖ noise
75 duckdb:vortex-compact +3.3% +1.0% +2.3% +10.1% ➖ noise
75 duckdb:vortex-file-compressed +1.1% +1.0% +0.1% +10.0% ➖ noise
76 datafusion:vortex-compact +2.5% +1.1% +1.4% +14.4% ➖ noise
76 datafusion:vortex-file-compressed -0.2% +1.1% -1.3% +16.8% ➖ noise
76 duckdb:duckdb +0.9% +1.1% -0.2% +19.5% ➖ noise
76 duckdb:vortex-compact -1.9% +1.1% -3.0% +22.1% ➖ noise
76 duckdb:vortex-file-compressed -2.3% +1.1% -3.3% +30.0% ➖ noise
77 datafusion:vortex-compact +2.1% +0.3% +1.9% +13.3% ➖ noise
77 datafusion:vortex-file-compressed +3.4% +0.3% +3.1% +15.1% ➖ noise
77 duckdb:duckdb +1.8% +0.3% +1.5% +10.0% ➖ noise
77 duckdb:vortex-compact +2.8% +0.3% +2.6% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +8.5% +0.3% +8.2% +12.2% ➖ noise
78 datafusion:vortex-compact +2.4% +0.9% +1.4% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +3.3% +0.9% +2.4% +10.0% ➖ noise
78 duckdb:duckdb +3.3% +0.9% +2.4% +10.0% ➖ noise
78 duckdb:vortex-compact +8.8% +0.9% +7.7% +15.1% ➖ noise
78 duckdb:vortex-file-compressed +2.0% +0.9% +1.1% +14.4% ➖ noise
79 datafusion:vortex-compact +7.3% +7.1% +0.1% +14.1% ➖ noise
79 datafusion:vortex-file-compressed -3.1% +7.1% -9.6% +13.7% ➖ noise
79 duckdb:duckdb +1.8% +7.1% -5.0% +10.0% ➖ noise
79 duckdb:vortex-compact -0.4% +7.1% -7.0% +12.4% ➖ noise
79 duckdb:vortex-file-compressed +1.3% +7.1% -5.4% +10.3% ➖ noise
80 datafusion:vortex-compact +1.0% -1.3% +2.3% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.3% -1.3% +1.6% +11.5% ➖ noise
80 duckdb:duckdb +0.5% -1.3% +1.8% +13.7% ➖ noise
80 duckdb:vortex-compact +5.8% -1.3% +7.2% +12.1% ➖ noise
80 duckdb:vortex-file-compressed +6.0% -1.3% +7.4% +14.8% ➖ noise
81 datafusion:vortex-compact +19.5% +0.7% +18.7% +18.3% 🚨 regression
81 datafusion:vortex-file-compressed +1.5% +0.7% +0.8% +10.0% ➖ noise
81 duckdb:duckdb +4.9% +0.7% +4.2% +11.6% ➖ noise
81 duckdb:vortex-compact +5.7% +0.7% +4.9% +15.6% ➖ noise
81 duckdb:vortex-file-compressed +19.1% +0.7% +18.2% +15.0% 🚨 regression
82 datafusion:vortex-compact +3.5% +4.8% -1.3% +13.5% ➖ noise
82 datafusion:vortex-file-compressed +7.4% +4.8% +2.5% +11.2% ➖ noise
82 duckdb:duckdb +7.9% +4.8% +3.0% +13.1% ➖ noise
82 duckdb:vortex-compact +3.4% +4.8% -1.3% +17.1% ➖ noise
82 duckdb:vortex-file-compressed +1.1% +4.8% -3.5% +21.7% ➖ noise
83 datafusion:vortex-compact +3.3% +5.7% -2.3% +10.1% ➖ noise
83 datafusion:vortex-file-compressed +3.0% +5.7% -2.6% +10.0% ➖ noise
83 duckdb:duckdb -2.4% +5.7% -7.6% +11.2% ➖ noise
83 duckdb:vortex-compact -2.0% +5.7% -7.3% +20.4% ➖ noise
83 duckdb:vortex-file-compressed +7.7% +5.7% +1.9% +15.9% ➖ noise
84 datafusion:vortex-compact +5.7% +3.8% +1.8% +20.8% ➖ noise
84 datafusion:vortex-file-compressed +6.0% +3.8% +2.1% +11.7% ➖ noise
84 duckdb:duckdb -6.8% +3.8% -10.2% +10.0% ✅ faster
84 duckdb:vortex-compact -1.0% +3.8% -4.7% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +4.1% +3.8% +0.3% +10.0% ➖ noise
85 datafusion:vortex-compact -3.6% -0.1% -3.6% +16.2% ➖ noise
85 datafusion:vortex-file-compressed +2.8% -0.1% +2.9% +10.0% ➖ noise
85 duckdb:duckdb -0.7% -0.1% -0.6% +14.3% ➖ noise
85 duckdb:vortex-compact +2.8% -0.1% +2.9% +10.4% ➖ noise
85 duckdb:vortex-file-compressed -1.7% -0.1% -1.6% +10.0% ➖ noise
86 datafusion:vortex-compact +18.6% +7.8% +10.0% +29.3% ➖ noise
86 datafusion:vortex-file-compressed +1.0% +7.8% -6.3% +17.6% ➖ noise
86 duckdb:duckdb +3.6% +7.8% -3.9% +13.0% ➖ noise
86 duckdb:vortex-compact +9.0% +7.8% +1.0% +16.1% ➖ noise
86 duckdb:vortex-file-compressed +5.0% +7.8% -2.7% +20.8% ➖ noise
87 datafusion:vortex-compact +3.2% +1.7% +1.5% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.8% +1.7% -0.9% +10.0% ➖ noise
87 duckdb:duckdb -0.4% +1.7% -2.0% +10.0% ➖ noise
87 duckdb:vortex-compact -1.5% +1.7% -3.1% +12.7% ➖ noise
87 duckdb:vortex-file-compressed +1.9% +1.7% +0.2% +10.1% ➖ noise
88 datafusion:vortex-compact -3.2% +0.9% -4.0% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.7% +0.9% -2.5% +10.0% ➖ noise
88 duckdb:duckdb +0.7% +0.9% -0.2% +10.0% ➖ noise
88 duckdb:vortex-compact +2.4% +0.9% +1.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +4.1% +0.9% +3.2% +10.0% ➖ noise
89 datafusion:vortex-compact +4.1% +7.8% -3.4% +15.0% ➖ noise
89 datafusion:vortex-file-compressed -0.2% +7.8% -7.4% +10.0% ➖ noise
89 duckdb:duckdb +1.6% +7.8% -5.7% +10.8% ➖ noise
89 duckdb:vortex-compact +1.7% +7.8% -5.6% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +1.3% +7.8% -6.0% +10.0% ➖ noise
90 datafusion:vortex-compact +3.2% +1.0% +2.1% +15.3% ➖ noise
90 datafusion:vortex-file-compressed +12.6% +1.0% +11.5% +10.0% 🚨 regression
90 duckdb:duckdb +2.8% +1.0% +1.8% +10.0% ➖ noise
90 duckdb:vortex-compact -2.3% +1.0% -3.3% +18.0% ➖ noise
90 duckdb:vortex-file-compressed -5.2% +1.0% -6.2% +18.3% ➖ noise
91 datafusion:vortex-compact +2.9% -1.0% +3.9% +14.2% ➖ noise
91 datafusion:vortex-file-compressed +4.3% -1.0% +5.4% +10.0% ➖ noise
91 duckdb:duckdb +6.4% -1.0% +7.4% +15.1% ➖ noise
91 duckdb:vortex-compact -2.1% -1.0% -1.1% +11.8% ➖ noise
91 duckdb:vortex-file-compressed -6.3% -1.0% -5.4% +10.0% ➖ noise
92 datafusion:vortex-compact +2.0% +8.9% -6.3% +14.2% ➖ noise
92 datafusion:vortex-file-compressed +3.4% +8.9% -5.0% +16.4% ➖ noise
92 duckdb:duckdb +2.8% +8.9% -5.6% +14.2% ➖ noise
92 duckdb:vortex-compact +15.0% +8.9% +5.7% +14.4% ➖ noise
92 duckdb:vortex-file-compressed +11.3% +8.9% +2.2% +13.5% ➖ noise
93 datafusion:vortex-compact +4.8% +2.3% +2.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -0.8% +2.3% -3.0% +10.0% ➖ noise
93 duckdb:duckdb -5.1% +2.3% -7.2% +17.2% ➖ noise
93 duckdb:vortex-compact +2.7% +2.3% +0.4% +13.4% ➖ noise
93 duckdb:vortex-file-compressed +0.1% +2.3% -2.1% +10.0% ➖ noise
94 datafusion:vortex-compact +2.2% +2.0% +0.2% +12.0% ➖ noise
94 datafusion:vortex-file-compressed +3.7% +2.0% +1.6% +10.0% ➖ noise
94 duckdb:duckdb +2.0% +2.0% -0.0% +11.2% ➖ noise
94 duckdb:vortex-compact -0.6% +2.0% -2.5% +10.7% ➖ noise
94 duckdb:vortex-file-compressed -0.6% +2.0% -2.6% +10.0% ➖ noise
95 datafusion:vortex-compact +6.5% -1.2% +7.8% +13.1% ➖ noise
95 datafusion:vortex-file-compressed +4.7% -1.2% +6.0% +11.8% ➖ noise
95 duckdb:duckdb +3.4% -1.2% +4.7% +21.9% ➖ noise
95 duckdb:vortex-compact +5.3% -1.2% +6.6% +18.6% ➖ noise
95 duckdb:vortex-file-compressed -8.0% -1.2% -6.9% +16.8% ➖ noise
96 datafusion:vortex-compact -0.9% -0.2% -0.7% +19.0% ➖ noise
96 datafusion:vortex-file-compressed -3.3% -0.2% -3.1% +11.9% ➖ noise
96 duckdb:duckdb +13.0% -0.2% +13.3% +19.9% ➖ noise
96 duckdb:vortex-compact -4.0% -0.2% -3.8% +18.0% ➖ noise
96 duckdb:vortex-file-compressed +1.2% -0.2% +1.5% +16.7% ➖ noise
97 datafusion:vortex-compact -4.8% +1.0% -5.8% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +0.1% +1.0% -0.9% +10.0% ➖ noise
97 duckdb:duckdb -3.2% +1.0% -4.2% +10.7% ➖ noise
97 duckdb:vortex-compact -2.2% +1.0% -3.2% +12.5% ➖ noise
97 duckdb:vortex-file-compressed +2.4% +1.0% +1.3% +13.1% ➖ noise
98 datafusion:vortex-compact -0.2% -2.2% +2.0% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +1.1% -2.2% +3.3% +17.2% ➖ noise
98 duckdb:duckdb +1.4% -2.2% +3.6% +14.2% ➖ noise
98 duckdb:vortex-compact +5.8% -2.2% +8.1% +15.7% ➖ noise
98 duckdb:vortex-file-compressed -1.2% -2.2% +1.0% +12.7% ➖ noise
99 datafusion:vortex-compact -7.0% +2.6% -9.4% +19.0% ➖ noise
99 datafusion:vortex-file-compressed +12.6% +2.6% +9.7% +19.1% ➖ noise
99 duckdb:duckdb +7.8% +2.6% +5.0% +25.7% ➖ noise
99 duckdb:vortex-compact +3.8% +2.6% +1.1% +18.4% ➖ noise
99 duckdb:vortex-file-compressed +14.2% +2.6% +11.2% +21.7% ➖ noise

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 0.946x ➖
Parquet (geomean): 0.950x ➖
Shifts: Parquet (control) -5.0% · Median polish -5.3%


datafusion / vortex-file-compressed (0.949x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 397067932 408277143 0.97
tpch_q02/datafusion:vortex-file-compressed 104750281 111620348 0.94
tpch_q03/datafusion:vortex-file-compressed 214811704 234143824 0.92
tpch_q04/datafusion:vortex-file-compressed 112628965 118260023 0.95
tpch_q05/datafusion:vortex-file-compressed 366929960 388431803 0.94
tpch_q06/datafusion:vortex-file-compressed 35578249 38125949 0.93
tpch_q07/datafusion:vortex-file-compressed 498392333 532052896 0.94
tpch_q08/datafusion:vortex-file-compressed 351580984 372372955 0.94
tpch_q09/datafusion:vortex-file-compressed 625723991 670317893 0.93
tpch_q10/datafusion:vortex-file-compressed 224484779 235256113 0.95
tpch_q11/datafusion:vortex-file-compressed 80633873 85086017 0.95
tpch_q12/datafusion:vortex-file-compressed 115233207 121799049 0.95
tpch_q13/datafusion:vortex-file-compressed 213080529 222221673 0.96
tpch_q14/datafusion:vortex-file-compressed 52374854 53836952 0.97
tpch_q15/datafusion:vortex-file-compressed 96612744 100668800 0.96
tpch_q16/datafusion:vortex-file-compressed 73633108 78676203 0.94
tpch_q17/datafusion:vortex-file-compressed 629536444 665428519 0.95
tpch_q18/datafusion:vortex-file-compressed 833016363 895155044 0.93
tpch_q19/datafusion:vortex-file-compressed 68243022 70533469 0.97
tpch_q20/datafusion:vortex-file-compressed 161356779 166799364 0.97
tpch_q21/datafusion:vortex-file-compressed 647930644 681753914 0.95
tpch_q22/datafusion:vortex-file-compressed 63244862 65552513 0.96
datafusion / vortex-compact (0.947x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 449202181 452844751 0.99
tpch_q02/datafusion:vortex-compact 108498913 115204898 0.94
tpch_q03/datafusion:vortex-compact 214091591 228237189 0.94
tpch_q04/datafusion:vortex-compact 119438825 122228564 0.98
tpch_q05/datafusion:vortex-compact 365942946 391414607 0.93
tpch_q06/datafusion:vortex-compact 58287192 5950383 0.98
tpch_q07/datafusion:vortex-compact 519553803 547588382 0.95
tpch_q08/datafusion:vortex-compact 355525012 379119762 0.94
tpch_q09/datafusion:vortex-compact 631862825 670993859 0.94
tpch_q10/datafusion:vortex-compact 242039359 253437607 0.96
tpch_q11/datafusion:vortex-compact 83284447 88588988 0.94
tpch_q12/datafusion:vortex-compact 158150170 168309646 0.94
tpch_q13/datafusion:vortex-compact 265687463 283908562 0.94
tpch_q14/datafusion:vortex-compact 69748961 72159870 0.97
tpch_q15/datafusion:vortex-compact 151831002 161100268 0.94
tpch_q16/datafusion:vortex-compact 77739844 84114275 0.92
tpch_q17/datafusion:vortex-compact 629002740 685565828 0.92
tpch_q18/datafusion:vortex-compact 828287326 892714342 0.93
tpch_q19/datafusion:vortex-compact 120855023 126114162 0.96
tpch_q20/datafusion:vortex-compact 184599333 194347509 0.95
tpch_q21/datafusion:vortex-compact 663589950 695191475 0.95
tpch_q22/datafusion:vortex-compact 69701465 73885067 0.94
datafusion / parquet (0.948x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 454136268 474199132 0.96
tpch_q02/datafusion:parquet 169634041 178269181 0.95
tpch_q03/datafusion:parquet 279663020 295611885 0.95
tpch_q04/datafusion:parquet 126156040 132834429 0.95
tpch_q05/datafusion:parquet 428235755 464962211 0.92
tpch_q06/datafusion:parquet 125065899 132409821 0.94
tpch_q07/datafusion:parquet 600451845 641606327 0.94
tpch_q08/datafusion:parquet 457254840 478374578 0.96
tpch_q09/datafusion:parquet 728482499 779672326 0.93
tpch_q10/datafusion:parquet 485737134 512412841 0.95
tpch_q11/datafusion:parquet 114709411 120785115 0.95
tpch_q12/datafusion:parquet 196178644 199876432 0.98
tpch_q13/datafusion:parquet 329919730 342150759 0.96
tpch_q14/datafusion:parquet 151234037 165637281 0.91
tpch_q15/datafusion:parquet 250370249 258186846 0.97
tpch_q16/datafusion:parquet 120595525 124560142 0.97
tpch_q17/datafusion:parquet 678728244 719107980 0.94
tpch_q18/datafusion:parquet 864884531 936175079 0.92
tpch_q19/datafusion:parquet 261002423 269621871 0.97
tpch_q20/datafusion:parquet 288264020 305450959 0.94
tpch_q21/datafusion:parquet 680743612 734053386 0.93
tpch_q22/datafusion:parquet 207566441 218209794 0.95
datafusion / arrow (0.917x ➖, 8↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 594874480 642117169 0.93
tpch_q02/datafusion:arrow 165678662 172221409 0.96
tpch_q03/datafusion:arrow 🚀 461067646 522497883 0.88
tpch_q04/datafusion:arrow 🚀 334495812 384351204 0.87
tpch_q05/datafusion:arrow 924150746 1007162597 0.92
tpch_q06/datafusion:arrow 🚀 277601695 317711871 0.87
tpch_q07/datafusion:arrow 1143191159 1267829290 0.90
tpch_q08/datafusion:arrow 1130217306 1240444375 0.91
tpch_q09/datafusion:arrow 1334495359 1452482607 0.92
tpch_q10/datafusion:arrow 🚀 589201977 656386975 0.90
tpch_q11/datafusion:arrow 136993202 144481926 0.95
tpch_q12/datafusion:arrow 791375092 832766703 0.95
tpch_q13/datafusion:arrow 494752157 515231700 0.96
tpch_q14/datafusion:arrow 🚀 312783239 353616277 0.88
tpch_q15/datafusion:arrow 🚀 689683137 771843523 0.89
tpch_q16/datafusion:arrow 105112148 109351458 0.96
tpch_q17/datafusion:arrow 1328315014 1442083304 0.92
tpch_q18/datafusion:arrow 🚀 1855491874 2065017810 0.90
tpch_q19/datafusion:arrow 🚀 480998720 538503886 0.89
tpch_q20/datafusion:arrow 482044374 532349340 0.91
tpch_q21/datafusion:arrow 2981069620 3158864400 0.94
tpch_q22/datafusion:arrow 131919743 137637873 0.96
duckdb / vortex-file-compressed (0.932x ➖, 4↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171358045 177873349 0.96
tpch_q02/duckdb:vortex-file-compressed 51725690 54274810 0.95
tpch_q03/duckdb:vortex-file-compressed 126299849 139736788 0.90
tpch_q04/duckdb:vortex-file-compressed 🚀 157274020 175752158 0.89
tpch_q05/duckdb:vortex-file-compressed 🚀 139626907 155599294 0.90
tpch_q06/duckdb:vortex-file-compressed 33807721 33847271 1.00
tpch_q07/duckdb:vortex-file-compressed 🚀 133303416 149638176 0.89
tpch_q08/duckdb:vortex-file-compressed 167096188 183575515 0.91
tpch_q09/duckdb:vortex-file-compressed 381327465 408937252 0.93
tpch_q10/duckdb:vortex-file-compressed 181882612 194684035 0.93
tpch_q11/duckdb:vortex-file-compressed 31259762 33419257 0.94
tpch_q12/duckdb:vortex-file-compressed 98393508 107308700 0.92
tpch_q13/duckdb:vortex-file-compressed 224715265 241795905 0.93
tpch_q14/duckdb:vortex-file-compressed 52345163 57728288 0.91
tpch_q15/duckdb:vortex-file-compressed 90391130 92428602 0.98
tpch_q16/duckdb:vortex-file-compressed 72807919 79253118 0.92
tpch_q17/duckdb:vortex-file-compressed 92897749 99525889 0.93
tpch_q18/duckdb:vortex-file-compressed 279038540 292416954 0.95
tpch_q19/duckdb:vortex-file-compressed 82720910 84604875 0.98
tpch_q20/duckdb:vortex-file-compressed 🚀 139311630 156019660 0.89
tpch_q21/duckdb:vortex-file-compressed 490866312 529020198 0.93
tpch_q22/duckdb:vortex-file-compressed 63094859 64702638 0.98
duckdb / vortex-compact (0.956x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227503805 231232427 0.98
tpch_q02/duckdb:vortex-compact 55235924 58146932 0.95
tpch_q03/duckdb:vortex-compact 139056641 148883152 0.93
tpch_q04/duckdb:vortex-compact 170417589 181064815 0.94
tpch_q05/duckdb:vortex-compact 169608586 177360191 0.96
tpch_q06/duckdb:vortex-compact 54782997 56565627 0.97
tpch_q07/duckdb:vortex-compact 172213549 180396807 0.95
tpch_q08/duckdb:vortex-compact 182768794 194953182 0.94
tpch_q09/duckdb:vortex-compact 412068077 426622877 0.97
tpch_q10/duckdb:vortex-compact 214474324 219219938 0.98
tpch_q11/duckdb:vortex-compact 38276829 38838229 0.99
tpch_q12/duckdb:vortex-compact 161997776 168784442 0.96
tpch_q13/duckdb:vortex-compact 271772315 284237235 0.96
tpch_q14/duckdb:vortex-compact 71398309 76813514 0.93
tpch_q15/duckdb:vortex-compact 112196277 118711699 0.95
tpch_q16/duckdb:vortex-compact 77706968 82410534 0.94
tpch_q17/duckdb:vortex-compact 104612448 113798445 0.92
tpch_q18/duckdb:vortex-compact 286431609 293572141 0.98
tpch_q19/duckdb:vortex-compact 99380687 101113782 0.98
tpch_q20/duckdb:vortex-compact 176589473 186053758 0.95
tpch_q21/duckdb:vortex-compact 514761606 540968814 0.95
tpch_q22/duckdb:vortex-compact 70107882 72576356 0.97
duckdb / parquet (0.953x ➖, 2↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256828069 258443432 0.99
tpch_q02/duckdb:parquet 96917540 102786733 0.94
tpch_q03/duckdb:parquet 206596258 210044865 0.98
tpch_q04/duckdb:parquet 132091315 141064983 0.94
tpch_q05/duckdb:parquet 212724154 226597502 0.94
tpch_q06/duckdb:parquet 68097195 67494911 1.01
tpch_q07/duckdb:parquet 180870520 185391430 0.98
tpch_q08/duckdb:parquet 253364583 274183314 0.92
tpch_q09/duckdb:parquet 485939376 513855384 0.95
tpch_q10/duckdb:parquet 606371052 631970006 0.96
tpch_q11/duckdb:parquet 🚀 54299797 62018271 0.88
tpch_q12/duckdb:parquet 125075336 126753727 0.99
tpch_q13/duckdb:parquet 442385214 457631004 0.97
tpch_q14/duckdb:parquet 173249023 180711206 0.96
tpch_q15/duckdb:parquet 98211965 100908073 0.97
tpch_q16/duckdb:parquet 🚀 135515848 169626915 0.80
tpch_q17/duckdb:parquet 179505528 174667029 1.03
tpch_q18/duckdb:parquet 358054646 367860057 0.97
tpch_q19/duckdb:parquet 287017389 294130378 0.98
tpch_q20/duckdb:parquet 226669345 236764732 0.96
tpch_q21/duckdb:parquet 555344296 610722455 0.91
tpch_q22/duckdb:parquet 287297074 296267341 0.97
duckdb / duckdb (0.974x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117222677 118878991 0.99
tpch_q02/duckdb:duckdb 45987395 46990467 0.98
tpch_q03/duckdb:duckdb 98404306 100477972 0.98
tpch_q04/duckdb:duckdb 132165660 140307331 0.94
tpch_q05/duckdb:duckdb 109450354 113439084 0.96
tpch_q06/duckdb:duckdb 38103959 38041899 1.00
tpch_q07/duckdb:duckdb 86663466 89099654 0.97
tpch_q08/duckdb:duckdb 111784257 114485947 0.98
tpch_q09/duckdb:duckdb 279147242 285443965 0.98
tpch_q10/duckdb:duckdb 203832096 212571294 0.96
tpch_q11/duckdb:duckdb 15618809 16201162 0.96
tpch_q12/duckdb:duckdb 85388619 87118198 0.98
tpch_q13/duckdb:duckdb 221028448 231079836 0.96
tpch_q14/duckdb:duckdb 71116956 72518441 0.98
tpch_q15/duckdb:duckdb 77903166 79412094 0.98
tpch_q16/duckdb:duckdb 72610501 75885151 0.96
tpch_q17/duckdb:duckdb 85284408 86605168 0.98
tpch_q18/duckdb:duckdb 212990966 219046662 0.97
tpch_q19/duckdb:duckdb 115522527 118617424 0.97
tpch_q20/duckdb:duckdb 112586885 113952290 0.99
tpch_q21/duckdb:duckdb 298679793 310792717 0.96
tpch_q22/duckdb:duckdb 68006760 68362539 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -7.4% -2.4% -5.0% +10.0% ➖ noise
1 datafusion:vortex-compact -0.8% -2.4% +1.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -2.7% -2.4% -0.3% +10.0% ➖ noise
1 duckdb:duckdb -1.4% -2.4% +1.1% +10.0% ➖ noise
1 duckdb:vortex-compact -1.6% -2.4% +0.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -3.7% -2.4% -1.2% +10.0% ➖ noise
2 datafusion:arrow -3.8% -5.3% +1.6% +10.0% ➖ noise
2 datafusion:vortex-compact -5.8% -5.3% -0.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -6.2% -5.3% -0.9% +10.0% ➖ noise
2 duckdb:duckdb -2.1% -5.3% +3.3% +10.0% ➖ noise
2 duckdb:vortex-compact -5.0% -5.3% +0.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -4.7% -5.3% +0.6% +10.0% ➖ noise
3 datafusion:arrow -11.8% -3.5% -8.5% +10.0% ➖ noise
3 datafusion:vortex-compact -6.2% -3.5% -2.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -8.3% -3.5% -4.9% +10.0% ➖ noise
3 duckdb:duckdb -2.1% -3.5% +1.5% +10.0% ➖ noise
3 duckdb:vortex-compact -6.6% -3.5% -3.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -9.6% -3.5% -6.3% +10.0% ➖ noise
4 datafusion:arrow -13.0% -5.7% -7.7% +10.0% ➖ noise
4 datafusion:vortex-compact -2.3% -5.7% +3.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.8% -5.7% +1.0% +10.0% ➖ noise
4 duckdb:duckdb -5.8% -5.7% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact -5.9% -5.7% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -10.5% -5.7% -5.1% +10.0% ➖ noise
5 datafusion:arrow -8.2% -7.0% -1.3% +10.0% ➖ noise
5 datafusion:vortex-compact -6.5% -7.0% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.5% -7.0% +1.6% +10.0% ➖ noise
5 duckdb:duckdb -3.5% -7.0% +3.8% +10.0% ➖ noise
5 duckdb:vortex-compact -4.4% -7.0% +2.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -10.3% -7.0% -3.5% +10.0% ➖ noise
6 datafusion:arrow -12.6% -2.4% -10.5% +10.0% ✅ faster
6 datafusion:vortex-compact -2.0% -2.4% +0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.7% -2.4% -4.4% +10.0% ➖ noise
6 duckdb:duckdb +0.2% -2.4% +2.6% +10.7% ➖ noise
6 duckdb:vortex-compact -3.2% -2.4% -0.8% +16.3% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -2.4% +2.3% +13.2% ➖ noise
7 datafusion:arrow -9.8% -4.4% -5.6% +10.0% ➖ noise
7 datafusion:vortex-compact -5.1% -4.4% -0.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.3% -4.4% -2.0% +10.0% ➖ noise
7 duckdb:duckdb -2.7% -4.4% +1.8% +10.0% ➖ noise
7 duckdb:vortex-compact -4.5% -4.4% -0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -10.9% -4.4% -6.8% +10.0% ➖ noise
8 datafusion:arrow -8.9% -6.0% -3.1% +10.0% ➖ noise
8 datafusion:vortex-compact -6.2% -6.0% -0.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.6% -6.0% +0.5% +10.0% ➖ noise
8 duckdb:duckdb -2.4% -6.0% +3.9% +10.0% ➖ noise
8 duckdb:vortex-compact -6.2% -6.0% -0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -9.0% -6.0% -3.1% +10.0% ➖ noise
9 datafusion:arrow -8.1% -6.0% -2.3% +10.0% ➖ noise
9 datafusion:vortex-compact -5.8% -6.0% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -6.7% -6.0% -0.7% +10.0% ➖ noise
9 duckdb:duckdb -2.2% -6.0% +4.0% +10.0% ➖ noise
9 duckdb:vortex-compact -3.4% -6.0% +2.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -6.0% -0.8% +10.0% ➖ noise
10 datafusion:arrow -10.2% -4.6% -5.9% +10.0% ➖ noise
10 datafusion:vortex-compact -4.5% -4.6% +0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.6% -4.6% +0.1% +10.0% ➖ noise
10 duckdb:duckdb -4.1% -4.6% +0.5% +10.0% ➖ noise
10 duckdb:vortex-compact -2.2% -4.6% +2.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.6% -4.6% -2.0% +10.0% ➖ noise
11 datafusion:arrow -5.2% -8.8% +4.0% +10.6% ➖ noise
11 datafusion:vortex-compact -6.0% -8.8% +3.1% +11.8% ➖ noise
11 datafusion:vortex-file-compressed -5.2% -8.8% +3.9% +10.0% ➖ noise
11 duckdb:duckdb -3.6% -8.8% +5.7% +14.1% ➖ noise
11 duckdb:vortex-compact -1.4% -8.8% +8.1% +10.5% ➖ noise
11 duckdb:vortex-file-compressed -6.5% -8.8% +2.6% +15.1% ➖ noise
12 datafusion:arrow -5.0% -1.6% -3.4% +34.9% ➖ noise
12 datafusion:vortex-compact -6.0% -1.6% -4.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -5.4% -1.6% -3.9% +10.0% ➖ noise
12 duckdb:duckdb -2.0% -1.6% -0.4% +10.0% ➖ noise
12 duckdb:vortex-compact -4.0% -1.6% -2.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -8.3% -1.6% -6.8% +10.0% ➖ noise
13 datafusion:arrow -4.0% -3.5% -0.5% +10.0% ➖ noise
13 datafusion:vortex-compact -6.4% -3.5% -3.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -4.1% -3.5% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -4.3% -3.5% -0.9% +10.0% ➖ noise
13 duckdb:vortex-compact -4.4% -3.5% -1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -7.1% -3.5% -3.7% +10.0% ➖ noise
14 datafusion:arrow -11.5% -6.4% -5.5% +10.0% ➖ noise
14 datafusion:vortex-compact -3.3% -6.4% +3.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.7% -6.4% +4.0% +10.0% ➖ noise
14 duckdb:duckdb -1.9% -6.4% +4.8% +10.0% ➖ noise
14 duckdb:vortex-compact -7.0% -6.4% -0.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -9.3% -6.4% -3.1% +10.0% ➖ noise
15 datafusion:arrow -10.6% -2.8% -8.0% +10.0% ➖ noise
15 datafusion:vortex-compact -5.8% -2.8% -3.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.0% -2.8% -1.2% +10.0% ➖ noise
15 duckdb:duckdb -1.9% -2.8% +1.0% +10.0% ➖ noise
15 duckdb:vortex-compact -5.5% -2.8% -2.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.2% -2.8% +0.7% +10.0% ➖ noise
16 datafusion:arrow -3.9% -12.1% +9.3% +10.0% ➖ noise
16 datafusion:vortex-compact -7.6% -12.1% +5.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -6.4% -12.1% +6.4% +10.0% ➖ noise
16 duckdb:duckdb -4.3% -12.1% +8.8% +10.0% ➖ noise
16 duckdb:vortex-compact -5.7% -12.1% +7.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -8.1% -12.1% +4.5% +10.0% ➖ noise
17 datafusion:arrow -7.9% -1.5% -6.5% +10.0% ➖ noise
17 datafusion:vortex-compact -8.3% -1.5% -6.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -5.4% -1.5% -3.9% +10.0% ➖ noise
17 duckdb:duckdb -1.5% -1.5% -0.0% +10.0% ➖ noise
17 duckdb:vortex-compact -8.1% -1.5% -6.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -6.7% -1.5% -5.2% +10.0% ➖ noise
18 datafusion:arrow -10.1% -5.2% -5.2% +10.0% ➖ noise
18 datafusion:vortex-compact -7.2% -5.2% -2.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -6.9% -5.2% -1.9% +10.0% ➖ noise
18 duckdb:duckdb -2.8% -5.2% +2.5% +10.0% ➖ noise
18 duckdb:vortex-compact -2.4% -5.2% +2.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.6% -5.2% +0.6% +10.0% ➖ noise
19 datafusion:arrow -10.7% -2.8% -8.1% +10.0% ➖ noise
19 datafusion:vortex-compact -4.2% -2.8% -1.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.2% -2.8% -0.5% +10.0% ➖ noise
19 duckdb:duckdb -2.6% -2.8% +0.2% +10.0% ➖ noise
19 duckdb:vortex-compact -1.7% -2.8% +1.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.2% -2.8% +0.6% +10.0% ➖ noise
20 datafusion:arrow -9.4% -4.9% -4.7% +10.0% ➖ noise
20 datafusion:vortex-compact -5.0% -4.9% -0.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -3.3% -4.9% +1.8% +10.0% ➖ noise
20 duckdb:duckdb -1.2% -4.9% +3.9% +10.0% ➖ noise
20 duckdb:vortex-compact -5.1% -4.9% -0.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -10.7% -4.9% -6.1% +10.0% ➖ noise
21 datafusion:arrow -5.6% -8.2% +2.8% +10.0% ➖ noise
21 datafusion:vortex-compact -4.5% -8.2% +3.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -5.0% -8.2% +3.5% +10.0% ➖ noise
21 duckdb:duckdb -3.9% -8.2% +4.7% +10.0% ➖ noise
21 duckdb:vortex-compact -4.8% -8.2% +3.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -7.2% -8.2% +1.0% +10.0% ➖ noise
22 datafusion:arrow -4.2% -4.0% -0.2% +10.0% ➖ noise
22 datafusion:vortex-compact -5.7% -4.0% -1.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.5% -4.0% +0.5% +10.0% ➖ noise
22 duckdb:duckdb -0.5% -4.0% +3.6% +10.0% ➖ noise
22 duckdb:vortex-compact -3.4% -4.0% +0.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.5% -4.0% +1.5% +10.0% ➖ noise

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.979x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.1%


duckdb / vortex-file-compressed (0.968x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11618833 12420518 0.94
statpopgen_q01/duckdb:vortex-file-compressed 26095905 26647983 0.98
statpopgen_q02/duckdb:vortex-file-compressed 534814420 548369053 0.98
statpopgen_q03/duckdb:vortex-file-compressed 2254545159 2317243282 0.97
statpopgen_q04/duckdb:vortex-file-compressed 2276651738 2316203258 0.98
statpopgen_q05/duckdb:vortex-file-compressed 482910423 510895067 0.95
statpopgen_q06/duckdb:vortex-file-compressed 1544367436 1575485424 0.98
statpopgen_q07/duckdb:vortex-file-compressed 208080510 223754377 0.93
statpopgen_q08/duckdb:vortex-file-compressed 250218421 249889306 1.00
statpopgen_q09/duckdb:vortex-file-compressed 2068769371 2119802345 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4187561843 4296668825 0.97
duckdb / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11703544 11846732 0.99
statpopgen_q01/duckdb:vortex-compact 212969666 217475754 0.98
statpopgen_q02/duckdb:vortex-compact 563278986 566190731 0.99
statpopgen_q03/duckdb:vortex-compact 2229829194 2282045662 0.98
statpopgen_q04/duckdb:vortex-compact 2294844686 2277204722 1.01
statpopgen_q05/duckdb:vortex-compact 561894060 564210292 1.00
statpopgen_q06/duckdb:vortex-compact 1499189434 1504933807 1.00
statpopgen_q07/duckdb:vortex-compact 885927784 906521409 0.98
statpopgen_q08/duckdb:vortex-compact 918221147 940094584 0.98
statpopgen_q09/duckdb:vortex-compact 2032957986 2021006911 1.01
statpopgen_q10/duckdb:vortex-compact 4229733913 4248378849 1.00
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 327487020 336901874 0.97
statpopgen_q01/duckdb:parquet 404538662 419367054 0.96
statpopgen_q02/duckdb:parquet 993298327 1013479223 0.98
statpopgen_q03/duckdb:parquet 1510173721 1493688881 1.01
statpopgen_q04/duckdb:parquet 1511401660 1558178789 0.97
statpopgen_q05/duckdb:parquet 1019264373 1036194679 0.98
statpopgen_q06/duckdb:parquet 1506865775 1515721276 0.99
statpopgen_q07/duckdb:parquet 1316664445 1305220262 1.01
statpopgen_q08/duckdb:parquet 1309503721 1310820850 1.00
statpopgen_q09/duckdb:parquet 1391541225 1405046133 0.99
statpopgen_q10/duckdb:parquet 2681436132 2682175942 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.2% -2.8% +1.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -6.5% -2.8% -3.8% +10.0% ➖ noise
1 duckdb:vortex-compact -2.1% -3.5% +1.5% +13.5% ➖ noise
1 duckdb:vortex-file-compressed -2.1% -3.5% +1.5% +222.9% ➖ noise
2 duckdb:vortex-compact -0.5% -2.0% +1.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.5% -2.0% -0.5% +10.0% ➖ noise
3 duckdb:vortex-compact -2.3% +1.1% -3.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.7% +1.1% -3.8% +10.0% ➖ noise
4 duckdb:vortex-compact +0.8% -3.0% +3.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.7% -3.0% +1.3% +10.0% ➖ noise
5 duckdb:vortex-compact -0.4% -1.6% +1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.5% -1.6% -3.9% +10.0% ➖ noise
6 duckdb:vortex-compact -0.4% -0.6% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.0% -0.6% -1.4% +10.0% ➖ noise
7 duckdb:vortex-compact -2.3% +0.9% -3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -7.0% +0.9% -7.8% +10.0% ➖ noise
8 duckdb:vortex-compact -2.3% -0.1% -2.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% -0.1% +0.2% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% -1.0% +1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.4% -1.0% -1.5% +10.0% ➖ noise
10 duckdb:vortex-compact -0.4% -0.0% -0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.5% -0.0% -2.5% +10.0% ➖ noise

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.2%


datafusion / vortex-file-compressed (1.006x ➖, 1↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1661763 1670229 0.99
clickbench_q01/datafusion:vortex-file-compressed 18478572 18148604 1.02
clickbench_q02/datafusion:vortex-file-compressed 36832933 36515297 1.01
clickbench_q03/datafusion:vortex-file-compressed 44211082 43874026 1.01
clickbench_q04/datafusion:vortex-file-compressed 286886966 288020253 1.00
clickbench_q05/datafusion:vortex-file-compressed 305252417 303634000 1.01
clickbench_q06/datafusion:vortex-file-compressed 🚨 1901605 1623924 1.17
clickbench_q07/datafusion:vortex-file-compressed 22738581 22084817 1.03
clickbench_q08/datafusion:vortex-file-compressed 350676414 346505496 1.01
clickbench_q09/datafusion:vortex-file-compressed 563101171 550578447 1.02
clickbench_q10/datafusion:vortex-file-compressed 74100641 72456749 1.02
clickbench_q11/datafusion:vortex-file-compressed 85357722 85980992 0.99
clickbench_q12/datafusion:vortex-file-compressed 266386839 269460789 0.99
clickbench_q13/datafusion:vortex-file-compressed 404127238 412772778 0.98
clickbench_q14/datafusion:vortex-file-compressed 253725309 259683082 0.98
clickbench_q15/datafusion:vortex-file-compressed 328514098 322862101 1.02
clickbench_q16/datafusion:vortex-file-compressed 640300878 632393936 1.01
clickbench_q17/datafusion:vortex-file-compressed 639804535 633871851 1.01
clickbench_q18/datafusion:vortex-file-compressed 1288659623 1281072588 1.01
clickbench_q19/datafusion:vortex-file-compressed 33919237 33309004 1.02
clickbench_q20/datafusion:vortex-file-compressed 345868003 344967113 1.00
clickbench_q21/datafusion:vortex-file-compressed 374449739 372396690 1.01
clickbench_q22/datafusion:vortex-file-compressed 443181460 448022127 0.99
clickbench_q23/datafusion:vortex-file-compressed 639310186 637126276 1.00
clickbench_q24/datafusion:vortex-file-compressed 45556459 46045171 0.99
clickbench_q25/datafusion:vortex-file-compressed 70243592 70869607 0.99
clickbench_q26/datafusion:vortex-file-compressed 45139931 46226925 0.98
clickbench_q27/datafusion:vortex-file-compressed 719362543 720383327 1.00
clickbench_q28/datafusion:vortex-file-compressed 6687730483 6527475161 1.02
clickbench_q29/datafusion:vortex-file-compressed 227508958 229251565 0.99
clickbench_q30/datafusion:vortex-file-compressed 217863258 219187371 0.99
clickbench_q31/datafusion:vortex-file-compressed 252691107 253203509 1.00
clickbench_q32/datafusion:vortex-file-compressed 🚀 1109151487 1264455179 0.88
clickbench_q33/datafusion:vortex-file-compressed 1296481735 1294491573 1.00
clickbench_q34/datafusion:vortex-file-compressed 1281294951 1277125913 1.00
clickbench_q35/datafusion:vortex-file-compressed 449679356 451777239 1.00
clickbench_q36/datafusion:vortex-file-compressed 70136548 67001915 1.05
clickbench_q37/datafusion:vortex-file-compressed 34174135 34149990 1.00
clickbench_q38/datafusion:vortex-file-compressed 18836119 18111222 1.04
clickbench_q39/datafusion:vortex-file-compressed 130420564 131629866 0.99
clickbench_q40/datafusion:vortex-file-compressed 16086218 15628281 1.03
clickbench_q41/datafusion:vortex-file-compressed 14624332 14310880 1.02
clickbench_q42/datafusion:vortex-file-compressed 16909171 16291927 1.04
datafusion / parquet (1.013x ➖, 0↑ 2↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1727555 1552051 1.11
clickbench_q01/datafusion:parquet 18715609 20457969 0.91
clickbench_q02/datafusion:parquet 46587042 46340795 1.01
clickbench_q03/datafusion:parquet 38232116 39334048 0.97
clickbench_q04/datafusion:parquet 297423059 298686814 1.00
clickbench_q05/datafusion:parquet 341510694 335698339 1.02
clickbench_q06/datafusion:parquet 1543284 1584546 0.97
clickbench_q07/datafusion:parquet 22534790 21985587 1.02
clickbench_q08/datafusion:parquet 367559899 363049813 1.01
clickbench_q09/datafusion:parquet 595526420 593553975 1.00
clickbench_q10/datafusion:parquet 103750298 103783593 1.00
clickbench_q11/datafusion:parquet 124974595 125441057 1.00
clickbench_q12/datafusion:parquet 338440486 341517460 0.99
clickbench_q13/datafusion:parquet 489269693 483518921 1.01
clickbench_q14/datafusion:parquet 342415838 333343611 1.03
clickbench_q15/datafusion:parquet 335476739 334141675 1.00
clickbench_q16/datafusion:parquet 678096267 651921160 1.04
clickbench_q17/datafusion:parquet 651180527 643545828 1.01
clickbench_q18/datafusion:parquet 1354404585 1308008924 1.04
clickbench_q19/datafusion:parquet 🚨 35178389 30092237 1.17
clickbench_q20/datafusion:parquet 599395542 605245977 0.99
clickbench_q21/datafusion:parquet 667181797 644310769 1.04
clickbench_q22/datafusion:parquet 978756125 964226329 1.02
clickbench_q23/datafusion:parquet 3636837206 3664748932 0.99
clickbench_q24/datafusion:parquet 83860779 82502781 1.02
clickbench_q25/datafusion:parquet 133240827 128570090 1.04
clickbench_q26/datafusion:parquet 83515129 81964828 1.02
clickbench_q27/datafusion:parquet 1044972136 1053520268 0.99
clickbench_q28/datafusion:parquet 6574844802 6429336087 1.02
clickbench_q29/datafusion:parquet 242244746 240960247 1.01
clickbench_q30/datafusion:parquet 321374399 322940875 1.00
clickbench_q31/datafusion:parquet 368544127 358719726 1.03
clickbench_q32/datafusion:parquet 1214106540 1203084807 1.01
clickbench_q33/datafusion:parquet 1495865752 1483375333 1.01
clickbench_q34/datafusion:parquet 1473425070 1436410557 1.03
clickbench_q35/datafusion:parquet 458470796 447715308 1.02
clickbench_q36/datafusion:parquet 136946181 132807274 1.03
clickbench_q37/datafusion:parquet 55224730 56841592 0.97
clickbench_q38/datafusion:parquet 83516154 85476182 0.98
clickbench_q39/datafusion:parquet 258516208 248844225 1.04
clickbench_q40/datafusion:parquet 30536287 29465935 1.04
clickbench_q41/datafusion:parquet 26803218 27112397 0.99
clickbench_q42/datafusion:parquet 29133445 29097653 1.00
duckdb / vortex-file-compressed (0.983x ➖, 4↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6304816 6734014 0.94
clickbench_q01/duckdb:vortex-file-compressed 11938873 12046108 0.99
clickbench_q02/duckdb:vortex-file-compressed 25708899 27144793 0.95
clickbench_q03/duckdb:vortex-file-compressed 30123745 31807520 0.95
clickbench_q04/duckdb:vortex-file-compressed 186697959 185331134 1.01
clickbench_q05/duckdb:vortex-file-compressed 175122396 173838469 1.01
clickbench_q06/duckdb:vortex-file-compressed 19667198 19469827 1.01
clickbench_q07/duckdb:vortex-file-compressed 13971812 14849715 0.94
clickbench_q08/duckdb:vortex-file-compressed 263582728 256305241 1.03
clickbench_q09/duckdb:vortex-file-compressed 339020453 334550910 1.01
clickbench_q10/duckdb:vortex-file-compressed 66535687 68241344 0.98
clickbench_q11/duckdb:vortex-file-compressed 75551063 76353443 0.99
clickbench_q12/duckdb:vortex-file-compressed 193010233 202902300 0.95
clickbench_q13/duckdb:vortex-file-compressed 402747498 409806084 0.98
clickbench_q14/duckdb:vortex-file-compressed 234518639 229218761 1.02
clickbench_q15/duckdb:vortex-file-compressed 238863048 243088827 0.98
clickbench_q16/duckdb:vortex-file-compressed 579712223 574820700 1.01
clickbench_q17/duckdb:vortex-file-compressed 464225385 443270801 1.05
clickbench_q18/duckdb:vortex-file-compressed 967125758 956656513 1.01
clickbench_q19/duckdb:vortex-file-compressed 21038559 20639189 1.02
clickbench_q20/duckdb:vortex-file-compressed 328296649 329209124 1.00
clickbench_q21/duckdb:vortex-file-compressed 354632428 364555782 0.97
clickbench_q22/duckdb:vortex-file-compressed 605960931 610400240 0.99
clickbench_q23/duckdb:vortex-file-compressed 177790911 196447210 0.91
clickbench_q24/duckdb:vortex-file-compressed 35692757 32567045 1.10
clickbench_q25/duckdb:vortex-file-compressed 68777270 67020025 1.03
clickbench_q26/duckdb:vortex-file-compressed 🚨 41720245 36791033 1.13
clickbench_q27/duckdb:vortex-file-compressed 475542692 471778583 1.01
clickbench_q28/duckdb:vortex-file-compressed 2955492340 2965703509 1.00
clickbench_q29/duckdb:vortex-file-compressed 28292766 28437011 0.99
clickbench_q30/duckdb:vortex-file-compressed 190732516 190600767 1.00
clickbench_q31/duckdb:vortex-file-compressed 282914813 283797576 1.00
clickbench_q32/duckdb:vortex-file-compressed 1249096804 1191001554 1.05
clickbench_q33/duckdb:vortex-file-compressed 1213464624 1152422790 1.05
clickbench_q34/duckdb:vortex-file-compressed 1248159177 1237224682 1.01
clickbench_q35/duckdb:vortex-file-compressed 378018338 387489567 0.98
clickbench_q36/duckdb:vortex-file-compressed 22866562 24718943 0.93
clickbench_q37/duckdb:vortex-file-compressed 🚀 16301201 18663609 0.87
clickbench_q38/duckdb:vortex-file-compressed 🚀 17893985 20642110 0.87
clickbench_q39/duckdb:vortex-file-compressed 35678457 36701585 0.97
clickbench_q40/duckdb:vortex-file-compressed 16651126 18024574 0.92
clickbench_q41/duckdb:vortex-file-compressed 🚀 16063520 17851596 0.90
clickbench_q42/duckdb:vortex-file-compressed 🚀 16759806 20131172 0.83
duckdb / parquet (1.000x ➖, 0↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24582961 26997527 0.91
clickbench_q01/duckdb:parquet 27847987 27351863 1.02
clickbench_q02/duckdb:parquet 48071230 48788864 0.99
clickbench_q03/duckdb:parquet 38504878 39316322 0.98
clickbench_q04/duckdb:parquet 202317915 205022638 0.99
clickbench_q05/duckdb:parquet 268066462 270908685 0.99
clickbench_q06/duckdb:parquet 46158423 45633922 1.01
clickbench_q07/duckdb:parquet 29461230 29187184 1.01
clickbench_q08/duckdb:parquet 269042091 265418899 1.01
clickbench_q09/duckdb:parquet 399962398 399848459 1.00
clickbench_q10/duckdb:parquet 80473329 80744583 1.00
clickbench_q11/duckdb:parquet 99658178 98918372 1.01
clickbench_q12/duckdb:parquet 292845646 289576295 1.01
clickbench_q13/duckdb:parquet 489105133 474886879 1.03
clickbench_q14/duckdb:parquet 335271638 323223126 1.04
clickbench_q15/duckdb:parquet 259333919 258056746 1.00
clickbench_q16/duckdb:parquet 638742785 644485791 0.99
clickbench_q17/duckdb:parquet 536361379 530907356 1.01
clickbench_q18/duckdb:parquet 1087399366 1069373580 1.02
clickbench_q19/duckdb:parquet 26025963 26105349 1.00
clickbench_q20/duckdb:parquet 417721232 433337756 0.96
clickbench_q21/duckdb:parquet 554066201 540819474 1.02
clickbench_q22/duckdb:parquet 926178813 932211693 0.99
clickbench_q23/duckdb:parquet 310399838 314626785 0.99
clickbench_q24/duckdb:parquet 68408685 67663307 1.01
clickbench_q25/duckdb:parquet 155783502 156339689 1.00
clickbench_q26/duckdb:parquet 49941971 51534404 0.97
clickbench_q27/duckdb:parquet 648424816 642999613 1.01
clickbench_q28/duckdb:parquet 4797885897 4788542055 1.00
clickbench_q29/duckdb:parquet 40973733 41650281 0.98
clickbench_q30/duckdb:parquet 300415747 303860297 0.99
clickbench_q31/duckdb:parquet 364181445 364848448 1.00
clickbench_q32/duckdb:parquet 1179739075 1160340987 1.02
clickbench_q33/duckdb:parquet 1261936355 1309637526 0.96
clickbench_q34/duckdb:parquet 1306435878 1374139619 0.95
clickbench_q35/duckdb:parquet 365234514 366413605 1.00
clickbench_q36/duckdb:parquet 45716850 44766248 1.02
clickbench_q37/duckdb:parquet 31987630 32225754 0.99
clickbench_q38/duckdb:parquet 35082801 33093759 1.06
clickbench_q39/duckdb:parquet 79736286 79323513 1.01
clickbench_q40/duckdb:parquet 🚨 19233197 17274289 1.11
clickbench_q41/duckdb:parquet 17297914 18513196 0.93
clickbench_q42/duckdb:parquet 21938453 20899534 1.05
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18377560 18814178 0.98
clickbench_q01/duckdb:duckdb 34961502 33891793 1.03
clickbench_q02/duckdb:duckdb 47110593 45936752 1.03
clickbench_q03/duckdb:duckdb 49217234 47994692 1.03
clickbench_q04/duckdb:duckdb 194018225 189123432 1.03
clickbench_q05/duckdb:duckdb 266596723 264998327 1.01
clickbench_q06/duckdb:duckdb 37429858 36834353 1.02
clickbench_q07/duckdb:duckdb 37115286 36384326 1.02
clickbench_q08/duckdb:duckdb 253876053 255511574 0.99
clickbench_q09/duckdb:duckdb 369966307 372046659 0.99
clickbench_q10/duckdb:duckdb 99053087 100275840 0.99
clickbench_q11/duckdb:duckdb 107532599 107891625 1.00
clickbench_q12/duckdb:duckdb 240233143 239981794 1.00
clickbench_q13/duckdb:duckdb 456475238 464403836 0.98
clickbench_q14/duckdb:duckdb 277471584 275126057 1.01
clickbench_q15/duckdb:duckdb 222543278 220568186 1.01
clickbench_q16/duckdb:duckdb 631108474 640882126 0.98
clickbench_q17/duckdb:duckdb 545220916 536271437 1.02
clickbench_q18/duckdb:duckdb 1234891401 1210871149 1.02
clickbench_q19/duckdb:duckdb 36005077 35385393 1.02
clickbench_q20/duckdb:duckdb 901775305 861598773 1.05
clickbench_q21/duckdb:duckdb 898809951 923636271 0.97
clickbench_q22/duckdb:duckdb 1091980756 1091986519 1.00
clickbench_q23/duckdb:duckdb 253886777 251098248 1.01
clickbench_q24/duckdb:duckdb 63195916 63510898 1.00
clickbench_q25/duckdb:duckdb 144988862 143708179 1.01
clickbench_q26/duckdb:duckdb 61300013 61625036 0.99
clickbench_q27/duckdb:duckdb 926481540 939498881 0.99
clickbench_q28/duckdb:duckdb 4703056693 4694276217 1.00
clickbench_q29/duckdb:duckdb 50396214 49706104 1.01
clickbench_q30/duckdb:duckdb 262424507 262155490 1.00
clickbench_q31/duckdb:duckdb 416032034 399554660 1.04
clickbench_q32/duckdb:duckdb 1464389849 1544744884 0.95
clickbench_q33/duckdb:duckdb 2002892448 2081767944 0.96
clickbench_q34/duckdb:duckdb 2232355714 2215228016 1.01
clickbench_q35/duckdb:duckdb 288050644 284024560 1.01
clickbench_q36/duckdb:duckdb 44515480 44879701 0.99
clickbench_q37/duckdb:duckdb 32672694 33220484 0.98
clickbench_q38/duckdb:duckdb 32450982 32877387 0.99
clickbench_q39/duckdb:duckdb 70125781 67232531 1.04
clickbench_q40/duckdb:duckdb 33488107 33713196 0.99
clickbench_q41/duckdb:duckdb 31436868 31593052 1.00
clickbench_q42/duckdb:duckdb 33566075 33424504 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.5% +0.7% -1.2% +745.9% ➖ noise
0 duckdb:duckdb -2.3% +0.7% -3.0% +288.9% ➖ noise
0 duckdb:vortex-file-compressed -6.4% +0.7% -7.0% +463.8% ➖ noise
1 datafusion:vortex-file-compressed +1.8% -3.5% +5.5% +22.6% ➖ noise
1 duckdb:duckdb +3.2% -3.5% +6.9% +61.4% ➖ noise
1 duckdb:vortex-file-compressed -0.9% -3.5% +2.7% +23.2% ➖ noise
2 datafusion:vortex-file-compressed +0.9% -0.5% +1.4% +14.3% ➖ noise
2 duckdb:duckdb +2.6% -0.5% +3.0% +21.7% ➖ noise
2 duckdb:vortex-file-compressed -5.3% -0.5% -4.8% +10.1% ➖ noise
3 datafusion:vortex-file-compressed +0.8% -2.4% +3.3% +142.0% ➖ noise
3 duckdb:duckdb +2.5% -2.4% +5.1% +45.3% ➖ noise
3 duckdb:vortex-file-compressed -5.3% -2.4% -2.9% +55.6% ➖ noise
4 datafusion:vortex-file-compressed -0.4% -0.9% +0.5% +10.0% ➖ noise
4 duckdb:duckdb +2.6% -0.9% +3.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.7% -0.9% +1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% +0.3% +0.2% +10.0% ➖ noise
5 duckdb:duckdb +0.6% +0.3% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.7% +0.3% +0.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +17.1% -0.7% +18.0% +70.5% ➖ noise
6 duckdb:duckdb +1.6% -0.7% +2.4% +64.5% ➖ noise
6 duckdb:vortex-file-compressed +1.0% -0.7% +1.8% +57.8% ➖ noise
7 datafusion:vortex-file-compressed +3.0% +1.7% +1.2% +10.0% ➖ noise
7 duckdb:duckdb +2.0% +1.7% +0.3% +11.7% ➖ noise
7 duckdb:vortex-file-compressed -5.9% +1.7% -7.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.2% +1.3% -0.1% +10.0% ➖ noise
8 duckdb:duckdb -0.6% +1.3% -1.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.8% +1.3% +1.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.3% +0.2% +2.1% +10.0% ➖ noise
9 duckdb:duckdb -0.6% +0.2% -0.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.3% +0.2% +1.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.3% -0.2% +2.5% +10.0% ➖ noise
10 duckdb:duckdb -1.2% -0.2% -1.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.5% -0.2% -2.3% +12.0% ➖ noise
11 datafusion:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
11 duckdb:duckdb -0.3% +0.2% -0.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.1% +0.2% -1.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.1% +0.1% -1.2% +10.0% ➖ noise
12 duckdb:duckdb +0.1% +0.1% -0.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -4.9% +0.1% -5.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.1% +2.1% -4.1% +10.0% ➖ noise
13 duckdb:duckdb -1.7% +2.1% -3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.7% +2.1% -3.7% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.3% +3.2% -5.3% +10.0% ➖ noise
14 duckdb:duckdb +0.9% +3.2% -2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.3% +3.2% -0.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.8% +0.4% +1.3% +10.0% ➖ noise
15 duckdb:duckdb +0.9% +0.4% +0.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.7% +0.4% -2.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% +1.5% -0.3% +10.0% ➖ noise
16 duckdb:duckdb -1.5% +1.5% -3.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.9% +1.5% -0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.9% +1.1% -0.2% +10.0% ➖ noise
17 duckdb:duckdb +1.7% +1.1% +0.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +4.7% +1.1% +3.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.6% +2.6% -2.0% +10.0% ➖ noise
18 duckdb:duckdb +2.0% +2.6% -0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.1% +2.6% -1.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.8% +8.0% -5.7% +24.3% ➖ noise
19 duckdb:duckdb +1.8% +8.0% -5.7% +19.7% ➖ noise
19 duckdb:vortex-file-compressed +1.9% +8.0% -5.6% +20.8% ➖ noise
20 datafusion:vortex-file-compressed +0.3% -2.3% +2.6% +205.4% ➖ noise
20 duckdb:duckdb +4.7% -2.3% +7.1% +34.8% ➖ noise
20 duckdb:vortex-file-compressed -0.3% -2.3% +2.1% +60.8% ➖ noise
21 datafusion:vortex-file-compressed +0.6% +3.0% -2.4% +10.0% ➖ noise
21 duckdb:duckdb -2.7% +3.0% -5.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -2.7% +3.0% -5.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.1% +0.4% -1.5% +14.9% ➖ noise
22 duckdb:duckdb -0.0% +0.4% -0.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +0.4% -1.1% +24.5% ➖ noise
23 datafusion:vortex-file-compressed +0.3% -1.1% +1.4% +50.2% ➖ noise
23 duckdb:duckdb +1.1% -1.1% +2.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -9.5% -1.1% -8.5% +27.5% ➖ noise
24 datafusion:vortex-file-compressed -1.1% +1.4% -2.4% +12.5% ➖ noise
24 duckdb:duckdb -0.5% +1.4% -1.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +9.6% +1.4% +8.1% +10.9% ➖ noise
25 datafusion:vortex-file-compressed -0.9% +1.6% -2.5% +10.0% ➖ noise
25 duckdb:duckdb +0.9% +1.6% -0.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.6% +1.6% +1.0% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -2.4% -0.6% -1.7% +10.0% ➖ noise
26 duckdb:duckdb -0.5% -0.6% +0.1% +12.2% ➖ noise
26 duckdb:vortex-file-compressed +13.4% -0.6% +14.1% +23.0% ➖ noise
27 datafusion:vortex-file-compressed -0.1% +0.0% -0.2% +10.0% ➖ noise
27 duckdb:duckdb -1.4% +0.0% -1.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.8% +0.0% +0.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.5% +1.2% +1.2% +10.0% ➖ noise
28 duckdb:duckdb +0.2% +1.2% -1.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.3% +1.2% -1.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.0% ➖ noise
29 duckdb:duckdb +1.4% -0.6% +2.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.5% -0.6% +0.0% +16.7% ➖ noise
30 datafusion:vortex-file-compressed -0.6% -0.8% +0.2% +10.0% ➖ noise
30 duckdb:duckdb +0.1% -0.8% +0.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.1% -0.8% +0.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.2% +1.3% -1.5% +10.0% ➖ noise
31 duckdb:duckdb +4.1% +1.3% +2.8% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.3% +1.3% -1.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -12.3% +1.3% -13.4% +12.8% ✅ faster
32 duckdb:duckdb -5.2% +1.3% -6.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +4.9% +1.3% +3.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.2% -1.4% +1.6% +10.0% ➖ noise
33 duckdb:duckdb -3.8% -1.4% -2.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +5.3% -1.4% +6.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.3% -1.2% +1.6% +10.0% ➖ noise
34 duckdb:duckdb +0.8% -1.2% +2.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.9% -1.2% +2.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.5% +1.0% -1.5% +10.0% ➖ noise
35 duckdb:duckdb +1.4% +1.0% +0.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.4% +1.0% -3.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +4.7% +2.6% +2.0% +10.0% ➖ noise
36 duckdb:duckdb -0.8% +2.6% -3.3% +13.7% ➖ noise
36 duckdb:vortex-file-compressed -7.5% +2.6% -9.9% +12.7% ➖ noise
37 datafusion:vortex-file-compressed +0.1% -1.8% +1.9% +10.0% ➖ noise
37 duckdb:duckdb -1.6% -1.8% +0.2% +11.2% ➖ noise
37 duckdb:vortex-file-compressed -12.7% -1.8% -11.1% +11.5% ✅ faster
38 datafusion:vortex-file-compressed +4.0% +1.8% +2.2% +10.6% ➖ noise
38 duckdb:duckdb -1.3% +1.8% -3.0% +11.2% ➖ noise
38 duckdb:vortex-file-compressed -13.3% +1.8% -14.8% +11.9% ✅ faster
39 datafusion:vortex-file-compressed -0.9% +2.2% -3.0% +10.0% ➖ noise
39 duckdb:duckdb +4.3% +2.2% +2.1% +12.7% ➖ noise
39 duckdb:vortex-file-compressed -2.8% +2.2% -4.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.9% +7.4% -4.2% +10.9% ➖ noise
40 duckdb:duckdb -0.7% +7.4% -7.5% +11.8% ➖ noise
40 duckdb:vortex-file-compressed -7.6% +7.4% -14.0% +11.7% ✅ faster
41 datafusion:vortex-file-compressed +2.2% -3.9% +6.3% +10.1% ➖ noise
41 duckdb:duckdb -0.5% -3.9% +3.5% +11.6% ➖ noise
41 duckdb:vortex-file-compressed -10.0% -3.9% -6.4% +15.1% ➖ noise
42 datafusion:vortex-file-compressed +3.8% +2.5% +1.2% +10.0% ➖ noise
42 duckdb:duckdb +0.4% +2.5% -2.0% +11.8% ➖ noise
42 duckdb:vortex-file-compressed -16.7% +2.5% -18.8% +14.1% ✅ faster

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.0%
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.022x ➖
Shifts: Parquet (control) +2.2% · Median polish +1.5%


datafusion / vortex-file-compressed (1.103x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 44421696 34345192 1.29
fineweb_q01/datafusion:vortex-file-compressed 611061348 491004918 1.24
fineweb_q02/datafusion:vortex-file-compressed 527994817 406583538 1.30
fineweb_q03/datafusion:vortex-file-compressed 1419669377 1395064977 1.02
fineweb_q04/datafusion:vortex-file-compressed 1427586481 1351653940 1.06
fineweb_q05/datafusion:vortex-file-compressed 1389073710 1342364347 1.03
fineweb_q06/datafusion:vortex-file-compressed 1543434083 1589555947 0.97
fineweb_q07/datafusion:vortex-file-compressed 1360590466 1329067084 1.02
fineweb_q08/datafusion:vortex-file-compressed 522905809 501434755 1.04
datafusion / vortex-compact (0.956x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36113985 35326046 1.02
fineweb_q01/datafusion:vortex-compact 502558953 508599505 0.99
fineweb_q02/datafusion:vortex-compact 537297651 629100702 0.85
fineweb_q03/datafusion:vortex-compact 1328179077 1313488096 1.01
fineweb_q04/datafusion:vortex-compact 1587671361 1595496571 1.00
fineweb_q05/datafusion:vortex-compact 1373498963 1396005720 0.98
fineweb_q06/datafusion:vortex-compact 1285441621 1336398146 0.96
fineweb_q07/datafusion:vortex-compact 1074715505 1169960441 0.92
fineweb_q08/datafusion:vortex-compact 373516517 423226503 0.88
datafusion / parquet (1.033x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1134611493 1064567569 1.07
fineweb_q01/datafusion:parquet 1747676022 1786581091 0.98
fineweb_q02/datafusion:parquet 1774235342 2001665495 0.89
fineweb_q03/datafusion:parquet 1858325892 1722962043 1.08
fineweb_q04/datafusion:parquet 1855342272 1821538707 1.02
fineweb_q05/datafusion:parquet 2131546246 1952837921 1.09
fineweb_q06/datafusion:parquet 1950884429 1866613781 1.05
fineweb_q07/datafusion:parquet 2136297643 1847091896 1.16
fineweb_q08/datafusion:parquet 1841330009 1837373208 1.00
duckdb / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 91867288 75236313 1.22
fineweb_q01/duckdb:vortex-file-compressed 595965722 550224969 1.08
fineweb_q02/duckdb:vortex-file-compressed 430451750 488726705 0.88
fineweb_q03/duckdb:vortex-file-compressed 1499683874 1465315301 1.02
fineweb_q04/duckdb:vortex-file-compressed 1691821428 1550081455 1.09
fineweb_q05/duckdb:vortex-file-compressed 1448492221 1549014353 0.94
fineweb_q06/duckdb:vortex-file-compressed 1692660934 1668468131 1.01
fineweb_q07/duckdb:vortex-file-compressed 1423957208 1428171049 1.00
fineweb_q08/duckdb:vortex-file-compressed 586595513 630952862 0.93
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 63685592 74911451 0.85
fineweb_q01/duckdb:vortex-compact 528958325 573991206 0.92
fineweb_q02/duckdb:vortex-compact 596055558 603402463 0.99
fineweb_q03/duckdb:vortex-compact 1680520158 1742848389 0.96
fineweb_q04/duckdb:vortex-compact 1811318172 1727667234 1.05
fineweb_q05/duckdb:vortex-compact 1547047757 1506741058 1.03
fineweb_q06/duckdb:vortex-compact 1465879111 1480393744 0.99
fineweb_q07/duckdb:vortex-compact 1421681975 1354773482 1.05
fineweb_q08/duckdb:vortex-compact 494199546 496445987 1.00
duckdb / parquet (1.011x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1174311008 1056583222 1.11
fineweb_q01/duckdb:parquet 1364743937 1394456378 0.98
fineweb_q02/duckdb:parquet 1478674620 1398856792 1.06
fineweb_q03/duckdb:parquet 3983049255 3715427805 1.07
fineweb_q04/duckdb:parquet 1951937973 1956585366 1.00
fineweb_q05/duckdb:parquet 2050315833 2141821896 0.96
fineweb_q06/duckdb:parquet 4293369048 4366394731 0.98
fineweb_q07/duckdb:parquet 2757324037 2659261746 1.04
fineweb_q08/duckdb:parquet 1087777053 1183701332 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +2.2% +8.8% -6.1% +171.8% ➖ noise
0 datafusion:vortex-file-compressed +29.3% +8.8% +18.8% +142.3% ➖ noise
0 duckdb:vortex-compact -15.0% +8.8% -21.9% +83.1% ➖ noise
0 duckdb:vortex-file-compressed +22.1% +8.8% +12.2% +35.8% ➖ noise
1 datafusion:vortex-compact -1.2% -2.2% +1.0% +78.1% ➖ noise
1 datafusion:vortex-file-compressed +24.5% -2.2% +27.2% +89.3% ➖ noise
1 duckdb:vortex-compact -7.8% -2.2% -5.8% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +8.3% -2.2% +10.7% +30.0% ➖ noise
2 datafusion:vortex-compact -14.6% -3.2% -11.8% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +29.9% -3.2% +34.2% +43.3% ➖ noise
2 duckdb:vortex-compact -1.2% -3.2% +2.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -11.9% -3.2% -9.0% +30.0% ➖ noise
3 datafusion:vortex-compact +1.1% +7.5% -6.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +1.8% +7.5% -5.4% +30.0% ➖ noise
3 duckdb:vortex-compact -3.6% +7.5% -10.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +2.3% +7.5% -4.8% +30.0% ➖ noise
4 datafusion:vortex-compact -0.5% +0.8% -1.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +5.6% +0.8% +4.8% +30.0% ➖ noise
4 duckdb:vortex-compact +4.8% +0.8% +4.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +9.1% +0.8% +8.3% +30.0% ➖ noise
5 datafusion:vortex-compact -1.6% +2.2% -3.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +3.5% +2.2% +1.2% +30.0% ➖ noise
5 duckdb:vortex-compact +2.7% +2.2% +0.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.5% +2.2% -8.5% +30.0% ➖ noise
6 datafusion:vortex-compact -3.8% +1.4% -5.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.9% +1.4% -4.2% +30.0% ➖ noise
6 duckdb:vortex-compact -1.0% +1.4% -2.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.5% +1.4% +0.1% +30.0% ➖ noise
7 datafusion:vortex-compact -8.1% +9.5% -16.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +2.4% +9.5% -6.5% +30.0% ➖ noise
7 duckdb:vortex-compact +4.9% +9.5% -4.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% +9.5% -9.0% +30.0% ➖ noise
8 datafusion:vortex-compact -11.7% -4.0% -8.0% +57.3% ➖ noise
8 datafusion:vortex-file-compressed +4.3% -4.0% +8.7% +30.0% ➖ noise
8 duckdb:vortex-compact -0.5% -4.0% +3.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -7.0% -4.0% -3.1% +30.0% ➖ noise

@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.8%
Vortex (geomean): 1.020x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%


datafusion / vortex-file-compressed (1.057x ➖, 0↑ 5↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 257818068 260808180 0.99
tpch_q02/datafusion:vortex-file-compressed 411303531 510239932 0.81
tpch_q03/datafusion:vortex-file-compressed 439815065 454546347 0.97
tpch_q04/datafusion:vortex-file-compressed 226732546 279449759 0.81
tpch_q05/datafusion:vortex-file-compressed 414836451 471023450 0.88
tpch_q06/datafusion:vortex-file-compressed 291894745 354040952 0.82
tpch_q07/datafusion:vortex-file-compressed 399258787 482635760 0.83
tpch_q08/datafusion:vortex-file-compressed 750116608 639751049 1.17
tpch_q09/datafusion:vortex-file-compressed 419773897 413496888 1.02
tpch_q10/datafusion:vortex-file-compressed 463599570 494706387 0.94
tpch_q11/datafusion:vortex-file-compressed 330464682 380257020 0.87
tpch_q12/datafusion:vortex-file-compressed 448656851 440439196 1.02
tpch_q13/datafusion:vortex-file-compressed 🚨 265549449 147772275 1.80
tpch_q14/datafusion:vortex-file-compressed 214409702 243199857 0.88
tpch_q15/datafusion:vortex-file-compressed 🚨 544455310 403202597 1.35
tpch_q16/datafusion:vortex-file-compressed 215595361 191617983 1.13
tpch_q17/datafusion:vortex-file-compressed 457843691 377239459 1.21
tpch_q18/datafusion:vortex-file-compressed 🚨 446536516 329529556 1.36
tpch_q19/datafusion:vortex-file-compressed 🚨 598320486 458522577 1.30
tpch_q20/datafusion:vortex-file-compressed 🚨 536126530 381124166 1.41
tpch_q21/datafusion:vortex-file-compressed 655029700 611357081 1.07
tpch_q22/datafusion:vortex-file-compressed 148495964 125419351 1.18
datafusion / vortex-compact (1.087x ➖, 0↑ 4↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 294226383 293471493 1.00
tpch_q02/datafusion:vortex-compact 418557274 565240717 0.74
tpch_q03/datafusion:vortex-compact 379998796 394782429 0.96
tpch_q04/datafusion:vortex-compact 244797028 267875031 0.91
tpch_q05/datafusion:vortex-compact 453347091 388586110 1.17
tpch_q06/datafusion:vortex-compact 383179250 303328479 1.26
tpch_q07/datafusion:vortex-compact 451585492 472653282 0.96
tpch_q08/datafusion:vortex-compact 🚨 842400898 629741715 1.34
tpch_q09/datafusion:vortex-compact 531199736 410517991 1.29
tpch_q10/datafusion:vortex-compact 477615316 431366953 1.11
tpch_q11/datafusion:vortex-compact 277510772 297601087 0.93
tpch_q12/datafusion:vortex-compact 449548113 416212578 1.08
tpch_q13/datafusion:vortex-compact 🚨 169553599 125097302 1.36
tpch_q14/datafusion:vortex-compact 🚨 329412008 253353788 1.30
tpch_q15/datafusion:vortex-compact 🚨 607463364 465262380 1.31
tpch_q16/datafusion:vortex-compact 198205274 185969575 1.07
tpch_q17/datafusion:vortex-compact 422665197 345659497 1.22
tpch_q18/datafusion:vortex-compact 352590102 289500576 1.22
tpch_q19/datafusion:vortex-compact 501624677 521872771 0.96
tpch_q20/datafusion:vortex-compact 418883769 423748351 0.99
tpch_q21/datafusion:vortex-compact 559339115 542813506 1.03
tpch_q22/datafusion:vortex-compact 106222094 107910432 0.98
datafusion / parquet (1.023x ➖, 0↑ 2↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 226945497 261900649 0.87
tpch_q02/datafusion:parquet 404888348 417650577 0.97
tpch_q03/datafusion:parquet 321204801 308301563 1.04
tpch_q04/datafusion:parquet 188306728 161016259 1.17
tpch_q05/datafusion:parquet 515429797 543609263 0.95
tpch_q06/datafusion:parquet 155444822 139212362 1.12
tpch_q07/datafusion:parquet 476722541 452037430 1.05
tpch_q08/datafusion:parquet 608719620 635468688 0.96
tpch_q09/datafusion:parquet 476118537 475746775 1.00
tpch_q10/datafusion:parquet 488772798 594319733 0.82
tpch_q11/datafusion:parquet 325763975 397317350 0.82
tpch_q12/datafusion:parquet 244101580 273768982 0.89
tpch_q13/datafusion:parquet 446800896 494049679 0.90
tpch_q14/datafusion:parquet 220545386 229909280 0.96
tpch_q15/datafusion:parquet 340424661 338691108 1.01
tpch_q16/datafusion:parquet 176880358 179326452 0.99
tpch_q17/datafusion:parquet 497993708 408684573 1.22
tpch_q18/datafusion:parquet 511436864 453682672 1.13
tpch_q19/datafusion:parquet 🚨 441746942 338553244 1.30
tpch_q20/datafusion:parquet 🚨 414487212 314593813 1.32
tpch_q21/datafusion:parquet 553037458 491282513 1.13
tpch_q22/datafusion:parquet 118162346 108620567 1.09
duckdb / vortex-file-compressed (0.966x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 276388885 297860072 0.93
tpch_q02/duckdb:vortex-file-compressed 984813642 906889328 1.09
tpch_q03/duckdb:vortex-file-compressed 672509370 662025742 1.02
tpch_q04/duckdb:vortex-file-compressed 430285909 428172208 1.00
tpch_q05/duckdb:vortex-file-compressed 848918000 875523577 0.97
tpch_q06/duckdb:vortex-file-compressed 327541838 326531522 1.00
tpch_q07/duckdb:vortex-file-compressed 920376698 1030948304 0.89
tpch_q08/duckdb:vortex-file-compressed 1015114807 1040435848 0.98
tpch_q09/duckdb:vortex-file-compressed 906891937 993462447 0.91
tpch_q10/duckdb:vortex-file-compressed 760133604 772729308 0.98
tpch_q11/duckdb:vortex-file-compressed 496761438 526935156 0.94
tpch_q12/duckdb:vortex-file-compressed 666376042 628711205 1.06
tpch_q13/duckdb:vortex-file-compressed 464650574 482380438 0.96
tpch_q14/duckdb:vortex-file-compressed 353904209 422289268 0.84
tpch_q15/duckdb:vortex-file-compressed 286644228 292356078 0.98
tpch_q16/duckdb:vortex-file-compressed 332768211 351864654 0.95
tpch_q17/duckdb:vortex-file-compressed 728160635 771207427 0.94
tpch_q18/duckdb:vortex-file-compressed 570670195 550254924 1.04
tpch_q19/duckdb:vortex-file-compressed 440058400 486738007 0.90
tpch_q20/duckdb:vortex-file-compressed 764138674 813731498 0.94
tpch_q21/duckdb:vortex-file-compressed 1050787060 1060300626 0.99
tpch_q22/duckdb:vortex-file-compressed 265877840 276415411 0.96
duckdb / vortex-compact (0.974x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 285014752 289200533 0.99
tpch_q02/duckdb:vortex-compact 968298653 960504784 1.01
tpch_q03/duckdb:vortex-compact 651281513 621165444 1.05
tpch_q04/duckdb:vortex-compact 360515804 415864071 0.87
tpch_q05/duckdb:vortex-compact 743610817 765659283 0.97
tpch_q06/duckdb:vortex-compact 314727857 315701831 1.00
tpch_q07/duckdb:vortex-compact 877244362 905563540 0.97
tpch_q08/duckdb:vortex-compact 988434073 1061231305 0.93
tpch_q09/duckdb:vortex-compact 930026195 926355088 1.00
tpch_q10/duckdb:vortex-compact 679756290 655288495 1.04
tpch_q11/duckdb:vortex-compact 475656742 500784055 0.95
tpch_q12/duckdb:vortex-compact 623268457 587821239 1.06
tpch_q13/duckdb:vortex-compact 427489836 446474719 0.96
tpch_q14/duckdb:vortex-compact 409592036 464568296 0.88
tpch_q15/duckdb:vortex-compact 294171993 293502716 1.00
tpch_q16/duckdb:vortex-compact 331373364 350593141 0.95
tpch_q17/duckdb:vortex-compact 620661808 658728324 0.94
tpch_q18/duckdb:vortex-compact 519384305 512313902 1.01
tpch_q19/duckdb:vortex-compact 473940455 496354339 0.95
tpch_q20/duckdb:vortex-compact 722541348 766928889 0.94
tpch_q21/duckdb:vortex-compact 934307581 1012270812 0.92
tpch_q22/duckdb:vortex-compact 298469324 278959559 1.07
duckdb / parquet (0.981x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 440499827 473230409 0.93
tpch_q02/duckdb:parquet 1153811866 1139463180 1.01
tpch_q03/duckdb:parquet 988997439 1192548372 0.83
tpch_q04/duckdb:parquet 649245536 667861808 0.97
tpch_q05/duckdb:parquet 1311994762 1340838073 0.98
tpch_q06/duckdb:parquet 432746063 433004773 1.00
tpch_q07/duckdb:parquet 1209961188 1232241089 0.98
tpch_q08/duckdb:parquet 1435205889 1558807657 0.92
tpch_q09/duckdb:parquet 1401704674 1459221642 0.96
tpch_q10/duckdb:parquet 1187527972 1309614615 0.91
tpch_q11/duckdb:parquet 743599471 753476992 0.99
tpch_q12/duckdb:parquet 704544440 670340061 1.05
tpch_q13/duckdb:parquet 906280780 910230698 1.00
tpch_q14/duckdb:parquet 681934387 677066876 1.01
tpch_q15/duckdb:parquet 505589482 523547523 0.97
tpch_q16/duckdb:parquet 681444998 627186034 1.09
tpch_q17/duckdb:parquet 719975459 746038719 0.97
tpch_q18/duckdb:parquet 955837319 909024130 1.05
tpch_q19/duckdb:parquet 805582210 796041990 1.01
tpch_q20/duckdb:parquet 1124935126 1079982194 1.04
tpch_q21/duckdb:parquet 1028287674 1097841618 0.94
tpch_q22/duckdb:parquet 539541815 529725963 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.3% -10.2% +11.6% +68.8% ➖ noise
1 datafusion:vortex-file-compressed -1.1% -10.2% +10.1% +67.5% ➖ noise
1 duckdb:vortex-compact -1.4% -10.2% +9.7% +40.3% ➖ noise
1 duckdb:vortex-file-compressed -7.2% -10.2% +3.3% +38.7% ➖ noise
2 datafusion:vortex-compact -26.0% -0.9% -25.3% +31.4% ✅ faster
2 datafusion:vortex-file-compressed -19.4% -0.9% -18.6% +30.0% ➖ noise
2 duckdb:vortex-compact +0.8% -0.9% +1.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +8.6% -0.9% +9.6% +30.0% ➖ noise
3 datafusion:vortex-compact -3.7% -7.0% +3.6% +44.9% ➖ noise
3 datafusion:vortex-file-compressed -3.2% -7.0% +4.1% +44.6% ➖ noise
3 duckdb:vortex-compact +4.8% -7.0% +12.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.6% -7.0% +9.3% +30.0% ➖ noise
4 datafusion:vortex-compact -8.6% +6.6% -14.3% +43.3% ➖ noise
4 datafusion:vortex-file-compressed -18.9% +6.6% -23.9% +30.0% ✅ faster
4 duckdb:vortex-compact -13.3% +6.6% -18.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +0.5% +6.6% -5.8% +30.0% ➖ noise
5 datafusion:vortex-compact +16.7% -3.7% +21.1% +34.7% ➖ noise
5 datafusion:vortex-file-compressed -11.9% -3.7% -8.6% +30.0% ➖ noise
5 duckdb:vortex-compact -2.9% -3.7% +0.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.0% -3.7% +0.7% +30.0% ➖ noise
6 datafusion:vortex-compact +26.3% +5.6% +19.6% +44.2% ➖ noise
6 datafusion:vortex-file-compressed -17.6% +5.6% -22.0% +31.2% ➖ noise
6 duckdb:vortex-compact -0.3% +5.6% -5.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.3% +5.6% -5.0% +30.0% ➖ noise
7 datafusion:vortex-compact -4.5% +1.8% -6.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -17.3% +1.8% -18.7% +30.0% ➖ noise
7 duckdb:vortex-compact -3.1% +1.8% -4.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -10.7% +1.8% -12.3% +30.0% ➖ noise
8 datafusion:vortex-compact +33.8% -6.1% +42.4% +42.6% ➖ noise
8 datafusion:vortex-file-compressed +17.3% -6.1% +24.9% +37.1% ➖ noise
8 duckdb:vortex-compact -6.9% -6.1% -0.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.4% -6.1% +3.9% +30.0% ➖ noise
9 datafusion:vortex-compact +29.4% -2.0% +32.0% +32.1% ➖ noise
9 datafusion:vortex-file-compressed +1.5% -2.0% +3.5% +30.0% ➖ noise
9 duckdb:vortex-compact +0.4% -2.0% +2.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -8.7% -2.0% -6.9% +30.0% ➖ noise
10 datafusion:vortex-compact +10.7% -13.6% +28.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -6.3% -13.6% +8.5% +30.0% ➖ noise
10 duckdb:vortex-compact +3.7% -13.6% +20.1% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -1.6% -13.6% +13.9% +30.0% ➖ noise
11 datafusion:vortex-compact -6.8% -10.0% +3.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -13.1% -10.0% -3.4% +30.0% ➖ noise
11 duckdb:vortex-compact -5.0% -10.0% +5.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -5.7% -10.0% +4.8% +30.0% ➖ noise
12 datafusion:vortex-compact +8.0% -3.2% +11.6% +33.9% ➖ noise
12 datafusion:vortex-file-compressed +1.9% -3.2% +5.2% +30.0% ➖ noise
12 duckdb:vortex-compact +6.0% -3.2% +9.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +6.0% -3.2% +9.5% +30.0% ➖ noise
13 datafusion:vortex-compact +35.5% -5.1% +42.8% +63.6% ➖ noise
13 datafusion:vortex-file-compressed +79.7% -5.1% +89.4% +59.7% 🚨 regression
13 duckdb:vortex-compact -4.3% -5.1% +0.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -3.7% -5.1% +1.5% +30.0% ➖ noise
14 datafusion:vortex-compact +30.0% -1.7% +32.3% +30.0% 🚨 regression
14 datafusion:vortex-file-compressed -11.8% -1.7% -10.3% +30.0% ➖ noise
14 duckdb:vortex-compact -11.8% -1.7% -10.3% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -16.2% -1.7% -14.7% +30.0% ➖ noise
15 datafusion:vortex-compact +30.6% -1.5% +32.5% +39.1% ➖ noise
15 datafusion:vortex-file-compressed +35.0% -1.5% +37.1% +32.8% 🚨 regression
15 duckdb:vortex-compact +0.2% -1.5% +1.7% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -2.0% -1.5% -0.5% +30.0% ➖ noise
16 datafusion:vortex-compact +6.6% +3.5% +3.0% +33.5% ➖ noise
16 datafusion:vortex-file-compressed +12.5% +3.5% +8.7% +32.5% ➖ noise
16 duckdb:vortex-compact -5.5% +3.5% -8.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -5.4% +3.5% -8.6% +30.0% ➖ noise
17 datafusion:vortex-compact +22.3% +8.4% +12.8% +34.0% ➖ noise
17 datafusion:vortex-file-compressed +21.4% +8.4% +11.9% +34.0% ➖ noise
17 duckdb:vortex-compact -5.8% +8.4% -13.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -5.6% +8.4% -12.9% +30.0% ➖ noise
18 datafusion:vortex-compact +21.8% +8.9% +11.9% +30.1% ➖ noise
18 datafusion:vortex-file-compressed +35.5% +8.9% +24.5% +30.0% ➖ noise
18 duckdb:vortex-compact +1.4% +8.9% -6.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +3.7% +8.9% -4.7% +30.0% ➖ noise
19 datafusion:vortex-compact -3.9% +14.9% -16.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +30.5% +14.9% +13.6% +30.0% ➖ noise
19 duckdb:vortex-compact -4.5% +14.9% -16.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -9.6% +14.9% -21.3% +30.0% ➖ noise
20 datafusion:vortex-compact -1.1% +17.1% -15.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +40.7% +17.1% +20.1% +30.0% ➖ noise
20 duckdb:vortex-compact -5.8% +17.1% -19.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -6.1% +17.1% -19.8% +30.0% ➖ noise
21 datafusion:vortex-compact +3.0% +2.7% +0.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +7.1% +2.7% +4.3% +30.0% ➖ noise
21 duckdb:vortex-compact -7.7% +2.7% -10.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -0.9% +2.7% -3.5% +30.0% ➖ noise
22 datafusion:vortex-compact -1.6% +5.3% -6.5% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +18.4% +5.3% +12.5% +30.0% ➖ noise
22 duckdb:vortex-compact +7.0% +5.3% +1.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -3.8% +5.3% -8.6% +30.0% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.4%
Vortex (geomean): 1.023x ➖
Parquet (geomean): 1.059x ➖
Shifts: Parquet (control) +5.9% · Median polish +0.7%


datafusion / vortex-file-compressed (1.068x ➖, 0↑ 1↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 663205302 655958529 1.01
tpch_q02/datafusion:vortex-file-compressed 928759395 763337322 1.22
tpch_q03/datafusion:vortex-file-compressed 807764926 799397350 1.01
tpch_q04/datafusion:vortex-file-compressed 562905253 583570296 0.96
tpch_q05/datafusion:vortex-file-compressed 950893735 917470995 1.04
tpch_q06/datafusion:vortex-file-compressed 562388438 642354731 0.88
tpch_q07/datafusion:vortex-file-compressed 1053707452 1103465399 0.95
tpch_q08/datafusion:vortex-file-compressed 1183409058 1244968903 0.95
tpch_q09/datafusion:vortex-file-compressed 1471630822 1244761972 1.18
tpch_q10/datafusion:vortex-file-compressed 948005548 1046367613 0.91
tpch_q11/datafusion:vortex-file-compressed 556143152 526552010 1.06
tpch_q12/datafusion:vortex-file-compressed 1003180321 798706360 1.26
tpch_q13/datafusion:vortex-file-compressed 445860665 445430012 1.00
tpch_q14/datafusion:vortex-file-compressed 580751994 489363196 1.19
tpch_q15/datafusion:vortex-file-compressed 1069782843 928272047 1.15
tpch_q16/datafusion:vortex-file-compressed 408687214 383029427 1.07
tpch_q17/datafusion:vortex-file-compressed 1492354557 1148560500 1.30
tpch_q18/datafusion:vortex-file-compressed 1306431373 1290448123 1.01
tpch_q19/datafusion:vortex-file-compressed 812292615 785704905 1.03
tpch_q20/datafusion:vortex-file-compressed 865606307 799721908 1.08
tpch_q21/datafusion:vortex-file-compressed 1701253056 1609136357 1.06
tpch_q22/datafusion:vortex-file-compressed 🚨 473899524 355752554 1.33
datafusion / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 670356293 663552615 1.01
tpch_q02/datafusion:vortex-compact 599753657 601293846 1.00
tpch_q03/datafusion:vortex-compact 802952060 781897157 1.03
tpch_q04/datafusion:vortex-compact 474293069 554075991 0.86
tpch_q05/datafusion:vortex-compact 846943984 918742235 0.92
tpch_q06/datafusion:vortex-compact 560451991 612675450 0.91
tpch_q07/datafusion:vortex-compact 955087005 1050386721 0.91
tpch_q08/datafusion:vortex-compact 1086803876 1100261415 0.99
tpch_q09/datafusion:vortex-compact 1160015474 1338811638 0.87
tpch_q10/datafusion:vortex-compact 836219709 876254114 0.95
tpch_q11/datafusion:vortex-compact 412217510 394491967 1.04
tpch_q12/datafusion:vortex-compact 962296314 761896595 1.26
tpch_q13/datafusion:vortex-compact 412033380 391161952 1.05
tpch_q14/datafusion:vortex-compact 506497457 519105799 0.98
tpch_q15/datafusion:vortex-compact 908267268 903717541 1.01
tpch_q16/datafusion:vortex-compact 327701533 338128073 0.97
tpch_q17/datafusion:vortex-compact 1337959271 1107381308 1.21
tpch_q18/datafusion:vortex-compact 1246549166 1064753368 1.17
tpch_q19/datafusion:vortex-compact 772645647 715456943 1.08
tpch_q20/datafusion:vortex-compact 887654119 740751467 1.20
tpch_q21/datafusion:vortex-compact 1362501194 1356520307 1.00
tpch_q22/datafusion:vortex-compact 320712806 368679016 0.87
datafusion / parquet (1.166x ➖, 1↑ 2↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 861931070 819941449 1.05
tpch_q02/datafusion:parquet 878055837 732398438 1.20
tpch_q03/datafusion:parquet 1055641326 1014054737 1.04
tpch_q04/datafusion:parquet 554834764 448330671 1.24
tpch_q05/datafusion:parquet 1213805005 1128375028 1.08
tpch_q06/datafusion:parquet 520711786 540657606 0.96
tpch_q07/datafusion:parquet 1290046082 1168099831 1.10
tpch_q08/datafusion:parquet 1743980754 1463543547 1.19
tpch_q09/datafusion:parquet 2001648584 1626250448 1.23
tpch_q10/datafusion:parquet 2061532976 1998953589 1.03
tpch_q11/datafusion:parquet 470788417 532942256 0.88
tpch_q12/datafusion:parquet 694064056 783032973 0.89
tpch_q13/datafusion:parquet 747823628 792655288 0.94
tpch_q14/datafusion:parquet 789792568 809151972 0.98
tpch_q15/datafusion:parquet 1258979284 1515111006 0.83
tpch_q16/datafusion:parquet 🚀 371457843 532405190 0.70
tpch_q17/datafusion:parquet 🚨 5635712816 1359125769 4.15
tpch_q18/datafusion:parquet 🚨 5881487785 1624000678 3.62
tpch_q19/datafusion:parquet 867884210 839451798 1.03
tpch_q20/datafusion:parquet 1146799749 1076157219 1.07
tpch_q21/datafusion:parquet 2069140028 1616281429 1.28
tpch_q22/datafusion:parquet 767029190 649571033 1.18
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 618170336 622741928 0.99
tpch_q02/duckdb:vortex-file-compressed 1129621829 1145504989 0.99
tpch_q03/duckdb:vortex-file-compressed 876568993 910101875 0.96
tpch_q04/duckdb:vortex-file-compressed 828008807 748949322 1.11
tpch_q05/duckdb:vortex-file-compressed 1190286054 1110644871 1.07
tpch_q06/duckdb:vortex-file-compressed 537403579 597938350 0.90
tpch_q07/duckdb:vortex-file-compressed 1213799798 1230348909 0.99
tpch_q08/duckdb:vortex-file-compressed 1476935890 1412212063 1.05
tpch_q09/duckdb:vortex-file-compressed 1725705045 1649282110 1.05
tpch_q10/duckdb:vortex-file-compressed 1145732438 1127154462 1.02
tpch_q11/duckdb:vortex-file-compressed 672949152 728484292 0.92
tpch_q12/duckdb:vortex-file-compressed 1205094450 1181907010 1.02
tpch_q13/duckdb:vortex-file-compressed 971564899 871080793 1.12
tpch_q14/duckdb:vortex-file-compressed 695632623 654030068 1.06
tpch_q15/duckdb:vortex-file-compressed 509606007 526108808 0.97
tpch_q16/duckdb:vortex-file-compressed 373938064 427183386 0.88
tpch_q17/duckdb:vortex-file-compressed 958042905 934745473 1.02
tpch_q18/duckdb:vortex-file-compressed 903379798 936259199 0.96
tpch_q19/duckdb:vortex-file-compressed 807362523 809895265 1.00
tpch_q20/duckdb:vortex-file-compressed 1147650630 1182638138 0.97
tpch_q21/duckdb:vortex-file-compressed 1915459238 1881544153 1.02
tpch_q22/duckdb:vortex-file-compressed 396294915 439628347 0.90
duckdb / vortex-compact (1.022x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 624069755 598227526 1.04
tpch_q02/duckdb:vortex-compact 1102706770 1007600225 1.09
tpch_q03/duckdb:vortex-compact 841934266 781611310 1.08
tpch_q04/duckdb:vortex-compact 550173604 600161206 0.92
tpch_q05/duckdb:vortex-compact 1130079011 1101619776 1.03
tpch_q06/duckdb:vortex-compact 574649674 520440486 1.10
tpch_q07/duckdb:vortex-compact 1167130865 1065365040 1.10
tpch_q08/duckdb:vortex-compact 1354284052 1333340304 1.02
tpch_q09/duckdb:vortex-compact 1589707652 1521089090 1.05
tpch_q10/duckdb:vortex-compact 1053199784 1029434304 1.02
tpch_q11/duckdb:vortex-compact 742295561 717536430 1.03
tpch_q12/duckdb:vortex-compact 1102637869 1013968552 1.09
tpch_q13/duckdb:vortex-compact 927975430 881210435 1.05
tpch_q14/duckdb:vortex-compact 676872513 644618046 1.05
tpch_q15/duckdb:vortex-compact 527511190 555640475 0.95
tpch_q16/duckdb:vortex-compact 439009835 430172134 1.02
tpch_q17/duckdb:vortex-compact 916002396 894616473 1.02
tpch_q18/duckdb:vortex-compact 804332957 887380760 0.91
tpch_q19/duckdb:vortex-compact 845407450 782286692 1.08
tpch_q20/duckdb:vortex-compact 1151987745 1199584473 0.96
tpch_q21/duckdb:vortex-compact 1673782020 1743329251 0.96
tpch_q22/duckdb:vortex-compact 472156582 495711320 0.95
duckdb / parquet (0.962x ➖, 0↑ 0↓)
name PR 7a3b856 (ns) base 2fa51e2 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 798607386 779119735 1.03
tpch_q02/duckdb:parquet 1291497038 1250281933 1.03
tpch_q03/duckdb:parquet 1592409883 1681539254 0.95
tpch_q04/duckdb:parquet 906942438 1020710096 0.89
tpch_q05/duckdb:parquet 1807502946 1760563254 1.03
tpch_q06/duckdb:parquet 710232409 877395792 0.81
tpch_q07/duckdb:parquet 1865766258 1952329126 0.96
tpch_q08/duckdb:parquet 2339740462 2429789519 0.96
tpch_q09/duckdb:parquet 2396040295 2468322466 0.97
tpch_q10/duckdb:parquet 2962581722 2996967029 0.99
tpch_q11/duckdb:parquet 894722036 902383033 0.99
tpch_q12/duckdb:parquet 1107807946 1168999916 0.95
tpch_q13/duckdb:parquet 1170131719 1261787309 0.93
tpch_q14/duckdb:parquet 1234720017 1267334759 0.97
tpch_q15/duckdb:parquet 872238117 940850608 0.93
tpch_q16/duckdb:parquet 906501584 899373930 1.01
tpch_q17/duckdb:parquet 1212336544 1261288363 0.96
tpch_q18/duckdb:parquet 1338962409 1400958919 0.96
tpch_q19/duckdb:parquet 1379259384 1468771105 0.94
tpch_q20/duckdb:parquet 1847971050 2052479032 0.90
tpch_q21/duckdb:parquet 1802831032 1831647437 0.98
tpch_q22/duckdb:parquet 1085353984 1011810750 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.0% +3.8% -2.7% +72.0% ➖ noise
1 datafusion:vortex-file-compressed +1.1% +3.8% -2.6% +72.0% ➖ noise
1 duckdb:vortex-compact +4.3% +3.8% +0.5% +72.0% ➖ noise
1 duckdb:vortex-file-compressed -0.7% +3.8% -4.4% +72.0% ➖ noise
2 datafusion:vortex-compact -0.3% +11.3% -10.4% +72.0% ➖ noise
2 datafusion:vortex-file-compressed +21.7% +11.3% +9.3% +72.0% ➖ noise
2 duckdb:vortex-compact +9.4% +11.3% -1.7% +72.0% ➖ noise
2 duckdb:vortex-file-compressed -1.4% +11.3% -11.4% +72.0% ➖ noise
3 datafusion:vortex-compact +2.7% -0.7% +3.4% +72.0% ➖ noise
3 datafusion:vortex-file-compressed +1.0% -0.7% +1.8% +72.0% ➖ noise
3 duckdb:vortex-compact +7.7% -0.7% +8.5% +72.0% ➖ noise
3 duckdb:vortex-file-compressed -3.7% -0.7% -3.0% +72.0% ➖ noise
4 datafusion:vortex-compact -14.4% +4.9% -18.4% +72.0% ➖ noise
4 datafusion:vortex-file-compressed -3.5% +4.9% -8.0% +72.0% ➖ noise
4 duckdb:vortex-compact -8.3% +4.9% -12.6% +72.0% ➖ noise
4 duckdb:vortex-file-compressed +10.6% +4.9% +5.4% +72.0% ➖ noise
5 datafusion:vortex-compact -7.8% +5.1% -12.3% +72.0% ➖ noise
5 datafusion:vortex-file-compressed +3.6% +5.1% -1.4% +72.0% ➖ noise
5 duckdb:vortex-compact +2.6% +5.1% -2.4% +72.0% ➖ noise
5 duckdb:vortex-file-compressed +7.2% +5.1% +2.0% +72.0% ➖ noise
6 datafusion:vortex-compact -8.5% -11.7% +3.6% +72.0% ➖ noise
6 datafusion:vortex-file-compressed -12.4% -11.7% -0.8% +72.0% ➖ noise
6 duckdb:vortex-compact +10.4% -11.7% +25.1% +72.0% ➖ noise
6 duckdb:vortex-file-compressed -10.1% -11.7% +1.8% +72.0% ➖ noise
7 datafusion:vortex-compact -9.1% +2.7% -11.5% +72.0% ➖ noise
7 datafusion:vortex-file-compressed -4.5% +2.7% -7.1% +72.0% ➖ noise
7 duckdb:vortex-compact +9.6% +2.7% +6.6% +72.0% ➖ noise
7 duckdb:vortex-file-compressed -1.3% +2.7% -4.0% +72.0% ➖ noise
8 datafusion:vortex-compact -1.2% +7.1% -7.8% +72.0% ➖ noise
8 datafusion:vortex-file-compressed -4.9% +7.1% -11.3% +72.0% ➖ noise
8 duckdb:vortex-compact +1.6% +7.1% -5.2% +72.0% ➖ noise
8 duckdb:vortex-file-compressed +4.6% +7.1% -2.4% +72.0% ➖ noise
9 datafusion:vortex-compact -13.4% +9.3% -20.7% +72.0% ➖ noise
9 datafusion:vortex-file-compressed +18.2% +9.3% +8.2% +72.0% ➖ noise
9 duckdb:vortex-compact +4.5% +9.3% -4.4% +72.0% ➖ noise
9 duckdb:vortex-file-compressed +4.6% +9.3% -4.3% +72.0% ➖ noise
10 datafusion:vortex-compact -4.6% +1.0% -5.5% +72.0% ➖ noise
10 datafusion:vortex-file-compressed -9.4% +1.0% -10.3% +72.0% ➖ noise
10 duckdb:vortex-compact +2.3% +1.0% +1.3% +72.0% ➖ noise
10 duckdb:vortex-file-compressed +1.6% +1.0% +0.7% +72.0% ➖ noise
11 datafusion:vortex-compact +4.5% -6.4% +11.7% +72.0% ➖ noise
11 datafusion:vortex-file-compressed +5.6% -6.4% +12.9% +72.0% ➖ noise
11 duckdb:vortex-compact +3.5% -6.4% +10.5% +72.0% ➖ noise
11 duckdb:vortex-file-compressed -7.6% -6.4% -1.3% +72.0% ➖ noise
12 datafusion:vortex-compact +26.3% -8.3% +37.8% +72.0% ➖ noise
12 datafusion:vortex-file-compressed +25.6% -8.3% +37.0% +72.0% ➖ noise
12 duckdb:vortex-compact +8.7% -8.3% +18.7% +72.0% ➖ noise
12 duckdb:vortex-file-compressed +2.0% -8.3% +11.3% +72.0% ➖ noise
13 datafusion:vortex-compact +5.3% -6.5% +12.6% +72.0% ➖ noise
13 datafusion:vortex-file-compressed +0.1% -6.5% +7.0% +72.0% ➖ noise
13 duckdb:vortex-compact +5.3% -6.5% +12.6% +72.0% ➖ noise
13 duckdb:vortex-file-compressed +11.5% -6.5% +19.2% +72.0% ➖ noise
14 datafusion:vortex-compact -2.4% -2.5% +0.1% +72.0% ➖ noise
14 datafusion:vortex-file-compressed +18.7% -2.5% +21.7% +72.0% ➖ noise
14 duckdb:vortex-compact +5.0% -2.5% +7.7% +72.0% ➖ noise
14 duckdb:vortex-file-compressed +6.4% -2.5% +9.1% +72.0% ➖ noise
15 datafusion:vortex-compact +0.5% -12.2% +14.5% +72.0% ➖ noise
15 datafusion:vortex-file-compressed +15.2% -12.2% +31.3% +72.0% ➖ noise
15 duckdb:vortex-compact -5.1% -12.2% +8.2% +72.0% ➖ noise
15 duckdb:vortex-file-compressed -3.1% -12.2% +10.4% +72.0% ➖ noise
16 datafusion:vortex-compact -3.1% -16.1% +15.6% +72.0% ➖ noise
16 datafusion:vortex-file-compressed +6.7% -16.1% +27.2% +72.0% ➖ noise
16 duckdb:vortex-compact +2.1% -16.1% +21.7% +72.0% ➖ noise
16 duckdb:vortex-file-compressed -12.5% -16.1% +4.4% +72.0% ➖ noise
17 datafusion:vortex-compact +20.8% +99.6% -39.5% +72.0% ➖ noise
17 datafusion:vortex-file-compressed +29.9% +99.6% -34.9% +72.0% ➖ noise
17 duckdb:vortex-compact +2.4% +99.6% -48.7% +72.0% ✅ faster
17 duckdb:vortex-file-compressed +2.5% +99.6% -48.7% +72.0% ✅ faster
18 datafusion:vortex-compact +17.1% +86.0% -37.1% +72.0% ➖ noise
18 datafusion:vortex-file-compressed +1.2% +86.0% -45.6% +72.0% ✅ faster
18 duckdb:vortex-compact -9.4% +86.0% -51.3% +72.0% ✅ faster
18 duckdb:vortex-file-compressed -3.5% +86.0% -48.1% +72.0% ✅ faster
19 datafusion:vortex-compact +8.0% -1.5% +9.6% +72.0% ➖ noise
19 datafusion:vortex-file-compressed +3.4% -1.5% +4.9% +72.0% ➖ noise
19 duckdb:vortex-compact +8.1% -1.5% +9.7% +72.0% ➖ noise
19 duckdb:vortex-file-compressed -0.3% -1.5% +1.2% +72.0% ➖ noise
20 datafusion:vortex-compact +19.8% -2.0% +22.3% +72.0% ➖ noise
20 datafusion:vortex-file-compressed +8.2% -2.0% +10.5% +72.0% ➖ noise
20 duckdb:vortex-compact -4.0% -2.0% -2.0% +72.0% ➖ noise
20 duckdb:vortex-file-compressed -3.0% -2.0% -0.9% +72.0% ➖ noise
21 datafusion:vortex-compact +0.4% +12.3% -10.5% +72.0% ➖ noise
21 datafusion:vortex-file-compressed +5.7% +12.3% -5.8% +72.0% ➖ noise
21 duckdb:vortex-compact -4.0% +12.3% -14.5% +72.0% ➖ noise
21 duckdb:vortex-file-compressed +1.8% +12.3% -9.3% +72.0% ➖ noise
22 datafusion:vortex-compact -13.0% +12.5% -22.7% +72.0% ➖ noise
22 datafusion:vortex-file-compressed +33.2% +12.5% +18.4% +72.0% ➖ noise
22 duckdb:vortex-compact -4.8% +12.5% -15.4% +72.0% ➖ noise
22 duckdb:vortex-file-compressed -9.9% +12.5% -19.9% +72.0% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch 2 times, most recently from a103738 to 4454bc6 Compare April 3, 2026 20:26
@AdamGS AdamGS changed the title Try to implement compare/between for bitpacked arrays Implement compare/between for bitpacked arrays - improve performance by up to 2X Apr 3, 2026
@AdamGS AdamGS requested review from gatesn and joseph-isaacs April 3, 2026 21:03
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch 2 times, most recently from 52289bf to dbe5a37 Compare April 3, 2026 21:29
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 3, 2026
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from dbe5a37 to 33e6d30 Compare April 3, 2026 21:40
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 22, 2026
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from 083b4b4 to 695ce82 Compare April 24, 2026 08:59
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 24, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 24, 2026
@joseph-isaacs

Copy link
Copy Markdown
Contributor

Diff size of and bin using this with and without the compare+bitpack

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@github-actions

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label May 18, 2026
AdamGS added 12 commits May 19, 2026 11:20
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from dbfb7c2 to 6109031 Compare May 19, 2026 10:34
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from 6109031 to 526936f Compare May 19, 2026 10:58
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 19, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR stale This PR is stale and will be auto-closed soon labels May 19, 2026
@AdamGS AdamGS closed this May 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants