Skip to content

fix: fix typo in compressor scheme - #7241

Merged
joseph-isaacs merged 1 commit into
developfrom
ji/fix-fuzz-7227
Apr 1, 2026
Merged

fix: fix typo in compressor scheme#7241
joseph-isaacs merged 1 commit into
developfrom
ji/fix-fuzz-7227

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

fix typo in compressor scheme

@joseph-isaacs
fix fuzzer
7ceb2f0 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions

github-actions Bot commented Apr 1, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7ceb2f0 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 7ceb2f0 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.915x ➖

datafusion / vortex-file-compressed (0.915x ➖, 3↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 133819649 136095923 0.98
polarsignals_q01/datafusion:vortex-file-compressed 381283741 407371109 0.94
polarsignals_q02/datafusion:vortex-file-compressed 22349945 24697672 0.90
polarsignals_q03/datafusion:vortex-file-compressed 384602978 407383179 0.94
polarsignals_q04/datafusion:vortex-file-compressed 🚀 11887688 13415683 0.89
polarsignals_q05/datafusion:vortex-file-compressed 🚀 15929008 18228697 0.87
polarsignals_q06/datafusion:vortex-file-compressed 18729574 20380708 0.92
polarsignals_q07/datafusion:vortex-file-compressed 🚀 13664914 16910423 0.81
polarsignals_q08/datafusion:vortex-file-compressed 462553005 496785635 0.93
polarsignals_q09/datafusion:vortex-file-compressed 11060957 11359523 0.97

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.018x ➖
Shifts: Parquet (control) +1.8% · Median polish +0.7%

datafusion / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 48393312 48984875 0.99
tpch_q02/datafusion:vortex-file-compressed 32480917 32975379 0.99
tpch_q03/datafusion:vortex-file-compressed 26478200 26774162 0.99
tpch_q04/datafusion:vortex-file-compressed 18263801 17789001 1.03
tpch_q05/datafusion:vortex-file-compressed 54124164 52325108 1.03
tpch_q06/datafusion:vortex-file-compressed 9754720 10165532 0.96
tpch_q07/datafusion:vortex-file-compressed 63222905 63449557 1.00
tpch_q08/datafusion:vortex-file-compressed 45446168 44430819 1.02
tpch_q09/datafusion:vortex-file-compressed 56231122 53869524 1.04
tpch_q10/datafusion:vortex-file-compressed 43703823 43696081 1.00
tpch_q11/datafusion:vortex-file-compressed 17711190 17147348 1.03
tpch_q12/datafusion:vortex-file-compressed 23427281 22106014 1.06
tpch_q13/datafusion:vortex-file-compressed 27522136 27969493 0.98
tpch_q14/datafusion:vortex-file-compressed 16662301 15701075 1.06
tpch_q15/datafusion:vortex-file-compressed 24207462 23959238 1.01
tpch_q16/datafusion:vortex-file-compressed 24278832 25319929 0.96
tpch_q17/datafusion:vortex-file-compressed 64557322 63798767 1.01
tpch_q18/datafusion:vortex-file-compressed 79508145 77146995 1.03
tpch_q19/datafusion:vortex-file-compressed 22515338 23117155 0.97
tpch_q20/datafusion:vortex-file-compressed 31882950 31364117 1.02
tpch_q21/datafusion:vortex-file-compressed 74121861 73708768 1.01
tpch_q22/datafusion:vortex-file-compressed 16567249 16098102 1.03
datafusion / vortex-compact (1.019x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58625021 56171110 1.04
tpch_q02/datafusion:vortex-compact 36457682 36700393 0.99
tpch_q03/datafusion:vortex-compact 31137010 31126673 1.00
tpch_q04/datafusion:vortex-compact 24006508 22990734 1.04
tpch_q05/datafusion:vortex-compact 58329664 55734082 1.05
tpch_q06/datafusion:vortex-compact 12986763 13233737 0.98
tpch_q07/datafusion:vortex-compact 72325413 69124832 1.05
tpch_q08/datafusion:vortex-compact 51027435 50231362 1.02
tpch_q09/datafusion:vortex-compact 63190024 61456049 1.03
tpch_q10/datafusion:vortex-compact 54856122 53905839 1.02
tpch_q11/datafusion:vortex-compact 21078380 19188950 1.10
tpch_q12/datafusion:vortex-compact 34847678 33428591 1.04
tpch_q13/datafusion:vortex-compact 36199101 36614908 0.99
tpch_q14/datafusion:vortex-compact 20497649 20518117 1.00
tpch_q15/datafusion:vortex-compact 34076194 34215036 1.00
tpch_q16/datafusion:vortex-compact 29222111 30228842 0.97
tpch_q17/datafusion:vortex-compact 69869824 67659599 1.03
tpch_q18/datafusion:vortex-compact 84267835 85254206 0.99
tpch_q19/datafusion:vortex-compact 34021752 33695997 1.01
tpch_q20/datafusion:vortex-compact 37892425 37727746 1.00
tpch_q21/datafusion:vortex-compact 89151547 85115101 1.05
tpch_q22/datafusion:vortex-compact 17437740 16974385 1.03
datafusion / parquet (1.007x ➖, 1↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 96706832 93917380 1.03
tpch_q02/datafusion:parquet 68600404 70082300 0.98
tpch_q03/datafusion:parquet 78414464 78879947 0.99
tpch_q04/datafusion:parquet 48427351 47151877 1.03
tpch_q05/datafusion:parquet 100728864 100114072 1.01
tpch_q06/datafusion:parquet 🚀 34134453 45024757 0.76
tpch_q07/datafusion:parquet 114282423 113479993 1.01
tpch_q08/datafusion:parquet 102477062 104599378 0.98
tpch_q09/datafusion:parquet 133859122 136052778 0.98
tpch_q10/datafusion:parquet 118772556 119961635 0.99
tpch_q11/datafusion:parquet 48694235 48417690 1.01
tpch_q12/datafusion:parquet 🚨 95350515 81089273 1.18
tpch_q13/datafusion:parquet 206880324 206218979 1.00
tpch_q14/datafusion:parquet 51384616 47227518 1.09
tpch_q15/datafusion:parquet 65549999 72440430 0.90
tpch_q16/datafusion:parquet 50919160 50586015 1.01
tpch_q17/datafusion:parquet 141652562 130128660 1.09
tpch_q18/datafusion:parquet 163567607 170136980 0.96
tpch_q19/datafusion:parquet 🚨 88858076 68711238 1.29
tpch_q20/datafusion:parquet 76448120 76833947 0.99
tpch_q21/datafusion:parquet 141984921 142875718 0.99
tpch_q22/datafusion:parquet 34233789 34992316 0.98
datafusion / arrow (1.013x ➖, 0↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 57485917 57833823 0.99
tpch_q02/datafusion:arrow 21723901 22102580 0.98
tpch_q03/datafusion:arrow 33231424 33404679 0.99
tpch_q04/datafusion:arrow 27096828 27615338 0.98
tpch_q05/datafusion:arrow 76663129 81435743 0.94
tpch_q06/datafusion:arrow 20956715 21188181 0.99
tpch_q07/datafusion:arrow 114745772 111150109 1.03
tpch_q08/datafusion:arrow 48117949 44016812 1.09
tpch_q09/datafusion:arrow 🚨 75182247 68012609 1.11
tpch_q10/datafusion:arrow 55264113 50504160 1.09
tpch_q11/datafusion:arrow 11633207 11269146 1.03
tpch_q12/datafusion:arrow 54964399 55907552 0.98
tpch_q13/datafusion:arrow 50638698 48899153 1.04
tpch_q14/datafusion:arrow 23220545 22527075 1.03
tpch_q15/datafusion:arrow 47192298 44462709 1.06
tpch_q16/datafusion:arrow 21238030 20684946 1.03
tpch_q17/datafusion:arrow 71076974 68877589 1.03
tpch_q18/datafusion:arrow 142598972 143164904 1.00
tpch_q19/datafusion:arrow 42083101 41673759 1.01
tpch_q20/datafusion:arrow 37311134 40925235 0.91
tpch_q21/datafusion:arrow 153043840 153900986 0.99
tpch_q22/datafusion:arrow 19923742 20073433 0.99
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33002690 33226680 0.99
tpch_q02/duckdb:vortex-file-compressed 26672650 27762591 0.96
tpch_q03/duckdb:vortex-file-compressed 30102884 28881840 1.04
tpch_q04/duckdb:vortex-file-compressed 29377796 30724665 0.96
tpch_q05/duckdb:vortex-file-compressed 33355266 32321941 1.03
tpch_q06/duckdb:vortex-file-compressed 10566527 10746765 0.98
tpch_q07/duckdb:vortex-file-compressed 36252470 37462379 0.97
tpch_q08/duckdb:vortex-file-compressed 38615009 39055686 0.99
tpch_q09/duckdb:vortex-file-compressed 82369546 76042399 1.08
tpch_q10/duckdb:vortex-file-compressed 37388409 37253644 1.00
tpch_q11/duckdb:vortex-file-compressed 15869235 15806623 1.00
tpch_q12/duckdb:vortex-file-compressed 23298124 22210232 1.05
tpch_q13/duckdb:vortex-file-compressed 37106343 36874351 1.01
tpch_q14/duckdb:vortex-file-compressed 21442426 20951184 1.02
tpch_q15/duckdb:vortex-file-compressed 16323393 16306228 1.00
tpch_q16/duckdb:vortex-file-compressed 28975111 29736538 0.97
tpch_q17/duckdb:vortex-file-compressed 25646909 25613479 1.00
tpch_q18/duckdb:vortex-file-compressed 45013817 46620333 0.97
tpch_q19/duckdb:vortex-file-compressed 32738059 30995148 1.06
tpch_q20/duckdb:vortex-file-compressed 34832964 35136966 0.99
tpch_q21/duckdb:vortex-file-compressed 101816889 102675444 0.99
tpch_q22/duckdb:vortex-file-compressed 17987198 18023940 1.00
duckdb / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39005253 39991312 0.98
tpch_q02/duckdb:vortex-compact 38422684 37125947 1.03
tpch_q03/duckdb:vortex-compact 32433575 32071274 1.01
tpch_q04/duckdb:vortex-compact 34858142 33849055 1.03
tpch_q05/duckdb:vortex-compact 37692990 37327109 1.01
tpch_q06/duckdb:vortex-compact 15467566 14133043 1.09
tpch_q07/duckdb:vortex-compact 43585881 42271329 1.03
tpch_q08/duckdb:vortex-compact 46338985 45100046 1.03
tpch_q09/duckdb:vortex-compact 88826203 85704193 1.04
tpch_q10/duckdb:vortex-compact 39903451 39789133 1.00
tpch_q11/duckdb:vortex-compact 20050032 20493190 0.98
tpch_q12/duckdb:vortex-compact 37402089 37769815 0.99
tpch_q13/duckdb:vortex-compact 48026102 45439117 1.06
tpch_q14/duckdb:vortex-compact 29186740 30046746 0.97
tpch_q15/duckdb:vortex-compact 19289650 19140842 1.01
tpch_q16/duckdb:vortex-compact 35635381 36108105 0.99
tpch_q17/duckdb:vortex-compact 31182541 31788153 0.98
tpch_q18/duckdb:vortex-compact 49529974 49279318 1.01
tpch_q19/duckdb:vortex-compact 37162856 37615897 0.99
tpch_q20/duckdb:vortex-compact 42922111 43164874 0.99
tpch_q21/duckdb:vortex-compact 112260958 110293393 1.02
tpch_q22/duckdb:vortex-compact 21035835 21144841 0.99
duckdb / parquet (1.029x ➖, 3↑ 4↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 82050064 76256379 1.08
tpch_q02/duckdb:parquet 39786820 38856613 1.02
tpch_q03/duckdb:parquet 69769502 69354893 1.01
tpch_q04/duckdb:parquet 🚀 49977486 56206649 0.89
tpch_q05/duckdb:parquet 🚨 73452641 66540739 1.10
tpch_q06/duckdb:parquet 20235835 20654383 0.98
tpch_q07/duckdb:parquet 🚀 67335393 75038497 0.90
tpch_q08/duckdb:parquet 80741323 79679337 1.01
tpch_q09/duckdb:parquet 131815584 131191008 1.00
tpch_q10/duckdb:parquet 124861682 124460432 1.00
tpch_q11/duckdb:parquet 22544605 22016562 1.02
tpch_q12/duckdb:parquet 45450363 45259343 1.00
tpch_q13/duckdb:parquet 261421542 265303436 0.99
tpch_q14/duckdb:parquet 48201951 48348094 1.00
tpch_q15/duckdb:parquet 🚨 35869386 24427460 1.47
tpch_q16/duckdb:parquet 56126650 54514094 1.03
tpch_q17/duckdb:parquet 55789439 53811620 1.04
tpch_q18/duckdb:parquet 🚨 133635853 120384375 1.11
tpch_q19/duckdb:parquet 🚨 85006363 69850025 1.22
tpch_q20/duckdb:parquet 🚀 63141877 76060078 0.83
tpch_q21/duckdb:parquet 176147389 165914586 1.06
tpch_q22/duckdb:parquet 52367050 51059337 1.03
duckdb / duckdb (1.020x ➖, 0↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15864960 15906663 1.00
tpch_q02/duckdb:duckdb 🚨 12540309 11149121 1.12
tpch_q03/duckdb:duckdb 19985281 18849734 1.06
tpch_q04/duckdb:duckdb 🚨 19475080 17683002 1.10
tpch_q05/duckdb:duckdb 20059750 19213772 1.04
tpch_q06/duckdb:duckdb 5322334 5334134 1.00
tpch_q07/duckdb:duckdb 22745724 23543879 0.97
tpch_q08/duckdb:duckdb 20339747 20472415 0.99
tpch_q09/duckdb:duckdb 53115868 52449709 1.01
tpch_q10/duckdb:duckdb 41985293 42030766 1.00
tpch_q11/duckdb:duckdb 5915547 6494530 0.91
tpch_q12/duckdb:duckdb 13723438 13593039 1.01
tpch_q13/duckdb:duckdb 38471650 38064176 1.01
tpch_q14/duckdb:duckdb 15910230 15521284 1.03
tpch_q15/duckdb:duckdb 11619585 11526072 1.01
tpch_q16/duckdb:duckdb 22651919 22646749 1.00
tpch_q17/duckdb:duckdb 14243546 13360556 1.07
tpch_q18/duckdb:duckdb 37798836 36751738 1.03
tpch_q19/duckdb:duckdb 27609697 25816555 1.07
tpch_q20/duckdb:duckdb 23061002 23199738 0.99
tpch_q21/duckdb:duckdb 55710452 56501291 0.99
tpch_q22/duckdb:duckdb 25175918 23598818 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.6% +5.3% -5.6% +24.9% ➖ noise
1 datafusion:vortex-compact +4.4% +5.3% -0.8% +21.7% ➖ noise
1 datafusion:vortex-file-compressed -1.2% +5.3% -6.1% +24.4% ➖ noise
1 duckdb:duckdb -0.3% +5.3% -5.2% +22.5% ➖ noise
1 duckdb:vortex-compact -2.5% +5.3% -7.3% +21.5% ➖ noise
1 duckdb:vortex-file-compressed -0.7% +5.3% -5.6% +21.5% ➖ noise
2 datafusion:arrow -1.7% +0.1% -1.8% +21.5% ➖ noise
2 datafusion:vortex-compact -0.7% +0.1% -0.8% +21.5% ➖ noise
2 datafusion:vortex-file-compressed -1.5% +0.1% -1.6% +21.5% ➖ noise
2 duckdb:duckdb +12.5% +0.1% +12.3% +21.5% ➖ noise
2 duckdb:vortex-compact +3.5% +0.1% +3.4% +21.5% ➖ noise
2 duckdb:vortex-file-compressed -3.9% +0.1% -4.0% +21.5% ➖ noise
3 datafusion:arrow -0.5% +0.0% -0.5% +21.5% ➖ noise
3 datafusion:vortex-compact +0.0% +0.0% +0.0% +21.5% ➖ noise
3 datafusion:vortex-file-compressed -1.1% +0.0% -1.1% +21.5% ➖ noise
3 duckdb:duckdb +6.0% +0.0% +6.0% +21.5% ➖ noise
3 duckdb:vortex-compact +1.1% +0.0% +1.1% +21.5% ➖ noise
3 duckdb:vortex-file-compressed +4.2% +0.0% +4.2% +21.5% ➖ noise
4 datafusion:arrow -1.9% -4.4% +2.7% +21.5% ➖ noise
4 datafusion:vortex-compact +4.4% -4.4% +9.3% +21.5% ➖ noise
4 datafusion:vortex-file-compressed +2.7% -4.4% +7.4% +21.5% ➖ noise
4 duckdb:duckdb +10.1% -4.4% +15.2% +21.5% ➖ noise
4 duckdb:vortex-compact +3.0% -4.4% +7.8% +21.5% ➖ noise
4 duckdb:vortex-file-compressed -4.4% -4.4% +0.1% +21.5% ➖ noise
5 datafusion:arrow -5.9% +5.4% -10.7% +21.5% ➖ noise
5 datafusion:vortex-compact +4.7% +5.4% -0.7% +21.5% ➖ noise
5 datafusion:vortex-file-compressed +3.4% +5.4% -1.8% +21.5% ➖ noise
5 duckdb:duckdb +4.4% +5.4% -0.9% +21.5% ➖ noise
5 duckdb:vortex-compact +1.0% +5.4% -4.2% +21.5% ➖ noise
5 duckdb:vortex-file-compressed +3.2% +5.4% -2.1% +21.5% ➖ noise
6 datafusion:arrow -1.1% -13.8% +14.8% +23.4% ➖ noise
6 datafusion:vortex-compact -1.9% -13.8% +13.9% +24.4% ➖ noise
6 datafusion:vortex-file-compressed -4.0% -13.8% +11.3% +22.8% ➖ noise
6 duckdb:duckdb -0.2% -13.8% +15.8% +26.7% ➖ noise
6 duckdb:vortex-compact +9.4% -13.8% +27.0% +23.4% 🚨 regression
6 duckdb:vortex-file-compressed -1.7% -13.8% +14.1% +26.6% ➖ noise
7 datafusion:arrow +3.2% -4.9% +8.6% +21.5% ➖ noise
7 datafusion:vortex-compact +4.6% -4.9% +10.1% +21.5% ➖ noise
7 datafusion:vortex-file-compressed -0.4% -4.9% +4.8% +21.5% ➖ noise
7 duckdb:duckdb -3.4% -4.9% +1.6% +21.5% ➖ noise
7 duckdb:vortex-compact +3.1% -4.9% +8.5% +21.5% ➖ noise
7 duckdb:vortex-file-compressed -3.2% -4.9% +1.8% +21.5% ➖ noise
8 datafusion:arrow +9.3% -0.4% +9.7% +21.5% ➖ noise
8 datafusion:vortex-compact +1.6% -0.4% +2.0% +21.5% ➖ noise
8 datafusion:vortex-file-compressed +2.3% -0.4% +2.7% +21.5% ➖ noise
8 duckdb:duckdb -0.6% -0.4% -0.3% +21.5% ➖ noise
8 duckdb:vortex-compact +2.7% -0.4% +3.1% +21.5% ➖ noise
8 duckdb:vortex-file-compressed -1.1% -0.4% -0.8% +21.5% ➖ noise
9 datafusion:arrow +10.5% -0.6% +11.2% +21.5% ➖ noise
9 datafusion:vortex-compact +2.8% -0.6% +3.4% +21.5% ➖ noise
9 datafusion:vortex-file-compressed +4.4% -0.6% +5.0% +21.5% ➖ noise
9 duckdb:duckdb +1.3% -0.6% +1.9% +21.5% ➖ noise
9 duckdb:vortex-compact +3.6% -0.6% +4.2% +21.5% ➖ noise
9 duckdb:vortex-file-compressed +8.3% -0.6% +8.9% +21.5% ➖ noise
10 datafusion:arrow +9.4% -0.3% +9.8% +21.5% ➖ noise
10 datafusion:vortex-compact +1.8% -0.3% +2.1% +21.5% ➖ noise
10 datafusion:vortex-file-compressed +0.0% -0.3% +0.4% +21.5% ➖ noise
10 duckdb:duckdb -0.1% -0.3% +0.2% +21.5% ➖ noise
10 duckdb:vortex-compact +0.3% -0.3% +0.6% +21.5% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -0.3% +0.7% +21.5% ➖ noise
11 datafusion:arrow +3.2% +1.5% +1.7% +21.5% ➖ noise
11 datafusion:vortex-compact +9.8% +1.5% +8.2% +21.5% ➖ noise
11 datafusion:vortex-file-compressed +3.3% +1.5% +1.8% +21.5% ➖ noise
11 duckdb:duckdb -8.9% +1.5% -10.2% +21.5% ➖ noise
11 duckdb:vortex-compact -2.2% +1.5% -3.6% +21.5% ➖ noise
11 duckdb:vortex-file-compressed +0.4% +1.5% -1.1% +21.5% ➖ noise
12 datafusion:arrow -1.7% +8.7% -9.5% +21.5% ➖ noise
12 datafusion:vortex-compact +4.2% +8.7% -4.1% +21.5% ➖ noise
12 datafusion:vortex-file-compressed +6.0% +8.7% -2.5% +21.5% ➖ noise
12 duckdb:duckdb +1.0% +8.7% -7.1% +21.5% ➖ noise
12 duckdb:vortex-compact -1.0% +8.7% -8.9% +21.5% ➖ noise
12 duckdb:vortex-file-compressed +4.9% +8.7% -3.5% +21.5% ➖ noise
13 datafusion:arrow +3.6% -0.6% +4.2% +21.5% ➖ noise
13 datafusion:vortex-compact -1.1% -0.6% -0.6% +21.5% ➖ noise
13 datafusion:vortex-file-compressed -1.6% -0.6% -1.0% +21.5% ➖ noise
13 duckdb:duckdb +1.1% -0.6% +1.7% +21.5% ➖ noise
13 duckdb:vortex-compact +5.7% -0.6% +6.3% +21.5% ➖ noise
13 duckdb:vortex-file-compressed +0.6% -0.6% +1.2% +21.5% ➖ noise
14 datafusion:arrow +3.1% +4.2% -1.0% +21.5% ➖ noise
14 datafusion:vortex-compact -0.1% +4.2% -4.1% +21.5% ➖ noise
14 datafusion:vortex-file-compressed +6.1% +4.2% +1.9% +21.5% ➖ noise
14 duckdb:duckdb +2.5% +4.2% -1.6% +22.1% ➖ noise
14 duckdb:vortex-compact -2.9% +4.2% -6.7% +21.5% ➖ noise
14 duckdb:vortex-file-compressed +2.3% +4.2% -1.7% +21.5% ➖ noise
15 datafusion:arrow +6.1% +15.3% -7.9% +21.5% ➖ noise
15 datafusion:vortex-compact -0.4% +15.3% -13.6% +21.5% ➖ noise
15 datafusion:vortex-file-compressed +1.0% +15.3% -12.3% +22.0% ➖ noise
15 duckdb:duckdb +0.8% +15.3% -12.5% +21.5% ➖ noise
15 duckdb:vortex-compact +0.8% +15.3% -12.6% +21.5% ➖ noise
15 duckdb:vortex-file-compressed +0.1% +15.3% -13.2% +21.5% ➖ noise
16 datafusion:arrow +2.7% +1.8% +0.9% +21.5% ➖ noise
16 datafusion:vortex-compact -3.3% +1.8% -5.0% +21.5% ➖ noise
16 datafusion:vortex-file-compressed -4.1% +1.8% -5.8% +21.5% ➖ noise
16 duckdb:duckdb +0.0% +1.8% -1.7% +21.5% ➖ noise
16 duckdb:vortex-compact -1.3% +1.8% -3.1% +21.5% ➖ noise
16 duckdb:vortex-file-compressed -2.6% +1.8% -4.3% +21.5% ➖ noise
17 datafusion:arrow +3.2% +6.2% -2.9% +21.5% ➖ noise
17 datafusion:vortex-compact +3.3% +6.2% -2.8% +21.5% ➖ noise
17 datafusion:vortex-file-compressed +1.2% +6.2% -4.7% +21.5% ➖ noise
17 duckdb:duckdb +6.6% +6.2% +0.4% +21.5% ➖ noise
17 duckdb:vortex-compact -1.9% +6.2% -7.7% +21.5% ➖ noise
17 duckdb:vortex-file-compressed +0.1% +6.2% -5.7% +21.5% ➖ noise
18 datafusion:arrow -0.4% +3.3% -3.6% +21.5% ➖ noise
18 datafusion:vortex-compact -1.2% +3.3% -4.3% +21.5% ➖ noise
18 datafusion:vortex-file-compressed +3.1% +3.3% -0.2% +21.5% ➖ noise
18 duckdb:duckdb +2.8% +3.3% -0.4% +21.5% ➖ noise
18 duckdb:vortex-compact +0.5% +3.3% -2.7% +21.5% ➖ noise
18 duckdb:vortex-file-compressed -3.4% +3.3% -6.5% +21.5% ➖ noise
19 datafusion:arrow +1.0% +25.5% -19.5% +21.5% ✅ faster
19 datafusion:vortex-compact +1.0% +25.5% -19.5% +21.5% ✅ faster
19 datafusion:vortex-file-compressed -2.6% +25.5% -22.4% +21.5% ✅ faster
19 duckdb:duckdb +6.9% +25.5% -14.8% +21.5% ➖ noise
19 duckdb:vortex-compact -1.2% +25.5% -21.2% +21.5% ✅ faster
19 duckdb:vortex-file-compressed +5.6% +25.5% -15.8% +21.5% ➖ noise
20 datafusion:arrow -8.8% -9.1% +0.3% +21.5% ➖ noise
20 datafusion:vortex-compact +0.4% -9.1% +10.5% +21.5% ➖ noise
20 datafusion:vortex-file-compressed +1.7% -9.1% +11.9% +21.5% ➖ noise
20 duckdb:duckdb -0.6% -9.1% +9.4% +21.5% ➖ noise
20 duckdb:vortex-compact -0.6% -9.1% +9.4% +21.5% ➖ noise
20 duckdb:vortex-file-compressed -0.9% -9.1% +9.1% +21.5% ➖ noise
21 datafusion:arrow -0.6% +2.7% -3.2% +21.5% ➖ noise
21 datafusion:vortex-compact +4.7% +2.7% +2.0% +21.5% ➖ noise
21 datafusion:vortex-file-compressed +0.6% +2.7% -2.1% +21.5% ➖ noise
21 duckdb:duckdb -1.4% +2.7% -4.0% +21.5% ➖ noise
21 duckdb:vortex-compact +1.8% +2.7% -0.9% +21.5% ➖ noise
21 duckdb:vortex-file-compressed -0.8% +2.7% -3.5% +21.5% ➖ noise
22 datafusion:arrow -0.7% +0.2% -0.9% +21.5% ➖ noise
22 datafusion:vortex-compact +2.7% +0.2% +2.6% +21.5% ➖ noise
22 datafusion:vortex-file-compressed +2.9% +0.2% +2.7% +21.5% ➖ noise
22 duckdb:duckdb +6.7% +0.2% +6.5% +21.5% ➖ noise
22 duckdb:vortex-compact -0.5% +0.2% -0.7% +21.5% ➖ noise
22 duckdb:vortex-file-compressed -0.2% +0.2% -0.4% +21.5% ➖ noise

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.931x ➖
Parquet (geomean): 0.945x ➖
Shifts: Parquet (control) -5.5% · Median polish -6.3%

datafusion / vortex-file-compressed (0.906x ➖, 4↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5025154 5652316 0.89
fineweb_q01/datafusion:vortex-file-compressed 26893686 27405525 0.98
fineweb_q02/datafusion:vortex-file-compressed 🚨 36187208 32741003 1.11
fineweb_q03/datafusion:vortex-file-compressed 🚀 74432345 100207381 0.74
fineweb_q04/datafusion:vortex-file-compressed 264668363 265947380 1.00
fineweb_q05/datafusion:vortex-file-compressed 228336938 244930521 0.93
fineweb_q06/datafusion:vortex-file-compressed 🚀 62958420 78072124 0.81
fineweb_q07/datafusion:vortex-file-compressed 🚀 65902806 79282022 0.83
fineweb_q08/datafusion:vortex-file-compressed 25498538 27620783 0.92
datafusion / vortex-compact (0.943x ➖, 1↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5681469 5490308 1.03
fineweb_q01/datafusion:vortex-compact 162706398 176873796 0.92
fineweb_q02/datafusion:vortex-compact 165429918 174665118 0.95
fineweb_q03/datafusion:vortex-compact 1444104769 1578103796 0.92
fineweb_q04/datafusion:vortex-compact 1584827760 1686100472 0.94
fineweb_q05/datafusion:vortex-compact 1243002764 1317098744 0.94
fineweb_q06/datafusion:vortex-compact 698087030 729159992 0.96
fineweb_q07/datafusion:vortex-compact 736844181 782670337 0.94
fineweb_q08/datafusion:vortex-compact 🚀 22083758 24625299 0.90
datafusion / parquet (0.933x ➖, 1↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6476883 6625341 0.98
fineweb_q01/datafusion:parquet 266900306 292221965 0.91
fineweb_q02/datafusion:parquet 🚀 268287078 300188017 0.89
fineweb_q03/datafusion:parquet 280514049 293479282 0.96
fineweb_q04/datafusion:parquet 286403706 308740773 0.93
fineweb_q05/datafusion:parquet 282367595 304143703 0.93
fineweb_q06/datafusion:parquet 273064504 295443143 0.92
fineweb_q07/datafusion:parquet 270728104 287985719 0.94
fineweb_q08/datafusion:parquet 265738811 283579906 0.94
duckdb / vortex-file-compressed (0.926x ➖, 3↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3649929 3923565 0.93
fineweb_q01/duckdb:vortex-file-compressed 🚀 26592548 29799186 0.89
fineweb_q02/duckdb:vortex-file-compressed 27049045 29634614 0.91
fineweb_q03/duckdb:vortex-file-compressed 🚀 126295649 147849179 0.85
fineweb_q04/duckdb:vortex-file-compressed 228475442 234596129 0.97
fineweb_q05/duckdb:vortex-file-compressed 220945268 224462053 0.98
fineweb_q06/duckdb:vortex-file-compressed 67523398 70683167 0.96
fineweb_q07/duckdb:vortex-file-compressed 🚀 64955933 72538847 0.90
fineweb_q08/duckdb:vortex-file-compressed 25281004 26912769 0.94
duckdb / vortex-compact (0.949x ➖, 1↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4155583 4633320 0.90
fineweb_q01/duckdb:vortex-compact 111233244 113529242 0.98
fineweb_q02/duckdb:vortex-compact 114883580 117128346 0.98
fineweb_q03/duckdb:vortex-compact 856030903 915427403 0.94
fineweb_q04/duckdb:vortex-compact 909447593 970055391 0.94
fineweb_q05/duckdb:vortex-compact 822396948 873065779 0.94
fineweb_q06/duckdb:vortex-compact 470073994 493278214 0.95
fineweb_q07/duckdb:vortex-compact 475057437 503133892 0.94
fineweb_q08/duckdb:vortex-compact 24380171 24974386 0.98
duckdb / parquet (0.958x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37527261 37951087 0.99
fineweb_q01/duckdb:parquet 93998240 99170587 0.95
fineweb_q02/duckdb:parquet 96947949 103872814 0.93
fineweb_q03/duckdb:parquet 310284713 334266877 0.93
fineweb_q04/duckdb:parquet 439797354 458705879 0.96
fineweb_q05/duckdb:parquet 411954966 422212129 0.98
fineweb_q06/duckdb:parquet 200882079 207597907 0.97
fineweb_q07/duckdb:parquet 210396212 221243088 0.95
fineweb_q08/duckdb:parquet 60374050 61938751 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +3.5% -1.7% +5.3% +40.5% ➖ noise
0 datafusion:vortex-file-compressed -11.1% -1.7% -9.6% +61.1% ➖ noise
0 duckdb:vortex-compact -10.3% -1.7% -8.8% +34.4% ➖ noise
0 duckdb:vortex-file-compressed -7.0% -1.7% -5.4% +42.1% ➖ noise
1 datafusion:vortex-compact -8.0% -7.0% -1.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -1.9% -7.0% +5.5% +13.0% ➖ noise
1 duckdb:vortex-compact -2.0% -7.0% +5.3% +22.1% ➖ noise
1 duckdb:vortex-file-compressed -10.8% -7.0% -4.1% +35.9% ➖ noise
2 datafusion:vortex-compact -5.3% -8.7% +3.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +10.5% -8.7% +21.0% +24.9% ➖ noise
2 duckdb:vortex-compact -1.9% -8.7% +7.4% +11.2% ➖ noise
2 duckdb:vortex-file-compressed -8.7% -8.7% -0.1% +10.8% ➖ noise
3 datafusion:vortex-compact -8.5% -5.8% -2.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -25.7% -5.8% -21.1% +29.3% ➖ noise
3 duckdb:vortex-compact -6.5% -5.8% -0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -14.6% -5.8% -9.3% +28.6% ➖ noise
4 datafusion:vortex-compact -6.0% -5.7% -0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.5% -5.7% +5.5% +10.0% ➖ noise
4 duckdb:vortex-compact -6.2% -5.7% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% -5.7% +3.3% +10.0% ➖ noise
5 datafusion:vortex-compact -5.6% -4.8% -0.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.8% -4.8% -2.0% +11.1% ➖ noise
5 duckdb:vortex-compact -5.8% -4.8% -1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.6% -4.8% +3.4% +10.0% ➖ noise
6 datafusion:vortex-compact -4.3% -5.4% +1.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -19.4% -5.4% -14.7% +25.0% ➖ noise
6 duckdb:vortex-compact -4.7% -5.4% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.5% -5.4% +1.0% +16.0% ➖ noise
7 datafusion:vortex-compact -5.9% -5.4% -0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -16.9% -5.4% -12.1% +10.2% ✅ faster
7 duckdb:vortex-compact -5.6% -5.4% -0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -10.5% -5.4% -5.3% +12.7% ➖ noise
8 datafusion:vortex-compact -10.3% -4.4% -6.2% +17.5% ➖ noise
8 datafusion:vortex-file-compressed -7.7% -4.4% -3.4% +30.7% ➖ noise
8 duckdb:vortex-compact -2.4% -4.4% +2.1% +18.4% ➖ noise
8 duckdb:vortex-file-compressed -6.1% -4.4% -1.7% +11.8% ➖ noise

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.943x ➖
Parquet (geomean): 0.950x ➖
Shifts: Parquet (control) -5.0% · Median polish -5.5%

datafusion / vortex-file-compressed (0.936x ➖, 8↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27578155 29590450 0.93
tpcds_q02/datafusion:vortex-file-compressed 52522390 56861591 0.92
tpcds_q03/datafusion:vortex-file-compressed 20498241 21677754 0.95
tpcds_q04/datafusion:vortex-file-compressed 291588752 320075734 0.91
tpcds_q05/datafusion:vortex-file-compressed 56089291 56893872 0.99
tpcds_q06/datafusion:vortex-file-compressed 52505540 56178729 0.93
tpcds_q07/datafusion:vortex-file-compressed 51644383 53907288 0.96
tpcds_q08/datafusion:vortex-file-compressed 37630844 40523361 0.93
tpcds_q09/datafusion:vortex-file-compressed 55364337 58873470 0.94
tpcds_q10/datafusion:vortex-file-compressed 47775001 49130665 0.97
tpcds_q11/datafusion:vortex-file-compressed 168323183 185259967 0.91
tpcds_q12/datafusion:vortex-file-compressed 23577527 24926273 0.95
tpcds_q13/datafusion:vortex-file-compressed 60599331 65610402 0.92
tpcds_q14/datafusion:vortex-file-compressed 202847871 210664246 0.96
tpcds_q15/datafusion:vortex-file-compressed 34392334 36094265 0.95
tpcds_q16/datafusion:vortex-file-compressed 28812002 30614991 0.94
tpcds_q17/datafusion:vortex-file-compressed 68256958 70391083 0.97
tpcds_q18/datafusion:vortex-file-compressed 78592283 83459482 0.94
tpcds_q19/datafusion:vortex-file-compressed 31214582 34485737 0.91
tpcds_q20/datafusion:vortex-file-compressed 26354314 27815263 0.95
tpcds_q21/datafusion:vortex-file-compressed 140258252 148876729 0.94
tpcds_q22/datafusion:vortex-file-compressed 57966246 63410065 0.91
tpcds_q23/datafusion:vortex-file-compressed 148201360 160830668 0.92
tpcds_q24/datafusion:vortex-file-compressed 112585646 121046810 0.93
tpcds_q25/datafusion:vortex-file-compressed 67180108 71581654 0.94
tpcds_q26/datafusion:vortex-file-compressed 38042454 39571804 0.96
tpcds_q27/datafusion:vortex-file-compressed 118885134 129098940 0.92
tpcds_q28/datafusion:vortex-file-compressed 49437189 50344100 0.98
tpcds_q29/datafusion:vortex-file-compressed 69019832 71232957 0.97
tpcds_q30/datafusion:vortex-file-compressed 🚀 30746456 35149602 0.87
tpcds_q31/datafusion:vortex-file-compressed 99032912 106153214 0.93
tpcds_q32/datafusion:vortex-file-compressed 22262966 24457333 0.91
tpcds_q33/datafusion:vortex-file-compressed 39424022 41475939 0.95
tpcds_q34/datafusion:vortex-file-compressed 34565663 36461468 0.95
tpcds_q35/datafusion:vortex-file-compressed 55738404 60577702 0.92
tpcds_q36/datafusion:vortex-file-compressed 74510469 80853939 0.92
tpcds_q37/datafusion:vortex-file-compressed 🚀 33548483 38075228 0.88
tpcds_q38/datafusion:vortex-file-compressed 53929088 59202166 0.91
tpcds_q39/datafusion:vortex-file-compressed 151341692 154231891 0.98
tpcds_q40/datafusion:vortex-file-compressed 53081669 56436388 0.94
tpcds_q41/datafusion:vortex-file-compressed 🚀 17593050 20433926 0.86
tpcds_q42/datafusion:vortex-file-compressed 18720715 20792054 0.90
tpcds_q43/datafusion:vortex-file-compressed 32766770 35819053 0.91
tpcds_q44/datafusion:vortex-file-compressed 47727749 49350650 0.97
tpcds_q45/datafusion:vortex-file-compressed 35929413 36782978 0.98
tpcds_q46/datafusion:vortex-file-compressed 49183101 53783930 0.91
tpcds_q47/datafusion:vortex-file-compressed 204192880 220697514 0.93
tpcds_q48/datafusion:vortex-file-compressed 48821565 51825282 0.94
tpcds_q49/datafusion:vortex-file-compressed 67600950 75053559 0.90
tpcds_q50/datafusion:vortex-file-compressed 47524347 50111658 0.95
tpcds_q51/datafusion:vortex-file-compressed 91292036 97186791 0.94
tpcds_q52/datafusion:vortex-file-compressed 19337751 20234831 0.96
tpcds_q53/datafusion:vortex-file-compressed 26343684 28181104 0.93
tpcds_q54/datafusion:vortex-file-compressed 45029233 48854564 0.92
tpcds_q55/datafusion:vortex-file-compressed 19078218 20213174 0.94
tpcds_q56/datafusion:vortex-file-compressed 41947997 45265429 0.93
tpcds_q57/datafusion:vortex-file-compressed 127856673 135507902 0.94
tpcds_q58/datafusion:vortex-file-compressed 71022211 75496529 0.94
tpcds_q59/datafusion:vortex-file-compressed 74256977 76888353 0.97
tpcds_q60/datafusion:vortex-file-compressed 41679165 43637865 0.96
tpcds_q61/datafusion:vortex-file-compressed 52545178 56334229 0.93
tpcds_q62/datafusion:vortex-file-compressed 30415046 33184046 0.92
tpcds_q63/datafusion:vortex-file-compressed 25983888 27172243 0.96
tpcds_q64/datafusion:vortex-file-compressed 473709570 507997081 0.93
tpcds_q65/datafusion:vortex-file-compressed 48690199 51118001 0.95
tpcds_q66/datafusion:vortex-file-compressed 90059111 94929761 0.95
tpcds_q67/datafusion:vortex-file-compressed 125849070 124214971 1.01
tpcds_q68/datafusion:vortex-file-compressed 48252294 52712432 0.92
tpcds_q69/datafusion:vortex-file-compressed 45674229 46193073 0.99
tpcds_q70/datafusion:vortex-file-compressed 112891335 123411785 0.91
tpcds_q71/datafusion:vortex-file-compressed 32597225 34107624 0.96
tpcds_q72/datafusion:vortex-file-compressed 2574500668 2757578514 0.93
tpcds_q73/datafusion:vortex-file-compressed 35734724 37948927 0.94
tpcds_q74/datafusion:vortex-file-compressed 117949890 125091842 0.94
tpcds_q75/datafusion:vortex-file-compressed 🚀 115900040 129791179 0.89
tpcds_q76/datafusion:vortex-file-compressed 35384646 38173722 0.93
tpcds_q77/datafusion:vortex-file-compressed 51528318 55243255 0.93
tpcds_q78/datafusion:vortex-file-compressed 126090322 132540593 0.95
tpcds_q79/datafusion:vortex-file-compressed 🚀 40539464 45418121 0.89
tpcds_q80/datafusion:vortex-file-compressed 112646013 121716437 0.93
tpcds_q81/datafusion:vortex-file-compressed 36123740 38248161 0.94
tpcds_q82/datafusion:vortex-file-compressed 35392027 37025223 0.96
tpcds_q83/datafusion:vortex-file-compressed 51551382 53489898 0.96
tpcds_q84/datafusion:vortex-file-compressed 15240654 16550662 0.92
tpcds_q85/datafusion:vortex-file-compressed 100789986 107593843 0.94
tpcds_q86/datafusion:vortex-file-compressed 🚀 18559401 21024455 0.88
tpcds_q87/datafusion:vortex-file-compressed 56373883 55402784 1.02
tpcds_q88/datafusion:vortex-file-compressed 85718460 87171015 0.98
tpcds_q89/datafusion:vortex-file-compressed 36412111 38469311 0.95
tpcds_q90/datafusion:vortex-file-compressed 18731487 19755551 0.95
tpcds_q91/datafusion:vortex-file-compressed 26541031 29024737 0.91
tpcds_q92/datafusion:vortex-file-compressed 🚀 18496308 21060632 0.88
tpcds_q93/datafusion:vortex-file-compressed 34188376 37693711 0.91
tpcds_q94/datafusion:vortex-file-compressed 25338002 26909351 0.94
tpcds_q95/datafusion:vortex-file-compressed 62037370 63017962 0.98
tpcds_q96/datafusion:vortex-file-compressed 17792864 19453657 0.91
tpcds_q97/datafusion:vortex-file-compressed 🚀 31614778 36459903 0.87
tpcds_q98/datafusion:vortex-file-compressed 32590580 34425556 0.95
tpcds_q99/datafusion:vortex-file-compressed 45632997 46952340 0.97
datafusion / vortex-compact (0.938x ➖, 6↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 36514042 38807141 0.94
tpcds_q02/datafusion:vortex-compact 56881844 60799165 0.94
tpcds_q03/datafusion:vortex-compact 25620285 26782795 0.96
tpcds_q04/datafusion:vortex-compact 326008864 354571108 0.92
tpcds_q05/datafusion:vortex-compact 65159718 68762827 0.95
tpcds_q06/datafusion:vortex-compact 55964024 60318725 0.93
tpcds_q07/datafusion:vortex-compact 65584222 71294507 0.92
tpcds_q08/datafusion:vortex-compact 44820514 46880375 0.96
tpcds_q09/datafusion:vortex-compact 101811626 107184620 0.95
tpcds_q10/datafusion:vortex-compact 62234746 65070160 0.96
tpcds_q11/datafusion:vortex-compact 186730630 197018488 0.95
tpcds_q12/datafusion:vortex-compact 25789027 26712549 0.97
tpcds_q13/datafusion:vortex-compact 133415127 135340038 0.99
tpcds_q14/datafusion:vortex-compact 251260962 262494522 0.96
tpcds_q15/datafusion:vortex-compact 38996935 40143246 0.97
tpcds_q16/datafusion:vortex-compact 39782766 40382013 0.99
tpcds_q17/datafusion:vortex-compact 91534473 97656852 0.94
tpcds_q18/datafusion:vortex-compact 91483121 99822141 0.92
tpcds_q19/datafusion:vortex-compact 42722527 45601704 0.94
tpcds_q20/datafusion:vortex-compact 30594087 33326094 0.92
tpcds_q21/datafusion:vortex-compact 146407645 149649646 0.98
tpcds_q22/datafusion:vortex-compact 65580720 67487058 0.97
tpcds_q23/datafusion:vortex-compact 184375321 198012126 0.93
tpcds_q24/datafusion:vortex-compact 135937423 145394768 0.93
tpcds_q25/datafusion:vortex-compact 93122485 97318884 0.96
tpcds_q26/datafusion:vortex-compact 46686866 49019423 0.95
tpcds_q27/datafusion:vortex-compact 155548361 161708772 0.96
tpcds_q28/datafusion:vortex-compact 100709672 103373856 0.97
tpcds_q29/datafusion:vortex-compact 92589559 98985423 0.94
tpcds_q30/datafusion:vortex-compact 35164236 39060941 0.90
tpcds_q31/datafusion:vortex-compact 125901670 133295201 0.94
tpcds_q32/datafusion:vortex-compact 26383251 28824177 0.92
tpcds_q33/datafusion:vortex-compact 51790892 55229360 0.94
tpcds_q34/datafusion:vortex-compact 47953406 50884166 0.94
tpcds_q35/datafusion:vortex-compact 68134089 74999403 0.91
tpcds_q36/datafusion:vortex-compact 96640500 104236542 0.93
tpcds_q37/datafusion:vortex-compact 🚀 47045427 52534091 0.90
tpcds_q38/datafusion:vortex-compact 64605276 71407419 0.90
tpcds_q39/datafusion:vortex-compact 🚀 153872764 171918629 0.90
tpcds_q40/datafusion:vortex-compact 🚀 57574454 64945365 0.89
tpcds_q41/datafusion:vortex-compact 🚀 19358384 23716252 0.82
tpcds_q42/datafusion:vortex-compact 24666061 26857998 0.92
tpcds_q43/datafusion:vortex-compact 37508942 41338526 0.91
tpcds_q44/datafusion:vortex-compact 76494662 79082709 0.97
tpcds_q45/datafusion:vortex-compact 🚀 36405676 40637667 0.90
tpcds_q46/datafusion:vortex-compact 68013705 71636255 0.95
tpcds_q47/datafusion:vortex-compact 225753284 245781826 0.92
tpcds_q48/datafusion:vortex-compact 98832964 100724088 0.98
tpcds_q49/datafusion:vortex-compact 98721778 102340403 0.96
tpcds_q50/datafusion:vortex-compact 62615087 68246008 0.92
tpcds_q51/datafusion:vortex-compact 94984214 103197334 0.92
tpcds_q52/datafusion:vortex-compact 24404918 26327473 0.93
tpcds_q53/datafusion:vortex-compact 33996323 37247034 0.91
tpcds_q54/datafusion:vortex-compact 56911982 60951693 0.93
tpcds_q55/datafusion:vortex-compact 24159527 25319483 0.95
tpcds_q56/datafusion:vortex-compact 53850543 57439788 0.94
tpcds_q57/datafusion:vortex-compact 138423781 149739454 0.92
tpcds_q58/datafusion:vortex-compact 78266393 82123845 0.95
tpcds_q59/datafusion:vortex-compact 85858095 90517716 0.95
tpcds_q60/datafusion:vortex-compact 53775039 57094022 0.94
tpcds_q61/datafusion:vortex-compact 69893895 72836247 0.96
tpcds_q62/datafusion:vortex-compact 🚀 32113880 36325664 0.88
tpcds_q63/datafusion:vortex-compact 35614201 36909165 0.96
tpcds_q64/datafusion:vortex-compact 531260109 564306963 0.94
tpcds_q65/datafusion:vortex-compact 68787846 67352729 1.02
tpcds_q66/datafusion:vortex-compact 100058501 104511238 0.96
tpcds_q67/datafusion:vortex-compact 129606306 136217868 0.95
tpcds_q68/datafusion:vortex-compact 67775955 71978887 0.94
tpcds_q69/datafusion:vortex-compact 58493478 62846181 0.93
tpcds_q70/datafusion:vortex-compact 120663688 131786862 0.92
tpcds_q71/datafusion:vortex-compact 45482323 46027998 0.99
tpcds_q72/datafusion:vortex-compact 2580795791 2807949499 0.92
tpcds_q73/datafusion:vortex-compact 50043472 53525796 0.93
tpcds_q74/datafusion:vortex-compact 132725878 139280080 0.95
tpcds_q75/datafusion:vortex-compact 164031111 173092818 0.95
tpcds_q76/datafusion:vortex-compact 51146379 53933799 0.95
tpcds_q77/datafusion:vortex-compact 65959067 69202820 0.95
tpcds_q78/datafusion:vortex-compact 147814317 157843271 0.94
tpcds_q79/datafusion:vortex-compact 59042073 61745637 0.96
tpcds_q80/datafusion:vortex-compact 128754141 138637069 0.93
tpcds_q81/datafusion:vortex-compact 42320630 44720988 0.95
tpcds_q82/datafusion:vortex-compact 48348510 53022624 0.91
tpcds_q83/datafusion:vortex-compact 59909931 64363257 0.93
tpcds_q84/datafusion:vortex-compact 18866241 20917372 0.90
tpcds_q85/datafusion:vortex-compact 125717569 134694618 0.93
tpcds_q86/datafusion:vortex-compact 20094129 22088450 0.91
tpcds_q87/datafusion:vortex-compact 65282602 69978003 0.93
tpcds_q88/datafusion:vortex-compact 130461878 133846641 0.97
tpcds_q89/datafusion:vortex-compact 43864673 45454890 0.97
tpcds_q90/datafusion:vortex-compact 24879141 25953565 0.96
tpcds_q91/datafusion:vortex-compact 40805811 44382417 0.92
tpcds_q92/datafusion:vortex-compact 21019377 22908432 0.92
tpcds_q93/datafusion:vortex-compact 48353908 50222819 0.96
tpcds_q94/datafusion:vortex-compact 30915677 34161338 0.90
tpcds_q95/datafusion:vortex-compact 70686734 74767272 0.95
tpcds_q96/datafusion:vortex-compact 25250146 26454441 0.95
tpcds_q97/datafusion:vortex-compact 40779995 43841034 0.93
tpcds_q98/datafusion:vortex-compact 36616031 40298536 0.91
tpcds_q99/datafusion:vortex-compact 51218897 52593135 0.97
datafusion / parquet (0.934x ➖, 10↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36272704 38128067 0.95
tpcds_q02/datafusion:parquet 47170365 49693670 0.95
tpcds_q03/datafusion:parquet 15167031 15531025 0.98
tpcds_q04/datafusion:parquet 310096463 339860981 0.91
tpcds_q05/datafusion:parquet 52503293 54860480 0.96
tpcds_q06/datafusion:parquet 66173878 67088235 0.99
tpcds_q07/datafusion:parquet 88884038 93548200 0.95
tpcds_q08/datafusion:parquet 32022256 34833471 0.92
tpcds_q09/datafusion:parquet 57411681 58656292 0.98
tpcds_q10/datafusion:parquet 84933650 87296079 0.97
tpcds_q11/datafusion:parquet 182433525 188912527 0.97
tpcds_q12/datafusion:parquet 23585641 23971075 0.98
tpcds_q13/datafusion:parquet 85410155 90245081 0.95
tpcds_q14/datafusion:parquet 191642065 204192042 0.94
tpcds_q15/datafusion:parquet 26171344 27164328 0.96
tpcds_q16/datafusion:parquet 28377216 30615246 0.93
tpcds_q17/datafusion:parquet 71213185 73714817 0.97
tpcds_q18/datafusion:parquet 130084993 138453144 0.94
tpcds_q19/datafusion:parquet 27354215 29968962 0.91
tpcds_q20/datafusion:parquet 21186863 22159501 0.96
tpcds_q21/datafusion:parquet 22193289 24609062 0.90
tpcds_q22/datafusion:parquet 🚀 131402761 151835701 0.87
tpcds_q23/datafusion:parquet 161897967 175592133 0.92
tpcds_q24/datafusion:parquet 101911626 110305551 0.92
tpcds_q25/datafusion:parquet 71283479 72763822 0.98
tpcds_q26/datafusion:parquet 75492233 79198150 0.95
tpcds_q27/datafusion:parquet 161860264 168708785 0.96
tpcds_q28/datafusion:parquet 47695675 50735242 0.94
tpcds_q29/datafusion:parquet 72997586 75862679 0.96
tpcds_q30/datafusion:parquet 43949461 46874952 0.94
tpcds_q31/datafusion:parquet 76668798 79935428 0.96
tpcds_q32/datafusion:parquet 🚀 21360256 24257752 0.88
tpcds_q33/datafusion:parquet 34086613 37241915 0.92
tpcds_q34/datafusion:parquet 27207071 29366157 0.93
tpcds_q35/datafusion:parquet 84712934 92147220 0.92
tpcds_q36/datafusion:parquet 63526306 69885747 0.91
tpcds_q37/datafusion:parquet 🚀 22422466 25166961 0.89
tpcds_q38/datafusion:parquet 50153619 53355085 0.94
tpcds_q39/datafusion:parquet 84345052 91302238 0.92
tpcds_q40/datafusion:parquet 27433915 28039497 0.98
tpcds_q41/datafusion:parquet 16040184 17444332 0.92
tpcds_q42/datafusion:parquet 13644583 14483127 0.94
tpcds_q43/datafusion:parquet 19086898 20344127 0.94
tpcds_q44/datafusion:parquet 42270096 45010144 0.94
tpcds_q45/datafusion:parquet 32585374 35210488 0.93
tpcds_q46/datafusion:parquet 39144627 39560738 0.99
tpcds_q47/datafusion:parquet 135262829 142038133 0.95
tpcds_q48/datafusion:parquet 78823739 81987914 0.96
tpcds_q49/datafusion:parquet 66543925 68685457 0.97
tpcds_q50/datafusion:parquet 48095890 53168495 0.90
tpcds_q51/datafusion:parquet 88760209 96952124 0.92
tpcds_q52/datafusion:parquet 14303492 15276588 0.94
tpcds_q53/datafusion:parquet 21521535 23865203 0.90
tpcds_q54/datafusion:parquet 42926705 45406924 0.95
tpcds_q55/datafusion:parquet 14150994 14648363 0.97
tpcds_q56/datafusion:parquet 35831587 36374505 0.99
tpcds_q57/datafusion:parquet 115577030 118827811 0.97
tpcds_q58/datafusion:parquet 59519521 61866324 0.96
tpcds_q59/datafusion:parquet 58726903 61706432 0.95
tpcds_q60/datafusion:parquet 34859882 37551025 0.93
tpcds_q61/datafusion:parquet 51126083 53718917 0.95
tpcds_q62/datafusion:parquet 28182330 30087832 0.94
tpcds_q63/datafusion:parquet 21411235 23343774 0.92
tpcds_q64/datafusion:parquet 547689158 595962121 0.92
tpcds_q65/datafusion:parquet 🚀 42919976 51369825 0.84
tpcds_q66/datafusion:parquet 🚀 75081475 83995559 0.89
tpcds_q67/datafusion:parquet 149245661 164758534 0.91
tpcds_q68/datafusion:parquet 🚀 38160122 43344947 0.88
tpcds_q69/datafusion:parquet 78466365 83570716 0.94
tpcds_q70/datafusion:parquet 94716786 101760792 0.93
tpcds_q71/datafusion:parquet 26364071 28111619 0.94
tpcds_q72/datafusion:parquet 633400977 680083838 0.93
tpcds_q73/datafusion:parquet 26735010 28946126 0.92
tpcds_q74/datafusion:parquet 102862318 112181706 0.92
tpcds_q75/datafusion:parquet 113526907 124432700 0.91
tpcds_q76/datafusion:parquet 36359435 37855072 0.96
tpcds_q77/datafusion:parquet 49548543 51384507 0.96
tpcds_q78/datafusion:parquet 122514535 132401653 0.93
tpcds_q79/datafusion:parquet 30531718 33045887 0.92
tpcds_q80/datafusion:parquet 94075186 100295444 0.94
tpcds_q81/datafusion:parquet 40911729 44289541 0.92
tpcds_q82/datafusion:parquet 🚀 22135818 25960517 0.85
tpcds_q83/datafusion:parquet 47569878 51059763 0.93
tpcds_q84/datafusion:parquet 47971327 49250271 0.97
tpcds_q85/datafusion:parquet 169636100 184546790 0.92
tpcds_q86/datafusion:parquet 🚀 17548842 19846738 0.88
tpcds_q87/datafusion:parquet 48813162 53498892 0.91
tpcds_q88/datafusion:parquet 70120404 72604819 0.97
tpcds_q89/datafusion:parquet 24118389 25446893 0.95
tpcds_q90/datafusion:parquet 18938386 20639788 0.92
tpcds_q91/datafusion:parquet 70435401 74378018 0.95
tpcds_q92/datafusion:parquet 22085663 23413115 0.94
tpcds_q93/datafusion:parquet 34539477 37403481 0.92
tpcds_q94/datafusion:parquet 24177258 26078058 0.93
tpcds_q95/datafusion:parquet 69769637 71134727 0.98
tpcds_q96/datafusion:parquet 🚀 14304209 16093471 0.89
tpcds_q97/datafusion:parquet 33323713 35013844 0.95
tpcds_q98/datafusion:parquet 25845244 28504457 0.91
tpcds_q99/datafusion:parquet 🚀 27932745 32019303 0.87
duckdb / vortex-file-compressed (0.945x ➖, 9↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25012991 26949261 0.93
tpcds_q02/duckdb:vortex-file-compressed 82801640 87611207 0.95
tpcds_q03/duckdb:vortex-file-compressed 23569152 25606436 0.92
tpcds_q04/duckdb:vortex-file-compressed 109788952 107946390 1.02
tpcds_q05/duckdb:vortex-file-compressed 99250915 105292986 0.94
tpcds_q06/duckdb:vortex-file-compressed 36367363 38198299 0.95
tpcds_q07/duckdb:vortex-file-compressed 🚀 23642978 27579463 0.86
tpcds_q08/duckdb:vortex-file-compressed 23698482 24464620 0.97
tpcds_q09/duckdb:vortex-file-compressed 40135255 40105769 1.00
tpcds_q10/duckdb:vortex-file-compressed 36886081 39194459 0.94
tpcds_q11/duckdb:vortex-file-compressed 62084264 63592865 0.98
tpcds_q12/duckdb:vortex-file-compressed 14469686 15086637 0.96
tpcds_q13/duckdb:vortex-file-compressed 34552946 35957774 0.96
tpcds_q14/duckdb:vortex-file-compressed 197544627 203499047 0.97
tpcds_q15/duckdb:vortex-file-compressed 43223788 43602907 0.99
tpcds_q16/duckdb:vortex-file-compressed 🚀 28549823 32020381 0.89
tpcds_q17/duckdb:vortex-file-compressed 38234024 41868527 0.91
tpcds_q18/duckdb:vortex-file-compressed 47336787 49691096 0.95
tpcds_q19/duckdb:vortex-file-compressed 33875610 36219780 0.94
tpcds_q20/duckdb:vortex-file-compressed 15806954 17435074 0.91
tpcds_q21/duckdb:vortex-file-compressed 21628005 21632835 1.00
tpcds_q22/duckdb:vortex-file-compressed 107217895 113956639 0.94
tpcds_q23/duckdb:vortex-file-compressed 🚀 119133134 137451626 0.87
tpcds_q24/duckdb:vortex-file-compressed 55215517 59542837 0.93
tpcds_q25/duckdb:vortex-file-compressed 38416133 40374441 0.95
tpcds_q26/duckdb:vortex-file-compressed 39856860 43567324 0.91
tpcds_q27/duckdb:vortex-file-compressed 86795748 93489554 0.93
tpcds_q28/duckdb:vortex-file-compressed 35119386 38034187 0.92
tpcds_q29/duckdb:vortex-file-compressed 37559390 38946213 0.96
tpcds_q30/duckdb:vortex-file-compressed 29177873 30091341 0.97
tpcds_q31/duckdb:vortex-file-compressed 25534350 27333644 0.93
tpcds_q32/duckdb:vortex-file-compressed 16048046 17524145 0.92
tpcds_q33/duckdb:vortex-file-compressed 65689838 72681162 0.90
tpcds_q34/duckdb:vortex-file-compressed 19127406 19977666 0.96
tpcds_q35/duckdb:vortex-file-compressed 🚀 61495385 68605035 0.90
tpcds_q36/duckdb:vortex-file-compressed 27350741 28255976 0.97
tpcds_q37/duckdb:vortex-file-compressed 21286444 22860739 0.93
tpcds_q38/duckdb:vortex-file-compressed 37347857 38544146 0.97
tpcds_q39/duckdb:vortex-file-compressed 45875307 47403207 0.97
tpcds_q40/duckdb:vortex-file-compressed 25037119 24998459 1.00
tpcds_q41/duckdb:vortex-file-compressed 🚀 13033095 14987560 0.87
tpcds_q42/duckdb:vortex-file-compressed 12178940 12729726 0.96
tpcds_q43/duckdb:vortex-file-compressed 20315781 21505243 0.94
tpcds_q44/duckdb:vortex-file-compressed 22573747 25045190 0.90
tpcds_q45/duckdb:vortex-file-compressed 🚀 27664382 30798038 0.90
tpcds_q46/duckdb:vortex-file-compressed 48401661 52404685 0.92
tpcds_q47/duckdb:vortex-file-compressed 50614083 53706037 0.94
tpcds_q48/duckdb:vortex-file-compressed 31595496 32789788 0.96
tpcds_q49/duckdb:vortex-file-compressed 30202415 32359297 0.93
tpcds_q50/duckdb:vortex-file-compressed 37571576 39228803 0.96
tpcds_q51/duckdb:vortex-file-compressed 99972238 102677421 0.97
tpcds_q52/duckdb:vortex-file-compressed 12063028 13387410 0.90
tpcds_q53/duckdb:vortex-file-compressed 17362698 18479629 0.94
tpcds_q54/duckdb:vortex-file-compressed 50184900 54003087 0.93
tpcds_q55/duckdb:vortex-file-compressed 11977970 12844652 0.93
tpcds_q56/duckdb:vortex-file-compressed 68286176 70496057 0.97
tpcds_q57/duckdb:vortex-file-compressed 45693778 48381662 0.94
tpcds_q58/duckdb:vortex-file-compressed 32641968 33999120 0.96
tpcds_q59/duckdb:vortex-file-compressed 63102662 64339191 0.98
tpcds_q60/duckdb:vortex-file-compressed 🚀 70197845 78263748 0.90
tpcds_q61/duckdb:vortex-file-compressed 39055475 40096677 0.97
tpcds_q62/duckdb:vortex-file-compressed 🚀 17479424 19885713 0.88
tpcds_q63/duckdb:vortex-file-compressed 18193477 19961421 0.91
tpcds_q64/duckdb:vortex-file-compressed 81964315 86927539 0.94
tpcds_q65/duckdb:vortex-file-compressed 23551456 24831005 0.95
tpcds_q66/duckdb:vortex-file-compressed 59257904 61201385 0.97
tpcds_q67/duckdb:vortex-file-compressed 145291190 150054123 0.97
tpcds_q68/duckdb:vortex-file-compressed 42349577 42635491 0.99
tpcds_q69/duckdb:vortex-file-compressed 38095810 40967728 0.93
tpcds_q70/duckdb:vortex-file-compressed 24637114 25883192 0.95
tpcds_q71/duckdb:vortex-file-compressed 20932669 22573998 0.93
tpcds_q72/duckdb:vortex-file-compressed 177825528 183031733 0.97
tpcds_q73/duckdb:vortex-file-compressed 19219446 20443713 0.94
tpcds_q74/duckdb:vortex-file-compressed 52087488 51664734 1.01
tpcds_q75/duckdb:vortex-file-compressed 59650645 61697174 0.97
tpcds_q76/duckdb:vortex-file-compressed 82730092 80476882 1.03
tpcds_q77/duckdb:vortex-file-compressed 70109806 74638751 0.94
tpcds_q78/duckdb:vortex-file-compressed 80450168 83540825 0.96
tpcds_q79/duckdb:vortex-file-compressed 41828581 45615337 0.92
tpcds_q80/duckdb:vortex-file-compressed 92127890 100552283 0.92
tpcds_q81/duckdb:vortex-file-compressed 34810842 35630500 0.98
tpcds_q82/duckdb:vortex-file-compressed 21669002 24003068 0.90
tpcds_q83/duckdb:vortex-file-compressed 28880127 30421513 0.95
tpcds_q84/duckdb:vortex-file-compressed 17229810 19101346 0.90
tpcds_q85/duckdb:vortex-file-compressed 47136918 49110175 0.96
tpcds_q86/duckdb:vortex-file-compressed 18629138 18335869 1.02
tpcds_q87/duckdb:vortex-file-compressed 40762397 43244671 0.94
tpcds_q88/duckdb:vortex-file-compressed 35323968 37111869 0.95
tpcds_q89/duckdb:vortex-file-compressed 17686760 19280502 0.92
tpcds_q90/duckdb:vortex-file-compressed 15051742 16545607 0.91
tpcds_q91/duckdb:vortex-file-compressed 27483160 29181965 0.94
tpcds_q92/duckdb:vortex-file-compressed 🚀 14022467 16167085 0.87
tpcds_q93/duckdb:vortex-file-compressed 30049888 32917321 0.91
tpcds_q94/duckdb:vortex-file-compressed 22773811 24016619 0.95
tpcds_q95/duckdb:vortex-file-compressed 155732770 146677475 1.06
tpcds_q96/duckdb:vortex-file-compressed 11585239 12119708 0.96
tpcds_q97/duckdb:vortex-file-compressed 40073815 41364819 0.97
tpcds_q98/duckdb:vortex-file-compressed 19339311 19191323 1.01
tpcds_q99/duckdb:vortex-file-compressed 33003040 32810951 1.01
duckdb / vortex-compact (0.954x ➖, 6↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 34224602 38313204 0.89
tpcds_q02/duckdb:vortex-compact 122266934 127369684 0.96
tpcds_q03/duckdb:vortex-compact 50909677 53396119 0.95
tpcds_q04/duckdb:vortex-compact 123901632 129497709 0.96
tpcds_q05/duckdb:vortex-compact 160395202 167439927 0.96
tpcds_q06/duckdb:vortex-compact 37542214 39946363 0.94
tpcds_q07/duckdb:vortex-compact 36536713 38761592 0.94
tpcds_q08/duckdb:vortex-compact 28093563 28649569 0.98
tpcds_q09/duckdb:vortex-compact 110047692 113514847 0.97
tpcds_q10/duckdb:vortex-compact 45325241 48850121 0.93
tpcds_q11/duckdb:vortex-compact 75264862 79256344 0.95
tpcds_q12/duckdb:vortex-compact 🚀 19872854 22557362 0.88
tpcds_q13/duckdb:vortex-compact 47407031 49939537 0.95
tpcds_q14/duckdb:vortex-compact 260798778 281291411 0.93
tpcds_q15/duckdb:vortex-compact 44920403 49140857 0.91
tpcds_q16/duckdb:vortex-compact 36538545 38384619 0.95
tpcds_q17/duckdb:vortex-compact 47643726 50786943 0.94
tpcds_q18/duckdb:vortex-compact 66284492 70103611 0.95
tpcds_q19/duckdb:vortex-compact 37881320 40292024 0.94
tpcds_q20/duckdb:vortex-compact 20005367 21498839 0.93
tpcds_q21/duckdb:vortex-compact 28759360 30624024 0.94
tpcds_q22/duckdb:vortex-compact 118598746 124358643 0.95
tpcds_q23/duckdb:vortex-compact 167154606 176871428 0.95
tpcds_q24/duckdb:vortex-compact 🚀 68870193 77709163 0.89
tpcds_q25/duckdb:vortex-compact 47901430 52320736 0.92
tpcds_q26/duckdb:vortex-compact 52960119 52989546 1.00
tpcds_q27/duckdb:vortex-compact 129902969 133724146 0.97
tpcds_q28/duckdb:vortex-compact 106802691 110571266 0.97
tpcds_q29/duckdb:vortex-compact 46468912 51249367 0.91
tpcds_q30/duckdb:vortex-compact 34917151 36053962 0.97
tpcds_q31/duckdb:vortex-compact 31638033 32149923 0.98
tpcds_q32/duckdb:vortex-compact 23220846 25095391 0.93
tpcds_q33/duckdb:vortex-compact 129862040 134777022 0.96
tpcds_q34/duckdb:vortex-compact 22197257 23561081 0.94
tpcds_q35/duckdb:vortex-compact 66870406 70920352 0.94
tpcds_q36/duckdb:vortex-compact 33599500 34945584 0.96
tpcds_q37/duckdb:vortex-compact 31665757 33637089 0.94
tpcds_q38/duckdb:vortex-compact 37675825 40620485 0.93
tpcds_q39/duckdb:vortex-compact 52626674 55845076 0.94
tpcds_q40/duckdb:vortex-compact 31878015 31239131 1.02
tpcds_q41/duckdb:vortex-compact 16648380 18024982 0.92
tpcds_q42/duckdb:vortex-compact 14691281 16090886 0.91
tpcds_q43/duckdb:vortex-compact 24252640 24633130 0.98
tpcds_q44/duckdb:vortex-compact 28290509 31012837 0.91
tpcds_q45/duckdb:vortex-compact 32615544 34335045 0.95
tpcds_q46/duckdb:vortex-compact 56377013 58122299 0.97
tpcds_q47/duckdb:vortex-compact 53854246 55460563 0.97
tpcds_q48/duckdb:vortex-compact 40397565 41528431 0.97
tpcds_q49/duckdb:vortex-compact 49285134 51937636 0.95
tpcds_q50/duckdb:vortex-compact 37648174 38048020 0.99
tpcds_q51/duckdb:vortex-compact 103160662 107456471 0.96
tpcds_q52/duckdb:vortex-compact 14776730 16035762 0.92
tpcds_q53/duckdb:vortex-compact 21482879 22453920 0.96
tpcds_q54/duckdb:vortex-compact 84687350 86527354 0.98
tpcds_q55/duckdb:vortex-compact 14355654 15233300 0.94
tpcds_q56/duckdb:vortex-compact 130554528 133663415 0.98
tpcds_q57/duckdb:vortex-compact 49037276 47508159 1.03
tpcds_q58/duckdb:vortex-compact 🚀 37481379 42356252 0.88
tpcds_q59/duckdb:vortex-compact 76399578 77473099 0.99
tpcds_q60/duckdb:vortex-compact 132452656 142788804 0.93
tpcds_q61/duckdb:vortex-compact 43700638 47307950 0.92
tpcds_q62/duckdb:vortex-compact 24244875 22290449 1.09
tpcds_q63/duckdb:vortex-compact 21811158 23071692 0.95
tpcds_q64/duckdb:vortex-compact 97874396 102465514 0.96
tpcds_q65/duckdb:vortex-compact 26800036 29173255 0.92
tpcds_q66/duckdb:vortex-compact 95569343 101875347 0.94
tpcds_q67/duckdb:vortex-compact 151946976 159333518 0.95
tpcds_q68/duckdb:vortex-compact 51139569 50262512 1.02
tpcds_q69/duckdb:vortex-compact 45768851 49277148 0.93
tpcds_q70/duckdb:vortex-compact 28231730 27748204 1.02
tpcds_q71/duckdb:vortex-compact 27419440 27036547 1.01
tpcds_q72/duckdb:vortex-compact 198638091 205087891 0.97
tpcds_q73/duckdb:vortex-compact 21986698 22916580 0.96
tpcds_q74/duckdb:vortex-compact 57257996 59451051 0.96
tpcds_q75/duckdb:vortex-compact 🚀 67667716 78574573 0.86
tpcds_q76/duckdb:vortex-compact 124452213 125920634 0.99
tpcds_q77/duckdb:vortex-compact 127910570 131686187 0.97
tpcds_q78/duckdb:vortex-compact 86156189 93441060 0.92
tpcds_q79/duckdb:vortex-compact 🚨 79345780 71772320 1.11
tpcds_q80/duckdb:vortex-compact 158762071 166671963 0.95
tpcds_q81/duckdb:vortex-compact 43349559 41359044 1.05
tpcds_q82/duckdb:vortex-compact 31376814 33208521 0.94
tpcds_q83/duckdb:vortex-compact 45650648 48169089 0.95
tpcds_q84/duckdb:vortex-compact 21605167 22115098 0.98
tpcds_q85/duckdb:vortex-compact 59719154 65618418 0.91
tpcds_q86/duckdb:vortex-compact 19888165 20580797 0.97
tpcds_q87/duckdb:vortex-compact 🚀 39455724 44407513 0.89
tpcds_q88/duckdb:vortex-compact 33095841 35339419 0.94
tpcds_q89/duckdb:vortex-compact 22443728 22996623 0.98
tpcds_q90/duckdb:vortex-compact 15793007 16626611 0.95
tpcds_q91/duckdb:vortex-compact 45028448 46483208 0.97
tpcds_q92/duckdb:vortex-compact 18861995 20471626 0.92
tpcds_q93/duckdb:vortex-compact 35930768 37514780 0.96
tpcds_q94/duckdb:vortex-compact 27846946 28393902 0.98
tpcds_q95/duckdb:vortex-compact 165130498 164736542 1.00
tpcds_q96/duckdb:vortex-compact 11210146 11747481 0.95
tpcds_q97/duckdb:vortex-compact 42929829 42346409 1.01
tpcds_q98/duckdb:vortex-compact 22216547 23956504 0.93
tpcds_q99/duckdb:vortex-compact 37420218 39350446 0.95
duckdb / parquet (0.965x ➖, 6↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44615240 46079318 0.97
tpcds_q02/duckdb:parquet 61843516 62964027 0.98
tpcds_q03/duckdb:parquet 11779494 12586357 0.94
tpcds_q04/duckdb:parquet 122602007 128490605 0.95
tpcds_q05/duckdb:parquet 74609381 75483360 0.99
tpcds_q06/duckdb:parquet 29004226 29536867 0.98
tpcds_q07/duckdb:parquet 23087545 24906579 0.93
tpcds_q08/duckdb:parquet 28441081 28168243 1.01
tpcds_q09/duckdb:parquet 39802838 40171290 0.99
tpcds_q10/duckdb:parquet 36786673 36910749 1.00
tpcds_q11/duckdb:parquet 85776666 90757244 0.95
tpcds_q12/duckdb:parquet 14509396 15823924 0.92
tpcds_q13/duckdb:parquet 34062857 35447907 0.96
tpcds_q14/duckdb:parquet 160280985 167937433 0.95
tpcds_q15/duckdb:parquet 29772010 31590379 0.94
tpcds_q16/duckdb:parquet 21849816 22005176 0.99
tpcds_q17/duckdb:parquet 37903680 40056051 0.95
tpcds_q18/duckdb:parquet 46327821 46700318 0.99
tpcds_q19/duckdb:parquet 31308396 30004911 1.04
tpcds_q20/duckdb:parquet 14700146 15275397 0.96
tpcds_q21/duckdb:parquet 11542475 11828925 0.98
tpcds_q22/duckdb:parquet 65393897 71774152 0.91
tpcds_q23/duckdb:parquet 113207882 113418782 1.00
tpcds_q24/duckdb:parquet 44827846 47658948 0.94
tpcds_q25/duckdb:parquet 33292400 33781953 0.99
tpcds_q26/duckdb:parquet 37229587 34978840 1.06
tpcds_q27/duckdb:parquet 89017025 91795442 0.97
tpcds_q28/duckdb:parquet 37078837 37199712 1.00
tpcds_q29/duckdb:parquet 35613855 37390350 0.95
tpcds_q30/duckdb:parquet 39885729 41467982 0.96
tpcds_q31/duckdb:parquet 23013523 23217122 0.99
tpcds_q32/duckdb:parquet 11340591 11455723 0.99
tpcds_q33/duckdb:parquet 69808741 72787871 0.96
tpcds_q34/duckdb:parquet 20705615 21400534 0.97
tpcds_q35/duckdb:parquet 57232529 62293430 0.92
tpcds_q36/duckdb:parquet 20293191 20909925 0.97
tpcds_q37/duckdb:parquet 13341237 13555035 0.98
tpcds_q38/duckdb:parquet 🚀 31856380 36164622 0.88
tpcds_q39/duckdb:parquet 33338363 33881586 0.98
tpcds_q40/duckdb:parquet 17598325 18405721 0.96
tpcds_q41/duckdb:parquet 7482988 7812701 0.96
tpcds_q42/duckdb:parquet 🚀 9551152 11378337 0.84
tpcds_q43/duckdb:parquet 15535415 16528638 0.94
tpcds_q44/duckdb:parquet 21398960 22191694 0.96
tpcds_q45/duckdb:parquet 26957449 29036766 0.93
tpcds_q46/duckdb:parquet 44923776 47096341 0.95
tpcds_q47/duckdb:parquet 45374342 46401300 0.98
tpcds_q48/duckdb:parquet 30687187 30966486 0.99
tpcds_q49/duckdb:parquet 24706750 25249531 0.98
tpcds_q50/duckdb:parquet 24735106 25315276 0.98
tpcds_q51/duckdb:parquet 93556087 96149269 0.97
tpcds_q52/duckdb:parquet 11355753 11228558 1.01
tpcds_q53/duckdb:parquet 16772167 16881321 0.99
tpcds_q54/duckdb:parquet 41104099 40222239 1.02
tpcds_q55/duckdb:parquet 10349061 11465612 0.90
tpcds_q56/duckdb:parquet 71063958 68743567 1.03
tpcds_q57/duckdb:parquet 35073483 35936109 0.98
tpcds_q58/duckdb:parquet 20737561 22223002 0.93
tpcds_q59/duckdb:parquet 36534051 36937687 0.99
tpcds_q60/duckdb:parquet 71100356 73205152 0.97
tpcds_q61/duckdb:parquet 30381105 30986715 0.98
tpcds_q62/duckdb:parquet 12307317 11923512 1.03
tpcds_q63/duckdb:parquet 15286089 16082700 0.95
tpcds_q64/duckdb:parquet 73539616 74908034 0.98
tpcds_q65/duckdb:parquet 20167166 21929201 0.92
tpcds_q66/duckdb:parquet 55186058 56092429 0.98
tpcds_q67/duckdb:parquet 135959067 137468272 0.99
tpcds_q68/duckdb:parquet 37168879 39003146 0.95
tpcds_q69/duckdb:parquet 38241133 38101448 1.00
tpcds_q70/duckdb:parquet 19886690 20066226 0.99
tpcds_q71/duckdb:parquet 20830328 19383937 1.07
tpcds_q72/duckdb:parquet 163458538 166612655 0.98
tpcds_q73/duckdb:parquet 17853730 18991191 0.94
tpcds_q74/duckdb:parquet 48982846 52550935 0.93
tpcds_q75/duckdb:parquet 53267269 56708701 0.94
tpcds_q76/duckdb:parquet 70582912 70101432 1.01
tpcds_q77/duckdb:parquet 63417884 63549110 1.00
tpcds_q78/duckdb:parquet 74719156 77156656 0.97
tpcds_q79/duckdb:parquet 27379628 28428664 0.96
tpcds_q80/duckdb:parquet 86817253 85178531 1.02
tpcds_q81/duckdb:parquet 46484298 47480111 0.98
tpcds_q82/duckdb:parquet 15315514 15836936 0.97
tpcds_q83/duckdb:parquet 15662076 17257256 0.91
tpcds_q84/duckdb:parquet 19082213 20935520 0.91
tpcds_q85/duckdb:parquet 39046792 39684397 0.98
tpcds_q86/duckdb:parquet 12787480 12711684 1.01
tpcds_q87/duckdb:parquet 37002070 36605101 1.01
tpcds_q88/duckdb:parquet 28617358 29913266 0.96
tpcds_q89/duckdb:parquet 17178749 18080494 0.95
tpcds_q90/duckdb:parquet 🚀 7137452 8335470 0.86
tpcds_q91/duckdb:parquet 22773834 23014436 0.99
tpcds_q92/duckdb:parquet 🚀 11154786 12672470 0.88
tpcds_q93/duckdb:parquet 29397688 30234620 0.97
tpcds_q94/duckdb:parquet 16373307 17090988 0.96
tpcds_q95/duckdb:parquet 135655278 145828918 0.93
tpcds_q96/duckdb:parquet 9103153 9802870 0.93
tpcds_q97/duckdb:parquet 🚀 32920218 36771613 0.90
tpcds_q98/duckdb:parquet 17620389 18483545 0.95
tpcds_q99/duckdb:parquet 🚀 19050245 21363616 0.89
duckdb / duckdb (0.958x ➖, 8↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19727042 21008232 0.94
tpcds_q02/duckdb:duckdb 17752144 19348132 0.92
tpcds_q03/duckdb:duckdb 🚀 7791705 8766391 0.89
tpcds_q04/duckdb:duckdb 167521856 164523531 1.02
tpcds_q05/duckdb:duckdb 18284940 19099751 0.96
tpcds_q06/duckdb:duckdb 22664498 22756974 1.00
tpcds_q07/duckdb:duckdb 37886491 39285658 0.96
tpcds_q08/duckdb:duckdb 120427707 120932780 1.00
tpcds_q09/duckdb:duckdb 19736507 19983730 0.99
tpcds_q10/duckdb:duckdb 23477600 23623813 0.99
tpcds_q11/duckdb:duckdb 138868654 144510499 0.96
tpcds_q12/duckdb:duckdb 11201684 11888254 0.94
tpcds_q13/duckdb:duckdb 23492139 24252245 0.97
tpcds_q14/duckdb:duckdb 92384653 95295864 0.97
tpcds_q15/duckdb:duckdb 24268556 25254223 0.96
tpcds_q16/duckdb:duckdb 17856221 16889299 1.06
tpcds_q17/duckdb:duckdb 21093293 22440217 0.94
tpcds_q18/duckdb:duckdb 42847691 46122901 0.93
tpcds_q19/duckdb:duckdb 15791915 16978245 0.93
tpcds_q20/duckdb:duckdb 11735466 10908986 1.08
tpcds_q21/duckdb:duckdb 🚀 6390041 7211625 0.89
tpcds_q22/duckdb:duckdb 61526374 64580938 0.95
tpcds_q23/duckdb:duckdb 79069542 83379753 0.95
tpcds_q24/duckdb:duckdb 22880093 24266998 0.94
tpcds_q25/duckdb:duckdb 17126640 16254268 1.05
tpcds_q26/duckdb:duckdb 25680077 27074379 0.95
tpcds_q27/duckdb:duckdb 38302457 42001310 0.91
tpcds_q28/duckdb:duckdb 21225233 21324397 1.00
tpcds_q29/duckdb:duckdb 20082088 20457596 0.98
tpcds_q30/duckdb:duckdb 29176720 30227637 0.97
tpcds_q31/duckdb:duckdb 20396084 20616649 0.99
tpcds_q32/duckdb:duckdb 7045909 6988495 1.01
tpcds_q33/duckdb:duckdb 12616701 13170217 0.96
tpcds_q34/duckdb:duckdb 14226955 15608873 0.91
tpcds_q35/duckdb:duckdb 31582992 33539720 0.94
tpcds_q36/duckdb:duckdb 66335772 73285068 0.91
tpcds_q37/duckdb:duckdb 7625002 7962296 0.96
tpcds_q38/duckdb:duckdb 30462169 31221707 0.98
tpcds_q39/duckdb:duckdb 26268934 27916689 0.94
tpcds_q40/duckdb:duckdb 13312956 14440312 0.92
tpcds_q41/duckdb:duckdb 7963034 8195449 0.97
tpcds_q42/duckdb:duckdb 🚀 6254604 7106705 0.88
tpcds_q43/duckdb:duckdb 11203338 11470824 0.98
tpcds_q44/duckdb:duckdb 12563093 12903560 0.97
tpcds_q45/duckdb:duckdb 17635001 17688836 1.00
tpcds_q46/duckdb:duckdb 35544603 37301760 0.95
tpcds_q47/duckdb:duckdb 41113841 42857193 0.96
tpcds_q48/duckdb:duckdb 21467093 22110568 0.97
tpcds_q49/duckdb:duckdb 16315343 16803643 0.97
tpcds_q50/duckdb:duckdb 13840095 14038566 0.99
tpcds_q51/duckdb:duckdb 92110627 92811866 0.99
tpcds_q52/duckdb:duckdb 7218604 7873832 0.92
tpcds_q53/duckdb:duckdb 11919928 12222111 0.98
tpcds_q54/duckdb:duckdb 16057492 17020307 0.94
tpcds_q55/duckdb:duckdb 6667804 7069896 0.94
tpcds_q56/duckdb:duckdb 13366657 13492780 0.99
tpcds_q57/duckdb:duckdb 31150262 32493589 0.96
tpcds_q58/duckdb:duckdb 11303985 12458298 0.91
tpcds_q59/duckdb:duckdb 33944036 35668549 0.95
tpcds_q60/duckdb:duckdb 🚀 13955502 16039803 0.87
tpcds_q61/duckdb:duckdb 13755409 14477793 0.95
tpcds_q62/duckdb:duckdb 8732910 9482731 0.92
tpcds_q63/duckdb:duckdb 10671376 11746121 0.91
tpcds_q64/duckdb:duckdb 51219169 55440182 0.92
tpcds_q65/duckdb:duckdb 34159651 35213965 0.97
tpcds_q66/duckdb:duckdb 24717433 24576124 1.01
tpcds_q67/duckdb:duckdb 124619077 132874826 0.94
tpcds_q68/duckdb:duckdb 24673317 25742483 0.96
tpcds_q69/duckdb:duckdb 23299944 24674431 0.94
tpcds_q70/duckdb:duckdb 14038958 14405078 0.97
tpcds_q71/duckdb:duckdb 🚀 11837909 13431598 0.88
tpcds_q72/duckdb:duckdb 40918996 41440094 0.99
tpcds_q73/duckdb:duckdb 10289096 10877442 0.95
tpcds_q74/duckdb:duckdb 95091470 101723647 0.93
tpcds_q75/duckdb:duckdb 41246030 44183778 0.93
tpcds_q76/duckdb:duckdb 12044997 12682763 0.95
tpcds_q77/duckdb:duckdb 11587836 12095555 0.96
tpcds_q78/duckdb:duckdb 61557711 63393519 0.97
tpcds_q79/duckdb:duckdb 17696037 18576155 0.95
tpcds_q80/duckdb:duckdb 27870638 28200097 0.99
tpcds_q81/duckdb:duckdb 35591391 37439075 0.95
tpcds_q82/duckdb:duckdb 8103856 8916667 0.91
tpcds_q83/duckdb:duckdb 8535714 9247513 0.92
tpcds_q84/duckdb:duckdb 13749573 13723532 1.00
tpcds_q85/duckdb:duckdb 22683140 23695752 0.96
tpcds_q86/duckdb:duckdb 🚀 10301637 11564013 0.89
tpcds_q87/duckdb:duckdb 33452229 33525326 1.00
tpcds_q88/duckdb:duckdb 23980429 23807678 1.01
tpcds_q89/duckdb:duckdb 12992759 13348996 0.97
tpcds_q90/duckdb:duckdb 5557419 5454991 1.02
tpcds_q91/duckdb:duckdb 12181566 13229913 0.92
tpcds_q92/duckdb:duckdb 8888817 8795550 1.01
tpcds_q93/duckdb:duckdb 🚀 20974146 23676577 0.89
tpcds_q94/duckdb:duckdb 12180726 12677270 0.96
tpcds_q95/duckdb:duckdb 🚨 127453767 113609263 1.12
tpcds_q96/duckdb:duckdb 🚀 4525893 5036539 0.90
tpcds_q97/duckdb:duckdb 29966883 31788137 0.94
tpcds_q98/duckdb:duckdb 14002980 14577468 0.96
tpcds_q99/duckdb:duckdb 15844629 15944121 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.9% -4.0% -2.0% +10.3% ➖ noise
1 datafusion:vortex-file-compressed -6.8% -4.0% -2.9% +10.4% ➖ noise
1 duckdb:duckdb -6.1% -4.0% -2.2% +10.0% ➖ noise
1 duckdb:vortex-compact -10.7% -4.0% -6.9% +13.9% ➖ noise
1 duckdb:vortex-file-compressed -7.2% -4.0% -3.3% +10.8% ➖ noise
2 datafusion:vortex-compact -6.4% -3.4% -3.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.6% -3.4% -4.3% +10.0% ➖ noise
2 duckdb:duckdb -8.2% -3.4% -5.0% +15.3% ➖ noise
2 duckdb:vortex-compact -4.0% -3.4% -0.6% +10.7% ➖ noise
2 duckdb:vortex-file-compressed -5.5% -3.4% -2.1% +11.4% ➖ noise
3 datafusion:vortex-compact -4.3% -4.4% +0.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -5.4% -4.4% -1.1% +10.0% ➖ noise
3 duckdb:duckdb -11.1% -4.4% -7.0% +17.4% ➖ noise
3 duckdb:vortex-compact -4.7% -4.4% -0.3% +11.9% ➖ noise
3 duckdb:vortex-file-compressed -8.0% -4.4% -3.7% +10.7% ➖ noise
4 datafusion:vortex-compact -8.1% -6.7% -1.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -8.9% -6.7% -2.4% +10.0% ➖ noise
4 duckdb:duckdb +1.8% -6.7% +9.1% +10.0% ➖ noise
4 duckdb:vortex-compact -4.3% -6.7% +2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.7% -6.7% +9.0% +10.0% ➖ noise
5 datafusion:vortex-compact -5.2% -2.7% -2.6% +10.4% ➖ noise
5 datafusion:vortex-file-compressed -1.4% -2.7% +1.4% +12.1% ➖ noise
5 duckdb:duckdb -4.3% -2.7% -1.6% +12.5% ➖ noise
5 duckdb:vortex-compact -4.2% -2.7% -1.5% +14.1% ➖ noise
5 duckdb:vortex-file-compressed -5.7% -2.7% -3.1% +12.7% ➖ noise
6 datafusion:vortex-compact -7.2% -1.6% -5.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.5% -1.6% -5.0% +10.0% ➖ noise
6 duckdb:duckdb -0.4% -1.6% +1.2% +10.7% ➖ noise
6 duckdb:vortex-compact -6.0% -1.6% -4.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.8% -1.6% -3.3% +10.0% ➖ noise
7 datafusion:vortex-compact -8.0% -6.2% -2.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.2% -6.2% +2.1% +11.7% ➖ noise
7 duckdb:duckdb -3.6% -6.2% +2.8% +19.0% ➖ noise
7 duckdb:vortex-compact -5.7% -6.2% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -14.3% -6.2% -8.7% +12.4% ➖ noise
8 datafusion:vortex-compact -4.4% -3.7% -0.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -7.1% -3.7% -3.6% +10.0% ➖ noise
8 duckdb:duckdb -0.4% -3.7% +3.4% +10.0% ➖ noise
8 duckdb:vortex-compact -1.9% -3.7% +1.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.1% -3.7% +0.5% +10.2% ➖ noise
9 datafusion:vortex-compact -5.0% -1.5% -3.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -6.0% -1.5% -4.5% +10.0% ➖ noise
9 duckdb:duckdb -1.2% -1.5% +0.3% +24.9% ➖ noise
9 duckdb:vortex-compact -3.1% -1.5% -1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.1% -1.5% +1.6% +10.0% ➖ noise
10 datafusion:vortex-compact -4.4% -1.5% -2.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.8% -1.5% -1.3% +10.0% ➖ noise
10 duckdb:duckdb -0.6% -1.5% +0.9% +10.0% ➖ noise
10 duckdb:vortex-compact -7.2% -1.5% -5.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.9% -1.5% -4.4% +10.0% ➖ noise
11 datafusion:vortex-compact -5.2% -4.5% -0.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -9.1% -4.5% -4.9% +10.0% ➖ noise
11 duckdb:duckdb -3.9% -4.5% +0.6% +10.0% ➖ noise
11 duckdb:vortex-compact -5.0% -4.5% -0.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.4% -4.5% +2.2% +10.0% ➖ noise
12 datafusion:vortex-compact -3.5% -5.0% +1.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -5.4% -5.0% -0.4% +10.0% ➖ noise
12 duckdb:duckdb -5.8% -5.0% -0.8% +10.1% ➖ noise
12 duckdb:vortex-compact -11.9% -5.0% -7.2% +13.4% ➖ noise
12 duckdb:vortex-file-compressed -4.1% -5.0% +1.0% +12.2% ➖ noise
13 datafusion:vortex-compact -1.4% -4.6% +3.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -7.6% -4.6% -3.1% +10.7% ➖ noise
13 duckdb:duckdb -3.1% -4.6% +1.6% +10.0% ➖ noise
13 duckdb:vortex-compact -5.1% -4.6% -0.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -3.9% -4.6% +0.8% +10.0% ➖ noise
14 datafusion:vortex-compact -4.3% -5.4% +1.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.7% -5.4% +1.7% +10.0% ➖ noise
14 duckdb:duckdb -3.1% -5.4% +2.4% +10.0% ➖ noise
14 duckdb:vortex-compact -7.3% -5.4% -2.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.9% -5.4% +2.6% +11.2% ➖ noise
15 datafusion:vortex-compact -2.9% -4.7% +1.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.7% -4.7% -0.0% +10.0% ➖ noise
15 duckdb:duckdb -3.9% -4.7% +0.8% +14.7% ➖ noise
15 duckdb:vortex-compact -8.6% -4.7% -4.1% +15.0% ➖ noise
15 duckdb:vortex-file-compressed -0.9% -4.7% +4.0% +10.0% ➖ noise
16 datafusion:vortex-compact -1.5% -4.1% +2.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -5.9% -4.1% -1.9% +11.5% ➖ noise
16 duckdb:duckdb +5.7% -4.1% +10.2% +15.7% ➖ noise
16 duckdb:vortex-compact -4.8% -4.1% -0.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -10.8% -4.1% -7.1% +12.0% ➖ noise
17 datafusion:vortex-compact -6.3% -4.4% -2.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -3.0% -4.4% +1.4% +10.0% ➖ noise
17 duckdb:duckdb -6.0% -4.4% -1.7% +12.2% ➖ noise
17 duckdb:vortex-compact -6.2% -4.4% -1.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -8.7% -4.4% -4.5% +11.3% ➖ noise
18 datafusion:vortex-compact -8.4% -3.5% -5.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -5.8% -3.5% -2.5% +10.0% ➖ noise
18 duckdb:duckdb -7.1% -3.5% -3.8% +11.0% ➖ noise
18 duckdb:vortex-compact -5.4% -3.5% -2.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.7% -3.5% -1.3% +11.7% ➖ noise
19 datafusion:vortex-compact -6.3% -2.4% -4.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -9.5% -2.4% -7.3% +10.0% ➖ noise
19 duckdb:duckdb -7.0% -2.4% -4.7% +12.7% ➖ noise
19 duckdb:vortex-compact -6.0% -2.4% -3.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -6.5% -2.4% -4.2% +15.9% ➖ noise
20 datafusion:vortex-compact -8.2% -4.1% -4.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -5.3% -4.1% -1.2% +10.0% ➖ noise
20 duckdb:duckdb +7.6% -4.1% +12.1% +12.2% ➖ noise
20 duckdb:vortex-compact -6.9% -4.1% -3.0% +12.2% ➖ noise
20 duckdb:vortex-file-compressed -9.3% -4.1% -5.5% +10.7% ➖ noise
21 datafusion:vortex-compact -2.2% -6.2% +4.3% +12.3% ➖ noise
21 datafusion:vortex-file-compressed -5.8% -6.2% +0.4% +11.8% ➖ noise
21 duckdb:duckdb -11.4% -6.2% -5.5% +21.0% ➖ noise
21 duckdb:vortex-compact -6.1% -6.2% +0.1% +11.0% ➖ noise
21 duckdb:vortex-file-compressed -0.0% -6.2% +6.6% +27.0% ➖ noise
22 datafusion:vortex-compact -2.8% -11.2% +9.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -8.6% -11.2% +2.9% +10.0% ➖ noise
22 duckdb:duckdb -4.7% -11.2% +7.3% +10.2% ➖ noise
22 duckdb:vortex-compact -4.6% -11.2% +7.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -5.9% -11.2% +6.0% +10.0% ➖ noise
23 datafusion:vortex-compact -6.9% -4.1% -2.9% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -7.9% -4.1% -3.9% +10.0% ➖ noise
23 duckdb:duckdb -5.2% -4.1% -1.1% +17.6% ➖ noise
23 duckdb:vortex-compact -5.5% -4.1% -1.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -13.3% -4.1% -9.7% +10.0% ✅ faster
24 datafusion:vortex-compact -6.5% -6.8% +0.3% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -7.0% -6.8% -0.2% +10.0% ➖ noise
24 duckdb:duckdb -5.7% -6.8% +1.1% +10.2% ➖ noise
24 duckdb:vortex-compact -11.4% -6.8% -4.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -7.3% -6.8% -0.5% +10.0% ➖ noise
25 datafusion:vortex-compact -4.3% -1.7% -2.6% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -6.1% -1.7% -4.5% +10.0% ➖ noise
25 duckdb:duckdb +5.4% -1.7% +7.2% +11.5% ➖ noise
25 duckdb:vortex-compact -8.4% -1.7% -6.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.9% -1.7% -3.2% +10.0% ➖ noise
26 datafusion:vortex-compact -4.8% +0.7% -5.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -3.9% +0.7% -4.6% +11.0% ➖ noise
26 duckdb:duckdb -5.1% +0.7% -5.8% +14.4% ➖ noise
26 duckdb:vortex-compact -0.1% +0.7% -0.8% +15.9% ➖ noise
26 duckdb:vortex-file-compressed -8.5% +0.7% -9.2% +15.5% ➖ noise
27 datafusion:vortex-compact -3.8% -3.5% -0.3% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -7.9% -3.5% -4.5% +10.0% ➖ noise
27 duckdb:duckdb -8.8% -3.5% -5.5% +15.3% ➖ noise
27 duckdb:vortex-compact -2.9% -3.5% +0.7% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -7.2% -3.5% -3.7% +10.0% ➖ noise
28 datafusion:vortex-compact -2.6% -3.2% +0.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.8% -3.2% +1.4% +10.0% ➖ noise
28 duckdb:duckdb -0.5% -3.2% +2.8% +10.0% ➖ noise
28 duckdb:vortex-compact -3.4% -3.2% -0.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -7.7% -3.2% -4.6% +10.0% ➖ noise
29 datafusion:vortex-compact -6.5% -4.3% -2.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.1% -4.3% +1.2% +10.0% ➖ noise
29 duckdb:duckdb -1.8% -4.3% +2.5% +10.0% ➖ noise
29 duckdb:vortex-compact -9.3% -4.3% -5.3% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -3.6% -4.3% +0.7% +10.0% ➖ noise
30 datafusion:vortex-compact -10.0% -5.0% -5.2% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -12.5% -5.0% -7.9% +10.0% ➖ noise
30 duckdb:duckdb -3.5% -5.0% +1.6% +10.0% ➖ noise
30 duckdb:vortex-compact -3.2% -5.0% +2.0% +14.1% ➖ noise
30 duckdb:vortex-file-compressed -3.0% -5.0% +2.1% +11.2% ➖ noise
31 datafusion:vortex-compact -5.5% -2.5% -3.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -6.7% -2.5% -4.3% +10.0% ➖ noise
31 duckdb:duckdb -1.1% -2.5% +1.5% +10.0% ➖ noise
31 duckdb:vortex-compact -1.6% -2.5% +0.9% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -6.6% -2.5% -4.2% +10.1% ➖ noise
32 datafusion:vortex-compact -8.5% -6.6% -2.0% +10.4% ➖ noise
32 datafusion:vortex-file-compressed -9.0% -6.6% -2.5% +10.0% ➖ noise
32 duckdb:duckdb +0.8% -6.6% +8.0% +13.7% ➖ noise
32 duckdb:vortex-compact -7.5% -6.6% -0.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -8.4% -6.6% -1.9% +14.8% ➖ noise
33 datafusion:vortex-compact -6.2% -6.3% +0.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.9% -6.3% +1.5% +10.0% ➖ noise
33 duckdb:duckdb -4.2% -6.3% +2.2% +10.2% ➖ noise
33 duckdb:vortex-compact -3.6% -6.3% +2.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -9.6% -6.3% -3.5% +11.9% ➖ noise
34 datafusion:vortex-compact -5.8% -5.3% -0.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.2% -5.3% +0.1% +30.8% ➖ noise
34 duckdb:duckdb -8.9% -5.3% -3.7% +10.0% ➖ noise
34 duckdb:vortex-compact -5.8% -5.3% -0.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -4.3% -5.3% +1.1% +10.0% ➖ noise
35 datafusion:vortex-compact -9.2% -8.1% -1.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -8.0% -8.1% +0.1% +10.0% ➖ noise
35 duckdb:duckdb -5.8% -8.1% +2.5% +18.9% ➖ noise
35 duckdb:vortex-compact -5.7% -8.1% +2.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -10.4% -8.1% -2.5% +11.9% ➖ noise
36 datafusion:vortex-compact -7.3% -6.1% -1.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -7.8% -6.1% -1.9% +10.0% ➖ noise
36 duckdb:duckdb -9.5% -6.1% -3.6% +10.0% ➖ noise
36 duckdb:vortex-compact -3.9% -6.1% +2.4% +13.2% ➖ noise
36 duckdb:vortex-file-compressed -3.2% -6.1% +3.1% +10.0% ➖ noise
37 datafusion:vortex-compact -10.4% -6.4% -4.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -11.9% -6.4% -5.9% +11.1% ➖ noise
37 duckdb:duckdb -4.2% -6.4% +2.3% +12.6% ➖ noise
37 duckdb:vortex-compact -5.9% -6.4% +0.5% +16.9% ➖ noise
37 duckdb:vortex-file-compressed -6.9% -6.4% -0.6% +16.3% ➖ noise
38 datafusion:vortex-compact -9.5% -9.0% -0.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -8.9% -9.0% +0.1% +10.0% ➖ noise
38 duckdb:duckdb -2.4% -9.0% +7.2% +13.6% ➖ noise
38 duckdb:vortex-compact -7.2% -9.0% +1.9% +16.1% ➖ noise
38 duckdb:vortex-file-compressed -3.1% -9.0% +6.5% +10.0% ➖ noise
39 datafusion:vortex-compact -10.5% -4.7% -6.1% +14.9% ➖ noise
39 datafusion:vortex-file-compressed -1.9% -4.7% +2.9% +14.8% ➖ noise
39 duckdb:duckdb -5.9% -4.7% -1.3% +21.6% ➖ noise
39 duckdb:vortex-compact -5.8% -4.7% -1.2% +15.6% ➖ noise
39 duckdb:vortex-file-compressed -3.2% -4.7% +1.5% +13.2% ➖ noise
40 datafusion:vortex-compact -11.3% -3.3% -8.3% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -5.9% -3.3% -2.8% +10.0% ➖ noise
40 duckdb:duckdb -7.8% -3.3% -4.7% +16.3% ➖ noise
40 duckdb:vortex-compact +2.0% -3.3% +5.5% +10.4% ➖ noise
40 duckdb:vortex-file-compressed +0.2% -3.3% +3.6% +11.6% ➖ noise
41 datafusion:vortex-compact -18.4% -6.2% -13.0% +15.2% ➖ noise
41 datafusion:vortex-file-compressed -13.9% -6.2% -8.3% +10.9% ➖ noise
41 duckdb:duckdb -2.8% -6.2% +3.5% +11.2% ➖ noise
41 duckdb:vortex-compact -7.6% -6.2% -1.6% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -13.0% -6.2% -7.3% +10.0% ➖ noise
42 datafusion:vortex-compact -8.2% -11.1% +3.3% +10.4% ➖ noise
42 datafusion:vortex-file-compressed -10.0% -11.1% +1.2% +13.0% ➖ noise
42 duckdb:duckdb -12.0% -11.1% -1.0% +12.4% ➖ noise
42 duckdb:vortex-compact -8.7% -11.1% +2.7% +12.7% ➖ noise
42 duckdb:vortex-file-compressed -4.3% -11.1% +7.6% +12.0% ➖ noise
43 datafusion:vortex-compact -9.3% -6.1% -3.4% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -8.5% -6.1% -2.6% +10.1% ➖ noise
43 duckdb:duckdb -2.3% -6.1% +4.0% +11.6% ➖ noise
43 duckdb:vortex-compact -1.5% -6.1% +4.8% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -5.5% -6.1% +0.6% +10.0% ➖ noise
44 datafusion:vortex-compact -3.3% -4.8% +1.6% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -3.3% -4.8% +1.6% +10.0% ➖ noise
44 duckdb:duckdb -2.6% -4.8% +2.3% +11.4% ➖ noise
44 duckdb:vortex-compact -8.8% -4.8% -4.1% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -9.9% -4.8% -5.3% +15.0% ➖ noise
45 datafusion:vortex-compact -10.4% -7.3% -3.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -2.3% -7.3% +5.4% +10.0% ➖ noise
45 duckdb:duckdb -0.3% -7.3% +7.6% +13.2% ➖ noise
45 duckdb:vortex-compact -5.0% -7.3% +2.5% +12.4% ➖ noise
45 duckdb:vortex-file-compressed -10.2% -7.3% -3.1% +11.0% ➖ noise
46 datafusion:vortex-compact -5.1% -2.8% -2.3% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -8.6% -2.8% -5.9% +10.0% ➖ noise
46 duckdb:duckdb -4.7% -2.8% -1.9% +10.0% ➖ noise
46 duckdb:vortex-compact -3.0% -2.8% -0.2% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -7.6% -2.8% -4.9% +10.0% ➖ noise
47 datafusion:vortex-compact -8.1% -3.5% -4.8% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -7.5% -3.5% -4.1% +10.0% ➖ noise
47 duckdb:duckdb -4.1% -3.5% -0.6% +10.0% ➖ noise
47 duckdb:vortex-compact -2.9% -3.5% +0.6% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -5.8% -3.5% -2.3% +10.0% ➖ noise
48 datafusion:vortex-compact -1.9% -2.4% +0.5% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -5.8% -2.4% -3.5% +10.0% ➖ noise
48 duckdb:duckdb -2.9% -2.4% -0.5% +10.0% ➖ noise
48 duckdb:vortex-compact -2.7% -2.4% -0.3% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -3.6% -2.4% -1.3% +10.0% ➖ noise
49 datafusion:vortex-compact -3.5% -2.6% -0.9% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -9.9% -2.6% -7.5% +10.0% ➖ noise
49 duckdb:duckdb -2.9% -2.6% -0.3% +12.1% ➖ noise
49 duckdb:vortex-compact -5.1% -2.6% -2.5% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -6.7% -2.6% -4.1% +14.9% ➖ noise
50 datafusion:vortex-compact -8.3% -6.0% -2.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -5.2% -6.0% +0.9% +10.0% ➖ noise
50 duckdb:duckdb -1.4% -6.0% +4.9% +10.0% ➖ noise
50 duckdb:vortex-compact -1.1% -6.0% +5.2% +11.4% ➖ noise
50 duckdb:vortex-file-compressed -4.2% -6.0% +1.9% +10.0% ➖ noise
51 datafusion:vortex-compact -8.0% -5.6% -2.5% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -6.1% -5.6% -0.5% +10.0% ➖ noise
51 duckdb:duckdb -0.8% -5.6% +5.2% +14.4% ➖ noise
51 duckdb:vortex-compact -4.0% -5.6% +1.7% +12.5% ➖ noise
51 duckdb:vortex-file-compressed -2.6% -5.6% +3.2% +14.5% ➖ noise
52 datafusion:vortex-compact -7.3% -2.7% -4.7% +13.3% ➖ noise
52 datafusion:vortex-file-compressed -4.4% -2.7% -1.8% +10.7% ➖ noise
52 duckdb:duckdb -8.3% -2.7% -5.8% +14.5% ➖ noise
52 duckdb:vortex-compact -7.9% -2.7% -5.3% +13.7% ➖ noise
52 duckdb:vortex-file-compressed -9.9% -2.7% -7.4% +21.6% ➖ noise
53 datafusion:vortex-compact -8.7% -5.3% -3.6% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -6.5% -5.3% -1.2% +11.0% ➖ noise
53 duckdb:duckdb -2.5% -5.3% +3.0% +12.3% ➖ noise
53 duckdb:vortex-compact -4.3% -5.3% +1.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -6.0% -5.3% -0.7% +10.0% ➖ noise
54 datafusion:vortex-compact -6.6% -1.7% -5.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -7.8% -1.7% -6.2% +10.0% ➖ noise
54 duckdb:duckdb -5.7% -1.7% -4.0% +12.2% ➖ noise
54 duckdb:vortex-compact -2.1% -1.7% -0.4% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -7.1% -1.7% -5.5% +12.2% ➖ noise
55 datafusion:vortex-compact -4.6% -6.6% +2.2% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -5.6% -6.6% +1.1% +10.0% ➖ noise
55 duckdb:duckdb -5.7% -6.6% +1.0% +14.1% ➖ noise
55 duckdb:vortex-compact -5.8% -6.6% +0.9% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -6.7% -6.6% -0.1% +11.7% ➖ noise
56 datafusion:vortex-compact -6.2% +0.9% -7.1% +10.8% ➖ noise
56 datafusion:vortex-file-compressed -7.3% +0.9% -8.2% +10.0% ➖ noise
56 duckdb:duckdb -0.9% +0.9% -1.8% +11.4% ➖ noise
56 duckdb:vortex-compact -2.3% +0.9% -3.2% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -3.1% +0.9% -4.0% +13.3% ➖ noise
57 datafusion:vortex-compact -7.6% -2.6% -5.1% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -5.6% -2.6% -3.2% +10.0% ➖ noise
57 duckdb:duckdb -4.1% -2.6% -1.6% +10.0% ➖ noise
57 duckdb:vortex-compact +3.2% -2.6% +5.9% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -5.6% -2.6% -3.1% +21.5% ➖ noise
58 datafusion:vortex-compact -4.7% -5.2% +0.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -5.9% -5.2% -0.7% +10.0% ➖ noise
58 duckdb:duckdb -9.3% -5.2% -4.2% +15.8% ➖ noise
58 duckdb:vortex-compact -11.5% -5.2% -6.6% +14.0% ➖ noise
58 duckdb:vortex-file-compressed -4.0% -5.2% +1.3% +18.5% ➖ noise
59 datafusion:vortex-compact -5.1% -3.0% -2.2% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -3.4% -3.0% -0.5% +10.0% ➖ noise
59 duckdb:duckdb -4.8% -3.0% -1.9% +10.0% ➖ noise
59 duckdb:vortex-compact -1.4% -3.0% +1.6% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -1.9% -3.0% +1.1% +10.0% ➖ noise
60 datafusion:vortex-compact -5.8% -5.0% -0.8% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -4.5% -5.0% +0.6% +10.0% ➖ noise
60 duckdb:duckdb -13.0% -5.0% -8.4% +12.4% ➖ noise
60 duckdb:vortex-compact -7.2% -5.0% -2.3% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -10.3% -5.0% -5.5% +10.8% ➖ noise
61 datafusion:vortex-compact -4.0% -3.4% -0.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -6.7% -3.4% -3.4% +10.0% ➖ noise
61 duckdb:duckdb -5.0% -3.4% -1.6% +11.1% ➖ noise
61 duckdb:vortex-compact -7.6% -3.4% -4.4% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -2.6% -3.4% +0.8% +11.3% ➖ noise
62 datafusion:vortex-compact -11.6% -1.7% -10.1% +13.7% ➖ noise
62 datafusion:vortex-file-compressed -8.3% -1.7% -6.8% +14.6% ➖ noise
62 duckdb:duckdb -7.9% -1.7% -6.3% +14.0% ➖ noise
62 duckdb:vortex-compact +8.8% -1.7% +10.6% +31.5% ➖ noise
62 duckdb:vortex-file-compressed -12.1% -1.7% -10.6% +23.0% ➖ noise
63 datafusion:vortex-compact -3.5% -6.6% +3.3% +21.7% ➖ noise
63 datafusion:vortex-file-compressed -4.4% -6.6% +2.4% +10.0% ➖ noise
63 duckdb:duckdb -9.1% -6.6% -2.7% +10.0% ➖ noise
63 duckdb:vortex-compact -5.5% -6.6% +1.3% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -8.9% -6.6% -2.4% +19.8% ➖ noise
64 datafusion:vortex-compact -5.9% -5.0% -0.9% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -6.7% -5.0% -1.8% +10.0% ➖ noise
64 duckdb:duckdb -7.6% -5.0% -2.7% +10.0% ➖ noise
64 duckdb:vortex-compact -4.5% -5.0% +0.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -5.7% -5.0% -0.7% +10.0% ➖ noise
65 datafusion:vortex-compact +2.1% -12.3% +16.5% +10.0% 🚨 regression
65 datafusion:vortex-file-compressed -4.7% -12.3% +8.7% +10.0% ➖ noise
65 duckdb:duckdb -3.0% -12.3% +10.7% +16.2% ➖ noise
65 duckdb:vortex-compact -8.1% -12.3% +4.8% +10.2% ➖ noise
65 duckdb:vortex-file-compressed -5.2% -12.3% +8.2% +10.3% ➖ noise
66 datafusion:vortex-compact -4.3% -6.2% +2.1% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -5.1% -6.2% +1.2% +10.0% ➖ noise
66 duckdb:duckdb +0.6% -6.2% +7.2% +11.9% ➖ noise
66 duckdb:vortex-compact -6.2% -6.2% +0.0% +10.6% ➖ noise
66 duckdb:vortex-file-compressed -3.2% -6.2% +3.2% +18.8% ➖ noise
67 datafusion:vortex-compact -4.9% -5.3% +0.5% +10.1% ➖ noise
67 datafusion:vortex-file-compressed +1.3% -5.3% +7.0% +10.0% ➖ noise
67 duckdb:duckdb -6.2% -5.3% -0.9% +10.0% ➖ noise
67 duckdb:vortex-compact -4.6% -5.3% +0.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -3.2% -5.3% +2.3% +10.0% ➖ noise
68 datafusion:vortex-compact -5.8% -8.4% +2.8% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -8.5% -8.4% -0.1% +10.0% ➖ noise
68 duckdb:duckdb -4.2% -8.4% +4.6% +10.0% ➖ noise
68 duckdb:vortex-compact +1.7% -8.4% +11.1% +10.0% 🚨 regression
68 duckdb:vortex-file-compressed -0.7% -8.4% +8.4% +10.0% ➖ noise
69 datafusion:vortex-compact -6.9% -2.9% -4.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -1.1% -2.9% +1.9% +10.1% ➖ noise
69 duckdb:duckdb -5.6% -2.9% -2.7% +11.0% ➖ noise
69 duckdb:vortex-compact -7.1% -2.9% -4.3% +10.3% ➖ noise
69 duckdb:vortex-file-compressed -7.0% -2.9% -4.2% +10.0% ➖ noise
70 datafusion:vortex-compact -8.4% -4.0% -4.7% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -8.5% -4.0% -4.8% +10.0% ➖ noise
70 duckdb:duckdb -2.5% -4.0% +1.5% +14.8% ➖ noise
70 duckdb:vortex-compact +1.7% -4.0% +5.9% +10.1% ➖ noise
70 duckdb:vortex-file-compressed -4.8% -4.0% -0.9% +10.4% ➖ noise
71 datafusion:vortex-compact -1.2% +0.4% -1.6% +10.4% ➖ noise
71 datafusion:vortex-file-compressed -4.4% +0.4% -4.8% +10.3% ➖ noise
71 duckdb:duckdb -11.9% +0.4% -12.2% +13.2% ✅ faster
71 duckdb:vortex-compact +1.4% +0.4% +1.0% +14.6% ➖ noise
71 duckdb:vortex-file-compressed -7.3% +0.4% -7.6% +14.0% ➖ noise
72 datafusion:vortex-compact -8.1% -4.4% -3.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -6.6% -4.4% -2.3% +10.0% ➖ noise
72 duckdb:duckdb -1.3% -4.4% +3.3% +10.0% ➖ noise
72 duckdb:vortex-compact -3.1% -4.4% +1.3% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.8% -4.4% +1.6% +10.0% ➖ noise
73 datafusion:vortex-compact -6.5% -6.8% +0.3% +17.2% ➖ noise
73 datafusion:vortex-file-compressed -5.8% -6.8% +1.1% +15.6% ➖ noise
73 duckdb:duckdb -5.4% -6.8% +1.5% +13.1% ➖ noise
73 duckdb:vortex-compact -4.1% -6.8% +3.0% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -6.0% -6.8% +0.9% +10.5% ➖ noise
74 datafusion:vortex-compact -4.7% -7.6% +3.1% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -5.7% -7.6% +2.0% +10.0% ➖ noise
74 duckdb:duckdb -6.5% -7.6% +1.1% +18.7% ➖ noise
74 duckdb:vortex-compact -3.7% -7.6% +4.2% +10.2% ➖ noise
74 duckdb:vortex-file-compressed +0.8% -7.6% +9.1% +11.4% ➖ noise
75 datafusion:vortex-compact -5.2% -7.4% +2.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -10.7% -7.4% -3.5% +10.0% ➖ noise
75 duckdb:duckdb -6.6% -7.4% +0.8% +10.0% ➖ noise
75 duckdb:vortex-compact -13.9% -7.4% -7.0% +10.2% ➖ noise
75 duckdb:vortex-file-compressed -3.3% -7.4% +4.4% +10.0% ➖ noise
76 datafusion:vortex-compact -5.2% -1.7% -3.6% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -7.3% -1.7% -5.7% +10.4% ➖ noise
76 duckdb:duckdb -5.0% -1.7% -3.4% +17.2% ➖ noise
76 duckdb:vortex-compact -1.2% -1.7% +0.5% +12.8% ➖ noise
76 duckdb:vortex-file-compressed +2.8% -1.7% +4.5% +18.0% ➖ noise
77 datafusion:vortex-compact -4.7% -1.9% -2.8% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -6.7% -1.9% -4.9% +11.2% ➖ noise
77 duckdb:duckdb -4.2% -1.9% -2.3% +17.6% ➖ noise
77 duckdb:vortex-compact -2.9% -1.9% -1.0% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -6.1% -1.9% -4.2% +13.9% ➖ noise
78 datafusion:vortex-compact -6.4% -5.3% -1.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -4.9% -5.3% +0.5% +10.0% ➖ noise
78 duckdb:duckdb -2.9% -5.3% +2.6% +10.0% ➖ noise
78 duckdb:vortex-compact -7.8% -5.3% -2.6% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -3.7% -5.3% +1.7% +10.0% ➖ noise
79 datafusion:vortex-compact -4.4% -5.7% +1.4% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -10.7% -5.7% -5.4% +20.2% ➖ noise
79 duckdb:duckdb -4.7% -5.7% +1.0% +10.8% ➖ noise
79 duckdb:vortex-compact +10.6% -5.7% +17.2% +16.6% 🚨 regression
79 duckdb:vortex-file-compressed -8.3% -5.7% -2.8% +15.5% ➖ noise
80 datafusion:vortex-compact -7.1% -2.2% -5.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -7.5% -2.2% -5.3% +10.0% ➖ noise
80 duckdb:duckdb -1.2% -2.2% +1.1% +10.8% ➖ noise
80 duckdb:vortex-compact -4.7% -2.2% -2.6% +10.8% ➖ noise
80 duckdb:vortex-file-compressed -8.4% -2.2% -6.3% +10.0% ➖ noise
81 datafusion:vortex-compact -5.4% -4.9% -0.5% +11.3% ➖ noise
81 datafusion:vortex-file-compressed -5.6% -4.9% -0.7% +10.0% ➖ noise
81 duckdb:duckdb -4.9% -4.9% -0.0% +10.0% ➖ noise
81 duckdb:vortex-compact +4.8% -4.9% +10.2% +10.0% 🚨 regression
81 duckdb:vortex-file-compressed -2.3% -4.9% +2.7% +10.0% ➖ noise
82 datafusion:vortex-compact -8.8% -9.2% +0.4% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -4.4% -9.2% +5.3% +10.0% ➖ noise
82 duckdb:duckdb -9.1% -9.2% +0.1% +15.0% ➖ noise
82 duckdb:vortex-compact -5.5% -9.2% +4.0% +11.3% ➖ noise
82 duckdb:vortex-file-compressed -9.7% -9.2% -0.6% +11.1% ➖ noise
83 datafusion:vortex-compact -6.9% -8.0% +1.2% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -3.6% -8.0% +4.8% +10.0% ➖ noise
83 duckdb:duckdb -7.7% -8.0% +0.4% +11.9% ➖ noise
83 duckdb:vortex-compact -5.2% -8.0% +3.1% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -5.1% -8.0% +3.2% +11.5% ➖ noise
84 datafusion:vortex-compact -9.8% -5.8% -4.3% +12.9% ➖ noise
84 datafusion:vortex-file-compressed -7.9% -5.8% -2.3% +11.0% ➖ noise
84 duckdb:duckdb +0.2% -5.8% +6.3% +10.6% ➖ noise
84 duckdb:vortex-compact -2.3% -5.8% +3.7% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -9.8% -5.8% -4.3% +10.0% ➖ noise
85 datafusion:vortex-compact -6.7% -4.9% -1.9% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -6.3% -4.9% -1.5% +10.0% ➖ noise
85 duckdb:duckdb -4.3% -4.9% +0.7% +15.8% ➖ noise
85 duckdb:vortex-compact -9.0% -4.9% -4.3% +11.1% ➖ noise
85 duckdb:vortex-file-compressed -4.0% -4.9% +0.9% +10.0% ➖ noise
86 datafusion:vortex-compact -9.0% -5.7% -3.5% +10.0% ➖ noise
86 datafusion:vortex-file-compressed -11.7% -5.7% -6.4% +14.6% ➖ noise
86 duckdb:duckdb -10.9% -5.7% -5.5% +14.3% ➖ noise
86 duckdb:vortex-compact -3.4% -5.7% +2.5% +19.1% ➖ noise
86 duckdb:vortex-file-compressed +1.6% -5.7% +7.7% +21.5% ➖ noise
87 datafusion:vortex-compact -6.7% -4.0% -2.9% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +1.8% -4.0% +6.0% +10.0% ➖ noise
87 duckdb:duckdb -0.2% -4.0% +3.9% +12.5% ➖ noise
87 duckdb:vortex-compact -11.2% -4.0% -7.5% +12.5% ➖ noise
87 duckdb:vortex-file-compressed -5.7% -4.0% -1.9% +10.8% ➖ noise
88 datafusion:vortex-compact -2.5% -3.9% +1.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.7% -3.9% +2.3% +10.9% ➖ noise
88 duckdb:duckdb +0.7% -3.9% +4.8% +10.0% ➖ noise
88 duckdb:vortex-compact -6.3% -3.9% -2.6% +11.8% ➖ noise
88 duckdb:vortex-file-compressed -4.8% -3.9% -1.0% +10.0% ➖ noise
89 datafusion:vortex-compact -3.5% -5.1% +1.7% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -5.3% -5.1% -0.3% +10.2% ➖ noise
89 duckdb:duckdb -2.7% -5.1% +2.6% +12.9% ➖ noise
89 duckdb:vortex-compact -2.4% -5.1% +2.8% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -8.3% -5.1% -3.3% +12.2% ➖ noise
90 datafusion:vortex-compact -4.1% -11.4% +8.1% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -5.2% -11.4% +7.0% +10.0% ➖ noise
90 duckdb:duckdb +1.9% -11.4% +14.9% +12.1% 🚨 regression
90 duckdb:vortex-compact -5.0% -11.4% +7.2% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -9.0% -11.4% +2.6% +12.0% ➖ noise
91 datafusion:vortex-compact -8.1% -3.2% -5.0% +14.7% ➖ noise
91 datafusion:vortex-file-compressed -8.6% -3.2% -5.5% +10.0% ➖ noise
91 duckdb:duckdb -7.9% -3.2% -4.9% +15.6% ➖ noise
91 duckdb:vortex-compact -3.1% -3.2% +0.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -5.8% -3.2% -2.7% +19.6% ➖ noise
92 datafusion:vortex-compact -8.2% -8.9% +0.7% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -12.2% -8.9% -3.6% +10.0% ➖ noise
92 duckdb:duckdb +1.1% -8.9% +10.9% +11.0% ➖ noise
92 duckdb:vortex-compact -7.9% -8.9% +1.1% +24.7% ➖ noise
92 duckdb:vortex-file-compressed -13.3% -8.9% -4.8% +10.9% ➖ noise
93 datafusion:vortex-compact -3.7% -5.2% +1.6% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -9.3% -5.2% -4.3% +10.0% ➖ noise
93 duckdb:duckdb -11.4% -5.2% -6.5% +12.5% ➖ noise
93 duckdb:vortex-compact -4.2% -5.2% +1.1% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -8.7% -5.2% -3.7% +11.3% ➖ noise
94 datafusion:vortex-compact -9.5% -5.8% -4.0% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -5.8% -5.8% -0.1% +10.3% ➖ noise
94 duckdb:duckdb -3.9% -5.8% +2.0% +12.6% ➖ noise
94 duckdb:vortex-compact -1.9% -5.8% +4.1% +13.6% ➖ noise
94 duckdb:vortex-file-compressed -5.2% -5.8% +0.6% +10.0% ➖ noise
95 datafusion:vortex-compact -5.5% -4.5% -1.0% +11.4% ➖ noise
95 datafusion:vortex-file-compressed -1.6% -4.5% +3.1% +12.3% ➖ noise
95 duckdb:duckdb +12.2% -4.5% +17.4% +19.0% ➖ noise
95 duckdb:vortex-compact +0.2% -4.5% +4.9% +21.2% ➖ noise
95 duckdb:vortex-file-compressed +6.2% -4.5% +11.2% +19.1% ➖ noise
96 datafusion:vortex-compact -4.6% -9.1% +5.1% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -8.5% -9.1% +0.7% +10.0% ➖ noise
96 duckdb:duckdb -10.1% -9.1% -1.1% +19.2% ➖ noise
96 duckdb:vortex-compact -4.6% -9.1% +5.0% +11.1% ➖ noise
96 duckdb:vortex-file-compressed -4.4% -9.1% +5.2% +11.7% ➖ noise
97 datafusion:vortex-compact -7.0% -7.7% +0.8% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -13.3% -7.7% -6.1% +11.3% ➖ noise
97 duckdb:duckdb -5.7% -7.7% +2.1% +12.7% ➖ noise
97 duckdb:vortex-compact +1.4% -7.7% +9.8% +13.4% ➖ noise
97 duckdb:vortex-file-compressed -3.1% -7.7% +5.0% +10.6% ➖ noise
98 datafusion:vortex-compact -9.1% -7.0% -2.3% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -5.3% -7.0% +1.8% +10.0% ➖ noise
98 duckdb:duckdb -3.9% -7.0% +3.3% +11.6% ➖ noise
98 duckdb:vortex-compact -7.3% -7.0% -0.3% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +0.8% -7.0% +8.4% +12.6% ➖ noise
99 datafusion:vortex-compact -2.6% -11.8% +10.4% +14.1% ➖ noise
99 datafusion:vortex-file-compressed -2.8% -11.8% +10.2% +15.7% ➖ noise
99 duckdb:duckdb -0.6% -11.8% +12.7% +12.4% 🚨 regression
99 duckdb:vortex-compact -4.9% -11.8% +7.8% +16.8% ➖ noise
99 duckdb:vortex-file-compressed +0.6% -11.8% +14.0% +24.9% ➖ noise

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -1.5%

datafusion / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 383302992 390294171 0.98
tpch_q02/datafusion:vortex-file-compressed 118212278 115404594 1.02
tpch_q03/datafusion:vortex-file-compressed 203265280 207689021 0.98
tpch_q04/datafusion:vortex-file-compressed 99022538 104027054 0.95
tpch_q05/datafusion:vortex-file-compressed 379171546 384903526 0.99
tpch_q06/datafusion:vortex-file-compressed 41403892 41618163 0.99
tpch_q07/datafusion:vortex-file-compressed 555335271 567894383 0.98
tpch_q08/datafusion:vortex-file-compressed 370455105 383292231 0.97
tpch_q09/datafusion:vortex-file-compressed 655971806 674347578 0.97
tpch_q10/datafusion:vortex-file-compressed 236237064 244988698 0.96
tpch_q11/datafusion:vortex-file-compressed 84762652 86971266 0.97
tpch_q12/datafusion:vortex-file-compressed 107162107 108778791 0.99
tpch_q13/datafusion:vortex-file-compressed 222102880 225530862 0.98
tpch_q14/datafusion:vortex-file-compressed 57056648 58315844 0.98
tpch_q15/datafusion:vortex-file-compressed 107431965 108910342 0.99
tpch_q16/datafusion:vortex-file-compressed 76997081 78504234 0.98
tpch_q17/datafusion:vortex-file-compressed 644778157 653983733 0.99
tpch_q18/datafusion:vortex-file-compressed 875796753 895431927 0.98
tpch_q19/datafusion:vortex-file-compressed 100286023 101006218 0.99
tpch_q20/datafusion:vortex-file-compressed 170683313 172638389 0.99
tpch_q21/datafusion:vortex-file-compressed 658057497 669603542 0.98
tpch_q22/datafusion:vortex-file-compressed 65055115 62922426 1.03
datafusion / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 438329416 450502714 0.97
tpch_q02/datafusion:vortex-compact 119694555 123583483 0.97
tpch_q03/datafusion:vortex-compact 215955548 226040736 0.96
tpch_q04/datafusion:vortex-compact 120437839 123147420 0.98
tpch_q05/datafusion:vortex-compact 388106313 394052618 0.98
tpch_q06/datafusion:vortex-compact 64479302 65142742 0.99
tpch_q07/datafusion:vortex-compact 588094296 597550971 0.98
tpch_q08/datafusion:vortex-compact 384027886 389191576 0.99
tpch_q09/datafusion:vortex-compact 679454302 691924147 0.98
tpch_q10/datafusion:vortex-compact 272090791 280274386 0.97
tpch_q11/datafusion:vortex-compact 90471980 91228018 0.99
tpch_q12/datafusion:vortex-compact 168456171 174295711 0.97
tpch_q13/datafusion:vortex-compact 275284625 280625869 0.98
tpch_q14/datafusion:vortex-compact 74444790 74781119 1.00
tpch_q15/datafusion:vortex-compact 166248936 168110703 0.99
tpch_q16/datafusion:vortex-compact 84237518 82862695 1.02
tpch_q17/datafusion:vortex-compact 642667227 659453079 0.97
tpch_q18/datafusion:vortex-compact 891158417 896393538 0.99
tpch_q19/datafusion:vortex-compact 146117384 149798717 0.98
tpch_q20/datafusion:vortex-compact 196832538 202221373 0.97
tpch_q21/datafusion:vortex-compact 698782754 707888928 0.99
tpch_q22/datafusion:vortex-compact 72270467 75722496 0.95
datafusion / parquet (0.980x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 416127942 434112903 0.96
tpch_q02/datafusion:parquet 185878092 193963521 0.96
tpch_q03/datafusion:parquet 292938320 302594409 0.97
tpch_q04/datafusion:parquet 133715383 139078596 0.96
tpch_q05/datafusion:parquet 441477929 453044791 0.97
tpch_q06/datafusion:parquet 129315325 127991628 1.01
tpch_q07/datafusion:parquet 628813744 634549176 0.99
tpch_q08/datafusion:parquet 483839981 492996566 0.98
tpch_q09/datafusion:parquet 756305020 783859719 0.96
tpch_q10/datafusion:parquet 494544080 512171694 0.97
tpch_q11/datafusion:parquet 132958232 135837861 0.98
tpch_q12/datafusion:parquet 218523369 203275289 1.08
tpch_q13/datafusion:parquet 338527015 348066763 0.97
tpch_q14/datafusion:parquet 156519301 167167819 0.94
tpch_q15/datafusion:parquet 244970078 253038732 0.97
tpch_q16/datafusion:parquet 134187001 136402629 0.98
tpch_q17/datafusion:parquet 682992217 699827027 0.98
tpch_q18/datafusion:parquet 874970240 909011289 0.96
tpch_q19/datafusion:parquet 278523737 267713545 1.04
tpch_q20/datafusion:parquet 302908279 306526970 0.99
tpch_q21/datafusion:parquet 725797279 745024908 0.97
tpch_q22/datafusion:parquet 219022426 225719182 0.97
datafusion / arrow (0.953x ➖, 2↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 590895946 620225105 0.95
tpch_q02/datafusion:arrow 164095162 174129762 0.94
tpch_q03/datafusion:arrow 463151961 492149372 0.94
tpch_q04/datafusion:arrow 🚀 343988686 385882456 0.89
tpch_q05/datafusion:arrow 903592136 972273163 0.93
tpch_q06/datafusion:arrow 271167945 293038665 0.93
tpch_q07/datafusion:arrow 1110191162 1224472323 0.91
tpch_q08/datafusion:arrow 1110625094 1166911085 0.95
tpch_q09/datafusion:arrow 1314513704 1375296038 0.96
tpch_q10/datafusion:arrow 595180973 607096985 0.98
tpch_q11/datafusion:arrow 150552150 152430168 0.99
tpch_q12/datafusion:arrow 🚀 648003556 757869933 0.86
tpch_q13/datafusion:arrow 519520155 534194008 0.97
tpch_q14/datafusion:arrow 310167477 311102004 1.00
tpch_q15/datafusion:arrow 649877408 684669457 0.95
tpch_q16/datafusion:arrow 108263310 107023585 1.01
tpch_q17/datafusion:arrow 1295289890 1334319360 0.97
tpch_q18/datafusion:arrow 1827547564 1832108408 1.00
tpch_q19/datafusion:arrow 499814521 525719503 0.95
tpch_q20/datafusion:arrow 485382440 502121138 0.97
tpch_q21/datafusion:arrow 2846527945 2844659853 1.00
tpch_q22/datafusion:arrow 140510251 148363221 0.95
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175108494 176792523 0.99
tpch_q02/duckdb:vortex-file-compressed 54924659 54611894 1.01
tpch_q03/duckdb:vortex-file-compressed 127092584 128261880 0.99
tpch_q04/duckdb:vortex-file-compressed 148771562 152060905 0.98
tpch_q05/duckdb:vortex-file-compressed 132907222 133769229 0.99
tpch_q06/duckdb:vortex-file-compressed 47673778 47815846 1.00
tpch_q07/duckdb:vortex-file-compressed 147580399 147987987 1.00
tpch_q08/duckdb:vortex-file-compressed 174297162 177321508 0.98
tpch_q09/duckdb:vortex-file-compressed 336225258 338183924 0.99
tpch_q10/duckdb:vortex-file-compressed 153432111 157278242 0.98
tpch_q11/duckdb:vortex-file-compressed 35722516 36310832 0.98
tpch_q12/duckdb:vortex-file-compressed 90487517 92534144 0.98
tpch_q13/duckdb:vortex-file-compressed 248000227 249637515 0.99
tpch_q14/duckdb:vortex-file-compressed 70499214 74252167 0.95
tpch_q15/duckdb:vortex-file-compressed 96802361 97595056 0.99
tpch_q16/duckdb:vortex-file-compressed 79937022 79965991 1.00
tpch_q17/duckdb:vortex-file-compressed 100652253 105917883 0.95
tpch_q18/duckdb:vortex-file-compressed 278931905 274329768 1.02
tpch_q19/duckdb:vortex-file-compressed 92251675 91241595 1.01
tpch_q20/duckdb:vortex-file-compressed 164668576 168245661 0.98
tpch_q21/duckdb:vortex-file-compressed 546956801 564019851 0.97
tpch_q22/duckdb:vortex-file-compressed 77917433 76770671 1.01
duckdb / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229620725 232327158 0.99
tpch_q02/duckdb:vortex-compact 58886389 57172835 1.03
tpch_q03/duckdb:vortex-compact 141909933 143837981 0.99
tpch_q04/duckdb:vortex-compact 178535194 175623582 1.02
tpch_q05/duckdb:vortex-compact 149463721 148431177 1.01
tpch_q06/duckdb:vortex-compact 85927863 86485116 0.99
tpch_q07/duckdb:vortex-compact 205445144 205945351 1.00
tpch_q08/duckdb:vortex-compact 193288981 193753288 1.00
tpch_q09/duckdb:vortex-compact 361511535 370511899 0.98
tpch_q10/duckdb:vortex-compact 186521144 191214134 0.98
tpch_q11/duckdb:vortex-compact 42981510 42307547 1.02
tpch_q12/duckdb:vortex-compact 208346353 210998140 0.99
tpch_q13/duckdb:vortex-compact 295960654 299998419 0.99
tpch_q14/duckdb:vortex-compact 105817071 105345588 1.00
tpch_q15/duckdb:vortex-compact 119829796 122353216 0.98
tpch_q16/duckdb:vortex-compact 88992420 85886236 1.04
tpch_q17/duckdb:vortex-compact 117466800 120025851 0.98
tpch_q18/duckdb:vortex-compact 294499644 289856615 1.02
tpch_q19/duckdb:vortex-compact 114421844 116402842 0.98
tpch_q20/duckdb:vortex-compact 206220367 211734222 0.97
tpch_q21/duckdb:vortex-compact 631396574 643486922 0.98
tpch_q22/duckdb:vortex-compact 90560776 91687858 0.99
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257458247 254011322 1.01
tpch_q02/duckdb:parquet 100270617 104179582 0.96
tpch_q03/duckdb:parquet 207730680 214255166 0.97
tpch_q04/duckdb:parquet 137246927 135899063 1.01
tpch_q05/duckdb:parquet 218247004 214011895 1.02
tpch_q06/duckdb:parquet 66358997 66764291 0.99
tpch_q07/duckdb:parquet 177006190 181117317 0.98
tpch_q08/duckdb:parquet 255334514 255654027 1.00
tpch_q09/duckdb:parquet 464692015 464741613 1.00
tpch_q10/duckdb:parquet 600078406 603653580 0.99
tpch_q11/duckdb:parquet 39910823 44086644 0.91
tpch_q12/duckdb:parquet 127065352 124921530 1.02
tpch_q13/duckdb:parquet 445527265 465877529 0.96
tpch_q14/duckdb:parquet 176124713 177011883 0.99
tpch_q15/duckdb:parquet 99306005 101243652 0.98
tpch_q16/duckdb:parquet 163613416 165795295 0.99
tpch_q17/duckdb:parquet 179428910 179402413 1.00
tpch_q18/duckdb:parquet 350902369 347328301 1.01
tpch_q19/duckdb:parquet 282720917 296105138 0.95
tpch_q20/duckdb:parquet 228373704 216339383 1.06
tpch_q21/duckdb:parquet 571488043 573958029 1.00
tpch_q22/duckdb:parquet 290559402 292068213 0.99
duckdb / duckdb (0.982x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117369037 116983649 1.00
tpch_q02/duckdb:duckdb 47756524 50103021 0.95
tpch_q03/duckdb:duckdb 97291933 99056447 0.98
tpch_q04/duckdb:duckdb 130633229 130551202 1.00
tpch_q05/duckdb:duckdb 109487279 111823197 0.98
tpch_q06/duckdb:duckdb 39119755 39176487 1.00
tpch_q07/duckdb:duckdb 86256541 86581623 1.00
tpch_q08/duckdb:duckdb 110730840 111715514 0.99
tpch_q09/duckdb:duckdb 279453793 276769121 1.01
tpch_q10/duckdb:duckdb 200820514 211917451 0.95
tpch_q11/duckdb:duckdb 16055580 15774980 1.02
tpch_q12/duckdb:duckdb 82816594 86093116 0.96
tpch_q13/duckdb:duckdb 247387754 256353003 0.97
tpch_q14/duckdb:duckdb 69778165 72026707 0.97
tpch_q15/duckdb:duckdb 77642338 79125087 0.98
tpch_q16/duckdb:duckdb 73304947 77194601 0.95
tpch_q17/duckdb:duckdb 85090941 84936693 1.00
tpch_q18/duckdb:duckdb 215631822 214888628 1.00
tpch_q19/duckdb:duckdb 115813027 117335374 0.99
tpch_q20/duckdb:duckdb 111058740 111353227 1.00
tpch_q21/duckdb:duckdb 295097183 303694665 0.97
tpch_q22/duckdb:duckdb 62356611 65953332 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.7% -1.4% -3.3% +10.4% ➖ noise
1 datafusion:vortex-compact -2.7% -1.4% -1.3% +11.9% ➖ noise
1 datafusion:vortex-file-compressed -1.8% -1.4% -0.4% +11.4% ➖ noise
1 duckdb:duckdb +0.3% -1.4% +1.8% +10.4% ➖ noise
1 duckdb:vortex-compact -1.2% -1.4% +0.3% +10.4% ➖ noise
1 duckdb:vortex-file-compressed -1.0% -1.4% +0.5% +11.4% ➖ noise
2 datafusion:arrow -5.8% -4.0% -1.9% +10.0% ➖ noise
2 datafusion:vortex-compact -3.1% -4.0% +0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +2.4% -4.0% +6.7% +10.0% ➖ noise
2 duckdb:duckdb -4.7% -4.0% -0.8% +12.8% ➖ noise
2 duckdb:vortex-compact +3.0% -4.0% +7.2% +11.1% ➖ noise
2 duckdb:vortex-file-compressed +0.6% -4.0% +4.7% +11.9% ➖ noise
3 datafusion:arrow -5.9% -3.1% -2.9% +10.0% ➖ noise
3 datafusion:vortex-compact -4.5% -3.1% -1.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -2.1% -3.1% +1.0% +10.0% ➖ noise
3 duckdb:duckdb -1.8% -3.1% +1.4% +10.0% ➖ noise
3 duckdb:vortex-compact -1.3% -3.1% +1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.9% -3.1% +2.3% +10.0% ➖ noise
4 datafusion:arrow -10.9% -1.5% -9.5% +10.0% ✅ faster
4 datafusion:vortex-compact -2.2% -1.5% -0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.8% -1.5% -3.4% +10.0% ➖ noise
4 duckdb:duckdb +0.1% -1.5% +1.5% +10.0% ➖ noise
4 duckdb:vortex-compact +1.7% -1.5% +3.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.2% -1.5% -0.7% +10.0% ➖ noise
5 datafusion:arrow -7.1% -0.3% -6.8% +10.0% ➖ noise
5 datafusion:vortex-compact -1.5% -0.3% -1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.5% -0.3% -1.2% +10.0% ➖ noise
5 duckdb:duckdb -2.1% -0.3% -1.8% +10.0% ➖ noise
5 duckdb:vortex-compact +0.7% -0.3% +1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% -0.3% -0.3% +10.0% ➖ noise
6 datafusion:arrow -7.5% +0.2% -7.7% +10.0% ➖ noise
6 datafusion:vortex-compact -1.0% +0.2% -1.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% +0.2% -0.7% +10.0% ➖ noise
6 duckdb:duckdb -0.1% +0.2% -0.4% +15.3% ➖ noise
6 duckdb:vortex-compact -0.6% +0.2% -0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.3% +0.2% -0.5% +12.5% ➖ noise
7 datafusion:arrow -9.3% -1.6% -7.9% +10.0% ➖ noise
7 datafusion:vortex-compact -1.6% -1.6% +0.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.2% -1.6% -0.6% +10.0% ➖ noise
7 duckdb:duckdb -0.4% -1.6% +1.2% +11.2% ➖ noise
7 duckdb:vortex-compact -0.2% -1.6% +1.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% -1.6% +1.3% +10.0% ➖ noise
8 datafusion:arrow -4.8% -1.0% -3.9% +10.0% ➖ noise
8 datafusion:vortex-compact -1.3% -1.0% -0.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -3.3% -1.0% -2.4% +10.0% ➖ noise
8 duckdb:duckdb -0.9% -1.0% +0.1% +10.0% ➖ noise
8 duckdb:vortex-compact -0.2% -1.0% +0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.7% -1.0% -0.7% +10.0% ➖ noise
9 datafusion:arrow -4.4% -1.8% -2.7% +10.0% ➖ noise
9 datafusion:vortex-compact -1.8% -1.8% -0.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.7% -1.8% -1.0% +10.0% ➖ noise
9 duckdb:duckdb +1.0% -1.8% +2.8% +10.0% ➖ noise
9 duckdb:vortex-compact -2.4% -1.8% -0.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.6% -1.8% +1.2% +10.0% ➖ noise
10 datafusion:arrow -2.0% -2.0% +0.1% +10.0% ➖ noise
10 datafusion:vortex-compact -2.9% -2.0% -0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.6% -2.0% -1.6% +10.0% ➖ noise
10 duckdb:duckdb -5.2% -2.0% -3.3% +10.0% ➖ noise
10 duckdb:vortex-compact -2.5% -2.0% -0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.4% -2.0% -0.4% +10.0% ➖ noise
11 datafusion:arrow -1.2% -5.9% +4.9% +10.0% ➖ noise
11 datafusion:vortex-compact -0.8% -5.9% +5.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.5% -5.9% +3.5% +10.0% ➖ noise
11 duckdb:duckdb +1.8% -5.9% +8.1% +18.4% ➖ noise
11 duckdb:vortex-compact +1.6% -5.9% +7.9% +13.4% ➖ noise
11 duckdb:vortex-file-compressed -1.6% -5.9% +4.5% +14.0% ➖ noise
12 datafusion:arrow -14.5% +4.6% -18.2% +43.7% ➖ noise
12 datafusion:vortex-compact -3.4% +4.6% -7.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.5% +4.6% -5.8% +10.0% ➖ noise
12 duckdb:duckdb -3.8% +4.6% -8.0% +10.0% ➖ noise
12 duckdb:vortex-compact -1.3% +4.6% -5.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.2% +4.6% -6.5% +10.0% ➖ noise
13 datafusion:arrow -2.7% -3.6% +0.8% +10.0% ➖ noise
13 datafusion:vortex-compact -1.9% -3.6% +1.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.5% -3.6% +2.1% +10.0% ➖ noise
13 duckdb:duckdb -3.5% -3.6% +0.1% +10.0% ➖ noise
13 duckdb:vortex-compact -1.3% -3.6% +2.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.7% -3.6% +3.0% +10.0% ➖ noise
14 datafusion:arrow -0.3% -3.5% +3.3% +10.0% ➖ noise
14 datafusion:vortex-compact -0.4% -3.5% +3.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.2% -3.5% +1.4% +13.6% ➖ noise
14 duckdb:duckdb -3.1% -3.5% +0.4% +10.0% ➖ noise
14 duckdb:vortex-compact +0.4% -3.5% +4.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.1% -3.5% -1.6% +11.1% ➖ noise
15 datafusion:arrow -5.1% -2.6% -2.6% +10.0% ➖ noise
15 datafusion:vortex-compact -1.1% -2.6% +1.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.4% -2.6% +1.2% +10.0% ➖ noise
15 duckdb:duckdb -1.9% -2.6% +0.7% +10.0% ➖ noise
15 duckdb:vortex-compact -2.1% -2.6% +0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.8% -2.6% +1.8% +10.0% ➖ noise
16 datafusion:arrow +1.2% -1.5% +2.7% +10.2% ➖ noise
16 datafusion:vortex-compact +1.7% -1.5% +3.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.9% -1.5% -0.5% +10.0% ➖ noise
16 duckdb:duckdb -5.0% -1.5% -3.6% +10.0% ➖ noise
16 duckdb:vortex-compact +3.6% -1.5% +5.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.0% -1.5% +1.5% +10.0% ➖ noise
17 datafusion:arrow -2.9% -1.2% -1.7% +10.0% ➖ noise
17 datafusion:vortex-compact -2.5% -1.2% -1.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.4% -1.2% -0.2% +10.7% ➖ noise
17 duckdb:duckdb +0.2% -1.2% +1.4% +10.0% ➖ noise
17 duckdb:vortex-compact -2.1% -1.2% -0.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -5.0% -1.2% -3.8% +10.0% ➖ noise
18 datafusion:arrow -0.2% -1.4% +1.2% +10.0% ➖ noise
18 datafusion:vortex-compact -0.6% -1.4% +0.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.2% -1.4% -0.8% +10.0% ➖ noise
18 duckdb:duckdb +0.3% -1.4% +1.8% +10.0% ➖ noise
18 duckdb:vortex-compact +1.6% -1.4% +3.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.7% -1.4% +3.1% +10.0% ➖ noise
19 datafusion:arrow -4.9% -0.3% -4.6% +10.0% ➖ noise
19 datafusion:vortex-compact -2.5% -0.3% -2.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +10.0% ➖ noise
19 duckdb:duckdb -1.3% -0.3% -1.0% +10.0% ➖ noise
19 duckdb:vortex-compact -1.7% -0.3% -1.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.1% -0.3% +1.4% +10.0% ➖ noise
20 datafusion:arrow -3.3% +2.1% -5.4% +10.0% ➖ noise
20 datafusion:vortex-compact -2.7% +2.1% -4.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.1% +2.1% -3.2% +10.0% ➖ noise
20 duckdb:duckdb -0.3% +2.1% -2.3% +10.0% ➖ noise
20 duckdb:vortex-compact -2.6% +2.1% -4.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -2.1% +2.1% -4.2% +10.0% ➖ noise
21 datafusion:arrow +0.1% -1.5% +1.6% +10.0% ➖ noise
21 datafusion:vortex-compact -1.3% -1.5% +0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.7% -1.5% -0.2% +10.0% ➖ noise
21 duckdb:duckdb -2.8% -1.5% -1.3% +10.0% ➖ noise
21 duckdb:vortex-compact -1.9% -1.5% -0.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -3.0% -1.5% -1.5% +10.0% ➖ noise
22 datafusion:arrow -5.3% -1.7% -3.6% +10.0% ➖ noise
22 datafusion:vortex-compact -4.6% -1.7% -2.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.4% -1.7% +5.2% +10.0% ➖ noise
22 duckdb:duckdb -5.5% -1.7% -3.8% +14.4% ➖ noise
22 duckdb:vortex-compact -1.2% -1.7% +0.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +1.5% -1.7% +3.3% +10.0% ➖ noise

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 1.024x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish +1.5%

datafusion / vortex-file-compressed (1.139x ➖, 0↑ 5↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 226291322 204275954 1.11
tpch_q02/datafusion:vortex-file-compressed 627423163 693097827 0.91
tpch_q03/datafusion:vortex-file-compressed 429869868 452038223 0.95
tpch_q04/datafusion:vortex-file-compressed 295627454 268561724 1.10
tpch_q05/datafusion:vortex-file-compressed 🚨 754240615 537728227 1.40
tpch_q06/datafusion:vortex-file-compressed 🚨 446800327 315476840 1.42
tpch_q07/datafusion:vortex-file-compressed 🚨 1155318284 349744704 3.30
tpch_q08/datafusion:vortex-file-compressed 1140735507 1303907173 0.87
tpch_q09/datafusion:vortex-file-compressed 843598644 772397979 1.09
tpch_q10/datafusion:vortex-file-compressed 1044671701 1074200014 0.97
tpch_q11/datafusion:vortex-file-compressed 816280886 753319304 1.08
tpch_q12/datafusion:vortex-file-compressed 685655445 899449636 0.76
tpch_q13/datafusion:vortex-file-compressed 🚨 437475090 302292106 1.45
tpch_q14/datafusion:vortex-file-compressed 330193889 259507346 1.27
tpch_q15/datafusion:vortex-file-compressed 🚨 766140230 510110845 1.50
tpch_q16/datafusion:vortex-file-compressed 432285119 506166333 0.85
tpch_q17/datafusion:vortex-file-compressed 670111870 553749750 1.21
tpch_q18/datafusion:vortex-file-compressed 657390537 590885931 1.11
tpch_q19/datafusion:vortex-file-compressed 848657727 682923514 1.24
tpch_q20/datafusion:vortex-file-compressed 557860722 555101694 1.00
tpch_q21/datafusion:vortex-file-compressed 904911296 773881156 1.17
tpch_q22/datafusion:vortex-file-compressed 193144755 268521798 0.72
datafusion / vortex-compact (0.968x ➖, 4↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 290705178 459099231 0.63
tpch_q02/datafusion:vortex-compact 🚀 454740201 1053051675 0.43
tpch_q03/datafusion:vortex-compact 🚀 467552505 681982412 0.69
tpch_q04/datafusion:vortex-compact 🚀 187586131 605456329 0.31
tpch_q05/datafusion:vortex-compact 569386587 591152527 0.96
tpch_q06/datafusion:vortex-compact 437743012 337511891 1.30
tpch_q07/datafusion:vortex-compact 575379184 577433485 1.00
tpch_q08/datafusion:vortex-compact 582115742 701571397 0.83
tpch_q09/datafusion:vortex-compact 526092765 461775340 1.14
tpch_q10/datafusion:vortex-compact 619279554 527256024 1.17
tpch_q11/datafusion:vortex-compact 350066171 336674259 1.04
tpch_q12/datafusion:vortex-compact 518250456 453595473 1.14
tpch_q13/datafusion:vortex-compact 217733654 228836640 0.95
tpch_q14/datafusion:vortex-compact 347347432 282380319 1.23
tpch_q15/datafusion:vortex-compact 🚨 663038008 487339353 1.36
tpch_q16/datafusion:vortex-compact 🚨 302400021 183561032 1.65
tpch_q17/datafusion:vortex-compact 501046815 410755881 1.22
tpch_q18/datafusion:vortex-compact 384637273 314223449 1.22
tpch_q19/datafusion:vortex-compact 645916188 526738275 1.23
tpch_q20/datafusion:vortex-compact 530784494 460896029 1.15
tpch_q21/datafusion:vortex-compact 599822295 655386459 0.92
tpch_q22/datafusion:vortex-compact 251922631 246094105 1.02
datafusion / parquet (1.001x ➖, 7↑ 5↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 239722214 435712588 0.55
tpch_q02/datafusion:parquet 🚀 423988987 905130058 0.47
tpch_q03/datafusion:parquet 🚀 316660818 487514785 0.65
tpch_q04/datafusion:parquet 🚀 161738008 236803445 0.68
tpch_q05/datafusion:parquet 492234867 660588812 0.75
tpch_q06/datafusion:parquet 🚨 182300635 140060979 1.30
tpch_q07/datafusion:parquet 🚀 562537623 850229898 0.66
tpch_q08/datafusion:parquet 🚀 577581524 1170956424 0.49
tpch_q09/datafusion:parquet 517714768 618286514 0.84
tpch_q10/datafusion:parquet 🚀 531414606 990489927 0.54
tpch_q11/datafusion:parquet 402151628 334534412 1.20
tpch_q12/datafusion:parquet 300325709 231411846 1.30
tpch_q13/datafusion:parquet 435477739 434780658 1.00
tpch_q14/datafusion:parquet 184924144 176499111 1.05
tpch_q15/datafusion:parquet 312873851 296815653 1.05
tpch_q16/datafusion:parquet 175557168 219410971 0.80
tpch_q17/datafusion:parquet 🚨 981150817 421511404 2.33
tpch_q18/datafusion:parquet 🚨 1187817494 515718139 2.30
tpch_q19/datafusion:parquet 🚨 1262585900 371675030 3.40
tpch_q20/datafusion:parquet 🚨 1271666958 463463001 2.74
tpch_q21/datafusion:parquet 876009347 677187929 1.29
tpch_q22/datafusion:parquet 223056461 318436575 0.70
duckdb / vortex-file-compressed (0.985x ➖, 1↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 327099972 344446630 0.95
tpch_q02/duckdb:vortex-file-compressed 964206578 1079962300 0.89
tpch_q03/duckdb:vortex-file-compressed 661371766 713729770 0.93
tpch_q04/duckdb:vortex-file-compressed 409547539 512904851 0.80
tpch_q05/duckdb:vortex-file-compressed 838218643 964789496 0.87
tpch_q06/duckdb:vortex-file-compressed 399539459 414394541 0.96
tpch_q07/duckdb:vortex-file-compressed 868366514 769328108 1.13
tpch_q08/duckdb:vortex-file-compressed 1192347330 1093015979 1.09
tpch_q09/duckdb:vortex-file-compressed 872557511 906288934 0.96
tpch_q10/duckdb:vortex-file-compressed 784723477 716235556 1.10
tpch_q11/duckdb:vortex-file-compressed 599198530 556710967 1.08
tpch_q12/duckdb:vortex-file-compressed 639606180 498566645 1.28
tpch_q13/duckdb:vortex-file-compressed 490472833 461573718 1.06
tpch_q14/duckdb:vortex-file-compressed 🚨 632583556 457925417 1.38
tpch_q15/duckdb:vortex-file-compressed 🚨 507766756 318827729 1.59
tpch_q16/duckdb:vortex-file-compressed 415553864 466470543 0.89
tpch_q17/duckdb:vortex-file-compressed 631310876 898286387 0.70
tpch_q18/duckdb:vortex-file-compressed 610913620 577381341 1.06
tpch_q19/duckdb:vortex-file-compressed 449910552 521585330 0.86
tpch_q20/duckdb:vortex-file-compressed 784257638 832650583 0.94
tpch_q21/duckdb:vortex-file-compressed 🚀 1203195117 1756068835 0.69
tpch_q22/duckdb:vortex-file-compressed 376015632 426409131 0.88
duckdb / vortex-compact (1.010x ➖, 0↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 343892806 372860973 0.92
tpch_q02/duckdb:vortex-compact 957076881 903317592 1.06
tpch_q03/duckdb:vortex-compact 578208951 681878095 0.85
tpch_q04/duckdb:vortex-compact 371633978 344148485 1.08
tpch_q05/duckdb:vortex-compact 893609296 898131198 0.99
tpch_q06/duckdb:vortex-compact 496185121 395484827 1.25
tpch_q07/duckdb:vortex-compact 763777112 1051124386 0.73
tpch_q08/duckdb:vortex-compact 978715139 903838434 1.08
tpch_q09/duckdb:vortex-compact 908865991 1001828712 0.91
tpch_q10/duckdb:vortex-compact 706455929 622153868 1.14
tpch_q11/duckdb:vortex-compact 511139595 552254013 0.93
tpch_q12/duckdb:vortex-compact 529387912 480362823 1.10
tpch_q13/duckdb:vortex-compact 🚨 637233273 461626001 1.38
tpch_q14/duckdb:vortex-compact 583669746 452393232 1.29
tpch_q15/duckdb:vortex-compact 302449697 350834352 0.86
tpch_q16/duckdb:vortex-compact 382127254 356280187 1.07
tpch_q17/duckdb:vortex-compact 670987486 690305382 0.97
tpch_q18/duckdb:vortex-compact 527864137 580264333 0.91
tpch_q19/duckdb:vortex-compact 466720736 508062643 0.92
tpch_q20/duckdb:vortex-compact 826084384 931588313 0.89
tpch_q21/duckdb:vortex-compact 1071853455 1047868980 1.02
tpch_q22/duckdb:vortex-compact 377839475 336632390 1.12
duckdb / parquet (1.046x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 655734378 727822660 0.90
tpch_q02/duckdb:parquet 1402877822 1267485900 1.11
tpch_q03/duckdb:parquet 1359553442 1266480493 1.07
tpch_q04/duckdb:parquet 961951526 828713687 1.16
tpch_q05/duckdb:parquet 1550343897 1462280765 1.06
tpch_q06/duckdb:parquet 482492175 375764458 1.28
tpch_q07/duckdb:parquet 1590517162 1511405092 1.05
tpch_q08/duckdb:parquet 2047798400 1767896027 1.16
tpch_q09/duckdb:parquet 1451188158 1470158651 0.99
tpch_q10/duckdb:parquet 1551292764 1596887290 0.97
tpch_q11/duckdb:parquet 864936216 1088737037 0.79
tpch_q12/duckdb:parquet 651057286 785654357 0.83
tpch_q13/duckdb:parquet 1098871108 940370870 1.17
tpch_q14/duckdb:parquet 1087288335 869066334 1.25
tpch_q15/duckdb:parquet 563271766 543494752 1.04
tpch_q16/duckdb:parquet 569971411 559191290 1.02
tpch_q17/duckdb:parquet 897167412 767988122 1.17
tpch_q18/duckdb:parquet 846587583 965772669 0.88
tpch_q19/duckdb:parquet 812114207 788584251 1.03
tpch_q20/duckdb:parquet 1072855591 1077406573 1.00
tpch_q21/duckdb:parquet 1437251401 1250442202 1.15
tpch_q22/duckdb:parquet 619129154 553285902 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -36.7% -29.6% -10.1% +135.5% ➖ noise
1 datafusion:vortex-file-compressed +10.8% -29.6% +57.3% +173.6% ➖ noise
1 duckdb:vortex-compact -7.8% -29.6% +31.0% +107.3% ➖ noise
1 duckdb:vortex-file-compressed -5.0% -29.6% +34.9% +107.3% ➖ noise
2 datafusion:vortex-compact -56.8% -28.0% -40.0% +107.3% ➖ noise
2 datafusion:vortex-file-compressed -9.5% -28.0% +25.7% +107.3% ➖ noise
2 duckdb:vortex-compact +6.0% -28.0% +47.1% +107.3% ➖ noise
2 duckdb:vortex-file-compressed -10.7% -28.0% +24.0% +107.3% ➖ noise
3 datafusion:vortex-compact -31.4% -16.5% -17.9% +107.3% ➖ noise
3 datafusion:vortex-file-compressed -4.9% -16.5% +13.9% +148.3% ➖ noise
3 duckdb:vortex-compact -15.2% -16.5% +1.5% +107.3% ➖ noise
3 duckdb:vortex-file-compressed -7.3% -16.5% +11.0% +107.3% ➖ noise
4 datafusion:vortex-compact -69.0% -11.0% -65.2% +131.2% ✅ faster
4 datafusion:vortex-file-compressed +10.1% -11.0% +23.6% +107.3% ➖ noise
4 duckdb:vortex-compact +8.0% -11.0% +21.3% +107.3% ➖ noise
4 duckdb:vortex-file-compressed -20.2% -11.0% -10.3% +107.3% ➖ noise
5 datafusion:vortex-compact -3.7% -11.1% +8.4% +107.3% ➖ noise
5 datafusion:vortex-file-compressed +40.3% -11.1% +57.8% +107.3% ➖ noise
5 duckdb:vortex-compact -0.5% -11.1% +11.9% +107.3% ➖ noise
5 duckdb:vortex-file-compressed -13.1% -11.1% -2.3% +107.3% ➖ noise
6 datafusion:vortex-compact +29.7% +29.3% +0.3% +107.3% ➖ noise
6 datafusion:vortex-file-compressed +41.6% +29.3% +9.6% +107.3% ➖ noise
6 duckdb:vortex-compact +25.5% +29.3% -3.0% +107.3% ➖ noise
6 duckdb:vortex-file-compressed -3.6% +29.3% -25.4% +107.3% ➖ noise
7 datafusion:vortex-compact -0.4% -16.6% +19.4% +107.3% ➖ noise
7 datafusion:vortex-file-compressed +230.3% -16.6% +295.9% +107.3% 🚨 regression
7 duckdb:vortex-compact -27.3% -16.6% -12.9% +107.3% ➖ noise
7 duckdb:vortex-file-compressed +12.9% -16.6% +35.3% +107.3% ➖ noise
8 datafusion:vortex-compact -17.0% -24.4% +9.8% +107.3% ➖ noise
8 datafusion:vortex-file-compressed -12.5% -24.4% +15.7% +107.3% ➖ noise
8 duckdb:vortex-compact +8.3% -24.4% +43.3% +107.3% ➖ noise
8 duckdb:vortex-file-compressed +9.1% -24.4% +44.3% +107.3% ➖ noise
9 datafusion:vortex-compact +13.9% -9.1% +25.3% +107.3% ➖ noise
9 datafusion:vortex-file-compressed +9.2% -9.1% +20.1% +107.3% ➖ noise
9 duckdb:vortex-compact -9.3% -9.1% -0.2% +107.3% ➖ noise
9 duckdb:vortex-file-compressed -3.7% -9.1% +5.9% +107.3% ➖ noise
10 datafusion:vortex-compact +17.5% -27.8% +62.7% +107.3% ➖ noise
10 datafusion:vortex-file-compressed -2.7% -27.8% +34.7% +107.3% ➖ noise
10 duckdb:vortex-compact +13.6% -27.8% +57.3% +107.3% ➖ noise
10 duckdb:vortex-file-compressed +9.6% -27.8% +51.8% +107.3% ➖ noise
11 datafusion:vortex-compact +4.0% -2.3% +6.4% +107.3% ➖ noise
11 datafusion:vortex-file-compressed +8.4% -2.3% +10.9% +107.3% ➖ noise
11 duckdb:vortex-compact -7.4% -2.3% -5.3% +107.3% ➖ noise
11 duckdb:vortex-file-compressed +7.6% -2.3% +10.1% +107.3% ➖ noise
12 datafusion:vortex-compact +14.3% +3.7% +10.2% +107.3% ➖ noise
12 datafusion:vortex-file-compressed -23.8% +3.7% -26.5% +107.3% ➖ noise
12 duckdb:vortex-compact +10.2% +3.7% +6.3% +107.3% ➖ noise
12 duckdb:vortex-file-compressed +28.3% +3.7% +23.7% +107.3% ➖ noise
13 datafusion:vortex-compact -4.9% +8.2% -12.1% +107.3% ➖ noise
13 datafusion:vortex-file-compressed +44.7% +8.2% +33.8% +107.3% ➖ noise
13 duckdb:vortex-compact +38.0% +8.2% +27.6% +107.3% ➖ noise
13 duckdb:vortex-file-compressed +6.3% +8.2% -1.8% +107.3% ➖ noise
14 datafusion:vortex-compact +23.0% +14.5% +7.4% +107.3% ➖ noise
14 datafusion:vortex-file-compressed +27.2% +14.5% +11.1% +111.9% ➖ noise
14 duckdb:vortex-compact +29.0% +14.5% +12.7% +107.3% ➖ noise
14 duckdb:vortex-file-compressed +38.1% +14.5% +20.7% +107.3% ➖ noise
15 datafusion:vortex-compact +36.1% +4.5% +30.2% +107.3% ➖ noise
15 datafusion:vortex-file-compressed +50.2% +4.5% +43.7% +107.3% ➖ noise
15 duckdb:vortex-compact -13.8% +4.5% -17.5% +107.3% ➖ noise
15 duckdb:vortex-file-compressed +59.3% +4.5% +52.4% +107.3% ➖ noise
16 datafusion:vortex-compact +64.7% -9.7% +82.4% +107.3% ➖ noise
16 datafusion:vortex-file-compressed -14.6% -9.7% -5.4% +107.3% ➖ noise
16 duckdb:vortex-compact +7.3% -9.7% +18.8% +107.3% ➖ noise
16 duckdb:vortex-file-compressed -10.9% -9.7% -1.4% +107.3% ➖ noise
17 datafusion:vortex-compact +22.0% +64.9% -26.0% +107.3% ➖ noise
17 datafusion:vortex-file-compressed +21.0% +64.9% -26.6% +107.3% ➖ noise
17 duckdb:vortex-compact -2.8% +64.9% -41.1% +107.3% ➖ noise
17 duckdb:vortex-file-compressed -29.7% +64.9% -57.4% +107.3% ✅ faster
18 datafusion:vortex-compact +22.4% +42.1% -13.9% +107.3% ➖ noise
18 datafusion:vortex-file-compressed +11.3% +42.1% -21.7% +107.3% ➖ noise
18 duckdb:vortex-compact -9.0% +42.1% -36.0% +107.3% ➖ noise
18 duckdb:vortex-file-compressed +5.8% +42.1% -25.5% +107.3% ➖ noise
19 datafusion:vortex-compact +22.6% +87.0% -34.4% +107.3% ➖ noise
19 datafusion:vortex-file-compressed +24.3% +87.0% -33.6% +107.3% ➖ noise
19 duckdb:vortex-compact -8.1% +87.0% -50.9% +107.3% ➖ noise
19 duckdb:vortex-file-compressed -13.7% +87.0% -53.9% +107.3% ✅ faster
20 datafusion:vortex-compact +15.2% +65.3% -30.3% +107.3% ➖ noise
20 datafusion:vortex-file-compressed +0.5% +65.3% -39.2% +107.3% ➖ noise
20 duckdb:vortex-compact -11.3% +65.3% -46.4% +107.3% ➖ noise
20 duckdb:vortex-file-compressed -5.8% +65.3% -43.0% +107.3% ➖ noise
21 datafusion:vortex-compact -8.5% +21.9% -24.9% +107.3% ➖ noise
21 datafusion:vortex-file-compressed +16.9% +21.9% -4.1% +107.3% ➖ noise
21 duckdb:vortex-compact +2.3% +21.9% -16.1% +107.3% ➖ noise
21 duckdb:vortex-file-compressed -31.5% +21.9% -43.8% +107.3% ➖ noise
22 datafusion:vortex-compact +2.4% -11.5% +15.6% +107.3% ➖ noise
22 datafusion:vortex-file-compressed -28.1% -11.5% -18.8% +107.3% ➖ noise
22 duckdb:vortex-compact +12.2% -11.5% +26.8% +107.3% ➖ noise
22 duckdb:vortex-file-compressed -11.8% -11.5% -0.4% +107.3% ➖ noise

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 1.086x ➖
Parquet (geomean): 1.065x ➖
Shifts: Parquet (control) +6.5% · Median polish +7.1%

datafusion / vortex-file-compressed (0.895x ➖, 1↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 57358044 99458290 0.58
fineweb_q01/datafusion:vortex-file-compressed 793599354 846449101 0.94
fineweb_q02/datafusion:vortex-file-compressed 🚨 824756557 615374172 1.34
fineweb_q03/datafusion:vortex-file-compressed 1416312424 1541253194 0.92
fineweb_q04/datafusion:vortex-file-compressed 1468083372 1435022873 1.02
fineweb_q05/datafusion:vortex-file-compressed 1403762736 1405494318 1.00
fineweb_q06/datafusion:vortex-file-compressed 1523170098 1950312582 0.78
fineweb_q07/datafusion:vortex-file-compressed 1451911641 1652499513 0.88
fineweb_q08/datafusion:vortex-file-compressed 565269380 717769044 0.79
datafusion / vortex-compact (1.358x ❌, 0↑ 3↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 75410162 33974024 2.22
fineweb_q01/datafusion:vortex-compact 🚨 1393380036 584180637 2.39
fineweb_q02/datafusion:vortex-compact 🚨 1482606475 741381776 2.00
fineweb_q03/datafusion:vortex-compact 2229386786 1831798325 1.22
fineweb_q04/datafusion:vortex-compact 2413688893 2242688245 1.08
fineweb_q05/datafusion:vortex-compact 1786420616 1701734682 1.05
fineweb_q06/datafusion:vortex-compact 1608405980 1417797934 1.13
fineweb_q07/datafusion:vortex-compact 1492959881 1364746703 1.09
fineweb_q08/datafusion:vortex-compact 464592405 534509765 0.87
datafusion / parquet (1.120x ➖, 0↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1487482998 1572669491 0.95
fineweb_q01/datafusion:parquet 2360633248 2025717955 1.17
fineweb_q02/datafusion:parquet 🚨 2894941704 1882829693 1.54
fineweb_q03/datafusion:parquet 2442071219 2166622881 1.13
fineweb_q04/datafusion:parquet 2271384303 2185737082 1.04
fineweb_q05/datafusion:parquet 2168533371 2223257119 0.98
fineweb_q06/datafusion:parquet 2090866950 1876573159 1.11
fineweb_q07/datafusion:parquet 2296006108 2491483964 0.92
fineweb_q08/datafusion:parquet 🚨 2936182445 2100137199 1.40
duckdb / vortex-file-compressed (1.125x ➖, 0↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 85042307 78727518 1.08
fineweb_q01/duckdb:vortex-file-compressed 🚨 871845703 614749121 1.42
fineweb_q02/duckdb:vortex-file-compressed 496800800 505854136 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚨 1938699836 1422297410 1.36
fineweb_q04/duckdb:vortex-file-compressed 2065160339 1741281758 1.19
fineweb_q05/duckdb:vortex-file-compressed 1653221920 1553450553 1.06
fineweb_q06/duckdb:vortex-file-compressed 2137887122 1794973557 1.19
fineweb_q07/duckdb:vortex-file-compressed 1560028081 1739675446 0.90
fineweb_q08/duckdb:vortex-file-compressed 692636612 661687183 1.05
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 86482298 75122706 1.15
fineweb_q01/duckdb:vortex-compact 626633096 542723172 1.15
fineweb_q02/duckdb:vortex-compact 607415465 780133043 0.78
fineweb_q03/duckdb:vortex-compact 1980566186 1617770513 1.22
fineweb_q04/duckdb:vortex-compact 1780709705 1609874908 1.11
fineweb_q05/duckdb:vortex-compact 1609632538 1451269621 1.11
fineweb_q06/duckdb:vortex-compact 1629735035 1469264995 1.11
fineweb_q07/duckdb:vortex-compact 1474116167 1588898516 0.93
fineweb_q08/duckdb:vortex-compact 557346975 766512300 0.73
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1124869220 1188869994 0.95
fineweb_q01/duckdb:parquet 1793133876 1809675458 0.99
fineweb_q02/duckdb:parquet 1578710512 1645977276 0.96
fineweb_q03/duckdb:parquet 4412468336 4235928540 1.04
fineweb_q04/duckdb:parquet 1926129307 2064358795 0.93
fineweb_q05/duckdb:parquet 3275609390 2972800306 1.10
fineweb_q06/duckdb:parquet 3766865510 3697849644 1.02
fineweb_q07/duckdb:parquet 4840493922 4030178391 1.20
fineweb_q08/duckdb:parquet 1074871158 1133801562 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +122.0% -5.4% +134.6% +124.1% 🚨 regression
0 datafusion:vortex-file-compressed -42.3% -5.4% -39.0% +110.5% ➖ noise
0 duckdb:vortex-compact +15.1% -5.4% +21.7% +35.8% ➖ noise
0 duckdb:vortex-file-compressed +8.0% -5.4% +14.2% +82.4% ➖ noise
1 datafusion:vortex-compact +138.5% +7.5% +122.0% +76.7% 🚨 regression
1 datafusion:vortex-file-compressed -6.2% +7.5% -12.7% +85.4% ➖ noise
1 duckdb:vortex-compact +15.5% +7.5% +7.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +41.8% +7.5% +32.0% +32.5% ➖ noise
2 datafusion:vortex-compact +100.0% +21.4% +64.7% +61.8% 🚨 regression
2 datafusion:vortex-file-compressed +34.0% +21.4% +10.4% +106.1% ➖ noise
2 duckdb:vortex-compact -22.1% +21.4% -35.9% +30.2% ✅ faster
2 duckdb:vortex-file-compressed -1.8% +21.4% -19.1% +33.6% ➖ noise
3 datafusion:vortex-compact +21.7% +8.4% +12.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -8.1% +8.4% -15.2% +30.0% ➖ noise
3 duckdb:vortex-compact +22.4% +8.4% +13.0% +34.6% ➖ noise
3 duckdb:vortex-file-compressed +36.3% +8.4% +25.8% +38.0% ➖ noise
4 datafusion:vortex-compact +7.6% -1.5% +9.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +2.3% -1.5% +3.9% +30.0% ➖ noise
4 duckdb:vortex-compact +10.6% -1.5% +12.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +18.6% -1.5% +20.4% +30.0% ➖ noise
5 datafusion:vortex-compact +5.0% +3.7% +1.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.1% +3.7% -3.7% +30.0% ➖ noise
5 duckdb:vortex-compact +10.9% +3.7% +7.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.4% +3.7% +2.7% +30.0% ➖ noise
6 datafusion:vortex-compact +13.4% +6.5% +6.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -21.9% +6.5% -26.7% +30.0% ✅ faster
6 duckdb:vortex-compact +10.9% +6.5% +4.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +19.1% +6.5% +11.8% +32.4% ➖ noise
7 datafusion:vortex-compact +9.4% +5.2% +4.0% +35.4% ➖ noise
7 datafusion:vortex-file-compressed -12.1% +5.2% -16.5% +30.0% ➖ noise
7 duckdb:vortex-compact -7.2% +5.2% -11.8% +33.9% ➖ noise
7 duckdb:vortex-file-compressed -10.3% +5.2% -14.8% +30.0% ➖ noise
8 datafusion:vortex-compact -13.1% +15.1% -24.5% +30.4% ✅ faster
8 datafusion:vortex-file-compressed -21.2% +15.1% -31.6% +62.1% ➖ noise
8 duckdb:vortex-compact -27.3% +15.1% -36.8% +61.7% ➖ noise
8 duckdb:vortex-file-compressed +4.7% +15.1% -9.1% +30.0% ➖ noise

@connortsui20

connortsui20 commented Apr 1, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

whoops, could you rename the ctx stats options method to merged_stats_options? I can also make this change separately

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -2.2%

duckdb / vortex-file-compressed (0.939x ➖, 1↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10708324 11363644 0.94
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19733440 27947417 0.71
statpopgen_q02/duckdb:vortex-file-compressed 1301606564 1347606028 0.97
statpopgen_q03/duckdb:vortex-file-compressed 3011354483 3170161229 0.95
statpopgen_q04/duckdb:vortex-file-compressed 3018223772 3123344989 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1397168368 1422316264 0.98
statpopgen_q06/duckdb:vortex-file-compressed 2050150003 2084387560 0.98
statpopgen_q07/duckdb:vortex-file-compressed 255064233 271927719 0.94
statpopgen_q08/duckdb:vortex-file-compressed 273511184 283957635 0.96
statpopgen_q09/duckdb:vortex-file-compressed 2793794031 2881818597 0.97
statpopgen_q10/duckdb:vortex-file-compressed 4676592599 4692385904 1.00
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11016642 11166146 0.99
statpopgen_q01/duckdb:vortex-compact 166401634 168143146 0.99
statpopgen_q02/duckdb:vortex-compact 1810843298 1847861647 0.98
statpopgen_q03/duckdb:vortex-compact 3522308478 3573766500 0.99
statpopgen_q04/duckdb:vortex-compact 3516968195 3546242146 0.99
statpopgen_q05/duckdb:vortex-compact 1843242226 1825489604 1.01
statpopgen_q06/duckdb:vortex-compact 2668761053 2634633594 1.01
statpopgen_q07/duckdb:vortex-compact 976996251 971390049 1.01
statpopgen_q08/duckdb:vortex-compact 1017611935 1012439268 1.01
statpopgen_q09/duckdb:vortex-compact 3359126275 3325490882 1.01
statpopgen_q10/duckdb:vortex-compact 5390259541 5403315687 1.00
duckdb / parquet (0.975x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 311216395 323554780 0.96
statpopgen_q01/duckdb:parquet 398974476 408520971 0.98
statpopgen_q02/duckdb:parquet 990260636 1029259858 0.96
statpopgen_q03/duckdb:parquet 1488235680 1512161043 0.98
statpopgen_q04/duckdb:parquet 1501033028 1525312071 0.98
statpopgen_q05/duckdb:parquet 999726361 1025616430 0.97
statpopgen_q06/duckdb:parquet 1477059142 1495542379 0.99
statpopgen_q07/duckdb:parquet 1846959065 1909992278 0.97
statpopgen_q08/duckdb:parquet 1867121725 1909586868 0.98
statpopgen_q09/duckdb:parquet 1354491969 1400294337 0.97
statpopgen_q10/duckdb:parquet 2653431139 2695846763 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.3% -3.8% +2.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -5.8% -3.8% -2.0% +19.5% ➖ noise
1 duckdb:vortex-compact -1.0% -2.3% +1.3% +45.8% ➖ noise
1 duckdb:vortex-file-compressed -29.4% -2.3% -27.7% +202.6% ➖ noise
2 duckdb:vortex-compact -2.0% -3.8% +1.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.4% -3.8% +0.4% +10.0% ➖ noise
3 duckdb:vortex-compact -1.4% -1.6% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.0% -1.6% -3.5% +10.0% ➖ noise
4 duckdb:vortex-compact -0.8% -1.6% +0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.4% -1.6% -1.8% +10.0% ➖ noise
5 duckdb:vortex-compact +1.0% -2.5% +3.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.8% -2.5% +0.8% +10.0% ➖ noise
6 duckdb:vortex-compact +1.3% -1.2% +2.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.6% -1.2% -0.4% +10.0% ➖ noise
7 duckdb:vortex-compact +0.6% -3.3% +4.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.2% -3.3% -3.0% +22.6% ➖ noise
8 duckdb:vortex-compact +0.5% -2.2% +2.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.7% -2.2% -1.5% +10.0% ➖ noise
9 duckdb:vortex-compact +1.0% -3.3% +4.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.1% -3.3% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact -0.2% -1.6% +1.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% -1.6% +1.3% +10.0% ➖ noise

@joseph-isaacs

joseph-isaacs commented Apr 1, 2026

Copy link
Copy Markdown
Contributor Author

Can you

@joseph-isaacs
joseph-isaacs marked this pull request as ready for review April 1, 2026 13:28
@joseph-isaacs
joseph-isaacs merged commit ba827a4 into develop Apr 1, 2026
76 of 81 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/fix-fuzz-7227 branch April 1, 2026 13:28
@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.872x ✅
Parquet (geomean): 0.933x ➖

unknown / unknown (0.926x ➖, 16↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2396086 2655675 0.90
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1279153 1305724 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11996869561 12000987523 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11464617062 11437516880 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8187538 8619503 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6411649 6747018 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk 1491866 1485148 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2411719 2394269 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11385330739 11416793653 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11332605775 11319712746 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12776757 13860545 0.92
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12983807 14373393 0.90
random-access/lance-tokio-local-disk 🚀 739576 846959 0.87
random-access/lance-tokio-local-disk-footer 🚀 1348298 1510734 0.89
random-access/nested-lists/correlated/lance-tokio-local-disk 270682 274358 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 717018 728911 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk 142825668 138427289 1.03
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 139838097 137894127 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 703083 707299 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 706731 903210 0.78
random-access/nested-lists/uniform/lance-tokio-local-disk 1202398 1192199 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1684146 1685451 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 137545869 140015088 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 137581669 140476001 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk 2371446 2401098 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2451670 2547919 0.96
random-access/nested-structs/correlated/lance-tokio-local-disk 438646 438027 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 646205 649074 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk 26835926 24665925 1.09
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 26640147 24599323 1.08
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 822403 915759 0.90
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 936088 909582 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk 2927386 2901582 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3192011 3134127 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 26968311 24611319 1.10
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 26599649 24865264 1.07
random-access/nested-structs/uniform/vortex-tokio-local-disk 1818721 1852769 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1829401 1885340 0.97
random-access/parquet-tokio-local-disk 🚀 183714994 250579605 0.73
random-access/parquet-tokio-local-disk-footer 🚀 181600928 245540270 0.74
random-access/taxi/correlated/lance-tokio-local-disk 962674 991950 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 1654783 1684475 0.98
random-access/taxi/correlated/parquet-tokio-local-disk 🚀 275974785 373070277 0.74
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚀 275033836 371282223 0.74
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1717990 2561830 0.67
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1745722 2343131 0.75
random-access/taxi/uniform/lance-tokio-local-disk 8848160 8857481 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 9580336 9506561 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 🚀 288561957 363422910 0.79
random-access/taxi/uniform/parquet-tokio-local-disk-footer 🚀 289195351 331277926 0.87
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4482439 5578140 0.80
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4540101 5576218 0.81
random-access/vortex-tokio-local-disk 🚀 1261933 1816046 0.69
random-access/vortex-tokio-local-disk-footer 🚀 1282615 1692666 0.76

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.988x ➖

unknown / unknown (0.985x ➖, 14↑ 6↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
compress time/Arade 1229566695 1265509883 0.97
compress time/Bimbo 8304917933 7838413688 1.06
compress time/CMSprovider 3120963993 3069538662 1.02
compress time/Euro2016 461887549 482800652 0.96
compress time/Food 417185585 440983525 0.95
compress time/HashTags 824548899 847833331 0.97
compress time/TPC-H l_comment canonical 1365617025 1373609736 0.99
compress time/TPC-H l_comment chunked 1380285068 1381215213 1.00
compress time/taxi 746415448 743364329 1.00
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11520593 13477526 0.85
compress time/wide table cols=100 chunks=50 rows=1000 🚀 11757174 13642744 0.86
compress time/wide table cols=1000 chunks=1 rows=1000 126514730 128199366 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 122470702 130521502 0.94
compress time/wide table cols=10000 chunks=1 rows=1000 🚀 1262257428 1411536423 0.89
compress time/wide table cols=10000 chunks=50 rows=1000 🚀 1257503273 1415361241 0.89
decompress time/Arade 31500051 30692591 1.03
decompress time/Bimbo 131793725 131246657 1.00
decompress time/CMSprovider 🚀 84180947 103784730 0.81
decompress time/Euro2016 🚀 21120996 24632744 0.86
decompress time/Food 9100085 8933650 1.02
decompress time/HashTags 91621132 92265525 0.99
decompress time/TPC-H l_comment canonical 45194623 44715753 1.01
decompress time/TPC-H l_comment chunked 44474557 43554094 1.02
decompress time/taxi 19906394 22021447 0.90
decompress time/wide table cols=100 chunks=1 rows=1000 2735453 2795116 0.98
decompress time/wide table cols=100 chunks=50 rows=1000 2733940 2758513 0.99
decompress time/wide table cols=1000 chunks=1 rows=1000 35855021 35212887 1.02
decompress time/wide table cols=1000 chunks=50 rows=1000 35709593 33937402 1.05
decompress time/wide table cols=10000 chunks=1 rows=1000 1491847952 1479188294 1.01
decompress time/wide table cols=10000 chunks=50 rows=1000 1491848991 1497107509 1.00
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3040198137 3108149348 0.98
parquet_rs-zstd compress time/Bimbo 17347551328 18617092481 0.93
parquet_rs-zstd compress time/CMSprovider 🚀 7907393470 8984476426 0.88
parquet_rs-zstd compress time/Euro2016 1365664964 1367308798 1.00
parquet_rs-zstd compress time/Food 944275344 1023337495 0.92
parquet_rs-zstd compress time/HashTags 🚀 2501570806 2921531324 0.86
parquet_rs-zstd compress time/TPC-H l_comment canonical 3113170200 3151800149 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3118710420 3378654186 0.92
parquet_rs-zstd compress time/taxi 1511834215 1678194623 0.90
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6858936 6845883 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6850178 6818276 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 90714609 93947074 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90477522 92679577 0.98
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 967873806 970228694 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 956011879 981628230 0.97
parquet_rs-zstd decompress time/Arade 649984979 676616689 0.96
parquet_rs-zstd decompress time/Bimbo 1888798071 1768082335 1.07
parquet_rs-zstd decompress time/CMSprovider 1943228028 1993162686 0.97
parquet_rs-zstd decompress time/Euro2016 391679751 386636797 1.01
parquet_rs-zstd decompress time/Food 224630890 225744469 1.00
parquet_rs-zstd decompress time/HashTags 🚀 633788715 787642850 0.80
parquet_rs-zstd decompress time/TPC-H l_comment canonical 571416060 596000683 0.96
parquet_rs-zstd decompress time/TPC-H l_comment chunked 576742478 564785074 1.02
parquet_rs-zstd decompress time/taxi 251633418 258275399 0.97
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2686452 2709194 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2748015 2716473 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32477420 36001028 0.90
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32639878 34050583 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 373944023 387977850 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 374134848 381967529 0.98
vortex-file-compressed size/Arade 143600332 143600332 1.00
vortex-file-compressed size/Bimbo 510400068 510400068 1.00
vortex-file-compressed size/CMSprovider 448304012 448304012 1.00
vortex-file-compressed size/Euro2016 164458756 164456780 1.00
vortex-file-compressed size/Food 44206912 44206912 1.00
vortex-file-compressed size/HashTags 195864476 195864476 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481896 179481896 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481896 179481896 1.00
vortex-file-compressed size/taxi 51040172 51040172 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 🚨 0 0 1.14
vortex:parquet-zstd ratio compress time/CMSprovider 🚨 0 0 1.16
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.96
vortex:parquet-zstd ratio compress time/Food 0 0 1.03
vortex:parquet-zstd ratio compress time/HashTags 🚨 0 0 1.14
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.08
vortex:parquet-zstd ratio compress time/taxi 🚨 0 0 1.11
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.85
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 2 0.86
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 🚀 1 1 0.90
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.91
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.07
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.94
vortex:parquet-zstd ratio decompress time/CMSprovider 🚀 0 0 0.83
vortex:parquet-zstd ratio decompress time/Euro2016 🚀 0 0 0.85
vortex:parquet-zstd ratio decompress time/Food 0 0 1.02
vortex:parquet-zstd ratio decompress time/HashTags 🚨 0 0 1.23
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.05
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 1 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 0 1.13
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 1 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 3 3 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 3 3 1.02
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 1.028x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.2%

datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1931299 1967246 0.98
clickbench_q01/datafusion:vortex-file-compressed 13761534 13675231 1.01
clickbench_q02/datafusion:vortex-file-compressed 33872054 32528241 1.04
clickbench_q03/datafusion:vortex-file-compressed 39301476 36406433 1.08
clickbench_q04/datafusion:vortex-file-compressed 312008315 306989842 1.02
clickbench_q05/datafusion:vortex-file-compressed 330675782 323644384 1.02
clickbench_q06/datafusion:vortex-file-compressed 1931989 1965205 0.98
clickbench_q07/datafusion:vortex-file-compressed 17369809 17588804 0.99
clickbench_q08/datafusion:vortex-file-compressed 385060934 381135622 1.01
clickbench_q09/datafusion:vortex-file-compressed 566024613 553277699 1.02
clickbench_q10/datafusion:vortex-file-compressed 76018469 75284994 1.01
clickbench_q11/datafusion:vortex-file-compressed 86942417 84996900 1.02
clickbench_q12/datafusion:vortex-file-compressed 280646696 276051934 1.02
clickbench_q13/datafusion:vortex-file-compressed 417547191 415499988 1.00
clickbench_q14/datafusion:vortex-file-compressed 259352706 250785985 1.03
clickbench_q15/datafusion:vortex-file-compressed 367078913 360941732 1.02
clickbench_q16/datafusion:vortex-file-compressed 689888641 697664312 0.99
clickbench_q17/datafusion:vortex-file-compressed 685986007 682515762 1.01
clickbench_q18/datafusion:vortex-file-compressed 1377756496 1356591500 1.02
clickbench_q19/datafusion:vortex-file-compressed 24715598 24401417 1.01
clickbench_q20/datafusion:vortex-file-compressed 357463151 352292238 1.01
clickbench_q21/datafusion:vortex-file-compressed 410993579 407023978 1.01
clickbench_q22/datafusion:vortex-file-compressed 502488000 503652747 1.00
clickbench_q23/datafusion:vortex-file-compressed 833684628 836573613 1.00
clickbench_q24/datafusion:vortex-file-compressed 48826551 45270833 1.08
clickbench_q25/datafusion:vortex-file-compressed 69253112 69793061 0.99
clickbench_q26/datafusion:vortex-file-compressed 43010371 45331359 0.95
clickbench_q27/datafusion:vortex-file-compressed 814715990 805845659 1.01
clickbench_q28/datafusion:vortex-file-compressed 6759562354 6844574863 0.99
clickbench_q29/datafusion:vortex-file-compressed 243108989 243101112 1.00
clickbench_q30/datafusion:vortex-file-compressed 233025617 231791276 1.01
clickbench_q31/datafusion:vortex-file-compressed 267968759 269045463 1.00
clickbench_q32/datafusion:vortex-file-compressed 1232267872 1315387259 0.94
clickbench_q33/datafusion:vortex-file-compressed 1386608790 1450267048 0.96
clickbench_q34/datafusion:vortex-file-compressed 1382487485 1436036688 0.96
clickbench_q35/datafusion:vortex-file-compressed 504217113 519679002 0.97
clickbench_q36/datafusion:vortex-file-compressed 81246904 86283040 0.94
clickbench_q37/datafusion:vortex-file-compressed 40199459 39442074 1.02
clickbench_q38/datafusion:vortex-file-compressed 23115834 23572350 0.98
clickbench_q39/datafusion:vortex-file-compressed 148213037 152698538 0.97
clickbench_q40/datafusion:vortex-file-compressed 19398441 19784976 0.98
clickbench_q41/datafusion:vortex-file-compressed 17252412 17653731 0.98
clickbench_q42/datafusion:vortex-file-compressed 19122729 18945507 1.01
datafusion / parquet (0.998x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1806533 1784702 1.01
clickbench_q01/datafusion:parquet 20518237 21058823 0.97
clickbench_q02/datafusion:parquet 56629598 56889460 1.00
clickbench_q03/datafusion:parquet 45028845 44264613 1.02
clickbench_q04/datafusion:parquet 336184327 345387076 0.97
clickbench_q05/datafusion:parquet 374269969 378892863 0.99
clickbench_q06/datafusion:parquet 1791633 1761747 1.02
clickbench_q07/datafusion:parquet 25814623 27133588 0.95
clickbench_q08/datafusion:parquet 407267050 415648362 0.98
clickbench_q09/datafusion:parquet 640697798 654700210 0.98
clickbench_q10/datafusion:parquet 108999508 109434401 1.00
clickbench_q11/datafusion:parquet 136584569 133234415 1.03
clickbench_q12/datafusion:parquet 366684127 363948501 1.01
clickbench_q13/datafusion:parquet 516507146 506537912 1.02
clickbench_q14/datafusion:parquet 357204776 359549310 0.99
clickbench_q15/datafusion:parquet 379042917 387677231 0.98
clickbench_q16/datafusion:parquet 734341461 711697256 1.03
clickbench_q17/datafusion:parquet 684285803 687069950 1.00
clickbench_q18/datafusion:parquet 1370134698 1417194749 0.97
clickbench_q19/datafusion:parquet 33633061 33148003 1.01
clickbench_q20/datafusion:parquet 596929668 607839858 0.98
clickbench_q21/datafusion:parquet 666645518 669650941 1.00
clickbench_q22/datafusion:parquet 970337011 971267590 1.00
clickbench_q23/datafusion:parquet 3689126112 3634873747 1.01
clickbench_q24/datafusion:parquet 87762344 92444651 0.95
clickbench_q25/datafusion:parquet 138441879 140167131 0.99
clickbench_q26/datafusion:parquet 85571081 84124962 1.02
clickbench_q27/datafusion:parquet 1050866295 1047209695 1.00
clickbench_q28/datafusion:parquet 6555421578 6702718806 0.98
clickbench_q29/datafusion:parquet 247671050 252647120 0.98
clickbench_q30/datafusion:parquet 359494512 363397917 0.99
clickbench_q31/datafusion:parquet 400763700 383519202 1.04
clickbench_q32/datafusion:parquet 1282077140 1307263624 0.98
clickbench_q33/datafusion:parquet 1492714423 1497487411 1.00
clickbench_q34/datafusion:parquet 1523618883 1512810030 1.01
clickbench_q35/datafusion:parquet 538197829 529521418 1.02
clickbench_q36/datafusion:parquet 147555210 146896538 1.00
clickbench_q37/datafusion:parquet 60529963 60280510 1.00
clickbench_q38/datafusion:parquet 93098316 88661358 1.05
clickbench_q39/datafusion:parquet 274109489 272685521 1.01
clickbench_q40/datafusion:parquet 36415597 33289786 1.09
clickbench_q41/datafusion:parquet 30080695 32866453 0.92
clickbench_q42/datafusion:parquet 31444955 31860354 0.99
duckdb / vortex-file-compressed (1.056x ➖, 0↑ 10↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6091157 5921011 1.03
clickbench_q01/duckdb:vortex-file-compressed 14292056 14404321 0.99
clickbench_q02/duckdb:vortex-file-compressed 25948328 25615809 1.01
clickbench_q03/duckdb:vortex-file-compressed 30292644 30533880 0.99
clickbench_q04/duckdb:vortex-file-compressed 173843442 171341060 1.01
clickbench_q05/duckdb:vortex-file-compressed 201020251 196093905 1.03
clickbench_q06/duckdb:vortex-file-compressed 17767656 17582466 1.01
clickbench_q07/duckdb:vortex-file-compressed 16341516 17844763 0.92
clickbench_q08/duckdb:vortex-file-compressed 275032412 263554197 1.04
clickbench_q09/duckdb:vortex-file-compressed 393460442 379713217 1.04
clickbench_q10/duckdb:vortex-file-compressed 75945546 74109745 1.02
clickbench_q11/duckdb:vortex-file-compressed 83247157 84832061 0.98
clickbench_q12/duckdb:vortex-file-compressed 221791064 210208253 1.06
clickbench_q13/duckdb:vortex-file-compressed 458184554 430931640 1.06
clickbench_q14/duckdb:vortex-file-compressed 250140593 238227423 1.05
clickbench_q15/duckdb:vortex-file-compressed 210930503 213680474 0.99
clickbench_q16/duckdb:vortex-file-compressed 🚨 731111262 612589260 1.19
clickbench_q17/duckdb:vortex-file-compressed 🚨 575024559 499711123 1.15
clickbench_q18/duckdb:vortex-file-compressed 1259790361 1191884976 1.06
clickbench_q19/duckdb:vortex-file-compressed 22097521 21437188 1.03
clickbench_q20/duckdb:vortex-file-compressed 407668238 389119293 1.05
clickbench_q21/duckdb:vortex-file-compressed 419337618 417353251 1.00
clickbench_q22/duckdb:vortex-file-compressed 🚨 647799621 547587385 1.18
clickbench_q23/duckdb:vortex-file-compressed 🚨 1134194139 983464756 1.15
clickbench_q24/duckdb:vortex-file-compressed 50248513 50884979 0.99
clickbench_q25/duckdb:vortex-file-compressed 80010369 80454071 0.99
clickbench_q26/duckdb:vortex-file-compressed 🚨 48357739 41792253 1.16
clickbench_q27/duckdb:vortex-file-compressed 503298222 507727620 0.99
clickbench_q28/duckdb:vortex-file-compressed 2999474042 2984198715 1.01
clickbench_q29/duckdb:vortex-file-compressed 28007096 28621022 0.98
clickbench_q30/duckdb:vortex-file-compressed 186116388 181355387 1.03
clickbench_q31/duckdb:vortex-file-compressed 264306904 263384938 1.00
clickbench_q32/duckdb:vortex-file-compressed 1376586786 1347479166 1.02
clickbench_q33/duckdb:vortex-file-compressed 1587570919 1560983959 1.02
clickbench_q34/duckdb:vortex-file-compressed 1678522457 1637980535 1.02
clickbench_q35/duckdb:vortex-file-compressed 370782519 371149778 1.00
clickbench_q36/duckdb:vortex-file-compressed 34469455 31464404 1.10
clickbench_q37/duckdb:vortex-file-compressed 🚨 27009042 20510289 1.32
clickbench_q38/duckdb:vortex-file-compressed 🚨 27802138 24219971 1.15
clickbench_q39/duckdb:vortex-file-compressed 46995079 42898872 1.10
clickbench_q40/duckdb:vortex-file-compressed 🚨 26742630 21501453 1.24
clickbench_q41/duckdb:vortex-file-compressed 🚨 25669673 21029158 1.22
clickbench_q42/duckdb:vortex-file-compressed 🚨 26755084 22647462 1.18
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 219268795 224650850 0.98
clickbench_q01/duckdb:parquet 49871944 50681840 0.98
clickbench_q02/duckdb:parquet 66345452 66704049 0.99
clickbench_q03/duckdb:parquet 65019547 65505513 0.99
clickbench_q04/duckdb:parquet 206352464 209736450 0.98
clickbench_q05/duckdb:parquet 280792126 286464521 0.98
clickbench_q06/duckdb:parquet 59751906 59987766 1.00
clickbench_q07/duckdb:parquet 50865672 51734853 0.98
clickbench_q08/duckdb:parquet 269911674 271720053 0.99
clickbench_q09/duckdb:parquet 399166678 398444667 1.00
clickbench_q10/duckdb:parquet 95345144 93903386 1.02
clickbench_q11/duckdb:parquet 107480781 115161079 0.93
clickbench_q12/duckdb:parquet 296401690 295324557 1.00
clickbench_q13/duckdb:parquet 517938804 523004896 0.99
clickbench_q14/duckdb:parquet 333597204 332948420 1.00
clickbench_q15/duckdb:parquet 240585486 241046630 1.00
clickbench_q16/duckdb:parquet 624412026 623687986 1.00
clickbench_q17/duckdb:parquet 518938013 515244617 1.01
clickbench_q18/duckdb:parquet 1065893158 1058335041 1.01
clickbench_q19/duckdb:parquet 49492851 49882797 0.99
clickbench_q20/duckdb:parquet 438172551 433639575 1.01
clickbench_q21/duckdb:parquet 559015280 557966622 1.00
clickbench_q22/duckdb:parquet 938182932 937363878 1.00
clickbench_q23/duckdb:parquet 317421899 317368135 1.00
clickbench_q24/duckdb:parquet 79278020 79618169 1.00
clickbench_q25/duckdb:parquet 142215947 140350723 1.01
clickbench_q26/duckdb:parquet 52702002 52810746 1.00
clickbench_q27/duckdb:parquet 640586682 642788867 1.00
clickbench_q28/duckdb:parquet 4849361282 4841122881 1.00
clickbench_q29/duckdb:parquet 61943967 61390622 1.01
clickbench_q30/duckdb:parquet 305418518 305543558 1.00
clickbench_q31/duckdb:parquet 351008994 348287812 1.01
clickbench_q32/duckdb:parquet 1232560833 1184217137 1.04
clickbench_q33/duckdb:parquet 1309771950 1229992175 1.06
clickbench_q34/duckdb:parquet 1310962570 1290132019 1.02
clickbench_q35/duckdb:parquet 352667671 358692957 0.98
clickbench_q36/duckdb:parquet 63762910 65460805 0.97
clickbench_q37/duckdb:parquet 54435480 52619769 1.03
clickbench_q38/duckdb:parquet 58344217 58310938 1.00
clickbench_q39/duckdb:parquet 101181644 98452797 1.03
clickbench_q40/duckdb:parquet 55498379 55650834 1.00
clickbench_q41/duckdb:parquet 59262084 58127486 1.02
clickbench_q42/duckdb:parquet 52151996 52511335 0.99
duckdb / duckdb (0.956x ➖, 8↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18099807 18913272 0.96
clickbench_q01/duckdb:duckdb 34049925 34145348 1.00
clickbench_q02/duckdb:duckdb 46852807 46325367 1.01
clickbench_q03/duckdb:duckdb 48056409 47942552 1.00
clickbench_q04/duckdb:duckdb 233949309 246533756 0.95
clickbench_q05/duckdb:duckdb 345346916 340563942 1.01
clickbench_q06/duckdb:duckdb 37296322 35928622 1.04
clickbench_q07/duckdb:duckdb 36951038 35917301 1.03
clickbench_q08/duckdb:duckdb 324257236 347276991 0.93
clickbench_q09/duckdb:duckdb 467981101 507202546 0.92
clickbench_q10/duckdb:duckdb 98759623 100500686 0.98
clickbench_q11/duckdb:duckdb 108348160 119105954 0.91
clickbench_q12/duckdb:duckdb 327576852 339159411 0.97
clickbench_q13/duckdb:duckdb 581576805 615593968 0.94
clickbench_q14/duckdb:duckdb 🚀 363767050 433910248 0.84
clickbench_q15/duckdb:duckdb 🚀 270772677 306207639 0.88
clickbench_q16/duckdb:duckdb 🚀 703309780 814756146 0.86
clickbench_q17/duckdb:duckdb 🚀 592085108 668401740 0.89
clickbench_q18/duckdb:duckdb 🚀 1310744090 1529582497 0.86
clickbench_q19/duckdb:duckdb 36465041 36851614 0.99
clickbench_q20/duckdb:duckdb 1000704015 1088675837 0.92
clickbench_q21/duckdb:duckdb 1155844300 1221423178 0.95
clickbench_q22/duckdb:duckdb 🚀 1116879364 1377305519 0.81
clickbench_q23/duckdb:duckdb 🚀 248707640 312394837 0.80
clickbench_q24/duckdb:duckdb 62350383 65537288 0.95
clickbench_q25/duckdb:duckdb 126546782 136714955 0.93
clickbench_q26/duckdb:duckdb 56946136 62073257 0.92
clickbench_q27/duckdb:duckdb 🚀 1007921220 1254767605 0.80
clickbench_q28/duckdb:duckdb 4667113839 5180300049 0.90
clickbench_q29/duckdb:duckdb 49624267 47730505 1.04
clickbench_q30/duckdb:duckdb 303918669 302209900 1.01
clickbench_q31/duckdb:duckdb 435143682 450983383 0.96
clickbench_q32/duckdb:duckdb 1525857315 1496418507 1.02
clickbench_q33/duckdb:duckdb 2113792103 2053910371 1.03
clickbench_q34/duckdb:duckdb 2096667150 2147655474 0.98
clickbench_q35/duckdb:duckdb 264699291 262355942 1.01
clickbench_q36/duckdb:duckdb 42797239 42323663 1.01
clickbench_q37/duckdb:duckdb 33171300 31382582 1.06
clickbench_q38/duckdb:duckdb 31691118 30834306 1.03
clickbench_q39/duckdb:duckdb 64900851 65298123 0.99
clickbench_q40/duckdb:duckdb 33175070 31369335 1.06
clickbench_q41/duckdb:duckdb 31175980 30112452 1.04
clickbench_q42/duckdb:duckdb 32986070 31529645 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -1.8% -0.6% -1.2% +540.8% ➖ noise
0 duckdb:duckdb -4.3% -0.6% -3.7% +261.7% ➖ noise
0 duckdb:vortex-file-compressed +2.9% -0.6% +3.5% +305.9% ➖ noise
1 datafusion:vortex-file-compressed +0.6% -2.1% +2.8% +44.0% ➖ noise
1 duckdb:duckdb -0.3% -2.1% +1.8% +60.8% ➖ noise
1 duckdb:vortex-file-compressed -0.8% -2.1% +1.3% +15.1% ➖ noise
2 datafusion:vortex-file-compressed +4.1% -0.5% +4.7% +32.7% ➖ noise
2 duckdb:duckdb +1.1% -0.5% +1.6% +21.7% ➖ noise
2 duckdb:vortex-file-compressed +1.3% -0.5% +1.8% +12.0% ➖ noise
3 datafusion:vortex-file-compressed +8.0% +0.5% +7.4% +154.7% ➖ noise
3 duckdb:duckdb +0.2% +0.5% -0.2% +52.8% ➖ noise
3 duckdb:vortex-file-compressed -0.8% +0.5% -1.3% +25.4% ➖ noise
4 datafusion:vortex-file-compressed +1.6% -2.1% +3.9% +10.0% ➖ noise
4 duckdb:duckdb -5.1% -2.1% -3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.5% -2.1% +3.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.2% -1.6% +3.8% +10.0% ➖ noise
5 duckdb:duckdb +1.4% -1.6% +3.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.5% -1.6% +4.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.7% +0.6% -2.3% +38.0% ➖ noise
6 duckdb:duckdb +3.8% +0.6% +3.1% +29.2% ➖ noise
6 duckdb:vortex-file-compressed +1.1% +0.6% +0.4% +20.0% ➖ noise
7 datafusion:vortex-file-compressed -1.2% -3.3% +2.1% +13.0% ➖ noise
7 duckdb:duckdb +2.9% -3.3% +6.4% +11.3% ➖ noise
7 duckdb:vortex-file-compressed -8.4% -3.3% -5.3% +19.5% ➖ noise
8 datafusion:vortex-file-compressed +1.0% -1.3% +2.4% +10.0% ➖ noise
8 duckdb:duckdb -6.6% -1.3% -5.4% +11.0% ➖ noise
8 duckdb:vortex-file-compressed +4.4% -1.3% +5.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.3% -1.0% +3.3% +10.0% ➖ noise
9 duckdb:duckdb -7.7% -1.0% -6.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.6% -1.0% +4.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.0% +0.6% +0.4% +10.0% ➖ noise
10 duckdb:duckdb -1.7% +0.6% -2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.5% +0.6% +1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.3% -2.2% +4.6% +10.0% ➖ noise
11 duckdb:duckdb -9.0% -2.2% -7.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.9% -2.2% +0.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.7% +0.6% +1.1% +10.0% ➖ noise
12 duckdb:duckdb -3.4% +0.6% -4.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +5.5% +0.6% +4.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.5% +0.5% +0.0% +10.0% ➖ noise
13 duckdb:duckdb -5.5% +0.5% -6.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +6.3% +0.5% +5.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.4% -0.2% +3.7% +10.0% ➖ noise
14 duckdb:duckdb -16.2% -0.2% -16.0% +10.0% ✅ faster
14 duckdb:vortex-file-compressed +5.0% -0.2% +5.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.7% -1.2% +3.0% +10.0% ➖ noise
15 duckdb:duckdb -11.6% -1.2% -10.5% +10.0% ✅ faster
15 duckdb:vortex-file-compressed -1.3% -1.2% -0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.1% +1.6% -2.7% +10.0% ➖ noise
16 duckdb:duckdb -13.7% +1.6% -15.1% +10.0% ✅ faster
16 duckdb:vortex-file-compressed +19.3% +1.6% +17.4% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +0.5% +0.2% +0.4% +10.0% ➖ noise
17 duckdb:duckdb -11.4% +0.2% -11.6% +10.0% ✅ faster
17 duckdb:vortex-file-compressed +15.1% +0.2% +14.9% +10.0% 🚨 regression
18 datafusion:vortex-file-compressed +1.6% -1.3% +2.9% +10.0% ➖ noise
18 duckdb:duckdb -14.3% -1.3% -13.2% +12.0% ✅ faster
18 duckdb:vortex-file-compressed +5.7% -1.3% +7.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.3% +0.3% +0.9% +15.4% ➖ noise
19 duckdb:duckdb -1.0% +0.3% -1.4% +22.1% ➖ noise
19 duckdb:vortex-file-compressed +3.1% +0.3% +2.7% +33.7% ➖ noise
20 datafusion:vortex-file-compressed +1.5% -0.4% +1.9% +181.5% ➖ noise
20 duckdb:duckdb -8.1% -0.4% -7.7% +24.8% ➖ noise
20 duckdb:vortex-file-compressed +4.8% -0.4% +5.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.0% -0.1% +1.1% +10.0% ➖ noise
21 duckdb:duckdb -5.4% -0.1% -5.2% +12.7% ➖ noise
21 duckdb:vortex-file-compressed +0.5% -0.1% +0.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.2% -0.0% -0.2% +10.0% ➖ noise
22 duckdb:duckdb -18.9% -0.0% -18.9% +18.0% ✅ faster
22 duckdb:vortex-file-compressed +18.3% -0.0% +18.3% +14.7% 🚨 regression
23 datafusion:vortex-file-compressed -0.3% +0.8% -1.1% +43.4% ➖ noise
23 duckdb:duckdb -20.4% +0.8% -21.0% +10.0% ✅ faster
23 duckdb:vortex-file-compressed +15.3% +0.8% +14.5% +67.4% ➖ noise
24 datafusion:vortex-file-compressed +7.9% -2.8% +10.9% +15.5% ➖ noise
24 duckdb:duckdb -4.9% -2.8% -2.1% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -1.3% -2.8% +1.6% +30.8% ➖ noise
25 datafusion:vortex-file-compressed -0.8% +0.0% -0.8% +10.0% ➖ noise
25 duckdb:duckdb -7.4% +0.0% -7.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.6% +0.0% -0.6% +12.5% ➖ noise
26 datafusion:vortex-file-compressed -5.1% +0.8% -5.8% +11.1% ➖ noise
26 duckdb:duckdb -8.3% +0.8% -8.9% +10.2% ➖ noise
26 duckdb:vortex-file-compressed +15.7% +0.8% +14.8% +20.6% ➖ noise
27 datafusion:vortex-file-compressed +1.1% +0.0% +1.1% +10.0% ➖ noise
27 duckdb:duckdb -19.7% +0.0% -19.7% +10.0% ✅ faster
27 duckdb:vortex-file-compressed -0.9% +0.0% -0.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.2% -1.0% -0.2% +10.0% ➖ noise
28 duckdb:duckdb -9.9% -1.0% -9.0% +10.6% ➖ noise
28 duckdb:vortex-file-compressed +0.5% -1.0% +1.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.0% -0.5% +0.6% +12.2% ➖ noise
29 duckdb:duckdb +4.0% -0.5% +4.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -2.1% -0.5% -1.6% +13.1% ➖ noise
30 datafusion:vortex-file-compressed +0.5% -0.6% +1.1% +10.0% ➖ noise
30 duckdb:duckdb +0.6% -0.6% +1.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +2.6% -0.6% +3.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.4% +2.6% -2.9% +10.0% ➖ noise
31 duckdb:duckdb -3.5% +2.6% -6.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.4% +2.6% -2.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -6.3% +1.0% -7.3% +14.9% ➖ noise
32 duckdb:duckdb +2.0% +1.0% +0.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +2.2% +1.0% +1.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.4% +3.0% -7.2% +10.0% ➖ noise
33 duckdb:duckdb +2.9% +3.0% -0.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +1.7% +3.0% -1.3% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -3.7% +1.2% -4.8% +10.0% ➖ noise
34 duckdb:duckdb -2.4% +1.2% -3.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +2.5% +1.2% +1.3% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.0% -0.0% -2.9% +10.0% ➖ noise
35 duckdb:duckdb +0.9% -0.0% +0.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.1% -0.0% -0.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -5.8% -1.1% -4.8% +11.0% ➖ noise
36 duckdb:duckdb +1.1% -1.1% +2.2% +10.2% ➖ noise
36 duckdb:vortex-file-compressed +9.6% -1.1% +10.8% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed +1.9% +1.9% -0.0% +10.0% ➖ noise
37 duckdb:duckdb +5.7% +1.9% +3.7% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +31.7% +1.9% +29.2% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed -1.9% +2.5% -4.3% +10.0% ➖ noise
38 duckdb:duckdb +2.8% +2.5% +0.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +14.8% +2.5% +12.0% +10.0% 🚨 regression
39 datafusion:vortex-file-compressed -2.9% +1.6% -4.5% +10.0% ➖ noise
39 duckdb:duckdb -0.6% +1.6% -2.2% +22.6% ➖ noise
39 duckdb:vortex-file-compressed +9.5% +1.6% +7.8% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -2.0% +4.4% -6.1% +10.6% ➖ noise
40 duckdb:duckdb +5.8% +4.4% +1.3% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +24.4% +4.4% +19.1% +10.0% 🚨 regression
41 datafusion:vortex-file-compressed -2.3% -3.4% +1.2% +10.0% ➖ noise
41 duckdb:duckdb +3.5% -3.4% +7.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +22.1% -3.4% +26.4% +13.1% 🚨 regression
42 datafusion:vortex-file-compressed +0.9% -1.0% +1.9% +10.0% ➖ noise
42 duckdb:duckdb +4.6% -1.0% +5.7% +10.5% ➖ noise
42 duckdb:vortex-file-compressed +18.1% -1.0% +19.3% +15.5% 🚨 regression

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.903x ➖
Parquet (geomean): 0.906x ➖
Shifts: Parquet (control) -9.4% · Median polish -5.5%

datafusion / vortex-file-compressed (0.954x ➖, 2↑ 2↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 728032992 684258041 1.06
tpch_q02/datafusion:vortex-file-compressed 723141857 645357654 1.12
tpch_q03/datafusion:vortex-file-compressed 781055334 807082382 0.97
tpch_q04/datafusion:vortex-file-compressed 635452080 586009972 1.08
tpch_q05/datafusion:vortex-file-compressed 982051155 966413006 1.02
tpch_q06/datafusion:vortex-file-compressed 638326953 630703721 1.01
tpch_q07/datafusion:vortex-file-compressed 1089721162 1066643912 1.02
tpch_q08/datafusion:vortex-file-compressed 1461478450 1846543813 0.79
tpch_q09/datafusion:vortex-file-compressed 1763309649 1854522867 0.95
tpch_q10/datafusion:vortex-file-compressed 🚀 1210072045 1899899134 0.64
tpch_q11/datafusion:vortex-file-compressed 876114642 1118120442 0.78
tpch_q12/datafusion:vortex-file-compressed 1122803012 1302933725 0.86
tpch_q13/datafusion:vortex-file-compressed 652154231 552768150 1.18
tpch_q14/datafusion:vortex-file-compressed 695778182 831339542 0.84
tpch_q15/datafusion:vortex-file-compressed 1339584655 1334775247 1.00
tpch_q16/datafusion:vortex-file-compressed 730909502 819541564 0.89
tpch_q17/datafusion:vortex-file-compressed 🚨 1897070608 1446093737 1.31
tpch_q18/datafusion:vortex-file-compressed 1602639273 1447298259 1.11
tpch_q19/datafusion:vortex-file-compressed 1122985594 1155184137 0.97
tpch_q20/datafusion:vortex-file-compressed 🚨 1854466211 1262523521 1.47
tpch_q21/datafusion:vortex-file-compressed 1670079103 2045455960 0.82
tpch_q22/datafusion:vortex-file-compressed 🚀 363733936 652107053 0.56
datafusion / vortex-compact (0.799x ➖, 5↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 770697358 678157586 1.14
tpch_q02/datafusion:vortex-compact 763706884 673847697 1.13
tpch_q03/datafusion:vortex-compact 936767389 1195837947 0.78
tpch_q04/datafusion:vortex-compact 548062771 674007656 0.81
tpch_q05/datafusion:vortex-compact 848770062 1067823045 0.79
tpch_q06/datafusion:vortex-compact 635787467 654155357 0.97
tpch_q07/datafusion:vortex-compact 1051801821 1298960208 0.81
tpch_q08/datafusion:vortex-compact 🚀 1114716207 1700251536 0.66
tpch_q09/datafusion:vortex-compact 1216394530 1535233631 0.79
tpch_q10/datafusion:vortex-compact 1074134387 1209457241 0.89
tpch_q11/datafusion:vortex-compact 🚀 425600233 908213736 0.47
tpch_q12/datafusion:vortex-compact 928302631 1053636441 0.88
tpch_q13/datafusion:vortex-compact 403235222 444091408 0.91
tpch_q14/datafusion:vortex-compact 🚀 590098709 960816897 0.61
tpch_q15/datafusion:vortex-compact 1070188639 1274161456 0.84
tpch_q16/datafusion:vortex-compact 🚀 320351727 516715884 0.62
tpch_q17/datafusion:vortex-compact 1107181326 1435331261 0.77
tpch_q18/datafusion:vortex-compact 1068340253 1307101191 0.82
tpch_q19/datafusion:vortex-compact 820180624 970065801 0.85
tpch_q20/datafusion:vortex-compact 858471487 1045466969 0.82
tpch_q21/datafusion:vortex-compact 1432371175 1556950667 0.92
tpch_q22/datafusion:vortex-compact 🚀 537031010 856391288 0.63
datafusion / parquet (0.811x ➖, 5↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 994552776 1090358021 0.91
tpch_q02/datafusion:parquet 🚀 1089194989 1790213425 0.61
tpch_q03/datafusion:parquet 1053210124 1473282540 0.71
tpch_q04/datafusion:parquet 526394052 629481576 0.84
tpch_q05/datafusion:parquet 1278341729 1558077342 0.82
tpch_q06/datafusion:parquet 547258040 550322049 0.99
tpch_q07/datafusion:parquet 1272774674 1738829485 0.73
tpch_q08/datafusion:parquet 1704612828 1675416577 1.02
tpch_q09/datafusion:parquet 1764377995 1873579780 0.94
tpch_q10/datafusion:parquet 2689552020 2358492149 1.14
tpch_q11/datafusion:parquet 800701602 764311860 1.05
tpch_q12/datafusion:parquet 878543824 822315303 1.07
tpch_q13/datafusion:parquet 816026939 930045044 0.88
tpch_q14/datafusion:parquet 863830445 923600655 0.94
tpch_q15/datafusion:parquet 1334040239 1379463648 0.97
tpch_q16/datafusion:parquet 🚀 376707695 971647033 0.39
tpch_q17/datafusion:parquet 1873621222 1979962565 0.95
tpch_q18/datafusion:parquet 2169970566 2744958422 0.79
tpch_q19/datafusion:parquet 🚀 1128044469 2199953174 0.51
tpch_q20/datafusion:parquet 🚀 1340500711 2174269168 0.62
tpch_q21/datafusion:parquet 🚀 1863666572 2723675654 0.68
tpch_q22/datafusion:parquet 933183523 1136549271 0.82
duckdb / vortex-file-compressed (0.964x ➖, 0↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 673601500 635124069 1.06
tpch_q02/duckdb:vortex-file-compressed 1274809987 1544157886 0.83
tpch_q03/duckdb:vortex-file-compressed 950102807 1070358282 0.89
tpch_q04/duckdb:vortex-file-compressed 638029983 642546751 0.99
tpch_q05/duckdb:vortex-file-compressed 1214904445 1262967186 0.96
tpch_q06/duckdb:vortex-file-compressed 839289738 838589113 1.00
tpch_q07/duckdb:vortex-file-compressed 1213785500 1262772825 0.96
tpch_q08/duckdb:vortex-file-compressed 1474683981 1481764694 1.00
tpch_q09/duckdb:vortex-file-compressed 1453924507 1478216958 0.98
tpch_q10/duckdb:vortex-file-compressed 1187760023 1232648440 0.96
tpch_q11/duckdb:vortex-file-compressed 702943630 649602854 1.08
tpch_q12/duckdb:vortex-file-compressed 784597201 814380539 0.96
tpch_q13/duckdb:vortex-file-compressed 911617816 1144056204 0.80
tpch_q14/duckdb:vortex-file-compressed 824751657 940408659 0.88
tpch_q15/duckdb:vortex-file-compressed 562037383 565859149 0.99
tpch_q16/duckdb:vortex-file-compressed 452230503 531910142 0.85
tpch_q17/duckdb:vortex-file-compressed 1060315768 1030072424 1.03
tpch_q18/duckdb:vortex-file-compressed 950077707 987620656 0.96
tpch_q19/duckdb:vortex-file-compressed 819432084 848353031 0.97
tpch_q20/duckdb:vortex-file-compressed 1326558388 1374844125 0.96
tpch_q21/duckdb:vortex-file-compressed 2053920152 2114781073 0.97
tpch_q22/duckdb:vortex-file-compressed 780624926 649378939 1.20
duckdb / vortex-compact (0.905x ➖, 3↑ 0↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 590530517 669712690 0.88
tpch_q02/duckdb:vortex-compact 1273423077 1086201049 1.17
tpch_q03/duckdb:vortex-compact 1067825236 845836436 1.26
tpch_q04/duckdb:vortex-compact 515756099 728106773 0.71
tpch_q05/duckdb:vortex-compact 1034143874 1430277340 0.72
tpch_q06/duckdb:vortex-compact 750411734 872163851 0.86
tpch_q07/duckdb:vortex-compact 1082870062 1044230350 1.04
tpch_q08/duckdb:vortex-compact 1423037562 1500800960 0.95
tpch_q09/duckdb:vortex-compact 1486395525 1635436804 0.91
tpch_q10/duckdb:vortex-compact 🚀 1084636684 1879806135 0.58
tpch_q11/duckdb:vortex-compact 661287753 689486176 0.96
tpch_q12/duckdb:vortex-compact 726035816 682288032 1.06
tpch_q13/duckdb:vortex-compact 🚀 1032156804 1599937748 0.65
tpch_q14/duckdb:vortex-compact 1078594952 870315504 1.24
tpch_q15/duckdb:vortex-compact 538995214 531816871 1.01
tpch_q16/duckdb:vortex-compact 386747320 427157859 0.91
tpch_q17/duckdb:vortex-compact 902168764 927501843 0.97
tpch_q18/duckdb:vortex-compact 914563742 905443482 1.01
tpch_q19/duckdb:vortex-compact 758184839 823232502 0.92
tpch_q20/duckdb:vortex-compact 1230019943 1378253873 0.89
tpch_q21/duckdb:vortex-compact 1782668900 1967188126 0.91
tpch_q22/duckdb:vortex-compact 🚀 600603170 875260800 0.69
duckdb / parquet (1.012x ➖, 0↑ 1↓)
name PR 7ceb2f0 (ns) base db00b43 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1093785983 1025707821 1.07
tpch_q02/duckdb:parquet 1530545404 1659329895 0.92
tpch_q03/duckdb:parquet 1782897798 1756279604 1.02
tpch_q04/duckdb:parquet 1226234299 1006645616 1.22
tpch_q05/duckdb:parquet 2200072292 2319966925 0.95
tpch_q06/duckdb:parquet 772097167 839607006 0.92
tpch_q07/duckdb:parquet 2274554291 2602962200 0.87
tpch_q08/duckdb:parquet 2342184275 2727541604 0.86
tpch_q09/duckdb:parquet 2952208803 2900527043 1.02
tpch_q10/duckdb:parquet 3248591616 3524678232 0.92
tpch_q11/duckdb:parquet 926133168 993694682 0.93
tpch_q12/duckdb:parquet 1097766904 1360082166 0.81
tpch_q13/duckdb:parquet 1557842220 1444487723 1.08
tpch_q14/duckdb:parquet 1680487059 1455046003 1.15
tpch_q15/duckdb:parquet 🚨 1140478827 877143282 1.30
tpch_q16/duckdb:parquet 772882951 795300800 0.97
tpch_q17/duckdb:parquet 1505871870 1249956206 1.20
tpch_q18/duckdb:parquet 1612247511 1286965497 1.25
tpch_q19/duckdb:parquet 1699231321 1839073370 0.92
tpch_q20/duckdb:parquet 1934980375 2090469591 0.93
tpch_q21/duckdb:parquet 2138496251 2083989659 1.03
tpch_q22/duckdb:parquet 1127477259 1009126329 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +13.6% -1.4% +15.2% +87.0% ➖ noise
1 datafusion:vortex-file-compressed +6.4% -1.4% +7.9% +95.0% ➖ noise
1 duckdb:vortex-compact -11.8% -1.4% -10.6% +47.8% ➖ noise
1 duckdb:vortex-file-compressed +6.1% -1.4% +7.5% +64.7% ➖ noise
2 datafusion:vortex-compact +13.3% -25.1% +51.3% +68.3% ➖ noise
2 datafusion:vortex-file-compressed +12.1% -25.1% +49.6% +70.4% ➖ noise
2 duckdb:vortex-compact +17.2% -25.1% +56.5% +58.6% ➖ noise
2 duckdb:vortex-file-compressed -17.4% -25.1% +10.2% +50.5% ➖ noise
3 datafusion:vortex-compact -21.7% -14.8% -8.0% +71.3% ➖ noise
3 datafusion:vortex-file-compressed -3.2% -14.8% +13.6% +99.8% ➖ noise
3 duckdb:vortex-compact +26.2% -14.8% +48.2% +75.9% ➖ noise
3 duckdb:vortex-file-compressed -11.2% -14.8% +4.2% +71.2% ➖ noise
4 datafusion:vortex-compact -18.7% +0.9% -19.4% +60.5% ➖ noise
4 datafusion:vortex-file-compressed +8.4% +0.9% +7.4% +47.8% ➖ noise
4 duckdb:vortex-compact -29.2% +0.9% -29.8% +47.8% ➖ noise
4 duckdb:vortex-file-compressed -0.7% +0.9% -1.6% +47.8% ➖ noise
5 datafusion:vortex-compact -20.5% -11.8% -9.9% +47.8% ➖ noise
5 datafusion:vortex-file-compressed +1.6% -11.8% +15.2% +47.8% ➖ noise
5 duckdb:vortex-compact -27.7% -11.8% -18.0% +47.8% ➖ noise
5 duckdb:vortex-file-compressed -3.8% -11.8% +9.1% +47.8% ➖ noise
6 datafusion:vortex-compact -2.8% -4.4% +1.6% +47.8% ➖ noise
6 datafusion:vortex-file-compressed +1.2% -4.4% +5.8% +47.8% ➖ noise
6 duckdb:vortex-compact -14.0% -4.4% -10.0% +47.8% ➖ noise
6 duckdb:vortex-file-compressed +0.1% -4.4% +4.7% +47.8% ➖ noise
7 datafusion:vortex-compact -19.0% -20.0% +1.2% +47.8% ➖ noise
7 datafusion:vortex-file-compressed +2.2% -20.0% +27.7% +47.8% ➖ noise
7 duckdb:vortex-compact +3.7% -20.0% +29.7% +51.1% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -20.0% +20.2% +47.8% ➖ noise
8 datafusion:vortex-compact -34.4% -6.5% -29.9% +47.8% ➖ noise
8 datafusion:vortex-file-compressed -20.9% -6.5% -15.3% +56.8% ➖ noise
8 duckdb:vortex-compact -5.2% -6.5% +1.4% +47.8% ➖ noise
8 duckdb:vortex-file-compressed -0.5% -6.5% +6.5% +47.8% ➖ noise
9 datafusion:vortex-compact -20.8% -2.1% -19.1% +47.8% ➖ noise
9 datafusion:vortex-file-compressed -4.9% -2.1% -2.9% +51.2% ➖ noise
9 duckdb:vortex-compact -9.1% -2.1% -7.2% +47.8% ➖ noise
9 duckdb:vortex-file-compressed -1.6% -2.1% +0.5% +47.8% ➖ noise
10 datafusion:vortex-compact -11.2% +2.5% -13.4% +47.8% ➖ noise
10 datafusion:vortex-file-compressed -36.3% +2.5% -37.9% +47.8% ✅ faster
10 duckdb:vortex-compact -42.3% +2.5% -43.7% +55.4% ✅ faster
10 duckdb:vortex-file-compressed -3.6% +2.5% -6.0% +47.8% ➖ noise
11 datafusion:vortex-compact -53.1% -1.2% -52.6% +69.6% ✅ faster
11 datafusion:vortex-file-compressed -21.6% -1.2% -20.7% +67.3% ➖ noise
11 duckdb:vortex-compact -4.1% -1.2% -2.9% +47.8% ➖ noise
11 duckdb:vortex-file-compressed +8.2% -1.2% +9.5% +47.8% ➖ noise
12 datafusion:vortex-compact -11.9% -7.1% -5.1% +47.8% ➖ noise
12 datafusion:vortex-file-compressed -13.8% -7.1% -7.2% +47.8% ➖ noise
12 duckdb:vortex-compact +6.4% -7.1% +14.6% +47.8% ➖ noise
12 duckdb:vortex-file-compressed -3.7% -7.1% +3.7% +55.1% ➖ noise
13 datafusion:vortex-compact -9.2% -2.7% -6.7% +56.0% ➖ noise
13 datafusion:vortex-file-compressed +18.0% -2.7% +21.3% +61.9% ➖ noise
13 duckdb:vortex-compact -35.5% -2.7% -33.7% +83.2% ➖ noise
13 duckdb:vortex-file-compressed -20.3% -2.7% -18.1% +90.4% ➖ noise
14 datafusion:vortex-compact -38.6% +3.9% -40.9% +47.8% ✅ faster
14 datafusion:vortex-file-compressed -16.3% +3.9% -19.5% +47.8% ➖ noise
14 duckdb:vortex-compact +23.9% +3.9% +19.2% +47.8% ➖ noise
14 duckdb:vortex-file-compressed -12.3% +3.9% -15.6% +47.8% ➖ noise
15 datafusion:vortex-compact -16.0% +12.1% -25.1% +47.8% ➖ noise
15 datafusion:vortex-file-compressed +0.4% +12.1% -10.5% +47.8% ➖ noise
15 duckdb:vortex-compact +1.3% +12.1% -9.6% +47.8% ➖ noise
15 duckdb:vortex-file-compressed -0.7% +12.1% -11.4% +47.8% ➖ noise
16 datafusion:vortex-compact -38.0% -38.6% +1.0% +86.8% ➖ noise
16 datafusion:vortex-file-compressed -10.8% -38.6% +45.3% +55.5% ➖ noise
16 duckdb:vortex-compact -9.5% -38.6% +47.5% +47.8% ➖ noise
16 duckdb:vortex-file-compressed -15.0% -38.6% +38.5% +77.0% ➖ noise
17 datafusion:vortex-compact -22.9% +6.8% -27.8% +47.8% ➖ noise
17 datafusion:vortex-file-compressed +31.2% +6.8% +22.9% +47.8% ➖ noise
17 duckdb:vortex-compact -2.7% +6.8% -8.9% +47.8% ➖ noise
17 duckdb:vortex-file-compressed +2.9% +6.8% -3.6% +47.8% ➖ noise
18 datafusion:vortex-compact -18.3% -0.5% -17.9% +47.8% ➖ noise
18 datafusion:vortex-file-compressed +10.7% -0.5% +11.3% +47.8% ➖ noise
18 duckdb:vortex-compact +1.0% -0.5% +1.5% +47.8% ➖ noise
18 duckdb:vortex-file-compressed -3.8% -0.5% -3.3% +47.8% ➖ noise
19 datafusion:vortex-compact -15.5% -31.2% +22.8% +55.6% ➖ noise
19 datafusion:vortex-file-compressed -2.8% -31.2% +41.2% +47.8% ➖ noise
19 duckdb:vortex-compact -7.9% -31.2% +33.8% +47.8% ➖ noise
19 duckdb:vortex-file-compressed -3.4% -31.2% +40.3% +47.8% ➖ noise
20 datafusion:vortex-compact -17.9% -24.5% +8.7% +47.8% ➖ noise
20 datafusion:vortex-file-compressed +46.9% -24.5% +94.4% +47.8% 🚨 regression
20 duckdb:vortex-compact -10.8% -24.5% +18.1% +47.8% ➖ noise
20 duckdb:vortex-file-compressed -3.5% -24.5% +27.7% +47.8% ➖ noise
21 datafusion:vortex-compact -8.0% -16.2% +9.8% +47.8% ➖ noise
21 datafusion:vortex-file-compressed -18.4% -16.2% -2.6% +47.8% ➖ noise
21 duckdb:vortex-compact -9.4% -16.2% +8.1% +47.8% ➖ noise
21 duckdb:vortex-file-compressed -2.9% -16.2% +15.9% +47.8% ➖ noise
22 datafusion:vortex-compact -37.3% -4.2% -34.5% +58.7% ➖ noise
22 datafusion:vortex-file-compressed -44.2% -4.2% -41.8% +55.0% ✅ faster
22 duckdb:vortex-compact -31.4% -4.2% -28.4% +50.2% ➖ noise
22 duckdb:vortex-file-compressed +20.2% -4.2% +25.5% +47.8% ➖ noise

lwwmanning pushed a commit that referenced this pull request Apr 1, 2026
@joseph-isaacs @lwwmanning
fix: fix typo in compressor scheme (#7241)
a1d5b71 
fix typo in compressor scheme

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Will Manning <will@willmanning.io>
This was referenced Apr 1, 2026
Merged
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes
@connortsui20 connortsui20 Awaiting requested review from connortsui20

Assignees

No one assigned

Labels

changelog/fix A bug fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@joseph-isaacs @connortsui20 @robert3005