Skip to content

substr expression#7898

Open
myrrc wants to merge 1 commit into
developfrom
myrrc/substr
Open

substr expression#7898
myrrc wants to merge 1 commit into
developfrom
myrrc/substr

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented May 12, 2026

No description provided.

@myrrc myrrc added the changelog/feature A new feature label May 12, 2026
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 12, 2026
@github-actions github-actions Bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 12, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a284482 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 6acde39 1 Explore Profiling Data
🟢 Done ae1703d 1 Explore Profiling Data
🟢 Done 488d0ff 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.009x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 115920012 109306197 1.06
polarsignals_q01/datafusion:vortex-file-compressed 260172154 268509295 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22469602 23109238 0.97
polarsignals_q03/datafusion:vortex-file-compressed 270082517 278471743 0.97
polarsignals_q04/datafusion:vortex-file-compressed 10853669 10354000 1.05
polarsignals_q05/datafusion:vortex-file-compressed 14624300 14134508 1.03
polarsignals_q06/datafusion:vortex-file-compressed 18656648 18119846 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13808699 13356681 1.03
polarsignals_q08/datafusion:vortex-file-compressed 398474349 389602990 1.02
polarsignals_q09/datafusion:vortex-file-compressed 10279798 10733086 0.96

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.7%
Engines: DataFusion No clear signal (-2.6%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.986x ➖, 1↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5473244 5308871 1.03
fineweb_q01/datafusion:vortex-file-compressed 30709288 30625389 1.00
fineweb_q02/datafusion:vortex-file-compressed 36434146 37791917 0.96
fineweb_q03/datafusion:vortex-file-compressed 🚀 63079391 71532425 0.88
fineweb_q04/datafusion:vortex-file-compressed 274667568 281372716 0.98
fineweb_q05/datafusion:vortex-file-compressed 216335011 219653619 0.98
fineweb_q06/datafusion:vortex-file-compressed 48978161 47437350 1.03
fineweb_q07/datafusion:vortex-file-compressed 53000161 51634166 1.03
fineweb_q08/datafusion:vortex-file-compressed 19525667 19823759 0.98
datafusion / vortex-compact (1.002x ➖, 1↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6185838 5578313 1.11
fineweb_q01/datafusion:vortex-compact 95062414 94626108 1.00
fineweb_q02/datafusion:vortex-compact 🚀 105357011 120587828 0.87
fineweb_q03/datafusion:vortex-compact 871243773 863457931 1.01
fineweb_q04/datafusion:vortex-compact 919247332 912620180 1.01
fineweb_q05/datafusion:vortex-compact 817129259 815027075 1.00
fineweb_q06/datafusion:vortex-compact 454641139 459457616 0.99
fineweb_q07/datafusion:vortex-compact 480206133 485871286 0.99
fineweb_q08/datafusion:vortex-compact 19317817 18360059 1.05
datafusion / parquet (1.020x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7522220 6161980 1.22
fineweb_q01/datafusion:parquet 299853612 301464867 0.99
fineweb_q02/datafusion:parquet 311613675 298287669 1.04
fineweb_q03/datafusion:parquet 284221440 279012247 1.02
fineweb_q04/datafusion:parquet 298089343 300629883 0.99
fineweb_q05/datafusion:parquet 297654316 299223433 0.99
fineweb_q06/datafusion:parquet 287155759 301702080 0.95
fineweb_q07/datafusion:parquet 277205444 283501202 0.98
fineweb_q08/datafusion:parquet 277640866 274849846 1.01
duckdb / vortex-file-compressed (0.974x ➖, 1↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3370227 3352706 1.01
fineweb_q01/duckdb:vortex-file-compressed 32893485 32553209 1.01
fineweb_q02/duckdb:vortex-file-compressed 39531691 38955496 1.01
fineweb_q03/duckdb:vortex-file-compressed 🚀 128941371 163686841 0.79
fineweb_q04/duckdb:vortex-file-compressed 274179585 268173134 1.02
fineweb_q05/duckdb:vortex-file-compressed 210887341 213726998 0.99
fineweb_q06/duckdb:vortex-file-compressed 49812083 50920052 0.98
fineweb_q07/duckdb:vortex-file-compressed 53686080 55333482 0.97
fineweb_q08/duckdb:vortex-file-compressed 21903541 21510076 1.02
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4233219 4223169 1.00
fineweb_q01/duckdb:vortex-compact 109088463 100504676 1.09
fineweb_q02/duckdb:vortex-compact 110643071 115654998 0.96
fineweb_q03/duckdb:vortex-compact 853531617 853918201 1.00
fineweb_q04/duckdb:vortex-compact 893929975 899376900 0.99
fineweb_q05/duckdb:vortex-compact 809288836 801196735 1.01
fineweb_q06/duckdb:vortex-compact 461530883 466824631 0.99
fineweb_q07/duckdb:vortex-compact 478125562 483613531 0.99
fineweb_q08/duckdb:vortex-compact 18736529 19458682 0.96
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30421969 32131628 0.95
fineweb_q01/duckdb:parquet 86365586 84673143 1.02
fineweb_q02/duckdb:parquet 84449852 85042258 0.99
fineweb_q03/duckdb:parquet 314926637 319773840 0.98
fineweb_q04/duckdb:parquet 444160754 445519380 1.00
fineweb_q05/duckdb:parquet 415362225 414400838 1.00
fineweb_q06/duckdb:parquet 203503946 204927428 0.99
fineweb_q07/duckdb:parquet 216858596 215429241 1.01
fineweb_q08/duckdb:parquet 32438337 32256846 1.01
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 867.58 KB -0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +10.9% +7.5% +3.1% +49.5% ➖ noise
0 datafusion:vortex-file-compressed +3.1% +7.5% -4.1% +51.2% ➖ noise
0 duckdb:vortex-compact +0.2% +7.5% -6.8% +53.6% ➖ noise
0 duckdb:vortex-file-compressed +0.5% +7.5% -6.5% +77.7% ➖ noise
1 datafusion:vortex-compact +0.5% +0.7% -0.3% +14.7% ➖ noise
1 datafusion:vortex-file-compressed +0.3% +0.7% -0.4% +30.6% ➖ noise
1 duckdb:vortex-compact +8.5% +0.7% +7.8% +21.0% ➖ noise
1 duckdb:vortex-file-compressed +1.0% +0.7% +0.3% +44.7% ➖ noise
2 datafusion:vortex-compact -12.6% +1.9% -14.2% +13.4% ✅ faster
2 datafusion:vortex-file-compressed -3.6% +1.9% -5.3% +13.8% ➖ noise
2 duckdb:vortex-compact -4.3% +1.9% -6.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.5% +1.9% -0.4% +10.0% ➖ noise
3 datafusion:vortex-compact +0.9% +0.2% +0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -11.8% +0.2% -12.0% +27.9% ➖ noise
3 duckdb:vortex-compact -0.0% +0.2% -0.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -21.2% +0.2% -21.4% +40.8% ➖ noise
4 datafusion:vortex-compact +0.7% -0.6% +1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.4% -0.6% -1.8% +10.0% ➖ noise
4 duckdb:vortex-compact -0.6% -0.6% -0.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.2% -0.6% +2.8% +10.0% ➖ noise
5 datafusion:vortex-compact +0.3% -0.1% +0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.5% -0.1% -1.4% +10.0% ➖ noise
5 duckdb:vortex-compact +1.0% -0.1% +1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.3% -0.1% -1.2% +10.0% ➖ noise
6 datafusion:vortex-compact -1.0% -2.8% +1.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.2% -2.8% +6.2% +13.7% ➖ noise
6 duckdb:vortex-compact -1.1% -2.8% +1.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -2.8% +0.6% +14.1% ➖ noise
7 datafusion:vortex-compact -1.2% -0.8% -0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.6% -0.8% +3.5% +10.9% ➖ noise
7 duckdb:vortex-compact -1.1% -0.8% -0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.0% -0.8% -2.2% +17.5% ➖ noise
8 datafusion:vortex-compact +5.2% +0.8% +4.4% +23.9% ➖ noise
8 datafusion:vortex-file-compressed -1.5% +0.8% -2.3% +13.2% ➖ noise
8 duckdb:vortex-compact -3.7% +0.8% -4.5% +34.0% ➖ noise
8 duckdb:vortex-file-compressed +1.8% +0.8% +1.0% +28.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.040x ➖
Parquet (geomean): 1.032x ➖
Shifts: Parquet (control) +3.2% · Median polish +3.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.040x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50434009 51974384 0.97
tpch_q02/datafusion:vortex-file-compressed 24178703 23484293 1.03
tpch_q03/datafusion:vortex-file-compressed 30224569 28319003 1.07
tpch_q04/datafusion:vortex-file-compressed 21517052 20465680 1.05
tpch_q05/datafusion:vortex-file-compressed 51877276 50292252 1.03
tpch_q06/datafusion:vortex-file-compressed 11155825 10300465 1.08
tpch_q07/datafusion:vortex-file-compressed 56789624 55947083 1.02
tpch_q08/datafusion:vortex-file-compressed 43822548 41152785 1.06
tpch_q09/datafusion:vortex-file-compressed 52966683 52121004 1.02
tpch_q10/datafusion:vortex-file-compressed 46624527 44242814 1.05
tpch_q11/datafusion:vortex-file-compressed 17684745 16692064 1.06
tpch_q12/datafusion:vortex-file-compressed 24813453 24653958 1.01
tpch_q13/datafusion:vortex-file-compressed 27184795 26585804 1.02
tpch_q14/datafusion:vortex-file-compressed 17194895 15984543 1.08
tpch_q15/datafusion:vortex-file-compressed 25326585 24996022 1.01
tpch_q16/datafusion:vortex-file-compressed 21073418 20292321 1.04
tpch_q17/datafusion:vortex-file-compressed 🚨 76789884 67253357 1.14
tpch_q18/datafusion:vortex-file-compressed 85576698 81960499 1.04
tpch_q19/datafusion:vortex-file-compressed 21452824 21767504 0.99
tpch_q20/datafusion:vortex-file-compressed 29809810 29340065 1.02
tpch_q21/datafusion:vortex-file-compressed 76202391 73418946 1.04
tpch_q22/datafusion:vortex-file-compressed 12644669 11857208 1.07
datafusion / vortex-compact (1.033x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61318070 57449592 1.07
tpch_q02/datafusion:vortex-compact 27307271 27136931 1.01
tpch_q03/datafusion:vortex-compact 30191467 29434693 1.03
tpch_q04/datafusion:vortex-compact 24268988 22497281 1.08
tpch_q05/datafusion:vortex-compact 52451843 52103615 1.01
tpch_q06/datafusion:vortex-compact 13230916 12519669 1.06
tpch_q07/datafusion:vortex-compact 64784886 59953307 1.08
tpch_q08/datafusion:vortex-compact 45034072 43556256 1.03
tpch_q09/datafusion:vortex-compact 57676868 57082162 1.01
tpch_q10/datafusion:vortex-compact 48031976 46568430 1.03
tpch_q11/datafusion:vortex-compact 18689281 17823895 1.05
tpch_q12/datafusion:vortex-compact 32395832 30967611 1.05
tpch_q13/datafusion:vortex-compact 33776359 32049953 1.05
tpch_q14/datafusion:vortex-compact 20217684 19315501 1.05
tpch_q15/datafusion:vortex-compact 31766848 31693808 1.00
tpch_q16/datafusion:vortex-compact 25144808 25861466 0.97
tpch_q17/datafusion:vortex-compact 74235651 70685285 1.05
tpch_q18/datafusion:vortex-compact 89489549 86395716 1.04
tpch_q19/datafusion:vortex-compact 32035297 31945590 1.00
tpch_q20/datafusion:vortex-compact 34887369 34114380 1.02
tpch_q21/datafusion:vortex-compact 77754368 77640535 1.00
tpch_q22/datafusion:vortex-compact 13375208 12603848 1.06
datafusion / parquet (1.045x ➖, 0↑ 3↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 125608318 111908088 1.12
tpch_q02/datafusion:parquet 64569543 62174209 1.04
tpch_q03/datafusion:parquet 71124625 68172212 1.04
tpch_q04/datafusion:parquet 44142232 43660033 1.01
tpch_q05/datafusion:parquet 96532549 93255283 1.04
tpch_q06/datafusion:parquet 43451462 42107624 1.03
tpch_q07/datafusion:parquet 111850720 106294667 1.05
tpch_q08/datafusion:parquet 98065686 99731587 0.98
tpch_q09/datafusion:parquet 131104032 129718421 1.01
tpch_q10/datafusion:parquet 116617994 113990117 1.02
tpch_q11/datafusion:parquet 44376082 42310591 1.05
tpch_q12/datafusion:parquet 83442712 87565715 0.95
tpch_q13/datafusion:parquet 208875697 205673661 1.02
tpch_q14/datafusion:parquet 🚨 49056459 41999175 1.17
tpch_q15/datafusion:parquet 62343695 59822548 1.04
tpch_q16/datafusion:parquet 45489269 41853315 1.09
tpch_q17/datafusion:parquet 🚨 146661399 129630349 1.13
tpch_q18/datafusion:parquet 175862890 166874138 1.05
tpch_q19/datafusion:parquet 83530420 77728341 1.07
tpch_q20/datafusion:parquet 74705227 71362351 1.05
tpch_q21/datafusion:parquet 139777794 135242718 1.03
tpch_q22/datafusion:parquet 33133216 33067497 1.00
datafusion / arrow (1.054x ➖, 0↑ 3↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 57073748 57364476 0.99
tpch_q02/datafusion:arrow 19454797 19439549 1.00
tpch_q03/datafusion:arrow 33845653 30947861 1.09
tpch_q04/datafusion:arrow 🚨 30506044 26434495 1.15
tpch_q05/datafusion:arrow 🚨 91271176 76274842 1.20
tpch_q06/datafusion:arrow 🚨 23307239 19920651 1.17
tpch_q07/datafusion:arrow 111175342 104523251 1.06
tpch_q08/datafusion:arrow 46749466 43734321 1.07
tpch_q09/datafusion:arrow 71624217 66875558 1.07
tpch_q10/datafusion:arrow 48841357 50252731 0.97
tpch_q11/datafusion:arrow 9649019 9087116 1.06
tpch_q12/datafusion:arrow 55005746 51666808 1.06
tpch_q13/datafusion:arrow 48366209 47572340 1.02
tpch_q14/datafusion:arrow 23287315 22187510 1.05
tpch_q15/datafusion:arrow 44632267 44127846 1.01
tpch_q16/datafusion:arrow 19590667 19121190 1.02
tpch_q17/datafusion:arrow 70952359 69095256 1.03
tpch_q18/datafusion:arrow 140673033 138462999 1.02
tpch_q19/datafusion:arrow 37048927 35884282 1.03
tpch_q20/datafusion:arrow 35393131 34406480 1.03
tpch_q21/datafusion:arrow 160104281 148065738 1.08
tpch_q22/datafusion:arrow 18155338 17958210 1.01
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 2↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31881619 31277685 1.02
tpch_q02/duckdb:vortex-file-compressed 26764185 24916717 1.07
tpch_q03/duckdb:vortex-file-compressed 34264717 33178134 1.03
tpch_q04/duckdb:vortex-file-compressed 30006605 28532535 1.05
tpch_q05/duckdb:vortex-file-compressed 39092314 37531547 1.04
tpch_q06/duckdb:vortex-file-compressed 🚨 9241762 8105677 1.14
tpch_q07/duckdb:vortex-file-compressed 35925403 35364305 1.02
tpch_q08/duckdb:vortex-file-compressed 38125192 37177147 1.03
tpch_q09/duckdb:vortex-file-compressed 60019167 58469623 1.03
tpch_q10/duckdb:vortex-file-compressed 42116827 40629557 1.04
tpch_q11/duckdb:vortex-file-compressed 15586414 15014051 1.04
tpch_q12/duckdb:vortex-file-compressed 23696113 22787856 1.04
tpch_q13/duckdb:vortex-file-compressed 43450895 42103082 1.03
tpch_q14/duckdb:vortex-file-compressed 22314281 22547334 0.99
tpch_q15/duckdb:vortex-file-compressed 17765733 17128851 1.04
tpch_q16/duckdb:vortex-file-compressed 30292431 29904909 1.01
tpch_q17/duckdb:vortex-file-compressed 24525340 24299920 1.01
tpch_q18/duckdb:vortex-file-compressed 54477062 53506957 1.02
tpch_q19/duckdb:vortex-file-compressed 30979897 29774838 1.04
tpch_q20/duckdb:vortex-file-compressed 34616451 33852000 1.02
tpch_q21/duckdb:vortex-file-compressed 105606091 102213780 1.03
tpch_q22/duckdb:vortex-file-compressed 🚨 23806346 18199783 1.31
duckdb / vortex-compact (1.041x ➖, 0↑ 2↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38766857 38375252 1.01
tpch_q02/duckdb:vortex-compact 34871414 33963288 1.03
tpch_q03/duckdb:vortex-compact 35888518 35055356 1.02
tpch_q04/duckdb:vortex-compact 31053400 31578476 0.98
tpch_q05/duckdb:vortex-compact 42710026 41557482 1.03
tpch_q06/duckdb:vortex-compact 🚨 11318769 10223943 1.11
tpch_q07/duckdb:vortex-compact 41705906 40702788 1.02
tpch_q08/duckdb:vortex-compact 42058533 42669489 0.99
tpch_q09/duckdb:vortex-compact 68177607 66435529 1.03
tpch_q10/duckdb:vortex-compact 46010015 44750253 1.03
tpch_q11/duckdb:vortex-compact 18812697 18629412 1.01
tpch_q12/duckdb:vortex-compact 29573317 29936022 0.99
tpch_q13/duckdb:vortex-compact 48050222 48441910 0.99
tpch_q14/duckdb:vortex-compact 26794094 26055308 1.03
tpch_q15/duckdb:vortex-compact 20743214 19970733 1.04
tpch_q16/duckdb:vortex-compact 32706296 33370673 0.98
tpch_q17/duckdb:vortex-compact 30027719 29016427 1.03
tpch_q18/duckdb:vortex-compact 53803812 53632302 1.00
tpch_q19/duckdb:vortex-compact 35104254 33446907 1.05
tpch_q20/duckdb:vortex-compact 41654114 41161945 1.01
tpch_q21/duckdb:vortex-compact 108280394 103628735 1.04
tpch_q22/duckdb:vortex-compact 🚨 31311873 19401523 1.61
duckdb / parquet (1.020x ➖, 0↑ 2↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76813648 79613051 0.96
tpch_q02/duckdb:parquet 39828373 39907996 1.00
tpch_q03/duckdb:parquet 71278291 70928205 1.00
tpch_q04/duckdb:parquet 53589543 55764897 0.96
tpch_q05/duckdb:parquet 68541279 70209055 0.98
tpch_q06/duckdb:parquet 22607509 22133218 1.02
tpch_q07/duckdb:parquet 70604709 69410809 1.02
tpch_q08/duckdb:parquet 🚨 93251062 82407563 1.13
tpch_q09/duckdb:parquet 147949914 156206363 0.95
tpch_q10/duckdb:parquet 129451405 133939629 0.97
tpch_q11/duckdb:parquet 22815991 22569474 1.01
tpch_q12/duckdb:parquet 🚨 51663373 46741950 1.11
tpch_q13/duckdb:parquet 263098586 255256850 1.03
tpch_q14/duckdb:parquet 52425531 51085276 1.03
tpch_q15/duckdb:parquet 26874642 26940436 1.00
tpch_q16/duckdb:parquet 59641879 58150232 1.03
tpch_q17/duckdb:parquet 63545681 59052898 1.08
tpch_q18/duckdb:parquet 121596646 121276618 1.00
tpch_q19/duckdb:parquet 73587547 69058470 1.07
tpch_q20/duckdb:parquet 66870892 65165477 1.03
tpch_q21/duckdb:parquet 187051507 174826887 1.07
tpch_q22/duckdb:parquet 55690689 54172708 1.03
duckdb / duckdb (1.030x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17966192 17888303 1.00
tpch_q02/duckdb:duckdb 15273352 14271472 1.07
tpch_q03/duckdb:duckdb 23566149 23242640 1.01
tpch_q04/duckdb:duckdb 22984423 21287976 1.08
tpch_q05/duckdb:duckdb 23926305 23521190 1.02
tpch_q06/duckdb:duckdb 7130428 7094123 1.01
tpch_q07/duckdb:duckdb 26054843 25549035 1.02
tpch_q08/duckdb:duckdb 25004517 24326540 1.03
tpch_q09/duckdb:duckdb 58393439 57040287 1.02
tpch_q10/duckdb:duckdb 53646599 51855164 1.03
tpch_q11/duckdb:duckdb 7672767 7246097 1.06
tpch_q12/duckdb:duckdb 18598106 17784641 1.05
tpch_q13/duckdb:duckdb 40386594 39602282 1.02
tpch_q14/duckdb:duckdb 22048472 21698012 1.02
tpch_q15/duckdb:duckdb 14066353 13609395 1.03
tpch_q16/duckdb:duckdb 27044890 26044978 1.04
tpch_q17/duckdb:duckdb 16852578 16227202 1.04
tpch_q18/duckdb:duckdb 41300594 40618407 1.02
tpch_q19/duckdb:duckdb 32263672 31170707 1.04
tpch_q20/duckdb:duckdb 26115404 25271874 1.03
tpch_q21/duckdb:duckdb 63052885 61963482 1.02
tpch_q22/duckdb:duckdb 25751368 25553714 1.01
File Size Changes (9 files changed, -0.0% overall, 3↑ 6↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-compact 3.35 MB 3.40 MB +53.87 KB +1.6%
part_0.vortex 1.0 vortex-file-compressed 4.94 MB 5.01 MB +77.73 KB +1.5%
lineitem_1.vortex 1.0 vortex-file-compressed 84.51 MB 84.59 MB +81.76 KB +0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.16 MB 85.11 MB 50.33 KB -0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.83 MB 23.81 MB 17.52 KB -0.1%
customer_0.vortex 1.0 vortex-file-compressed 8.91 MB 8.89 MB 18.74 KB -0.2%
supplier_0.vortex 1.0 vortex-file-compressed 605.52 KB 603.31 KB 2.20 KB -0.4%
partsupp_0.vortex 1.0 vortex-compact 20.92 MB 20.83 MB 84.72 KB -0.4%
orders_0.vortex 1.0 vortex-file-compressed 38.62 MB 38.43 MB 194.80 KB -0.5%

Totals:

  • vortex-compact: 190.69 MB → 190.66 MB (-0.0%)
  • vortex-file-compressed: 246.84 MB → 246.72 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.5% +4.1% -4.4% +17.6% ➖ noise
1 datafusion:vortex-compact +6.7% +4.1% +2.6% +16.2% ➖ noise
1 datafusion:vortex-file-compressed -3.0% +4.1% -6.8% +15.5% ➖ noise
1 duckdb:duckdb +0.4% +4.1% -3.5% +14.1% ➖ noise
1 duckdb:vortex-compact +1.0% +4.1% -2.9% +14.0% ➖ noise
1 duckdb:vortex-file-compressed +1.9% +4.1% -2.1% +16.8% ➖ noise
2 datafusion:arrow +0.1% +1.8% -1.7% +10.0% ➖ noise
2 datafusion:vortex-compact +0.6% +1.8% -1.2% +10.2% ➖ noise
2 datafusion:vortex-file-compressed +3.0% +1.8% +1.1% +10.0% ➖ noise
2 duckdb:duckdb +7.0% +1.8% +5.1% +10.0% ➖ noise
2 duckdb:vortex-compact +2.7% +1.8% +0.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +7.4% +1.8% +5.5% +10.0% ➖ noise
3 datafusion:arrow +9.4% +2.4% +6.8% +10.2% ➖ noise
3 datafusion:vortex-compact +2.6% +2.4% +0.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +6.7% +2.4% +4.2% +13.8% ➖ noise
3 duckdb:duckdb +1.4% +2.4% -1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +2.4% +2.4% -0.0% +11.3% ➖ noise
3 duckdb:vortex-file-compressed +3.3% +2.4% +0.9% +10.0% ➖ noise
4 datafusion:arrow +15.4% -1.4% +17.1% +10.0% 🚨 regression
4 datafusion:vortex-compact +7.9% -1.4% +9.4% +11.2% ➖ noise
4 datafusion:vortex-file-compressed +5.1% -1.4% +6.7% +11.5% ➖ noise
4 duckdb:duckdb +8.0% -1.4% +9.5% +10.0% ➖ noise
4 duckdb:vortex-compact -1.7% -1.4% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +5.2% -1.4% +6.7% +10.0% ➖ noise
5 datafusion:arrow +19.7% +0.5% +19.0% +10.0% 🚨 regression
5 datafusion:vortex-compact +0.7% +0.5% +0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +3.2% +0.5% +2.6% +10.0% ➖ noise
5 duckdb:duckdb +1.7% +0.5% +1.2% +10.0% ➖ noise
5 duckdb:vortex-compact +2.8% +0.5% +2.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.2% +0.5% +3.6% +13.1% ➖ noise
6 datafusion:arrow +17.0% +2.7% +14.0% +13.3% 🚨 regression
6 datafusion:vortex-compact +5.7% +2.7% +2.9% +17.3% ➖ noise
6 datafusion:vortex-file-compressed +8.3% +2.7% +5.5% +14.3% ➖ noise
6 duckdb:duckdb +0.5% +2.7% -2.1% +12.8% ➖ noise
6 duckdb:vortex-compact +10.7% +2.7% +7.8% +15.9% ➖ noise
6 duckdb:vortex-file-compressed +14.0% +2.7% +11.1% +16.4% ➖ noise
7 datafusion:arrow +6.4% +3.5% +2.8% +10.0% ➖ noise
7 datafusion:vortex-compact +8.1% +3.5% +4.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.5% +3.5% -1.9% +10.0% ➖ noise
7 duckdb:duckdb +2.0% +3.5% -1.4% +10.0% ➖ noise
7 duckdb:vortex-compact +2.5% +3.5% -1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.6% +3.5% -1.8% +10.0% ➖ noise
8 datafusion:arrow +6.9% +5.5% +1.3% +12.0% ➖ noise
8 datafusion:vortex-compact +3.4% +5.5% -2.0% +13.6% ➖ noise
8 datafusion:vortex-file-compressed +6.5% +5.5% +1.0% +13.7% ➖ noise
8 duckdb:duckdb +2.8% +5.5% -2.6% +11.0% ➖ noise
8 duckdb:vortex-compact -1.4% +5.5% -6.6% +11.6% ➖ noise
8 duckdb:vortex-file-compressed +2.6% +5.5% -2.8% +12.0% ➖ noise
9 datafusion:arrow +7.1% -2.2% +9.5% +10.0% ➖ noise
9 datafusion:vortex-compact +1.0% -2.2% +3.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.6% -2.2% +3.9% +10.0% ➖ noise
9 duckdb:duckdb +2.4% -2.2% +4.6% +10.0% ➖ noise
9 duckdb:vortex-compact +2.6% -2.2% +4.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.7% -2.2% +4.9% +10.0% ➖ noise
10 datafusion:arrow -2.8% -0.6% -2.3% +10.0% ➖ noise
10 datafusion:vortex-compact +3.1% -0.6% +3.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.4% -0.6% +6.0% +10.0% ➖ noise
10 duckdb:duckdb +3.5% -0.6% +4.0% +10.0% ➖ noise
10 duckdb:vortex-compact +2.8% -0.6% +3.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.7% -0.6% +4.2% +10.0% ➖ noise
11 datafusion:arrow +6.2% +3.0% +3.1% +10.0% ➖ noise
11 datafusion:vortex-compact +4.9% +3.0% +1.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.9% +3.0% +2.9% +10.3% ➖ noise
11 duckdb:duckdb +5.9% +3.0% +2.8% +10.0% ➖ noise
11 duckdb:vortex-compact +1.0% +3.0% -1.9% +17.6% ➖ noise
11 duckdb:vortex-file-compressed +3.8% +3.0% +0.8% +10.0% ➖ noise
12 datafusion:arrow +6.5% +2.6% +3.7% +17.8% ➖ noise
12 datafusion:vortex-compact +4.6% +2.6% +1.9% +12.1% ➖ noise
12 datafusion:vortex-file-compressed +0.6% +2.6% -1.9% +10.0% ➖ noise
12 duckdb:duckdb +4.6% +2.6% +1.9% +10.0% ➖ noise
12 duckdb:vortex-compact -1.2% +2.6% -3.7% +11.5% ➖ noise
12 duckdb:vortex-file-compressed +4.0% +2.6% +1.3% +12.1% ➖ noise
13 datafusion:arrow +1.7% +2.3% -0.6% +10.0% ➖ noise
13 datafusion:vortex-compact +5.4% +2.3% +3.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.3% +2.3% -0.1% +10.0% ➖ noise
13 duckdb:duckdb +2.0% +2.3% -0.3% +10.0% ➖ noise
13 duckdb:vortex-compact -0.8% +2.3% -3.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.2% +2.3% +0.9% +10.0% ➖ noise
14 datafusion:arrow +5.0% +9.5% -4.1% +13.1% ➖ noise
14 datafusion:vortex-compact +4.7% +9.5% -4.4% +13.0% ➖ noise
14 datafusion:vortex-file-compressed +7.6% +9.5% -1.7% +11.9% ➖ noise
14 duckdb:duckdb +1.6% +9.5% -7.2% +10.0% ➖ noise
14 duckdb:vortex-compact +2.8% +9.5% -6.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.0% +9.5% -9.6% +10.0% ✅ faster
15 datafusion:arrow +1.1% +2.0% -0.8% +10.5% ➖ noise
15 datafusion:vortex-compact +0.2% +2.0% -1.7% +10.8% ➖ noise
15 datafusion:vortex-file-compressed +1.3% +2.0% -0.6% +12.6% ➖ noise
15 duckdb:duckdb +3.4% +2.0% +1.4% +10.0% ➖ noise
15 duckdb:vortex-compact +3.9% +2.0% +1.9% +13.9% ➖ noise
15 duckdb:vortex-file-compressed +3.7% +2.0% +1.7% +10.0% ➖ noise
16 datafusion:arrow +2.5% +5.6% -3.0% +10.0% ➖ noise
16 datafusion:vortex-compact -2.8% +5.6% -7.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.8% +5.6% -1.6% +10.0% ➖ noise
16 duckdb:duckdb +3.8% +5.6% -1.7% +10.0% ➖ noise
16 duckdb:vortex-compact -2.0% +5.6% -7.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.3% +5.6% -4.1% +10.0% ➖ noise
17 datafusion:arrow +2.7% +10.3% -6.9% +12.6% ➖ noise
17 datafusion:vortex-compact +5.0% +10.3% -4.8% +12.4% ➖ noise
17 datafusion:vortex-file-compressed +14.2% +10.3% +3.5% +11.7% ➖ noise
17 duckdb:duckdb +3.9% +10.3% -5.9% +10.1% ➖ noise
17 duckdb:vortex-compact +3.5% +10.3% -6.2% +12.0% ➖ noise
17 duckdb:vortex-file-compressed +0.9% +10.3% -8.5% +12.5% ➖ noise
18 datafusion:arrow +1.6% +2.8% -1.2% +10.4% ➖ noise
18 datafusion:vortex-compact +3.6% +2.8% +0.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.4% +2.8% +1.6% +10.0% ➖ noise
18 duckdb:duckdb +1.7% +2.8% -1.1% +10.0% ➖ noise
18 duckdb:vortex-compact +0.3% +2.8% -2.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.8% +2.8% -1.0% +10.0% ➖ noise
19 datafusion:arrow +3.2% +7.0% -3.5% +10.9% ➖ noise
19 datafusion:vortex-compact +0.3% +7.0% -6.3% +13.4% ➖ noise
19 datafusion:vortex-file-compressed -1.4% +7.0% -7.9% +13.7% ➖ noise
19 duckdb:duckdb +3.5% +7.0% -3.3% +10.2% ➖ noise
19 duckdb:vortex-compact +5.0% +7.0% -1.9% +11.1% ➖ noise
19 duckdb:vortex-file-compressed +4.0% +7.0% -2.8% +12.2% ➖ noise
20 datafusion:arrow +2.9% +3.6% -0.8% +10.5% ➖ noise
20 datafusion:vortex-compact +2.3% +3.6% -1.3% +11.6% ➖ noise
20 datafusion:vortex-file-compressed +1.6% +3.6% -2.0% +10.0% ➖ noise
20 duckdb:duckdb +3.3% +3.6% -0.3% +10.0% ➖ noise
20 duckdb:vortex-compact +1.2% +3.6% -2.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +2.3% +3.6% -1.3% +12.4% ➖ noise
21 datafusion:arrow +8.1% +5.2% +2.8% +10.3% ➖ noise
21 datafusion:vortex-compact +0.1% +5.2% -4.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +3.8% +5.2% -1.3% +10.0% ➖ noise
21 duckdb:duckdb +1.8% +5.2% -3.2% +10.0% ➖ noise
21 duckdb:vortex-compact +4.5% +5.2% -0.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +3.3% +5.2% -1.7% +10.0% ➖ noise
22 datafusion:arrow +1.1% +1.5% -0.4% +10.0% ➖ noise
22 datafusion:vortex-compact +6.1% +1.5% +4.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +6.6% +1.5% +5.1% +10.0% ➖ noise
22 duckdb:duckdb +0.8% +1.5% -0.7% +10.0% ➖ noise
22 duckdb:vortex-compact +61.4% +1.5% +59.0% +13.2% 🚨 regression
22 duckdb:vortex-file-compressed +30.8% +1.5% +28.9% +10.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 0.981x ➖
Parquet (geomean): 0.979x ➖
Shifts: Parquet (control) -2.1% · Median polish -2.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.966x ➖, 1↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26889798 28288092 0.95
tpcds_q02/datafusion:vortex-file-compressed 48818367 50113532 0.97
tpcds_q03/datafusion:vortex-file-compressed 15695080 16222094 0.97
tpcds_q04/datafusion:vortex-file-compressed 266922234 281021811 0.95
tpcds_q05/datafusion:vortex-file-compressed 44329447 48137767 0.92
tpcds_q06/datafusion:vortex-file-compressed 59413856 63860558 0.93
tpcds_q07/datafusion:vortex-file-compressed 43104165 46331784 0.93
tpcds_q08/datafusion:vortex-file-compressed 29413384 31281052 0.94
tpcds_q09/datafusion:vortex-file-compressed 38031342 41047159 0.93
tpcds_q10/datafusion:vortex-file-compressed 39700513 40614399 0.98
tpcds_q11/datafusion:vortex-file-compressed 131830634 138324468 0.95
tpcds_q12/datafusion:vortex-file-compressed 20902186 20693003 1.01
tpcds_q13/datafusion:vortex-file-compressed 48624115 49820260 0.98
tpcds_q14/datafusion:vortex-file-compressed 173703722 182391242 0.95
tpcds_q15/datafusion:vortex-file-compressed 28744229 30416892 0.95
tpcds_q16/datafusion:vortex-file-compressed 29573787 30220877 0.98
tpcds_q17/datafusion:vortex-file-compressed 65171417 66163445 0.99
tpcds_q18/datafusion:vortex-file-compressed 70506544 73290029 0.96
tpcds_q19/datafusion:vortex-file-compressed 22871754 22991414 0.99
tpcds_q20/datafusion:vortex-file-compressed 21982856 23621999 0.93
tpcds_q21/datafusion:vortex-file-compressed 36519869 37212732 0.98
tpcds_q22/datafusion:vortex-file-compressed 111570011 116785755 0.96
tpcds_q23/datafusion:vortex-file-compressed 153319240 157594336 0.97
tpcds_q24/datafusion:vortex-file-compressed 85087012 90637582 0.94
tpcds_q25/datafusion:vortex-file-compressed 67857786 71214661 0.95
tpcds_q26/datafusion:vortex-file-compressed 35440665 35227925 1.01
tpcds_q27/datafusion:vortex-file-compressed 110164498 107764825 1.02
tpcds_q28/datafusion:vortex-file-compressed 34529811 34306303 1.01
tpcds_q29/datafusion:vortex-file-compressed 66784474 65850772 1.01
tpcds_q30/datafusion:vortex-file-compressed 23342096 25229550 0.93
tpcds_q31/datafusion:vortex-file-compressed 75959954 79985929 0.95
tpcds_q32/datafusion:vortex-file-compressed 20494857 20856753 0.98
tpcds_q33/datafusion:vortex-file-compressed 31808936 32103546 0.99
tpcds_q34/datafusion:vortex-file-compressed 25394401 27125196 0.94
tpcds_q35/datafusion:vortex-file-compressed 46673446 47920717 0.97
tpcds_q36/datafusion:vortex-file-compressed 58649718 61580275 0.95
tpcds_q37/datafusion:vortex-file-compressed 24719609 25625928 0.96
tpcds_q38/datafusion:vortex-file-compressed 45513876 47070365 0.97
tpcds_q39/datafusion:vortex-file-compressed 109755177 115350387 0.95
tpcds_q40/datafusion:vortex-file-compressed 34104247 35450808 0.96
tpcds_q41/datafusion:vortex-file-compressed 17435340 17305820 1.01
tpcds_q42/datafusion:vortex-file-compressed 15326441 14736988 1.04
tpcds_q43/datafusion:vortex-file-compressed 19192931 19577428 0.98
tpcds_q44/datafusion:vortex-file-compressed 31702917 33524184 0.95
tpcds_q45/datafusion:vortex-file-compressed 28791214 29281571 0.98
tpcds_q46/datafusion:vortex-file-compressed 36305959 36894450 0.98
tpcds_q47/datafusion:vortex-file-compressed 135089047 139442125 0.97
tpcds_q48/datafusion:vortex-file-compressed 37014505 37314776 0.99
tpcds_q49/datafusion:vortex-file-compressed 59041688 60555258 0.98
tpcds_q50/datafusion:vortex-file-compressed 39936553 40721165 0.98
tpcds_q51/datafusion:vortex-file-compressed 91275810 93704883 0.97
tpcds_q52/datafusion:vortex-file-compressed 14977619 15603365 0.96
tpcds_q53/datafusion:vortex-file-compressed 22831088 23624843 0.97
tpcds_q54/datafusion:vortex-file-compressed 35190497 37818610 0.93
tpcds_q55/datafusion:vortex-file-compressed 14288281 14874246 0.96
tpcds_q56/datafusion:vortex-file-compressed 29915114 33023747 0.91
tpcds_q57/datafusion:vortex-file-compressed 108660210 114328175 0.95
tpcds_q58/datafusion:vortex-file-compressed 53943084 57473448 0.94
tpcds_q59/datafusion:vortex-file-compressed 58542418 60351434 0.97
tpcds_q60/datafusion:vortex-file-compressed 30717206 31973695 0.96
tpcds_q61/datafusion:vortex-file-compressed 44299896 42641243 1.04
tpcds_q62/datafusion:vortex-file-compressed 🚀 23854581 28253982 0.84
tpcds_q63/datafusion:vortex-file-compressed 21906887 23233952 0.94
tpcds_q64/datafusion:vortex-file-compressed 420550482 441220361 0.95
tpcds_q65/datafusion:vortex-file-compressed 40162723 41712003 0.96
tpcds_q66/datafusion:vortex-file-compressed 72093367 78431749 0.92
tpcds_q67/datafusion:vortex-file-compressed 142635840 148800903 0.96
tpcds_q68/datafusion:vortex-file-compressed 33164936 34581219 0.96
tpcds_q69/datafusion:vortex-file-compressed 37391172 38857056 0.96
tpcds_q70/datafusion:vortex-file-compressed 84374573 89778082 0.94
tpcds_q71/datafusion:vortex-file-compressed 23210181 24226324 0.96
tpcds_q72/datafusion:vortex-file-compressed 2209417476 2273719851 0.97
tpcds_q73/datafusion:vortex-file-compressed 23117755 24544437 0.94
tpcds_q74/datafusion:vortex-file-compressed 81445960 85491441 0.95
tpcds_q75/datafusion:vortex-file-compressed 112215655 114651234 0.98
tpcds_q76/datafusion:vortex-file-compressed 32081587 31208555 1.03
tpcds_q77/datafusion:vortex-file-compressed 41324196 43975056 0.94
tpcds_q78/datafusion:vortex-file-compressed 128214811 132471157 0.97
tpcds_q79/datafusion:vortex-file-compressed 28907987 30041730 0.96
tpcds_q80/datafusion:vortex-file-compressed 93542500 99715803 0.94
tpcds_q81/datafusion:vortex-file-compressed 24971966 25586213 0.98
tpcds_q82/datafusion:vortex-file-compressed 26568960 27863488 0.95
tpcds_q83/datafusion:vortex-file-compressed 36579753 36242430 1.01
tpcds_q84/datafusion:vortex-file-compressed 13799794 14302261 0.96
tpcds_q85/datafusion:vortex-file-compressed 94962184 94898325 1.00
tpcds_q86/datafusion:vortex-file-compressed 16747794 16635114 1.01
tpcds_q87/datafusion:vortex-file-compressed 47019670 48122121 0.98
tpcds_q88/datafusion:vortex-file-compressed 59515826 57952781 1.03
tpcds_q89/datafusion:vortex-file-compressed 25721647 27773204 0.93
tpcds_q90/datafusion:vortex-file-compressed 15157951 15890690 0.95
tpcds_q91/datafusion:vortex-file-compressed 18527376 19872437 0.93
tpcds_q92/datafusion:vortex-file-compressed 18836576 19532978 0.96
tpcds_q93/datafusion:vortex-file-compressed 34210482 35524386 0.96
tpcds_q94/datafusion:vortex-file-compressed 26043113 24958174 1.04
tpcds_q95/datafusion:vortex-file-compressed 65528422 65632634 1.00
tpcds_q96/datafusion:vortex-file-compressed 13822003 15295474 0.90
tpcds_q97/datafusion:vortex-file-compressed 33649147 32677983 1.03
tpcds_q98/datafusion:vortex-file-compressed 24703476 24845496 0.99
tpcds_q99/datafusion:vortex-file-compressed 33680952 33695756 1.00
datafusion / vortex-compact (0.976x ➖, 3↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 28384108 28058325 1.01
tpcds_q02/datafusion:vortex-compact 57398553 55486832 1.03
tpcds_q03/datafusion:vortex-compact 19635154 20487642 0.96
tpcds_q04/datafusion:vortex-compact 308949119 313216868 0.99
tpcds_q05/datafusion:vortex-compact 49554335 50695435 0.98
tpcds_q06/datafusion:vortex-compact 61671653 61120531 1.01
tpcds_q07/datafusion:vortex-compact 53311626 55871520 0.95
tpcds_q08/datafusion:vortex-compact 38294885 36992066 1.04
tpcds_q09/datafusion:vortex-compact 53962124 53797847 1.00
tpcds_q10/datafusion:vortex-compact 51130413 50851493 1.01
tpcds_q11/datafusion:vortex-compact 154854324 162702629 0.95
tpcds_q12/datafusion:vortex-compact 26259231 24124392 1.09
tpcds_q13/datafusion:vortex-compact 🚀 129503036 146336136 0.88
tpcds_q14/datafusion:vortex-compact 204429324 215048880 0.95
tpcds_q15/datafusion:vortex-compact 31271328 32300512 0.97
tpcds_q16/datafusion:vortex-compact 32724820 34036204 0.96
tpcds_q17/datafusion:vortex-compact 78201417 81158308 0.96
tpcds_q18/datafusion:vortex-compact 79016223 84234772 0.94
tpcds_q19/datafusion:vortex-compact 30742272 30970143 0.99
tpcds_q20/datafusion:vortex-compact 26245700 27486947 0.95
tpcds_q21/datafusion:vortex-compact 39589381 42909783 0.92
tpcds_q22/datafusion:vortex-compact 127125612 129989329 0.98
tpcds_q23/datafusion:vortex-compact 164506226 171723656 0.96
tpcds_q24/datafusion:vortex-compact 101720968 103765808 0.98
tpcds_q25/datafusion:vortex-compact 79576440 86909828 0.92
tpcds_q26/datafusion:vortex-compact 45864256 45702313 1.00
tpcds_q27/datafusion:vortex-compact 130502828 131940541 0.99
tpcds_q28/datafusion:vortex-compact 102139416 105573933 0.97
tpcds_q29/datafusion:vortex-compact 75863495 78444706 0.97
tpcds_q30/datafusion:vortex-compact 28940997 29876226 0.97
tpcds_q31/datafusion:vortex-compact 99585360 102054530 0.98
tpcds_q32/datafusion:vortex-compact 26591224 28374099 0.94
tpcds_q33/datafusion:vortex-compact 37741275 37609666 1.00
tpcds_q34/datafusion:vortex-compact 34788226 34826655 1.00
tpcds_q35/datafusion:vortex-compact 52656278 53553589 0.98
tpcds_q36/datafusion:vortex-compact 74236635 79139377 0.94
tpcds_q37/datafusion:vortex-compact 34374363 37688829 0.91
tpcds_q38/datafusion:vortex-compact 52471370 53365186 0.98
tpcds_q39/datafusion:vortex-compact 117832860 121665219 0.97
tpcds_q40/datafusion:vortex-compact 38360798 38378317 1.00
tpcds_q41/datafusion:vortex-compact 19003261 19359642 0.98
tpcds_q42/datafusion:vortex-compact 19093128 19437830 0.98
tpcds_q43/datafusion:vortex-compact 25173454 27837362 0.90
tpcds_q44/datafusion:vortex-compact 47189369 50120079 0.94
tpcds_q45/datafusion:vortex-compact 33422745 32507038 1.03
tpcds_q46/datafusion:vortex-compact 49511616 46537802 1.06
tpcds_q47/datafusion:vortex-compact 157059020 159318467 0.99
tpcds_q48/datafusion:vortex-compact 85325865 84792888 1.01
tpcds_q49/datafusion:vortex-compact 71680706 75761670 0.95
tpcds_q50/datafusion:vortex-compact 50757386 49423929 1.03
tpcds_q51/datafusion:vortex-compact 96120367 99814292 0.96
tpcds_q52/datafusion:vortex-compact 18732664 19152053 0.98
tpcds_q53/datafusion:vortex-compact 28982308 29843677 0.97
tpcds_q54/datafusion:vortex-compact 44956634 45088570 1.00
tpcds_q55/datafusion:vortex-compact 19107683 18630348 1.03
tpcds_q56/datafusion:vortex-compact 38345069 37690763 1.02
tpcds_q57/datafusion:vortex-compact 119936178 123889572 0.97
tpcds_q58/datafusion:vortex-compact 63483631 63614812 1.00
tpcds_q59/datafusion:vortex-compact 70546559 74893378 0.94
tpcds_q60/datafusion:vortex-compact 35716216 37535662 0.95
tpcds_q61/datafusion:vortex-compact 55694268 55970915 1.00
tpcds_q62/datafusion:vortex-compact 🚨 32171533 25385700 1.27
tpcds_q63/datafusion:vortex-compact 29359570 30308371 0.97
tpcds_q64/datafusion:vortex-compact 461612636 477746360 0.97
tpcds_q65/datafusion:vortex-compact 57568733 54336087 1.06
tpcds_q66/datafusion:vortex-compact 79115921 81516377 0.97
tpcds_q67/datafusion:vortex-compact 156219992 151410204 1.03
tpcds_q68/datafusion:vortex-compact 46418017 46950030 0.99
tpcds_q69/datafusion:vortex-compact 47761970 50598812 0.94
tpcds_q70/datafusion:vortex-compact 100224158 97796534 1.02
tpcds_q71/datafusion:vortex-compact 30102794 31887998 0.94
tpcds_q72/datafusion:vortex-compact 2229943425 2272275493 0.98
tpcds_q73/datafusion:vortex-compact 30750905 31482691 0.98
tpcds_q74/datafusion:vortex-compact 97091498 103130282 0.94
tpcds_q75/datafusion:vortex-compact 131108361 136651199 0.96
tpcds_q76/datafusion:vortex-compact 32164085 34650943 0.93
tpcds_q77/datafusion:vortex-compact 53450955 54219887 0.99
tpcds_q78/datafusion:vortex-compact 142609676 145552992 0.98
tpcds_q79/datafusion:vortex-compact 38748482 39246100 0.99
tpcds_q80/datafusion:vortex-compact 106057088 112341058 0.94
tpcds_q81/datafusion:vortex-compact 🚀 28173483 32027674 0.88
tpcds_q82/datafusion:vortex-compact 35252365 36909536 0.96
tpcds_q83/datafusion:vortex-compact 34719682 35320208 0.98
tpcds_q84/datafusion:vortex-compact 15289198 15873675 0.96
tpcds_q85/datafusion:vortex-compact 172612234 170418567 1.01
tpcds_q86/datafusion:vortex-compact 19734693 19065185 1.04
tpcds_q87/datafusion:vortex-compact 52622662 54891480 0.96
tpcds_q88/datafusion:vortex-compact 79533477 83643273 0.95
tpcds_q89/datafusion:vortex-compact 32938449 32825682 1.00
tpcds_q90/datafusion:vortex-compact 15596311 16320158 0.96
tpcds_q91/datafusion:vortex-compact 32781777 35566854 0.92
tpcds_q92/datafusion:vortex-compact 24209410 25949569 0.93
tpcds_q93/datafusion:vortex-compact 40093928 42115925 0.95
tpcds_q94/datafusion:vortex-compact 🚀 27725938 31950301 0.87
tpcds_q95/datafusion:vortex-compact 71783793 71548002 1.00
tpcds_q96/datafusion:vortex-compact 17835217 18276117 0.98
tpcds_q97/datafusion:vortex-compact 36633868 37835275 0.97
tpcds_q98/datafusion:vortex-compact 30456132 31689236 0.96
tpcds_q99/datafusion:vortex-compact 35797659 36598670 0.98
datafusion / parquet (0.966x ➖, 3↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30368824 32709140 0.93
tpcds_q02/datafusion:parquet 42875744 45319922 0.95
tpcds_q03/datafusion:parquet 12935395 13304821 0.97
tpcds_q04/datafusion:parquet 258387849 275028455 0.94
tpcds_q05/datafusion:parquet 40734572 44657828 0.91
tpcds_q06/datafusion:parquet 59864320 59273838 1.01
tpcds_q07/datafusion:parquet 80335951 79123431 1.02
tpcds_q08/datafusion:parquet 26829810 28220993 0.95
tpcds_q09/datafusion:parquet 44414132 45673036 0.97
tpcds_q10/datafusion:parquet 70707528 72459347 0.98
tpcds_q11/datafusion:parquet 149203421 157481766 0.95
tpcds_q12/datafusion:parquet 17963879 19108531 0.94
tpcds_q13/datafusion:parquet 76311703 79494268 0.96
tpcds_q14/datafusion:parquet 165922542 167834832 0.99
tpcds_q15/datafusion:parquet 21554844 23466402 0.92
tpcds_q16/datafusion:parquet 🚀 24396790 28054141 0.87
tpcds_q17/datafusion:parquet 66437333 67403280 0.99
tpcds_q18/datafusion:parquet 115682755 125081276 0.92
tpcds_q19/datafusion:parquet 22942765 23801849 0.96
tpcds_q20/datafusion:parquet 17093194 17544809 0.97
tpcds_q21/datafusion:parquet 18930814 20113955 0.94
tpcds_q22/datafusion:parquet 157770361 171292040 0.92
tpcds_q23/datafusion:parquet 150055590 155629134 0.96
tpcds_q24/datafusion:parquet 90453235 95079429 0.95
tpcds_q25/datafusion:parquet 67003814 66417976 1.01
tpcds_q26/datafusion:parquet 65478241 67849917 0.97
tpcds_q27/datafusion:parquet 148787863 154588657 0.96
tpcds_q28/datafusion:parquet 44482820 45891891 0.97
tpcds_q29/datafusion:parquet 66899831 68218758 0.98
tpcds_q30/datafusion:parquet 34705813 37084279 0.94
tpcds_q31/datafusion:parquet 66345337 68734584 0.97
tpcds_q32/datafusion:parquet 18196121 19343584 0.94
tpcds_q33/datafusion:parquet 27758431 28144686 0.99
tpcds_q34/datafusion:parquet 23937548 22501469 1.06
tpcds_q35/datafusion:parquet 71515114 72264717 0.99
tpcds_q36/datafusion:parquet 58054264 59603134 0.97
tpcds_q37/datafusion:parquet 19373787 19599902 0.99
tpcds_q38/datafusion:parquet 42105360 44582045 0.94
tpcds_q39/datafusion:parquet 78128941 79997856 0.98
tpcds_q40/datafusion:parquet 24334197 25164610 0.97
tpcds_q41/datafusion:parquet 🚀 12984425 14926094 0.87
tpcds_q42/datafusion:parquet 11670314 11998335 0.97
tpcds_q43/datafusion:parquet 17597916 17836568 0.99
tpcds_q44/datafusion:parquet 33989699 36094490 0.94
tpcds_q45/datafusion:parquet 28229698 29722445 0.95
tpcds_q46/datafusion:parquet 32201278 34176325 0.94
tpcds_q47/datafusion:parquet 129070236 133149373 0.97
tpcds_q48/datafusion:parquet 69674479 72969874 0.95
tpcds_q49/datafusion:parquet 56342654 59244299 0.95
tpcds_q50/datafusion:parquet 47528747 46717629 1.02
tpcds_q51/datafusion:parquet 90168680 86630259 1.04
tpcds_q52/datafusion:parquet 12392844 12435852 1.00
tpcds_q53/datafusion:parquet 17600322 18240904 0.96
tpcds_q54/datafusion:parquet 34358052 37575590 0.91
tpcds_q55/datafusion:parquet 11582286 12170188 0.95
tpcds_q56/datafusion:parquet 27740165 29604752 0.94
tpcds_q57/datafusion:parquet 103121890 102148580 1.01
tpcds_q58/datafusion:parquet 53775747 51572582 1.04
tpcds_q59/datafusion:parquet 57968897 61156388 0.95
tpcds_q60/datafusion:parquet 27191929 28140288 0.97
tpcds_q61/datafusion:parquet 43986336 46423575 0.95
tpcds_q62/datafusion:parquet 25133896 25267955 0.99
tpcds_q63/datafusion:parquet 18073215 18129753 1.00
tpcds_q64/datafusion:parquet 522055696 538256406 0.97
tpcds_q65/datafusion:parquet 38026061 40270703 0.94
tpcds_q66/datafusion:parquet 73558592 69725605 1.05
tpcds_q67/datafusion:parquet 153229379 151850214 1.01
tpcds_q68/datafusion:parquet 33158522 32662613 1.02
tpcds_q69/datafusion:parquet 66846478 69442739 0.96
tpcds_q70/datafusion:parquet 89220665 91390042 0.98
tpcds_q71/datafusion:parquet 21996025 23787467 0.92
tpcds_q72/datafusion:parquet 616099574 644706014 0.96
tpcds_q73/datafusion:parquet 20629578 20988740 0.98
tpcds_q74/datafusion:parquet 86840802 87518227 0.99
tpcds_q75/datafusion:parquet 103565395 108679547 0.95
tpcds_q76/datafusion:parquet 29651966 30737163 0.96
tpcds_q77/datafusion:parquet 39548684 42288054 0.94
tpcds_q78/datafusion:parquet 115762307 123339081 0.94
tpcds_q79/datafusion:parquet 26370022 28344220 0.93
tpcds_q80/datafusion:parquet 83323109 86131581 0.97
tpcds_q81/datafusion:parquet 32880630 33487481 0.98
tpcds_q82/datafusion:parquet 19353859 19967348 0.97
tpcds_q83/datafusion:parquet 36834212 38571746 0.95
tpcds_q84/datafusion:parquet 39184767 41200568 0.95
tpcds_q85/datafusion:parquet 155793712 155344233 1.00
tpcds_q86/datafusion:parquet 15797392 16431876 0.96
tpcds_q87/datafusion:parquet 41504455 44240105 0.94
tpcds_q88/datafusion:parquet 60524487 60534730 1.00
tpcds_q89/datafusion:parquet 22579081 21771520 1.04
tpcds_q90/datafusion:parquet 14949920 15479405 0.97
tpcds_q91/datafusion:parquet 59555877 59671759 1.00
tpcds_q92/datafusion:parquet 17404587 18440002 0.94
tpcds_q93/datafusion:parquet 34058267 33098557 1.03
tpcds_q94/datafusion:parquet 20579111 20181653 1.02
tpcds_q95/datafusion:parquet 61390324 61500474 1.00
tpcds_q96/datafusion:parquet 12268915 12747408 0.96
tpcds_q97/datafusion:parquet 32274987 32333006 1.00
tpcds_q98/datafusion:parquet 21787315 23291827 0.94
tpcds_q99/datafusion:parquet 🚀 26775410 31214175 0.86
duckdb / vortex-file-compressed (0.991x ➖, 3↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24519306 25533160 0.96
tpcds_q02/duckdb:vortex-file-compressed 36937960 36846924 1.00
tpcds_q03/duckdb:vortex-file-compressed 23114915 22788308 1.01
tpcds_q04/duckdb:vortex-file-compressed 100253205 97207615 1.03
tpcds_q05/duckdb:vortex-file-compressed 34581070 36111924 0.96
tpcds_q06/duckdb:vortex-file-compressed 34182027 34955705 0.98
tpcds_q07/duckdb:vortex-file-compressed 22184304 22428134 0.99
tpcds_q08/duckdb:vortex-file-compressed 🚨 83551455 30408370 2.75
tpcds_q09/duckdb:vortex-file-compressed 15548626 16340042 0.95
tpcds_q10/duckdb:vortex-file-compressed 38395320 38732268 0.99
tpcds_q11/duckdb:vortex-file-compressed 68279018 67835574 1.01
tpcds_q12/duckdb:vortex-file-compressed 16079444 17190724 0.94
tpcds_q13/duckdb:vortex-file-compressed 31757649 33582969 0.95
tpcds_q14/duckdb:vortex-file-compressed 98847528 101517548 0.97
tpcds_q15/duckdb:vortex-file-compressed 27382961 29525789 0.93
tpcds_q16/duckdb:vortex-file-compressed 🚀 24994586 28142417 0.89
tpcds_q17/duckdb:vortex-file-compressed 44667999 46835260 0.95
tpcds_q18/duckdb:vortex-file-compressed 39155866 38875717 1.01
tpcds_q19/duckdb:vortex-file-compressed 32944637 35618000 0.92
tpcds_q20/duckdb:vortex-file-compressed 17225898 18075422 0.95
tpcds_q21/duckdb:vortex-file-compressed 16532967 16755842 0.99
tpcds_q22/duckdb:vortex-file-compressed 75768478 77812172 0.97
tpcds_q23/duckdb:vortex-file-compressed 95309415 96230763 0.99
tpcds_q24/duckdb:vortex-file-compressed 48180845 50822317 0.95
tpcds_q25/duckdb:vortex-file-compressed 41588957 43096914 0.97
tpcds_q26/duckdb:vortex-file-compressed 🚀 18450701 20930512 0.88
tpcds_q27/duckdb:vortex-file-compressed 22534377 23249729 0.97
tpcds_q28/duckdb:vortex-file-compressed 12890828 12769104 1.01
tpcds_q29/duckdb:vortex-file-compressed 41788642 43872226 0.95
tpcds_q30/duckdb:vortex-file-compressed 25038137 26204563 0.96
tpcds_q31/duckdb:vortex-file-compressed 27898642 29455301 0.95
tpcds_q32/duckdb:vortex-file-compressed 13848220 14781028 0.94
tpcds_q33/duckdb:vortex-file-compressed 24029241 23965448 1.00
tpcds_q34/duckdb:vortex-file-compressed 26363719 27193147 0.97
tpcds_q35/duckdb:vortex-file-compressed 66091849 65537134 1.01
tpcds_q36/duckdb:vortex-file-compressed 24403324 24178754 1.01
tpcds_q37/duckdb:vortex-file-compressed 20131389 20839975 0.97
tpcds_q38/duckdb:vortex-file-compressed 37716596 38909423 0.97
tpcds_q39/duckdb:vortex-file-compressed 35967345 35960456 1.00
tpcds_q40/duckdb:vortex-file-compressed 21132730 21181739 1.00
tpcds_q41/duckdb:vortex-file-compressed 10740927 10706318 1.00
tpcds_q42/duckdb:vortex-file-compressed 13645494 13443269 1.02
tpcds_q43/duckdb:vortex-file-compressed 22695172 22051304 1.03
tpcds_q44/duckdb:vortex-file-compressed 20529473 21491136 0.96
tpcds_q45/duckdb:vortex-file-compressed 31052990 31486665 0.99
tpcds_q46/duckdb:vortex-file-compressed 31211838 31099360 1.00
tpcds_q47/duckdb:vortex-file-compressed 55676895 54491559 1.02
tpcds_q48/duckdb:vortex-file-compressed 30410863 31777503 0.96
tpcds_q49/duckdb:vortex-file-compressed 35069871 32513480 1.08
tpcds_q50/duckdb:vortex-file-compressed 25303763 26082121 0.97
tpcds_q51/duckdb:vortex-file-compressed 108840401 107826599 1.01
tpcds_q52/duckdb:vortex-file-compressed 13207874 13583840 0.97
tpcds_q53/duckdb:vortex-file-compressed 22033762 23130261 0.95
tpcds_q54/duckdb:vortex-file-compressed 31223957 30279746 1.03
tpcds_q55/duckdb:vortex-file-compressed 13089435 13295567 0.98
tpcds_q56/duckdb:vortex-file-compressed 25903181 26497606 0.98
tpcds_q57/duckdb:vortex-file-compressed 42435243 43284679 0.98
tpcds_q58/duckdb:vortex-file-compressed 29523913 30470573 0.97
tpcds_q59/duckdb:vortex-file-compressed 56922325 57233449 0.99
tpcds_q60/duckdb:vortex-file-compressed 26640184 27582891 0.97
tpcds_q61/duckdb:vortex-file-compressed 30837948 31591753 0.98
tpcds_q62/duckdb:vortex-file-compressed 🚀 15807964 17665392 0.89
tpcds_q63/duckdb:vortex-file-compressed 22355613 22771148 0.98
tpcds_q64/duckdb:vortex-file-compressed 96286711 99233945 0.97
tpcds_q65/duckdb:vortex-file-compressed 23250503 23431429 0.99
tpcds_q66/duckdb:vortex-file-compressed 31757537 31424192 1.01
tpcds_q67/duckdb:vortex-file-compressed 141370331 144125918 0.98
tpcds_q68/duckdb:vortex-file-compressed 31436669 31857816 0.99
tpcds_q69/duckdb:vortex-file-compressed 41107110 41789425 0.98
tpcds_q70/duckdb:vortex-file-compressed 37633972 36936942 1.02
tpcds_q71/duckdb:vortex-file-compressed 21972719 22274942 0.99
tpcds_q72/duckdb:vortex-file-compressed 170498182 171635564 0.99
tpcds_q73/duckdb:vortex-file-compressed 25464639 25911655 0.98
tpcds_q74/duckdb:vortex-file-compressed 43580296 42795835 1.02
tpcds_q75/duckdb:vortex-file-compressed 48839035 51474493 0.95
tpcds_q76/duckdb:vortex-file-compressed 22924996 21217374 1.08
tpcds_q77/duckdb:vortex-file-compressed 25397222 27233115 0.93
tpcds_q78/duckdb:vortex-file-compressed 78338138 80488427 0.97
tpcds_q79/duckdb:vortex-file-compressed 24559210 25676176 0.96
tpcds_q80/duckdb:vortex-file-compressed 49990082 51607517 0.97
tpcds_q81/duckdb:vortex-file-compressed 29629652 31131832 0.95
tpcds_q82/duckdb:vortex-file-compressed 46302727 47237017 0.98
tpcds_q83/duckdb:vortex-file-compressed 28377783 28235130 1.01
tpcds_q84/duckdb:vortex-file-compressed 17346165 17597153 0.99
tpcds_q85/duckdb:vortex-file-compressed 42510719 42851400 0.99
tpcds_q86/duckdb:vortex-file-compressed 16812621 17192478 0.98
tpcds_q87/duckdb:vortex-file-compressed 43790638 41790446 1.05
tpcds_q88/duckdb:vortex-file-compressed 53455776 53350088 1.00
tpcds_q89/duckdb:vortex-file-compressed 22388836 22680983 0.99
tpcds_q90/duckdb:vortex-file-compressed 10494475 11181339 0.94
tpcds_q91/duckdb:vortex-file-compressed 22372103 24521020 0.91
tpcds_q92/duckdb:vortex-file-compressed 21714905 21718440 1.00
tpcds_q93/duckdb:vortex-file-compressed 30254825 31347935 0.97
tpcds_q94/duckdb:vortex-file-compressed 22482324 22761363 0.99
tpcds_q95/duckdb:vortex-file-compressed 162197676 156392670 1.04
tpcds_q96/duckdb:vortex-file-compressed 12753201 12651768 1.01
tpcds_q97/duckdb:vortex-file-compressed 40201598 40386952 1.00
tpcds_q98/duckdb:vortex-file-compressed 21347020 19708645 1.08
tpcds_q99/duckdb:vortex-file-compressed 23119388 23385075 0.99
duckdb / vortex-compact (0.991x ➖, 2↑ 2↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26432539 26393188 1.00
tpcds_q02/duckdb:vortex-compact 39100224 41637915 0.94
tpcds_q03/duckdb:vortex-compact 49785335 49750760 1.00
tpcds_q04/duckdb:vortex-compact 106741718 111695396 0.96
tpcds_q05/duckdb:vortex-compact 46139006 43308855 1.07
tpcds_q06/duckdb:vortex-compact 40749712 40140992 1.02
tpcds_q07/duckdb:vortex-compact 35292495 35952211 0.98
tpcds_q08/duckdb:vortex-compact 🚨 98435848 41444735 2.38
tpcds_q09/duckdb:vortex-compact 19692184 20891976 0.94
tpcds_q10/duckdb:vortex-compact 53539185 54010472 0.99
tpcds_q11/duckdb:vortex-compact 77259050 76839610 1.01
tpcds_q12/duckdb:vortex-compact 22657724 22913112 0.99
tpcds_q13/duckdb:vortex-compact 53728712 54276101 0.99
tpcds_q14/duckdb:vortex-compact 119894781 121386127 0.99
tpcds_q15/duckdb:vortex-compact 30211293 31591553 0.96
tpcds_q16/duckdb:vortex-compact 28958518 29217730 0.99
tpcds_q17/duckdb:vortex-compact 57578695 57489535 1.00
tpcds_q18/duckdb:vortex-compact 52701338 51740130 1.02
tpcds_q19/duckdb:vortex-compact 44311786 46518739 0.95
tpcds_q20/duckdb:vortex-compact 22234863 22576176 0.98
tpcds_q21/duckdb:vortex-compact 18345438 18933024 0.97
tpcds_q22/duckdb:vortex-compact 85199617 83002660 1.03
tpcds_q23/duckdb:vortex-compact 109338448 113851068 0.96
tpcds_q24/duckdb:vortex-compact 58708976 59964812 0.98
tpcds_q25/duckdb:vortex-compact 56731568 56497044 1.00
tpcds_q26/duckdb:vortex-compact 30360159 32766589 0.93
tpcds_q27/duckdb:vortex-compact 36572243 37396347 0.98
tpcds_q28/duckdb:vortex-compact 35466675 35954260 0.99
tpcds_q29/duckdb:vortex-compact 55252592 55761075 0.99
tpcds_q30/duckdb:vortex-compact 31317223 31426997 1.00
tpcds_q31/duckdb:vortex-compact 🚀 35554970 40547054 0.88
tpcds_q32/duckdb:vortex-compact 21797720 22906133 0.95
tpcds_q33/duckdb:vortex-compact 34729647 32685993 1.06
tpcds_q34/duckdb:vortex-compact 31037002 31042517 1.00
tpcds_q35/duckdb:vortex-compact 79599049 78568681 1.01
tpcds_q36/duckdb:vortex-compact 36107118 37176189 0.97
tpcds_q37/duckdb:vortex-compact 24315368 25897532 0.94
tpcds_q38/duckdb:vortex-compact 42783315 44745888 0.96
tpcds_q39/duckdb:vortex-compact 42021963 40960169 1.03
tpcds_q40/duckdb:vortex-compact 25412383 25922018 0.98
tpcds_q41/duckdb:vortex-compact 12367618 12573296 0.98
tpcds_q42/duckdb:vortex-compact 20120135 19841713 1.01
tpcds_q43/duckdb:vortex-compact 31345409 32296156 0.97
tpcds_q44/duckdb:vortex-compact 30161399 29431298 1.02
tpcds_q45/duckdb:vortex-compact 36665545 37295625 0.98
tpcds_q46/duckdb:vortex-compact 46374349 47707011 0.97
tpcds_q47/duckdb:vortex-compact 63512492 64299154 0.99
tpcds_q48/duckdb:vortex-compact 46015078 46114335 1.00
tpcds_q49/duckdb:vortex-compact 48433060 51025898 0.95
tpcds_q50/duckdb:vortex-compact 39154386 39047620 1.00
tpcds_q51/duckdb:vortex-compact 113503905 115432818 0.98
tpcds_q52/duckdb:vortex-compact 20123760 19862391 1.01
tpcds_q53/duckdb:vortex-compact 32635742 33399810 0.98
tpcds_q54/duckdb:vortex-compact 37401826 39285729 0.95
tpcds_q55/duckdb:vortex-compact 19261212 20506398 0.94
tpcds_q56/duckdb:vortex-compact 34453037 33723802 1.02
tpcds_q57/duckdb:vortex-compact 45632210 46983896 0.97
tpcds_q58/duckdb:vortex-compact 36132368 38109725 0.95
tpcds_q59/duckdb:vortex-compact 66877971 69303850 0.96
tpcds_q60/duckdb:vortex-compact 35732025 35070771 1.02
tpcds_q61/duckdb:vortex-compact 54968586 55320423 0.99
tpcds_q62/duckdb:vortex-compact 22525536 22612739 1.00
tpcds_q63/duckdb:vortex-compact 33684022 32706810 1.03
tpcds_q64/duckdb:vortex-compact 127857175 130890719 0.98
tpcds_q65/duckdb:vortex-compact 31094652 31844881 0.98
tpcds_q66/duckdb:vortex-compact 34337000 37037214 0.93
tpcds_q67/duckdb:vortex-compact 159597358 155933377 1.02
tpcds_q68/duckdb:vortex-compact 45813351 48669529 0.94
tpcds_q69/duckdb:vortex-compact 55777869 57289312 0.97
tpcds_q70/duckdb:vortex-compact 59437063 58731960 1.01
tpcds_q71/duckdb:vortex-compact 29578477 32338952 0.91
tpcds_q72/duckdb:vortex-compact 192413282 189623978 1.01
tpcds_q73/duckdb:vortex-compact 30264719 29816345 1.02
tpcds_q74/duckdb:vortex-compact 48002227 49571830 0.97
tpcds_q75/duckdb:vortex-compact 63793752 63886209 1.00
tpcds_q76/duckdb:vortex-compact 30583770 32804017 0.93
tpcds_q77/duckdb:vortex-compact 36744450 37578182 0.98
tpcds_q78/duckdb:vortex-compact 90773378 87373765 1.04
tpcds_q79/duckdb:vortex-compact 40453512 41270440 0.98
tpcds_q80/duckdb:vortex-compact 72566184 72980240 0.99
tpcds_q81/duckdb:vortex-compact 34576287 35811044 0.97
tpcds_q82/duckdb:vortex-compact 52547310 52458152 1.00
tpcds_q83/duckdb:vortex-compact 35981310 38122190 0.94
tpcds_q84/duckdb:vortex-compact 🚀 21349288 23987244 0.89
tpcds_q85/duckdb:vortex-compact 54761026 56793495 0.96
tpcds_q86/duckdb:vortex-compact 20801409 21553358 0.97
tpcds_q87/duckdb:vortex-compact 45997856 46715821 0.98
tpcds_q88/duckdb:vortex-compact 78208432 77756279 1.01
tpcds_q89/duckdb:vortex-compact 32403571 33954186 0.95
tpcds_q90/duckdb:vortex-compact 11760276 12512067 0.94
tpcds_q91/duckdb:vortex-compact 42026473 43463609 0.97
tpcds_q92/duckdb:vortex-compact 🚨 49595298 43292687 1.15
tpcds_q93/duckdb:vortex-compact 32648460 34395591 0.95
tpcds_q94/duckdb:vortex-compact 27763932 28560348 0.97
tpcds_q95/duckdb:vortex-compact 168811767 164039353 1.03
tpcds_q96/duckdb:vortex-compact 16577017 16897198 0.98
tpcds_q97/duckdb:vortex-compact 45371997 44162140 1.03
tpcds_q98/duckdb:vortex-compact 28216765 28205437 1.00
tpcds_q99/duckdb:vortex-compact 26991080 29085734 0.93
duckdb / parquet (0.991x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28936206 31996628 0.90
tpcds_q02/duckdb:parquet 23880715 23683874 1.01
tpcds_q03/duckdb:parquet 12837636 13353271 0.96
tpcds_q04/duckdb:parquet 166667667 174884756 0.95
tpcds_q05/duckdb:parquet 34587208 33212350 1.04
tpcds_q06/duckdb:parquet 32967006 34824598 0.95
tpcds_q07/duckdb:parquet 24660031 24793783 0.99
tpcds_q08/duckdb:parquet 30131679 30071005 1.00
tpcds_q09/duckdb:parquet 45011776 44499241 1.01
tpcds_q10/duckdb:parquet 38042527 38981775 0.98
tpcds_q11/duckdb:parquet 94412023 97168611 0.97
tpcds_q12/duckdb:parquet 17482932 17462419 1.00
tpcds_q13/duckdb:parquet 35773431 35654082 1.00
tpcds_q14/duckdb:parquet 105753059 102220070 1.03
tpcds_q15/duckdb:parquet 31309035 31672914 0.99
tpcds_q16/duckdb:parquet 22989558 23281344 0.99
tpcds_q17/duckdb:parquet 38948204 41864666 0.93
tpcds_q18/duckdb:parquet 49119411 49870429 0.98
tpcds_q19/duckdb:parquet 31817730 32392643 0.98
tpcds_q20/duckdb:parquet 19273551 19380960 0.99
tpcds_q21/duckdb:parquet 11942503 12263016 0.97
tpcds_q22/duckdb:parquet 74830053 68082650 1.10
tpcds_q23/duckdb:parquet 81282560 81262576 1.00
tpcds_q24/duckdb:parquet 47492541 48504633 0.98
tpcds_q25/duckdb:parquet 36443923 36925989 0.99
tpcds_q26/duckdb:parquet 39026724 41768297 0.93
tpcds_q27/duckdb:parquet 53837188 53883756 1.00
tpcds_q28/duckdb:parquet 42949813 43035720 1.00
tpcds_q29/duckdb:parquet 42820932 39841283 1.07
tpcds_q30/duckdb:parquet 38180984 38833642 0.98
tpcds_q31/duckdb:parquet 27714413 27724558 1.00
tpcds_q32/duckdb:parquet 12800953 13073417 0.98
tpcds_q33/duckdb:parquet 23879587 24710422 0.97
tpcds_q34/duckdb:parquet 23162392 23104336 1.00
tpcds_q35/duckdb:parquet 61283572 63639027 0.96
tpcds_q36/duckdb:parquet 22597818 23190770 0.97
tpcds_q37/duckdb:parquet 14664692 14866365 0.99
tpcds_q38/duckdb:parquet 37431886 37847305 0.99
tpcds_q39/duckdb:parquet 32420505 32962841 0.98
tpcds_q40/duckdb:parquet 20013095 20653563 0.97
tpcds_q41/duckdb:parquet 9109246 9427668 0.97
tpcds_q42/duckdb:parquet 12629424 12634900 1.00
tpcds_q43/duckdb:parquet 19871565 18289029 1.09
tpcds_q44/duckdb:parquet 25978420 27002960 0.96
tpcds_q45/duckdb:parquet 29932349 29916534 1.00
tpcds_q46/duckdb:parquet 49129385 49404072 0.99
tpcds_q47/duckdb:parquet 51143523 51346230 1.00
tpcds_q48/duckdb:parquet 32766716 32570136 1.01
tpcds_q49/duckdb:parquet 28980447 29584555 0.98
tpcds_q50/duckdb:parquet 26831919 26499880 1.01
tpcds_q51/duckdb:parquet 106128264 105574482 1.01
tpcds_q52/duckdb:parquet 14390400 13222965 1.09
tpcds_q53/duckdb:parquet 19212111 19419226 0.99
tpcds_q54/duckdb:parquet 28751846 29496288 0.97
tpcds_q55/duckdb:parquet 13261515 12421439 1.07
tpcds_q56/duckdb:parquet 23471802 24684509 0.95
tpcds_q57/duckdb:parquet 38839788 39136653 0.99
tpcds_q58/duckdb:parquet 25862346 26495978 0.98
tpcds_q59/duckdb:parquet 36547288 36664815 1.00
tpcds_q60/duckdb:parquet 25400429 26329027 0.96
tpcds_q61/duckdb:parquet 33616082 34785247 0.97
tpcds_q62/duckdb:parquet 12673309 13019985 0.97
tpcds_q63/duckdb:parquet 17961075 18455464 0.97
tpcds_q64/duckdb:parquet 78228466 76365878 1.02
tpcds_q65/duckdb:parquet 22791962 22666660 1.01
tpcds_q66/duckdb:parquet 🚨 33292399 30081033 1.11
tpcds_q67/duckdb:parquet 137861676 139142145 0.99
tpcds_q68/duckdb:parquet 39420087 39341825 1.00
tpcds_q69/duckdb:parquet 38840593 39002237 1.00
tpcds_q70/duckdb:parquet 22886888 23399814 0.98
tpcds_q71/duckdb:parquet 22912762 23553360 0.97
tpcds_q72/duckdb:parquet 167168315 169606578 0.99
tpcds_q73/duckdb:parquet 20041354 21059101 0.95
tpcds_q74/duckdb:parquet 126900272 129296253 0.98
tpcds_q75/duckdb:parquet 59112974 60279328 0.98
tpcds_q76/duckdb:parquet 21924862 22141721 0.99
tpcds_q77/duckdb:parquet 25444830 25600869 0.99
tpcds_q78/duckdb:parquet 78324545 78392998 1.00
tpcds_q79/duckdb:parquet 29739712 30613715 0.97
tpcds_q80/duckdb:parquet 47050919 44540824 1.06
tpcds_q81/duckdb:parquet 35704355 35473657 1.01
tpcds_q82/duckdb:parquet 17233246 17999762 0.96
tpcds_q83/duckdb:parquet 18942006 19397081 0.98
tpcds_q84/duckdb:parquet 20876491 20972080 1.00
tpcds_q85/duckdb:parquet 41797648 42816438 0.98
tpcds_q86/duckdb:parquet 13959678 14104247 0.99
tpcds_q87/duckdb:parquet 39870296 40485963 0.98
tpcds_q88/duckdb:parquet 54067502 54622332 0.99
tpcds_q89/duckdb:parquet 21659416 22137156 0.98
tpcds_q90/duckdb:parquet 8464536 8543907 0.99
tpcds_q91/duckdb:parquet 26312459 25973587 1.01
tpcds_q92/duckdb:parquet 13496147 13771296 0.98
tpcds_q93/duckdb:parquet 32426261 33753686 0.96
tpcds_q94/duckdb:parquet 18234722 18673869 0.98
tpcds_q95/duckdb:parquet 147115889 148638538 0.99
tpcds_q96/duckdb:parquet 10852235 10641100 1.02
tpcds_q97/duckdb:parquet 39078396 40092920 0.97
tpcds_q98/duckdb:parquet 24513948 25319243 0.97
tpcds_q99/duckdb:parquet 20535974 20819450 0.99
duckdb / duckdb (0.981x ➖, 4↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21833344 22849798 0.96
tpcds_q02/duckdb:duckdb 20019595 19200731 1.04
tpcds_q03/duckdb:duckdb 10580028 11029264 0.96
tpcds_q04/duckdb:duckdb 180515718 183903849 0.98
tpcds_q05/duckdb:duckdb 🚀 21230325 24461136 0.87
tpcds_q06/duckdb:duckdb 27732779 28550144 0.97
tpcds_q07/duckdb:duckdb 40796545 42119185 0.97
tpcds_q08/duckdb:duckdb 121450737 121268938 1.00
tpcds_q09/duckdb:duckdb 20627804 20962725 0.98
tpcds_q10/duckdb:duckdb 27786288 28661245 0.97
tpcds_q11/duckdb:duckdb 92972445 91741622 1.01
tpcds_q12/duckdb:duckdb 14279321 14571718 0.98
tpcds_q13/duckdb:duckdb 26036472 26977122 0.97
tpcds_q14/duckdb:duckdb 94244100 92872842 1.01
tpcds_q15/duckdb:duckdb 25335372 25895980 0.98
tpcds_q16/duckdb:duckdb 20413549 19728310 1.03
tpcds_q17/duckdb:duckdb 24798799 25067735 0.99
tpcds_q18/duckdb:duckdb 48587003 48706688 1.00
tpcds_q19/duckdb:duckdb 20709365 19880809 1.04
tpcds_q20/duckdb:duckdb 14546137 14841128 0.98
tpcds_q21/duckdb:duckdb 🚀 7551480 9074590 0.83
tpcds_q22/duckdb:duckdb 64848409 64298885 1.01
tpcds_q23/duckdb:duckdb 81275874 76460011 1.06
tpcds_q24/duckdb:duckdb 25347642 26361458 0.96
tpcds_q25/duckdb:duckdb 18604599 19775402 0.94
tpcds_q26/duckdb:duckdb 29264543 29378806 1.00
tpcds_q27/duckdb:duckdb 41694131 42474668 0.98
tpcds_q28/duckdb:duckdb 26395504 25081685 1.05
tpcds_q29/duckdb:duckdb 23523774 23855137 0.99
tpcds_q30/duckdb:duckdb 31243113 31761397 0.98
tpcds_q31/duckdb:duckdb 52426789 54795807 0.96
tpcds_q32/duckdb:duckdb 9002601 9333373 0.96
tpcds_q33/duckdb:duckdb 15925943 16613789 0.96
tpcds_q34/duckdb:duckdb 18852469 19030966 0.99
tpcds_q35/duckdb:duckdb 38411886 38565039 1.00
tpcds_q36/duckdb:duckdb 70947866 74434110 0.95
tpcds_q37/duckdb:duckdb 8804847 9507837 0.93
tpcds_q38/duckdb:duckdb 33965617 33927067 1.00
tpcds_q39/duckdb:duckdb 28398226 29055496 0.98
tpcds_q40/duckdb:duckdb 15214052 15664700 0.97
tpcds_q41/duckdb:duckdb 9517290 9883070 0.96
tpcds_q42/duckdb:duckdb 8615203 9454173 0.91
tpcds_q43/duckdb:duckdb 14426657 15320400 0.94
tpcds_q44/duckdb:duckdb 15143208 15783321 0.96
tpcds_q45/duckdb:duckdb 18787377 19585152 0.96
tpcds_q46/duckdb:duckdb 38969605 39895267 0.98
tpcds_q47/duckdb:duckdb 47311225 48133650 0.98
tpcds_q48/duckdb:duckdb 25545642 24674274 1.04
tpcds_q49/duckdb:duckdb 21996946 20765341 1.06
tpcds_q50/duckdb:duckdb 16209305 16877567 0.96
tpcds_q51/duckdb:duckdb 99885045 102999744 0.97
tpcds_q52/duckdb:duckdb 10387488 9777157 1.06
tpcds_q53/duckdb:duckdb 17868419 17619422 1.01
tpcds_q54/duckdb:duckdb 19538199 19808849 0.99
tpcds_q55/duckdb:duckdb 10300147 10008830 1.03
tpcds_q56/duckdb:duckdb 16583519 16694192 0.99
tpcds_q57/duckdb:duckdb 37755615 37480221 1.01
tpcds_q58/duckdb:duckdb 16719641 16776817 1.00
tpcds_q59/duckdb:duckdb 37170977 37830330 0.98
tpcds_q60/duckdb:duckdb 18289339 18504812 0.99
tpcds_q61/duckdb:duckdb 16393208 16977333 0.97
tpcds_q62/duckdb:duckdb 10199813 10385104 0.98
tpcds_q63/duckdb:duckdb 17308263 17196803 1.01
tpcds_q64/duckdb:duckdb 60177099 59690437 1.01
tpcds_q65/duckdb:duckdb 36838957 37827127 0.97
tpcds_q66/duckdb:duckdb 26950093 27450370 0.98
tpcds_q67/duckdb:duckdb 132879554 135607361 0.98
tpcds_q68/duckdb:duckdb 27081178 27072271 1.00
tpcds_q69/duckdb:duckdb 27922268 28555129 0.98
tpcds_q70/duckdb:duckdb 17962093 17593201 1.02
tpcds_q71/duckdb:duckdb 16325462 16933511 0.96
tpcds_q72/duckdb:duckdb 45884681 47543334 0.97
tpcds_q73/duckdb:duckdb 14053323 13355549 1.05
tpcds_q74/duckdb:duckdb 147058423 147879065 0.99
tpcds_q75/duckdb:duckdb 47411077 47729679 0.99
tpcds_q76/duckdb:duckdb 14737674 15081203 0.98
tpcds_q77/duckdb:duckdb 15401135 16125866 0.96
tpcds_q78/duckdb:duckdb 67206178 68011734 0.99
tpcds_q79/duckdb:duckdb 20534243 20516695 1.00
tpcds_q80/duckdb:duckdb 🚀 31695316 36102906 0.88
tpcds_q81/duckdb:duckdb 40738257 40120958 1.02
tpcds_q82/duckdb:duckdb 10338403 11407243 0.91
tpcds_q83/duckdb:duckdb 11264539 11511658 0.98
tpcds_q84/duckdb:duckdb 14945833 15450034 0.97
tpcds_q85/duckdb:duckdb 26976688 27077985 1.00
tpcds_q86/duckdb:duckdb 12466814 12779389 0.98
tpcds_q87/duckdb:duckdb 38246174 36806827 1.04
tpcds_q88/duckdb:duckdb 29948181 29652734 1.01
tpcds_q89/duckdb:duckdb 21745906 22688881 0.96
tpcds_q90/duckdb:duckdb 6737938 6838972 0.99
tpcds_q91/duckdb:duckdb 15069128 15281562 0.99
tpcds_q92/duckdb:duckdb 10540183 10570423 1.00
tpcds_q93/duckdb:duckdb 24168070 25159961 0.96
tpcds_q94/duckdb:duckdb 14935724 14939868 1.00
tpcds_q95/duckdb:duckdb 🚀 112725128 132726639 0.85
tpcds_q96/duckdb:duckdb 6166738 6210322 0.99
tpcds_q97/duckdb:duckdb 33023105 33791839 0.98
tpcds_q98/duckdb:duckdb 21175990 20805388 1.02
tpcds_q99/duckdb:duckdb 17088751 17554392 0.97
File Size Changes (6 files changed, +0.0% overall, 3↑ 3↓)
File Scale Format Base HEAD Change %
date_dim.vortex 1.0 vortex-file-compressed 964.11 KB 1.03 MB +91.28 KB +9.5%
catalog_page.vortex 1.0 vortex-file-compressed 571.31 KB 572.19 KB +896 B +0.2%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB +1.96 KB +0.1%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.26 MB 2.73 KB -0.1%
customer_address.vortex 1.0 vortex-file-compressed 826.43 KB 825.62 KB 832 B -0.1%
time_dim.vortex 1.0 vortex-file-compressed 380.09 KB 379.57 KB 528 B -0.1%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (0.0%)
  • vortex-file-compressed: 271.76 MB → 271.85 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.2% -8.4% +10.4% +18.4% ➖ noise
1 datafusion:vortex-file-compressed -4.9% -8.4% +3.7% +20.3% ➖ noise
1 duckdb:duckdb -4.4% -8.4% +4.3% +18.8% ➖ noise
1 duckdb:vortex-compact +0.1% -8.4% +9.3% +21.1% ➖ noise
1 duckdb:vortex-file-compressed -4.0% -8.4% +4.8% +25.1% ➖ noise
2 datafusion:vortex-compact +3.4% -2.3% +5.9% +13.9% ➖ noise
2 datafusion:vortex-file-compressed -2.6% -2.3% -0.3% +10.0% ➖ noise
2 duckdb:duckdb +4.3% -2.3% +6.8% +10.0% ➖ noise
2 duckdb:vortex-compact -6.1% -2.3% -3.9% +26.9% ➖ noise
2 duckdb:vortex-file-compressed +0.2% -2.3% +2.6% +18.2% ➖ noise
3 datafusion:vortex-compact -4.2% -3.3% -0.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -3.2% -3.3% +0.1% +10.0% ➖ noise
3 duckdb:duckdb -4.1% -3.3% -0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +0.1% -3.3% +3.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.4% -3.3% +4.9% +10.0% ➖ noise
4 datafusion:vortex-compact -1.4% -5.4% +4.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -5.0% -5.4% +0.4% +10.0% ➖ noise
4 duckdb:duckdb -1.8% -5.4% +3.7% +10.0% ➖ noise
4 duckdb:vortex-compact -4.4% -5.4% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.1% -5.4% +9.0% +12.6% ➖ noise
5 datafusion:vortex-compact -2.3% -2.5% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -7.9% -2.5% -5.5% +10.0% ➖ noise
5 duckdb:duckdb -13.2% -2.5% -10.9% +15.8% ➖ noise
5 duckdb:vortex-compact +6.5% -2.5% +9.3% +14.5% ➖ noise
5 duckdb:vortex-file-compressed -4.2% -2.5% -1.7% +14.1% ➖ noise
6 datafusion:vortex-compact +0.9% -2.2% +3.2% +10.9% ➖ noise
6 datafusion:vortex-file-compressed -7.0% -2.2% -4.9% +13.0% ➖ noise
6 duckdb:duckdb -2.9% -2.2% -0.7% +10.0% ➖ noise
6 duckdb:vortex-compact +1.5% -2.2% +3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -2.2% +0.0% +10.0% ➖ noise
7 datafusion:vortex-compact -4.6% +0.5% -5.0% +16.4% ➖ noise
7 datafusion:vortex-file-compressed -7.0% +0.5% -7.4% +10.0% ➖ noise
7 duckdb:duckdb -3.1% +0.5% -3.6% +10.0% ➖ noise
7 duckdb:vortex-compact -1.8% +0.5% -2.3% +11.7% ➖ noise
7 duckdb:vortex-file-compressed -1.1% +0.5% -1.6% +10.0% ➖ noise
8 datafusion:vortex-compact +3.5% -2.4% +6.1% +19.5% ➖ noise
8 datafusion:vortex-file-compressed -6.0% -2.4% -3.7% +10.0% ➖ noise
8 duckdb:duckdb +0.1% -2.4% +2.6% +10.0% ➖ noise
8 duckdb:vortex-compact +137.5% -2.4% +143.3% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +174.8% -2.4% +181.5% +22.6% 🚨 regression
9 datafusion:vortex-compact +0.3% -0.8% +1.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -7.3% -0.8% -6.6% +10.1% ➖ noise
9 duckdb:duckdb -1.6% -0.8% -0.8% +10.0% ➖ noise
9 duckdb:vortex-compact -5.7% -0.8% -5.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.8% -0.8% -4.1% +19.5% ➖ noise
10 datafusion:vortex-compact +0.5% -2.4% +3.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.3% -2.4% +0.2% +10.5% ➖ noise
10 duckdb:duckdb -3.1% -2.4% -0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.9% -2.4% +1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.9% -2.4% +1.6% +10.0% ➖ noise
11 datafusion:vortex-compact -4.8% -4.1% -0.8% +10.1% ➖ noise
11 datafusion:vortex-file-compressed -4.7% -4.1% -0.7% +11.6% ➖ noise
11 duckdb:duckdb +1.3% -4.1% +5.6% +10.0% ➖ noise
11 duckdb:vortex-compact +0.5% -4.1% +4.8% +12.4% ➖ noise
11 duckdb:vortex-file-compressed +0.7% -4.1% +4.9% +11.6% ➖ noise
12 datafusion:vortex-compact +8.8% -3.0% +12.2% +13.6% ➖ noise
12 datafusion:vortex-file-compressed +1.0% -3.0% +4.1% +16.6% ➖ noise
12 duckdb:duckdb -2.0% -3.0% +1.0% +10.0% ➖ noise
12 duckdb:vortex-compact -1.1% -3.0% +1.9% +11.9% ➖ noise
12 duckdb:vortex-file-compressed -6.5% -3.0% -3.6% +33.4% ➖ noise
13 datafusion:vortex-compact -11.5% -1.9% -9.8% +19.1% ➖ noise
13 datafusion:vortex-file-compressed -2.4% -1.9% -0.6% +10.0% ➖ noise
13 duckdb:duckdb -3.5% -1.9% -1.7% +10.0% ➖ noise
13 duckdb:vortex-compact -1.0% -1.9% +0.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.4% -1.9% -3.6% +10.0% ➖ noise
14 datafusion:vortex-compact -4.9% +1.1% -6.0% +10.3% ➖ noise
14 datafusion:vortex-file-compressed -4.8% +1.1% -5.8% +10.0% ➖ noise
14 duckdb:duckdb +1.5% +1.1% +0.3% +10.0% ➖ noise
14 duckdb:vortex-compact -1.2% +1.1% -2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.6% +1.1% -3.7% +10.0% ➖ noise
15 datafusion:vortex-compact -3.2% -4.7% +1.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -5.5% -4.7% -0.8% +24.7% ➖ noise
15 duckdb:duckdb -2.2% -4.7% +2.7% +10.0% ➖ noise
15 duckdb:vortex-compact -4.4% -4.7% +0.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -7.3% -4.7% -2.7% +10.0% ➖ noise
16 datafusion:vortex-compact -3.9% -7.3% +3.8% +12.1% ➖ noise
16 datafusion:vortex-file-compressed -2.1% -7.3% +5.6% +14.3% ➖ noise
16 duckdb:duckdb +3.5% -7.3% +11.7% +13.0% ➖ noise
16 duckdb:vortex-compact -0.9% -7.3% +7.0% +16.7% ➖ noise
16 duckdb:vortex-file-compressed -11.2% -7.3% -4.2% +11.6% ➖ noise
17 datafusion:vortex-compact -3.6% -4.2% +0.6% +12.6% ➖ noise
17 datafusion:vortex-file-compressed -1.5% -4.2% +2.9% +10.0% ➖ noise
17 duckdb:duckdb -1.1% -4.2% +3.3% +10.6% ➖ noise
17 duckdb:vortex-compact +0.2% -4.2% +4.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.6% -4.2% -0.4% +10.0% ➖ noise
18 datafusion:vortex-compact -6.2% -4.6% -1.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.8% -4.6% +0.8% +10.0% ➖ noise
18 duckdb:duckdb -0.2% -4.6% +4.5% +10.0% ➖ noise
18 duckdb:vortex-compact +1.9% -4.6% +6.7% +13.7% ➖ noise
18 duckdb:vortex-file-compressed +0.7% -4.6% +5.5% +20.6% ➖ noise
19 datafusion:vortex-compact -0.7% -2.7% +2.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.5% -2.7% +2.2% +10.0% ➖ noise
19 duckdb:duckdb +4.2% -2.7% +7.1% +10.0% ➖ noise
19 duckdb:vortex-compact -4.7% -2.7% -2.1% +20.4% ➖ noise
19 duckdb:vortex-file-compressed -7.5% -2.7% -4.9% +10.0% ➖ noise
20 datafusion:vortex-compact -4.5% -1.6% -3.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.9% -1.6% -5.5% +31.5% ➖ noise
20 duckdb:duckdb -2.0% -1.6% -0.4% +10.0% ➖ noise
20 duckdb:vortex-compact -1.5% -1.6% +0.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -4.7% -1.6% -3.2% +10.0% ➖ noise
21 datafusion:vortex-compact -7.7% -4.3% -3.6% +21.6% ➖ noise
21 datafusion:vortex-file-compressed -1.9% -4.3% +2.5% +12.4% ➖ noise
21 duckdb:duckdb -16.8% -4.3% -13.1% +19.4% ➖ noise
21 duckdb:vortex-compact -3.1% -4.3% +1.2% +14.2% ➖ noise
21 duckdb:vortex-file-compressed -1.3% -4.3% +3.1% +10.4% ➖ noise
22 datafusion:vortex-compact -2.2% +0.6% -2.8% +16.2% ➖ noise
22 datafusion:vortex-file-compressed -4.5% +0.6% -5.1% +23.0% ➖ noise
22 duckdb:duckdb +0.9% +0.6% +0.2% +10.7% ➖ noise
22 duckdb:vortex-compact +2.6% +0.6% +2.0% +13.2% ➖ noise
22 duckdb:vortex-file-compressed -2.6% +0.6% -3.2% +14.4% ➖ noise
23 datafusion:vortex-compact -4.2% -1.8% -2.5% +11.8% ➖ noise
23 datafusion:vortex-file-compressed -2.7% -1.8% -0.9% +10.0% ➖ noise
23 duckdb:duckdb +6.3% -1.8% +8.2% +12.7% ➖ noise
23 duckdb:vortex-compact -4.0% -1.8% -2.2% +17.5% ➖ noise
23 duckdb:vortex-file-compressed -1.0% -1.8% +0.9% +11.1% ➖ noise
24 datafusion:vortex-compact -2.0% -3.5% +1.6% +19.8% ➖ noise
24 datafusion:vortex-file-compressed -6.1% -3.5% -2.7% +12.6% ➖ noise
24 duckdb:duckdb -3.8% -3.5% -0.4% +10.0% ➖ noise
24 duckdb:vortex-compact -2.1% -3.5% +1.4% +13.4% ➖ noise
24 duckdb:vortex-file-compressed -5.2% -3.5% -1.8% +13.7% ➖ noise
25 datafusion:vortex-compact -8.4% -0.2% -8.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -4.7% -0.2% -4.5% +10.0% ➖ noise
25 duckdb:duckdb -5.9% -0.2% -5.7% +10.0% ➖ noise
25 duckdb:vortex-compact +0.4% -0.2% +0.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -3.5% -0.2% -3.3% +10.0% ➖ noise
26 datafusion:vortex-compact +0.4% -5.0% +5.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +0.6% -5.0% +5.9% +10.0% ➖ noise
26 duckdb:duckdb -0.4% -5.0% +4.9% +10.0% ➖ noise
26 duckdb:vortex-compact -7.3% -5.0% -2.4% +10.4% ➖ noise
26 duckdb:vortex-file-compressed -11.8% -5.0% -7.2% +10.0% ➖ noise
27 datafusion:vortex-compact -1.1% -1.9% +0.9% +10.3% ➖ noise
27 datafusion:vortex-file-compressed +2.2% -1.9% +4.2% +15.6% ➖ noise
27 duckdb:duckdb -1.8% -1.9% +0.1% +10.0% ➖ noise
27 duckdb:vortex-compact -2.2% -1.9% -0.3% +14.4% ➖ noise
27 duckdb:vortex-file-compressed -3.1% -1.9% -1.2% +10.0% ➖ noise
28 datafusion:vortex-compact -3.3% -1.6% -1.6% +12.7% ➖ noise
28 datafusion:vortex-file-compressed +0.7% -1.6% +2.3% +12.6% ➖ noise
28 duckdb:duckdb +5.2% -1.6% +7.0% +10.0% ➖ noise
28 duckdb:vortex-compact -1.4% -1.6% +0.3% +27.5% ➖ noise
28 duckdb:vortex-file-compressed +1.0% -1.6% +2.6% +15.8% ➖ noise
29 datafusion:vortex-compact -3.3% +2.7% -5.8% +18.7% ➖ noise
29 datafusion:vortex-file-compressed +1.4% +2.7% -1.2% +10.0% ➖ noise
29 duckdb:duckdb -1.4% +2.7% -3.9% +10.0% ➖ noise
29 duckdb:vortex-compact -0.9% +2.7% -3.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -4.7% +2.7% -7.2% +24.0% ➖ noise
30 datafusion:vortex-compact -3.1% -4.1% +1.0% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -7.5% -4.1% -3.5% +10.0% ➖ noise
30 duckdb:duckdb -1.6% -4.1% +2.5% +10.0% ➖ noise
30 duckdb:vortex-compact -0.3% -4.1% +3.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -4.5% -4.1% -0.4% +10.0% ➖ noise
31 datafusion:vortex-compact -2.4% -1.8% -0.7% +10.7% ➖ noise
31 datafusion:vortex-file-compressed -5.0% -1.8% -3.3% +15.0% ➖ noise
31 duckdb:duckdb -4.3% -1.8% -2.6% +13.9% ➖ noise
31 duckdb:vortex-compact -12.3% -1.8% -10.7% +29.7% ➖ noise
31 duckdb:vortex-file-compressed -5.3% -1.8% -3.6% +10.2% ➖ noise
32 datafusion:vortex-compact -6.3% -4.0% -2.4% +34.0% ➖ noise
32 datafusion:vortex-file-compressed -1.7% -4.0% +2.4% +10.0% ➖ noise
32 duckdb:duckdb -3.5% -4.0% +0.5% +10.2% ➖ noise
32 duckdb:vortex-compact -4.8% -4.0% -0.8% +10.4% ➖ noise
32 duckdb:vortex-file-compressed -6.3% -4.0% -2.4% +10.0% ➖ noise
33 datafusion:vortex-compact +0.3% -2.4% +2.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.9% -2.4% +1.5% +10.0% ➖ noise
33 duckdb:duckdb -4.1% -2.4% -1.8% +10.0% ➖ noise
33 duckdb:vortex-compact +6.3% -2.4% +8.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +0.3% -2.4% +2.7% +10.0% ➖ noise
34 datafusion:vortex-compact -0.1% +3.3% -3.3% +12.6% ➖ noise
34 datafusion:vortex-file-compressed -6.4% +3.3% -9.3% +22.2% ➖ noise
34 duckdb:duckdb -0.9% +3.3% -4.1% +12.6% ➖ noise
34 duckdb:vortex-compact -0.0% +3.3% -3.2% +11.1% ➖ noise
34 duckdb:vortex-file-compressed -3.1% +3.3% -6.1% +18.6% ➖ noise
35 datafusion:vortex-compact -1.7% -2.4% +0.7% +11.7% ➖ noise
35 datafusion:vortex-file-compressed -2.6% -2.4% -0.2% +10.0% ➖ noise
35 duckdb:duckdb -0.4% -2.4% +2.0% +10.0% ➖ noise
35 duckdb:vortex-compact +1.3% -2.4% +3.8% +12.8% ➖ noise
35 duckdb:vortex-file-compressed +0.8% -2.4% +3.3% +10.0% ➖ noise
36 datafusion:vortex-compact -6.2% -2.6% -3.7% +12.5% ➖ noise
36 datafusion:vortex-file-compressed -4.8% -2.6% -2.2% +12.9% ➖ noise
36 duckdb:duckdb -4.7% -2.6% -2.2% +10.0% ➖ noise
36 duckdb:vortex-compact -2.9% -2.6% -0.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.9% -2.6% +3.6% +10.0% ➖ noise
37 datafusion:vortex-compact -8.8% -1.3% -7.6% +12.6% ➖ noise
37 datafusion:vortex-file-compressed -3.5% -1.3% -2.3% +10.0% ➖ noise
37 duckdb:duckdb -7.4% -1.3% -6.2% +10.0% ➖ noise
37 duckdb:vortex-compact -6.1% -1.3% -4.9% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -3.4% -1.3% -2.2% +14.8% ➖ noise
38 datafusion:vortex-compact -1.7% -3.4% +1.7% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -3.3% -3.4% +0.0% +10.0% ➖ noise
38 duckdb:duckdb +0.1% -3.4% +3.6% +13.6% ➖ noise
38 duckdb:vortex-compact -4.4% -3.4% -1.1% +19.9% ➖ noise
38 duckdb:vortex-file-compressed -3.1% -3.4% +0.3% +10.0% ➖ noise
39 datafusion:vortex-compact -3.1% -2.0% -1.2% +13.8% ➖ noise
39 datafusion:vortex-file-compressed -4.9% -2.0% -2.9% +10.0% ➖ noise
39 duckdb:duckdb -2.3% -2.0% -0.3% +15.4% ➖ noise
39 duckdb:vortex-compact +2.6% -2.0% +4.7% +14.7% ➖ noise
39 duckdb:vortex-file-compressed +0.0% -2.0% +2.1% +10.0% ➖ noise
40 datafusion:vortex-compact -0.0% -3.2% +3.3% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -3.8% -3.2% -0.6% +10.6% ➖ noise
40 duckdb:duckdb -2.9% -3.2% +0.3% +10.0% ➖ noise
40 duckdb:vortex-compact -2.0% -3.2% +1.3% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -0.2% -3.2% +3.1% +10.0% ➖ noise
41 datafusion:vortex-compact -1.8% -8.3% +7.1% +10.6% ➖ noise
41 datafusion:vortex-file-compressed +0.7% -8.3% +9.9% +10.0% ➖ noise
41 duckdb:duckdb -3.7% -8.3% +5.0% +10.0% ➖ noise
41 duckdb:vortex-compact -1.6% -8.3% +7.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.3% -8.3% +9.4% +10.0% ➖ noise
42 datafusion:vortex-compact -1.8% -1.4% -0.4% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +4.0% -1.4% +5.5% +10.0% ➖ noise
42 duckdb:duckdb -8.9% -1.4% -7.6% +16.8% ➖ noise
42 duckdb:vortex-compact +1.4% -1.4% +2.8% +19.5% ➖ noise
42 duckdb:vortex-file-compressed +1.5% -1.4% +2.9% +38.1% ➖ noise
43 datafusion:vortex-compact -9.6% +3.5% -12.7% +10.0% ✅ faster
43 datafusion:vortex-file-compressed -2.0% +3.5% -5.3% +10.0% ➖ noise
43 duckdb:duckdb -5.8% +3.5% -9.1% +10.4% ➖ noise
43 duckdb:vortex-compact -2.9% +3.5% -6.3% +13.6% ➖ noise
43 duckdb:vortex-file-compressed +2.9% +3.5% -0.6% +16.2% ➖ noise
44 datafusion:vortex-compact -5.8% -4.8% -1.1% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.4% -4.8% -0.6% +13.8% ➖ noise
44 duckdb:duckdb -4.1% -4.8% +0.8% +10.9% ➖ noise
44 duckdb:vortex-compact +2.5% -4.8% +7.7% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -4.5% -4.8% +0.4% +10.0% ➖ noise
45 datafusion:vortex-compact +2.8% -2.5% +5.5% +17.3% ➖ noise
45 datafusion:vortex-file-compressed -1.7% -2.5% +0.9% +10.0% ➖ noise
45 duckdb:duckdb -4.1% -2.5% -1.6% +10.0% ➖ noise
45 duckdb:vortex-compact -1.7% -2.5% +0.8% +16.0% ➖ noise
45 duckdb:vortex-file-compressed -1.4% -2.5% +1.2% +10.0% ➖ noise
46 datafusion:vortex-compact +6.4% -3.2% +9.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -1.6% -3.2% +1.7% +21.0% ➖ noise
46 duckdb:duckdb -2.3% -3.2% +0.9% +10.0% ➖ noise
46 duckdb:vortex-compact -2.8% -3.2% +0.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +0.4% -3.2% +3.7% +10.8% ➖ noise
47 datafusion:vortex-compact -1.4% -1.7% +0.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -3.1% -1.7% -1.4% +10.0% ➖ noise
47 duckdb:duckdb -1.7% -1.7% +0.0% +10.0% ➖ noise
47 duckdb:vortex-compact -1.2% -1.7% +0.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +2.2% -1.7% +4.0% +10.0% ➖ noise
48 datafusion:vortex-compact +0.6% -2.0% +2.7% +13.8% ➖ noise
48 datafusion:vortex-file-compressed -0.8% -2.0% +1.2% +12.6% ➖ noise
48 duckdb:duckdb +3.5% -2.0% +5.6% +10.0% ➖ noise
48 duckdb:vortex-compact -0.2% -2.0% +1.8% +17.2% ➖ noise
48 duckdb:vortex-file-compressed -4.3% -2.0% -2.4% +10.0% ➖ noise
49 datafusion:vortex-compact -5.4% -3.5% -2.0% +11.0% ➖ noise
49 datafusion:vortex-file-compressed -2.5% -3.5% +1.0% +10.0% ➖ noise
49 duckdb:duckdb +5.9% -3.5% +9.8% +10.0% ➖ noise
49 duckdb:vortex-compact -5.1% -3.5% -1.7% +10.9% ➖ noise
49 duckdb:vortex-file-compressed +7.9% -3.5% +11.8% +14.4% ➖ noise
50 datafusion:vortex-compact +2.7% +1.5% +1.2% +15.9% ➖ noise
50 datafusion:vortex-file-compressed -1.9% +1.5% -3.4% +10.0% ➖ noise
50 duckdb:duckdb -4.0% +1.5% -5.4% +10.1% ➖ noise
50 duckdb:vortex-compact +0.3% +1.5% -1.2% +15.8% ➖ noise
50 duckdb:vortex-file-compressed -3.0% +1.5% -4.4% +10.0% ➖ noise
51 datafusion:vortex-compact -3.7% +2.3% -5.9% +12.4% ➖ noise
51 datafusion:vortex-file-compressed -2.6% +2.3% -4.8% +13.6% ➖ noise
51 duckdb:duckdb -3.0% +2.3% -5.2% +10.9% ➖ noise
51 duckdb:vortex-compact -1.7% +2.3% -3.9% +17.6% ➖ noise
51 duckdb:vortex-file-compressed +0.9% +2.3% -1.3% +23.4% ➖ noise
52 datafusion:vortex-compact -2.2% +4.1% -6.1% +15.1% ➖ noise
52 datafusion:vortex-file-compressed -4.0% +4.1% -7.8% +18.9% ➖ noise
52 duckdb:duckdb +6.2% +4.1% +2.0% +21.2% ➖ noise
52 duckdb:vortex-compact +1.3% +4.1% -2.7% +16.5% ➖ noise
52 duckdb:vortex-file-compressed -2.8% +4.1% -6.6% +17.4% ➖ noise
53 datafusion:vortex-compact -2.9% -2.3% -0.6% +13.1% ➖ noise
53 datafusion:vortex-file-compressed -3.4% -2.3% -1.1% +12.6% ➖ noise
53 duckdb:duckdb +1.4% -2.3% +3.8% +10.0% ➖ noise
53 duckdb:vortex-compact -2.3% -2.3% +0.0% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -4.7% -2.3% -2.5% +10.0% ➖ noise
54 datafusion:vortex-compact -0.3% -5.6% +5.6% +16.2% ➖ noise
54 datafusion:vortex-file-compressed -6.9% -5.6% -1.4% +10.3% ➖ noise
54 duckdb:duckdb -1.4% -5.6% +4.5% +10.0% ➖ noise
54 duckdb:vortex-compact -4.8% -5.6% +0.8% +17.7% ➖ noise
54 duckdb:vortex-file-compressed +3.1% -5.6% +9.2% +11.2% ➖ noise
55 datafusion:vortex-compact +2.6% +0.8% +1.7% +12.1% ➖ noise
55 datafusion:vortex-file-compressed -3.9% +0.8% -4.7% +12.8% ➖ noise
55 duckdb:duckdb +2.9% +0.8% +2.1% +15.7% ➖ noise
55 duckdb:vortex-compact -6.1% +0.8% -6.8% +15.7% ➖ noise
55 duckdb:vortex-file-compressed -1.6% +0.8% -2.3% +13.1% ➖ noise
56 datafusion:vortex-compact +1.7% -5.6% +7.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -9.4% -5.6% -4.0% +11.2% ➖ noise
56 duckdb:duckdb -0.7% -5.6% +5.2% +10.0% ➖ noise
56 duckdb:vortex-compact +2.2% -5.6% +8.2% +11.8% ➖ noise
56 duckdb:vortex-file-compressed -2.2% -5.6% +3.6% +10.0% ➖ noise
57 datafusion:vortex-compact -3.2% +0.1% -3.3% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -5.0% +0.1% -5.0% +11.5% ➖ noise
57 duckdb:duckdb +0.7% +0.1% +0.6% +14.9% ➖ noise
57 duckdb:vortex-compact -2.9% +0.1% -3.0% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -2.0% +0.1% -2.1% +15.5% ➖ noise
58 datafusion:vortex-compact -0.2% +0.9% -1.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -6.1% +0.9% -7.0% +10.0% ➖ noise
58 duckdb:duckdb -0.3% +0.9% -1.2% +10.3% ➖ noise
58 duckdb:vortex-compact -5.2% +0.9% -6.0% +15.5% ➖ noise
58 duckdb:vortex-file-compressed -3.1% +0.9% -4.0% +32.9% ➖ noise
59 datafusion:vortex-compact -5.8% -2.8% -3.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -3.0% -2.8% -0.2% +10.0% ➖ noise
59 duckdb:duckdb -1.7% -2.8% +1.1% +10.0% ➖ noise
59 duckdb:vortex-compact -3.5% -2.8% -0.7% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.5% -2.8% +2.3% +36.8% ➖ noise
60 datafusion:vortex-compact -4.8% -3.4% -1.4% +15.1% ➖ noise
60 datafusion:vortex-file-compressed -3.9% -3.4% -0.5% +10.0% ➖ noise
60 duckdb:duckdb -1.2% -3.4% +2.4% +10.0% ➖ noise
60 duckdb:vortex-compact +1.9% -3.4% +5.5% +10.2% ➖ noise
60 duckdb:vortex-file-compressed -3.4% -3.4% +0.0% +11.0% ➖ noise
61 datafusion:vortex-compact -0.5% -4.3% +4.0% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +3.9% -4.3% +8.6% +15.2% ➖ noise
61 duckdb:duckdb -3.4% -4.3% +0.9% +10.0% ➖ noise
61 duckdb:vortex-compact -0.6% -4.3% +3.8% +14.8% ➖ noise
61 duckdb:vortex-file-compressed -2.4% -4.3% +2.0% +10.0% ➖ noise
62 datafusion:vortex-compact +26.7% -1.6% +28.8% +22.3% 🚨 regression
62 datafusion:vortex-file-compressed -15.6% -1.6% -14.2% +25.0% ➖ noise
62 duckdb:duckdb -1.8% -1.6% -0.2% +14.4% ➖ noise
62 duckdb:vortex-compact -0.4% -1.6% +1.2% +23.9% ➖ noise
62 duckdb:vortex-file-compressed -10.5% -1.6% -9.1% +28.9% ➖ noise
63 datafusion:vortex-compact -3.1% -1.5% -1.7% +12.1% ➖ noise
63 datafusion:vortex-file-compressed -5.7% -1.5% -4.3% +10.0% ➖ noise
63 duckdb:duckdb +0.6% -1.5% +2.2% +10.0% ➖ noise
63 duckdb:vortex-compact +3.0% -1.5% +4.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.8% -1.5% -0.3% +10.8% ➖ noise
64 datafusion:vortex-compact -3.4% -0.3% -3.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -4.7% -0.3% -4.4% +10.0% ➖ noise
64 duckdb:duckdb +0.8% -0.3% +1.1% +10.0% ➖ noise
64 duckdb:vortex-compact -2.3% -0.3% -2.0% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -3.0% -0.3% -2.7% +10.0% ➖ noise
65 datafusion:vortex-compact +5.9% -2.6% +8.7% +25.8% ➖ noise
65 datafusion:vortex-file-compressed -3.7% -2.6% -1.2% +11.7% ➖ noise
65 duckdb:duckdb -2.6% -2.6% -0.1% +10.0% ➖ noise
65 duckdb:vortex-compact -2.4% -2.6% +0.2% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.8% -2.6% +1.8% +11.5% ➖ noise
66 datafusion:vortex-compact -2.9% +8.1% -10.2% +18.3% ➖ noise
66 datafusion:vortex-file-compressed -8.1% +8.1% -14.9% +21.0% ➖ noise
66 duckdb:duckdb -1.8% +8.1% -9.1% +12.2% ➖ noise
66 duckdb:vortex-compact -7.3% +8.1% -14.2% +11.3% ✅ faster
66 duckdb:vortex-file-compressed +1.1% +8.1% -6.5% +10.8% ➖ noise
67 datafusion:vortex-compact +3.2% -0.0% +3.2% +11.4% ➖ noise
67 datafusion:vortex-file-compressed -4.1% -0.0% -4.1% +10.0% ➖ noise
67 duckdb:duckdb -2.0% -0.0% -2.0% +10.0% ➖ noise
67 duckdb:vortex-compact +2.3% -0.0% +2.4% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.9% -0.0% -1.9% +10.0% ➖ noise
68 datafusion:vortex-compact -1.1% +0.9% -2.0% +24.9% ➖ noise
68 datafusion:vortex-file-compressed -4.1% +0.9% -4.9% +29.7% ➖ noise
68 duckdb:duckdb +0.0% +0.9% -0.8% +10.0% ➖ noise
68 duckdb:vortex-compact -5.9% +0.9% -6.7% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -1.3% +0.9% -2.2% +17.0% ➖ noise
69 datafusion:vortex-compact -5.6% -2.1% -3.6% +11.3% ➖ noise
69 datafusion:vortex-file-compressed -3.8% -2.1% -1.7% +10.0% ➖ noise
69 duckdb:duckdb -2.2% -2.1% -0.1% +10.0% ➖ noise
69 duckdb:vortex-compact -2.6% -2.1% -0.6% +10.4% ➖ noise
69 duckdb:vortex-file-compressed -1.6% -2.1% +0.5% +10.0% ➖ noise
70 datafusion:vortex-compact +2.5% -2.3% +4.9% +15.0% ➖ noise
70 datafusion:vortex-file-compressed -6.0% -2.3% -3.8% +16.8% ➖ noise
70 duckdb:duckdb +2.1% -2.3% +4.5% +13.4% ➖ noise
70 duckdb:vortex-compact +1.2% -2.3% +3.6% +16.4% ➖ noise
70 duckdb:vortex-file-compressed +1.9% -2.3% +4.3% +13.4% ➖ noise
71 datafusion:vortex-compact -5.6% -5.2% -0.5% +22.9% ➖ noise
71 datafusion:vortex-file-compressed -4.2% -5.2% +1.0% +10.0% ➖ noise
71 duckdb:duckdb -3.6% -5.2% +1.7% +10.0% ➖ noise
71 duckdb:vortex-compact -8.5% -5.2% -3.6% +11.4% ➖ noise
71 duckdb:vortex-file-compressed -1.4% -5.2% +4.0% +15.8% ➖ noise
72 datafusion:vortex-compact -1.9% -2.9% +1.1% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -2.8% -2.9% +0.1% +10.0% ➖ noise
72 duckdb:duckdb -3.5% -2.9% -0.6% +10.0% ➖ noise
72 duckdb:vortex-compact +1.5% -2.9% +4.6% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.7% -2.9% +2.4% +10.0% ➖ noise
73 datafusion:vortex-compact -2.3% -3.3% +1.0% +33.4% ➖ noise
73 datafusion:vortex-file-compressed -5.8% -3.3% -2.6% +10.0% ➖ noise
73 duckdb:duckdb +5.2% -3.3% +8.8% +15.0% ➖ noise
73 duckdb:vortex-compact +1.5% -3.3% +5.0% +13.8% ➖ noise
73 duckdb:vortex-file-compressed -1.7% -3.3% +1.6% +19.1% ➖ noise
74 datafusion:vortex-compact -5.9% -1.3% -4.6% +16.2% ➖ noise
74 datafusion:vortex-file-compressed -4.7% -1.3% -3.5% +21.7% ➖ noise
74 duckdb:duckdb -0.6% -1.3% +0.8% +10.0% ➖ noise
74 duckdb:vortex-compact -3.2% -1.3% -1.9% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +1.8% -1.3% +3.2% +10.0% ➖ noise
75 datafusion:vortex-compact -4.1% -3.3% -0.8% +12.4% ➖ noise
75 datafusion:vortex-file-compressed -2.1% -3.3% +1.2% +14.9% ➖ noise
75 duckdb:duckdb -0.7% -3.3% +2.8% +10.0% ➖ noise
75 duckdb:vortex-compact -0.1% -3.3% +3.3% +10.9% ➖ noise
75 duckdb:vortex-file-compressed -5.1% -3.3% -1.9% +11.6% ➖ noise
76 datafusion:vortex-compact -7.2% -2.3% -5.0% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +2.8% -2.3% +5.2% +13.1% ➖ noise
76 duckdb:duckdb -2.3% -2.3% -0.0% +10.0% ➖ noise
76 duckdb:vortex-compact -6.8% -2.3% -4.6% +15.5% ➖ noise
76 duckdb:vortex-file-compressed +8.0% -2.3% +10.6% +13.3% ➖ noise
77 datafusion:vortex-compact -1.4% -3.6% +2.3% +15.1% ➖ noise
77 datafusion:vortex-file-compressed -6.0% -3.6% -2.5% +10.0% ➖ noise
77 duckdb:duckdb -4.5% -3.6% -0.9% +10.0% ➖ noise
77 duckdb:vortex-compact -2.2% -3.6% +1.4% +14.9% ➖ noise
77 duckdb:vortex-file-compressed -6.7% -3.6% -3.3% +13.6% ➖ noise
78 datafusion:vortex-compact -2.0% -3.2% +1.2% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -3.2% -3.2% -0.1% +10.0% ➖ noise
78 duckdb:duckdb -1.2% -3.2% +2.0% +10.0% ➖ noise
78 duckdb:vortex-compact +3.9% -3.2% +7.3% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -2.7% -3.2% +0.5% +10.0% ➖ noise
79 datafusion:vortex-compact -1.3% -4.9% +3.9% +11.1% ➖ noise
79 datafusion:vortex-file-compressed -3.8% -4.9% +1.2% +17.5% ➖ noise
79 duckdb:duckdb +0.1% -4.9% +5.3% +14.8% ➖ noise
79 duckdb:vortex-compact -2.0% -4.9% +3.1% +12.8% ➖ noise
79 duckdb:vortex-file-compressed -4.4% -4.9% +0.6% +10.9% ➖ noise
80 datafusion:vortex-compact -5.6% +1.1% -6.6% +15.5% ➖ noise
80 datafusion:vortex-file-compressed -6.2% +1.1% -7.2% +10.0% ➖ noise
80 duckdb:duckdb -12.2% +1.1% -13.2% +10.9% ✅ faster
80 duckdb:vortex-compact -0.6% +1.1% -1.6% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -3.1% +1.1% -4.2% +15.2% ➖ noise
81 datafusion:vortex-compact -12.0% -0.6% -11.5% +14.7% ➖ noise
81 datafusion:vortex-file-compressed -2.4% -0.6% -1.8% +10.0% ➖ noise
81 duckdb:duckdb +1.5% -0.6% +2.1% +10.0% ➖ noise
81 duckdb:vortex-compact -3.4% -0.6% -2.9% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -4.8% -0.6% -4.3% +10.0% ➖ noise
82 datafusion:vortex-compact -4.5% -3.7% -0.9% +13.6% ➖ noise
82 datafusion:vortex-file-compressed -4.6% -3.7% -1.0% +32.4% ➖ noise
82 duckdb:duckdb -9.4% -3.7% -5.9% +11.9% ➖ noise
82 duckdb:vortex-compact +0.2% -3.7% +4.0% +13.6% ➖ noise
82 duckdb:vortex-file-compressed -2.0% -3.7% +1.8% +11.0% ➖ noise
83 datafusion:vortex-compact -1.7% -3.4% +1.8% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +0.9% -3.4% +4.5% +10.0% ➖ noise
83 duckdb:duckdb -2.1% -3.4% +1.3% +10.0% ➖ noise
83 duckdb:vortex-compact -5.6% -3.4% -2.3% +18.8% ➖ noise
83 duckdb:vortex-file-compressed +0.5% -3.4% +4.1% +10.2% ➖ noise
84 datafusion:vortex-compact -3.7% -2.7% -1.0% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -3.5% -2.7% -0.8% +11.8% ➖ noise
84 duckdb:duckdb -3.3% -2.7% -0.6% +10.0% ➖ noise
84 duckdb:vortex-compact -11.0% -2.7% -8.5% +15.3% ➖ noise
84 duckdb:vortex-file-compressed -1.4% -2.7% +1.3% +13.7% ➖ noise
85 datafusion:vortex-compact +1.3% -1.1% +2.4% +14.8% ➖ noise
85 datafusion:vortex-file-compressed +0.1% -1.1% +1.1% +10.0% ➖ noise
85 duckdb:duckdb -0.4% -1.1% +0.7% +10.0% ➖ noise
85 duckdb:vortex-compact -3.6% -1.1% -2.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -0.8% -1.1% +0.3% +10.0% ➖ noise
86 datafusion:vortex-compact +3.5% -2.5% +6.1% +20.6% ➖ noise
86 datafusion:vortex-file-compressed +0.7% -2.5% +3.2% +16.6% ➖ noise
86 duckdb:duckdb -2.4% -2.5% +0.0% +10.0% ➖ noise
86 duckdb:vortex-compact -3.5% -2.5% -1.1% +13.0% ➖ noise
86 duckdb:vortex-file-compressed -2.2% -2.5% +0.3% +14.7% ➖ noise
87 datafusion:vortex-compact -4.1% -3.9% -0.3% +11.2% ➖ noise
87 datafusion:vortex-file-compressed -2.3% -3.9% +1.7% +10.0% ➖ noise
87 duckdb:duckdb +3.9% -3.9% +8.1% +11.9% ➖ noise
87 duckdb:vortex-compact -1.5% -3.9% +2.4% +14.9% ➖ noise
87 duckdb:vortex-file-compressed +4.8% -3.9% +9.0% +12.2% ➖ noise
88 datafusion:vortex-compact -4.9% -0.5% -4.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +2.7% -0.5% +3.2% +10.0% ➖ noise
88 duckdb:duckdb +1.0% -0.5% +1.5% +10.0% ➖ noise
88 duckdb:vortex-compact +0.6% -0.5% +1.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +0.2% -0.5% +0.7% +10.0% ➖ noise
89 datafusion:vortex-compact +0.3% +0.7% -0.4% +11.5% ➖ noise
89 datafusion:vortex-file-compressed -7.4% +0.7% -8.1% +12.7% ➖ noise
89 duckdb:duckdb -4.2% +0.7% -4.9% +11.3% ➖ noise
89 duckdb:vortex-compact -4.6% +0.7% -5.3% +11.7% ➖ noise
89 duckdb:vortex-file-compressed -1.3% +0.7% -2.0% +10.0% ➖ noise
90 datafusion:vortex-compact -4.4% -2.2% -2.3% +12.3% ➖ noise
90 datafusion:vortex-file-compressed -4.6% -2.2% -2.5% +13.9% ➖ noise
90 duckdb:duckdb -1.5% -2.2% +0.7% +10.0% ➖ noise
90 duckdb:vortex-compact -6.0% -2.2% -3.9% +11.7% ➖ noise
90 duckdb:vortex-file-compressed -6.1% -2.2% -4.0% +25.6% ➖ noise
91 datafusion:vortex-compact -7.8% +0.6% -8.3% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -6.8% +0.6% -7.3% +10.0% ➖ noise
91 duckdb:duckdb -1.4% +0.6% -1.9% +10.0% ➖ noise
91 duckdb:vortex-compact -3.3% +0.6% -3.8% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -8.8% +0.6% -9.3% +10.0% ✅ faster
92 datafusion:vortex-compact -6.7% -3.8% -3.0% +27.5% ➖ noise
92 datafusion:vortex-file-compressed -3.6% -3.8% +0.3% +10.9% ➖ noise
92 duckdb:duckdb -0.3% -3.8% +3.7% +11.3% ➖ noise
92 duckdb:vortex-compact +14.6% -3.8% +19.1% +16.1% 🚨 regression
92 duckdb:vortex-file-compressed -0.0% -3.8% +4.0% +30.5% ➖ noise
93 datafusion:vortex-compact -4.8% -0.6% -4.3% +13.7% ➖ noise
93 datafusion:vortex-file-compressed -3.7% -0.6% -3.1% +12.2% ➖ noise
93 duckdb:duckdb -3.9% -0.6% -3.4% +10.9% ➖ noise
93 duckdb:vortex-compact -5.1% -0.6% -4.5% +10.2% ➖ noise
93 duckdb:vortex-file-compressed -3.5% -0.6% -2.9% +10.0% ➖ noise
94 datafusion:vortex-compact -13.2% -0.2% -13.0% +14.5% ✅ faster
94 datafusion:vortex-file-compressed +4.3% -0.2% +4.6% +17.4% ➖ noise
94 duckdb:duckdb -0.0% -0.2% +0.2% +10.0% ➖ noise
94 duckdb:vortex-compact -2.8% -0.2% -2.6% +10.2% ➖ noise
94 duckdb:vortex-file-compressed -1.2% -0.2% -1.0% +10.0% ➖ noise
95 datafusion:vortex-compact +0.3% -0.6% +0.9% +13.2% ➖ noise
95 datafusion:vortex-file-compressed -0.2% -0.6% +0.4% +10.9% ➖ noise
95 duckdb:duckdb -15.1% -0.6% -14.6% +19.3% ➖ noise
95 duckdb:vortex-compact +2.9% -0.6% +3.5% +10.9% ➖ noise
95 duckdb:vortex-file-compressed +3.7% -0.6% +4.3% +13.2% ➖ noise
96 datafusion:vortex-compact -2.4% -0.9% -1.5% +14.9% ➖ noise
96 datafusion:vortex-file-compressed -9.6% -0.9% -8.8% +10.0% ➖ noise
96 duckdb:duckdb -0.7% -0.9% +0.2% +16.5% ➖ noise
96 duckdb:vortex-compact -1.9% -0.9% -1.0% +11.4% ➖ noise
96 duckdb:vortex-file-compressed +0.8% -0.9% +1.7% +10.0% ➖ noise
97 datafusion:vortex-compact -3.2% -1.4% -1.8% +17.2% ➖ noise
97 datafusion:vortex-file-compressed +3.0% -1.4% +4.4% +10.0% ➖ noise
97 duckdb:duckdb -2.3% -1.4% -0.9% +10.0% ➖ noise
97 duckdb:vortex-compact +2.7% -1.4% +4.2% +15.4% ➖ noise
97 duckdb:vortex-file-compressed -0.5% -1.4% +0.9% +13.4% ➖ noise
98 datafusion:vortex-compact -3.9% -4.8% +1.0% +12.0% ➖ noise
98 datafusion:vortex-file-compressed -0.6% -4.8% +4.5% +10.0% ➖ noise
98 duckdb:duckdb +1.8% -4.8% +7.0% +10.0% ➖ noise
98 duckdb:vortex-compact +0.0% -4.8% +5.1% +12.7% ➖ noise
98 duckdb:vortex-file-compressed +8.3% -4.8% +13.8% +19.3% ➖ noise
99 datafusion:vortex-compact -2.2% -8.0% +6.3% +30.3% ➖ noise
99 datafusion:vortex-file-compressed -0.0% -8.0% +8.7% +33.7% ➖ noise
99 duckdb:duckdb -2.7% -8.0% +5.8% +21.7% ➖ noise
99 duckdb:vortex-compact -7.2% -8.0% +0.9% +26.9% ➖ noise
99 duckdb:vortex-file-compressed -1.1% -8.0% +7.5% +21.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 12, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels May 12, 2026
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 12, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels May 12, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +12.2%
Engines: DataFusion No clear signal (+23.6%, environment too noisy confidence) · DuckDB No clear signal (+1.8%, environment too noisy confidence)
Vortex (geomean): 1.160x ➖
Parquet (geomean): 1.034x ➖
Shifts: Parquet (control) +3.4% · Median polish +4.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.684x ❌, 0↑ 7↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 49174267 48808948 1.01
fineweb_q01/datafusion:vortex-file-compressed 🚨 870738121 598717832 1.45
fineweb_q02/datafusion:vortex-file-compressed 694181793 580819254 1.20
fineweb_q03/datafusion:vortex-file-compressed 🚨 3023306289 1209502324 2.50
fineweb_q04/datafusion:vortex-file-compressed 🚨 1638105088 1200207593 1.36
fineweb_q05/datafusion:vortex-file-compressed 🚨 2298564862 1145500683 2.01
fineweb_q06/datafusion:vortex-file-compressed 🚨 4595671549 1298626487 3.54
fineweb_q07/datafusion:vortex-file-compressed 🚨 1913008864 1182022834 1.62
fineweb_q08/datafusion:vortex-file-compressed 🚨 792033392 500151386 1.58
datafusion / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35302813 34530647 1.02
fineweb_q01/datafusion:vortex-compact 613050331 593414280 1.03
fineweb_q02/datafusion:vortex-compact 569802396 631183692 0.90
fineweb_q03/datafusion:vortex-compact 1363611206 1398131677 0.98
fineweb_q04/datafusion:vortex-compact 1574886765 1577941246 1.00
fineweb_q05/datafusion:vortex-compact 1386597514 1394590632 0.99
fineweb_q06/datafusion:vortex-compact 1401078944 1303129443 1.08
fineweb_q07/datafusion:vortex-compact 1237524212 1181391282 1.05
fineweb_q08/datafusion:vortex-compact 415527324 396744388 1.05
datafusion / parquet (1.055x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1709516640 1420731277 1.20
fineweb_q01/datafusion:parquet 2267874552 2118609011 1.07
fineweb_q02/datafusion:parquet 2150280451 2200614726 0.98
fineweb_q03/datafusion:parquet 2128182423 2202132970 0.97
fineweb_q04/datafusion:parquet 2365756937 2256712115 1.05
fineweb_q05/datafusion:parquet 2626896458 2130926788 1.23
fineweb_q06/datafusion:parquet 2780618409 2232895523 1.25
fineweb_q07/datafusion:parquet 2277493229 2303555471 0.99
fineweb_q08/datafusion:parquet 1885104424 2251030332 0.84
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 88622081 75343362 1.18
fineweb_q01/duckdb:vortex-file-compressed 669460802 606573505 1.10
fineweb_q02/duckdb:vortex-file-compressed 686460134 693509824 0.99
fineweb_q03/duckdb:vortex-file-compressed 1613323157 1444620626 1.12
fineweb_q04/duckdb:vortex-file-compressed 1389230010 1431932989 0.97
fineweb_q05/duckdb:vortex-file-compressed 1274521912 1481490322 0.86
fineweb_q06/duckdb:vortex-file-compressed 1636808881 1580838117 1.04
fineweb_q07/duckdb:vortex-file-compressed 1471933769 1470142178 1.00
fineweb_q08/duckdb:vortex-file-compressed 589233284 571521373 1.03
duckdb / vortex-compact (1.036x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 101655129 62684460 1.62
fineweb_q01/duckdb:vortex-compact 717158092 651189479 1.10
fineweb_q02/duckdb:vortex-compact 612580533 686089090 0.89
fineweb_q03/duckdb:vortex-compact 1666072974 1773980115 0.94
fineweb_q04/duckdb:vortex-compact 1742383996 1809354704 0.96
fineweb_q05/duckdb:vortex-compact 1520133747 1571974715 0.97
fineweb_q06/duckdb:vortex-compact 1608889726 1551683561 1.04
fineweb_q07/duckdb:vortex-compact 1410990433 1400365501 1.01
fineweb_q08/duckdb:vortex-compact 501606482 529336130 0.95
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1155798047 1334492782 0.87
fineweb_q01/duckdb:parquet 1530889580 1431910469 1.07
fineweb_q02/duckdb:parquet 1443213386 1484994527 0.97
fineweb_q03/duckdb:parquet 4102543426 4013631582 1.02
fineweb_q04/duckdb:parquet 2141431862 2027564499 1.06
fineweb_q05/duckdb:parquet 2513357765 2440914697 1.03
fineweb_q06/duckdb:parquet 4726826688 4724397029 1.00
fineweb_q07/duckdb:parquet 3043312067 2922273226 1.04
fineweb_q08/duckdb:parquet 1260523915 1161407436 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +2.2% +2.1% +0.1% +202.0% ➖ noise
0 datafusion:vortex-file-compressed +0.7% +2.1% -1.3% +200.2% ➖ noise
0 duckdb:vortex-compact +62.2% +2.1% +58.9% +43.7% 🚨 regression
0 duckdb:vortex-file-compressed +17.6% +2.1% +15.2% +69.4% ➖ noise
1 datafusion:vortex-compact +3.3% +7.0% -3.4% +65.5% ➖ noise
1 datafusion:vortex-file-compressed +45.4% +7.0% +35.9% +75.4% ➖ noise
1 duckdb:vortex-compact +10.1% +7.0% +2.9% +31.4% ➖ noise
1 duckdb:vortex-file-compressed +10.4% +7.0% +3.2% +30.0% ➖ noise
2 datafusion:vortex-compact -9.7% -2.6% -7.4% +48.8% ➖ noise
2 datafusion:vortex-file-compressed +19.5% -2.6% +22.6% +66.8% ➖ noise
2 duckdb:vortex-compact -10.7% -2.6% -8.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -1.0% -2.6% +1.6% +30.0% ➖ noise
3 datafusion:vortex-compact -2.5% -0.6% -1.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +150.0% -0.6% +151.5% +40.7% 🚨 regression
3 duckdb:vortex-compact -6.1% -0.6% -5.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +11.7% -0.6% +12.4% +30.7% ➖ noise
4 datafusion:vortex-compact -0.2% +5.2% -5.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +36.5% +5.2% +29.7% +56.1% ➖ noise
4 duckdb:vortex-compact -3.7% +5.2% -8.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -3.0% +5.2% -7.8% +30.0% ➖ noise
5 datafusion:vortex-compact -0.6% +12.7% -11.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +100.7% +12.7% +78.1% +30.0% 🚨 regression
5 duckdb:vortex-compact -3.3% +12.7% -14.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -14.0% +12.7% -23.6% +30.0% ✅ faster
6 datafusion:vortex-compact +7.5% +11.6% -3.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +253.9% +11.6% +217.0% +30.0% 🚨 regression
6 duckdb:vortex-compact +3.7% +11.6% -7.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +3.5% +11.6% -7.2% +30.0% ➖ noise
7 datafusion:vortex-compact +4.8% +1.5% +3.2% +30.1% ➖ noise
7 datafusion:vortex-file-compressed +61.8% +1.5% +59.5% +44.4% 🚨 regression
7 duckdb:vortex-compact +0.8% +1.5% -0.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.1% +1.5% -1.3% +38.1% ➖ noise
8 datafusion:vortex-compact +4.7% -4.7% +9.9% +33.1% ➖ noise
8 datafusion:vortex-file-compressed +58.4% -4.7% +66.1% +32.8% 🚨 regression
8 duckdb:vortex-compact -5.2% -4.7% -0.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.1% -4.7% +8.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: Random Access

Vortex (geomean): 0.873x ✅
Parquet (geomean): 0.947x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.917x ➖, 18↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 1749999 2379551 0.74
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1065497 1110703 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8491157232 9032701311 0.94
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8283338320 8907155943 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 6823637 3691667 1.85
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2892356 3402916 0.85
random-access/feature-vectors/uniform/lance-tokio-local-disk 1223105 1244407 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1887361 1978165 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8336528855 8743409973 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8357399467 8779505638 0.95
random-access/feature-vectors/uniform/vortex-tokio-local-disk 6362561 7055013 0.90
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 6090139 6833116 0.89
random-access/lance-tokio-local-disk 652074 671292 0.97
random-access/lance-tokio-local-disk-footer 1302467 1374705 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk 240446 255738 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 581957 625350 0.93
random-access/nested-lists/correlated/parquet-tokio-local-disk 130477731 136170686 0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 130611510 135268642 0.97
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 556700 719349 0.77
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 597408 740056 0.81
random-access/nested-lists/uniform/lance-tokio-local-disk 1018947 1082998 0.94
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1371841 1473230 0.93
random-access/nested-lists/uniform/parquet-tokio-local-disk 130380001 135075124 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130119726 135537158 0.96
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2081228 2430344 0.86
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2080326 2360581 0.88
random-access/nested-structs/correlated/lance-tokio-local-disk 370596 393136 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 549412 592260 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk 23176507 24956777 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 23011746 24718927 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 708988 871369 0.81
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 732659 906280 0.81
random-access/nested-structs/uniform/lance-tokio-local-disk 2684028 2721394 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2816780 2969888 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk 23148708 24547247 0.94
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22860139 24454256 0.93
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1561559 1889869 0.83
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1606014 1855981 0.87
random-access/parquet-tokio-local-disk 167257341 174660938 0.96
random-access/parquet-tokio-local-disk-footer 167071218 176602039 0.95
random-access/taxi/correlated/lance-tokio-local-disk 952970 984729 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1838059 2050109 0.90
random-access/taxi/correlated/parquet-tokio-local-disk 250970054 266857678 0.94
random-access/taxi/correlated/parquet-tokio-local-disk-footer 253390600 266977639 0.95
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1455209 2006439 0.73
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1626467 2030906 0.80
random-access/taxi/uniform/lance-tokio-local-disk 9377195 10031108 0.93
random-access/taxi/uniform/lance-tokio-local-disk-footer 9990047 10709987 0.93
random-access/taxi/uniform/parquet-tokio-local-disk 270156334 283928029 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 269609217 284528989 0.95
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4154147 4781884 0.87
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4137246 4764647 0.87
random-access/vortex-tokio-local-disk 🚀 1113109 1301119 0.86
random-access/vortex-tokio-local-disk-footer 🚀 1136828 1373437 0.83

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.3%
Engines: DataFusion No clear signal (+2.5%, low confidence) · DuckDB No clear signal (+6.2%, low confidence)
Vortex (geomean): 1.139x ❌
Parquet (geomean): 1.086x ➖
Shifts: Parquet (control) +8.6% · Median polish +11.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.141x ❌, 0↑ 18↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 442724668 392781674 1.13
tpch_q02/datafusion:vortex-file-compressed 🚨 128982249 112844182 1.14
tpch_q03/datafusion:vortex-file-compressed 🚨 245120136 213176599 1.15
tpch_q04/datafusion:vortex-file-compressed 🚨 135385747 113902121 1.19
tpch_q05/datafusion:vortex-file-compressed 🚨 454475102 383270385 1.19
tpch_q06/datafusion:vortex-file-compressed 42498548 39273123 1.08
tpch_q07/datafusion:vortex-file-compressed 🚨 604967297 510590265 1.18
tpch_q08/datafusion:vortex-file-compressed 🚨 429457575 373325159 1.15
tpch_q09/datafusion:vortex-file-compressed 🚨 775823952 653562229 1.19
tpch_q10/datafusion:vortex-file-compressed 🚨 279449748 232207661 1.20
tpch_q11/datafusion:vortex-file-compressed 95200871 88782945 1.07
tpch_q12/datafusion:vortex-file-compressed 🚨 130899857 118795226 1.10
tpch_q13/datafusion:vortex-file-compressed 🚨 256131213 223487677 1.15
tpch_q14/datafusion:vortex-file-compressed 57436630 53838417 1.07
tpch_q15/datafusion:vortex-file-compressed 🚨 112911122 99960317 1.13
tpch_q16/datafusion:vortex-file-compressed 🚨 87059623 78638704 1.11
tpch_q17/datafusion:vortex-file-compressed 🚨 761051362 648717645 1.17
tpch_q18/datafusion:vortex-file-compressed 🚨 1007582773 872242076 1.16
tpch_q19/datafusion:vortex-file-compressed 🚨 84134105 74367094 1.13
tpch_q20/datafusion:vortex-file-compressed 🚨 190708017 166764659 1.14
tpch_q21/datafusion:vortex-file-compressed 🚨 804854134 670852002 1.20
tpch_q22/datafusion:vortex-file-compressed 77221076 71277673 1.08
datafusion / vortex-compact (1.133x ❌, 0↑ 18↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 489897842 439186872 1.12
tpch_q02/datafusion:vortex-compact 🚨 131322595 115755186 1.13
tpch_q03/datafusion:vortex-compact 🚨 250797440 214271368 1.17
tpch_q04/datafusion:vortex-compact 🚨 135572663 120458225 1.13
tpch_q05/datafusion:vortex-compact 🚨 455806185 386690596 1.18
tpch_q06/datafusion:vortex-compact 🚨 67714773 60115128 1.13
tpch_q07/datafusion:vortex-compact 🚨 613913864 535956729 1.15
tpch_q08/datafusion:vortex-compact 🚨 428079542 384769162 1.11
tpch_q09/datafusion:vortex-compact 🚨 780576365 671233210 1.16
tpch_q10/datafusion:vortex-compact 🚨 285130443 248389125 1.15
tpch_q11/datafusion:vortex-compact 96630525 90200287 1.07
tpch_q12/datafusion:vortex-compact 🚨 181267582 161628447 1.12
tpch_q13/datafusion:vortex-compact 🚨 301733841 266129641 1.13
tpch_q14/datafusion:vortex-compact 🚨 78957544 70461439 1.12
tpch_q15/datafusion:vortex-compact 172119173 156849859 1.10
tpch_q16/datafusion:vortex-compact 🚨 94891531 81882001 1.16
tpch_q17/datafusion:vortex-compact 🚨 762564443 656340263 1.16
tpch_q18/datafusion:vortex-compact 🚨 1029711680 887107194 1.16
tpch_q19/datafusion:vortex-compact 135036189 125102680 1.08
tpch_q20/datafusion:vortex-compact 🚨 214022409 188663714 1.13
tpch_q21/datafusion:vortex-compact 🚨 803340854 680141099 1.18
tpch_q22/datafusion:vortex-compact 84796339 77612979 1.09
datafusion / parquet (1.121x ❌, 0↑ 17↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 528156473 438760015 1.20
tpch_q02/datafusion:parquet 🚨 193027965 175178085 1.10
tpch_q03/datafusion:parquet 🚨 319203682 284830122 1.12
tpch_q04/datafusion:parquet 🚨 144358229 129942976 1.11
tpch_q05/datafusion:parquet 🚨 507919986 446320718 1.14
tpch_q06/datafusion:parquet 🚨 140673011 127047944 1.11
tpch_q07/datafusion:parquet 🚨 712745486 619286635 1.15
tpch_q08/datafusion:parquet 🚨 549467178 471062244 1.17
tpch_q09/datafusion:parquet 🚨 874529357 767733584 1.14
tpch_q10/datafusion:parquet 🚨 577250186 512949447 1.13
tpch_q11/datafusion:parquet 130060071 119536263 1.09
tpch_q12/datafusion:parquet 212977083 201553930 1.06
tpch_q13/datafusion:parquet 358599011 341457747 1.05
tpch_q14/datafusion:parquet 🚨 181546147 162830728 1.11
tpch_q15/datafusion:parquet 289725005 267230439 1.08
tpch_q16/datafusion:parquet 🚨 139132151 126360689 1.10
tpch_q17/datafusion:parquet 🚨 807901245 705556765 1.15
tpch_q18/datafusion:parquet 🚨 1076159040 922973497 1.17
tpch_q19/datafusion:parquet 🚨 293422994 254330634 1.15
tpch_q20/datafusion:parquet 🚨 345878189 297853881 1.16
tpch_q21/datafusion:parquet 🚨 829236561 704665934 1.18
tpch_q22/datafusion:parquet 227448122 221784435 1.03
datafusion / arrow (1.175x ❌, 0↑ 21↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 691825500 585700850 1.18
tpch_q02/datafusion:arrow 🚨 194608972 164175724 1.19
tpch_q03/datafusion:arrow 🚨 559475824 459626195 1.22
tpch_q04/datafusion:arrow 🚨 414868844 330873899 1.25
tpch_q05/datafusion:arrow 🚨 1087087498 936847707 1.16
tpch_q06/datafusion:arrow 🚨 343835931 281824534 1.22
tpch_q07/datafusion:arrow 🚨 1376912013 1168525139 1.18
tpch_q08/datafusion:arrow 🚨 1302824153 1153808754 1.13
tpch_q09/datafusion:arrow 🚨 1544891074 1360807797 1.14
tpch_q10/datafusion:arrow 🚨 703148688 599633049 1.17
tpch_q11/datafusion:arrow 🚨 154860746 139575257 1.11
tpch_q12/datafusion:arrow 🚨 963846672 736461686 1.31
tpch_q13/datafusion:arrow 🚨 569326215 498714050 1.14
tpch_q14/datafusion:arrow 🚨 387456726 313898446 1.23
tpch_q15/datafusion:arrow 🚨 849529259 691578491 1.23
tpch_q16/datafusion:arrow 🚨 117816252 105168384 1.12
tpch_q17/datafusion:arrow 🚨 1555121284 1348741009 1.15
tpch_q18/datafusion:arrow 🚨 2266037045 1914213531 1.18
tpch_q19/datafusion:arrow 🚨 570752864 486894330 1.17
tpch_q20/datafusion:arrow 🚨 578574033 486559361 1.19
tpch_q21/datafusion:arrow 3314273354 3018344162 1.10
tpch_q22/datafusion:arrow 🚨 146226452 132783622 1.10
duckdb / vortex-file-compressed (1.139x ❌, 0↑ 12↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 177701740 171402561 1.04
tpch_q02/duckdb:vortex-file-compressed 54302196 52786949 1.03
tpch_q03/duckdb:vortex-file-compressed 🚨 135413047 121232315 1.12
tpch_q04/duckdb:vortex-file-compressed 🚨 178911042 158558049 1.13
tpch_q05/duckdb:vortex-file-compressed 150392611 138686555 1.08
tpch_q06/duckdb:vortex-file-compressed 🚨 42471954 34121799 1.24
tpch_q07/duckdb:vortex-file-compressed 🚨 148605139 131909631 1.13
tpch_q08/duckdb:vortex-file-compressed 🚨 187444807 167862782 1.12
tpch_q09/duckdb:vortex-file-compressed 439940319 400905417 1.10
tpch_q10/duckdb:vortex-file-compressed 212636686 194533726 1.09
tpch_q11/duckdb:vortex-file-compressed 34619599 32430040 1.07
tpch_q12/duckdb:vortex-file-compressed 🚨 111948692 101266110 1.11
tpch_q13/duckdb:vortex-file-compressed 292498758 274427377 1.07
tpch_q14/duckdb:vortex-file-compressed 🚨 58879517 53288498 1.10
tpch_q15/duckdb:vortex-file-compressed 98026589 89774362 1.09
tpch_q16/duckdb:vortex-file-compressed 🚨 86935031 77143037 1.13
tpch_q17/duckdb:vortex-file-compressed 🚨 107082662 91911470 1.17
tpch_q18/duckdb:vortex-file-compressed 319203984 290995953 1.10
tpch_q19/duckdb:vortex-file-compressed 85598185 80675614 1.06
tpch_q20/duckdb:vortex-file-compressed 🚨 162178605 144528335 1.12
tpch_q21/duckdb:vortex-file-compressed 🚨 573222302 496755185 1.15
tpch_q22/duckdb:vortex-file-compressed 🚨 136899536 64015131 2.14
duckdb / vortex-compact (1.144x ❌, 0↑ 10↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 246324979 227796727 1.08
tpch_q02/duckdb:vortex-compact 60556988 57518826 1.05
tpch_q03/duckdb:vortex-compact 150438677 136995804 1.10
tpch_q04/duckdb:vortex-compact 🚨 194063479 169807249 1.14
tpch_q05/duckdb:vortex-compact 182000758 166097015 1.10
tpch_q06/duckdb:vortex-compact 🚨 63688692 56718062 1.12
tpch_q07/duckdb:vortex-compact 190112037 176429473 1.08
tpch_q08/duckdb:vortex-compact 208516703 189659952 1.10
tpch_q09/duckdb:vortex-compact 🚨 469431487 425340002 1.10
tpch_q10/duckdb:vortex-compact 238944310 220324611 1.08
tpch_q11/duckdb:vortex-compact 42138083 38682653 1.09
tpch_q12/duckdb:vortex-compact 🚨 182473715 162447648 1.12
tpch_q13/duckdb:vortex-compact 352551946 326421789 1.08
tpch_q14/duckdb:vortex-compact 77651516 72012458 1.08
tpch_q15/duckdb:vortex-compact 🚨 128355942 112674061 1.14
tpch_q16/duckdb:vortex-compact 87691901 79811839 1.10
tpch_q17/duckdb:vortex-compact 🚨 120481306 107640468 1.12
tpch_q18/duckdb:vortex-compact 🚨 322831442 288596869 1.12
tpch_q19/duckdb:vortex-compact 🚨 108052673 97824731 1.10
tpch_q20/duckdb:vortex-compact 192734846 176304205 1.09
tpch_q21/duckdb:vortex-compact 🚨 576437416 517995435 1.11
tpch_q22/duckdb:vortex-compact 🚨 185667920 71541975 2.60
duckdb / parquet (1.052x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 280350963 261105992 1.07
tpch_q02/duckdb:parquet 109174745 105060139 1.04
tpch_q03/duckdb:parquet 222327328 209577624 1.06
tpch_q04/duckdb:parquet 144651256 134654402 1.07
tpch_q05/duckdb:parquet 238853112 225136244 1.06
tpch_q06/duckdb:parquet 76295354 75725838 1.01
tpch_q07/duckdb:parquet 199754991 186211896 1.07
tpch_q08/duckdb:parquet 283584961 261335104 1.09
tpch_q09/duckdb:parquet 508243858 475197045 1.07
tpch_q10/duckdb:parquet 648393485 623537949 1.04
tpch_q11/duckdb:parquet 67595810 64417044 1.05
tpch_q12/duckdb:parquet 136294929 130312947 1.05
tpch_q13/duckdb:parquet 🚨 467940678 413508575 1.13
tpch_q14/duckdb:parquet 187608207 178840572 1.05
tpch_q15/duckdb:parquet 111995329 105531275 1.06
tpch_q16/duckdb:parquet 158433215 164839732 0.96
tpch_q17/duckdb:parquet 190478731 180435310 1.06
tpch_q18/duckdb:parquet 385318576 367340988 1.05
tpch_q19/duckdb:parquet 299506830 285239874 1.05
tpch_q20/duckdb:parquet 240353177 232854706 1.03
tpch_q21/duckdb:parquet 599651902 569771991 1.05
tpch_q22/duckdb:parquet 302297600 293463453 1.03
duckdb / duckdb (1.069x ➖, 0↑ 3↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 125668360 120656332 1.04
tpch_q02/duckdb:duckdb 54895427 51652841 1.06
tpch_q03/duckdb:duckdb 111150998 103345618 1.08
tpch_q04/duckdb:duckdb 🚨 154371220 139408949 1.11
tpch_q05/duckdb:duckdb 130722455 119030429 1.10
tpch_q06/duckdb:duckdb 47712559 44611314 1.07
tpch_q07/duckdb:duckdb 🚨 100503664 90524359 1.11
tpch_q08/duckdb:duckdb 126471799 119321625 1.06
tpch_q09/duckdb:duckdb 304072633 286818707 1.06
tpch_q10/duckdb:duckdb 231243602 214338467 1.08
tpch_q11/duckdb:duckdb 20016374 19227292 1.04
tpch_q12/duckdb:duckdb 95911159 90282871 1.06
tpch_q13/duckdb:duckdb 🚨 255261778 231890039 1.10
tpch_q14/duckdb:duckdb 84113881 77956285 1.08
tpch_q15/duckdb:duckdb 87973646 83255781 1.06
tpch_q16/duckdb:duckdb 81123014 76123614 1.07
tpch_q17/duckdb:duckdb 92396136 87905640 1.05
tpch_q18/duckdb:duckdb 249678283 234844215 1.06
tpch_q19/duckdb:duckdb 131351259 124285144 1.06
tpch_q20/duckdb:duckdb 123923618 117901117 1.05
tpch_q21/duckdb:duckdb 330980447 302918443 1.09
tpch_q22/duckdb:duckdb 72936468 70329889 1.04
File Size Changes (27 files changed, +0.0% overall, 14↑ 13↓)
File Scale Format Base HEAD Change %
part_0.vortex 10.0 vortex-compact 16.92 MB 17.05 MB +126.77 KB +0.7%
part_0.vortex 10.0 vortex-file-compressed 24.49 MB 24.64 MB +156.69 KB +0.6%
supplier_0.vortex 10.0 vortex-file-compressed 5.69 MB 5.71 MB +19.12 KB +0.3%
part_1.vortex 10.0 vortex-file-compressed 24.83 MB 24.90 MB +70.64 KB +0.3%
orders_0.vortex 10.0 vortex-file-compressed 144.47 MB 144.83 MB +369.09 KB +0.2%
partsupp_0.vortex 10.0 vortex-compact 105.11 MB 105.36 MB +253.93 KB +0.2%
orders_2.vortex 10.0 vortex-file-compressed 145.47 MB 145.78 MB +320.14 KB +0.2%
part_1.vortex 10.0 vortex-compact 17.01 MB 17.04 MB +35.55 KB +0.2%
lineitem_11.vortex 10.0 vortex-file-compressed 134.30 MB 134.41 MB +105.73 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.07 MB 134.17 MB +102.00 KB +0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 134.19 MB 134.29 MB +99.91 KB +0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 134.17 MB 134.19 MB +25.88 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.49 MB 88.50 MB +10.79 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.31 MB 120.32 MB +13.68 KB +0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 133.45 MB 133.44 MB 8.75 KB -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 133.89 MB 133.87 MB 26.76 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.34 MB 120.31 MB 32.26 KB -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.25 MB 134.20 MB 44.39 KB -0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.09 MB 25.27 KB -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 133.73 MB 133.68 MB 51.09 KB -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.53 MB 133.46 MB 71.27 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.11 MB 134.00 MB 116.38 KB -0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 133.24 MB 133.11 MB 132.57 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.62 MB 133.41 MB 216.13 KB -0.2%
orders_1.vortex 10.0 vortex-file-compressed 145.92 MB 145.63 MB 294.85 KB -0.2%
lineitem_6.vortex 10.0 vortex-file-compressed 132.99 MB 132.67 MB 323.94 KB -0.2%
partsupp_1.vortex 10.0 vortex-compact 105.23 MB 104.92 MB 319.88 KB -0.3%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +18.1% +13.7% +3.9% +10.0% ➖ noise
1 datafusion:vortex-compact +11.5% +13.7% -1.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +12.7% +13.7% -0.9% +10.0% ➖ noise
1 duckdb:duckdb +4.2% +13.7% -8.4% +10.0% ➖ noise
1 duckdb:vortex-compact +8.1% +13.7% -4.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +3.7% +13.7% -8.8% +10.0% ➖ noise
2 datafusion:arrow +18.5% +7.0% +10.8% +10.0% 🚨 regression
2 datafusion:vortex-compact +13.4% +7.0% +6.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +14.3% +7.0% +6.8% +10.0% ➖ noise
2 duckdb:duckdb +6.3% +7.0% -0.7% +10.0% ➖ noise
2 duckdb:vortex-compact +5.3% +7.0% -1.6% +11.9% ➖ noise
2 duckdb:vortex-file-compressed +2.9% +7.0% -3.9% +10.4% ➖ noise
3 datafusion:arrow +21.7% +9.0% +11.6% +10.0% 🚨 regression
3 datafusion:vortex-compact +17.0% +9.0% +7.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +15.0% +9.0% +5.5% +10.0% ➖ noise
3 duckdb:duckdb +7.6% +9.0% -1.4% +10.0% ➖ noise
3 duckdb:vortex-compact +9.8% +9.0% +0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +11.7% +9.0% +2.4% +10.0% ➖ noise
4 datafusion:arrow +25.4% +9.2% +14.8% +10.0% 🚨 regression
4 datafusion:vortex-compact +12.5% +9.2% +3.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +18.9% +9.2% +8.8% +10.0% ➖ noise
4 duckdb:duckdb +10.7% +9.2% +1.4% +10.0% ➖ noise
4 duckdb:vortex-compact +14.3% +9.2% +4.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +12.8% +9.2% +3.3% +10.0% ➖ noise
5 datafusion:arrow +16.0% +9.9% +5.6% +10.0% ➖ noise
5 datafusion:vortex-compact +17.9% +9.9% +7.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +18.6% +9.9% +7.9% +10.0% ➖ noise
5 duckdb:duckdb +9.8% +9.9% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact +9.6% +9.9% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +8.4% +9.9% -1.3% +10.0% ➖ noise
6 datafusion:arrow +22.0% +5.6% +15.5% +10.0% 🚨 regression
6 datafusion:vortex-compact +12.6% +5.6% +6.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +8.2% +5.6% +2.5% +10.4% ➖ noise
6 duckdb:duckdb +7.0% +5.6% +1.3% +10.0% ➖ noise
6 duckdb:vortex-compact +12.3% +5.6% +6.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +24.5% +5.6% +17.8% +13.6% 🚨 regression
7 datafusion:arrow +17.8% +11.1% +6.0% +10.0% ➖ noise
7 datafusion:vortex-compact +14.5% +11.1% +3.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +18.5% +11.1% +6.6% +10.0% ➖ noise
7 duckdb:duckdb +11.0% +11.1% -0.1% +10.0% ➖ noise
7 duckdb:vortex-compact +7.8% +11.1% -3.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +12.7% +11.1% +1.4% +10.0% ➖ noise
8 datafusion:arrow +12.9% +12.5% +0.4% +10.0% ➖ noise
8 datafusion:vortex-compact +11.3% +12.5% -1.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +15.0% +12.5% +2.2% +10.0% ➖ noise
8 duckdb:duckdb +6.0% +12.5% -5.8% +10.0% ➖ noise
8 duckdb:vortex-compact +9.9% +12.5% -2.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +11.7% +12.5% -0.7% +10.0% ➖ noise
9 datafusion:arrow +13.5% +10.4% +2.9% +10.0% ➖ noise
9 datafusion:vortex-compact +16.3% +10.4% +5.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +18.7% +10.4% +7.5% +10.0% ➖ noise
9 duckdb:duckdb +6.0% +10.4% -4.0% +10.0% ➖ noise
9 duckdb:vortex-compact +10.4% +10.4% -0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +9.7% +10.4% -0.6% +10.0% ➖ noise
10 datafusion:arrow +17.3% +8.2% +8.4% +10.0% ➖ noise
10 datafusion:vortex-compact +14.8% +8.2% +6.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +20.3% +8.2% +11.2% +10.0% 🚨 regression
10 duckdb:duckdb +7.9% +8.2% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact +8.5% +8.2% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +9.3% +8.2% +1.0% +10.0% ➖ noise
11 datafusion:arrow +11.0% +6.9% +3.8% +10.0% ➖ noise
11 datafusion:vortex-compact +7.1% +6.9% +0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +7.2% +6.9% +0.4% +10.0% ➖ noise
11 duckdb:duckdb +4.1% +6.9% -2.6% +10.0% ➖ noise
11 duckdb:vortex-compact +8.9% +6.9% +1.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +6.8% +6.9% -0.1% +13.7% ➖ noise
12 datafusion:arrow +30.9% +5.1% +24.5% +35.3% ➖ noise
12 datafusion:vortex-compact +12.2% +5.1% +6.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +10.2% +5.1% +4.8% +10.0% ➖ noise
12 duckdb:duckdb +6.2% +5.1% +1.1% +10.0% ➖ noise
12 duckdb:vortex-compact +12.3% +5.1% +6.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +10.5% +5.1% +5.2% +10.0% ➖ noise
13 datafusion:arrow +14.2% +9.0% +4.7% +10.0% ➖ noise
13 datafusion:vortex-compact +13.4% +9.0% +4.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +14.6% +9.0% +5.1% +10.0% ➖ noise
13 duckdb:duckdb +10.1% +9.0% +1.0% +10.0% ➖ noise
13 duckdb:vortex-compact +8.0% +9.0% -0.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +6.6% +9.0% -2.2% +10.0% ➖ noise
14 datafusion:arrow +23.4% +8.1% +14.1% +10.0% 🚨 regression
14 datafusion:vortex-compact +12.1% +8.1% +3.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +6.7% +8.1% -1.4% +10.0% ➖ noise
14 duckdb:duckdb +7.9% +8.1% -0.2% +10.0% ➖ noise
14 duckdb:vortex-compact +7.8% +8.1% -0.3% +10.7% ➖ noise
14 duckdb:vortex-file-compressed +10.5% +8.1% +2.2% +10.0% ➖ noise
15 datafusion:arrow +22.8% +7.3% +14.5% +10.0% 🚨 regression
15 datafusion:vortex-compact +9.7% +7.3% +2.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +13.0% +7.3% +5.3% +10.0% ➖ noise
15 duckdb:duckdb +5.7% +7.3% -1.5% +10.0% ➖ noise
15 duckdb:vortex-compact +13.9% +7.3% +6.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +9.2% +7.3% +1.8% +10.0% ➖ noise
16 datafusion:arrow +12.0% +2.9% +8.9% +10.0% ➖ noise
16 datafusion:vortex-compact +15.9% +2.9% +12.7% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +10.7% +2.9% +7.6% +10.1% ➖ noise
16 duckdb:duckdb +6.6% +2.9% +3.6% +10.0% ➖ noise
16 duckdb:vortex-compact +9.9% +2.9% +6.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +12.7% +2.9% +9.5% +10.0% ➖ noise
17 datafusion:arrow +15.3% +9.9% +4.9% +10.0% ➖ noise
17 datafusion:vortex-compact +16.2% +9.9% +5.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +17.3% +9.9% +6.7% +10.0% ➖ noise
17 duckdb:duckdb +5.1% +9.9% -4.4% +10.0% ➖ noise
17 duckdb:vortex-compact +11.9% +9.9% +1.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +16.5% +9.9% +6.0% +10.0% ➖ noise
18 datafusion:arrow +18.4% +10.6% +7.0% +10.0% ➖ noise
18 datafusion:vortex-compact +16.1% +10.6% +5.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +15.5% +10.6% +4.5% +10.0% ➖ noise
18 duckdb:duckdb +6.3% +10.6% -3.9% +10.0% ➖ noise
18 duckdb:vortex-compact +11.9% +10.6% +1.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +9.7% +10.6% -0.8% +10.0% ➖ noise
19 datafusion:arrow +17.2% +10.1% +6.5% +10.0% ➖ noise
19 datafusion:vortex-compact +7.9% +10.1% -1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +13.1% +10.1% +2.8% +10.0% ➖ noise
19 duckdb:duckdb +5.7% +10.1% -4.0% +10.0% ➖ noise
19 duckdb:vortex-compact +10.5% +10.1% +0.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +6.1% +10.1% -3.6% +10.0% ➖ noise
20 datafusion:arrow +18.9% +9.5% +8.6% +10.0% ➖ noise
20 datafusion:vortex-compact +13.4% +9.5% +3.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +14.4% +9.5% +4.5% +10.0% ➖ noise
20 duckdb:duckdb +5.1% +9.5% -4.0% +10.0% ➖ noise
20 duckdb:vortex-compact +9.3% +9.5% -0.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +12.2% +9.5% +2.5% +10.0% ➖ noise
21 datafusion:arrow +9.8% +11.3% -1.3% +10.0% ➖ noise
21 datafusion:vortex-compact +18.1% +11.3% +6.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +20.0% +11.3% +7.8% +10.0% ➖ noise
21 duckdb:duckdb +9.3% +11.3% -1.8% +10.0% ➖ noise
21 duckdb:vortex-compact +11.3% +11.3% -0.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +15.4% +11.3% +3.7% +10.0% ➖ noise
22 datafusion:arrow +10.1% +2.8% +7.1% +10.0% ➖ noise
22 datafusion:vortex-compact +9.3% +2.8% +6.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +8.3% +2.8% +5.4% +10.0% ➖ noise
22 duckdb:duckdb +3.7% +2.8% +0.9% +10.0% ➖ noise
22 duckdb:vortex-compact +159.5% +2.8% +152.5% +10.0% 🚨 regression
22 duckdb:vortex-file-compressed +113.9% +2.8% +108.1% +10.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Engines: DuckDB No clear signal (+3.5%, low confidence)
Vortex (geomean): 1.119x ❌
Parquet (geomean): 1.081x ➖
Shifts: Parquet (control) +8.1% · Median polish +10.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.122x ❌, 0↑ 6↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 13834341 13033995 1.06
statpopgen_q01/duckdb:vortex-file-compressed 31900207 29212390 1.09
statpopgen_q02/duckdb:vortex-file-compressed 🚨 644516596 583606075 1.10
statpopgen_q03/duckdb:vortex-file-compressed 🚨 1283999810 1109558368 1.16
statpopgen_q04/duckdb:vortex-file-compressed 🚨 1392730478 1090746614 1.28
statpopgen_q05/duckdb:vortex-file-compressed 🚨 606153594 526786442 1.15
statpopgen_q06/duckdb:vortex-file-compressed 🚨 1750615125 1571359264 1.11
statpopgen_q07/duckdb:vortex-file-compressed 240136001 218913531 1.10
statpopgen_q08/duckdb:vortex-file-compressed 267710053 250254016 1.07
statpopgen_q09/duckdb:vortex-file-compressed 🚨 988543440 868626516 1.14
statpopgen_q10/duckdb:vortex-file-compressed 2954016224 2702220817 1.09
duckdb / vortex-compact (1.116x ❌, 0↑ 8↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 13020984 12318869 1.06
statpopgen_q01/duckdb:vortex-compact 236753480 234213198 1.01
statpopgen_q02/duckdb:vortex-compact 🚨 675311091 571966014 1.18
statpopgen_q03/duckdb:vortex-compact 🚨 1295312937 1172131279 1.11
statpopgen_q04/duckdb:vortex-compact 🚨 1366543630 1170051933 1.17
statpopgen_q05/duckdb:vortex-compact 🚨 697924000 579092869 1.21
statpopgen_q06/duckdb:vortex-compact 🚨 1674184781 1519303658 1.10
statpopgen_q07/duckdb:vortex-compact 🚨 1042291255 911959505 1.14
statpopgen_q08/duckdb:vortex-compact 1020464807 953377658 1.07
statpopgen_q09/duckdb:vortex-compact 🚨 1090846857 963477985 1.13
statpopgen_q10/duckdb:vortex-compact 🚨 2991286567 2686324314 1.11
duckdb / parquet (1.081x ➖, 0↑ 4↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 327706794 315203118 1.04
statpopgen_q01/duckdb:parquet 417326413 390895262 1.07
statpopgen_q02/duckdb:parquet 861618862 811434232 1.06
statpopgen_q03/duckdb:parquet 1351460724 1259204817 1.07
statpopgen_q04/duckdb:parquet 1377051995 1266680546 1.09
statpopgen_q05/duckdb:parquet 🚨 949849479 845673495 1.12
statpopgen_q06/duckdb:parquet 🚨 1628093681 1462011816 1.11
statpopgen_q07/duckdb:parquet 933684665 892393852 1.05
statpopgen_q08/duckdb:parquet 944291254 907092267 1.04
statpopgen_q09/duckdb:parquet 🚨 1202784864 1060193165 1.13
statpopgen_q10/duckdb:parquet 🚨 2597905664 2336163066 1.11
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 108.33 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +5.7% +4.0% +1.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +6.1% +4.0% +2.1% +10.0% ➖ noise
1 duckdb:vortex-compact +1.1% +6.8% -5.3% +17.9% ➖ noise
1 duckdb:vortex-file-compressed +9.2% +6.8% +2.3% +224.8% ➖ noise
2 duckdb:vortex-compact +18.1% +6.2% +11.2% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +10.4% +6.2% +4.0% +10.0% ➖ noise
3 duckdb:vortex-compact +10.5% +7.3% +3.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +15.7% +7.3% +7.8% +10.0% ➖ noise
4 duckdb:vortex-compact +16.8% +8.7% +7.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +27.7% +8.7% +17.5% +10.0% 🚨 regression
5 duckdb:vortex-compact +20.5% +12.3% +7.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +15.1% +12.3% +2.4% +11.2% ➖ noise
6 duckdb:vortex-compact +10.2% +11.4% -1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +11.4% +11.4% +0.0% +10.0% ➖ noise
7 duckdb:vortex-compact +14.3% +4.6% +9.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +9.7% +4.6% +4.8% +11.3% ➖ noise
8 duckdb:vortex-compact +7.0% +4.1% +2.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +7.0% +4.1% +2.8% +10.0% ➖ noise
9 duckdb:vortex-compact +13.2% +13.4% -0.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +13.8% +13.4% +0.3% +10.0% ➖ noise
10 duckdb:vortex-compact +11.4% +11.2% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +9.3% +11.2% -1.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-5.8%, environment too noisy confidence) · DuckDB No clear signal (+6.4%, environment too noisy confidence)
Vortex (geomean): 0.966x ➖
Parquet (geomean): 0.965x ➖
Shifts: Parquet (control) -3.5% · Median polish -2.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.911x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 268497820 292745606 0.92
tpch_q02/datafusion:vortex-file-compressed 656208689 599946318 1.09
tpch_q03/datafusion:vortex-file-compressed 521117028 654349674 0.80
tpch_q04/datafusion:vortex-file-compressed 275494568 332897478 0.83
tpch_q05/datafusion:vortex-file-compressed 560638169 534063751 1.05
tpch_q06/datafusion:vortex-file-compressed 348127521 363911139 0.96
tpch_q07/datafusion:vortex-file-compressed 516559900 460085283 1.12
tpch_q08/datafusion:vortex-file-compressed 668290002 719934719 0.93
tpch_q09/datafusion:vortex-file-compressed 489526619 534370640 0.92
tpch_q10/datafusion:vortex-file-compressed 584699117 689995164 0.85
tpch_q11/datafusion:vortex-file-compressed 275508521 352430713 0.78
tpch_q12/datafusion:vortex-file-compressed 538131196 658718208 0.82
tpch_q13/datafusion:vortex-file-compressed 184228402 223393337 0.82
tpch_q14/datafusion:vortex-file-compressed 266049924 353915958 0.75
tpch_q15/datafusion:vortex-file-compressed 494865254 587005760 0.84
tpch_q16/datafusion:vortex-file-compressed 208327417 229211593 0.91
tpch_q17/datafusion:vortex-file-compressed 509066982 693716139 0.73
tpch_q18/datafusion:vortex-file-compressed 424237230 446783973 0.95
tpch_q19/datafusion:vortex-file-compressed 667875936 658201894 1.01
tpch_q20/datafusion:vortex-file-compressed 495054278 504803985 0.98
tpch_q21/datafusion:vortex-file-compressed 677512617 668368444 1.01
tpch_q22/datafusion:vortex-file-compressed 124858678 111950425 1.12
datafusion / vortex-compact (0.989x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 272421362 278143386 0.98
tpch_q02/datafusion:vortex-compact 445059920 525932757 0.85
tpch_q03/datafusion:vortex-compact 484163626 643760419 0.75
tpch_q04/datafusion:vortex-compact 281287664 237724332 1.18
tpch_q05/datafusion:vortex-compact 470792541 543926469 0.87
tpch_q06/datafusion:vortex-compact 421462306 330344589 1.28
tpch_q07/datafusion:vortex-compact 485676125 498782184 0.97
tpch_q08/datafusion:vortex-compact 583456098 616280069 0.95
tpch_q09/datafusion:vortex-compact 467874657 482205574 0.97
tpch_q10/datafusion:vortex-compact 569986373 677314909 0.84
tpch_q11/datafusion:vortex-compact 380786590 356561909 1.07
tpch_q12/datafusion:vortex-compact 🚨 549379925 419794263 1.31
tpch_q13/datafusion:vortex-compact 147185042 149275038 0.99
tpch_q14/datafusion:vortex-compact 314045979 331910602 0.95
tpch_q15/datafusion:vortex-compact 514170623 618597895 0.83
tpch_q16/datafusion:vortex-compact 218209615 215598828 1.01
tpch_q17/datafusion:vortex-compact 430522360 439134568 0.98
tpch_q18/datafusion:vortex-compact 397502196 354125064 1.12
tpch_q19/datafusion:vortex-compact 582198782 486067598 1.20
tpch_q20/datafusion:vortex-compact 430170092 465060375 0.92
tpch_q21/datafusion:vortex-compact 853889097 821593677 1.04
tpch_q22/datafusion:vortex-compact 185318967 201432674 0.92
datafusion / parquet (1.008x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 371388191 243235085 1.53
tpch_q02/datafusion:parquet 536788833 447847503 1.20
tpch_q03/datafusion:parquet 429858616 386109228 1.11
tpch_q04/datafusion:parquet 217760179 202584380 1.07
tpch_q05/datafusion:parquet 571917989 567090680 1.01
tpch_q06/datafusion:parquet 170909604 242947038 0.70
tpch_q07/datafusion:parquet 518147444 634917905 0.82
tpch_q08/datafusion:parquet 671546142 740518284 0.91
tpch_q09/datafusion:parquet 511313655 608221294 0.84
tpch_q10/datafusion:parquet 517335271 625728610 0.83
tpch_q11/datafusion:parquet 337061325 369479338 0.91
tpch_q12/datafusion:parquet 246374697 259563119 0.95
tpch_q13/datafusion:parquet 461283290 450239014 1.02
tpch_q14/datafusion:parquet 243546494 266520922 0.91
tpch_q15/datafusion:parquet 455304837 381234519 1.19
tpch_q16/datafusion:parquet 188877098 207351641 0.91
tpch_q17/datafusion:parquet 510017631 514236118 0.99
tpch_q18/datafusion:parquet 692166831 787872833 0.88
tpch_q19/datafusion:parquet 534686420 460517273 1.16
tpch_q20/datafusion:parquet 450541207 391091497 1.15
tpch_q21/datafusion:parquet 696673937 612499704 1.14
tpch_q22/datafusion:parquet 233593630 183139700 1.28
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 272915869 307999935 0.89
tpch_q02/duckdb:vortex-file-compressed 1005316814 1065882516 0.94
tpch_q03/duckdb:vortex-file-compressed 711772144 767132463 0.93
tpch_q04/duckdb:vortex-file-compressed 503113246 546071129 0.92
tpch_q05/duckdb:vortex-file-compressed 877454789 967760208 0.91
tpch_q06/duckdb:vortex-file-compressed 334301108 428111741 0.78
tpch_q07/duckdb:vortex-file-compressed 1026035253 1010053530 1.02
tpch_q08/duckdb:vortex-file-compressed 1087046591 1139447393 0.95
tpch_q09/duckdb:vortex-file-compressed 975796991 949710481 1.03
tpch_q10/duckdb:vortex-file-compressed 821126152 850383347 0.97
tpch_q11/duckdb:vortex-file-compressed 513852632 572539436 0.90
tpch_q12/duckdb:vortex-file-compressed 742452146 702044149 1.06
tpch_q13/duckdb:vortex-file-compressed 543393534 467453640 1.16
tpch_q14/duckdb:vortex-file-compressed 430836210 439301758 0.98
tpch_q15/duckdb:vortex-file-compressed 348742216 316876858 1.10
tpch_q16/duckdb:vortex-file-compressed 408028217 408896222 1.00
tpch_q17/duckdb:vortex-file-compressed 817963733 858308045 0.95
tpch_q18/duckdb:vortex-file-compressed 672324935 714161069 0.94
tpch_q19/duckdb:vortex-file-compressed 529544227 503229878 1.05
tpch_q20/duckdb:vortex-file-compressed 862195738 924813047 0.93
tpch_q21/duckdb:vortex-file-compressed 1149790018 1111318405 1.03
tpch_q22/duckdb:vortex-file-compressed 🚨 407767961 287429773 1.42
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 315006791 344789474 0.91
tpch_q02/duckdb:vortex-compact 971734527 999842116 0.97
tpch_q03/duckdb:vortex-compact 595880625 629752608 0.95
tpch_q04/duckdb:vortex-compact 358909750 504151733 0.71
tpch_q05/duckdb:vortex-compact 816135923 839442336 0.97
tpch_q06/duckdb:vortex-compact 386139063 399609902 0.97
tpch_q07/duckdb:vortex-compact 998478375 887039094 1.13
tpch_q08/duckdb:vortex-compact 1000981473 1066361257 0.94
tpch_q09/duckdb:vortex-compact 1066595421 1181065099 0.90
tpch_q10/duckdb:vortex-compact 724916103 783829832 0.92
tpch_q11/duckdb:vortex-compact 526572799 567988019 0.93
tpch_q12/duckdb:vortex-compact 714734943 685284486 1.04
tpch_q13/duckdb:vortex-compact 411235412 406762250 1.01
tpch_q14/duckdb:vortex-compact 441527437 404020661 1.09
tpch_q15/duckdb:vortex-compact 321768768 360135214 0.89
tpch_q16/duckdb:vortex-compact 347454645 342620553 1.01
tpch_q17/duckdb:vortex-compact 784633432 709798051 1.11
tpch_q18/duckdb:vortex-compact 530112124 589891424 0.90
tpch_q19/duckdb:vortex-compact 530723594 518538536 1.02
tpch_q20/duckdb:vortex-compact 879136278 860198032 1.02
tpch_q21/duckdb:vortex-compact 1170277564 1077701347 1.09
tpch_q22/duckdb:vortex-compact 343085998 292265958 1.17
duckdb / parquet (0.924x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 515433983 556749902 0.93
tpch_q02/duckdb:parquet 1195653494 1192226649 1.00
tpch_q03/duckdb:parquet 1041813252 1177774288 0.88
tpch_q04/duckdb:parquet 736624067 736523506 1.00
tpch_q05/duckdb:parquet 1296139592 1485825337 0.87
tpch_q06/duckdb:parquet 480977952 493241355 0.98
tpch_q07/duckdb:parquet 1194852904 1387319582 0.86
tpch_q08/duckdb:parquet 1586216018 1945227184 0.82
tpch_q09/duckdb:parquet 1527068603 1827696218 0.84
tpch_q10/duckdb:parquet 1367505587 1427903880 0.96
tpch_q11/duckdb:parquet 846003505 850995337 0.99
tpch_q12/duckdb:parquet 676051467 895939570 0.75
tpch_q13/duckdb:parquet 957182226 1034457094 0.93
tpch_q14/duckdb:parquet 777692912 880345346 0.88
tpch_q15/duckdb:parquet 573800646 598325699 0.96
tpch_q16/duckdb:parquet 662956865 758035252 0.87
tpch_q17/duckdb:parquet 885954798 892651572 0.99
tpch_q18/duckdb:parquet 977765191 1026470342 0.95
tpch_q19/duckdb:parquet 944955723 945985268 1.00
tpch_q20/duckdb:parquet 1239432232 1213886416 1.02
tpch_q21/duckdb:parquet 1178036712 1257370620 0.94
tpch_q22/duckdb:parquet 573828082 600561114 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.1% +18.9% -17.6% +87.9% ➖ noise
1 datafusion:vortex-file-compressed -8.3% +18.9% -22.9% +70.3% ➖ noise
1 duckdb:vortex-compact -8.6% +18.9% -23.2% +51.1% ➖ noise
1 duckdb:vortex-file-compressed -11.4% +18.9% -25.5% +60.5% ➖ noise
2 datafusion:vortex-compact -15.4% +9.6% -22.8% +31.8% ➖ noise
2 datafusion:vortex-file-compressed +9.4% +9.6% -0.2% +31.8% ➖ noise
2 duckdb:vortex-compact -2.8% +9.6% -11.4% +31.8% ➖ noise
2 duckdb:vortex-file-compressed -5.7% +9.6% -14.0% +31.8% ➖ noise
3 datafusion:vortex-compact -24.8% -0.8% -24.2% +45.0% ➖ noise
3 datafusion:vortex-file-compressed -20.4% -0.8% -19.7% +58.6% ➖ noise
3 duckdb:vortex-compact -5.4% -0.8% -4.7% +33.7% ➖ noise
3 duckdb:vortex-file-compressed -7.2% -0.8% -6.5% +37.8% ➖ noise
4 datafusion:vortex-compact +18.3% +3.7% +14.1% +50.1% ➖ noise
4 datafusion:vortex-file-compressed -17.2% +3.7% -20.2% +31.8% ➖ noise
4 duckdb:vortex-compact -28.8% +3.7% -31.3% +34.3% ✅ faster
4 duckdb:vortex-file-compressed -7.9% +3.7% -11.1% +34.7% ➖ noise
5 datafusion:vortex-compact -13.4% -6.2% -7.7% +37.3% ➖ noise
5 datafusion:vortex-file-compressed +5.0% -6.2% +11.9% +36.0% ➖ noise
5 duckdb:vortex-compact -2.8% -6.2% +3.7% +32.2% ➖ noise
5 duckdb:vortex-file-compressed -9.3% -6.2% -3.3% +31.8% ➖ noise
6 datafusion:vortex-compact +27.6% -17.2% +54.0% +31.8% 🚨 regression
6 datafusion:vortex-file-compressed -4.3% -17.2% +15.5% +31.8% ➖ noise
6 duckdb:vortex-compact -3.4% -17.2% +16.7% +31.8% ➖ noise
6 duckdb:vortex-file-compressed -21.9% -17.2% -5.7% +31.8% ➖ noise
7 datafusion:vortex-compact -2.6% -16.2% +16.1% +31.8% ➖ noise
7 datafusion:vortex-file-compressed +12.3% -16.2% +33.9% +31.8% 🚨 regression
7 duckdb:vortex-compact +12.6% -16.2% +34.3% +31.8% 🚨 regression
7 duckdb:vortex-file-compressed +1.6% -16.2% +21.2% +31.8% ➖ noise
8 datafusion:vortex-compact -5.3% -14.0% +10.1% +31.8% ➖ noise
8 datafusion:vortex-file-compressed -7.2% -14.0% +7.9% +31.8% ➖ noise
8 duckdb:vortex-compact -6.1% -14.0% +9.2% +31.8% ➖ noise
8 duckdb:vortex-file-compressed -4.6% -14.0% +10.9% +31.8% ➖ noise
9 datafusion:vortex-compact -3.0% -16.2% +15.8% +31.8% ➖ noise
9 datafusion:vortex-file-compressed -8.4% -16.2% +9.3% +33.9% ➖ noise
9 duckdb:vortex-compact -9.7% -16.2% +7.8% +31.8% ➖ noise
9 duckdb:vortex-file-compressed +2.7% -16.2% +22.6% +31.8% ➖ noise
10 datafusion:vortex-compact -15.8% -11.0% -5.4% +31.8% ➖ noise
10 datafusion:vortex-file-compressed -15.3% -11.0% -4.8% +39.8% ➖ noise
10 duckdb:vortex-compact -7.5% -11.0% +3.9% +31.8% ➖ noise
10 duckdb:vortex-file-compressed -3.4% -11.0% +8.5% +31.8% ➖ noise
11 datafusion:vortex-compact +6.8% -4.8% +12.1% +31.8% ➖ noise
11 datafusion:vortex-file-compressed -21.8% -4.8% -17.9% +34.9% ➖ noise
11 duckdb:vortex-compact -7.3% -4.8% -2.6% +31.8% ➖ noise
11 duckdb:vortex-file-compressed -10.3% -4.8% -5.8% +31.8% ➖ noise
12 datafusion:vortex-compact +30.9% -15.4% +54.6% +47.2% 🚨 regression
12 datafusion:vortex-file-compressed -18.3% -15.4% -3.5% +44.6% ➖ noise
12 duckdb:vortex-compact +4.3% -15.4% +23.2% +41.5% ➖ noise
12 duckdb:vortex-file-compressed +5.8% -15.4% +25.0% +54.1% ➖ noise
13 datafusion:vortex-compact -1.4% -2.6% +1.3% +53.9% ➖ noise
13 datafusion:vortex-file-compressed -17.5% -2.6% -15.3% +51.7% ➖ noise
13 duckdb:vortex-compact +1.1% -2.6% +3.8% +31.8% ➖ noise
13 duckdb:vortex-file-compressed +16.2% -2.6% +19.4% +34.4% ➖ noise
14 datafusion:vortex-compact -5.4% -10.2% +5.3% +34.6% ➖ noise
14 datafusion:vortex-file-compressed -24.8% -10.2% -16.3% +36.8% ➖ noise
14 duckdb:vortex-compact +9.3% -10.2% +21.6% +38.4% ➖ noise
14 duckdb:vortex-file-compressed -1.9% -10.2% +9.2% +31.8% ➖ noise
15 datafusion:vortex-compact -16.9% +7.0% -22.3% +31.8% ➖ noise
15 datafusion:vortex-file-compressed -15.7% +7.0% -21.2% +31.8% ➖ noise
15 duckdb:vortex-compact -10.7% +7.0% -16.5% +40.6% ➖ noise
15 duckdb:vortex-file-compressed +10.1% +7.0% +2.8% +40.4% ➖ noise
16 datafusion:vortex-compact +1.2% -10.7% +13.4% +31.8% ➖ noise
16 datafusion:vortex-file-compressed -9.1% -10.7% +1.8% +31.8% ➖ noise
16 duckdb:vortex-compact +1.4% -10.7% +13.6% +31.8% ➖ noise
16 duckdb:vortex-file-compressed -0.2% -10.7% +11.8% +31.8% ➖ noise
17 datafusion:vortex-compact -2.0% -0.8% -1.2% +34.7% ➖ noise
17 datafusion:vortex-file-compressed -26.6% -0.8% -26.0% +31.8% ✅ faster
17 duckdb:vortex-compact +10.5% -0.8% +11.4% +31.8% ➖ noise
17 duckdb:vortex-file-compressed -4.7% -0.8% -3.9% +31.8% ➖ noise
18 datafusion:vortex-compact +12.2% -8.5% +22.7% +34.7% ➖ noise
18 datafusion:vortex-file-compressed -5.0% -8.5% +3.8% +31.8% ➖ noise
18 duckdb:vortex-compact -10.1% -8.5% -1.8% +31.8% ➖ noise
18 duckdb:vortex-file-compressed -5.9% -8.5% +2.9% +31.8% ➖ noise
19 datafusion:vortex-compact +19.8% +7.7% +11.2% +31.8% ➖ noise
19 datafusion:vortex-file-compressed +1.5% +7.7% -5.8% +31.8% ➖ noise
19 duckdb:vortex-compact +2.3% +7.7% -5.0% +92.4% ➖ noise
19 duckdb:vortex-file-compressed +5.2% +7.7% -2.3% +31.8% ➖ noise
20 datafusion:vortex-compact -7.5% +8.5% -14.7% +31.8% ➖ noise
20 datafusion:vortex-file-compressed -1.9% +8.5% -9.6% +31.8% ➖ noise
20 duckdb:vortex-compact +2.2% +8.5% -5.8% +31.8% ➖ noise
20 duckdb:vortex-file-compressed -6.8% +8.5% -14.0% +31.8% ➖ noise
21 datafusion:vortex-compact +3.9% +3.2% +0.7% +31.8% ➖ noise
21 datafusion:vortex-file-compressed +1.4% +3.2% -1.8% +31.8% ➖ noise
21 duckdb:vortex-compact +8.6% +3.2% +5.2% +31.8% ➖ noise
21 duckdb:vortex-file-compressed +3.5% +3.2% +0.2% +31.8% ➖ noise
22 datafusion:vortex-compact -8.0% +10.4% -16.7% +31.8% ➖ noise
22 datafusion:vortex-file-compressed +11.5% +10.4% +1.0% +31.8% ➖ noise
22 duckdb:vortex-compact +17.4% +10.4% +6.3% +31.8% ➖ noise
22 duckdb:vortex-file-compressed +41.9% +10.4% +28.5% +31.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.990x ➖, 1↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1640828 1662891 0.99
clickbench_q01/datafusion:vortex-file-compressed 16917321 17497090 0.97
clickbench_q02/datafusion:vortex-file-compressed 34378753 36783297 0.93
clickbench_q03/datafusion:vortex-file-compressed 41127165 41657760 0.99
clickbench_q04/datafusion:vortex-file-compressed 287226853 280567295 1.02
clickbench_q05/datafusion:vortex-file-compressed 324413698 336694117 0.96
clickbench_q06/datafusion:vortex-file-compressed 1637226 1641562 1.00
clickbench_q07/datafusion:vortex-file-compressed 19799577 20490827 0.97
clickbench_q08/datafusion:vortex-file-compressed 344496323 354185147 0.97
clickbench_q09/datafusion:vortex-file-compressed 533941758 553880745 0.96
clickbench_q10/datafusion:vortex-file-compressed 73594472 75769922 0.97
clickbench_q11/datafusion:vortex-file-compressed 88636494 85630263 1.04
clickbench_q12/datafusion:vortex-file-compressed 303209475 288350235 1.05
clickbench_q13/datafusion:vortex-file-compressed 430093915 440705424 0.98
clickbench_q14/datafusion:vortex-file-compressed 270625396 271070828 1.00
clickbench_q15/datafusion:vortex-file-compressed 321419651 321540049 1.00
clickbench_q16/datafusion:vortex-file-compressed 661115445 679226103 0.97
clickbench_q17/datafusion:vortex-file-compressed 643665898 661527142 0.97
clickbench_q18/datafusion:vortex-file-compressed 🚀 1328806994 1518934657 0.87
clickbench_q19/datafusion:vortex-file-compressed 29088049 29145853 1.00
clickbench_q20/datafusion:vortex-file-compressed 329756598 329320386 1.00
clickbench_q21/datafusion:vortex-file-compressed 415184007 420165982 0.99
clickbench_q22/datafusion:vortex-file-compressed 514654758 534256263 0.96
clickbench_q23/datafusion:vortex-file-compressed 524983984 538329881 0.98
clickbench_q24/datafusion:vortex-file-compressed 51932908 53243245 0.98
clickbench_q25/datafusion:vortex-file-compressed 78458144 75210519 1.04
clickbench_q26/datafusion:vortex-file-compressed 46897263 46893363 1.00
clickbench_q27/datafusion:vortex-file-compressed 778306940 779888388 1.00
clickbench_q28/datafusion:vortex-file-compressed 5970413186 5871474703 1.02
clickbench_q29/datafusion:vortex-file-compressed 227198407 218328357 1.04
clickbench_q30/datafusion:vortex-file-compressed 266965143 266629634 1.00
clickbench_q31/datafusion:vortex-file-compressed 288353436 288248908 1.00
clickbench_q32/datafusion:vortex-file-compressed 🚨 1300835182 1136738438 1.14
clickbench_q33/datafusion:vortex-file-compressed 1347848569 1373270169 0.98
clickbench_q34/datafusion:vortex-file-compressed 1381441849 1370431666 1.01
clickbench_q35/datafusion:vortex-file-compressed 450410351 461411262 0.98
clickbench_q36/datafusion:vortex-file-compressed 73094783 77452179 0.94
clickbench_q37/datafusion:vortex-file-compressed 36093355 35771380 1.01
clickbench_q38/datafusion:vortex-file-compressed 20676418 21224821 0.97
clickbench_q39/datafusion:vortex-file-compressed 144026562 144290653 1.00
clickbench_q40/datafusion:vortex-file-compressed 16078980 16686957 0.96
clickbench_q41/datafusion:vortex-file-compressed 14853595 15417458 0.96
clickbench_q42/datafusion:vortex-file-compressed 18605297 18337520 1.01
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1554279 1527101 1.02
clickbench_q01/datafusion:parquet 19747607 20012741 0.99
clickbench_q02/datafusion:parquet 46060764 47889157 0.96
clickbench_q03/datafusion:parquet 36337746 37376538 0.97
clickbench_q04/datafusion:parquet 297946372 305588086 0.97
clickbench_q05/datafusion:parquet 357637822 352923898 1.01
clickbench_q06/datafusion:parquet 1591945 1619732 0.98
clickbench_q07/datafusion:parquet 22628193 22470783 1.01
clickbench_q08/datafusion:parquet 368501423 373445892 0.99
clickbench_q09/datafusion:parquet 619118054 621668024 1.00
clickbench_q10/datafusion:parquet 107136854 108254253 0.99
clickbench_q11/datafusion:parquet 128177426 131936080 0.97
clickbench_q12/datafusion:parquet 345631978 354203420 0.98
clickbench_q13/datafusion:parquet 489947159 516688918 0.95
clickbench_q14/datafusion:parquet 337571563 339312933 0.99
clickbench_q15/datafusion:parquet 339475850 345274446 0.98
clickbench_q16/datafusion:parquet 675466157 681411910 0.99
clickbench_q17/datafusion:parquet 662080078 670308793 0.99
clickbench_q18/datafusion:parquet 1367809102 1386447648 0.99
clickbench_q19/datafusion:parquet 31904408 29986460 1.06
clickbench_q20/datafusion:parquet 592574815 601855722 0.98
clickbench_q21/datafusion:parquet 647484051 665618382 0.97
clickbench_q22/datafusion:parquet 974810058 968491526 1.01
clickbench_q23/datafusion:parquet 3641155163 3775848071 0.96
clickbench_q24/datafusion:parquet 83752515 82930442 1.01
clickbench_q25/datafusion:parquet 129756672 136463150 0.95
clickbench_q26/datafusion:parquet 84243732 83388175 1.01
clickbench_q27/datafusion:parquet 1057921309 1076861051 0.98
clickbench_q28/datafusion:parquet 6680347072 6720147285 0.99
clickbench_q29/datafusion:parquet 238233459 232285410 1.03
clickbench_q30/datafusion:parquet 325252103 335013675 0.97
clickbench_q31/datafusion:parquet 369355054 385771167 0.96
clickbench_q32/datafusion:parquet 1215675809 1211975976 1.00
clickbench_q33/datafusion:parquet 1487435102 1504917219 0.99
clickbench_q34/datafusion:parquet 1458197872 1520067837 0.96
clickbench_q35/datafusion:parquet 478626498 473457979 1.01
clickbench_q36/datafusion:parquet 142056760 153988973 0.92
clickbench_q37/datafusion:parquet 57228892 58086934 0.99
clickbench_q38/datafusion:parquet 85233253 87518908 0.97
clickbench_q39/datafusion:parquet 267676516 272403071 0.98
clickbench_q40/datafusion:parquet 31405163 30863149 1.02
clickbench_q41/datafusion:parquet 26845810 26552161 1.01
clickbench_q42/datafusion:parquet 29833164 31091251 0.96
duckdb / vortex-file-compressed (0.985x ➖, 1↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6554463 6045019 1.08
clickbench_q01/duckdb:vortex-file-compressed 11368161 12051593 0.94
clickbench_q02/duckdb:vortex-file-compressed 25669204 26225921 0.98
clickbench_q03/duckdb:vortex-file-compressed 29896875 30709300 0.97
clickbench_q04/duckdb:vortex-file-compressed 187810647 189824712 0.99
clickbench_q05/duckdb:vortex-file-compressed 178540755 186941297 0.96
clickbench_q06/duckdb:vortex-file-compressed 19501232 20379600 0.96
clickbench_q07/duckdb:vortex-file-compressed 14561498 14339057 1.02
clickbench_q08/duckdb:vortex-file-compressed 263893794 261996401 1.01
clickbench_q09/duckdb:vortex-file-compressed 335002399 346910308 0.97
clickbench_q10/duckdb:vortex-file-compressed 68396603 71125165 0.96
clickbench_q11/duckdb:vortex-file-compressed 78499590 80117786 0.98
clickbench_q12/duckdb:vortex-file-compressed 200046505 204318116 0.98
clickbench_q13/duckdb:vortex-file-compressed 404787708 417533062 0.97
clickbench_q14/duckdb:vortex-file-compressed 230225609 233560122 0.99
clickbench_q15/duckdb:vortex-file-compressed 249168647 250302332 1.00
clickbench_q16/duckdb:vortex-file-compressed 532355499 532217374 1.00
clickbench_q17/duckdb:vortex-file-compressed 424749135 423215236 1.00
clickbench_q18/duckdb:vortex-file-compressed 949126651 948669582 1.00
clickbench_q19/duckdb:vortex-file-compressed 21623298 21859384 0.99
clickbench_q20/duckdb:vortex-file-compressed 305667198 322718218 0.95
clickbench_q21/duckdb:vortex-file-compressed 398419247 406784635 0.98
clickbench_q22/duckdb:vortex-file-compressed 642917005 667621454 0.96
clickbench_q23/duckdb:vortex-file-compressed 🚀 154696731 190197027 0.81
clickbench_q24/duckdb:vortex-file-compressed 47692017 43910860 1.09
clickbench_q25/duckdb:vortex-file-compressed 73433425 79292498 0.93
clickbench_q26/duckdb:vortex-file-compressed 49555921 49894287 0.99
clickbench_q27/duckdb:vortex-file-compressed 505381255 534554850 0.95
clickbench_q28/duckdb:vortex-file-compressed 3059213186 3094557927 0.99
clickbench_q29/duckdb:vortex-file-compressed 28140476 28038137 1.00
clickbench_q30/duckdb:vortex-file-compressed 215270100 217591604 0.99
clickbench_q31/duckdb:vortex-file-compressed 316580104 317638016 1.00
clickbench_q32/duckdb:vortex-file-compressed 1107161045 1131037485 0.98
clickbench_q33/duckdb:vortex-file-compressed 1128623719 1154830182 0.98
clickbench_q34/duckdb:vortex-file-compressed 1192514414 1267310676 0.94
clickbench_q35/duckdb:vortex-file-compressed 376885381 380704047 0.99
clickbench_q36/duckdb:vortex-file-compressed 27988763 27776522 1.01
clickbench_q37/duckdb:vortex-file-compressed 19621617 19948422 0.98
clickbench_q38/duckdb:vortex-file-compressed 22368934 21865462 1.02
clickbench_q39/duckdb:vortex-file-compressed 43912422 46851363 0.94
clickbench_q40/duckdb:vortex-file-compressed 20778718 20634056 1.01
clickbench_q41/duckdb:vortex-file-compressed 20797036 20462401 1.02
clickbench_q42/duckdb:vortex-file-compressed 🚨 23505098 20270610 1.16
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22551897 23000976 0.98
clickbench_q01/duckdb:parquet 30306884 28698378 1.06
clickbench_q02/duckdb:parquet 50225765 49685795 1.01
clickbench_q03/duckdb:parquet 39347175 40952035 0.96
clickbench_q04/duckdb:parquet 201222378 204558858 0.98
clickbench_q05/duckdb:parquet 261666287 262269038 1.00
clickbench_q06/duckdb:parquet 46584516 47829266 0.97
clickbench_q07/duckdb:parquet 31580451 31137188 1.01
clickbench_q08/duckdb:parquet 275900340 269311698 1.02
clickbench_q09/duckdb:parquet 399872053 399870587 1.00
clickbench_q10/duckdb:parquet 82630504 82034627 1.01
clickbench_q11/duckdb:parquet 100305847 99587599 1.01
clickbench_q12/duckdb:parquet 281740781 281972544 1.00
clickbench_q13/duckdb:parquet 468265246 470466281 1.00
clickbench_q14/duckdb:parquet 314547590 318027169 0.99
clickbench_q15/duckdb:parquet 256409928 259612710 0.99
clickbench_q16/duckdb:parquet 595588024 603311737 0.99
clickbench_q17/duckdb:parquet 496909485 502195341 0.99
clickbench_q18/duckdb:parquet 1030669061 1042889407 0.99
clickbench_q19/duckdb:parquet 27615921 27680517 1.00
clickbench_q20/duckdb:parquet 416403026 414958978 1.00
clickbench_q21/duckdb:parquet 535527075 534003237 1.00
clickbench_q22/duckdb:parquet 914862273 916564259 1.00
clickbench_q23/duckdb:parquet 268237756 263418694 1.02
clickbench_q24/duckdb:parquet 70444987 71734765 0.98
clickbench_q25/duckdb:parquet 163103732 163359868 1.00
clickbench_q26/duckdb:parquet 53959143 57188619 0.94
clickbench_q27/duckdb:parquet 644344246 640756711 1.01
clickbench_q28/duckdb:parquet 4889713626 4885512707 1.00
clickbench_q29/duckdb:parquet 42065728 42511500 0.99
clickbench_q30/duckdb:parquet 310115471 312800615 0.99
clickbench_q31/duckdb:parquet 375626952 377962603 0.99
clickbench_q32/duckdb:parquet 1098814395 1115867807 0.98
clickbench_q33/duckdb:parquet 1093697973 1115571859 0.98
clickbench_q34/duckdb:parquet 1146287543 1155197444 0.99
clickbench_q35/duckdb:parquet 369603905 371987986 0.99
clickbench_q36/duckdb:parquet 44495995 47743901 0.93
clickbench_q37/duckdb:parquet 33906519 34528569 0.98
clickbench_q38/duckdb:parquet 35752935 36754906 0.97
clickbench_q39/duckdb:parquet 87424011 84751131 1.03
clickbench_q40/duckdb:parquet 19706447 20365270 0.97
clickbench_q41/duckdb:parquet 20463546 20607615 0.99
clickbench_q42/duckdb:parquet 22464271 22082937 1.02
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18094635 17181883 1.05
clickbench_q01/duckdb:duckdb 35394197 33890127 1.04
clickbench_q02/duckdb:duckdb 53704398 51227998 1.05
clickbench_q03/duckdb:duckdb 59069216 55320652 1.07
clickbench_q04/duckdb:duckdb 224932364 213290529 1.05
clickbench_q05/duckdb:duckdb 291026540 282440808 1.03
clickbench_q06/duckdb:duckdb 35805993 34267307 1.04
clickbench_q07/duckdb:duckdb 35967441 34834704 1.03
clickbench_q08/duckdb:duckdb 272908923 275194804 0.99
clickbench_q09/duckdb:duckdb 389092770 393710287 0.99
clickbench_q10/duckdb:duckdb 115644826 117487757 0.98
clickbench_q11/duckdb:duckdb 125869231 126915086 0.99
clickbench_q12/duckdb:duckdb 259715314 259914531 1.00
clickbench_q13/duckdb:duckdb 441527134 442951734 1.00
clickbench_q14/duckdb:duckdb 284322564 285497296 1.00
clickbench_q15/duckdb:duckdb 245615833 241611753 1.02
clickbench_q16/duckdb:duckdb 559552634 557876308 1.00
clickbench_q17/duckdb:duckdb 467359594 472323285 0.99
clickbench_q18/duckdb:duckdb 985383560 1009783214 0.98
clickbench_q19/duckdb:duckdb 34486283 34967182 0.99
clickbench_q20/duckdb:duckdb 452582011 485087406 0.93
clickbench_q21/duckdb:duckdb 464727974 475636387 0.98
clickbench_q22/duckdb:duckdb 538761287 545989011 0.99
clickbench_q23/duckdb:duckdb 250393977 258387528 0.97
clickbench_q24/duckdb:duckdb 60529053 60918823 0.99
clickbench_q25/duckdb:duckdb 149188772 149993880 0.99
clickbench_q26/duckdb:duckdb 61310786 62206844 0.99
clickbench_q27/duckdb:duckdb 548119904 552098644 0.99
clickbench_q28/duckdb:duckdb 4533541526 4509626789 1.01
clickbench_q29/duckdb:duckdb 50569712 51284697 0.99
clickbench_q30/duckdb:duckdb 274614707 278145850 0.99
clickbench_q31/duckdb:duckdb 363702324 368375366 0.99
clickbench_q32/duckdb:duckdb 1104717141 1116952787 0.99
clickbench_q33/duckdb:duckdb 1101193153 1117217073 0.99
clickbench_q34/duckdb:duckdb 1188632616 1198831465 0.99
clickbench_q35/duckdb:duckdb 306269138 299337035 1.02
clickbench_q36/duckdb:duckdb 48518399 50361154 0.96
clickbench_q37/duckdb:duckdb 29026439 28714644 1.01
clickbench_q38/duckdb:duckdb 32979027 33750034 0.98
clickbench_q39/duckdb:duckdb 78676020 79563300 0.99
clickbench_q40/duckdb:duckdb 28268787 27878138 1.01
clickbench_q41/duckdb:duckdb 27285765 27135388 1.01
clickbench_q42/duckdb:duckdb 29685286 30822841 0.96
File Size Changes (105 files changed, +0.0% overall, 59↑ 46↓)
File Scale Format Base HEAD Change %
hits_71.vortex 1.0 vortex-compact 69.18 MB 69.46 MB +284.83 KB +0.4%
hits_25.vortex 1.0 vortex-file-compressed 114.13 MB 114.59 MB +463.74 KB +0.4%
hits_21.vortex 1.0 vortex-compact 51.39 MB 51.53 MB +144.64 KB +0.3%
hits_57.vortex 1.0 vortex-file-compressed 128.16 MB 128.44 MB +288.31 KB +0.2%
hits_68.vortex 1.0 vortex-file-compressed 123.05 MB 123.31 MB +266.20 KB +0.2%
hits_53.vortex 1.0 vortex-file-compressed 87.52 MB 87.70 MB +186.17 KB +0.2%
hits_38.vortex 1.0 vortex-file-compressed 99.22 MB 99.36 MB +144.02 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.42 MB 184.68 MB +259.79 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.51 MB 168.73 MB +226.10 KB +0.1%
hits_80.vortex 1.0 vortex-file-compressed 104.90 MB 105.03 MB +128.66 KB +0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.35 MB 90.46 MB +109.08 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.79 MB 75.87 MB +88.83 KB +0.1%
hits_52.vortex 1.0 vortex-file-compressed 105.27 MB 105.39 MB +122.66 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.00 MB 94.10 MB +105.88 KB +0.1%
hits_37.vortex 1.0 vortex-file-compressed 85.81 MB 85.90 MB +94.81 KB +0.1%
hits_27.vortex 1.0 vortex-file-compressed 122.35 MB 122.47 MB +117.51 KB +0.1%
hits_84.vortex 1.0 vortex-file-compressed 117.43 MB 117.54 MB +112.38 KB +0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.50 MB 172.65 MB +161.95 KB +0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.76 MB 59.81 MB +56.04 KB +0.1%
hits_55.vortex 1.0 vortex-file-compressed 169.16 MB 169.30 MB +150.63 KB +0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.01 MB 145.14 MB +126.73 KB +0.1%
hits_2.vortex 1.0 vortex-compact 129.14 MB 129.24 MB +102.38 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.29 MB 69.34 MB +51.80 KB +0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.43 MB 103.50 MB +71.45 KB +0.1%
hits_96.vortex 1.0 vortex-file-compressed 135.70 MB 135.79 MB +91.15 KB +0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.60 MB 117.68 MB +75.39 KB +0.1%
hits_4.vortex 1.0 vortex-file-compressed 108.67 MB 108.73 MB +67.83 KB +0.1%
hits_71.vortex 1.0 vortex-file-compressed 102.04 MB 102.10 MB +62.76 KB +0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.85 MB 84.90 MB +49.95 KB +0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.44 MB 111.50 MB +63.20 KB +0.1%
hits_78.vortex 1.0 vortex-file-compressed 164.23 MB 164.32 MB +86.32 KB +0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.62 MB 69.65 MB +35.88 KB +0.1%
hits_92.vortex 1.0 vortex-file-compressed 146.89 MB 146.96 MB +74.75 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.11 MB 223.22 MB +108.30 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.94 MB 77.98 MB +36.93 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.66 MB 93.70 MB +44.33 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.89 MB 117.94 MB +54.82 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.40 MB 118.45 MB +54.20 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.30 MB 81.34 MB +36.57 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.94 MB 119.99 MB +51.31 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.15 MB 115.20 MB +46.13 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.37 MB 111.42 MB +43.47 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.50 MB 90.53 MB +31.71 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.87 MB 119.91 MB +40.30 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.14 MB 224.20 MB +66.69 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.97 MB 62.98 MB +15.95 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.83 MB 104.86 MB +25.07 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.33 MB 41.34 MB +9.65 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 140.07 MB 140.09 MB +25.52 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.89 MB 97.91 MB +17.57 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 93.00 MB 93.02 MB +15.05 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 187.07 MB 187.10 MB +30.05 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.98 MB 79.99 MB +8.59 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.81 MB 89.82 MB +9.63 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.90 MB 101.91 MB +9.95 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.57 MB 87.58 MB +7.65 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.36 MB 90.37 MB +6.35 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.17 MB 87.17 MB +600 B +0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.20 MB 123.20 MB +432 B +0.0%
hits_97.vortex 1.0 vortex-file-compressed 107.02 MB 107.02 MB 3.74 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.33 MB 93.33 MB 4.31 KB -0.0%
hits_67.vortex 1.0 vortex-file-compressed 184.06 MB 184.05 MB 8.59 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 79.99 MB 4.98 KB -0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.80 MB 183.79 MB 17.92 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB 3.24 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.26 MB 101.24 MB 15.34 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.26 MB 57.25 MB 8.97 KB -0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.26 MB 97.25 MB 16.75 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.62 MB 96.60 MB 17.01 KB -0.0%
hits_21.vortex 1.0 vortex-file-compressed 93.99 MB 93.97 MB 18.11 KB -0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.61 MB 73.60 MB 15.93 KB -0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.63 MB 78.62 MB 18.90 KB -0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.29 MB 99.27 MB 24.08 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.35 MB 99.33 MB 25.73 KB -0.0%
hits_39.vortex 1.0 vortex-file-compressed 80.40 MB 80.38 MB 21.93 KB -0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.59 MB 138.55 MB 40.59 KB -0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.81 MB 138.76 MB 48.41 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.69 MB 277.60 MB 100.96 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.17 MB 122.12 MB 48.95 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.40 MB 221.31 MB 93.32 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.47 MB 77.44 MB 34.38 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.63 MB 89.58 MB 43.65 KB -0.0%
hits_12.vortex 1.0 vortex-file-compressed 101.09 MB 101.04 MB 50.40 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.32 MB 93.28 MB 46.98 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.48 MB 179.38 MB 93.51 KB -0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.49 MB 69.45 MB 38.40 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.52 MB 68.48 MB 38.95 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 227.42 MB 227.28 MB 137.71 KB -0.1%
hits_82.vortex 1.0 vortex-file-compressed 99.90 MB 99.84 MB 63.90 KB -0.1%
hits_2.vortex 1.0 vortex-file-compressed 186.62 MB 186.50 MB 122.02 KB -0.1%
hits_26.vortex 1.0 vortex-file-compressed 110.15 MB 110.07 MB 78.26 KB -0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.15 MB 90.09 MB 67.74 KB -0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.93 MB 91.87 MB 69.25 KB -0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.88 MB 100.81 MB 78.62 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.67 MB 123.57 MB 102.04 KB -0.1%
hits_3.vortex 1.0 vortex-file-compressed 142.39 MB 142.24 MB 153.80 KB -0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.38 MB 63.31 MB 77.27 KB -0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.50 MB 114.36 MB 148.04 KB -0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.41 MB 89.30 MB 119.77 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.91 MB 66.82 MB 93.12 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.54 MB 69.42 MB 126.08 KB -0.2%
hits_69.vortex 1.0 vortex-file-compressed 123.18 MB 122.93 MB 251.43 KB -0.2%
hits_27.vortex 1.0 vortex-compact 69.95 MB 69.81 MB 143.06 KB -0.2%
hits_73.vortex 1.0 vortex-file-compressed 110.89 MB 110.52 MB 375.16 KB -0.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -1.3% -0.1% -1.2% +870.2% ➖ noise
0 duckdb:duckdb +5.3% -0.1% +5.4% +274.4% ➖ noise
0 duckdb:vortex-file-compressed +8.4% -0.1% +8.5% +472.3% ➖ noise
1 datafusion:vortex-file-compressed -3.3% +2.1% -5.3% +20.8% ➖ noise
1 duckdb:duckdb +4.4% +2.1% +2.3% +60.2% ➖ noise
1 duckdb:vortex-file-compressed -5.7% +2.1% -7.6% +22.1% ➖ noise
2 datafusion:vortex-file-compressed -6.5% -1.4% -5.2% +14.8% ➖ noise
2 duckdb:duckdb +4.8% -1.4% +6.3% +33.9% ➖ noise
2 duckdb:vortex-file-compressed -2.1% -1.4% -0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.3% -3.4% +2.1% +143.8% ➖ noise
3 duckdb:duckdb +6.8% -3.4% +10.5% +55.8% ➖ noise
3 duckdb:vortex-file-compressed -2.6% -3.4% +0.7% +58.1% ➖ noise
4 datafusion:vortex-file-compressed +2.4% -2.1% +4.5% +10.0% ➖ noise
4 duckdb:duckdb +5.5% -2.1% +7.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% -2.1% +1.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.6% +0.5% -4.2% +10.0% ➖ noise
5 duckdb:duckdb +3.0% +0.5% +2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.5% +0.5% -5.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.3% -2.2% +1.9% +40.7% ➖ noise
6 duckdb:duckdb +4.5% -2.2% +6.8% +14.8% ➖ noise
6 duckdb:vortex-file-compressed -4.3% -2.2% -2.2% +17.1% ➖ noise
7 datafusion:vortex-file-compressed -3.4% +1.1% -4.4% +21.8% ➖ noise
7 duckdb:duckdb +3.3% +1.1% +2.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.6% +1.1% +0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.7% +0.5% -3.3% +10.0% ➖ noise
8 duckdb:duckdb -0.8% +0.5% -1.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +0.5% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.6% -0.2% -3.4% +10.0% ➖ noise
9 duckdb:duckdb -1.2% -0.2% -1.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.4% -0.2% -3.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.9% -0.2% -2.7% +10.9% ➖ noise
10 duckdb:duckdb -1.6% -0.2% -1.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.8% -0.2% -3.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +3.5% -1.1% +4.6% +10.0% ➖ noise
11 duckdb:duckdb -0.8% -1.1% +0.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.0% -1.1% -1.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +5.2% -1.3% +6.5% +10.0% ➖ noise
12 duckdb:duckdb -0.1% -1.3% +1.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.1% -1.3% -0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.4% -2.9% +0.5% +10.0% ➖ noise
13 duckdb:duckdb -0.3% -2.9% +2.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -3.1% -2.9% -0.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.2% -0.8% +0.6% +10.0% ➖ noise
14 duckdb:duckdb -0.4% -0.8% +0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.4% -0.8% -0.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.0% -1.5% +1.4% +10.0% ➖ noise
15 duckdb:duckdb +1.7% -1.5% +3.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.5% -1.5% +1.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.7% -1.1% -1.6% +10.0% ➖ noise
16 duckdb:duckdb +0.3% -1.1% +1.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.0% -1.1% +1.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.7% -1.1% -1.6% +10.0% ➖ noise
17 duckdb:duckdb -1.1% -1.1% +0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.4% -1.1% +1.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -12.5% -1.3% -11.4% +10.0% ✅ faster
18 duckdb:duckdb -2.4% -1.3% -1.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.0% -1.3% +1.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.2% +3.0% -3.1% +37.3% ➖ noise
19 duckdb:duckdb -1.4% +3.0% -4.3% +21.4% ➖ noise
19 duckdb:vortex-file-compressed -1.1% +3.0% -4.0% +31.7% ➖ noise
20 datafusion:vortex-file-compressed +0.1% -0.6% +0.7% +108.3% ➖ noise
20 duckdb:duckdb -6.7% -0.6% -6.1% +111.6% ➖ noise
20 duckdb:vortex-file-compressed -5.3% -0.6% -4.7% +11.6% ➖ noise
21 datafusion:vortex-file-compressed -1.2% -1.2% +0.0% +10.0% ➖ noise
21 duckdb:duckdb -2.3% -1.2% -1.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -2.1% -1.2% -0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.7% +0.2% -3.9% +10.0% ➖ noise
22 duckdb:duckdb -1.3% +0.2% -1.6% +48.6% ➖ noise
22 duckdb:vortex-file-compressed -3.7% +0.2% -3.9% +18.2% ➖ noise
23 datafusion:vortex-file-compressed -2.5% -0.9% -1.6% +40.5% ➖ noise
23 duckdb:duckdb -3.1% -0.9% -2.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -18.7% -0.9% -17.9% +28.6% ➖ noise
24 datafusion:vortex-file-compressed -2.5% -0.4% -2.1% +13.7% ➖ noise
24 duckdb:duckdb -0.6% -0.4% -0.2% +33.1% ➖ noise
24 duckdb:vortex-file-compressed +8.6% -0.4% +9.1% +22.0% ➖ noise
25 datafusion:vortex-file-compressed +4.3% -2.6% +7.1% +10.0% ➖ noise
25 duckdb:duckdb -0.5% -2.6% +2.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -7.4% -2.6% -5.0% +15.0% ➖ noise
26 datafusion:vortex-file-compressed +0.0% -2.4% +2.4% +12.4% ➖ noise
26 duckdb:duckdb -1.4% -2.4% +0.9% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -0.7% -2.4% +1.7% +22.0% ➖ noise
27 datafusion:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
27 duckdb:duckdb -0.7% -0.6% -0.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -5.5% -0.6% -4.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.7% -0.3% +1.9% +10.0% ➖ noise
28 duckdb:duckdb +0.5% -0.3% +0.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.1% -0.3% -0.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +4.1% +0.7% +3.3% +12.7% ➖ noise
29 duckdb:duckdb -1.4% +0.7% -2.1% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +0.4% +0.7% -0.4% +42.1% ➖ noise
30 datafusion:vortex-file-compressed +0.1% -1.9% +2.1% +10.0% ➖ noise
30 duckdb:duckdb -1.3% -1.9% +0.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.1% -1.9% +0.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.0% -2.5% +2.6% +10.0% ➖ noise
31 duckdb:duckdb -1.3% -2.5% +1.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.3% -2.5% +2.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +14.4% -0.6% +15.1% +12.8% 🚨 regression
32 duckdb:duckdb -1.1% -0.6% -0.5% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.1% -0.6% -1.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.9% -1.6% -0.3% +10.0% ➖ noise
33 duckdb:duckdb -1.4% -1.6% +0.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -2.3% -1.6% -0.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.8% -2.4% +3.3% +10.0% ➖ noise
34 duckdb:duckdb -0.9% -2.4% +1.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -5.9% -2.4% -3.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.4% +0.2% -2.6% +10.0% ➖ noise
35 duckdb:duckdb +2.3% +0.2% +2.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.0% +0.2% -1.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -5.6% -7.3% +1.8% +10.0% ➖ noise
36 duckdb:duckdb -3.7% -7.3% +3.9% +12.3% ➖ noise
36 duckdb:vortex-file-compressed +0.8% -7.3% +8.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +0.9% -1.6% +2.6% +10.5% ➖ noise
37 duckdb:duckdb +1.1% -1.6% +2.8% +18.1% ➖ noise
37 duckdb:vortex-file-compressed -1.6% -1.6% +0.0% +15.1% ➖ noise
38 datafusion:vortex-file-compressed -2.6% -2.7% +0.1% +17.4% ➖ noise
38 duckdb:duckdb -2.3% -2.7% +0.4% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +2.3% -2.7% +5.1% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -0.2% +0.7% -0.9% +10.0% ➖ noise
39 duckdb:duckdb -1.1% +0.7% -1.8% +14.5% ➖ noise
39 duckdb:vortex-file-compressed -6.3% +0.7% -6.9% +10.2% ➖ noise
40 datafusion:vortex-file-compressed -3.6% -0.8% -2.9% +10.0% ➖ noise
40 duckdb:duckdb +1.4% -0.8% +2.2% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +0.7% -0.8% +1.5% +25.8% ➖ noise
41 datafusion:vortex-file-compressed -3.7% +0.2% -3.8% +14.1% ➖ noise
41 duckdb:duckdb +0.6% +0.2% +0.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +1.6% +0.2% +1.4% +10.3% ➖ noise
42 datafusion:vortex-file-compressed +1.5% -1.2% +2.7% +15.3% ➖ noise
42 duckdb:duckdb -3.7% -1.2% -2.5% +21.8% ➖ noise
42 duckdb:vortex-file-compressed +16.0% -1.2% +17.4% +13.7% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: Compression

Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.005x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.006x ➖, 1↑ 3↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
compress time/Arade 1103417315 1122545997 0.98
compress time/Bimbo 5740978992 5737345415 1.00
compress time/CMSprovider 2793119235 2803660027 1.00
compress time/Euro2016 482982912 474101104 1.02
compress time/Food 376475705 378020302 1.00
compress time/HashTags 872189544 867949852 1.00
compress time/TPC-H l_comment canonical 1219999959 1223217382 1.00
compress time/TPC-H l_comment chunked 1233746340 1228626644 1.00
compress time/taxi 672740118 684081095 0.98
compress time/wide table cols=100 chunks=1 rows=1000 11687053 11799019 0.99
compress time/wide table cols=100 chunks=50 rows=1000 11812179 11602696 1.02
compress time/wide table cols=1000 chunks=1 rows=1000 135762754 127708516 1.06
compress time/wide table cols=1000 chunks=50 rows=1000 126056666 122514462 1.03
compress time/wide table cols=10000 chunks=1 rows=1000 1475275156 1436699829 1.03
compress time/wide table cols=10000 chunks=50 rows=1000 1501767844 1483156411 1.01
decompress time/Arade 25387701 26337892 0.96
decompress time/Bimbo 79383463 77493975 1.02
decompress time/CMSprovider 76313460 75434896 1.01
decompress time/Euro2016 19472494 19479573 1.00
decompress time/Food 8236772 8069280 1.02
decompress time/HashTags 93005609 92735220 1.00
decompress time/TPC-H l_comment canonical 41738864 39923137 1.05
decompress time/TPC-H l_comment chunked 41280973 40093139 1.03
decompress time/taxi 14601287 15448091 0.95
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2814896 2418930 1.16
decompress time/wide table cols=100 chunks=50 rows=1000 2545010 2474498 1.03
decompress time/wide table cols=1000 chunks=1 rows=1000 23719913 23050889 1.03
decompress time/wide table cols=1000 chunks=50 rows=1000 24555091 23817694 1.03
decompress time/wide table cols=10000 chunks=1 rows=1000 265142739 250085063 1.06
decompress time/wide table cols=10000 chunks=50 rows=1000 254348336 263406229 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2640319534 2598468594 1.02
parquet_rs-zstd compress time/Bimbo 12627379344 12677418847 1.00
parquet_rs-zstd compress time/CMSprovider 7118687164 6840609985 1.04
parquet_rs-zstd compress time/Euro2016 1324413911 1314532056 1.01
parquet_rs-zstd compress time/Food 805176441 802942723 1.00
parquet_rs-zstd compress time/HashTags 2148074765 2203419871 0.97
parquet_rs-zstd compress time/TPC-H l_comment canonical 3253931823 3206963357 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked 3213510033 3209556476 1.00
parquet_rs-zstd compress time/taxi 1186102333 1192134191 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 6956498 5978798 1.16
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6247985 6041640 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 76758965 74198588 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 75602823 75147846 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 800832637 767035389 1.04
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 771760517 799391738 0.97
parquet_rs-zstd decompress time/Arade 619992738 618385453 1.00
parquet_rs-zstd decompress time/Bimbo 1729244144 1695370937 1.02
parquet_rs-zstd decompress time/CMSprovider 1696739386 1707191328 0.99
parquet_rs-zstd decompress time/Euro2016 377458897 379093344 1.00
parquet_rs-zstd decompress time/Food 198738775 196981387 1.01
parquet_rs-zstd decompress time/HashTags 625243259 644728338 0.97
parquet_rs-zstd decompress time/TPC-H l_comment canonical 587774082 589228464 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 592313190 588051464 1.01
parquet_rs-zstd decompress time/taxi 243891594 244878911 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2879395 2768079 1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2841746 2783206 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33137324 31756942 1.04
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33118172 33109503 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 348426676 344247201 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 345971499 350096914 0.99
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417860508 417905492 1.00
vortex-file-compressed size/Euro2016 158516364 158190388 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185391764 185007124 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178287016 178402152 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178457912 178355072 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.96
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 0.99
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.85
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.96
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 1.01
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.05
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 12, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.4%
Engines: DataFusion No clear signal (+5.4%, environment too noisy confidence) · DuckDB No clear signal (+1.5%, environment too noisy confidence)
Vortex (geomean): 1.022x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish +5.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.989x ➖, 1↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 718744776 694550975 1.03
tpch_q02/datafusion:vortex-file-compressed 🚨 1082864265 820125791 1.32
tpch_q03/datafusion:vortex-file-compressed 1127990956 993602418 1.14
tpch_q04/datafusion:vortex-file-compressed 738926363 734667243 1.01
tpch_q05/datafusion:vortex-file-compressed 1333556948 1082166433 1.23
tpch_q06/datafusion:vortex-file-compressed 607535548 641966844 0.95
tpch_q07/datafusion:vortex-file-compressed 1051721111 1212408617 0.87
tpch_q08/datafusion:vortex-file-compressed 1309881308 1289187180 1.02
tpch_q09/datafusion:vortex-file-compressed 1472895696 1358843196 1.08
tpch_q10/datafusion:vortex-file-compressed 1080579493 1020841967 1.06
tpch_q11/datafusion:vortex-file-compressed 628121846 600891165 1.05
tpch_q12/datafusion:vortex-file-compressed 929866524 848288615 1.10
tpch_q13/datafusion:vortex-file-compressed 489616586 448529395 1.09
tpch_q14/datafusion:vortex-file-compressed 578467954 525545602 1.10
tpch_q15/datafusion:vortex-file-compressed 934522857 964193608 0.97
tpch_q16/datafusion:vortex-file-compressed 452431139 396897413 1.14
tpch_q17/datafusion:vortex-file-compressed 1296648930 1768590816 0.73
tpch_q18/datafusion:vortex-file-compressed 🚀 1341650268 2123074163 0.63
tpch_q19/datafusion:vortex-file-compressed 965411890 1134291182 0.85
tpch_q20/datafusion:vortex-file-compressed 1027425991 1082714246 0.95
tpch_q21/datafusion:vortex-file-compressed 1818880032 1765078724 1.03
tpch_q22/datafusion:vortex-file-compressed 453197001 628953924 0.72
datafusion / vortex-compact (0.913x ➖, 1↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 713257374 741483094 0.96
tpch_q02/datafusion:vortex-compact 1152588607 928113799 1.24
tpch_q03/datafusion:vortex-compact 730793832 963959469 0.76
tpch_q04/datafusion:vortex-compact 514064058 570178021 0.90
tpch_q05/datafusion:vortex-compact 878242882 998067730 0.88
tpch_q06/datafusion:vortex-compact 581132874 642430381 0.90
tpch_q07/datafusion:vortex-compact 1008069744 1056831014 0.95
tpch_q08/datafusion:vortex-compact 1191883286 1254318172 0.95
tpch_q09/datafusion:vortex-compact 1263613992 1370533210 0.92
tpch_q10/datafusion:vortex-compact 940133644 1042448825 0.90
tpch_q11/datafusion:vortex-compact 496852534 679479123 0.73
tpch_q12/datafusion:vortex-compact 🚀 847334148 1406848919 0.60
tpch_q13/datafusion:vortex-compact 417974867 424711371 0.98
tpch_q14/datafusion:vortex-compact 580241849 819354408 0.71
tpch_q15/datafusion:vortex-compact 1052994101 1115064653 0.94
tpch_q16/datafusion:vortex-compact 536612274 462276074 1.16
tpch_q17/datafusion:vortex-compact 1195405495 1125788291 1.06
tpch_q18/datafusion:vortex-compact 1245499421 1223836565 1.02
tpch_q19/datafusion:vortex-compact 804842629 891117617 0.90
tpch_q20/datafusion:vortex-compact 1100624864 984508595 1.12
tpch_q21/datafusion:vortex-compact 1576145793 1565029230 1.01
tpch_q22/datafusion:vortex-compact 424062594 565582625 0.75
datafusion / parquet (0.901x ➖, 2↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 869124934 846954655 1.03
tpch_q02/datafusion:parquet 1164512698 1082336298 1.08
tpch_q03/datafusion:parquet 1210167250 1212170659 1.00
tpch_q04/datafusion:parquet 517466468 564561932 0.92
tpch_q05/datafusion:parquet 1144332759 1504657910 0.76
tpch_q06/datafusion:parquet 🚀 538920564 790237548 0.68
tpch_q07/datafusion:parquet 1336099998 1541070577 0.87
tpch_q08/datafusion:parquet 2137304049 2058548837 1.04
tpch_q09/datafusion:parquet 1954061770 1915913426 1.02
tpch_q10/datafusion:parquet 2033567825 2783893682 0.73
tpch_q11/datafusion:parquet 741688581 697155640 1.06
tpch_q12/datafusion:parquet 667448872 863854287 0.77
tpch_q13/datafusion:parquet 785422712 775602533 1.01
tpch_q14/datafusion:parquet 850693815 897059732 0.95
tpch_q15/datafusion:parquet 1348893094 1487856613 0.91
tpch_q16/datafusion:parquet 🚀 380305754 585502451 0.65
tpch_q17/datafusion:parquet 1299746044 1402364592 0.93
tpch_q18/datafusion:parquet 1635134018 1761474960 0.93
tpch_q19/datafusion:parquet 1083797074 1033679825 1.05
tpch_q20/datafusion:parquet 1300927740 1571200369 0.83
tpch_q21/datafusion:parquet 2091254268 2066586447 1.01
tpch_q22/datafusion:parquet 883959051 1073038578 0.82
duckdb / vortex-file-compressed (1.102x ➖, 0↑ 2↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 597861643 652140165 0.92
tpch_q02/duckdb:vortex-file-compressed 1463167058 1203716676 1.22
tpch_q03/duckdb:vortex-file-compressed 1044029167 990375077 1.05
tpch_q04/duckdb:vortex-file-compressed 🚨 1123225919 855970978 1.31
tpch_q05/duckdb:vortex-file-compressed 1639942263 1366308979 1.20
tpch_q06/duckdb:vortex-file-compressed 615561540 580714885 1.06
tpch_q07/duckdb:vortex-file-compressed 1486923439 1287291150 1.16
tpch_q08/duckdb:vortex-file-compressed 1637330965 1705455191 0.96
tpch_q09/duckdb:vortex-file-compressed 1996334753 1915736418 1.04
tpch_q10/duckdb:vortex-file-compressed 1349647242 1452829162 0.93
tpch_q11/duckdb:vortex-file-compressed 805508583 707939771 1.14
tpch_q12/duckdb:vortex-file-compressed 1308609435 1340921496 0.98
tpch_q13/duckdb:vortex-file-compressed 1032405515 875565943 1.18
tpch_q14/duckdb:vortex-file-compressed 824091677 700988954 1.18
tpch_q15/duckdb:vortex-file-compressed 640007668 572323592 1.12
tpch_q16/duckdb:vortex-file-compressed 525727191 565825196 0.93
tpch_q17/duckdb:vortex-file-compressed 1060761823 1048882904 1.01
tpch_q18/duckdb:vortex-file-compressed 1076664439 943440261 1.14
tpch_q19/duckdb:vortex-file-compressed 865692594 789182597 1.10
tpch_q20/duckdb:vortex-file-compressed 1553769600 1299362110 1.20
tpch_q21/duckdb:vortex-file-compressed 2265767435 2072937468 1.09
tpch_q22/duckdb:vortex-file-compressed 🚨 662516700 434796499 1.52
duckdb / vortex-compact (1.098x ➖, 0↑ 1↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 663476706 622711667 1.07
tpch_q02/duckdb:vortex-compact 1289380800 1158320684 1.11
tpch_q03/duckdb:vortex-compact 1152362811 983802910 1.17
tpch_q04/duckdb:vortex-compact 719674488 665567486 1.08
tpch_q05/duckdb:vortex-compact 1293806903 1252838578 1.03
tpch_q06/duckdb:vortex-compact 555475872 561217882 0.99
tpch_q07/duckdb:vortex-compact 1356980356 1182863893 1.15
tpch_q08/duckdb:vortex-compact 1665729033 1463656624 1.14
tpch_q09/duckdb:vortex-compact 1880605307 1714135458 1.10
tpch_q10/duckdb:vortex-compact 1454727487 1425018883 1.02
tpch_q11/duckdb:vortex-compact 790527806 758747006 1.04
tpch_q12/duckdb:vortex-compact 1104641709 1111229434 0.99
tpch_q13/duckdb:vortex-compact 913528669 796651429 1.15
tpch_q14/duckdb:vortex-compact 714755261 655258187 1.09
tpch_q15/duckdb:vortex-compact 642688968 515917925 1.25
tpch_q16/duckdb:vortex-compact 459150041 491266524 0.93
tpch_q17/duckdb:vortex-compact 1156495482 961047744 1.20
tpch_q18/duckdb:vortex-compact 970118064 945994212 1.03
tpch_q19/duckdb:vortex-compact 883347284 804044440 1.10
tpch_q20/duckdb:vortex-compact 1382882351 1317291627 1.05
tpch_q21/duckdb:vortex-compact 1772065628 1765300151 1.00
tpch_q22/duckdb:vortex-compact 🚨 746494142 461309286 1.62
duckdb / parquet (1.084x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 912244700 864508835 1.06
tpch_q02/duckdb:parquet 1498140744 1526170722 0.98
tpch_q03/duckdb:parquet 2043946929 1771204466 1.15
tpch_q04/duckdb:parquet 1261454250 1144006931 1.10
tpch_q05/duckdb:parquet 2238731980 2069072829 1.08
tpch_q06/duckdb:parquet 751472263 889567002 0.84
tpch_q07/duckdb:parquet 2075953387 2003314491 1.04
tpch_q08/duckdb:parquet 2890228001 2560444643 1.13
tpch_q09/duckdb:parquet 2927211517 2880703180 1.02
tpch_q10/duckdb:parquet 3715995287 3210011463 1.16
tpch_q11/duckdb:parquet 1125799470 1026794452 1.10
tpch_q12/duckdb:parquet 1461216974 1259258229 1.16
tpch_q13/duckdb:parquet 1469369620 1313678131 1.12
tpch_q14/duckdb:parquet 1432080253 1331623604 1.08
tpch_q15/duckdb:parquet 1188750849 993731567 1.20
tpch_q16/duckdb:parquet 995766909 995639735 1.00
tpch_q17/duckdb:parquet 1598653571 1505467884 1.06
tpch_q18/duckdb:parquet 1966514796 1557437248 1.26
tpch_q19/duckdb:parquet 1759495745 1444238779 1.22
tpch_q20/duckdb:parquet 2318209984 2246420192 1.03
tpch_q21/duckdb:parquet 2121000642 1939259818 1.09
tpch_q22/duckdb:parquet 1250698381 1191290569 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.8% +4.1% -7.6% +43.8% ➖ noise
1 datafusion:vortex-file-compressed +3.5% +4.1% -0.6% +46.8% ➖ noise
1 duckdb:vortex-compact +6.5% +4.1% +2.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -8.3% +4.1% -11.9% +36.4% ➖ noise
2 datafusion:vortex-compact +24.2% +2.8% +20.8% +45.8% ➖ noise
2 datafusion:vortex-file-compressed +32.0% +2.8% +28.5% +33.6% ➖ noise
2 duckdb:vortex-compact +11.3% +2.8% +8.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +21.6% +2.8% +18.3% +30.0% ➖ noise
3 datafusion:vortex-compact -24.2% +7.3% -29.4% +43.5% ➖ noise
3 datafusion:vortex-file-compressed +13.5% +7.3% +5.8% +47.0% ➖ noise
3 duckdb:vortex-compact +17.1% +7.3% +9.1% +39.5% ➖ noise
3 duckdb:vortex-file-compressed +5.4% +7.3% -1.8% +48.3% ➖ noise
4 datafusion:vortex-compact -9.8% +0.5% -10.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +0.5% +0.0% +30.0% ➖ noise
4 duckdb:vortex-compact +8.1% +0.5% +7.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +31.2% +0.5% +30.5% +30.0% 🚨 regression
5 datafusion:vortex-compact -12.0% -9.3% -3.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +23.2% -9.3% +35.8% +30.0% 🚨 regression
5 duckdb:vortex-compact +3.3% -9.3% +13.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +20.0% -9.3% +32.3% +30.0% 🚨 regression
6 datafusion:vortex-compact -9.5% -24.1% +19.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -5.4% -24.1% +24.7% +30.0% ➖ noise
6 duckdb:vortex-compact -1.0% -24.1% +30.4% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +6.0% -24.1% +39.7% +30.0% 🚨 regression
7 datafusion:vortex-compact -4.6% -5.2% +0.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -13.3% -5.2% -8.5% +30.0% ➖ noise
7 duckdb:vortex-compact +14.7% -5.2% +21.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +15.5% -5.2% +21.9% +30.0% ➖ noise
8 datafusion:vortex-compact -5.0% +8.3% -12.2% +46.1% ➖ noise
8 datafusion:vortex-file-compressed +1.6% +8.3% -6.1% +47.9% ➖ noise
8 duckdb:vortex-compact +13.8% +8.3% +5.1% +46.7% ➖ noise
8 duckdb:vortex-file-compressed -4.0% +8.3% -11.3% +45.0% ➖ noise
9 datafusion:vortex-compact -7.8% +1.8% -9.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +8.4% +1.8% +6.5% +30.0% ➖ noise
9 duckdb:vortex-compact +9.7% +1.8% +7.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.2% +1.8% +2.4% +30.0% ➖ noise
10 datafusion:vortex-compact -9.8% -8.0% -1.9% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +5.9% -8.0% +15.1% +30.0% ➖ noise
10 duckdb:vortex-compact +2.1% -8.0% +11.0% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -7.1% -8.0% +1.0% +30.9% ➖ noise
11 datafusion:vortex-compact -26.9% +8.0% -32.3% +30.0% ✅ faster
11 datafusion:vortex-file-compressed +4.5% +8.0% -3.2% +31.3% ➖ noise
11 duckdb:vortex-compact +4.2% +8.0% -3.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +13.8% +8.0% +5.4% +35.2% ➖ noise
12 datafusion:vortex-compact -39.8% -5.3% -36.4% +30.0% ✅ faster
12 datafusion:vortex-file-compressed +9.6% -5.3% +15.8% +30.0% ➖ noise
12 duckdb:vortex-compact -0.6% -5.3% +5.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -2.4% -5.3% +3.1% +30.0% ➖ noise
13 datafusion:vortex-compact -1.6% +6.4% -7.5% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +9.2% +6.4% +2.6% +30.0% ➖ noise
13 duckdb:vortex-compact +14.7% +6.4% +7.7% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +17.9% +6.4% +10.8% +30.0% ➖ noise
14 datafusion:vortex-compact -29.2% +1.0% -29.9% +30.0% ✅ faster
14 datafusion:vortex-file-compressed +10.1% +1.0% +9.0% +30.0% ➖ noise
14 duckdb:vortex-compact +9.1% +1.0% +8.0% +31.9% ➖ noise
14 duckdb:vortex-file-compressed +17.6% +1.0% +16.4% +30.0% ➖ noise
15 datafusion:vortex-compact -5.6% +4.1% -9.3% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -3.1% +4.1% -6.9% +30.0% ➖ noise
15 duckdb:vortex-compact +24.6% +4.1% +19.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +11.8% +4.1% +7.4% +30.0% ➖ noise
16 datafusion:vortex-compact +16.1% -19.4% +44.0% +40.3% 🚨 regression
16 datafusion:vortex-file-compressed +14.0% -19.4% +41.4% +30.0% 🚨 regression
16 duckdb:vortex-compact -6.5% -19.4% +16.0% +32.4% ➖ noise
16 duckdb:vortex-file-compressed -7.1% -19.4% +15.3% +30.0% ➖ noise
17 datafusion:vortex-compact +6.2% -0.8% +7.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -26.7% -0.8% -26.1% +30.0% ✅ faster
17 duckdb:vortex-compact +20.3% -0.8% +21.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +1.1% -0.8% +1.9% +30.0% ➖ noise
18 datafusion:vortex-compact +1.8% +8.3% -6.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -36.8% +8.3% -41.6% +35.2% ✅ faster
18 duckdb:vortex-compact +2.6% +8.3% -5.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +14.1% +8.3% +5.4% +30.0% ➖ noise
19 datafusion:vortex-compact -9.7% +13.0% -20.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -14.9% +13.0% -24.7% +37.7% ➖ noise
19 duckdb:vortex-compact +9.9% +13.0% -2.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +9.7% +13.0% -2.9% +30.0% ➖ noise
20 datafusion:vortex-compact +11.8% -7.6% +20.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -5.1% -7.6% +2.7% +30.4% ➖ noise
20 duckdb:vortex-compact +5.0% -7.6% +13.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +19.6% -7.6% +29.4% +30.0% ➖ noise
21 datafusion:vortex-compact +0.7% +5.2% -4.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +3.0% +5.2% -2.0% +30.0% ➖ noise
21 duckdb:vortex-compact +0.4% +5.2% -4.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +9.3% +5.2% +3.9% +30.0% ➖ noise
22 datafusion:vortex-compact -25.0% -7.0% -19.4% +49.0% ➖ noise
22 datafusion:vortex-file-compressed -27.9% -7.0% -22.5% +30.0% ➖ noise
22 duckdb:vortex-compact +61.8% -7.0% +74.0% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +52.4% -7.0% +63.8% +32.7% 🚨 regression

@myrrc myrrc mentioned this pull request May 14, 2026
Open
@myrrc
Copy link
Copy Markdown
Contributor Author

myrrc commented May 18, 2026

No speedup, closing

@myrrc myrrc closed this May 18, 2026
joseph-isaacs
joseph-isaacs reviewed May 29, 2026
View reviewed changes
Comment thread vortex-array/src/scalar_fn/fns/substring/mod.rs Outdated
Comment on lines +131 to +133
let arrow_array = string_arr.execute_arrow(Some(&DataType::Utf8), ctx)?;
let result = arrow_string::substring::substring(arrow_array.as_ref(), start - 1, length)?;
from_arrow_array_with_len(result.as_ref(), len, nullable)
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs May 29, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is likely very slow, we can do this via varbinview offset rewrite and we should apply push down to each encoding type

@myrrc myrrc reopened this Jun 1, 2026
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@myrrc myrrc marked this pull request as ready for review June 2, 2026 12:56
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jun 2, 2026 •
edited
Loading

Merging this PR will improve performance by 23.42%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
✅ 1271 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation baseline_eq[4, 65536] 237.9 µs 185.1 µs +28.54%
⚡ Simulation baseline_lt[16, 65536] 275.5 µs 217.7 µs +26.57%
⚡ Simulation baseline_lt[4, 65536] 253.2 µs 201 µs +25.94%
⚡ Simulation baseline_eq[16, 65536] 260.5 µs 230 µs +13.23%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/substr (a284482) with develop (84a4a3f)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 0.992x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 130892185 137799694 0.95
appian_q02/datafusion:vortex-file-compressed 666573990 668827668 1.00
appian_q03/datafusion:vortex-file-compressed 362644439 365925192 0.99
appian_q04/datafusion:vortex-file-compressed 28242432177 28372105575 1.00
appian_q05/datafusion:vortex-file-compressed 268943926 268352381 1.00
appian_q06/datafusion:vortex-file-compressed 430530910 429610468 1.00
appian_q07/datafusion:vortex-file-compressed 452263114 462014155 0.98
appian_q08/datafusion:vortex-file-compressed 1880795153 1898043468 0.99
datafusion / parquet (0.994x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/datafusion:parquet 128890141 137932317 0.93
appian_q02/datafusion:parquet 685526838 681312608 1.01
appian_q03/datafusion:parquet 358275610 368990084 0.97
appian_q04/datafusion:parquet 28272351775 28368972734 1.00
appian_q05/datafusion:parquet 299407860 287970937 1.04
appian_q06/datafusion:parquet 434472152 436705751 0.99
appian_q07/datafusion:parquet 464801177 462180259 1.01
appian_q08/datafusion:parquet 1893713275 1881542311 1.01
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 195098144 195411314 1.00
appian_q02/duckdb:vortex-file-compressed 615569264 624469185 0.99
appian_q03/duckdb:vortex-file-compressed 262825128 261373895 1.01
appian_q04/duckdb:vortex-file-compressed 1334897452 1337184552 1.00
appian_q05/duckdb:vortex-file-compressed 298442953 298213246 1.00
appian_q06/duckdb:vortex-file-compressed 803961338 813182612 0.99
appian_q07/duckdb:vortex-file-compressed 347157989 348189349 1.00
appian_q08/duckdb:vortex-file-compressed 1312611850 1319636609 0.99
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/duckdb:parquet 206645433 203365905 1.02
appian_q02/duckdb:parquet 609281375 607789187 1.00
appian_q03/duckdb:parquet 293179884 291279591 1.01
appian_q04/duckdb:parquet 1331926710 1346376449 0.99
appian_q05/duckdb:parquet 316805121 304046394 1.04
appian_q06/duckdb:parquet 796646821 804970780 0.99
appian_q07/duckdb:parquet 366046003 364664403 1.00
appian_q08/duckdb:parquet 1276507845 1274227956 1.00
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR a284482 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 171450259 174553428 0.98
appian_q02/duckdb:duckdb 550574969 559692873 0.98
appian_q03/duckdb:duckdb 394493200 391727681 1.01
appian_q04/duckdb:duckdb 1300059538 1316941201 0.99
appian_q05/duckdb:duckdb 284145518 287112892 0.99
appian_q06/duckdb:duckdb 800824534 791416326 1.01
appian_q07/duckdb:duckdb 331404429 326220738 1.02
appian_q08/duckdb:duckdb 1236147499 1229225929 1.01
File Size Changes (4 files changed, -0.1% overall, 1↑ 3↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB +32 B +0.0%
orderview.vortex 1.0 vortex-file-compressed 81.14 MB 81.04 MB 95.59 KB -0.1%
creditcardview.vortex 1.0 vortex-file-compressed 61.09 MB 60.98 MB 117.19 KB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.86 MB → 513.65 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed -5.0% -2.6% -2.5% +10.6% ➖ noise
1 duckdb:duckdb -1.8% -2.6% +0.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -2.6% +2.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.3% +0.4% -0.8% +10.0% ➖ noise
2 duckdb:duckdb -1.6% +0.4% -2.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.4% +0.4% -1.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.9% -1.1% +0.2% +10.0% ➖ noise
3 duckdb:duckdb +0.7% -1.1% +1.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.6% -1.1% +1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.5% -0.7% +0.3% +10.0% ➖ noise
4 duckdb:duckdb -1.3% -0.7% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% -0.7% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.2% +4.1% -3.7% +13.3% ➖ noise
5 duckdb:duckdb -1.0% +4.1% -4.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.1% +4.1% -3.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.2% -0.8% +1.0% +10.0% ➖ noise
6 duckdb:duckdb +1.2% -0.8% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.1% -0.8% -0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.1% +0.5% -2.6% +10.0% ➖ noise
7 duckdb:duckdb +1.6% +0.5% +1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% +0.5% -0.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.9% +0.4% -1.3% +10.0% ➖ noise
8 duckdb:duckdb +0.6% +0.4% +0.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.5% +0.4% -0.9% +10.0% ➖ noise

@myrrc
substr
a284482 
Signed-off-by: Mikhail Kot <to@myrrc.dev>
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
joseph-isaacs
joseph-isaacs reviewed Jun 2, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/varbinview/compute/substring.rs
BinaryView::new_inlined(&buf[new_offset..new_offset + new_len])
} else {
let buf = array.buffer(r.buffer_index as usize);
let prefix: [u8; 4] = buf[new_offset..new_offset + 4]
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs Jun 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these will fit

@joseph-isaacs
Copy link
Copy Markdown
Contributor

joseph-isaacs commented Jun 2, 2026

worth looking at arrow-rs here. You can delegate to arrow-re or at least compare as a baseline

substring(array, start: u64, length: Option).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joseph-isaacs joseph-isaacs joseph-isaacs left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

changelog/feature A new feature

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@myrrc @joseph-isaacs