Skip to content

List layout: list-aligned element chunking#8641

Draft
mhk197 wants to merge 1 commit into
mk/add-list-layoutfrom
mk/list-element-chunk-index
Draft

List layout: list-aligned element chunking#8641
mhk197 wants to merge 1 commit into
mk/add-list-layoutfrom
mk/list-element-chunk-index

Conversation

@mhk197

@mhk197 mhk197 commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Adds element chunking to ListLayoutStrategy via ListLayoutStrategy::with_element_chunk_len(target).

Chunks only on list boundaries so no single list straddles two chunks. A selective read then fetches only the element chunks its rows reference:

Stacked on mk/add-list-layout.

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@codspeed-hq

codspeed-hq Bot commented Jul 2, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 8 improved benchmarks
❌ 2 regressed benchmarks
✅ 1585 untouched benchmarks
⏩ 4 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation bitwise_not_vortex_buffer_mut[128] 215.3 ns 244.4 ns -11.93%
Simulation chunked_varbinview_into_canonical[(100, 100)] 271.6 µs 306.4 µs -11.37%
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 206.2 µs 169.6 µs +21.57%
Simulation chunked_varbinview_into_canonical[(1000, 10)] 205.5 µs 169.3 µs +21.38%
Simulation chunked_varbinview_opt_into_canonical[(1000, 10)] 219.6 µs 183.4 µs +19.75%
Simulation slice_empty_vortex 397.8 ns 339.4 ns +17.18%
Simulation encode_varbin[(1000, 8)] 155.4 µs 140.1 µs +10.88%
Simulation encode_varbin[(1000, 4)] 153.7 µs 139.2 µs +10.43%
Simulation encode_varbin[(1000, 2)] 153.2 µs 138.7 µs +10.41%
Simulation encode_varbin[(1000, 32)] 159.1 µs 144.4 µs +10.16%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing mk/list-element-chunk-index (3df5ed6) with mk/add-list-layout (ebbac66)

Open in CodSpeed

Footnotes

  1. 4 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@mhk197 mhk197 added the changelog/performance A performance improvement label Jul 2, 2026
@mhk197 mhk197 changed the base branch from mk/add-list-layout to develop July 2, 2026 00:20
@mhk197 mhk197 added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 2, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 2, 2026
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 3df5ed6 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.076x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.076x ➖, 0↑ 2↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123618347 123887330 1.00
polarsignals_q01/datafusion:vortex-file-compressed 262847070 288290335 0.91
polarsignals_q02/datafusion:vortex-file-compressed 🚨 49228020 24731888 1.99
polarsignals_q03/datafusion:vortex-file-compressed 🚨 298998577 266937106 1.12
polarsignals_q04/datafusion:vortex-file-compressed 11195401 10333709 1.08
polarsignals_q05/datafusion:vortex-file-compressed 17244359 17635773 0.98
polarsignals_q06/datafusion:vortex-file-compressed 22174468 22320269 0.99
polarsignals_q07/datafusion:vortex-file-compressed 15802316 15910605 0.99
polarsignals_q08/datafusion:vortex-file-compressed 406589217 405953387 1.00
polarsignals_q09/datafusion:vortex-file-compressed 12785511 13071169 0.98

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.83 MB 685.87 MB +42.35 KB +0.0%

Totals:

  • vortex-file-compressed: 685.83 MB → 685.87 MB (+0.0%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.5%, environment too noisy confidence) · DuckDB No clear signal (+0.2%, environment too noisy confidence)
Vortex (geomean): 0.991x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49327125 51224068 0.96
tpch_q02/datafusion:vortex-file-compressed 22749702 22558525 1.01
tpch_q03/datafusion:vortex-file-compressed 30204664 31274050 0.97
tpch_q04/datafusion:vortex-file-compressed 19323053 19829689 0.97
tpch_q05/datafusion:vortex-file-compressed 45205280 45782576 0.99
tpch_q06/datafusion:vortex-file-compressed 9837399 9880361 1.00
tpch_q07/datafusion:vortex-file-compressed 51614523 52172225 0.99
tpch_q08/datafusion:vortex-file-compressed 38618719 38436939 1.00
tpch_q09/datafusion:vortex-file-compressed 51054417 51194797 1.00
tpch_q10/datafusion:vortex-file-compressed 32894750 32060750 1.03
tpch_q11/datafusion:vortex-file-compressed 16148923 16196850 1.00
tpch_q12/datafusion:vortex-file-compressed 23444849 23777563 0.99
tpch_q13/datafusion:vortex-file-compressed 27030210 26844855 1.01
tpch_q14/datafusion:vortex-file-compressed 14657083 14555077 1.01
tpch_q15/datafusion:vortex-file-compressed 23382196 22366038 1.05
tpch_q16/datafusion:vortex-file-compressed 19126172 19492634 0.98
tpch_q17/datafusion:vortex-file-compressed 66329283 63211749 1.05
tpch_q18/datafusion:vortex-file-compressed 74143997 78698490 0.94
tpch_q19/datafusion:vortex-file-compressed 29297737 28435100 1.03
tpch_q20/datafusion:vortex-file-compressed 29915537 31671788 0.94
tpch_q21/datafusion:vortex-file-compressed 68798389 67878139 1.01
tpch_q22/datafusion:vortex-file-compressed 11686500 11714742 1.00
datafusion / parquet (0.975x ➖, 2↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 95717200 138195377 0.69
tpch_q02/datafusion:parquet 60208231 60034292 1.00
tpch_q03/datafusion:parquet 80929338 77092992 1.05
tpch_q04/datafusion:parquet 45156544 46552753 0.97
tpch_q05/datafusion:parquet 93875652 93118829 1.01
tpch_q06/datafusion:parquet 42284828 42073671 1.01
tpch_q07/datafusion:parquet 103049856 106033074 0.97
tpch_q08/datafusion:parquet 92212546 92680951 0.99
tpch_q09/datafusion:parquet 127258849 119886847 1.06
tpch_q10/datafusion:parquet 118505666 115911162 1.02
tpch_q11/datafusion:parquet 40408228 41720764 0.97
tpch_q12/datafusion:parquet 77185211 78857515 0.98
tpch_q13/datafusion:parquet 191008388 195878158 0.98
tpch_q14/datafusion:parquet 45665822 44980543 1.02
tpch_q15/datafusion:parquet 61477853 59719463 1.03
tpch_q16/datafusion:parquet 42862378 42524327 1.01
tpch_q17/datafusion:parquet 137136903 138686402 0.99
tpch_q18/datafusion:parquet 148945072 152104402 0.98
tpch_q19/datafusion:parquet 🚀 68784123 79304934 0.87
tpch_q20/datafusion:parquet 67926602 72461024 0.94
tpch_q21/datafusion:parquet 147084847 145904588 1.01
tpch_q22/datafusion:parquet 43209051 43805385 0.99
datafusion / arrow (0.983x ➖, 1↑ 1↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56579338 61680836 0.92
tpch_q02/datafusion:arrow 16555673 16919747 0.98
tpch_q03/datafusion:arrow 31894848 31817842 1.00
tpch_q04/datafusion:arrow 26813804 25749338 1.04
tpch_q05/datafusion:arrow 55634313 53795110 1.03
tpch_q06/datafusion:arrow 🚨 23470682 20640342 1.14
tpch_q07/datafusion:arrow 106275896 104208860 1.02
tpch_q08/datafusion:arrow 40180408 43264782 0.93
tpch_q09/datafusion:arrow 63404494 67802166 0.94
tpch_q10/datafusion:arrow 🚀 46978753 53208360 0.88
tpch_q11/datafusion:arrow 8823734 9085576 0.97
tpch_q12/datafusion:arrow 48672617 49495886 0.98
tpch_q13/datafusion:arrow 45131003 44880734 1.01
tpch_q14/datafusion:arrow 23432496 23863884 0.98
tpch_q15/datafusion:arrow 46592216 47122449 0.99
tpch_q16/datafusion:arrow 15802947 16639360 0.95
tpch_q17/datafusion:arrow 67161898 67365866 1.00
tpch_q18/datafusion:arrow 106090836 106453539 1.00
tpch_q19/datafusion:arrow 37724471 38196333 0.99
tpch_q20/datafusion:arrow 35055436 36431729 0.96
tpch_q21/datafusion:arrow 149955624 153218444 0.98
tpch_q22/datafusion:arrow 11616516 11959196 0.97
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 27593594 27553873 1.00
tpch_q02/duckdb:vortex-file-compressed 24436917 25580253 0.96
tpch_q03/duckdb:vortex-file-compressed 31182015 31930294 0.98
tpch_q04/duckdb:vortex-file-compressed 27130251 27287169 0.99
tpch_q05/duckdb:vortex-file-compressed 34498766 34648209 1.00
tpch_q06/duckdb:vortex-file-compressed 8253296 8282126 1.00
tpch_q07/duckdb:vortex-file-compressed 33267416 33646083 0.99
tpch_q08/duckdb:vortex-file-compressed 39274150 39360977 1.00
tpch_q09/duckdb:vortex-file-compressed 53586894 55915727 0.96
tpch_q10/duckdb:vortex-file-compressed 40457151 40535014 1.00
tpch_q11/duckdb:vortex-file-compressed 13499521 13322563 1.01
tpch_q12/duckdb:vortex-file-compressed 22889764 23163643 0.99
tpch_q13/duckdb:vortex-file-compressed 39642763 39614288 1.00
tpch_q14/duckdb:vortex-file-compressed 19047527 19644587 0.97
tpch_q15/duckdb:vortex-file-compressed 16044205 16321592 0.98
tpch_q16/duckdb:vortex-file-compressed 27044389 27122811 1.00
tpch_q17/duckdb:vortex-file-compressed 23299817 23607856 0.99
tpch_q18/duckdb:vortex-file-compressed 50488856 50974525 0.99
tpch_q19/duckdb:vortex-file-compressed 25604655 25543120 1.00
tpch_q20/duckdb:vortex-file-compressed 30869652 31429654 0.98
tpch_q21/duckdb:vortex-file-compressed 95652592 97843064 0.98
tpch_q22/duckdb:vortex-file-compressed 16389001 16970598 0.97
duckdb / parquet (0.985x ➖, 2↑ 1↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77384594 79086675 0.98
tpch_q02/duckdb:parquet 38917664 39614073 0.98
tpch_q03/duckdb:parquet 70074225 70659895 0.99
tpch_q04/duckdb:parquet 49385489 49477777 1.00
tpch_q05/duckdb:parquet 67957485 68106017 1.00
tpch_q06/duckdb:parquet 22366727 22342185 1.00
tpch_q07/duckdb:parquet 🚀 68949412 83080337 0.83
tpch_q08/duckdb:parquet 83193852 82450383 1.01
tpch_q09/duckdb:parquet 133852819 134299346 1.00
tpch_q10/duckdb:parquet 132289224 132464534 1.00
tpch_q11/duckdb:parquet 22352767 22449120 1.00
tpch_q12/duckdb:parquet 🚀 46487446 58019555 0.80
tpch_q13/duckdb:parquet 247664599 253164477 0.98
tpch_q14/duckdb:parquet 51344724 51086986 1.01
tpch_q15/duckdb:parquet 26084139 26052969 1.00
tpch_q16/duckdb:parquet 57960454 58989650 0.98
tpch_q17/duckdb:parquet 62266711 59086861 1.05
tpch_q18/duckdb:parquet 118885099 120172573 0.99
tpch_q19/duckdb:parquet 🚨 88545060 73921243 1.20
tpch_q20/duckdb:parquet 67471189 65641604 1.03
tpch_q21/duckdb:parquet 169742588 185760943 0.91
tpch_q22/duckdb:parquet 53984334 53785236 1.00

File Size Changes (17 files changed, -44.3% overall, 6↑ 11↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 1.0 vortex-file-compressed 605.41 KB 616.60 KB +11.19 KB +1.8%
orders_0.vortex 1.0 vortex-file-compressed 35.27 MB 35.74 MB +473.49 KB +1.3%
partsupp_0.vortex 1.0 vortex-file-compressed 23.68 MB 23.73 MB +53.45 KB +0.2%
customer_0.vortex 1.0 vortex-file-compressed 8.88 MB 8.90 MB +20.03 KB +0.2%
lineitem_0.vortex 1.0 vortex-file-compressed 82.08 MB 82.24 MB +168.55 KB +0.2%
lineitem_1.vortex 1.0 vortex-file-compressed 81.99 MB 82.04 MB +58.41 KB +0.1%
part_0.vortex 1.0 vortex-file-compressed 5.08 MB 5.01 MB 71.27 KB -1.4%
customer_0.vortex 1.0 vortex-compact 7.43 MB 0 B 7.43 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 0 B 63.00 MB -100.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 0 B 63.03 MB -100.0%
nation_0.vortex 1.0 vortex-compact 8.18 KB 0 B 8.18 KB -100.0%
orders_0.vortex 1.0 vortex-compact 32.20 MB 0 B 32.20 MB -100.0%
part_0.vortex 1.0 vortex-compact 3.32 MB 0 B 3.32 MB -100.0%
partsupp_0.vortex 1.0 vortex-compact 20.85 MB 0 B 20.85 MB -100.0%
region_0.vortex 1.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 0 B 496.46 KB -100.0%

Totals:

  • vortex-compact: 190.59 MB → 0 B (-100.0%)
  • vortex-file-compressed: 237.85 MB → 238.55 MB (+0.3%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 0.906x ➖
Parquet (geomean): 0.911x ➖
Shifts: Parquet (control) -8.9% · Median polish -9.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.894x ✅, 6↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5219293 5906371 0.88
fineweb_q01/datafusion:vortex-file-compressed 33683536 36567973 0.92
fineweb_q02/datafusion:vortex-file-compressed 39117889 40204163 0.97
fineweb_q03/datafusion:vortex-file-compressed 🚀 54746071 67136765 0.82
fineweb_q04/datafusion:vortex-file-compressed 🚀 275019551 308465659 0.89
fineweb_q05/datafusion:vortex-file-compressed 🚀 217934180 244730227 0.89
fineweb_q06/datafusion:vortex-file-compressed 51365094 54713285 0.94
fineweb_q07/datafusion:vortex-file-compressed 🚀 54746806 63927068 0.86
fineweb_q08/datafusion:vortex-file-compressed 🚀 22145155 24973466 0.89
datafusion / parquet (0.896x ✅, 6↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6590577 7615906 0.87
fineweb_q01/datafusion:parquet 🚀 280564656 314549088 0.89
fineweb_q02/datafusion:parquet 🚀 287077889 320692415 0.90
fineweb_q03/datafusion:parquet 290010905 302692527 0.96
fineweb_q04/datafusion:parquet 299256070 331800422 0.90
fineweb_q05/datafusion:parquet 🚀 297971194 347590545 0.86
fineweb_q06/datafusion:parquet 🚀 282251725 319165923 0.88
fineweb_q07/datafusion:parquet 282281745 306684205 0.92
fineweb_q08/datafusion:parquet 🚀 275084131 307229342 0.90
duckdb / vortex-file-compressed (0.917x ➖, 3↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3211648 3247283 0.99
fineweb_q01/duckdb:vortex-file-compressed 🚀 33018723 37370097 0.88
fineweb_q02/duckdb:vortex-file-compressed 39221305 41104615 0.95
fineweb_q03/duckdb:vortex-file-compressed 🚀 113586978 126459998 0.90
fineweb_q04/duckdb:vortex-file-compressed 274355315 301933707 0.91
fineweb_q05/duckdb:vortex-file-compressed 214240185 237970082 0.90
fineweb_q06/duckdb:vortex-file-compressed 🚀 51917391 59986971 0.87
fineweb_q07/duckdb:vortex-file-compressed 53625000 57878318 0.93
fineweb_q08/duckdb:vortex-file-compressed 21965388 23503593 0.93
duckdb / parquet (0.926x ➖, 2↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30885552 33932562 0.91
fineweb_q01/duckdb:parquet 🚀 84202300 93634567 0.90
fineweb_q02/duckdb:parquet 84530392 92587553 0.91
fineweb_q03/duckdb:parquet 319217277 336300787 0.95
fineweb_q04/duckdb:parquet 445462636 466375365 0.96
fineweb_q05/duckdb:parquet 414570536 429720238 0.96
fineweb_q06/duckdb:parquet 204188182 213927955 0.95
fineweb_q07/duckdb:parquet 217762424 227454909 0.96
fineweb_q08/duckdb:parquet 🚀 33044744 39543948 0.84

File Size Changes (3 files changed, -46.3% overall, 1↑ 2↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +560.87 KB +0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.008x ➖, 0↑ 1↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 23450043 23609140 0.99
tpcds_q02/datafusion:vortex-file-compressed 45627762 44024617 1.04
tpcds_q03/datafusion:vortex-file-compressed 16358132 15051044 1.09
tpcds_q04/datafusion:vortex-file-compressed 229754931 223900799 1.03
tpcds_q05/datafusion:vortex-file-compressed 42082165 42908939 0.98
tpcds_q06/datafusion:vortex-file-compressed 23012700 22932004 1.00
tpcds_q07/datafusion:vortex-file-compressed 43816476 42593715 1.03
tpcds_q08/datafusion:vortex-file-compressed 30071675 29581817 1.02
tpcds_q09/datafusion:vortex-file-compressed 33479140 32077109 1.04
tpcds_q10/datafusion:vortex-file-compressed 37978280 38813184 0.98
tpcds_q11/datafusion:vortex-file-compressed 129383730 129720190 1.00
tpcds_q12/datafusion:vortex-file-compressed 17313487 17750010 0.98
tpcds_q13/datafusion:vortex-file-compressed 45988756 47294768 0.97
tpcds_q14/datafusion:vortex-file-compressed 162907232 160201667 1.02
tpcds_q15/datafusion:vortex-file-compressed 25797068 26832085 0.96
tpcds_q16/datafusion:vortex-file-compressed 23071899 23059727 1.00
tpcds_q17/datafusion:vortex-file-compressed 59095534 60674176 0.97
tpcds_q18/datafusion:vortex-file-compressed 61159744 59970747 1.02
tpcds_q19/datafusion:vortex-file-compressed 21838622 22444772 0.97
tpcds_q20/datafusion:vortex-file-compressed 19768078 21160348 0.93
tpcds_q21/datafusion:vortex-file-compressed 35181265 35860181 0.98
tpcds_q22/datafusion:vortex-file-compressed 124625170 123708450 1.01
tpcds_q23/datafusion:vortex-file-compressed 150807291 156955148 0.96
tpcds_q24/datafusion:vortex-file-compressed 🚨 94891600 85461677 1.11
tpcds_q25/datafusion:vortex-file-compressed 63120984 62777057 1.01
tpcds_q26/datafusion:vortex-file-compressed 30921508 31587554 0.98
tpcds_q27/datafusion:vortex-file-compressed 97744851 99135445 0.99
tpcds_q28/datafusion:vortex-file-compressed 33868282 34403827 0.98
tpcds_q29/datafusion:vortex-file-compressed 60703240 60081682 1.01
tpcds_q30/datafusion:vortex-file-compressed 24777343 23588672 1.05
tpcds_q31/datafusion:vortex-file-compressed 73081090 72860903 1.00
tpcds_q32/datafusion:vortex-file-compressed 18333374 18353891 1.00
tpcds_q33/datafusion:vortex-file-compressed 29270281 29480082 0.99
tpcds_q34/datafusion:vortex-file-compressed 27119792 25614354 1.06
tpcds_q35/datafusion:vortex-file-compressed 44062134 43440780 1.01
tpcds_q36/datafusion:vortex-file-compressed 58793659 61439397 0.96
tpcds_q37/datafusion:vortex-file-compressed 20357159 20910142 0.97
tpcds_q38/datafusion:vortex-file-compressed 38783157 39129928 0.99
tpcds_q39/datafusion:vortex-file-compressed 109985287 106519651 1.03
tpcds_q40/datafusion:vortex-file-compressed 29717450 30679704 0.97
tpcds_q41/datafusion:vortex-file-compressed 20150517 19936136 1.01
tpcds_q42/datafusion:vortex-file-compressed 14344008 13871047 1.03
tpcds_q43/datafusion:vortex-file-compressed 18826328 19181868 0.98
tpcds_q44/datafusion:vortex-file-compressed 29766927 29476154 1.01
tpcds_q45/datafusion:vortex-file-compressed 25582743 25278756 1.01
tpcds_q46/datafusion:vortex-file-compressed 36229296 36740015 0.99
tpcds_q47/datafusion:vortex-file-compressed 141212205 143395461 0.98
tpcds_q48/datafusion:vortex-file-compressed 38937420 36698928 1.06
tpcds_q49/datafusion:vortex-file-compressed 56899684 57101805 1.00
tpcds_q50/datafusion:vortex-file-compressed 38332214 38987773 0.98
tpcds_q51/datafusion:vortex-file-compressed 89704293 87818522 1.02
tpcds_q52/datafusion:vortex-file-compressed 14935408 14232826 1.05
tpcds_q53/datafusion:vortex-file-compressed 23091938 22427176 1.03
tpcds_q54/datafusion:vortex-file-compressed 33796703 34251421 0.99
tpcds_q55/datafusion:vortex-file-compressed 13740389 13600787 1.01
tpcds_q56/datafusion:vortex-file-compressed 31657665 29949383 1.06
tpcds_q57/datafusion:vortex-file-compressed 94625918 90179073 1.05
tpcds_q58/datafusion:vortex-file-compressed 55350998 55277836 1.00
tpcds_q59/datafusion:vortex-file-compressed 61716205 61446077 1.00
tpcds_q60/datafusion:vortex-file-compressed 31270783 29290859 1.07
tpcds_q61/datafusion:vortex-file-compressed 41501788 39224345 1.06
tpcds_q62/datafusion:vortex-file-compressed 21538262 21374433 1.01
tpcds_q63/datafusion:vortex-file-compressed 23084957 22879405 1.01
tpcds_q64/datafusion:vortex-file-compressed 388567849 370319089 1.05
tpcds_q65/datafusion:vortex-file-compressed 52344033 53239212 0.98
tpcds_q66/datafusion:vortex-file-compressed 69061272 68186072 1.01
tpcds_q67/datafusion:vortex-file-compressed 158723216 154064782 1.03
tpcds_q68/datafusion:vortex-file-compressed 35160743 33609624 1.05
tpcds_q69/datafusion:vortex-file-compressed 35412159 34877854 1.02
tpcds_q70/datafusion:vortex-file-compressed 95807749 95308681 1.01
tpcds_q71/datafusion:vortex-file-compressed 23705040 23159800 1.02
tpcds_q72/datafusion:vortex-file-compressed 2087019783 2079630590 1.00
tpcds_q73/datafusion:vortex-file-compressed 24825715 24053951 1.03
tpcds_q74/datafusion:vortex-file-compressed 84378886 81049495 1.04
tpcds_q75/datafusion:vortex-file-compressed 108266723 106470771 1.02
tpcds_q76/datafusion:vortex-file-compressed 28409991 27686705 1.03
tpcds_q77/datafusion:vortex-file-compressed 36758410 36094893 1.02
tpcds_q78/datafusion:vortex-file-compressed 111157940 110444864 1.01
tpcds_q79/datafusion:vortex-file-compressed 29908247 31553413 0.95
tpcds_q80/datafusion:vortex-file-compressed 86366240 86821452 0.99
tpcds_q81/datafusion:vortex-file-compressed 24724829 24382042 1.01
tpcds_q82/datafusion:vortex-file-compressed 21555870 22282165 0.97
tpcds_q83/datafusion:vortex-file-compressed 34723386 34402013 1.01
tpcds_q84/datafusion:vortex-file-compressed 12326779 12033577 1.02
tpcds_q85/datafusion:vortex-file-compressed 91215936 93641447 0.97
tpcds_q86/datafusion:vortex-file-compressed 15066965 15134038 1.00
tpcds_q87/datafusion:vortex-file-compressed 39800894 39571815 1.01
tpcds_q88/datafusion:vortex-file-compressed 55488878 54606270 1.02
tpcds_q89/datafusion:vortex-file-compressed 26579970 25322117 1.05
tpcds_q90/datafusion:vortex-file-compressed 13300358 13239107 1.00
tpcds_q91/datafusion:vortex-file-compressed 18704729 18688033 1.00
tpcds_q92/datafusion:vortex-file-compressed 15642832 15561073 1.01
tpcds_q93/datafusion:vortex-file-compressed 32308814 31857611 1.01
tpcds_q94/datafusion:vortex-file-compressed 20590459 20637997 1.00
tpcds_q95/datafusion:vortex-file-compressed 55387952 55343526 1.00
tpcds_q96/datafusion:vortex-file-compressed 13669908 13346704 1.02
tpcds_q97/datafusion:vortex-file-compressed 28859983 29081451 0.99
tpcds_q98/datafusion:vortex-file-compressed 24539179 25196507 0.97
tpcds_q99/datafusion:vortex-file-compressed 26198154 25439593 1.03
datafusion / parquet (1.008x ➖, 0↑ 5↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23548018 24135294 0.98
tpcds_q02/datafusion:parquet 40799580 43187688 0.94
tpcds_q03/datafusion:parquet 13492846 13564897 0.99
tpcds_q04/datafusion:parquet 288869980 300293911 0.96
tpcds_q05/datafusion:parquet 46766138 46125275 1.01
tpcds_q06/datafusion:parquet 22721060 23042169 0.99
tpcds_q07/datafusion:parquet 77654592 76058406 1.02
tpcds_q08/datafusion:parquet 27920702 29223444 0.96
tpcds_q09/datafusion:parquet 🚨 42830796 37424695 1.14
tpcds_q10/datafusion:parquet 73314977 69427852 1.06
tpcds_q11/datafusion:parquet 159825569 148134636 1.08
tpcds_q12/datafusion:parquet 18539247 17570648 1.06
tpcds_q13/datafusion:parquet 75178309 74485450 1.01
tpcds_q14/datafusion:parquet 163358700 160158588 1.02
tpcds_q15/datafusion:parquet 20708870 22263287 0.93
tpcds_q16/datafusion:parquet 29353359 31933874 0.92
tpcds_q17/datafusion:parquet 61415969 63060334 0.97
tpcds_q18/datafusion:parquet 108804010 110335922 0.99
tpcds_q19/datafusion:parquet 23587537 23009024 1.03
tpcds_q20/datafusion:parquet 🚨 19413138 17196409 1.13
tpcds_q21/datafusion:parquet 18988507 18450213 1.03
tpcds_q22/datafusion:parquet 150638787 155334087 0.97
tpcds_q23/datafusion:parquet 152825125 150846968 1.01
tpcds_q24/datafusion:parquet 90120192 86464339 1.04
tpcds_q25/datafusion:parquet 62657132 62211253 1.01
tpcds_q26/datafusion:parquet 66132541 66043279 1.00
tpcds_q27/datafusion:parquet 135200725 134802277 1.00
tpcds_q28/datafusion:parquet 45247383 45191786 1.00
tpcds_q29/datafusion:parquet 65253733 66663191 0.98
tpcds_q30/datafusion:parquet 33923947 33091996 1.03
tpcds_q31/datafusion:parquet 67308185 65490037 1.03
tpcds_q32/datafusion:parquet 16246233 17215061 0.94
tpcds_q33/datafusion:parquet 26761785 27090497 0.99
tpcds_q34/datafusion:parquet 23193342 21725997 1.07
tpcds_q35/datafusion:parquet 70203718 69392673 1.01
tpcds_q36/datafusion:parquet 57562591 59111818 0.97
tpcds_q37/datafusion:parquet 19182019 18994603 1.01
tpcds_q38/datafusion:parquet 41234860 39980032 1.03
tpcds_q39/datafusion:parquet 73940302 73912500 1.00
tpcds_q40/datafusion:parquet 🚨 25343736 22028715 1.15
tpcds_q41/datafusion:parquet 14379937 14673142 0.98
tpcds_q42/datafusion:parquet 11677913 12861535 0.91
tpcds_q43/datafusion:parquet 19426314 17829350 1.09
tpcds_q44/datafusion:parquet 🚨 37232203 32911191 1.13
tpcds_q45/datafusion:parquet 27846273 28517003 0.98
tpcds_q46/datafusion:parquet 32932981 31734368 1.04
tpcds_q47/datafusion:parquet 130951289 131297658 1.00
tpcds_q48/datafusion:parquet 72133729 69782357 1.03
tpcds_q49/datafusion:parquet 58649935 54533217 1.08
tpcds_q50/datafusion:parquet 44437252 42013993 1.06
tpcds_q51/datafusion:parquet 88113376 86469953 1.02
tpcds_q52/datafusion:parquet 12274978 12089299 1.02
tpcds_q53/datafusion:parquet 18638100 17918297 1.04
tpcds_q54/datafusion:parquet 31817125 33428129 0.95
tpcds_q55/datafusion:parquet 11615098 12214612 0.95
tpcds_q56/datafusion:parquet 28315656 27862203 1.02
tpcds_q57/datafusion:parquet 96855221 103773284 0.93
tpcds_q58/datafusion:parquet 55783074 54547891 1.02
tpcds_q59/datafusion:parquet 63852167 61981058 1.03
tpcds_q60/datafusion:parquet 27550862 28825312 0.96
tpcds_q61/datafusion:parquet 42438229 42748144 0.99
tpcds_q62/datafusion:parquet 🚨 23407616 20318762 1.15
tpcds_q63/datafusion:parquet 18337449 18566570 0.99
tpcds_q64/datafusion:parquet 304245417 302835005 1.00
tpcds_q65/datafusion:parquet 37479623 37962286 0.99
tpcds_q66/datafusion:parquet 72203807 69158908 1.04
tpcds_q67/datafusion:parquet 151647874 150879888 1.01
tpcds_q68/datafusion:parquet 31246792 34595797 0.90
tpcds_q69/datafusion:parquet 65320893 65648143 1.00
tpcds_q70/datafusion:parquet 33183576 32778687 1.01
tpcds_q71/datafusion:parquet 23184821 23342972 0.99
tpcds_q72/datafusion:parquet 570369468 577057069 0.99
tpcds_q73/datafusion:parquet 24029664 22706624 1.06
tpcds_q74/datafusion:parquet 81824987 82734886 0.99
tpcds_q75/datafusion:parquet 105893689 107066155 0.99
tpcds_q76/datafusion:parquet 30504485 29452284 1.04
tpcds_q77/datafusion:parquet 37724504 39525429 0.95
tpcds_q78/datafusion:parquet 107170724 106713335 1.00
tpcds_q79/datafusion:parquet 26815443 27333974 0.98
tpcds_q80/datafusion:parquet 73906114 78141689 0.95
tpcds_q81/datafusion:parquet 30046637 30163517 1.00
tpcds_q82/datafusion:parquet 19627008 18912423 1.04
tpcds_q83/datafusion:parquet 41445587 41514056 1.00
tpcds_q84/datafusion:parquet 39515444 39372593 1.00
tpcds_q85/datafusion:parquet 146868368 145341097 1.01
tpcds_q86/datafusion:parquet 15487452 15826664 0.98
tpcds_q87/datafusion:parquet 42849093 43030668 1.00
tpcds_q88/datafusion:parquet 60924602 62537454 0.97
tpcds_q89/datafusion:parquet 22639287 23068352 0.98
tpcds_q90/datafusion:parquet 15423303 14107025 1.09
tpcds_q91/datafusion:parquet 60159055 57391864 1.05
tpcds_q92/datafusion:parquet 17697489 17748149 1.00
tpcds_q93/datafusion:parquet 30853711 31835283 0.97
tpcds_q94/datafusion:parquet 21843796 21194696 1.03
tpcds_q95/datafusion:parquet 62305270 62561795 1.00
tpcds_q96/datafusion:parquet 13218840 12218692 1.08
tpcds_q97/datafusion:parquet 31943837 29438378 1.09
tpcds_q98/datafusion:parquet 21941514 21630824 1.01
tpcds_q99/datafusion:parquet 27343528 29521106 0.93
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 5↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23284039 22649664 1.03
tpcds_q02/duckdb:vortex-file-compressed 22327822 22328190 1.00
tpcds_q03/duckdb:vortex-file-compressed 20225429 19955097 1.01
tpcds_q04/duckdb:vortex-file-compressed 96996681 95792510 1.01
tpcds_q05/duckdb:vortex-file-compressed 33833454 34954004 0.97
tpcds_q06/duckdb:vortex-file-compressed 34510724 34717727 0.99
tpcds_q07/duckdb:vortex-file-compressed 28899327 28315072 1.02
tpcds_q08/duckdb:vortex-file-compressed 26819018 25651436 1.05
tpcds_q09/duckdb:vortex-file-compressed 16726870 16196578 1.03
tpcds_q10/duckdb:vortex-file-compressed 40015843 39557377 1.01
tpcds_q11/duckdb:vortex-file-compressed 73654936 72014378 1.02
tpcds_q12/duckdb:vortex-file-compressed 16593403 16156423 1.03
tpcds_q13/duckdb:vortex-file-compressed 36432817 34357058 1.06
tpcds_q14/duckdb:vortex-file-compressed 101915669 103040370 0.99
tpcds_q15/duckdb:vortex-file-compressed 28697018 28026729 1.02
tpcds_q16/duckdb:vortex-file-compressed 25006128 23330512 1.07
tpcds_q17/duckdb:vortex-file-compressed 49343447 50086559 0.99
tpcds_q18/duckdb:vortex-file-compressed 39905289 39624920 1.01
tpcds_q19/duckdb:vortex-file-compressed 37432577 36156240 1.04
tpcds_q20/duckdb:vortex-file-compressed 16458561 17030106 0.97
tpcds_q21/duckdb:vortex-file-compressed 16377438 16566750 0.99
tpcds_q22/duckdb:vortex-file-compressed 73578392 70776630 1.04
tpcds_q23/duckdb:vortex-file-compressed 90700298 90297025 1.00
tpcds_q24/duckdb:vortex-file-compressed 47062886 47059215 1.00
tpcds_q25/duckdb:vortex-file-compressed 39713867 37755840 1.05
tpcds_q26/duckdb:vortex-file-compressed 19759789 19650624 1.01
tpcds_q27/duckdb:vortex-file-compressed 29202224 29013500 1.01
tpcds_q28/duckdb:vortex-file-compressed 12173678 11946271 1.02
tpcds_q29/duckdb:vortex-file-compressed 46972690 46757155 1.00
tpcds_q30/duckdb:vortex-file-compressed 27458310 26508979 1.04
tpcds_q31/duckdb:vortex-file-compressed 30361225 31872848 0.95
tpcds_q32/duckdb:vortex-file-compressed 14166069 13024193 1.09
tpcds_q33/duckdb:vortex-file-compressed 25756635 24924072 1.03
tpcds_q34/duckdb:vortex-file-compressed 27654499 27009375 1.02
tpcds_q35/duckdb:vortex-file-compressed 67315613 69364537 0.97
tpcds_q36/duckdb:vortex-file-compressed 24943141 25220384 0.99
tpcds_q37/duckdb:vortex-file-compressed 19666267 19803588 0.99
tpcds_q38/duckdb:vortex-file-compressed 🚨 41286439 36432446 1.13
tpcds_q39/duckdb:vortex-file-compressed 32337984 29754736 1.09
tpcds_q40/duckdb:vortex-file-compressed 18416898 18489246 1.00
tpcds_q41/duckdb:vortex-file-compressed 12621776 12501499 1.01
tpcds_q42/duckdb:vortex-file-compressed 15376234 16114929 0.95
tpcds_q43/duckdb:vortex-file-compressed 18570068 18375148 1.01
tpcds_q44/duckdb:vortex-file-compressed 21938789 21415101 1.02
tpcds_q45/duckdb:vortex-file-compressed 30389835 31477807 0.97
tpcds_q46/duckdb:vortex-file-compressed 33102551 35862626 0.92
tpcds_q47/duckdb:vortex-file-compressed 53412489 53122202 1.01
tpcds_q48/duckdb:vortex-file-compressed 32067875 32447122 0.99
tpcds_q49/duckdb:vortex-file-compressed 35295715 36392173 0.97
tpcds_q50/duckdb:vortex-file-compressed 28252443 27262771 1.04
tpcds_q51/duckdb:vortex-file-compressed 106034988 106167464 1.00
tpcds_q52/duckdb:vortex-file-compressed 14971648 15595489 0.96
tpcds_q53/duckdb:vortex-file-compressed 24389306 23989048 1.02
tpcds_q54/duckdb:vortex-file-compressed 29572529 29704752 1.00
tpcds_q55/duckdb:vortex-file-compressed 15740232 14868050 1.06
tpcds_q56/duckdb:vortex-file-compressed 28728982 28900827 0.99
tpcds_q57/duckdb:vortex-file-compressed 37157793 36370408 1.02
tpcds_q58/duckdb:vortex-file-compressed 30668468 30007445 1.02
tpcds_q59/duckdb:vortex-file-compressed 42129455 38420381 1.10
tpcds_q60/duckdb:vortex-file-compressed 28365483 28001638 1.01
tpcds_q61/duckdb:vortex-file-compressed 33630008 31875271 1.06
tpcds_q62/duckdb:vortex-file-compressed 🚨 16548447 14860028 1.11
tpcds_q63/duckdb:vortex-file-compressed 23377938 23048496 1.01
tpcds_q64/duckdb:vortex-file-compressed 101546753 100560898 1.01
tpcds_q65/duckdb:vortex-file-compressed 23549589 23201373 1.02
tpcds_q66/duckdb:vortex-file-compressed 30441399 28611270 1.06
tpcds_q67/duckdb:vortex-file-compressed 139858468 140743026 0.99
tpcds_q68/duckdb:vortex-file-compressed 36321766 33311562 1.09
tpcds_q69/duckdb:vortex-file-compressed 43135654 45250287 0.95
tpcds_q70/duckdb:vortex-file-compressed 31847398 34209545 0.93
tpcds_q71/duckdb:vortex-file-compressed 23486193 22692457 1.03
tpcds_q72/duckdb:vortex-file-compressed 155363549 156600421 0.99
tpcds_q73/duckdb:vortex-file-compressed 29081822 28335618 1.03
tpcds_q74/duckdb:vortex-file-compressed 49389468 46561280 1.06
tpcds_q75/duckdb:vortex-file-compressed 49906308 50180172 0.99
tpcds_q76/duckdb:vortex-file-compressed 21926306 21139792 1.04
tpcds_q77/duckdb:vortex-file-compressed 🚨 27334157 23003113 1.19
tpcds_q78/duckdb:vortex-file-compressed 67466977 68104521 0.99
tpcds_q79/duckdb:vortex-file-compressed 27406472 28523510 0.96
tpcds_q80/duckdb:vortex-file-compressed 48908048 47491958 1.03
tpcds_q81/duckdb:vortex-file-compressed 29836046 29397663 1.01
tpcds_q82/duckdb:vortex-file-compressed 47439848 47068863 1.01
tpcds_q83/duckdb:vortex-file-compressed 29355137 28869953 1.02
tpcds_q84/duckdb:vortex-file-compressed 🚨 18783448 15998109 1.17
tpcds_q85/duckdb:vortex-file-compressed 45942598 44915268 1.02
tpcds_q86/duckdb:vortex-file-compressed 17806318 17154014 1.04
tpcds_q87/duckdb:vortex-file-compressed 45329747 42172878 1.07
tpcds_q88/duckdb:vortex-file-compressed 59962759 57139359 1.05
tpcds_q89/duckdb:vortex-file-compressed 23712552 25426940 0.93
tpcds_q90/duckdb:vortex-file-compressed 11744720 10985655 1.07
tpcds_q91/duckdb:vortex-file-compressed 24727846 23357042 1.06
tpcds_q92/duckdb:vortex-file-compressed 19677828 19182466 1.03
tpcds_q93/duckdb:vortex-file-compressed 28903736 28135720 1.03
tpcds_q94/duckdb:vortex-file-compressed 22280337 21779232 1.02
tpcds_q95/duckdb:vortex-file-compressed 124120668 123354906 1.01
tpcds_q96/duckdb:vortex-file-compressed 13415312 13501774 0.99
tpcds_q97/duckdb:vortex-file-compressed 39121592 39059395 1.00
tpcds_q98/duckdb:vortex-file-compressed 19696643 21083853 0.93
tpcds_q99/duckdb:vortex-file-compressed 🚨 21238063 17989015 1.18
duckdb / parquet (1.008x ➖, 1↑ 2↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29640445 29657274 1.00
tpcds_q02/duckdb:parquet 24569709 25304882 0.97
tpcds_q03/duckdb:parquet 12682829 12709317 1.00
tpcds_q04/duckdb:parquet 167589859 171022476 0.98
tpcds_q05/duckdb:parquet 31914091 30488306 1.05
tpcds_q06/duckdb:parquet 34753307 33379299 1.04
tpcds_q07/duckdb:parquet 24440262 24345735 1.00
tpcds_q08/duckdb:parquet 30000042 29689240 1.01
tpcds_q09/duckdb:parquet 44240847 44636087 0.99
tpcds_q10/duckdb:parquet 38059236 38172657 1.00
tpcds_q11/duckdb:parquet 89438206 93311247 0.96
tpcds_q12/duckdb:parquet 17459336 16686907 1.05
tpcds_q13/duckdb:parquet 35087194 35181902 1.00
tpcds_q14/duckdb:parquet 100478657 100829809 1.00
tpcds_q15/duckdb:parquet 30970459 30947643 1.00
tpcds_q16/duckdb:parquet 22940279 22410153 1.02
tpcds_q17/duckdb:parquet 38897536 38422933 1.01
tpcds_q18/duckdb:parquet 48562449 47815468 1.02
tpcds_q19/duckdb:parquet 31736410 31811260 1.00
tpcds_q20/duckdb:parquet 18860193 18479061 1.02
tpcds_q21/duckdb:parquet 🚨 14394702 11522362 1.25
tpcds_q22/duckdb:parquet 72028569 69643625 1.03
tpcds_q23/duckdb:parquet 80760491 80416688 1.00
tpcds_q24/duckdb:parquet 47259871 48360611 0.98
tpcds_q25/duckdb:parquet 35785045 35603775 1.01
tpcds_q26/duckdb:parquet 38936331 38319222 1.02
tpcds_q27/duckdb:parquet 53771138 52772280 1.02
tpcds_q28/duckdb:parquet 43303854 43841491 0.99
tpcds_q29/duckdb:parquet 37547456 36564063 1.03
tpcds_q30/duckdb:parquet 37919542 37690372 1.01
tpcds_q31/duckdb:parquet 28094633 26730269 1.05
tpcds_q32/duckdb:parquet 12980696 12166194 1.07
tpcds_q33/duckdb:parquet 24991521 23458847 1.07
tpcds_q34/duckdb:parquet 23335052 23684804 0.99
tpcds_q35/duckdb:parquet 62072817 61445912 1.01
tpcds_q36/duckdb:parquet 22788057 23002078 0.99
tpcds_q37/duckdb:parquet 15416709 14175242 1.09
tpcds_q38/duckdb:parquet 37703469 37690855 1.00
tpcds_q39/duckdb:parquet 32875388 32287030 1.02
tpcds_q40/duckdb:parquet 20392202 19284071 1.06
tpcds_q41/duckdb:parquet 9207931 8812034 1.04
tpcds_q42/duckdb:parquet 13029912 12125784 1.07
tpcds_q43/duckdb:parquet 18084300 16978046 1.07
tpcds_q44/duckdb:parquet 26240378 26093249 1.01
tpcds_q45/duckdb:parquet 28351212 29677001 0.96
tpcds_q46/duckdb:parquet 47436316 47816276 0.99
tpcds_q47/duckdb:parquet 50589329 50112423 1.01
tpcds_q48/duckdb:parquet 32447888 32828475 0.99
tpcds_q49/duckdb:parquet 28832769 28800125 1.00
tpcds_q50/duckdb:parquet 26016975 26471413 0.98
tpcds_q51/duckdb:parquet 102508031 113209686 0.91
tpcds_q52/duckdb:parquet 13337604 14623459 0.91
tpcds_q53/duckdb:parquet 19113239 19178150 1.00
tpcds_q54/duckdb:parquet 28629690 29187849 0.98
tpcds_q55/duckdb:parquet 12895353 12575616 1.03
tpcds_q56/duckdb:parquet 23779781 24608075 0.97
tpcds_q57/duckdb:parquet 38234588 38220201 1.00
tpcds_q58/duckdb:parquet 25916157 25424139 1.02
tpcds_q59/duckdb:parquet 36953392 36357518 1.02
tpcds_q60/duckdb:parquet 25365257 25034527 1.01
tpcds_q61/duckdb:parquet 33850360 34725486 0.97
tpcds_q62/duckdb:parquet 12635680 12531432 1.01
tpcds_q63/duckdb:parquet 18050672 17615808 1.02
tpcds_q64/duckdb:parquet 78788486 81635500 0.97
tpcds_q65/duckdb:parquet 22402086 23492330 0.95
tpcds_q66/duckdb:parquet 🚨 32477146 29240813 1.11
tpcds_q67/duckdb:parquet 139696058 135901438 1.03
tpcds_q68/duckdb:parquet 39076711 38686977 1.01
tpcds_q69/duckdb:parquet 40584312 38366013 1.06
tpcds_q70/duckdb:parquet 23732742 22043613 1.08
tpcds_q71/duckdb:parquet 24132519 22699652 1.06
tpcds_q72/duckdb:parquet 170088679 167921458 1.01
tpcds_q73/duckdb:parquet 20474786 20775048 0.99
tpcds_q74/duckdb:parquet 126661423 130194869 0.97
tpcds_q75/duckdb:parquet 58693151 59158446 0.99
tpcds_q76/duckdb:parquet 22851657 21689868 1.05
tpcds_q77/duckdb:parquet 25504157 25325527 1.01
tpcds_q78/duckdb:parquet 77483982 77846622 1.00
tpcds_q79/duckdb:parquet 29788975 30231130 0.99
tpcds_q80/duckdb:parquet 43644500 45296695 0.96
tpcds_q81/duckdb:parquet 35181842 35473382 0.99
tpcds_q82/duckdb:parquet 17364410 15955603 1.09
tpcds_q83/duckdb:parquet 18610401 18723001 0.99
tpcds_q84/duckdb:parquet 21585970 21683846 1.00
tpcds_q85/duckdb:parquet 41427110 42461836 0.98
tpcds_q86/duckdb:parquet 13764933 13660177 1.01
tpcds_q87/duckdb:parquet 39856188 39551758 1.01
tpcds_q88/duckdb:parquet 53719958 53591717 1.00
tpcds_q89/duckdb:parquet 20442067 21543333 0.95
tpcds_q90/duckdb:parquet 8389133 8476512 0.99
tpcds_q91/duckdb:parquet 26440071 25297564 1.05
tpcds_q92/duckdb:parquet 13356925 13052912 1.02
tpcds_q93/duckdb:parquet 32753158 31933018 1.03
tpcds_q94/duckdb:parquet 18013916 18095410 1.00
tpcds_q95/duckdb:parquet 🚀 124158734 148098726 0.84
tpcds_q96/duckdb:parquet 10729918 10694644 1.00
tpcds_q97/duckdb:parquet 39389964 37952828 1.04
tpcds_q98/duckdb:parquet 24035414 24859289 0.97
tpcds_q99/duckdb:parquet 20804972 20064201 1.04

File Size Changes (31 files changed, -43.5% overall, 2↑ 29↓)
File Scale Format Base HEAD Change %
item.vortex 1.0 vortex-file-compressed 1.37 MB 1.63 MB +270.08 KB +19.3%
catalog_page.vortex 1.0 vortex-file-compressed 565.62 KB 566.45 KB +848 B +0.1%
time_dim.vortex 1.0 vortex-file-compressed 379.34 KB 379.19 KB 160 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 827.92 KB 826.38 KB 1.55 KB -0.2%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.18 MB 91.93 KB -2.1%
date_dim.vortex 1.0 vortex-file-compressed 1.02 MB 953.91 KB 91.61 KB -8.8%
call_center.vortex 1.0 vortex-compact 49.33 KB 0 B 49.33 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.98 KB 0 B 362.98 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.01 MB 0 B 6.01 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 0 B 59.31 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 558.97 KB 0 B 558.97 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 649.07 KB 0 B 649.07 KB -100.0%
date_dim.vortex 1.0 vortex-compact 149.19 KB 0 B 149.19 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 0 B 10.29 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.56 KB 0 B 5.56 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 994.18 KB 0 B 994.18 KB -100.0%
promotion.vortex 1.0 vortex-compact 51.36 KB 0 B 51.36 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 11.09 KB 0 B 11.09 KB -100.0%
store.vortex 1.0 vortex-compact 44.86 KB 0 B 44.86 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.31 MB 0 B 9.31 MB -100.0%
store_sales.vortex 1.0 vortex-compact 77.87 MB 0 B 77.87 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.91 KB 0 B 96.91 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.33 KB 0 B 22.33 KB -100.0%
web_page.vortex 1.0 vortex-compact 26.44 KB 0 B 26.44 KB -100.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 0 B 2.99 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.35 MB 0 B 29.35 MB -100.0%
web_site.vortex 1.0 vortex-compact 44.69 KB 0 B 44.69 KB -100.0%

Totals:

  • vortex-compact: 207.47 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.73 MB → 269.82 MB (+0.0%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.012x ➖
Shifts: Parquet (control) +1.2% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 484984867 458361182 1.06
clickbench-sorted_q24/datafusion:vortex-file-compressed 22873962 22685071 1.01
clickbench-sorted_q26/datafusion:vortex-file-compressed 25610753 25772765 0.99
clickbench-sorted_q36/datafusion:vortex-file-compressed 65539967 64577977 1.01
clickbench-sorted_q37/datafusion:vortex-file-compressed 49216737 48222162 1.02
clickbench-sorted_q38/datafusion:vortex-file-compressed 55483634 56105826 0.99
clickbench-sorted_q39/datafusion:vortex-file-compressed 128394510 123958288 1.04
clickbench-sorted_q40/datafusion:vortex-file-compressed 22800482 22707956 1.00
clickbench-sorted_q41/datafusion:vortex-file-compressed 21686530 21124653 1.03
clickbench-sorted_q42/datafusion:vortex-file-compressed 17051938 16825151 1.01
datafusion / parquet (1.012x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4969299022 4936880066 1.01
clickbench-sorted_q24/datafusion:parquet 29111970 28361535 1.03
clickbench-sorted_q26/datafusion:parquet 29160166 28172046 1.04
clickbench-sorted_q36/datafusion:parquet 190271123 185359577 1.03
clickbench-sorted_q37/datafusion:parquet 114203964 117402934 0.97
clickbench-sorted_q38/datafusion:parquet 166523908 166954301 1.00
clickbench-sorted_q39/datafusion:parquet 309492101 294044959 1.05
clickbench-sorted_q40/datafusion:parquet 69324438 67974793 1.02
clickbench-sorted_q41/datafusion:parquet 61684643 64502679 0.96
clickbench-sorted_q42/datafusion:parquet 32510994 31557579 1.03
duckdb / vortex-file-compressed (0.997x ➖, 1↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚀 175626264 197286876 0.89
clickbench-sorted_q24/duckdb:vortex-file-compressed 28791903 28426172 1.01
clickbench-sorted_q26/duckdb:vortex-file-compressed 41812697 38774382 1.08
clickbench-sorted_q36/duckdb:vortex-file-compressed 63662145 68310038 0.93
clickbench-sorted_q37/duckdb:vortex-file-compressed 54599132 51567030 1.06
clickbench-sorted_q38/duckdb:vortex-file-compressed 58697528 58173829 1.01
clickbench-sorted_q39/duckdb:vortex-file-compressed 126318017 124698164 1.01
clickbench-sorted_q40/duckdb:vortex-file-compressed 31953714 30258624 1.06
clickbench-sorted_q41/duckdb:vortex-file-compressed 30832428 32349629 0.95
clickbench-sorted_q42/duckdb:vortex-file-compressed 25126944 25597370 0.98
duckdb / parquet (1.013x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 209238750 193337543 1.08
clickbench-sorted_q24/duckdb:parquet 28609510 29131357 0.98
clickbench-sorted_q26/duckdb:parquet 24258331 24089191 1.01
clickbench-sorted_q36/duckdb:parquet 110789025 106931143 1.04
clickbench-sorted_q37/duckdb:parquet 93039071 94355901 0.99
clickbench-sorted_q38/duckdb:parquet 98992766 95548983 1.04
clickbench-sorted_q39/duckdb:parquet 182584416 185621203 0.98
clickbench-sorted_q40/duckdb:parquet 40603010 41765734 0.97
clickbench-sorted_q41/duckdb:parquet 41770688 41000185 1.02
clickbench-sorted_q42/duckdb:parquet 28540136 27806701 1.03

File Size Changes (201 files changed, -42.6% overall, 45↑ 156↓)
File Scale Format Base HEAD Change %
hits_075.vortex 1.0 vortex-file-compressed 188.50 MB 190.63 MB +2.13 MB +1.1%
hits_079.vortex 1.0 vortex-file-compressed 180.23 MB 181.88 MB +1.65 MB +0.9%
hits_076.vortex 1.0 vortex-file-compressed 159.03 MB 160.19 MB +1.16 MB +0.7%
hits_036.vortex 1.0 vortex-file-compressed 170.66 MB 171.67 MB +1.02 MB +0.6%
hits_082.vortex 1.0 vortex-file-compressed 139.26 MB 139.98 MB +734.12 KB +0.5%
hits_013.vortex 1.0 vortex-file-compressed 160.55 MB 161.32 MB +781.82 KB +0.5%
hits_055.vortex 1.0 vortex-file-compressed 197.80 MB 198.70 MB +921.76 KB +0.5%
hits_066.vortex 1.0 vortex-file-compressed 162.67 MB 163.36 MB +699.64 KB +0.4%
hits_085.vortex 1.0 vortex-file-compressed 198.76 MB 199.49 MB +750.73 KB +0.4%
hits_003.vortex 1.0 vortex-file-compressed 135.99 MB 136.49 MB +505.67 KB +0.4%
hits_058.vortex 1.0 vortex-file-compressed 154.06 MB 154.58 MB +529.77 KB +0.3%
hits_077.vortex 1.0 vortex-file-compressed 171.48 MB 172.03 MB +566.62 KB +0.3%
hits_062.vortex 1.0 vortex-file-compressed 170.12 MB 170.65 MB +544.30 KB +0.3%
hits_029.vortex 1.0 vortex-file-compressed 198.97 MB 199.55 MB +586.17 KB +0.3%
hits_074.vortex 1.0 vortex-file-compressed 198.32 MB 198.84 MB +536.88 KB +0.3%
hits_046.vortex 1.0 vortex-file-compressed 100.86 MB 101.10 MB +248.69 KB +0.2%
hits_043.vortex 1.0 vortex-file-compressed 125.88 MB 126.16 MB +296.54 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.21 MB 179.59 MB +392.28 KB +0.2%
hits_018.vortex 1.0 vortex-file-compressed 198.35 MB 198.76 MB +410.73 KB +0.2%
hits_028.vortex 1.0 vortex-file-compressed 151.06 MB 151.27 MB +213.23 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.01 MB 131.19 MB +177.88 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 160.20 MB 160.38 MB +182.99 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 160.45 MB 160.63 MB +180.91 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 198.27 MB 198.49 MB +217.70 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 171.39 MB 171.56 MB +179.06 KB +0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.28 MB 159.44 MB +162.41 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.84 MB 192.03 MB +194.02 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.28 MB 156.43 MB +147.62 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.13 MB 199.30 MB +171.20 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.18 MB 168.32 MB +141.14 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 146.32 MB 146.44 MB +116.60 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 171.71 MB 171.84 MB +133.57 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 170.58 MB 170.71 MB +130.89 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.67 MB 130.76 MB +93.55 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.01 MB 102.07 MB +65.00 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 141.64 MB 141.73 MB +88.74 KB +0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.77 MB 153.86 MB +94.48 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 190.26 MB 190.34 MB +76.62 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.06 MB 135.10 MB +43.05 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 154.02 MB 154.07 MB +42.36 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 146.18 MB 146.20 MB +27.10 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.81 MB 153.82 MB +12.01 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.29 MB 194.30 MB +8.24 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.18 MB 131.19 MB +4.89 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 188.89 MB 188.90 MB +3.77 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 171.22 MB 171.22 MB 312 B -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.96 MB 130.96 MB 904 B -0.0%
hits_073.vortex 1.0 vortex-file-compressed 171.93 MB 171.92 MB 2.83 KB -0.0%
hits_059.vortex 1.0 vortex-file-compressed 198.33 MB 198.33 MB 4.65 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 159.81 MB 159.81 MB 3.77 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 140.35 MB 140.34 MB 3.65 KB -0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.11 MB 190.10 MB 12.98 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 131.11 MB 131.10 MB 12.91 KB -0.0%
hits_007.vortex 1.0 vortex-file-compressed 199.14 MB 199.11 MB 27.57 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 160.21 MB 160.19 MB 27.94 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 158.80 MB 158.78 MB 29.04 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.79 MB 125.77 MB 26.57 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.84 MB 153.81 MB 37.16 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.62 MB 130.59 MB 35.41 KB -0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.00 MB 188.93 MB 77.35 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.58 MB 130.52 MB 63.55 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 198.25 MB 198.15 MB 102.26 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 181.13 MB 181.02 MB 116.01 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.98 MB 100.92 MB 64.80 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 198.56 MB 198.43 MB 131.93 KB -0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.24 MB 199.10 MB 138.67 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 166.73 MB 166.62 MB 120.16 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.34 MB 131.24 MB 105.14 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 176.58 MB 176.44 MB 143.26 KB -0.1%
hits_091.vortex 1.0 vortex-file-compressed 146.46 MB 146.34 MB 123.39 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 171.36 MB 171.21 MB 152.11 KB -0.1%
hits_012.vortex 1.0 vortex-file-compressed 189.95 MB 189.75 MB 197.83 KB -0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.40 MB 126.26 MB 139.27 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 157.86 MB 157.69 MB 176.52 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.15 MB 142.99 MB 164.45 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 160.60 MB 160.37 MB 243.74 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.04 MB 159.79 MB 260.84 KB -0.2%
hits_032.vortex 1.0 vortex-file-compressed 154.33 MB 154.07 MB 267.77 KB -0.2%
hits_081.vortex 1.0 vortex-file-compressed 199.37 MB 199.01 MB 359.74 KB -0.2%
hits_048.vortex 1.0 vortex-file-compressed 199.00 MB 198.61 MB 394.63 KB -0.2%
hits_015.vortex 1.0 vortex-file-compressed 131.02 MB 130.75 MB 282.27 KB -0.2%
hits_020.vortex 1.0 vortex-file-compressed 160.00 MB 159.66 MB 349.59 KB -0.2%
hits_001.vortex 1.0 vortex-file-compressed 192.81 MB 192.40 MB 421.61 KB -0.2%
hits_070.vortex 1.0 vortex-file-compressed 199.60 MB 199.12 MB 486.03 KB -0.2%
hits_067.vortex 1.0 vortex-file-compressed 131.61 MB 131.25 MB 372.47 KB -0.3%
hits_042.vortex 1.0 vortex-file-compressed 200.44 MB 199.86 MB 591.57 KB -0.3%
hits_038.vortex 1.0 vortex-file-compressed 189.47 MB 188.92 MB 561.18 KB -0.3%
hits_050.vortex 1.0 vortex-file-compressed 160.59 MB 160.11 MB 495.19 KB -0.3%
hits_035.vortex 1.0 vortex-file-compressed 102.68 MB 102.24 MB 456.62 KB -0.4%
hits_030.vortex 1.0 vortex-file-compressed 131.99 MB 131.35 MB 655.77 KB -0.5%
hits_089.vortex 1.0 vortex-file-compressed 131.61 MB 130.96 MB 662.95 KB -0.5%
hits_008.vortex 1.0 vortex-file-compressed 140.39 MB 139.69 MB 716.41 KB -0.5%
hits_019.vortex 1.0 vortex-file-compressed 141.05 MB 140.29 MB 784.41 KB -0.5%
hits_060.vortex 1.0 vortex-file-compressed 193.10 MB 191.98 MB 1.12 MB -0.6%
hits_096.vortex 1.0 vortex-file-compressed 198.56 MB 197.24 MB 1.32 MB -0.7%
hits_071.vortex 1.0 vortex-file-compressed 140.27 MB 139.28 MB 1006.20 KB -0.7%
hits_098.vortex 1.0 vortex-file-compressed 138.03 MB 136.91 MB 1.11 MB -0.8%
hits_061.vortex 1.0 vortex-file-compressed 160.07 MB 158.78 MB 1.29 MB -0.8%
hits_086.vortex 1.0 vortex-file-compressed 193.22 MB 191.32 MB 1.90 MB -1.0%
hits_090.vortex 1.0 vortex-file-compressed 194.41 MB 191.63 MB 2.78 MB -1.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 98.18 MB 0 B 98.18 MB -100.0%
hits_001.vortex 1.0 vortex-compact 139.82 MB 0 B 139.82 MB -100.0%
hits_002.vortex 1.0 vortex-compact 122.37 MB 0 B 122.37 MB -100.0%
hits_003.vortex 1.0 vortex-compact 103.25 MB 0 B 103.25 MB -100.0%
hits_004.vortex 1.0 vortex-compact 97.69 MB 0 B 97.69 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.08 MB 0 B 115.08 MB -100.0%
hits_006.vortex 1.0 vortex-compact 93.70 MB 0 B 93.70 MB -100.0%
hits_007.vortex 1.0 vortex-compact 152.20 MB 0 B 152.20 MB -100.0%
hits_008.vortex 1.0 vortex-compact 105.12 MB 0 B 105.12 MB -100.0%
hits_009.vortex 1.0 vortex-compact 74.62 MB 0 B 74.62 MB -100.0%
hits_010.vortex 1.0 vortex-compact 121.47 MB 0 B 121.47 MB -100.0%
hits_011.vortex 1.0 vortex-compact 150.87 MB 0 B 150.87 MB -100.0%
hits_012.vortex 1.0 vortex-compact 138.26 MB 0 B 138.26 MB -100.0%
hits_013.vortex 1.0 vortex-compact 122.55 MB 0 B 122.55 MB -100.0%
hits_014.vortex 1.0 vortex-compact 131.27 MB 0 B 131.27 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.25 MB 0 B 97.25 MB -100.0%
hits_016.vortex 1.0 vortex-compact 125.98 MB 0 B 125.98 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.07 MB 0 B 111.07 MB -100.0%
hits_018.vortex 1.0 vortex-compact 152.59 MB 0 B 152.59 MB -100.0%
hits_019.vortex 1.0 vortex-compact 105.63 MB 0 B 105.63 MB -100.0%
hits_020.vortex 1.0 vortex-compact 110.91 MB 0 B 110.91 MB -100.0%
hits_021.vortex 1.0 vortex-compact 109.82 MB 0 B 109.82 MB -100.0%
hits_022.vortex 1.0 vortex-compact 151.57 MB 0 B 151.57 MB -100.0%
hits_023.vortex 1.0 vortex-compact 141.07 MB 0 B 141.07 MB -100.0%
hits_024.vortex 1.0 vortex-compact 122.76 MB 0 B 122.76 MB -100.0%
hits_025.vortex 1.0 vortex-compact 131.04 MB 0 B 131.04 MB -100.0%
hits_026.vortex 1.0 vortex-compact 97.74 MB 0 B 97.74 MB -100.0%
hits_027.vortex 1.0 vortex-compact 137.29 MB 0 B 137.29 MB -100.0%
hits_028.vortex 1.0 vortex-compact 113.96 MB 0 B 113.96 MB -100.0%
hits_029.vortex 1.0 vortex-compact 151.93 MB 0 B 151.93 MB -100.0%
hits_030.vortex 1.0 vortex-compact 97.65 MB 0 B 97.65 MB -100.0%
hits_031.vortex 1.0 vortex-compact 110.45 MB 0 B 110.45 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.26 MB 0 B 110.26 MB -100.0%
hits_033.vortex 1.0 vortex-compact 151.66 MB 0 B 151.66 MB -100.0%
hits_034.vortex 1.0 vortex-compact 132.11 MB 0 B 132.11 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.29 MB 0 B 75.29 MB -100.0%
hits_036.vortex 1.0 vortex-compact 131.78 MB 0 B 131.78 MB -100.0%
hits_037.vortex 1.0 vortex-compact 131.54 MB 0 B 131.54 MB -100.0%
hits_038.vortex 1.0 vortex-compact 137.59 MB 0 B 137.59 MB -100.0%
hits_039.vortex 1.0 vortex-compact 122.48 MB 0 B 122.48 MB -100.0%
hits_040.vortex 1.0 vortex-compact 109.18 MB 0 B 109.18 MB -100.0%
hits_041.vortex 1.0 vortex-compact 97.18 MB 0 B 97.18 MB -100.0%
hits_042.vortex 1.0 vortex-compact 135.91 MB 0 B 135.91 MB -100.0%
hits_043.vortex 1.0 vortex-compact 93.95 MB 0 B 93.95 MB -100.0%
hits_044.vortex 1.0 vortex-compact 152.85 MB 0 B 152.85 MB -100.0%
hits_045.vortex 1.0 vortex-compact 105.18 MB 0 B 105.18 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.31 MB 0 B 74.31 MB -100.0%
hits_047.vortex 1.0 vortex-compact 109.70 MB 0 B 109.70 MB -100.0%
hits_048.vortex 1.0 vortex-compact 151.94 MB 0 B 151.94 MB -100.0%
hits_049.vortex 1.0 vortex-compact 138.64 MB 0 B 138.64 MB -100.0%
hits_050.vortex 1.0 vortex-compact 122.93 MB 0 B 122.93 MB -100.0%
hits_051.vortex 1.0 vortex-compact 131.29 MB 0 B 131.29 MB -100.0%
hits_052.vortex 1.0 vortex-compact 97.26 MB 0 B 97.26 MB -100.0%
hits_053.vortex 1.0 vortex-compact 137.03 MB 0 B 137.03 MB -100.0%
hits_054.vortex 1.0 vortex-compact 110.43 MB 0 B 110.43 MB -100.0%
hits_055.vortex 1.0 vortex-compact 151.81 MB 0 B 151.81 MB -100.0%
hits_056.vortex 1.0 vortex-compact 100.23 MB 0 B 100.23 MB -100.0%
hits_057.vortex 1.0 vortex-compact 110.72 MB 0 B 110.72 MB -100.0%
hits_058.vortex 1.0 vortex-compact 110.51 MB 0 B 110.51 MB -100.0%
hits_059.vortex 1.0 vortex-compact 151.49 MB 0 B 151.49 MB -100.0%
hits_060.vortex 1.0 vortex-compact 140.80 MB 0 B 140.80 MB -100.0%
hits_061.vortex 1.0 vortex-compact 122.84 MB 0 B 122.84 MB -100.0%
hits_062.vortex 1.0 vortex-compact 129.82 MB 0 B 129.82 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.30 MB 0 B 98.30 MB -100.0%
hits_064.vortex 1.0 vortex-compact 138.24 MB 0 B 138.24 MB -100.0%
hits_065.vortex 1.0 vortex-compact 122.75 MB 0 B 122.75 MB -100.0%
hits_066.vortex 1.0 vortex-compact 116.38 MB 0 B 116.38 MB -100.0%
hits_067.vortex 1.0 vortex-compact 98.20 MB 0 B 98.20 MB -100.0%
hits_068.vortex 1.0 vortex-compact 111.17 MB 0 B 111.17 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.50 MB 0 B 99.50 MB -100.0%
hits_070.vortex 1.0 vortex-compact 152.19 MB 0 B 152.19 MB -100.0%
hits_071.vortex 1.0 vortex-compact 104.99 MB 0 B 104.99 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.03 MB 0 B 75.03 MB -100.0%
hits_073.vortex 1.0 vortex-compact 131.56 MB 0 B 131.56 MB -100.0%
hits_074.vortex 1.0 vortex-compact 151.29 MB 0 B 151.29 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.06 MB 0 B 137.06 MB -100.0%
hits_076.vortex 1.0 vortex-compact 122.36 MB 0 B 122.36 MB -100.0%
hits_077.vortex 1.0 vortex-compact 132.28 MB 0 B 132.28 MB -100.0%
hits_078.vortex 1.0 vortex-compact 96.70 MB 0 B 96.70 MB -100.0%
hits_079.vortex 1.0 vortex-compact 126.62 MB 0 B 126.62 MB -100.0%
hits_080.vortex 1.0 vortex-compact 94.15 MB 0 B 94.15 MB -100.0%
hits_081.vortex 1.0 vortex-compact 152.36 MB 0 B 152.36 MB -100.0%
hits_082.vortex 1.0 vortex-compact 105.04 MB 0 B 105.04 MB -100.0%
hits_083.vortex 1.0 vortex-compact 109.25 MB 0 B 109.25 MB -100.0%
hits_084.vortex 1.0 vortex-compact 109.89 MB 0 B 109.89 MB -100.0%
hits_085.vortex 1.0 vortex-compact 151.92 MB 0 B 151.92 MB -100.0%
hits_086.vortex 1.0 vortex-compact 138.87 MB 0 B 138.87 MB -100.0%
hits_087.vortex 1.0 vortex-compact 122.56 MB 0 B 122.56 MB -100.0%
hits_088.vortex 1.0 vortex-compact 131.74 MB 0 B 131.74 MB -100.0%
hits_089.vortex 1.0 vortex-compact 97.23 MB 0 B 97.23 MB -100.0%
hits_090.vortex 1.0 vortex-compact 139.42 MB 0 B 139.42 MB -100.0%
hits_091.vortex 1.0 vortex-compact 110.62 MB 0 B 110.62 MB -100.0%
hits_092.vortex 1.0 vortex-compact 151.79 MB 0 B 151.79 MB -100.0%
hits_093.vortex 1.0 vortex-compact 97.67 MB 0 B 97.67 MB -100.0%
hits_094.vortex 1.0 vortex-compact 109.94 MB 0 B 109.94 MB -100.0%
hits_095.vortex 1.0 vortex-compact 109.89 MB 0 B 109.89 MB -100.0%
hits_096.vortex 1.0 vortex-compact 151.63 MB 0 B 151.63 MB -100.0%
hits_097.vortex 1.0 vortex-compact 139.50 MB 0 B 139.50 MB -100.0%
hits_098.vortex 1.0 vortex-compact 101.40 MB 0 B 101.40 MB -100.0%
hits_099.vortex 1.0 vortex-compact 130.52 MB 0 B 130.52 MB -100.0%

Totals:

  • vortex-compact: 11.80 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.90 GB → 15.90 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.5%
Engines: DuckDB No clear signal (-5.5%, low confidence)
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (0.936x ➖, 2↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11502222 12246333 0.94
statpopgen_q01/duckdb:vortex-file-compressed 26714052 27424169 0.97
statpopgen_q02/duckdb:vortex-file-compressed 521071756 544408922 0.96
statpopgen_q03/duckdb:vortex-file-compressed 1035688095 1081992922 0.96
statpopgen_q04/duckdb:vortex-file-compressed 1039529172 1117584392 0.93
statpopgen_q05/duckdb:vortex-file-compressed 469115786 502989945 0.93
statpopgen_q06/duckdb:vortex-file-compressed 1514562315 1545281911 0.98
statpopgen_q07/duckdb:vortex-file-compressed 🚀 173023207 206009444 0.84
statpopgen_q08/duckdb:vortex-file-compressed 🚀 198006737 238266898 0.83
statpopgen_q09/duckdb:vortex-file-compressed 847565353 854080621 0.99
statpopgen_q10/duckdb:vortex-file-compressed 2530004913 2594015004 0.98
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 296714004 300956064 0.99
statpopgen_q01/duckdb:parquet 383080440 376913941 1.02
statpopgen_q02/duckdb:parquet 759878710 757721965 1.00
statpopgen_q03/duckdb:parquet 1177536960 1206357093 0.98
statpopgen_q04/duckdb:parquet 1198330146 1194370549 1.00
statpopgen_q05/duckdb:parquet 808510743 804366378 1.01
statpopgen_q06/duckdb:parquet 1419378903 1417747173 1.00
statpopgen_q07/duckdb:parquet 845245117 866741129 0.98
statpopgen_q08/duckdb:parquet 849395163 883711691 0.96
statpopgen_q09/duckdb:parquet 1022642943 1036492853 0.99
statpopgen_q10/duckdb:parquet 2204751258 2263340542 0.97

File Size Changes (3 files changed, -32.3% overall, 1↑ 2↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +302.08 KB +0.0%
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.32 MB 0 B 959.32 MB -100.0%

Totals:

  • vortex-compact: 959.59 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.2%
Engines: DataFusion No clear signal (-8.4%, environment too noisy confidence) · DuckDB No clear signal (-5.9%, environment too noisy confidence)
Vortex (geomean): 0.966x ➖
Parquet (geomean): 1.041x ➖
Shifts: Parquet (control) +4.1% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.969x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36402024 36459928 1.00
fineweb_q01/datafusion:vortex-file-compressed 811305567 1023402620 0.79
fineweb_q02/datafusion:vortex-file-compressed 1232762084 1318748258 0.93
fineweb_q03/datafusion:vortex-file-compressed 1166426840 1291998050 0.90
fineweb_q04/datafusion:vortex-file-compressed 1161596982 1191418992 0.97
fineweb_q05/datafusion:vortex-file-compressed 1143015473 1129557101 1.01
fineweb_q06/datafusion:vortex-file-compressed 1448835227 1559534932 0.93
fineweb_q07/datafusion:vortex-file-compressed 1389036591 1198686399 1.16
fineweb_q08/datafusion:vortex-file-compressed 611853696 576790706 1.06
datafusion / parquet (1.058x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1342828880 1343832939 1.00
fineweb_q01/datafusion:parquet 2624559066 2184143182 1.20
fineweb_q02/datafusion:parquet 2220007376 2244496322 0.99
fineweb_q03/datafusion:parquet 2263620925 2292404593 0.99
fineweb_q04/datafusion:parquet 2096941438 2143675892 0.98
fineweb_q05/datafusion:parquet 2089462194 2071916394 1.01
fineweb_q06/datafusion:parquet 2244630081 2122186595 1.06
fineweb_q07/datafusion:parquet 2648248503 2219256057 1.19
fineweb_q08/datafusion:parquet 2895797495 2538875422 1.14
duckdb / vortex-file-compressed (0.963x ➖, 1↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 97715787 150550998 0.65
fineweb_q01/duckdb:vortex-file-compressed 725090407 727451918 1.00
fineweb_q02/duckdb:vortex-file-compressed 1054807679 918679836 1.15
fineweb_q03/duckdb:vortex-file-compressed 1405844104 1411607184 1.00
fineweb_q04/duckdb:vortex-file-compressed 1562841381 1500553380 1.04
fineweb_q05/duckdb:vortex-file-compressed 1310651724 1378639099 0.95
fineweb_q06/duckdb:vortex-file-compressed 1620886652 1560963396 1.04
fineweb_q07/duckdb:vortex-file-compressed 1438002014 1359920413 1.06
fineweb_q08/duckdb:vortex-file-compressed 521584090 586290445 0.89
duckdb / parquet (1.024x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1398486025 1274473547 1.10
fineweb_q01/duckdb:parquet 1514683505 1691064608 0.90
fineweb_q02/duckdb:parquet 1579414743 1483862649 1.06
fineweb_q03/duckdb:parquet 4416547157 4364238933 1.01
fineweb_q04/duckdb:parquet 2070610138 2069766297 1.00
fineweb_q05/duckdb:parquet 2510101973 2460589093 1.02
fineweb_q06/duckdb:parquet 5027724660 5012301291 1.00
fineweb_q07/duckdb:parquet 3451914018 2958272468 1.17
fineweb_q08/duckdb:parquet 1209884258 1236870721 0.98

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (-4.0%, low confidence)
Vortex (geomean): 0.927x ➖
Parquet (geomean): 0.951x ➖
Shifts: Parquet (control) -4.9% · Median polish -6.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.931x ➖, 6↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1617669 1599226 1.01
clickbench_q01/datafusion:vortex-file-compressed 19554721 20993194 0.93
clickbench_q02/datafusion:vortex-file-compressed 35995794 37312077 0.96
clickbench_q03/datafusion:vortex-file-compressed 🚀 36363875 40817200 0.89
clickbench_q04/datafusion:vortex-file-compressed 233763667 251911620 0.93
clickbench_q05/datafusion:vortex-file-compressed 304401333 330336213 0.92
clickbench_q06/datafusion:vortex-file-compressed 1582906 1592482 0.99
clickbench_q07/datafusion:vortex-file-compressed 31748099 33414989 0.95
clickbench_q08/datafusion:vortex-file-compressed 324483239 357442143 0.91
clickbench_q09/datafusion:vortex-file-compressed 450033231 484427148 0.93
clickbench_q10/datafusion:vortex-file-compressed 79216907 84734289 0.93
clickbench_q11/datafusion:vortex-file-compressed 97427419 103649463 0.94
clickbench_q12/datafusion:vortex-file-compressed 257493594 278155906 0.93
clickbench_q13/datafusion:vortex-file-compressed 415640453 453304308 0.92
clickbench_q14/datafusion:vortex-file-compressed 🚀 252810566 281705635 0.90
clickbench_q15/datafusion:vortex-file-compressed 281204714 299513871 0.94
clickbench_q16/datafusion:vortex-file-compressed 645830863 703288057 0.92
clickbench_q17/datafusion:vortex-file-compressed 646773826 693282166 0.93
clickbench_q18/datafusion:vortex-file-compressed 1346290076 1436955441 0.94
clickbench_q19/datafusion:vortex-file-compressed 26526074 27738010 0.96
clickbench_q20/datafusion:vortex-file-compressed 301325710 328480510 0.92
clickbench_q21/datafusion:vortex-file-compressed 390257350 420737982 0.93
clickbench_q22/datafusion:vortex-file-compressed 498771315 539202489 0.93
clickbench_q23/datafusion:vortex-file-compressed 716273982 768494058 0.93
clickbench_q24/datafusion:vortex-file-compressed 46494775 48892136 0.95
clickbench_q25/datafusion:vortex-file-compressed 77535971 80599832 0.96
clickbench_q26/datafusion:vortex-file-compressed 44017007 48801179 0.90
clickbench_q27/datafusion:vortex-file-compressed 419580554 440968640 0.95
clickbench_q28/datafusion:vortex-file-compressed 2367315336 2482292907 0.95
clickbench_q29/datafusion:vortex-file-compressed 🚀 44622443 56237330 0.79
clickbench_q30/datafusion:vortex-file-compressed 224176296 239997071 0.93
clickbench_q31/datafusion:vortex-file-compressed 246696377 272029832 0.91
clickbench_q32/datafusion:vortex-file-compressed 1038475784 1102475727 0.94
clickbench_q33/datafusion:vortex-file-compressed 1434569269 1492833099 0.96
clickbench_q34/datafusion:vortex-file-compressed 1430174557 1468977661 0.97
clickbench_q35/datafusion:vortex-file-compressed 231930302 254189904 0.91
clickbench_q36/datafusion:vortex-file-compressed 61280639 58645033 1.04
clickbench_q37/datafusion:vortex-file-compressed 25650292 25471350 1.01
clickbench_q38/datafusion:vortex-file-compressed 16341903 17458188 0.94
clickbench_q39/datafusion:vortex-file-compressed 118242991 128568638 0.92
clickbench_q40/datafusion:vortex-file-compressed 🚀 11582685 13240947 0.87
clickbench_q41/datafusion:vortex-file-compressed 🚀 11355480 13265813 0.86
clickbench_q42/datafusion:vortex-file-compressed 🚀 10906149 12371867 0.88
datafusion / parquet (0.941x ➖, 1↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1516203 1646604 0.92
clickbench_q01/datafusion:parquet 19564837 20006206 0.98
clickbench_q02/datafusion:parquet 41818634 45508366 0.92
clickbench_q03/datafusion:parquet 35518583 36022066 0.99
clickbench_q04/datafusion:parquet 257580374 280447564 0.92
clickbench_q05/datafusion:parquet 311315164 332942187 0.94
clickbench_q06/datafusion:parquet 1666008 1545683 1.08
clickbench_q07/datafusion:parquet 21173540 21386998 0.99
clickbench_q08/datafusion:parquet 331500030 350623857 0.95
clickbench_q09/datafusion:parquet 467010213 508591195 0.92
clickbench_q10/datafusion:parquet 88849088 94618336 0.94
clickbench_q11/datafusion:parquet 114701579 122743799 0.93
clickbench_q12/datafusion:parquet 301731925 324770287 0.93
clickbench_q13/datafusion:parquet 461049957 479600897 0.96
clickbench_q14/datafusion:parquet 310941982 330888902 0.94
clickbench_q15/datafusion:parquet 273051546 297730796 0.92
clickbench_q16/datafusion:parquet 648340689 717358610 0.90
clickbench_q17/datafusion:parquet 645858227 689682816 0.94
clickbench_q18/datafusion:parquet 1348189616 1466885996 0.92
clickbench_q19/datafusion:parquet 26882751 27488745 0.98
clickbench_q20/datafusion:parquet 555679382 592423427 0.94
clickbench_q21/datafusion:parquet 615284777 650499929 0.95
clickbench_q22/datafusion:parquet 892898227 955438703 0.93
clickbench_q23/datafusion:parquet 3996745921 4330975028 0.92
clickbench_q24/datafusion:parquet 55824456 57701647 0.97
clickbench_q25/datafusion:parquet 128509946 133597636 0.96
clickbench_q26/datafusion:parquet 50828643 55217614 0.92
clickbench_q27/datafusion:parquet 648423212 686098529 0.95
clickbench_q28/datafusion:parquet 2428575344 2565731401 0.95
clickbench_q29/datafusion:parquet 🚀 44331773 51634144 0.86
clickbench_q30/datafusion:parquet 313573263 329868011 0.95
clickbench_q31/datafusion:parquet 336378920 357750310 0.94
clickbench_q32/datafusion:parquet 1069251628 1158311583 0.92
clickbench_q33/datafusion:parquet 1474640657 1560579927 0.94
clickbench_q34/datafusion:parquet 1477400354 1573083253 0.94
clickbench_q35/datafusion:parquet 241150296 254275366 0.95
clickbench_q36/datafusion:parquet 107699311 115807736 0.93
clickbench_q37/datafusion:parquet 41868226 45717477 0.92
clickbench_q38/datafusion:parquet 60579584 60571064 1.00
clickbench_q39/datafusion:parquet 212581392 219433444 0.97
clickbench_q40/datafusion:parquet 22351549 24513137 0.91
clickbench_q41/datafusion:parquet 20439110 22353846 0.91
clickbench_q42/datafusion:parquet 20779667 22730236 0.91
duckdb / vortex-file-compressed (0.923x ➖, 14↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 9624985 10912504 0.88
clickbench_q01/duckdb:vortex-file-compressed 🚀 15034223 17433824 0.86
clickbench_q02/duckdb:vortex-file-compressed 27750629 30200748 0.92
clickbench_q03/duckdb:vortex-file-compressed 34188581 36357098 0.94
clickbench_q04/duckdb:vortex-file-compressed 196686664 215071418 0.91
clickbench_q05/duckdb:vortex-file-compressed 🚀 183953673 208444701 0.88
clickbench_q06/duckdb:vortex-file-compressed 20145074 20981944 0.96
clickbench_q07/duckdb:vortex-file-compressed 26811542 27868328 0.96
clickbench_q08/duckdb:vortex-file-compressed 269226123 288510458 0.93
clickbench_q09/duckdb:vortex-file-compressed 351079687 370852235 0.95
clickbench_q10/duckdb:vortex-file-compressed 80350870 85948834 0.93
clickbench_q11/duckdb:vortex-file-compressed 97274509 107592945 0.90
clickbench_q12/duckdb:vortex-file-compressed 🚀 210573301 234218058 0.90
clickbench_q13/duckdb:vortex-file-compressed 414233386 454813576 0.91
clickbench_q14/duckdb:vortex-file-compressed 250156668 269510154 0.93
clickbench_q15/duckdb:vortex-file-compressed 257199898 259051003 0.99
clickbench_q16/duckdb:vortex-file-compressed 539310043 584583220 0.92
clickbench_q17/duckdb:vortex-file-compressed 430148839 474072325 0.91
clickbench_q18/duckdb:vortex-file-compressed 949663501 1033074104 0.92
clickbench_q19/duckdb:vortex-file-compressed 🚀 20209021 23060996 0.88
clickbench_q20/duckdb:vortex-file-compressed 🚀 285314172 325608212 0.88
clickbench_q21/duckdb:vortex-file-compressed 🚀 379858323 432506064 0.88
clickbench_q22/duckdb:vortex-file-compressed 🚀 543630483 613640020 0.89
clickbench_q23/duckdb:vortex-file-compressed 🚀 170669213 215739530 0.79
clickbench_q24/duckdb:vortex-file-compressed 33173291 35726704 0.93
clickbench_q25/duckdb:vortex-file-compressed 🚀 89864093 100683030 0.89
clickbench_q26/duckdb:vortex-file-compressed 48669836 46719837 1.04
clickbench_q27/duckdb:vortex-file-compressed 🚀 211356380 240109541 0.88
clickbench_q28/duckdb:vortex-file-compressed 3082119734 3225548663 0.96
clickbench_q29/duckdb:vortex-file-compressed 28742888 30652952 0.94
clickbench_q30/duckdb:vortex-file-compressed 206926300 220006847 0.94
clickbench_q31/duckdb:vortex-file-compressed 297531232 318182822 0.94
clickbench_q32/duckdb:vortex-file-compressed 1117090475 1196828528 0.93
clickbench_q33/duckdb:vortex-file-compressed 1119634956 1212783276 0.92
clickbench_q34/duckdb:vortex-file-compressed 🚀 1208988181 1351125702 0.89
clickbench_q35/duckdb:vortex-file-compressed 369634479 389100042 0.95
clickbench_q36/duckdb:vortex-file-compressed 29596886 29371668 1.01
clickbench_q37/duckdb:vortex-file-compressed 🚀 18901914 22146140 0.85
clickbench_q38/duckdb:vortex-file-compressed 23112811 23677796 0.98
clickbench_q39/duckdb:vortex-file-compressed 45899543 46411972 0.99
clickbench_q40/duckdb:vortex-file-compressed 20692385 21507704 0.96
clickbench_q41/duckdb:vortex-file-compressed 20005925 20052331 1.00
clickbench_q42/duckdb:vortex-file-compressed 🚀 18668664 20856000 0.90
duckdb / parquet (0.961x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23388844 22694936 1.03
clickbench_q01/duckdb:parquet 29603450 30401141 0.97
clickbench_q02/duckdb:parquet 50581140 51471996 0.98
clickbench_q03/duckdb:parquet 39185022 41537467 0.94
clickbench_q04/duckdb:parquet 203434541 213201812 0.95
clickbench_q05/duckdb:parquet 259387452 267951521 0.97
clickbench_q06/duckdb:parquet 47458855 48352731 0.98
clickbench_q07/duckdb:parquet 31800190 31552849 1.01
clickbench_q08/duckdb:parquet 272142089 285547006 0.95
clickbench_q09/duckdb:parquet 396367552 422982369 0.94
clickbench_q10/duckdb:parquet 82271115 85535348 0.96
clickbench_q11/duckdb:parquet 99842377 104594949 0.95
clickbench_q12/duckdb:parquet 281711538 297703738 0.95
clickbench_q13/duckdb:parquet 467412098 503821763 0.93
clickbench_q14/duckdb:parquet 318099375 330662664 0.96
clickbench_q15/duckdb:parquet 254480271 275892907 0.92
clickbench_q16/duckdb:parquet 595632633 634083708 0.94
clickbench_q17/duckdb:parquet 499757591 528291388 0.95
clickbench_q18/duckdb:parquet 1035761912 1115100241 0.93
clickbench_q19/duckdb:parquet 28071965 28669010 0.98
clickbench_q20/duckdb:parquet 410571224 440024397 0.93
clickbench_q21/duckdb:parquet 531230053 555788571 0.96
clickbench_q22/duckdb:parquet 919586539 954318987 0.96
clickbench_q23/duckdb:parquet 259426748 276448881 0.94
clickbench_q24/duckdb:parquet 71568181 72120883 0.99
clickbench_q25/duckdb:parquet 163782562 163803017 1.00
clickbench_q26/duckdb:parquet 54083936 54638670 0.99
clickbench_q27/duckdb:parquet 468910551 491707000 0.95
clickbench_q28/duckdb:parquet 4768240340 4926313381 0.97
clickbench_q29/duckdb:parquet 42119870 42727380 0.99
clickbench_q30/duckdb:parquet 308542771 321502167 0.96
clickbench_q31/duckdb:parquet 372209366 401620169 0.93
clickbench_q32/duckdb:parquet 1097903307 1192537415 0.92
clickbench_q33/duckdb:parquet 1098676043 1208268215 0.91
clickbench_q34/duckdb:parquet 1144893714 1252681969 0.91
clickbench_q35/duckdb:parquet 368945782 386867435 0.95
clickbench_q36/duckdb:parquet 44720331 45442374 0.98
clickbench_q37/duckdb:parquet 33619856 34338932 0.98
clickbench_q38/duckdb:parquet 35448707 35638550 0.99
clickbench_q39/duckdb:parquet 81089706 78279834 1.04
clickbench_q40/duckdb:parquet 20424099 20961294 0.97
clickbench_q41/duckdb:parquet 19683031 21132526 0.93
clickbench_q42/duckdb:parquet 22927587 23008166 1.00

File Size Changes (201 files changed, -39.1% overall, 42↑ 159↓)
File Scale Format Base HEAD Change %
hits_65.vortex 1.0 vortex-file-compressed 182.03 MB 183.46 MB +1.43 MB +0.8%
hits_84.vortex 1.0 vortex-file-compressed 116.76 MB 117.08 MB +332.07 KB +0.3%
hits_57.vortex 1.0 vortex-file-compressed 127.93 MB 128.18 MB +258.55 KB +0.2%
hits_37.vortex 1.0 vortex-file-compressed 85.36 MB 85.53 MB +165.88 KB +0.2%
hits_13.vortex 1.0 vortex-file-compressed 99.12 MB 99.31 MB +188.41 KB +0.2%
hits_80.vortex 1.0 vortex-file-compressed 104.95 MB 105.11 MB +166.14 KB +0.2%
hits_93.vortex 1.0 vortex-file-compressed 90.16 MB 90.28 MB +120.59 KB +0.1%
hits_41.vortex 1.0 vortex-file-compressed 222.81 MB 223.08 MB +283.98 KB +0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.02 MB 57.09 MB +66.82 KB +0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.08 MB 103.18 MB +109.41 KB +0.1%
hits_45.vortex 1.0 vortex-file-compressed 121.81 MB 121.94 MB +125.91 KB +0.1%
hits_83.vortex 1.0 vortex-file-compressed 89.14 MB 89.23 MB +90.95 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.35 MB 75.43 MB +76.16 KB +0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.50 MB 117.61 MB +113.50 KB +0.1%
hits_71.vortex 1.0 vortex-file-compressed 101.65 MB 101.74 MB +94.35 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.15 MB 111.23 MB +84.98 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 76.82 MB 76.88 MB +58.28 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 93.90 MB 93.96 MB +62.47 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 119.44 MB 119.51 MB +75.66 KB +0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.89 MB 92.95 MB +54.95 KB +0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.67 MB 119.73 MB +67.74 KB +0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.37 MB 138.45 MB +77.51 KB +0.1%
hits_31.vortex 1.0 vortex-file-compressed 89.93 MB 89.97 MB +50.34 KB +0.1%
hits_73.vortex 1.0 vortex-file-compressed 109.41 MB 109.47 MB +60.48 KB +0.1%
hits_2.vortex 1.0 vortex-file-compressed 185.97 MB 186.06 MB +99.56 KB +0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.15 MB 63.18 MB +31.62 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.37 MB 59.40 MB +29.43 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.17 MB 135.23 MB +64.55 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.28 MB 104.33 MB +49.23 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 122.92 MB 122.97 MB +42.73 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.16 MB 118.19 MB +39.22 KB +0.0%
hits_39.vortex 1.0 vortex-file-compressed 80.02 MB 80.04 MB +24.16 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.15 MB 138.19 MB +39.34 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 113.82 MB 113.85 MB +28.00 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.24 MB 108.27 MB +25.62 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 90.18 MB 90.18 MB +6.26 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.21 MB 93.21 MB +4.80 KB +0.0%
hits_10.vortex 1.0 vortex-file-compressed 69.35 MB 69.35 MB +2.89 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.15 MB 123.15 MB +3.54 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.50 MB 277.51 MB +6.15 KB +0.0%
hits_25.vortex 1.0 vortex-file-compressed 113.31 MB 113.32 MB +1.72 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 143.84 MB 143.84 MB +104 B +0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.77 MB 122.77 MB 1.16 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.03 MB 101.03 MB 2.41 KB -0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.06 MB 99.05 MB 4.56 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.48 MB 146.47 MB 9.77 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 141.77 MB 141.76 MB 11.66 KB -0.0%
hits_88.vortex 1.0 vortex-file-compressed 110.91 MB 110.90 MB 9.23 KB -0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.65 MB 100.64 MB 9.80 KB -0.0%
hits_42.vortex 1.0 vortex-file-compressed 221.72 MB 221.70 MB 23.89 KB -0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.20 MB 73.19 MB 11.20 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.49 MB 84.48 MB 14.98 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.00 MB 98.98 MB 17.69 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 76.47 MB 76.46 MB 14.88 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 79.67 MB 79.65 MB 18.30 KB -0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.41 MB 93.39 MB 22.01 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.28 MB 184.23 MB 43.73 KB -0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.51 MB 62.50 MB 15.79 KB -0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.51 MB 91.48 MB 27.83 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 226.44 MB 226.37 MB 76.19 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.19 MB 179.13 MB 60.73 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 75.96 MB 75.93 MB 28.70 KB -0.0%
hits_64.vortex 1.0 vortex-file-compressed 80.94 MB 80.91 MB 30.90 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.08 MB 69.04 MB 31.21 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.20 MB 164.13 MB 78.38 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.22 MB 221.11 MB 105.73 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.12 MB 89.08 MB 43.14 KB -0.0%
hits_82.vortex 1.0 vortex-file-compressed 99.50 MB 99.45 MB 48.26 KB -0.0%
hits_55.vortex 1.0 vortex-file-compressed 168.92 MB 168.84 MB 84.13 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.93 MB 122.87 MB 63.16 KB -0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.57 MB 101.51 MB 56.95 KB -0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.10 MB 168.00 MB 95.80 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 185.99 MB 185.88 MB 108.58 KB -0.1%
hits_47.vortex 1.0 vortex-file-compressed 41.27 MB 41.24 MB 24.54 KB -0.1%
hits_66.vortex 1.0 vortex-file-compressed 90.17 MB 90.12 MB 54.48 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.61 MB 66.57 MB 40.74 KB -0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.01 MB 114.94 MB 74.04 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.31 MB 68.26 MB 44.64 KB -0.1%
hits_16.vortex 1.0 vortex-file-compressed 79.31 MB 79.26 MB 55.02 KB -0.1%
hits_26.vortex 1.0 vortex-file-compressed 109.27 MB 109.19 MB 78.39 KB -0.1%
hits_30.vortex 1.0 vortex-file-compressed 86.81 MB 86.75 MB 65.49 KB -0.1%
hits_97.vortex 1.0 vortex-file-compressed 106.70 MB 106.62 MB 81.19 KB -0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.12 MB 172.00 MB 132.06 KB -0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.31 MB 93.23 MB 78.34 KB -0.1%
hits_68.vortex 1.0 vortex-file-compressed 122.76 MB 122.66 MB 107.69 KB -0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.09 MB 69.03 MB 66.43 KB -0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.41 MB 117.30 MB 114.23 KB -0.1%
hits_48.vortex 1.0 vortex-file-compressed 28.04 MB 28.01 MB 27.98 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.14 MB 69.06 MB 77.88 KB -0.1%
hits_91.vortex 1.0 vortex-file-compressed 96.88 MB 96.77 MB 113.75 KB -0.1%
hits_12.vortex 1.0 vortex-file-compressed 100.88 MB 100.76 MB 128.10 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 103.54 MB 103.40 MB 142.77 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.54 MB 97.40 MB 143.95 KB -0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.05 MB 183.76 MB 289.82 KB -0.2%
hits_95.vortex 1.0 vortex-file-compressed 96.27 MB 96.10 MB 177.30 KB -0.2%
hits_0.vortex 1.0 vortex-file-compressed 89.52 MB 89.35 MB 166.18 KB -0.2%
hits_53.vortex 1.0 vortex-file-compressed 85.95 MB 85.79 MB 161.56 KB -0.2%
hits_17.vortex 1.0 vortex-file-compressed 87.27 MB 87.11 MB 166.08 KB -0.2%
hits_21.vortex 1.0 vortex-file-compressed 92.96 MB 92.70 MB 264.50 KB -0.3%
hits_90.vortex 1.0 vortex-file-compressed 141.75 MB 139.74 MB 2.01 MB -1.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.57 MB 0 B 58.57 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.19 MB 0 B 90.19 MB -100.0%
hits_10.vortex 1.0 vortex-compact 48.75 MB 0 B 48.75 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.22 MB 0 B 54.22 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.16 MB 0 B 69.16 MB -100.0%
hits_13.vortex 1.0 vortex-compact 67.86 MB 0 B 67.86 MB -100.0%
hits_14.vortex 1.0 vortex-compact 73.60 MB 0 B 73.60 MB -100.0%
hits_15.vortex 1.0 vortex-compact 47.94 MB 0 B 47.94 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.07 MB 0 B 48.07 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.15 MB 0 B 58.15 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.13 MB 0 B 64.13 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.73 MB 0 B 44.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.13 MB 0 B 129.13 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.00 MB 0 B 38.00 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.96 MB 0 B 51.96 MB -100.0%
hits_22.vortex 1.0 vortex-compact 44.49 MB 0 B 44.49 MB -100.0%
hits_23.vortex 1.0 vortex-compact 43.92 MB 0 B 43.92 MB -100.0%
hits_24.vortex 1.0 vortex-compact 43.38 MB 0 B 43.38 MB -100.0%
hits_25.vortex 1.0 vortex-compact 72.93 MB 0 B 72.93 MB -100.0%
hits_26.vortex 1.0 vortex-compact 70.73 MB 0 B 70.73 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.94 MB 0 B 69.94 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.18 MB 0 B 70.18 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.49 MB 0 B 36.49 MB -100.0%
hits_3.vortex 1.0 vortex-compact 94.05 MB 0 B 94.05 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.56 MB 0 B 58.56 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.41 MB 0 B 55.41 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.03 MB 0 B 44.03 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.85 MB 0 B 35.85 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.09 MB 0 B 58.09 MB -100.0%
hits_35.vortex 1.0 vortex-compact 74.95 MB 0 B 74.95 MB -100.0%
hits_36.vortex 1.0 vortex-compact 48.90 MB 0 B 48.90 MB -100.0%
hits_37.vortex 1.0 vortex-compact 53.68 MB 0 B 53.68 MB -100.0%
hits_38.vortex 1.0 vortex-compact 62.96 MB 0 B 62.96 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.69 MB 0 B 49.69 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.69 MB 0 B 71.69 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.74 MB 0 B 75.74 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.52 MB 0 B 165.52 MB -100.0%
hits_42.vortex 1.0 vortex-compact 163.97 MB 0 B 163.97 MB -100.0%
hits_43.vortex 1.0 vortex-compact 168.64 MB 0 B 168.64 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.24 MB 0 B 132.24 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.87 MB 0 B 75.87 MB -100.0%
hits_46.vortex 1.0 vortex-compact 41.82 MB 0 B 41.82 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.19 MB 0 B 18.19 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.27 MB 0 B 17.27 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.42 MB 0 B 50.42 MB -100.0%
hits_5.vortex 1.0 vortex-compact 62.83 MB 0 B 62.83 MB -100.0%
hits_50.vortex 1.0 vortex-compact 112.99 MB 0 B 112.99 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.75 MB 0 B 167.75 MB -100.0%
hits_52.vortex 1.0 vortex-compact 63.54 MB 0 B 63.54 MB -100.0%
hits_53.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.56 MB 0 B 117.56 MB -100.0%
hits_55.vortex 1.0 vortex-compact 96.03 MB 0 B 96.03 MB -100.0%
hits_56.vortex 1.0 vortex-compact 77.75 MB 0 B 77.75 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.35 MB 0 B 83.35 MB -100.0%
hits_58.vortex 1.0 vortex-compact 60.31 MB 0 B 60.31 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.15 MB 0 B 66.15 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.08 MB 0 B 63.08 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.15 MB 0 B 64.15 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.46 MB 0 B 57.46 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.08 MB 0 B 74.08 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.00 MB 0 B 46.00 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.78 MB 0 B 53.78 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.70 MB 0 B 129.70 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.36 MB 0 B 53.36 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.93 MB 0 B 113.93 MB -100.0%
hits_68.vortex 1.0 vortex-compact 75.85 MB 0 B 75.85 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.82 MB 0 B 80.82 MB -100.0%
hits_7.vortex 1.0 vortex-compact 63.72 MB 0 B 63.72 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.16 MB 0 B 61.16 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.17 MB 0 B 69.17 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.60 MB 0 B 51.60 MB -100.0%
hits_73.vortex 1.0 vortex-compact 69.83 MB 0 B 69.83 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.46 MB 0 B 71.46 MB -100.0%
hits_75.vortex 1.0 vortex-compact 43.56 MB 0 B 43.56 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.27 MB 0 B 76.27 MB -100.0%
hits_77.vortex 1.0 vortex-compact 117.90 MB 0 B 117.90 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.80 MB 0 B 97.80 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.53 MB 0 B 85.53 MB -100.0%
hits_8.vortex 1.0 vortex-compact 62.81 MB 0 B 62.81 MB -100.0%
hits_80.vortex 1.0 vortex-compact 67.87 MB 0 B 67.87 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.33 MB 0 B 65.33 MB -100.0%
hits_82.vortex 1.0 vortex-compact 66.78 MB 0 B 66.78 MB -100.0%
hits_83.vortex 1.0 vortex-compact 52.39 MB 0 B 52.39 MB -100.0%
hits_84.vortex 1.0 vortex-compact 72.94 MB 0 B 72.94 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.53 MB 0 B 52.53 MB -100.0%
hits_86.vortex 1.0 vortex-compact 48.15 MB 0 B 48.15 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.82 MB 0 B 118.82 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_89.vortex 1.0 vortex-compact 112.70 MB 0 B 112.70 MB -100.0%
hits_9.vortex 1.0 vortex-compact 65.54 MB 0 B 65.54 MB -100.0%
hits_90.vortex 1.0 vortex-compact 81.71 MB 0 B 81.71 MB -100.0%
hits_91.vortex 1.0 vortex-compact 60.77 MB 0 B 60.77 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.11 MB 0 B 94.11 MB -100.0%
hits_93.vortex 1.0 vortex-compact 58.73 MB 0 B 58.73 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.48 MB 0 B 90.48 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.60 MB 0 B 57.60 MB -100.0%
hits_96.vortex 1.0 vortex-compact 90.92 MB 0 B 90.92 MB -100.0%
hits_97.vortex 1.0 vortex-compact 68.97 MB 0 B 68.97 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.60 MB 0 B 72.60 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.16 MB 0 B 77.16 MB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 0 B (-100.0%)
  • vortex-file-compressed: 10.98 GB → 10.98 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.7%
Engines: DataFusion No clear signal (-7.1%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 421094148 420037097 1.00
tpch_q02/datafusion:vortex-file-compressed 100626868 100564409 1.00
tpch_q03/datafusion:vortex-file-compressed 198122772 196783122 1.01
tpch_q04/datafusion:vortex-file-compressed 97289559 97511944 1.00
tpch_q05/datafusion:vortex-file-compressed 337424493 331307941 1.02
tpch_q06/datafusion:vortex-file-compressed 39451351 39140412 1.01
tpch_q07/datafusion:vortex-file-compressed 450488412 456513360 0.99
tpch_q08/datafusion:vortex-file-compressed 343056580 342216289 1.00
tpch_q09/datafusion:vortex-file-compressed 593309471 591122355 1.00
tpch_q10/datafusion:vortex-file-compressed 222903028 223848495 1.00
tpch_q11/datafusion:vortex-file-compressed 78347055 78127196 1.00
tpch_q12/datafusion:vortex-file-compressed 115389424 113745677 1.01
tpch_q13/datafusion:vortex-file-compressed 198235699 198157533 1.00
tpch_q14/datafusion:vortex-file-compressed 50842180 50841281 1.00
tpch_q15/datafusion:vortex-file-compressed 102311437 100622432 1.02
tpch_q16/datafusion:vortex-file-compressed 73119487 76528743 0.96
tpch_q17/datafusion:vortex-file-compressed 578221026 579619101 1.00
tpch_q18/datafusion:vortex-file-compressed 827289861 829025795 1.00
tpch_q19/datafusion:vortex-file-compressed 184259884 173505357 1.06
tpch_q20/datafusion:vortex-file-compressed 156622120 158778437 0.99
tpch_q21/datafusion:vortex-file-compressed 588252445 599107441 0.98
tpch_q22/datafusion:vortex-file-compressed 56004248 56299096 0.99
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 480143741 481428417 1.00
tpch_q02/datafusion:parquet 176391516 175669952 1.00
tpch_q03/datafusion:parquet 259413314 257226278 1.01
tpch_q04/datafusion:parquet 122142905 119071311 1.03
tpch_q05/datafusion:parquet 397243590 394410043 1.01
tpch_q06/datafusion:parquet 133353632 130729278 1.02
tpch_q07/datafusion:parquet 562687196 567182655 0.99
tpch_q08/datafusion:parquet 452310473 458015748 0.99
tpch_q09/datafusion:parquet 725087247 727602740 1.00
tpch_q10/datafusion:parquet 582004756 580635584 1.00
tpch_q11/datafusion:parquet 119201419 118888011 1.00
tpch_q12/datafusion:parquet 209021591 209622250 1.00
tpch_q13/datafusion:parquet 347601459 344871907 1.01
tpch_q14/datafusion:parquet 151329281 151243255 1.00
tpch_q15/datafusion:parquet 260792000 262067587 1.00
tpch_q16/datafusion:parquet 118143225 122333648 0.97
tpch_q17/datafusion:parquet 669419872 673276573 0.99
tpch_q18/datafusion:parquet 874633023 870020551 1.01
tpch_q19/datafusion:parquet 277547745 280665752 0.99
tpch_q20/datafusion:parquet 298876673 298552931 1.00
tpch_q21/datafusion:parquet 646596264 651654256 0.99
tpch_q22/datafusion:parquet 209465672 214194656 0.98
datafusion / arrow (0.859x ✅, 16↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 705189906 806023183 0.87
tpch_q02/datafusion:arrow 🚀 111767318 130721394 0.86
tpch_q03/datafusion:arrow 🚀 496547412 627078943 0.79
tpch_q04/datafusion:arrow 🚀 364372195 467938452 0.78
tpch_q05/datafusion:arrow 🚀 739114867 884787418 0.84
tpch_q06/datafusion:arrow 🚀 324610986 401964652 0.81
tpch_q07/datafusion:arrow 🚀 1126122994 1387968735 0.81
tpch_q08/datafusion:arrow 🚀 928919124 1154292427 0.80
tpch_q09/datafusion:arrow 🚀 1079649490 1280854929 0.84
tpch_q10/datafusion:arrow 🚀 628052871 766232778 0.82
tpch_q11/datafusion:arrow 🚀 91459898 105972012 0.86
tpch_q12/datafusion:arrow 1395443433 1449873624 0.96
tpch_q13/datafusion:arrow 466421526 509788157 0.91
tpch_q14/datafusion:arrow 🚀 356951870 435117139 0.82
tpch_q15/datafusion:arrow 🚀 734157697 921661707 0.80
tpch_q16/datafusion:arrow 🚀 79115024 89499588 0.88
tpch_q17/datafusion:arrow 🚀 956463177 1152775889 0.83
tpch_q18/datafusion:arrow 🚀 1809724312 2110814014 0.86
tpch_q19/datafusion:arrow 554035232 599037015 0.92
tpch_q20/datafusion:arrow 503508820 552813002 0.91
tpch_q21/datafusion:arrow 3137471198 3217080670 0.98
tpch_q22/datafusion:arrow 80272550 81410550 0.99
duckdb / vortex-file-compressed (0.998x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171658947 172438605 1.00
tpch_q02/duckdb:vortex-file-compressed 52572146 52567306 1.00
tpch_q03/duckdb:vortex-file-compressed 119335285 118776917 1.00
tpch_q04/duckdb:vortex-file-compressed 154466978 152163703 1.02
tpch_q05/duckdb:vortex-file-compressed 134939443 136901243 0.99
tpch_q06/duckdb:vortex-file-compressed 35634027 35329398 1.01
tpch_q07/duckdb:vortex-file-compressed 129793873 129622068 1.00
tpch_q08/duckdb:vortex-file-compressed 169923121 168707116 1.01
tpch_q09/duckdb:vortex-file-compressed 394582338 388829884 1.01
tpch_q10/duckdb:vortex-file-compressed 191541432 194995143 0.98
tpch_q11/duckdb:vortex-file-compressed 30596463 30895409 0.99
tpch_q12/duckdb:vortex-file-compressed 108328578 107569117 1.01
tpch_q13/duckdb:vortex-file-compressed 276269678 276535909 1.00
tpch_q14/duckdb:vortex-file-compressed 54591237 54286811 1.01
tpch_q15/duckdb:vortex-file-compressed 86381883 90292549 0.96
tpch_q16/duckdb:vortex-file-compressed 75380232 75903824 0.99
tpch_q17/duckdb:vortex-file-compressed 86977851 86500207 1.01
tpch_q18/duckdb:vortex-file-compressed 286247059 288933616 0.99
tpch_q19/duckdb:vortex-file-compressed 73455900 74259755 0.99
tpch_q20/duckdb:vortex-file-compressed 138991450 140030200 0.99
tpch_q21/duckdb:vortex-file-compressed 477609524 474056565 1.01
tpch_q22/duckdb:vortex-file-compressed 63009443 62099096 1.01
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257438395 266202789 0.97
tpch_q02/duckdb:parquet 102094361 98819798 1.03
tpch_q03/duckdb:parquet 211463198 209445499 1.01
tpch_q04/duckdb:parquet 129774613 134342179 0.97
tpch_q05/duckdb:parquet 222990055 224464845 0.99
tpch_q06/duckdb:parquet 72743597 74548413 0.98
tpch_q07/duckdb:parquet 186446115 187049114 1.00
tpch_q08/duckdb:parquet 262924510 263789296 1.00
tpch_q09/duckdb:parquet 471063568 479518724 0.98
tpch_q10/duckdb:parquet 621919696 620214311 1.00
tpch_q11/duckdb:parquet 65041470 64230728 1.01
tpch_q12/duckdb:parquet 130692840 130209858 1.00
tpch_q13/duckdb:parquet 442172663 446376594 0.99
tpch_q14/duckdb:parquet 178270988 178571186 1.00
tpch_q15/duckdb:parquet 103438409 104923014 0.99
tpch_q16/duckdb:parquet 166034470 163617631 1.01
tpch_q17/duckdb:parquet 180012992 182125757 0.99
tpch_q18/duckdb:parquet 362138901 360821597 1.00
tpch_q19/duckdb:parquet 285369235 287088134 0.99
tpch_q20/duckdb:parquet 229607675 225983415 1.02
tpch_q21/duckdb:parquet 563277614 561035195 1.00
tpch_q22/duckdb:parquet 293153977 292355579 1.00

File Size Changes (47 files changed, -44.4% overall, 15↑ 32↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 10.0 vortex-file-compressed 5.70 MB 5.80 MB +95.32 KB +1.6%
part_1.vortex 10.0 vortex-file-compressed 24.54 MB 24.73 MB +201.06 KB +0.8%
orders_1.vortex 10.0 vortex-file-compressed 134.11 MB 134.54 MB +440.87 KB +0.3%
lineitem_1.vortex 10.0 vortex-file-compressed 129.13 MB 129.41 MB +290.98 KB +0.2%
lineitem_9.vortex 10.0 vortex-file-compressed 129.15 MB 129.34 MB +187.24 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 129.40 MB 129.49 MB +98.68 KB +0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 129.41 MB 129.48 MB +73.03 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 129.45 MB 129.51 MB +55.37 KB +0.0%
orders_0.vortex 10.0 vortex-file-compressed 132.98 MB 133.03 MB +51.45 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.50 MB 88.53 MB +32.32 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 119.70 MB 119.74 MB +42.67 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 129.37 MB 129.41 MB +40.90 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 119.73 MB 119.77 MB +35.08 KB +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 129.06 MB 129.08 MB +12.45 KB +0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 129.49 MB 129.50 MB +6.98 KB +0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 129.28 MB 129.27 MB 9.44 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 129.56 MB 129.55 MB 13.36 KB -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 129.16 MB 129.14 MB 25.28 KB -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.66 MB 129.62 MB 43.11 KB -0.0%
orders_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.31 MB 71.28 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 129.34 MB 129.26 MB 82.85 KB -0.1%
part_0.vortex 10.0 vortex-file-compressed 24.85 MB 24.76 MB 90.72 KB -0.4%
customer_0.vortex 10.0 vortex-compact 74.12 MB 0 B 74.12 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 0 B 100.64 MB -100.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 0 B 100.53 MB -100.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_2.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 0 B 100.56 MB -100.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 0 B 100.70 MB -100.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 0 B 100.68 MB -100.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 0 B 100.58 MB -100.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 0 B 100.46 MB -100.0%
nation_0.vortex 10.0 vortex-compact 8.18 KB 0 B 8.18 KB -100.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 0 B 114.79 MB -100.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 0 B 114.76 MB -100.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 0 B 114.78 MB -100.0%
part_0.vortex 10.0 vortex-compact 17.10 MB 0 B 17.10 MB -100.0%
part_1.vortex 10.0 vortex-compact 16.96 MB 0 B 16.96 MB -100.0%
partsupp_0.vortex 10.0 vortex-compact 104.95 MB 0 B 104.95 MB -100.0%
partsupp_1.vortex 10.0 vortex-compact 105.50 MB 0 B 105.50 MB -100.0%
region_0.vortex 10.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (+0.1%)

@mhk197 mhk197 changed the base branch from develop to mk/add-list-layout July 2, 2026 00:38
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.6%
Engines: DataFusion No clear signal (-1.5%, environment too noisy confidence) · DuckDB No clear signal (-5.5%, environment too noisy confidence)
Vortex (geomean): 1.052x ➖
Parquet (geomean): 1.091x ➖
Shifts: Parquet (control) +9.1% · Median polish +10.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.137x ➖, 0↑ 6↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 363676664 285397233 1.27
tpch_q02/datafusion:vortex-file-compressed 620808541 496803120 1.25
tpch_q03/datafusion:vortex-file-compressed 530798703 465989507 1.14
tpch_q04/datafusion:vortex-file-compressed 333365283 283241091 1.18
tpch_q05/datafusion:vortex-file-compressed 672059708 575871247 1.17
tpch_q06/datafusion:vortex-file-compressed 321276110 381636103 0.84
tpch_q07/datafusion:vortex-file-compressed 518017767 559344294 0.93
tpch_q08/datafusion:vortex-file-compressed 686804600 726196060 0.95
tpch_q09/datafusion:vortex-file-compressed 415552211 527994942 0.79
tpch_q10/datafusion:vortex-file-compressed 474699442 597040932 0.80
tpch_q11/datafusion:vortex-file-compressed 350852902 491349775 0.71
tpch_q12/datafusion:vortex-file-compressed 🚨 953018786 572683899 1.66
tpch_q13/datafusion:vortex-file-compressed 312053534 303853091 1.03
tpch_q14/datafusion:vortex-file-compressed 🚨 455595665 327966537 1.39
tpch_q15/datafusion:vortex-file-compressed 702785029 563667077 1.25
tpch_q16/datafusion:vortex-file-compressed 284628409 323774523 0.88
tpch_q17/datafusion:vortex-file-compressed 417732259 438774263 0.95
tpch_q18/datafusion:vortex-file-compressed 341516581 303855923 1.12
tpch_q19/datafusion:vortex-file-compressed 🚨 663058908 472598089 1.40
tpch_q20/datafusion:vortex-file-compressed 🚨 889794312 416182369 2.14
tpch_q21/datafusion:vortex-file-compressed 🚨 1087597416 598505352 1.82
tpch_q22/datafusion:vortex-file-compressed 🚨 370782047 275357769 1.35
datafusion / parquet (1.154x ➖, 1↑ 9↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 296014060 352621926 0.84
tpch_q02/datafusion:parquet 470672338 495838305 0.95
tpch_q03/datafusion:parquet 435135308 497292390 0.88
tpch_q04/datafusion:parquet 269548530 258212168 1.04
tpch_q05/datafusion:parquet 582170839 533964168 1.09
tpch_q06/datafusion:parquet 233359918 189561508 1.23
tpch_q07/datafusion:parquet 534704377 498341336 1.07
tpch_q08/datafusion:parquet 640008890 605133635 1.06
tpch_q09/datafusion:parquet 536359816 568410383 0.94
tpch_q10/datafusion:parquet 🚨 905359299 577542795 1.57
tpch_q11/datafusion:parquet 🚀 387862537 573523305 0.68
tpch_q12/datafusion:parquet 🚨 396268489 271242381 1.46
tpch_q13/datafusion:parquet 🚨 676975861 503240423 1.35
tpch_q14/datafusion:parquet 🚨 397782601 304325908 1.31
tpch_q15/datafusion:parquet 544062461 458949465 1.19
tpch_q16/datafusion:parquet 🚨 347016888 169955291 2.04
tpch_q17/datafusion:parquet 🚨 689125110 467430752 1.47
tpch_q18/datafusion:parquet 🚨 705339141 501443150 1.41
tpch_q19/datafusion:parquet 🚨 508056713 359325598 1.41
tpch_q20/datafusion:parquet 313535884 362356510 0.87
tpch_q21/datafusion:parquet 🚨 1039304411 688483329 1.51
tpch_q22/datafusion:parquet 246142079 276653717 0.89
duckdb / vortex-file-compressed (0.974x ➖, 0↑ 0↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 339182460 296749154 1.14
tpch_q02/duckdb:vortex-file-compressed 1006660096 1218776520 0.83
tpch_q03/duckdb:vortex-file-compressed 817328170 714725008 1.14
tpch_q04/duckdb:vortex-file-compressed 422023299 490155676 0.86
tpch_q05/duckdb:vortex-file-compressed 1070210054 877295507 1.22
tpch_q06/duckdb:vortex-file-compressed 322979323 431103412 0.75
tpch_q07/duckdb:vortex-file-compressed 977530384 1154118122 0.85
tpch_q08/duckdb:vortex-file-compressed 1126493256 1315633044 0.86
tpch_q09/duckdb:vortex-file-compressed 1123603557 1115499795 1.01
tpch_q10/duckdb:vortex-file-compressed 800360231 801913226 1.00
tpch_q11/duckdb:vortex-file-compressed 552178822 507067640 1.09
tpch_q12/duckdb:vortex-file-compressed 738596504 746031010 0.99
tpch_q13/duckdb:vortex-file-compressed 532258093 578478583 0.92
tpch_q14/duckdb:vortex-file-compressed 525758545 499666860 1.05
tpch_q15/duckdb:vortex-file-compressed 387080961 366168058 1.06
tpch_q16/duckdb:vortex-file-compressed 346321545 358623503 0.97
tpch_q17/duckdb:vortex-file-compressed 738068023 841619588 0.88
tpch_q18/duckdb:vortex-file-compressed 693718648 689035195 1.01
tpch_q19/duckdb:vortex-file-compressed 503035221 614784310 0.82
tpch_q20/duckdb:vortex-file-compressed 1049298227 881141808 1.19
tpch_q21/duckdb:vortex-file-compressed 1154465331 1244549453 0.93
tpch_q22/duckdb:vortex-file-compressed 343381583 322336318 1.07
duckdb / parquet (1.031x ➖, 0↑ 1↓)
name PR 3df5ed6 (ns) base 890704f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 516833574 503348410 1.03
tpch_q02/duckdb:parquet 1281694568 1262586072 1.02
tpch_q03/duckdb:parquet 1172947598 1180908177 0.99
tpch_q04/duckdb:parquet 661546389 847839664 0.78
tpch_q05/duckdb:parquet 1487437130 1366962535 1.09
tpch_q06/duckdb:parquet 540881835 526169385 1.03
tpch_q07/duckdb:parquet 1380997375 1420975314 0.97
tpch_q08/duckdb:parquet 1843030558 1746305762 1.06
tpch_q09/duckdb:parquet 1553078259 1553852008 1.00
tpch_q10/duckdb:parquet 1433081920 1462331361 0.98
tpch_q11/duckdb:parquet 830625296 819825340 1.01
tpch_q12/duckdb:parquet 923861086 774191073 1.19
tpch_q13/duckdb:parquet 1023740367 961769159 1.06
tpch_q14/duckdb:parquet 852775662 816049305 1.05
tpch_q15/duckdb:parquet 626543026 694663870 0.90
tpch_q16/duckdb:parquet 683832221 723397533 0.95
tpch_q17/duckdb:parquet 🚨 1052592838 796647704 1.32
tpch_q18/duckdb:parquet 1093341000 990491899 1.10
tpch_q19/duckdb:parquet 938352735 836028262 1.12
tpch_q20/duckdb:parquet 1319067734 1312788092 1.00
tpch_q21/duckdb:parquet 1154956631 1217664202 0.95
tpch_q22/duckdb:parquet 742373447 612173621 1.21

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant