Skip to content

Remove usages of null_as_false - #10124

Merged
myrrc merged 4 commits into
developfrom
myrrc/to-mask-kernel
Oct 7, 2026
Merged

myrrc merged 4 commits into
developfrom
myrrc/to-mask-kernel

Conversation

@myrrc

@myrrc myrrc commented Sep 29, 2026 •

Copy link
Copy Markdown
Contributor

Depends on #9932.

We have lazy ScalarFn::validity() now, so fill_null is also lazy. Thus there's
no need in special null_as_false. Deprecate it and replace all usages with
fill_null(false) except for zone map pruning. Pruning work is very fast, so
just constructing FillNull node and then canonicalizing is slower than
canonicalizing and intersecting the bitbuffer.
So pruning keeps the current implementation which is now private.

@myrrc myrrc added the changelog/deprecation A change that introduces a series of API deprecations label Sep 29, 2026
@codspeed

codspeed Bot commented Sep 29, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 14.72%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 2152 untouched benchmarks
⏩ 476 skipped benchmarks1
🗄️ 1 archived benchmark run2

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ WallTime bitpack_blocked_compress_avx2 7.7 µs 6.7 µs +14.72%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/to-mask-kernel (ad62289) with develop (46d518b)

Open in CodSpeed

Footnotes

  1. 476 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. 1 benchmark was run, but is now archived. If it was deleted in another branch, consider rebasing to remove it from the report. Instead if it was added back, click here to restore it. ↩

Comment thread vortex-layout/src/layouts/zoned/zone_map.rs Outdated
@robert3005

robert3005 commented Sep 29, 2026 via email

Copy link
Copy Markdown
Contributor

myrrc added 3 commits October 6, 2026 10:30
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc force-pushed the myrrc/to-mask-kernel branch from 8368aab to 2b81987 Compare October 6, 2026 09:30
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc marked this pull request as ready for review October 7, 2026 11:03
@myrrc
myrrc enabled auto-merge (squash) October 7, 2026 11:03
@joseph-isaacs
joseph-isaacs disabled auto-merge October 7, 2026 11:08
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@joseph-isaacs joseph-isaacs changed the title Deprecate null_as_false Remove usages of null_as_false Oct 7, 2026
@github-actions

github-actions Bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ad62289 compress-bench 2 Explore Profiling Data
🟢 Done ad62289 random-access-bench 1 Explore Profiling Data
🟢 Done ad62289 statpopgen 1 Explore Profiling Data
🟢 Done ad62289 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ad62289 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done ad62289 tpch-s3-10 1 Explore Profiling Data
🟢 Done ad62289 tpcds-nvme 1 Explore Profiling Data
🟢 Done ad62289 clickbench-nvme 1 Explore Profiling Data
🟢 Done ad62289 fineweb 1 Explore Profiling Data
🟢 Done ad62289 fineweb-s3 1 Explore Profiling Data
🟢 Done ad62289 appian-nvme 1 Explore Profiling Data
🟢 Done ad62289 polarsignals 1 Explore Profiling Data
🟢 Done ad62289 tpch-nvme 1 Explore Profiling Data
🟢 Done ad62289 tpch-s3 1 Explore Profiling Data
🟢 Done ad62289 string-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ad622893 vs base c6e51ba4
Vortex (geomean): hot 0.999x ➖ · cold 0.992x ➖


datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57558666 / 57156250 / +0.7% 107927289 / 104801399 / +3.0% 0.53 / 0.55 / -2.2%
polarsignals_q01/datafusion:vortex-file-compressed 63847516 / 62851072 / +1.6% 128783548 / 129807190 / -0.8% 0.50 / 0.48 / +2.4%
polarsignals_q02/datafusion:vortex-file-compressed 71617825 / 74700028 / -4.1% 112691751 / 115425678 / -2.4% 0.64 / 0.65 / -1.8%
polarsignals_q03/datafusion:vortex-file-compressed 79457050 / 80048366 / -0.7% 148075951 / 147563705 / +0.3% 0.54 / 0.54 / -1.1%
polarsignals_q04/datafusion:vortex-file-compressed 9707370 / 9567692 / +1.5% 52751576 / 53947981 / -2.2% 0.18 / 0.18 / +3.8%
polarsignals_q05/datafusion:vortex-file-compressed 24271338 / 24277875 / -0.0% 69314487 / 68431009 / +1.3% 0.35 / 0.35 / -1.3%
polarsignals_q06/datafusion:vortex-file-compressed 21876168 / 21511986 / +1.7% 66469357 / 67818684 / -2.0% 0.33 / 0.32 / +3.8%
polarsignals_q07/datafusion:vortex-file-compressed 39976126 / 39255628 / +1.8% 81324555 / 81456453 / -0.2% 0.49 / 0.48 / +2.0%
polarsignals_q08/datafusion:vortex-file-compressed 98408300 / 98798464 / -0.4% 164414165 / 166619932 / -1.3% 0.60 / 0.59 / +0.9%
polarsignals_q09/datafusion:vortex-file-compressed 10005068 / 10282936 / -2.7% 50059114 / 51819252 / -3.4% 0.20 / 0.20 / +0.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR ad622893 vs base c6e51ba4


vortex / vortex-file-compressed / ms (1.001x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.697062 / 32.606597 / +0.3%
read/clickbench/URL/shard-0/onpair-12 20.976665 / 21.140119 / -0.8%
read/tpch/l_comment/fsst 57.809031 / 57.659612 / +0.3%
read/tpch/l_comment/onpair-12 53.532546 / 53.256399 / +0.5%
write/clickbench/URL/shard-0/fsst 593.122507 / 592.671511 / +0.1%
write/clickbench/URL/shard-0/onpair-12 967.841409 / 963.828644 / +0.4%
write/tpch/l_comment/fsst 1916.22718 / 1922.7657 / -0.3%
write/tpch/l_comment/onpair-12 2098.96352 / 2083.99088 / +0.7%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.4055438 / 47.4055438 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst 30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Engines: DataFusion No clear signal (+3.3%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.025x ➖ · cold 1.007x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6912974 / 6977566 / -0.9% 20581313 / 20631470 / -0.2% 0.34 / 0.34 / -0.7%
fineweb_q01/datafusion:vortex-file-compressed 11969068 / 12250270 / -2.3% 50411533 / 51800881 / -2.7% 0.24 / 0.24 / +0.4%
fineweb_q02/datafusion:vortex-file-compressed 13577306 / 13435082 / +1.1% 59202417 / 58108540 / +1.9% 0.23 / 0.23 / -0.8%
fineweb_q03/datafusion:vortex-file-compressed 22269192 / 21520646 / +3.5% 104473612 / 112777291 / -7.4% 0.21 / 0.19 / +11.7%
fineweb_q04/datafusion:vortex-file-compressed 81561875 / 82074258 / -0.6% 158462375 / 166186141 / -4.6% 0.51 / 0.49 / +4.2%
fineweb_q05/datafusion:vortex-file-compressed 69664163 / 68168710 / +2.2% 146910785 / 138504933 / +6.1% 0.47 / 0.49 / -3.7%
fineweb_q06/datafusion:vortex-file-compressed 20259334 / 19983494 / +1.4% 110267746 / 101305118 / +8.8% 0.18 / 0.20 / -6.9%
fineweb_q07/datafusion:vortex-file-compressed 19197822 / 19984052 / -3.9% 105525146 / 98121818 / +7.5% 0.18 / 0.20 / -10.7%
fineweb_q08/datafusion:vortex-file-compressed 10250953 / 10197038 / +0.5% 53095812 / 48715476 / +9.0% 0.19 / 0.21 / -7.8%
datafusion / vortex-compact / ns (1.077x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6993204 / 7031362 / -0.5% 20662939 / 21002262 / -1.6% 0.34 / 0.33 / +1.1%
fineweb_q01/datafusion:vortex-compact 76840563 / 44608506 / +72.3% 🔴 81379737 / 77635636 / +4.8% 0.94 / 0.57 / +64.3%
fineweb_q02/datafusion:vortex-compact 43915289 / 44672568 / -1.7% 83253390 / 111313653 / -25.2% 🟢 0.53 / 0.40 / +31.4%
fineweb_q03/datafusion:vortex-compact 156663634 / 167194168 / -6.3% 229412829 / 228392053 / +0.4% 0.68 / 0.73 / -6.7%
fineweb_q04/datafusion:vortex-compact 210963794 / 175589854 / +20.1% 🔴 252482744 / 255861871 / -1.3% 0.84 / 0.69 / +21.8%
fineweb_q05/datafusion:vortex-compact 153262809 / 155891217 / -1.7% 235589038 / 231467901 / +1.8% 0.65 / 0.67 / -3.4%
fineweb_q06/datafusion:vortex-compact 87406534 / 87028886 / +0.4% 188631573 / 156382269 / +20.6% 🔴 0.46 / 0.56 / -16.7%
fineweb_q07/datafusion:vortex-compact 88218525 / 87832335 / +0.4% 181645167 / 156413380 / +16.1% 🔴 0.49 / 0.56 / -13.5%
fineweb_q08/datafusion:vortex-compact 10180209 / 9833672 / +3.5% 48371090 / 40645150 / +19.0% 🔴 0.21 / 0.24 / -13.0%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9611702 / 9756417 / -1.5% 33730409 / 30740334 / +9.7% 0.28 / 0.32 / -10.2%
fineweb_q01/datafusion:parquet 74931050 / 75055046 / -0.2% 154853853 / 159385533 / -2.8% 0.48 / 0.47 / +2.8%
fineweb_q02/datafusion:parquet 76279698 / 74540138 / +2.3% 155272269 / 161687387 / -4.0% 0.49 / 0.46 / +6.6%
fineweb_q03/datafusion:parquet 74120233 / 73609387 / +0.7% 152714008 / 153654172 / -0.6% 0.49 / 0.48 / +1.3%
fineweb_q04/datafusion:parquet 84358702 / 81624874 / +3.3% 150965623 / 155143774 / -2.7% 0.56 / 0.53 / +6.2%
fineweb_q05/datafusion:parquet 81180110 / 80962160 / +0.3% 156804896 / 160347604 / -2.2% 0.52 / 0.50 / +2.5%
fineweb_q06/datafusion:parquet 75653666 / 75124122 / +0.7% 151349800 / 154179687 / -1.8% 0.50 / 0.49 / +2.6%
fineweb_q07/datafusion:parquet 73132595 / 74860969 / -2.3% 153461216 / 157306915 / -2.4% 0.48 / 0.48 / +0.1%
fineweb_q08/datafusion:parquet 74353099 / 73648372 / +1.0% 153833680 / 156298005 / -1.6% 0.48 / 0.47 / +2.6%
duckdb / vortex-file-compressed / ns (1.041x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3207214 / 1952483 / +64.3% 🔴 6954415 / 4900630 / +41.9% 🔴 0.46 / 0.40 / +15.8%
fineweb_q01/duckdb:vortex-file-compressed 22237244 / 20827830 / +6.8% 67249918 / 57575845 / +16.8% 🔴 0.33 / 0.36 / -8.6%
fineweb_q02/duckdb:vortex-file-compressed 19943958 / 20846764 / -4.3% 65717748 / 64474057 / +1.9% 0.30 / 0.32 / -6.1%
fineweb_q03/duckdb:vortex-file-compressed 30813202 / 26871826 / +14.7% 🔴 120639441 / 122936485 / -1.9% 0.26 / 0.22 / +16.9%
fineweb_q04/duckdb:vortex-file-compressed 80667544 / 78871774 / +2.3% 121011910 / 121178310 / -0.1% 0.67 / 0.65 / +2.4%
fineweb_q05/duckdb:vortex-file-compressed 68897003 / 68433136 / +0.7% 109800607 / 114714158 / -4.3% 0.63 / 0.60 / +5.2%
fineweb_q06/duckdb:vortex-file-compressed 31194991 / 33218308 / -6.1% 108103854 / 111758702 / -3.3% 0.29 / 0.30 / -2.9%
fineweb_q07/duckdb:vortex-file-compressed 28527876 / 33851328 / -15.7% 🟢 121051654 / 111241016 / +8.8% 0.24 / 0.30 / -22.6%
fineweb_q08/duckdb:vortex-file-compressed 6084718 / 6655178 / -8.6% 14525651 / 16906155 / -14.1% 🟢 0.42 / 0.39 / +6.4%
duckdb / vortex-compact / ns (0.986x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2365925 / 2433340 / -2.8% 5089576 / 7599598 / -33.0% 🟢 0.46 / 0.32 / +45.2%
fineweb_q01/duckdb:vortex-compact 45091502 / 51136879 / -11.8% 🟢 69020072 / 93474620 / -26.2% 🟢 0.65 / 0.55 / +19.4%
fineweb_q02/duckdb:vortex-compact 51362970 / 48904266 / +5.0% 96150842 / 83405253 / +15.3% 🔴 0.53 / 0.59 / -8.9%
fineweb_q03/duckdb:vortex-compact 185020262 / 185904025 / -0.5% 306049782 / 253765559 / +20.6% 🔴 0.60 / 0.73 / -17.5%
fineweb_q04/duckdb:vortex-compact 188106092 / 208808188 / -9.9% 234079092 / 345693005 / -32.3% 🟢 0.80 / 0.60 / +33.0%
fineweb_q05/duckdb:vortex-compact 195961998 / 183380976 / +6.9% 233637196 / 265049815 / -11.9% 🟢 0.84 / 0.69 / +21.2%
fineweb_q06/duckdb:vortex-compact 105147702 / 94217062 / +11.6% 🔴 184301053 / 144463923 / +27.6% 🔴 0.57 / 0.65 / -12.5%
fineweb_q07/duckdb:vortex-compact 103298876 / 102660284 / +0.6% 194367317 / 176610444 / +10.1% 🔴 0.53 / 0.58 / -8.6%
fineweb_q08/duckdb:vortex-compact 6064944 / 6677144 / -9.2% 12609858 / 12414292 / +1.6% 0.48 / 0.54 / -10.6%
duckdb / parquet / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21994082 / 23328734 / -5.7% 23363613 / 24689944 / -5.4% 0.94 / 0.94 / -0.4%
fineweb_q01/duckdb:parquet 43979862 / 44174194 / -0.4% 56409105 / 58291506 / -3.2% 0.78 / 0.76 / +2.9%
fineweb_q02/duckdb:parquet 43613480 / 43644754 / -0.1% 58396503 / 58010688 / +0.7% 0.75 / 0.75 / -0.7%
fineweb_q03/duckdb:parquet 94338108 / 95059930 / -0.8% 185452205 / 186031988 / -0.3% 0.51 / 0.51 / -0.4%
fineweb_q04/duckdb:parquet 151664090 / 151952179 / -0.2% 210927101 / 225312048 / -6.4% 0.72 / 0.67 / +6.6%
fineweb_q05/duckdb:parquet 143208292 / 142975964 / +0.2% 197842070 / 189424170 / +4.4% 0.72 / 0.75 / -4.1%
fineweb_q06/duckdb:parquet 71204172 / 70893176 / +0.4% 128986718 / 115398223 / +11.8% 🔴 0.55 / 0.61 / -10.1%
fineweb_q07/duckdb:parquet 71802196 / 72401231 / -0.8% 162378380 / 148620381 / +9.3% 0.44 / 0.49 / -9.2%
fineweb_q08/duckdb:parquet 25015898 / 22568878 / +10.8% 🔴 28210870 / 24391548 / +15.7% 🔴 0.89 / 0.93 / -4.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.979x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16625144 / 16390037 / +1.4% 46616960 / 48798303 / -4.5% 0.36 / 0.34 / +6.2%
tpch_q02/datafusion:vortex-file-compressed 17515064 / 17460227 / +0.3% 37102117 / 37076820 / +0.1% 0.47 / 0.47 / +0.2%
tpch_q03/datafusion:vortex-file-compressed 19087177 / 19406540 / -1.6% 47770502 / 51537560 / -7.3% 0.40 / 0.38 / +6.1%
tpch_q04/datafusion:vortex-file-compressed 9739906 / 10270048 / -5.2% 32596637 / 34477939 / -5.5% 0.30 / 0.30 / +0.3%
tpch_q05/datafusion:vortex-file-compressed 37116434 / 36990833 / +0.3% 65878147 / 67554721 / -2.5% 0.56 / 0.55 / +2.9%
tpch_q06/datafusion:vortex-file-compressed 6405326 / 6347290 / +0.9% 31023245 / 31135193 / -0.4% 0.21 / 0.20 / +1.3%
tpch_q07/datafusion:vortex-file-compressed 51307678 / 51752749 / -0.9% 75007337 / 81881632 / -8.4% 0.68 / 0.63 / +8.2%
tpch_q08/datafusion:vortex-file-compressed 51998653 / 51635250 / +0.7% 81575827 / 83905938 / -2.8% 0.64 / 0.62 / +3.6%
tpch_q09/datafusion:vortex-file-compressed 49184438 / 52769844 / -6.8% 78792883 / 80117055 / -1.7% 0.62 / 0.66 / -5.2%
tpch_q10/datafusion:vortex-file-compressed 17265743 / 17283768 / -0.1% 51051737 / 52953022 / -3.6% 0.34 / 0.33 / +3.6%
tpch_q11/datafusion:vortex-file-compressed 15194370 / 15201879 / -0.0% 34730683 / 34681458 / +0.1% 0.44 / 0.44 / -0.2%
tpch_q12/datafusion:vortex-file-compressed 23446096 / 22345002 / +4.9% 45304067 / 47221935 / -4.1% 0.52 / 0.47 / +9.4%
tpch_q13/datafusion:vortex-file-compressed 20334957 / 20244203 / +0.4% 40989361 / 44122638 / -7.1% 0.50 / 0.46 / +8.1%
tpch_q14/datafusion:vortex-file-compressed 14731653 / 14855404 / -0.8% 40818310 / 41799489 / -2.3% 0.36 / 0.36 / +1.6%
tpch_q15/datafusion:vortex-file-compressed 18656472 / 18895395 / -1.3% 46294213 / 45631985 / +1.5% 0.40 / 0.41 / -2.7%
tpch_q16/datafusion:vortex-file-compressed 18577927 / 18704036 / -0.7% 38190580 / 38656634 / -1.2% 0.49 / 0.48 / +0.5%
tpch_q17/datafusion:vortex-file-compressed 28237590 / 28057860 / +0.6% 58303532 / 60223455 / -3.2% 0.48 / 0.47 / +4.0%
tpch_q18/datafusion:vortex-file-compressed 36375289 / 36871451 / -1.3% 58320384 / 59101037 / -1.3% 0.62 / 0.62 / -0.0%
tpch_q19/datafusion:vortex-file-compressed 13720135 / 13388103 / +2.5% 39343283 / 38869596 / +1.2% 0.35 / 0.34 / +1.2%
tpch_q20/datafusion:vortex-file-compressed 20853704 / 20868612 / -0.1% 45394483 / 46498355 / -2.4% 0.46 / 0.45 / +2.4%
tpch_q21/datafusion:vortex-file-compressed 39023200 / 38782640 / +0.6% 66551790 / 67108855 / -0.8% 0.59 / 0.58 / +1.5%
tpch_q22/datafusion:vortex-file-compressed 11226187 / 11309260 / -0.7% 32055034 / 32682456 / -1.9% 0.35 / 0.35 / +1.2%
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 17901804 / 17008161 / +5.3% 44304533 / 44987473 / -1.5% 0.40 / 0.38 / +6.9%
tpch_q02/datafusion:vortex-compact 19839768 / 19759522 / +0.4% 37309049 / 37566458 / -0.7% 0.53 / 0.53 / +1.1%
tpch_q03/datafusion:vortex-compact 20424824 / 20434696 / -0.0% 48086562 / 46541270 / +3.3% 0.42 / 0.44 / -3.3%
tpch_q04/datafusion:vortex-compact 11519228 / 11242161 / +2.5% 32776857 / 33214070 / -1.3% 0.35 / 0.34 / +3.8%
tpch_q05/datafusion:vortex-compact 37881427 / 38521795 / -1.7% 66712905 / 65843259 / +1.3% 0.57 / 0.59 / -2.9%
tpch_q06/datafusion:vortex-compact 6902775 / 7310909 / -5.6% 29386580 / 29563865 / -0.6% 0.23 / 0.25 / -5.0%
tpch_q07/datafusion:vortex-compact 52918553 / 52314175 / +1.2% 79640536 / 82435624 / -3.4% 0.66 / 0.63 / +4.7%
tpch_q08/datafusion:vortex-compact 52424011 / 53488920 / -2.0% 81004054 / 86007824 / -5.8% 0.65 / 0.62 / +4.1%
tpch_q09/datafusion:vortex-compact 53198750 / 51230981 / +3.8% 75854200 / 83369023 / -9.0% 0.70 / 0.61 / +14.1%
tpch_q10/datafusion:vortex-compact 18995660 / 19195415 / -1.0% 49123835 / 49544512 / -0.8% 0.39 / 0.39 / -0.2%
tpch_q11/datafusion:vortex-compact 16034018 / 16045442 / -0.1% 35859632 / 35273792 / +1.7% 0.45 / 0.45 / -1.7%
tpch_q12/datafusion:vortex-compact 24776216 / 23791838 / +4.1% 46182716 / 46534850 / -0.8% 0.54 / 0.51 / +4.9%
tpch_q13/datafusion:vortex-compact 20808093 / 21260444 / -2.1% 42756506 / 40792285 / +4.8% 0.49 / 0.52 / -6.6%
tpch_q14/datafusion:vortex-compact 16318334 / 16356323 / -0.2% 42788559 / 43077332 / -0.7% 0.38 / 0.38 / +0.4%
tpch_q15/datafusion:vortex-compact 19727869 / 20179780 / -2.2% 46613203 / 48424882 / -3.7% 0.42 / 0.42 / +1.6%
tpch_q16/datafusion:vortex-compact 18616427 / 19129413 / -2.7% 38762741 / 39621948 / -2.2% 0.48 / 0.48 / -0.5%
tpch_q17/datafusion:vortex-compact 28862090 / 28920728 / -0.2% 58638399 / 60126874 / -2.5% 0.49 / 0.48 / +2.3%
tpch_q18/datafusion:vortex-compact 37796163 / 38101318 / -0.8% 58202790 / 58920674 / -1.2% 0.65 / 0.65 / +0.4%
tpch_q19/datafusion:vortex-compact 16701143 / 16448391 / +1.5% 41966076 / 43647394 / -3.9% 0.40 / 0.38 / +5.6%
tpch_q20/datafusion:vortex-compact 21817420 / 21773541 / +0.2% 46398148 / 48489276 / -4.3% 0.47 / 0.45 / +4.7%
tpch_q21/datafusion:vortex-compact 42217170 / 42589869 / -0.9% 69433915 / 68282748 / +1.7% 0.61 / 0.62 / -2.5%
tpch_q22/datafusion:vortex-compact 11796938 / 11697154 / +0.9% 32068256 / 32729473 / -2.0% 0.37 / 0.36 / +2.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72489859 / 72223040 / +0.4% 90201140 / 92328060 / -2.3% 0.80 / 0.78 / +2.7%
tpch_q02/datafusion:parquet 56843055 / 58000695 / -2.0% 76736996 / 78946538 / -2.8% 0.74 / 0.73 / +0.8%
tpch_q03/datafusion:parquet 84443532 / 84516961 / -0.1% 108946982 / 112795029 / -3.4% 0.78 / 0.75 / +3.4%
tpch_q04/datafusion:parquet 46955950 / 46749326 / +0.4% 65326875 / 68174067 / -4.2% 0.72 / 0.69 / +4.8%
tpch_q05/datafusion:parquet 99714321 / 99412528 / +0.3% 130532231 / 130735693 / -0.2% 0.76 / 0.76 / +0.5%
tpch_q06/datafusion:parquet 32028775 / 31892277 / +0.4% 50958373 / 53610739 / -4.9% 0.63 / 0.59 / +5.7%
tpch_q07/datafusion:parquet 108248294 / 104746501 / +3.3% 136362734 / 133060441 / +2.5% 0.79 / 0.79 / +0.8%
tpch_q08/datafusion:parquet 113598044 / 114268751 / -0.6% 141295734 / 141651057 / -0.3% 0.80 / 0.81 / -0.3%
tpch_q09/datafusion:parquet 131303386 / 130807654 / +0.4% 161638588 / 164099492 / -1.5% 0.81 / 0.80 / +1.9%
tpch_q10/datafusion:parquet 103978731 / 104690136 / -0.7% 136115443 / 137291661 / -0.9% 0.76 / 0.76 / +0.2%
tpch_q11/datafusion:parquet 41682145 / 43027742 / -3.1% 65907831 / 66790042 / -1.3% 0.63 / 0.64 / -1.8%
tpch_q12/datafusion:parquet 69077380 / 69284103 / -0.3% 92164812 / 98791184 / -6.7% 0.75 / 0.70 / +6.9%
tpch_q13/datafusion:parquet 186589453 / 186594545 / -0.0% 209096816 / 213196087 / -1.9% 0.89 / 0.88 / +2.0%
tpch_q14/datafusion:parquet 47786245 / 47740099 / +0.1% 74735248 / 76248748 / -2.0% 0.64 / 0.63 / +2.1%
tpch_q15/datafusion:parquet 54668005 / 55527141 / -1.5% 78329840 / 79328574 / -1.3% 0.70 / 0.70 / -0.3%
tpch_q16/datafusion:parquet 40881001 / 41360248 / -1.2% 61221370 / 60878951 / +0.6% 0.67 / 0.68 / -1.7%
tpch_q17/datafusion:parquet 129167893 / 129472201 / -0.2% 153715754 / 154772431 / -0.7% 0.84 / 0.84 / +0.5%
tpch_q18/datafusion:parquet 130742943 / 131542391 / -0.6% 151299130 / 153340994 / -1.3% 0.86 / 0.86 / +0.7%
tpch_q19/datafusion:parquet 59084791 / 59627536 / -0.9% 86044116 / 89223848 / -3.6% 0.69 / 0.67 / +2.8%
tpch_q20/datafusion:parquet 67554147 / 66470710 / +1.6% 92937927 / 96927295 / -4.1% 0.73 / 0.69 / +6.0%
tpch_q21/datafusion:parquet 106854905 / 108188677 / -1.2% 132400265 / 134057412 / -1.2% 0.81 / 0.81 / +0.0%
tpch_q22/datafusion:parquet 47704709 / 48297929 / -1.2% 65014011 / 68649455 / -5.3% 0.73 / 0.70 / +4.3%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10007444 / 10770809 / -7.1% 19206761 / 19963617 / -3.8% 0.52 / 0.54 / -3.4%
tpch_q02/duckdb:vortex-file-compressed 17174837 / 17210209 / -0.2% 27149362 / 25548904 / +6.3% 0.63 / 0.67 / -6.1%
tpch_q03/duckdb:vortex-file-compressed 18145158 / 17870734 / +1.5% 37205122 / 36988529 / +0.6% 0.49 / 0.48 / +0.9%
tpch_q04/duckdb:vortex-file-compressed 17580116 / 16875159 / +4.2% 28892076 / 32325366 / -10.6% 🟢 0.61 / 0.52 / +16.6%
tpch_q05/duckdb:vortex-file-compressed 21971254 / 22018187 / -0.2% 35921503 / 36188324 / -0.7% 0.61 / 0.61 / +0.5%
tpch_q06/duckdb:vortex-file-compressed 5852188 / 5667198 / +3.3% 16214498 / 14338877 / +13.1% 🔴 0.36 / 0.40 / -8.7%
tpch_q07/duckdb:vortex-file-compressed 20385116 / 20524555 / -0.7% 36121551 / 39310572 / -8.1% 0.56 / 0.52 / +8.1%
tpch_q08/duckdb:vortex-file-compressed 23716161 / 23415821 / +1.3% 40248971 / 39661701 / +1.5% 0.59 / 0.59 / -0.2%
tpch_q09/duckdb:vortex-file-compressed 28648846 / 30050701 / -4.7% 49936062 / 49906765 / +0.1% 0.57 / 0.60 / -4.7%
tpch_q10/duckdb:vortex-file-compressed 27621345 / 28771520 / -4.0% 44314176 / 48020499 / -7.7% 0.62 / 0.60 / +4.0%
tpch_q11/duckdb:vortex-file-compressed 8819703 / 8625590 / +2.3% 13900170 / 15559478 / -10.7% 🟢 0.63 / 0.55 / +14.5%
tpch_q12/duckdb:vortex-file-compressed 16754750 / 16127724 / +3.9% 34119324 / 31767187 / +7.4% 0.49 / 0.51 / -3.3%
tpch_q13/duckdb:vortex-file-compressed 21282039 / 21755193 / -2.2% 42837178 / 40532897 / +5.7% 0.50 / 0.54 / -7.4%
tpch_q14/duckdb:vortex-file-compressed 13746657 / 12681103 / +8.4% 24141541 / 23850678 / +1.2% 0.57 / 0.53 / +7.1%
tpch_q15/duckdb:vortex-file-compressed 10016970 / 9881015 / +1.4% 19133749 / 20385913 / -6.1% 0.52 / 0.48 / +8.0%
tpch_q16/duckdb:vortex-file-compressed 18851825 / 18552847 / +1.6% 23762226 / 24420524 / -2.7% 0.79 / 0.76 / +4.4%
tpch_q17/duckdb:vortex-file-compressed 15289307 / 15235861 / +0.4% 30809007 / 33477096 / -8.0% 0.50 / 0.46 / +9.0%
tpch_q18/duckdb:vortex-file-compressed 25163193 / 24903671 / +1.0% 33808705 / 36156522 / -6.5% 0.74 / 0.69 / +8.1%
tpch_q19/duckdb:vortex-file-compressed 22675393 / 24113130 / -6.0% 35606570 / 35328012 / +0.8% 0.64 / 0.68 / -6.7%
tpch_q20/duckdb:vortex-file-compressed 17129335 / 17330731 / -1.2% 33529967 / 33980032 / -1.3% 0.51 / 0.51 / +0.2%
tpch_q21/duckdb:vortex-file-compressed 65928587 / 65198129 / +1.1% 79921344 / 79182913 / +0.9% 0.82 / 0.82 / +0.2%
tpch_q22/duckdb:vortex-file-compressed 12149433 / 12243374 / -0.8% 21577438 / 20832502 / +3.6% 0.56 / 0.59 / -4.2%
duckdb / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 14606319 / 14045503 / +4.0% 21952214 / 21388584 / +2.6% 0.67 / 0.66 / +1.3%
tpch_q02/duckdb:vortex-compact 19841268 / 19941438 / -0.5% 27155547 / 28740416 / -5.5% 0.73 / 0.69 / +5.3%
tpch_q03/duckdb:vortex-compact 19017594 / 19826856 / -4.1% 34440270 / 37788196 / -8.9% 0.55 / 0.52 / +5.2%
tpch_q04/duckdb:vortex-compact 18261407 / 18625985 / -2.0% 31154957 / 30968617 / +0.6% 0.59 / 0.60 / -2.5%
tpch_q05/duckdb:vortex-compact 24206058 / 22995668 / +5.3% 35058705 / 39924028 / -12.2% 🟢 0.69 / 0.58 / +19.9%
tpch_q06/duckdb:vortex-compact 6053923 / 6058716 / -0.1% 14836560 / 16113298 / -7.9% 0.41 / 0.38 / +8.5%
tpch_q07/duckdb:vortex-compact 21919203 / 21509827 / +1.9% 38112137 / 37875982 / +0.6% 0.58 / 0.57 / +1.3%
tpch_q08/duckdb:vortex-compact 25478335 / 26520969 / -3.9% 40601921 / 41458684 / -2.1% 0.63 / 0.64 / -1.9%
tpch_q09/duckdb:vortex-compact 30757478 / 31134004 / -1.2% 49631504 / 52215266 / -4.9% 0.62 / 0.60 / +3.9%
tpch_q10/duckdb:vortex-compact 29959689 / 29663530 / +1.0% 47298895 / 48069099 / -1.6% 0.63 / 0.62 / +2.6%
tpch_q11/duckdb:vortex-compact 9838130 / 10000540 / -1.6% 15381506 / 18634336 / -17.5% 🟢 0.64 / 0.54 / +19.2%
tpch_q12/duckdb:vortex-compact 17835706 / 18591118 / -4.1% 31460469 / 34645653 / -9.2% 0.57 / 0.54 / +5.6%
tpch_q13/duckdb:vortex-compact 22747156 / 22414452 / +1.5% 42966247 / 37429172 / +14.8% 🔴 0.53 / 0.60 / -11.6%
tpch_q14/duckdb:vortex-compact 14532111 / 14314608 / +1.5% 27900904 / 27747524 / +0.6% 0.52 / 0.52 / +1.0%
tpch_q15/duckdb:vortex-compact 10061016 / 10493529 / -4.1% 21826662 / 22172816 / -1.6% 0.46 / 0.47 / -2.6%
tpch_q16/duckdb:vortex-compact 20497826 / 19953524 / +2.7% 26756593 / 24678071 / +8.4% 0.77 / 0.81 / -5.3%
tpch_q17/duckdb:vortex-compact 16217190 / 16233395 / -0.1% 33210097 / 33209426 / +0.0% 0.49 / 0.49 / -0.1%
tpch_q18/duckdb:vortex-compact 26049514 / 26506424 / -1.7% 34244940 / 35747194 / -4.2% 0.76 / 0.74 / +2.6%
tpch_q19/duckdb:vortex-compact 25425969 / 24163239 / +5.2% 34846393 / 36673851 / -5.0% 0.73 / 0.66 / +10.7%
tpch_q20/duckdb:vortex-compact 18722055 / 19211914 / -2.5% 34867871 / 35462644 / -1.7% 0.54 / 0.54 / -0.9%
tpch_q21/duckdb:vortex-compact 69217334 / 71023072 / -2.5% 84063091 / 85240439 / -1.4% 0.82 / 0.83 / -1.2%
tpch_q22/duckdb:vortex-compact 12854519 / 12923827 / -0.5% 21104111 / 20963093 / +0.7% 0.61 / 0.62 / -1.2%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 62760032 / 62827861 / -0.1% 68826110 / 69387056 / -0.8% 0.91 / 0.91 / +0.7%
tpch_q02/duckdb:parquet 37289032 / 37515513 / -0.6% 45830205 / 45077258 / +1.7% 0.81 / 0.83 / -2.2%
tpch_q03/duckdb:parquet 67445817 / 67316106 / +0.2% 78407412 / 77317836 / +1.4% 0.86 / 0.87 / -1.2%
tpch_q04/duckdb:parquet 46432707 / 46547973 / -0.2% 57989192 / 55543665 / +4.4% 0.80 / 0.84 / -4.5%
tpch_q05/duckdb:parquet 65779573 / 65697914 / +0.1% 75854514 / 76768176 / -1.2% 0.87 / 0.86 / +1.3%
tpch_q06/duckdb:parquet 21693407 / 21892279 / -0.9% 26522024 / 26992238 / -1.7% 0.82 / 0.81 / +0.8%
tpch_q07/duckdb:parquet 64882220 / 65215120 / -0.5% 74628761 / 76541173 / -2.5% 0.87 / 0.85 / +2.0%
tpch_q08/duckdb:parquet 79436756 / 79968857 / -0.7% 91670015 / 92404960 / -0.8% 0.87 / 0.87 / +0.1%
tpch_q09/duckdb:parquet 119146979 / 119829451 / -0.6% 133417277 / 133370931 / +0.0% 0.89 / 0.90 / -0.6%
tpch_q10/duckdb:parquet 118741710 / 119590753 / -0.7% 130361153 / 131830601 / -1.1% 0.91 / 0.91 / +0.4%
tpch_q11/duckdb:parquet 21335184 / 21273378 / +0.3% 25817000 / 25044779 / +3.1% 0.83 / 0.85 / -2.7%
tpch_q12/duckdb:parquet 44280627 / 44263030 / +0.0% 51440652 / 51640432 / -0.4% 0.86 / 0.86 / +0.4%
tpch_q13/duckdb:parquet 242728789 / 243455196 / -0.3% 253592247 / 252326151 / +0.5% 0.96 / 0.96 / -0.8%
tpch_q14/duckdb:parquet 46942048 / 47348799 / -0.9% 54911742 / 55857895 / -1.7% 0.85 / 0.85 / +0.8%
tpch_q15/duckdb:parquet 26594528 / 27105435 / -1.9% 32870356 / 34056964 / -3.5% 0.81 / 0.80 / +1.7%
tpch_q16/duckdb:parquet 50890925 / 51108913 / -0.4% 58375995 / 58137369 / +0.4% 0.87 / 0.88 / -0.8%
tpch_q17/duckdb:parquet 48776587 / 48877866 / -0.2% 58188676 / 58403394 / -0.4% 0.84 / 0.84 / +0.2%
tpch_q18/duckdb:parquet 95330950 / 94996286 / +0.4% 104099403 / 104454114 / -0.3% 0.92 / 0.91 / +0.7%
tpch_q19/duckdb:parquet 64566762 / 64830798 / -0.4% 74744778 / 74660099 / +0.1% 0.86 / 0.87 / -0.5%
tpch_q20/duckdb:parquet 61495905 / 61486588 / +0.0% 79493046 / 74062589 / +7.3% 0.77 / 0.83 / -6.8%
tpch_q21/duckdb:parquet 141722596 / 142072707 / -0.2% 152316291 / 152665983 / -0.2% 0.93 / 0.93 / -0.0%
tpch_q22/duckdb:parquet 51487835 / 51299832 / +0.4% 58538588 / 58423718 / +0.2% 0.88 / 0.88 / +0.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-2.7%, environment too noisy confidence)
Vortex (geomean): hot 1.013x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.030x ➖ · cold 1.019x ➖
Shifts: Parquet (control) +3.0% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 172182752 / 201928827 / -14.7% 🟢 651937890 / 550851169 / +18.4% 🔴 0.26 / 0.37 / -28.0%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11924696 / 10738495 / +11.0% 🔴 48213136 / 49657079 / -2.9% 0.25 / 0.22 / +14.4%
clickbench-sorted_q26/datafusion:vortex-file-compressed 12833634 / 12175350 / +5.4% 49133885 / 50559420 / -2.8% 0.26 / 0.24 / +8.5%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22600109 / 23149992 / -2.4% 70521612 / 71530975 / -1.4% 0.32 / 0.32 / -1.0%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18430681 / 18472054 / -0.2% 56353297 / 60433906 / -6.8% 0.33 / 0.31 / +7.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17743458 / 17106190 / +3.7% 61766752 / 62238480 / -0.8% 0.29 / 0.27 / +4.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41382262 / 40755246 / +1.5% 94360957 / 96517179 / -2.2% 0.44 / 0.42 / +3.9%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12060352 / 12332630 / -2.2% 47687339 / 48735003 / -2.1% 0.25 / 0.25 / -0.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11798537 / 12208535 / -3.4% 46650485 / 46371080 / +0.6% 0.25 / 0.26 / -3.9%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9988518 / 9728312 / +2.7% 37575063 / 36431216 / +3.1% 0.27 / 0.27 / -0.5%
datafusion / vortex-compact / ns (1.013x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 225611980 / 205104731 / +10.0% 422095674 / 466634904 / -9.5% 0.53 / 0.44 / +21.6%
clickbench-sorted_q24/datafusion:vortex-compact 21583499 / 24025730 / -10.2% 🟢 53418431 / 53682084 / -0.5% 0.40 / 0.45 / -9.7%
clickbench-sorted_q26/datafusion:vortex-compact 23167754 / 22316996 / +3.8% 54088643 / 53092206 / +1.9% 0.43 / 0.42 / +1.9%
clickbench-sorted_q36/datafusion:vortex-compact 26863918 / 25929639 / +3.6% 70618116 / 73673212 / -4.1% 0.38 / 0.35 / +8.1%
clickbench-sorted_q37/datafusion:vortex-compact 22621768 / 22578440 / +0.2% 69467934 / 69796258 / -0.5% 0.33 / 0.32 / +0.7%
clickbench-sorted_q38/datafusion:vortex-compact 21048131 / 21277460 / -1.1% 65474645 / 69039956 / -5.2% 0.32 / 0.31 / +4.3%
clickbench-sorted_q39/datafusion:vortex-compact 44038022 / 43043502 / +2.3% 86258398 / 90054890 / -4.2% 0.51 / 0.48 / +6.8%
clickbench-sorted_q40/datafusion:vortex-compact 14823784 / 13885480 / +6.8% 43888993 / 46018004 / -4.6% 0.34 / 0.30 / +11.9%
clickbench-sorted_q41/datafusion:vortex-compact 14301266 / 14119378 / +1.3% 47671005 / 48503308 / -1.7% 0.30 / 0.29 / +3.1%
clickbench-sorted_q42/datafusion:vortex-compact 10937521 / 11167538 / -2.1% 39643487 / 35586532 / +11.4% 🔴 0.28 / 0.31 / -12.1%
datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 766405806 / 760174144 / +0.8% 971891172 / 983855120 / -1.2% 0.79 / 0.77 / +2.1%
clickbench-sorted_q24/datafusion:parquet 9432902 / 9140916 / +3.2% 73984977 / 75255978 / -1.7% 0.13 / 0.12 / +5.0%
clickbench-sorted_q26/datafusion:parquet 9273813 / 8876915 / +4.5% 72947133 / 72923574 / +0.0% 0.13 / 0.12 / +4.4%
clickbench-sorted_q36/datafusion:parquet 93958524 / 93750310 / +0.2% 171024044 / 170148144 / +0.5% 0.55 / 0.55 / -0.3%
clickbench-sorted_q37/datafusion:parquet 64274510 / 64244966 / +0.0% 131188028 / 132990015 / -1.4% 0.49 / 0.48 / +1.4%
clickbench-sorted_q38/datafusion:parquet 88053696 / 87057888 / +1.1% 163319043 / 169155377 / -3.5% 0.54 / 0.51 / +4.8%
clickbench-sorted_q39/datafusion:parquet 160211638 / 160085022 / +0.1% 237799202 / 240136777 / -1.0% 0.67 / 0.67 / +1.1%
clickbench-sorted_q40/datafusion:parquet 44820874 / 44061744 / +1.7% 114961563 / 119965049 / -4.2% 0.39 / 0.37 / +6.2%
clickbench-sorted_q41/datafusion:parquet 42127148 / 42182672 / -0.1% 112858643 / 112826762 / +0.0% 0.37 / 0.37 / -0.2%
clickbench-sorted_q42/datafusion:parquet 26390840 / 26414566 / -0.1% 87391924 / 88199637 / -0.9% 0.30 / 0.30 / +0.8%
duckdb / vortex-file-compressed / ns (1.062x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 56559736 / 61571192 / -8.1% 89775818 / 86926735 / +3.3% 0.63 / 0.71 / -11.1%
clickbench-sorted_q24/duckdb:vortex-file-compressed 23372052 / 20988692 / +11.4% 🔴 34235810 / 34093899 / +0.4% 0.68 / 0.62 / +10.9%
clickbench-sorted_q26/duckdb:vortex-file-compressed 18190392 / 13873883 / +31.1% 🔴 26836624 / 31491654 / -14.8% 🟢 0.68 / 0.44 / +53.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29983160 / 29111052 / +3.0% 60997165 / 60426436 / +0.9% 0.49 / 0.48 / +2.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 24796608 / 24001778 / +3.3% 52133802 / 55026515 / -5.3% 0.48 / 0.44 / +9.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25600314 / 26527986 / -3.5% 58267544 / 58222621 / +0.1% 0.44 / 0.46 / -3.6%
clickbench-sorted_q39/duckdb:vortex-file-compressed 47271092 / 47726702 / -1.0% 99964029 / 99584952 / +0.4% 0.47 / 0.48 / -1.3%
clickbench-sorted_q40/duckdb:vortex-file-compressed 17283628 / 15185135 / +13.8% 🔴 38951047 / 38708288 / +0.6% 0.44 / 0.39 / +13.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 16178247 / 14923676 / +8.4% 38525043 / 40951838 / -5.9% 0.42 / 0.36 / +15.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12537668 / 11613016 / +8.0% 33105231 / 29680297 / +11.5% 🔴 0.38 / 0.39 / -3.2%
duckdb / vortex-compact / ns (0.979x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 66272122 / 65885698 / +0.6% 95627748 / 82248825 / +16.3% 🔴 0.69 / 0.80 / -13.5%
clickbench-sorted_q24/duckdb:vortex-compact 22199480 / 24529304 / -9.5% 30926768 / 31968716 / -3.3% 0.72 / 0.77 / -6.4%
clickbench-sorted_q26/duckdb:vortex-compact 17526462 / 19284014 / -9.1% 30850857 / 30582570 / +0.9% 0.57 / 0.63 / -9.9%
clickbench-sorted_q36/duckdb:vortex-compact 33027666 / 34499888 / -4.3% 71205444 / 68740037 / +3.6% 0.46 / 0.50 / -7.6%
clickbench-sorted_q37/duckdb:vortex-compact 29408202 / 28872820 / +1.9% 65312096 / 62350839 / +4.7% 0.45 / 0.46 / -2.8%
clickbench-sorted_q38/duckdb:vortex-compact 30495370 / 29541673 / +3.2% 65638216 / 63804296 / +2.9% 0.46 / 0.46 / +0.3%
clickbench-sorted_q39/duckdb:vortex-compact 61795318 / 59239287 / +4.3% 103092208 / 102967615 / +0.1% 0.60 / 0.58 / +4.2%
clickbench-sorted_q40/duckdb:vortex-compact 17235540 / 19100335 / -9.8% 40682415 / 38944101 / +4.5% 0.42 / 0.49 / -13.6%
clickbench-sorted_q41/duckdb:vortex-compact 17224530 / 17024018 / +1.2% 40281848 / 41764264 / -3.5% 0.43 / 0.41 / +4.9%
clickbench-sorted_q42/duckdb:vortex-compact 13414222 / 13136054 / +2.1% 30226145 / 29532495 / +2.3% 0.44 / 0.44 / -0.2%
duckdb / parquet / ns (1.048x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 130475088 / 126335540 / +3.3% 153995936 / 139917174 / +10.1% 🔴 0.85 / 0.90 / -6.2%
clickbench-sorted_q24/duckdb:parquet 17577778 / 17714570 / -0.8% 27851726 / 25979188 / +7.2% 0.63 / 0.68 / -7.4%
clickbench-sorted_q26/duckdb:parquet 13097015 / 12088770 / +8.3% 22472104 / 22869175 / -1.7% 0.58 / 0.53 / +10.3%
clickbench-sorted_q36/duckdb:parquet 44786218 / 43782577 / +2.3% 65865249 / 62631817 / +5.2% 0.68 / 0.70 / -2.7%
clickbench-sorted_q37/duckdb:parquet 31026362 / 30897442 / +0.4% 52154706 / 49229397 / +5.9% 0.59 / 0.63 / -5.2%
clickbench-sorted_q38/duckdb:parquet 38797436 / 40925419 / -5.2% 63051993 / 56122426 / +12.3% 🔴 0.62 / 0.73 / -15.6%
clickbench-sorted_q39/duckdb:parquet 78597366 / 70292364 / +11.8% 🔴 94775254 / 83232029 / +13.9% 🔴 0.83 / 0.84 / -1.8%
clickbench-sorted_q40/duckdb:parquet 17225866 / 16667730 / +3.3% 46192407 / 44967022 / +2.7% 0.37 / 0.37 / +0.6%
clickbench-sorted_q41/duckdb:parquet 19267860 / 16588458 / +16.2% 🔴 43522112 / 45162700 / -3.6% 0.44 / 0.37 / +20.5%
clickbench-sorted_q42/duckdb:parquet 11566224 / 10501936 / +10.1% 🔴 24062288 / 23515580 / +2.3% 0.48 / 0.45 / +7.6%

File Size Changes (200 files changed, +0.0% overall, 103↑ 97↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 189.14 MB 192.98 MB +3.84 MB +2.0%
hits_001.vortex 1.0 vortex-compact 137.71 MB 140.24 MB +2.52 MB +1.8%
hits_061.vortex 1.0 vortex-compact 123.44 MB 124.88 MB +1.44 MB +1.2%
hits_060.vortex 1.0 vortex-file-compressed 192.74 MB 194.80 MB +2.06 MB +1.1%
hits_038.vortex 1.0 vortex-file-compressed 189.87 MB 191.80 MB +1.93 MB +1.0%
hits_002.vortex 1.0 vortex-compact 123.81 MB 125.01 MB +1.20 MB +1.0%
hits_065.vortex 1.0 vortex-compact 124.12 MB 125.30 MB +1.18 MB +0.9%
hits_097.vortex 1.0 vortex-file-compressed 192.64 MB 194.35 MB +1.71 MB +0.9%
hits_050.vortex 1.0 vortex-file-compressed 160.35 MB 161.77 MB +1.42 MB +0.9%
hits_053.vortex 1.0 vortex-file-compressed 189.54 MB 191.07 MB +1.53 MB +0.8%
hits_055.vortex 1.0 vortex-file-compressed 199.20 MB 200.62 MB +1.42 MB +0.7%
hits_011.vortex 1.0 vortex-file-compressed 198.95 MB 200.31 MB +1.36 MB +0.7%
hits_081.vortex 1.0 vortex-compact 152.76 MB 153.77 MB +1.02 MB +0.7%
hits_023.vortex 1.0 vortex-compact 141.72 MB 142.63 MB +928.77 KB +0.6%
hits_063.vortex 1.0 vortex-compact 98.15 MB 98.77 MB +629.01 KB +0.6%
hits_026.vortex 1.0 vortex-compact 97.91 MB 98.52 MB +622.26 KB +0.6%
hits_060.vortex 1.0 vortex-compact 140.19 MB 141.05 MB +887.98 KB +0.6%
hits_034.vortex 1.0 vortex-compact 132.35 MB 133.14 MB +810.77 KB +0.6%
hits_016.vortex 1.0 vortex-compact 126.60 MB 127.35 MB +774.84 KB +0.6%
hits_022.vortex 1.0 vortex-compact 152.31 MB 153.13 MB +845.38 KB +0.5%
hits_000.vortex 1.0 vortex-compact 98.69 MB 99.18 MB +511.79 KB +0.5%
hits_033.vortex 1.0 vortex-file-compressed 200.21 MB 201.14 MB +956.75 KB +0.5%
hits_067.vortex 1.0 vortex-compact 97.87 MB 98.31 MB +456.81 KB +0.5%
hits_088.vortex 1.0 vortex-compact 133.73 MB 134.34 MB +618.57 KB +0.5%
hits_078.vortex 1.0 vortex-compact 97.70 MB 98.12 MB +430.34 KB +0.4%
hits_041.vortex 1.0 vortex-compact 98.08 MB 98.50 MB +426.40 KB +0.4%
hits_092.vortex 1.0 vortex-compact 153.00 MB 153.52 MB +537.28 KB +0.3%
hits_021.vortex 1.0 vortex-compact 110.59 MB 110.96 MB +376.83 KB +0.3%
hits_059.vortex 1.0 vortex-compact 152.48 MB 152.97 MB +505.05 KB +0.3%
hits_031.vortex 1.0 vortex-compact 111.12 MB 111.40 MB +288.95 KB +0.3%
hits_030.vortex 1.0 vortex-compact 98.37 MB 98.60 MB +233.66 KB +0.2%
hits_099.vortex 1.0 vortex-compact 133.13 MB 133.44 MB +312.36 KB +0.2%
hits_080.vortex 1.0 vortex-compact 96.70 MB 96.92 MB +215.71 KB +0.2%
hits_004.vortex 1.0 vortex-compact 97.85 MB 98.06 MB +216.17 KB +0.2%
hits_015.vortex 1.0 vortex-compact 98.20 MB 98.41 MB +213.27 KB +0.2%
hits_064.vortex 1.0 vortex-file-compressed 190.38 MB 190.76 MB +390.70 KB +0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.43 MB 190.80 MB +371.42 KB +0.2%
hits_043.vortex 1.0 vortex-compact 94.16 MB 94.33 MB +169.12 KB +0.2%
hits_007.vortex 1.0 vortex-compact 153.54 MB 153.77 MB +242.42 KB +0.2%
hits_069.vortex 1.0 vortex-compact 99.70 MB 99.86 MB +156.62 KB +0.2%
hits_046.vortex 1.0 vortex-compact 74.89 MB 75.00 MB +117.61 KB +0.2%
hits_034.vortex 1.0 vortex-file-compressed 181.75 MB 182.02 MB +267.73 KB +0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.45 MB 130.63 MB +186.60 KB +0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.33 MB 158.55 MB +225.48 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 134.92 MB 135.10 MB +183.56 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 139.96 MB 140.13 MB +175.45 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.56 MB 199.81 MB +249.15 KB +0.1%
hits_014.vortex 1.0 vortex-compact 133.72 MB 133.88 MB +162.44 KB +0.1%
hits_071.vortex 1.0 vortex-compact 105.56 MB 105.68 MB +126.13 KB +0.1%
hits_025.vortex 1.0 vortex-compact 133.43 MB 133.57 MB +150.23 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.12 MB 202.34 MB +225.98 KB +0.1%
hits_044.vortex 1.0 vortex-compact 153.47 MB 153.63 MB +167.62 KB +0.1%
hits_071.vortex 1.0 vortex-file-compressed 139.92 MB 140.06 MB +149.37 KB +0.1%
hits_073.vortex 1.0 vortex-compact 134.09 MB 134.23 MB +141.17 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.29 MB 130.37 MB +89.05 KB +0.1%
hits_079.vortex 1.0 vortex-compact 127.80 MB 127.88 MB +86.34 KB +0.1%
hits_066.vortex 1.0 vortex-compact 117.56 MB 117.64 MB +75.86 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.68 MB 153.78 MB +97.49 KB +0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.07 MB 131.15 MB +80.62 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.76 MB 142.84 MB +85.02 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.07 MB 130.15 MB +75.95 KB +0.1%
hits_003.vortex 1.0 vortex-compact 104.58 MB 104.64 MB +59.55 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.66 MB 191.76 MB +108.47 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.98 MB 127.05 MB +66.33 KB +0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.82 MB 159.90 MB +82.14 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.17 MB 139.24 MB +69.56 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.35 MB 172.44 MB +85.84 KB +0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.20 MB 130.26 MB +63.52 KB +0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.24 MB +32.23 KB +0.0%
hits_056.vortex 1.0 vortex-compact 100.76 MB 100.81 MB +42.63 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.96 MB 154.03 MB +64.11 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.17 MB 147.23 MB +59.15 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 200.15 MB 200.22 MB +79.95 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.51 MB 136.56 MB +48.34 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.46 MB 110.49 MB +38.88 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 152.07 MB 152.12 MB +49.54 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.23 MB 130.27 MB +41.97 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.78 MB 130.82 MB +41.27 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.92 MB 75.94 MB +23.67 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.49 MB 161.54 MB +48.97 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 201.30 MB 201.35 MB +56.68 KB +0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.25 MB 147.29 MB +41.18 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.70 MB 189.75 MB +51.55 KB +0.0%
hits_090.vortex 1.0 vortex-compact 140.95 MB 140.98 MB +37.98 KB +0.0%
hits_049.vortex 1.0 vortex-compact 139.26 MB 139.29 MB +36.72 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.64 MB 110.67 MB +27.59 KB +0.0%
hits_017.vortex 1.0 vortex-compact 111.78 MB 111.80 MB +20.09 KB +0.0%
hits_029.vortex 1.0 vortex-compact 153.36 MB 153.38 MB +24.80 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.32 MB 161.34 MB +23.04 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 200.97 MB 200.99 MB +26.98 KB +0.0%
hits_008.vortex 1.0 vortex-compact 105.63 MB 105.65 MB +13.54 KB +0.0%
hits_051.vortex 1.0 vortex-compact 133.98 MB 133.99 MB +15.49 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.04 MB 111.06 MB +12.28 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.67 MB 126.68 MB +12.89 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.63 MB 105.64 MB +9.15 KB +0.0%
hits_038.vortex 1.0 vortex-compact 139.28 MB 139.29 MB +10.22 KB +0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.89 MB 101.90 MB +7.10 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.60 MB 110.61 MB +5.77 KB +0.0%
hits_074.vortex 1.0 vortex-compact 153.17 MB 153.18 MB +6.24 KB +0.0%
hits_040.vortex 1.0 vortex-file-compressed 143.99 MB 144.00 MB +5.35 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 200.96 MB 200.97 MB +6.74 KB +0.0%
hits_085.vortex 1.0 vortex-compact 153.48 MB 153.49 MB +5.09 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.61 MB 75.62 MB +1.26 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.89 MB 153.89 MB 1.76 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.12 MB 160.12 MB 2.83 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.95 MB 172.94 MB 8.64 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.88 MB 153.87 MB 7.70 KB -0.0%
hits_013.vortex 1.0 vortex-compact 123.93 MB 123.92 MB 6.37 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.83 MB 130.82 MB 6.73 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.41 MB 139.40 MB 8.06 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.23 MB 156.22 MB 9.86 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.95 MB 200.94 MB 12.96 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.57 MB 126.56 MB 11.31 KB -0.0%
hits_059.vortex 1.0 vortex-file-compressed 200.23 MB 200.21 MB 21.27 KB -0.0%
hits_018.vortex 1.0 vortex-compact 153.71 MB 153.70 MB 18.05 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.90 MB 130.88 MB 15.90 KB -0.0%
hits_094.vortex 1.0 vortex-compact 110.73 MB 110.71 MB 16.37 KB -0.0%
hits_020.vortex 1.0 vortex-compact 111.66 MB 111.64 MB 19.01 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.60 MB 110.58 MB 20.37 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.71 MB 161.68 MB 30.55 KB -0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.53 MB 154.50 MB 29.98 KB -0.0%
hits_040.vortex 1.0 vortex-compact 110.06 MB 110.04 MB 22.05 KB -0.0%
hits_064.vortex 1.0 vortex-compact 138.78 MB 138.75 MB 32.34 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.05 MB 173.01 MB 43.95 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.72 MB 179.67 MB 47.09 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.67 MB 130.63 MB 41.17 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.94 MB 194.88 MB 62.92 KB -0.0%
hits_020.vortex 1.0 vortex-file-compressed 160.01 MB 159.96 MB 52.33 KB -0.0%
hits_096.vortex 1.0 vortex-file-compressed 200.45 MB 200.38 MB 75.45 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.41 MB 147.35 MB 60.65 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.98 MB 168.91 MB 70.37 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.24 MB 136.19 MB 56.91 KB -0.0%
hits_096.vortex 1.0 vortex-compact 153.25 MB 153.19 MB 64.54 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.79 MB 180.71 MB 77.95 KB -0.0%
hits_005.vortex 1.0 vortex-compact 115.86 MB 115.81 MB 50.81 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.04 MB 105.99 MB 47.96 KB -0.0%
hits_053.vortex 1.0 vortex-compact 138.24 MB 138.17 MB 63.37 KB -0.0%
hits_045.vortex 1.0 vortex-compact 105.67 MB 105.62 MB 49.69 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.30 MB 102.25 MB 48.81 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.76 MB 161.68 MB 78.08 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.90 MB 200.81 MB 100.19 KB -0.0%
hits_036.vortex 1.0 vortex-compact 133.59 MB 133.52 MB 69.23 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.27 MB 161.19 MB 86.52 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.47 MB 160.37 MB 92.55 KB -0.1%
hits_011.vortex 1.0 vortex-compact 153.00 MB 152.90 MB 104.26 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 200.30 MB 200.17 MB 137.45 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.84 MB 137.75 MB 96.10 KB -0.1%
hits_033.vortex 1.0 vortex-compact 153.63 MB 153.52 MB 110.38 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 200.77 MB 200.62 MB 147.96 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.77 MB 130.67 MB 96.86 KB -0.1%
hits_066.vortex 1.0 vortex-file-compressed 163.00 MB 162.88 MB 125.80 KB -0.1%
hits_012.vortex 1.0 vortex-compact 138.82 MB 138.71 MB 109.21 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.72 MB 100.63 MB 93.52 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.40 MB 167.23 MB 167.45 KB -0.1%
hits_054.vortex 1.0 vortex-compact 111.78 MB 111.67 MB 112.41 KB -0.1%
hits_027.vortex 1.0 vortex-compact 138.06 MB 137.92 MB 143.86 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.13 MB 101.03 MB 107.77 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.87 MB 132.72 MB 153.16 KB -0.1%
hits_068.vortex 1.0 vortex-compact 112.07 MB 111.94 MB 129.64 KB -0.1%
hits_083.vortex 1.0 vortex-compact 110.17 MB 110.04 MB 132.95 KB -0.1%
hits_077.vortex 1.0 vortex-compact 134.30 MB 134.13 MB 172.54 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 162.01 MB 161.81 MB 210.52 KB -0.1%
hits_048.vortex 1.0 vortex-compact 153.55 MB 153.35 MB 209.55 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 172.00 MB 171.77 MB 239.48 KB -0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.84 MB 161.61 MB 234.50 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.80 MB 172.55 MB 252.74 KB -0.1%
hits_010.vortex 1.0 vortex-compact 123.36 MB 123.17 MB 199.41 KB -0.2%
hits_037.vortex 1.0 vortex-file-compressed 178.31 MB 178.01 MB 308.60 KB -0.2%
hits_089.vortex 1.0 vortex-compact 98.58 MB 98.41 MB 171.50 KB -0.2%
hits_093.vortex 1.0 vortex-file-compressed 131.03 MB 130.80 MB 237.88 KB -0.2%
hits_052.vortex 1.0 vortex-compact 97.80 MB 97.62 MB 183.96 KB -0.2%
hits_090.vortex 1.0 vortex-file-compressed 192.60 MB 192.24 MB 362.32 KB -0.2%
hits_028.vortex 1.0 vortex-compact 115.42 MB 115.20 MB 217.81 KB -0.2%
hits_057.vortex 1.0 vortex-compact 111.63 MB 111.36 MB 279.37 KB -0.2%
hits_036.vortex 1.0 vortex-file-compressed 172.32 MB 171.87 MB 453.77 KB -0.3%
hits_051.vortex 1.0 vortex-file-compressed 173.48 MB 173.00 MB 492.87 KB -0.3%
hits_031.vortex 1.0 vortex-file-compressed 159.59 MB 159.13 MB 471.32 KB -0.3%
hits_062.vortex 1.0 vortex-file-compressed 171.88 MB 171.34 MB 550.84 KB -0.3%
hits_095.vortex 1.0 vortex-file-compressed 154.35 MB 153.85 MB 511.37 KB -0.3%
hits_037.vortex 1.0 vortex-compact 132.66 MB 132.19 MB 478.37 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 140.20 MB 139.62 MB 589.09 KB -0.4%
hits_050.vortex 1.0 vortex-compact 125.54 MB 125.01 MB 542.98 KB -0.4%
hits_014.vortex 1.0 vortex-file-compressed 173.71 MB 172.97 MB 759.23 KB -0.4%
hits_024.vortex 1.0 vortex-compact 123.98 MB 123.40 MB 586.29 KB -0.5%
hits_085.vortex 1.0 vortex-file-compressed 200.70 MB 199.63 MB 1.06 MB -0.5%
hits_070.vortex 1.0 vortex-compact 153.58 MB 152.73 MB 862.98 KB -0.5%
hits_086.vortex 1.0 vortex-compact 140.49 MB 139.72 MB 795.01 KB -0.6%
hits_091.vortex 1.0 vortex-compact 111.85 MB 111.22 MB 639.23 KB -0.6%
hits_018.vortex 1.0 vortex-file-compressed 200.74 MB 199.49 MB 1.24 MB -0.6%
hits_097.vortex 1.0 vortex-compact 141.11 MB 140.23 MB 902.27 KB -0.6%
hits_075.vortex 1.0 vortex-compact 138.69 MB 137.80 MB 908.30 KB -0.6%
hits_055.vortex 1.0 vortex-compact 153.44 MB 152.39 MB 1.05 MB -0.7%
hits_087.vortex 1.0 vortex-compact 125.38 MB 124.29 MB 1.09 MB -0.9%
hits_093.vortex 1.0 vortex-compact 98.72 MB 97.83 MB 905.73 KB -0.9%
hits_049.vortex 1.0 vortex-file-compressed 192.84 MB 191.09 MB 1.75 MB -0.9%
hits_076.vortex 1.0 vortex-compact 125.03 MB 123.82 MB 1.21 MB -1.0%
hits_098.vortex 1.0 vortex-compact 103.50 MB 102.37 MB 1.13 MB -1.1%
hits_075.vortex 1.0 vortex-file-compressed 191.19 MB 189.09 MB 2.09 MB -1.1%
hits_039.vortex 1.0 vortex-compact 125.15 MB 123.78 MB 1.37 MB -1.1%
hits_006.vortex 1.0 vortex-compact 96.19 MB 94.16 MB 2.03 MB -2.1%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (+0.0%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.4%
Engines: DataFusion No clear signal (+1.8%, environment too noisy confidence) · DuckDB No clear signal (+9.0%, environment too noisy confidence)
Vortex (geomean): hot 0.977x ➖ · cold 0.931x ➖
Parquet (geomean): hot 0.927x ➖ · cold 0.950x ➖
Shifts: Parquet (control) -7.3% · Median polish -6.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 49937870 / 59270558 / -15.7% 140556534 / 122358697 / +14.9% 0.36 / 0.48 / -26.7%
fineweb_q01/datafusion:vortex-file-compressed 416025970 / 508750924 / -18.2% 731245939 / 919957180 / -20.5% 0.57 / 0.55 / +2.9%
fineweb_q02/datafusion:vortex-file-compressed 482289061 / 418352987 / +15.3% 963760528 / 610233540 / +57.9% 🔴 0.50 / 0.69 / -27.0%
fineweb_q03/datafusion:vortex-file-compressed 540901292 / 724732338 / -25.4% 848354407 / 1068752260 / -20.6% 0.64 / 0.68 / -6.0%
fineweb_q04/datafusion:vortex-file-compressed 403368966 / 547241793 / -26.3% 429798043 / 514621426 / -16.5% 0.94 / 1.06 / -11.7%
fineweb_q05/datafusion:vortex-file-compressed 608932674 / 446543843 / +36.4% 🔴 534560369 / 446791752 / +19.6% 1.14 / 1.00 / +14.0%
fineweb_q06/datafusion:vortex-file-compressed 814007970 / 801803740 / +1.5% 783314570 / 836779730 / -6.4% 1.04 / 0.96 / +8.5%
fineweb_q07/datafusion:vortex-file-compressed 1599404432 / 991202506 / +61.4% 🔴 1190464034 / 1071940069 / +11.1% 1.34 / 0.92 / +45.3%
fineweb_q08/datafusion:vortex-file-compressed 390822735 / 347023362 / +12.6% 304238895 / 256657537 / +18.5% 1.28 / 1.35 / -5.0%
datafusion / vortex-compact / ns (1.055x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 53021351 / 70438802 / -24.7% 128506729 / 367624380 / -65.0% 🟢 0.41 / 0.19 / +115.3%
fineweb_q01/datafusion:vortex-compact 474586270 / 509979534 / -6.9% 851080483 / 813347604 / +4.6% 0.56 / 0.63 / -11.1%
fineweb_q02/datafusion:vortex-compact 1233872454 / 421001124 / +193.1% 🔴 1041120445 / 679011851 / +53.3% 🔴 1.19 / 0.62 / +91.1%
fineweb_q03/datafusion:vortex-compact 639506789 / 574188578 / +11.4% 778479965 / 799339518 / -2.6% 0.82 / 0.72 / +14.4%
fineweb_q04/datafusion:vortex-compact 585808334 / 535591414 / +9.4% 644839545 / 677817303 / -4.9% 0.91 / 0.79 / +15.0%
fineweb_q05/datafusion:vortex-compact 461969445 / 632802062 / -27.0% 495926338 / 560553256 / -11.5% 0.93 / 1.13 / -17.5%
fineweb_q06/datafusion:vortex-compact 1389894759 / 1138141498 / +22.1% 1112786832 / 826135326 / +34.7% 🔴 1.25 / 1.38 / -9.3%
fineweb_q07/datafusion:vortex-compact 666081494 / 723546114 / -7.9% 445273909 / 491560306 / -9.4% 1.50 / 1.47 / +1.6%
fineweb_q08/datafusion:vortex-compact 187090338 / 236234112 / -20.8% 318552047 / 618460687 / -48.5% 🟢 0.59 / 0.38 / +53.8%
datafusion / parquet / ns (1.014x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 771010340 / 565109310 / +36.4% 🔴 751311633 / 1059179334 / -29.1% 1.03 / 0.53 / +92.3%
fineweb_q01/datafusion:parquet 916093642 / 1041297671 / -12.0% 873371551 / 939068254 / -7.0% 1.05 / 1.11 / -5.4%
fineweb_q02/datafusion:parquet 860679146 / 1045242998 / -17.7% 781349244 / 927570772 / -15.8% 1.10 / 1.13 / -2.2%
fineweb_q03/datafusion:parquet 922469914 / 1298386334 / -29.0% 859613366 / 1010875823 / -15.0% 1.07 / 1.28 / -16.5%
fineweb_q04/datafusion:parquet 1192424556 / 955340380 / +24.8% 1187464922 / 1055636854 / +12.5% 1.00 / 0.90 / +11.0%
fineweb_q05/datafusion:parquet 1455200939 / 1041496992 / +39.7% 🔴 1130759350 / 928718150 / +21.8% 1.29 / 1.12 / +14.8%
fineweb_q06/datafusion:parquet 1038400837 / 1069047921 / -2.9% 1451379419 / 1024292291 / +41.7% 🔴 0.72 / 1.04 / -31.4%
fineweb_q07/datafusion:parquet 977211256 / 1152365671 / -15.2% 1153075441 / 1526800969 / -24.5% 0.85 / 0.75 / +12.3%
fineweb_q08/datafusion:parquet 1091952004 / 971738038 / +12.4% 1141447341 / 832746658 / +37.1% 🔴 0.96 / 1.17 / -18.0%
duckdb / vortex-file-compressed / ns (0.920x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 57015318 / 57679995 / -1.2% 46914773 / 68323874 / -31.3% 🟢 1.22 / 0.84 / +44.0%
fineweb_q01/duckdb:vortex-file-compressed 437555602 / 515534294 / -15.1% 498679746 / 607430246 / -17.9% 0.88 / 0.85 / +3.4%
fineweb_q02/duckdb:vortex-file-compressed 628260532 / 731200979 / -14.1% 599355651 / 700410191 / -14.4% 1.05 / 1.04 / +0.4%
fineweb_q03/duckdb:vortex-file-compressed 1031079454 / 1292077816 / -20.2% 1433002063 / 1286791745 / +11.4% 0.72 / 1.00 / -28.3%
fineweb_q04/duckdb:vortex-file-compressed 1000092836 / 1172728175 / -14.7% 1106567328 / 1199446071 / -7.7% 0.90 / 0.98 / -7.6%
fineweb_q05/duckdb:vortex-file-compressed 966755666 / 931300570 / +3.8% 1036355856 / 1106982122 / -6.4% 0.93 / 0.84 / +10.9%
fineweb_q06/duckdb:vortex-file-compressed 1239539012 / 1261404360 / -1.7% 1203982460 / 1237482311 / -2.7% 1.03 / 1.02 / +1.0%
fineweb_q07/duckdb:vortex-file-compressed 1081737116 / 1037326214 / +4.3% 1087056938 / 1080409793 / +0.6% 1.00 / 0.96 / +3.6%
fineweb_q08/duckdb:vortex-file-compressed 431672854 / 475220104 / -9.2% 510083926 / 509683911 / +0.1% 0.85 / 0.93 / -9.2%
duckdb / vortex-compact / ns (0.926x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 66511048 / 73595982 / -9.6% 66368845 / 66236151 / +0.2% 1.00 / 1.11 / -9.8%
fineweb_q01/duckdb:vortex-compact 407625398 / 551199480 / -26.0% 486439057 / 502096032 / -3.1% 0.84 / 1.10 / -23.7%
fineweb_q02/duckdb:vortex-compact 601639708 / 680784318 / -11.6% 580862643 / 656764620 / -11.6% 1.04 / 1.04 / -0.1%
fineweb_q03/duckdb:vortex-compact 1122572803 / 1154552590 / -2.8% 1298178776 / 1367230560 / -5.1% 0.86 / 0.84 / +2.4%
fineweb_q04/duckdb:vortex-compact 1107588978 / 1111309042 / -0.3% 1108665653 / 1080859069 / +2.6% 1.00 / 1.03 / -2.8%
fineweb_q05/duckdb:vortex-compact 1047092032 / 1003074090 / +4.4% 1064148729 / 1156407424 / -8.0% 0.98 / 0.87 / +13.4%
fineweb_q06/duckdb:vortex-compact 1155887858 / 1158196141 / -0.2% 1142740935 / 1329795582 / -14.1% 1.01 / 0.87 / +16.1%
fineweb_q07/duckdb:vortex-compact 931617218 / 988308138 / -5.7% 1009066366 / 1117102494 / -9.7% 0.92 / 0.88 / +4.4%
fineweb_q08/duckdb:vortex-compact 368814429 / 412517800 / -10.6% 406745378 / 590559632 / -31.1% 🟢 0.91 / 0.70 / +29.8%
duckdb / parquet / ns (0.847x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 528901246 / 586729898 / -9.9% 546133145 / 659820278 / -17.2% 0.97 / 0.89 / +8.9%
fineweb_q01/duckdb:parquet 591182800 / 750974352 / -21.3% 702997835 / 729146738 / -3.6% 0.84 / 1.03 / -18.3%
fineweb_q02/duckdb:parquet 607175072 / 711044022 / -14.6% 580268768 / 771699941 / -24.8% 1.05 / 0.92 / +13.6%
fineweb_q03/duckdb:parquet 1664133031 / 1953739331 / -14.8% 1634468305 / 2127556918 / -23.2% 1.02 / 0.92 / +10.9%
fineweb_q04/duckdb:parquet 832427634 / 1167826192 / -28.7% 1159002775 / 1005868778 / +15.2% 0.72 / 1.16 / -38.1%
fineweb_q05/duckdb:parquet 886985563 / 1130446851 / -21.5% 919544093 / 1118699074 / -17.8% 0.96 / 1.01 / -4.5%
fineweb_q06/duckdb:parquet 1713932459 / 2079160042 / -17.6% 1796205421 / 2099991005 / -14.5% 0.95 / 0.99 / -3.6%
fineweb_q07/duckdb:parquet 1228649980 / 1389864964 / -11.6% 1407233134 / 1577582663 / -10.8% 0.87 / 0.88 / -0.9%
fineweb_q08/duckdb:parquet 630316364 / 589553320 / +6.9% 760985547 / 610449391 / +24.7% 0.83 / 0.97 / -14.2%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.000x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.017x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 53295296 / 52688579 / +1.2% 74400583 / 77517109 / -4.0% 0.72 / 0.68 / +5.4%
appian_q02/datafusion:vortex-compact 232953389 / 238149789 / -2.2% 267462750 / 261700546 / +2.2% 0.87 / 0.91 / -4.3%
appian_q03/datafusion:vortex-compact 146983354 / 147148815 / -0.1% 190186408 / 191189023 / -0.5% 0.77 / 0.77 / +0.4%
appian_q04/datafusion:vortex-compact 9921337233 / 9952002391 / -0.3% 9827430232 / 9790294110 / +0.4% 1.01 / 1.02 / -0.7%
appian_q05/datafusion:vortex-compact 137403248 / 136815093 / +0.4% 172574268 / 164864752 / +4.7% 0.80 / 0.83 / -4.1%
appian_q06/datafusion:vortex-compact 144164856 / 144108347 / +0.0% 165071571 / 170160819 / -3.0% 0.87 / 0.85 / +3.1%
appian_q07/datafusion:vortex-compact 164875291 / 165679734 / -0.5% 198061899 / 190849477 / +3.8% 0.83 / 0.87 / -4.1%
appian_q08/datafusion:vortex-compact 556927725 / 556516750 / +0.1% 582152678 / 591278377 / -1.5% 0.96 / 0.94 / +1.6%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72486095 / 73339014 / -1.2% 93877297 / 92498197 / +1.5% 0.77 / 0.79 / -2.6%
appian_q02/datafusion:parquet 304887826 / 302806265 / +0.7% 335372787 / 331728866 / +1.1% 0.91 / 0.91 / -0.4%
appian_q03/datafusion:parquet 191251109 / 190891806 / +0.2% 227449671 / 229026012 / -0.7% 0.84 / 0.83 / +0.9%
appian_q04/datafusion:parquet 9913739444 / 9991042420 / -0.8% 9817514881 / 9849824119 / -0.3% 1.01 / 1.01 / -0.4%
appian_q05/datafusion:parquet 201014778 / 199351936 / +0.8% 223063396 / 225599935 / -1.1% 0.90 / 0.88 / +2.0%
appian_q06/datafusion:parquet 169389966 / 170187104 / -0.5% 194126305 / 192691120 / +0.7% 0.87 / 0.88 / -1.2%
appian_q07/datafusion:parquet 210665325 / 209840038 / +0.4% 242730181 / 241640901 / +0.5% 0.87 / 0.87 / -0.1%
appian_q08/datafusion:parquet 674371741 / 672479868 / +0.3% 689612151 / 693194027 / -0.5% 0.98 / 0.97 / +0.8%
duckdb / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 91034099 / 90848208 / +0.2% 104363383 / 109243851 / -4.5% 0.87 / 0.83 / +4.9%
appian_q02/duckdb:vortex-compact 213485861 / 213768085 / -0.1% 228326341 / 238288842 / -4.2% 0.94 / 0.90 / +4.2%
appian_q03/duckdb:vortex-compact 122580946 / 121005894 / +1.3% 138887073 / 133463624 / +4.1% 0.88 / 0.91 / -2.7%
appian_q04/duckdb:vortex-compact 571935660 / 566537693 / +1.0% 575957894 / 607072991 / -5.1% 0.99 / 0.93 / +6.4%
appian_q05/duckdb:vortex-compact 133627107 / 132701738 / +0.7% 155709008 / 137950791 / +12.9% 🔴 0.86 / 0.96 / -10.8%
appian_q06/duckdb:vortex-compact 400890417 / 407587287 / -1.6% 369138414 / 401079919 / -8.0% 1.09 / 1.02 / +6.9%
appian_q07/duckdb:vortex-compact 136977587 / 137849822 / -0.6% 157399413 / 158609739 / -0.8% 0.87 / 0.87 / +0.1%
appian_q08/duckdb:vortex-compact 445155792 / 436810006 / +1.9% 484607988 / 459830909 / +5.4% 0.92 / 0.95 / -3.3%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 98863298 / 99340054 / -0.5% 108297689 / 108982376 / -0.6% 0.91 / 0.91 / +0.1%
appian_q02/duckdb:parquet 197710539 / 196278069 / +0.7% 200386005 / 201400318 / -0.5% 0.99 / 0.97 / +1.2%
appian_q03/duckdb:parquet 124411793 / 124246719 / +0.1% 134354169 / 135403842 / -0.8% 0.93 / 0.92 / +0.9%
appian_q04/duckdb:parquet 443420086 / 455398276 / -2.6% 481518385 / 455287184 / +5.8% 0.92 / 1.00 / -7.9%
appian_q05/duckdb:parquet 143817414 / 143214512 / +0.4% 156898989 / 158819366 / -1.2% 0.92 / 0.90 / +1.7%
appian_q06/duckdb:parquet 246353599 / 254663266 / -3.3% 289697607 / 231743500 / +25.0% 🔴 0.85 / 1.10 / -22.6%
appian_q07/duckdb:parquet 154565417 / 154731552 / -0.1% 165731866 / 166768388 / -0.6% 0.93 / 0.93 / +0.5%
appian_q08/duckdb:parquet 385882419 / 371817433 / +3.8% 375841061 / 368355514 / +2.0% 1.03 / 1.01 / +1.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.026x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1233532 / 1234691 / -0.1% 22577766 / 20195352 / +11.8% 🔴 0.05 / 0.06 / -10.6%
clickbench_q01/datafusion:vortex-file-compressed 5825402 / 5719262 / +1.9% 35391747 / 33833728 / +4.6% 0.16 / 0.17 / -2.6%
clickbench_q02/datafusion:vortex-file-compressed 10185386 / 10529726 / -3.3% 41864679 / 41364214 / +1.2% 0.24 / 0.25 / -4.4%
clickbench_q03/datafusion:vortex-file-compressed 11623017 / 11728864 / -0.9% 57140529 / 52067485 / +9.7% 0.20 / 0.23 / -9.7%
clickbench_q04/datafusion:vortex-file-compressed 55571730 / 56496460 / -1.6% 93290112 / 92904474 / +0.4% 0.60 / 0.61 / -2.0%
clickbench_q05/datafusion:vortex-file-compressed 75247869 / 74838014 / +0.5% 126066316 / 117374190 / +7.4% 0.60 / 0.64 / -6.4%
clickbench_q06/datafusion:vortex-file-compressed 1266440 / 1234936 / +2.6% 22015928 / 20712211 / +6.3% 0.06 / 0.06 / -3.5%
clickbench_q07/datafusion:vortex-file-compressed 9597431 / 9546127 / +0.5% 39251779 / 33786553 / +16.2% 🔴 0.24 / 0.28 / -13.5%
clickbench_q08/datafusion:vortex-file-compressed 79164330 / 76426732 / +3.6% 117015894 / 117905122 / -0.8% 0.68 / 0.65 / +4.4%
clickbench_q09/datafusion:vortex-file-compressed 171735688 / 171172674 / +0.3% 208299075 / 206290865 / +1.0% 0.82 / 0.83 / -0.6%
clickbench_q10/datafusion:vortex-file-compressed 23997991 / 24664430 / -2.7% 67923715 / 66631729 / +1.9% 0.35 / 0.37 / -4.6%
clickbench_q11/datafusion:vortex-file-compressed 26144897 / 27078265 / -3.4% 68437490 / 67042768 / +2.1% 0.38 / 0.40 / -5.4%
clickbench_q12/datafusion:vortex-file-compressed 73282010 / 72230387 / +1.5% 116714622 / 120905987 / -3.5% 0.63 / 0.60 / +5.1%
clickbench_q13/datafusion:vortex-file-compressed 122720260 / 120895692 / +1.5% 178696191 / 177861565 / +0.5% 0.69 / 0.68 / +1.0%
clickbench_q14/datafusion:vortex-file-compressed 76545662 / 72612551 / +5.4% 121591559 / 124251619 / -2.1% 0.63 / 0.58 / +7.7%
clickbench_q15/datafusion:vortex-file-compressed 62132324 / 61581572 / +0.9% 98419995 / 94868489 / +3.7% 0.63 / 0.65 / -2.7%
clickbench_q16/datafusion:vortex-file-compressed 150889284 / 149703580 / +0.8% 207864705 / 203057190 / +2.4% 0.73 / 0.74 / -1.5%
clickbench_q17/datafusion:vortex-file-compressed 152716339 / 148910904 / +2.6% 213648685 / 215271820 / -0.8% 0.71 / 0.69 / +3.3%
clickbench_q18/datafusion:vortex-file-compressed 295061809 / 302859651 / -2.6% 380173364 / 371748673 / +2.3% 0.78 / 0.81 / -4.7%
clickbench_q19/datafusion:vortex-file-compressed 7547034 / 7383098 / +2.2% 49518097 / 49039822 / +1.0% 0.15 / 0.15 / +1.2%
clickbench_q20/datafusion:vortex-file-compressed 64767720 / 62212527 / +4.1% 233010145 / 230822695 / +0.9% 0.28 / 0.27 / +3.1%
clickbench_q21/datafusion:vortex-file-compressed 90585062 / 92680910 / -2.3% 273291064 / 266989972 / +2.4% 0.33 / 0.35 / -4.5%
clickbench_q22/datafusion:vortex-file-compressed 104952504 / 104410998 / +0.5% 348226010 / 345353233 / +0.8% 0.30 / 0.30 / -0.3%
clickbench_q23/datafusion:vortex-file-compressed 210234438 / 215007540 / -2.2% 477377696 / 508057672 / -6.0% 0.44 / 0.42 / +4.1%
clickbench_q24/datafusion:vortex-file-compressed 16138114 / 15873128 / +1.7% 65609302 / 62837699 / +4.4% 0.25 / 0.25 / -2.6%
clickbench_q25/datafusion:vortex-file-compressed 18597562 / 17664244 / +5.3% 57750584 / 59136655 / -2.3% 0.32 / 0.30 / +7.8%
clickbench_q26/datafusion:vortex-file-compressed 17484918 / 17624338 / -0.8% 64572987 / 62288041 / +3.7% 0.27 / 0.28 / -4.3%
clickbench_q27/datafusion:vortex-file-compressed 99937723 / 98670228 / +1.3% 248279110 / 242400185 / +2.4% 0.40 / 0.41 / -1.1%
clickbench_q28/datafusion:vortex-file-compressed 562543817 / 568602522 / -1.1% 617605062 / 616471726 / +0.2% 0.91 / 0.92 / -1.2%
clickbench_q29/datafusion:vortex-file-compressed 23579048 / 23252971 / +1.4% 50610315 / 49556290 / +2.1% 0.47 / 0.47 / -0.7%
clickbench_q30/datafusion:vortex-file-compressed 60818896 / 58227112 / +4.5% 106380654 / 102758056 / +3.5% 0.57 / 0.57 / +0.9%
clickbench_q31/datafusion:vortex-file-compressed 72474188 / 71498154 / +1.4% 156874130 / 150393815 / +4.3% 0.46 / 0.48 / -2.8%
clickbench_q32/datafusion:vortex-file-compressed 301859248 / 298681441 / +1.1% 386504082 / 376929179 / +2.5% 0.78 / 0.79 / -1.4%
clickbench_q33/datafusion:vortex-file-compressed 328953289 / 328095444 / +0.3% 427015068 / 424558338 / +0.6% 0.77 / 0.77 / -0.3%
clickbench_q34/datafusion:vortex-file-compressed 329183934 / 327587628 / +0.5% 440374614 / 423633304 / +4.0% 0.75 / 0.77 / -3.3%
clickbench_q35/datafusion:vortex-file-compressed 55878522 / 57273213 / -2.4% 93309721 / 89307285 / +4.5% 0.60 / 0.64 / -6.6%
clickbench_q36/datafusion:vortex-file-compressed 37459265 / 37558480 / -0.3% 67084023 / 64765015 / +3.6% 0.56 / 0.58 / -3.7%
clickbench_q37/datafusion:vortex-file-compressed 22029260 / 21853755 / +0.8% 48082347 / 47859771 / +0.5% 0.46 / 0.46 / +0.3%
clickbench_q38/datafusion:vortex-file-compressed 11858500 / 11761087 / +0.8% 40344451 / 37993547 / +6.2% 0.29 / 0.31 / -5.0%
clickbench_q39/datafusion:vortex-file-compressed 77896552 / 77305206 / +0.8% 110679552 / 110534112 / +0.1% 0.70 / 0.70 / +0.6%
clickbench_q40/datafusion:vortex-file-compressed 11315788 / 11239279 / +0.7% 36474544 / 35880245 / +1.7% 0.31 / 0.31 / -1.0%
clickbench_q41/datafusion:vortex-file-compressed 10754706 / 10661611 / +0.9% 37740063 / 35758184 / +5.5% 0.28 / 0.30 / -4.4%
clickbench_q42/datafusion:vortex-file-compressed 10747309 / 10813240 / -0.6% 37384508 / 36435124 / +2.6% 0.29 / 0.30 / -3.1%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1267070 / 1223360 / +3.6% 20986665 / 19627978 / +6.9% 0.06 / 0.06 / -3.1%
clickbench_q01/datafusion:vortex-compact 7054103 / 7411199 / -4.8% 31079601 / 31354440 / -0.9% 0.23 / 0.24 / -4.0%
clickbench_q02/datafusion:vortex-compact 19455417 / 19831647 / -1.9% 46492251 / 43906960 / +5.9% 0.42 / 0.45 / -7.4%
clickbench_q03/datafusion:vortex-compact 13895553 / 13593886 / +2.2% 39166492 / 37682860 / +3.9% 0.35 / 0.36 / -1.7%
clickbench_q04/datafusion:vortex-compact 56763320 / 57297860 / -0.9% 87008631 / 85704598 / +1.5% 0.65 / 0.67 / -2.4%
clickbench_q05/datafusion:vortex-compact 85455492 / 82274634 / +3.9% 125445978 / 116095149 / +8.1% 0.68 / 0.71 / -3.9%
clickbench_q06/datafusion:vortex-compact 1249554 / 1242607 / +0.6% 21022889 / 20596360 / +2.1% 0.06 / 0.06 / -1.5%
clickbench_q07/datafusion:vortex-compact 11901067 / 12206602 / -2.5% 35591128 / 35294551 / +0.8% 0.33 / 0.35 / -3.3%
clickbench_q08/datafusion:vortex-compact 86603986 / 84461990 / +2.5% 116186136 / 116945452 / -0.6% 0.75 / 0.72 / +3.2%
clickbench_q09/datafusion:vortex-compact 194786190 / 192951198 / +1.0% 212192355 / 218347835 / -2.8% 0.92 / 0.88 / +3.9%
clickbench_q10/datafusion:vortex-compact 44091925 / 43494174 / +1.4% 70736954 / 69088637 / +2.4% 0.62 / 0.63 / -1.0%
clickbench_q11/datafusion:vortex-compact 55171589 / 55390032 / -0.4% 86602370 / 82466433 / +5.0% 0.64 / 0.67 / -5.2%
clickbench_q12/datafusion:vortex-compact 86623614 / 86033162 / +0.7% 119657845 / 119790144 / -0.1% 0.72 / 0.72 / +0.8%
clickbench_q13/datafusion:vortex-compact 136840860 / 138226688 / -1.0% 184096131 / 189322381 / -2.8% 0.74 / 0.73 / +1.8%
clickbench_q14/datafusion:vortex-compact 93068362 / 89019464 / +4.5% 135368984 / 126155369 / +7.3% 0.69 / 0.71 / -2.6%
clickbench_q15/datafusion:vortex-compact 61893045 / 63573742 / -2.6% 99622752 / 96895388 / +2.8% 0.62 / 0.66 / -5.3%
clickbench_q16/datafusion:vortex-compact 164402108 / 162914883 / +0.9% 218517182 / 217634099 / +0.4% 0.75 / 0.75 / +0.5%
clickbench_q17/datafusion:vortex-compact 161638980 / 163711031 / -1.3% 239220501 / 226585573 / +5.6% 0.68 / 0.72 / -6.5%
clickbench_q18/datafusion:vortex-compact 304224849 / 304297016 / -0.0% 374333237 / 358148047 / +4.5% 0.81 / 0.85 / -4.3%
clickbench_q19/datafusion:vortex-compact 9977897 / 10197041 / -2.1% 39878355 / 37348761 / +6.8% 0.25 / 0.27 / -8.4%
clickbench_q20/datafusion:vortex-compact 72805796 / 71592627 / +1.7% 190189390 / 193189570 / -1.6% 0.38 / 0.37 / +3.3%
clickbench_q21/datafusion:vortex-compact 116773706 / 117227416 / -0.4% 227370541 / 227388156 / -0.0% 0.51 / 0.52 / -0.4%
clickbench_q22/datafusion:vortex-compact 184534052 / 184911544 / -0.2% 280405614 / 270870843 / +3.5% 0.66 / 0.68 / -3.6%
clickbench_q23/datafusion:vortex-compact 661943332 / 566439626 / +16.9% 🔴 803251108 / 637414745 / +26.0% 🔴 0.82 / 0.89 / -7.3%
clickbench_q24/datafusion:vortex-compact 28350749 / 28710877 / -1.3% 62304171 / 57753717 / +7.9% 0.46 / 0.50 / -8.5%
clickbench_q25/datafusion:vortex-compact 35632714 / 36347842 / -2.0% 67139411 / 66200292 / +1.4% 0.53 / 0.55 / -3.3%
clickbench_q26/datafusion:vortex-compact 28100770 / 29212768 / -3.8% 64764462 / 63465354 / +2.0% 0.43 / 0.46 / -5.7%
clickbench_q27/datafusion:vortex-compact 104793953 / 102835244 / +1.9% 208941934 / 207079001 / +0.9% 0.50 / 0.50 / +1.0%
clickbench_q28/datafusion:vortex-compact 581773418 / 569117546 / +2.2% 624415059 / 619018852 / +0.9% 0.93 / 0.92 / +1.3%
clickbench_q29/datafusion:vortex-compact 30647905 / 31049264 / -1.3% 55924449 / 55360314 / +1.0% 0.55 / 0.56 / -2.3%
clickbench_q30/datafusion:vortex-compact 90986006 / 95589168 / -4.8% 129996654 / 131653689 / -1.3% 0.70 / 0.73 / -3.6%
clickbench_q31/datafusion:vortex-compact 102325232 / 99449575 / +2.9% 151521732 / 149958545 / +1.0% 0.68 / 0.66 / +1.8%
clickbench_q32/datafusion:vortex-compact 305973242 / 308339240 / -0.8% 383019619 / 374994262 / +2.1% 0.80 / 0.82 / -2.8%
clickbench_q33/datafusion:vortex-compact 340747613 / 343775118 / -0.9% 414012406 / 434157525 / -4.6% 0.82 / 0.79 / +3.9%
clickbench_q34/datafusion:vortex-compact 341686333 / 334896984 / +2.0% 429655532 / 422102556 / +1.8% 0.80 / 0.79 / +0.2%
clickbench_q35/datafusion:vortex-compact 62092130 / 63598772 / -2.4% 92156547 / 91259844 / +1.0% 0.67 / 0.70 / -3.3%
clickbench_q36/datafusion:vortex-compact 38534952 / 38329067 / +0.5% 68438984 / 65485109 / +4.5% 0.56 / 0.59 / -3.8%
clickbench_q37/datafusion:vortex-compact 22583649 / 22326272 / +1.2% 49159989 / 47921886 / +2.6% 0.46 / 0.47 / -1.4%
clickbench_q38/datafusion:vortex-compact 13283027 / 13335008 / -0.4% 39989928 / 38723730 / +3.3% 0.33 / 0.34 / -3.5%
clickbench_q39/datafusion:vortex-compact 79240047 / 78679784 / +0.7% 110825609 / 110071079 / +0.7% 0.71 / 0.71 / +0.0%
clickbench_q40/datafusion:vortex-compact 12558432 / 12458730 / +0.8% 38649522 / 36789176 / +5.1% 0.32 / 0.34 / -4.1%
clickbench_q41/datafusion:vortex-compact 13246048 / 12989927 / +2.0% 36639726 / 38004597 / -3.6% 0.36 / 0.34 / +5.8%
clickbench_q42/datafusion:vortex-compact 10794057 / 11167050 / -3.3% 35081348 / 34889987 / +0.5% 0.31 / 0.32 / -3.9%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1299778 / 1252458 / +3.8% 50693741 / 49106014 / +3.2% 0.03 / 0.03 / +0.5%
clickbench_q01/datafusion:parquet 15732346 / 15812168 / -0.5% 68349075 / 67426928 / +1.4% 0.23 / 0.23 / -1.8%
clickbench_q02/datafusion:parquet 19844240 / 19227020 / +3.2% 84105053 / 83551160 / +0.7% 0.24 / 0.23 / +2.5%
clickbench_q03/datafusion:parquet 16913958 / 17258537 / -2.0% 83675102 / 80567746 / +3.9% 0.20 / 0.21 / -5.6%
clickbench_q04/datafusion:parquet 64433943 / 63063021 / +2.2% 129422934 / 127415462 / +1.6% 0.50 / 0.49 / +0.6%
clickbench_q05/datafusion:parquet 87918991 / 88357232 / -0.5% 158338012 / 155528039 / +1.8% 0.56 / 0.57 / -2.3%
clickbench_q06/datafusion:parquet 1300626 / 1274258 / +2.1% 49820325 / 49928108 / -0.2% 0.03 / 0.03 / +2.3%
clickbench_q07/datafusion:parquet 16830402 / 16868861 / -0.2% 70268050 / 71056426 / -1.1% 0.24 / 0.24 / +0.9%
clickbench_q08/datafusion:parquet 87321335 / 88385874 / -1.2% 166803988 / 160887607 / +3.7% 0.52 / 0.55 / -4.7%
clickbench_q09/datafusion:parquet 191105176 / 188300782 / +1.5% 266774602 / 269895606 / -1.2% 0.72 / 0.70 / +2.7%
clickbench_q10/datafusion:parquet 36485578 / 35865454 / +1.7% 102310294 / 99482690 / +2.8% 0.36 / 0.36 / -1.1%
clickbench_q11/datafusion:parquet 42430844 / 43199374 / -1.8% 111344439 / 110651614 / +0.6% 0.38 / 0.39 / -2.4%
clickbench_q12/datafusion:parquet 97194387 / 95683081 / +1.6% 167994671 / 162652172 / +3.3% 0.58 / 0.59 / -1.7%
clickbench_q13/datafusion:parquet 150643764 / 147834380 / +1.9% 230910570 / 230074248 / +0.4% 0.65 / 0.64 / +1.5%
clickbench_q14/datafusion:parquet 101046228 / 102242466 / -1.2% 176623641 / 171012535 / +3.3% 0.57 / 0.60 / -4.3%
clickbench_q15/datafusion:parquet 70861980 / 69601354 / +1.8% 132791442 / 132544585 / +0.2% 0.53 / 0.53 / +1.6%
clickbench_q16/datafusion:parquet 154719090 / 158896720 / -2.6% 238808112 / 234762834 / +1.7% 0.65 / 0.68 / -4.3%
clickbench_q17/datafusion:parquet 157237676 / 156997889 / +0.2% 237410953 / 238823122 / -0.6% 0.66 / 0.66 / +0.7%
clickbench_q18/datafusion:parquet 314026388 / 329918400 / -4.8% 428524122 / 423167143 / +1.3% 0.73 / 0.78 / -6.0%
clickbench_q19/datafusion:parquet 18934650 / 18989808 / -0.3% 79685702 / 75796638 / +5.1% 0.24 / 0.25 / -5.2%
clickbench_q20/datafusion:parquet 178639418 / 178109817 / +0.3% 285177152 / 277916508 / +2.6% 0.63 / 0.64 / -2.3%
clickbench_q21/datafusion:parquet 173531371 / 173830016 / -0.2% 303243160 / 291351434 / +4.1% 0.57 / 0.60 / -4.1%
clickbench_q22/datafusion:parquet 262613140 / 260337994 / +0.9% 425225554 / 414863884 / +2.5% 0.62 / 0.63 / -1.6%
clickbench_q23/datafusion:parquet 1064973811 / 1149881386 / -7.4% 1251917973 / 1239996712 / +1.0% 0.85 / 0.93 / -8.3%
clickbench_q24/datafusion:parquet 30609478 / 30665972 / -0.2% 90972669 / 87248880 / +4.3% 0.34 / 0.35 / -4.3%
clickbench_q25/datafusion:parquet 37761437 / 37486903 / +0.7% 105794482 / 100406678 / +5.4% 0.36 / 0.37 / -4.4%
clickbench_q26/datafusion:parquet 31180667 / 30919676 / +0.8% 91400334 / 88480216 / +3.3% 0.34 / 0.35 / -2.4%
clickbench_q27/datafusion:parquet 194052635 / 193688136 / +0.2% 290424225 / 282773609 / +2.7% 0.67 / 0.68 / -2.5%
clickbench_q28/datafusion:parquet 630115118 / 623312240 / +1.1% 711218668 / 705293678 / +0.8% 0.89 / 0.88 / +0.2%
clickbench_q29/datafusion:parquet 29370902 / 28970646 / +1.4% 92660089 / 91471505 / +1.3% 0.32 / 0.32 / +0.1%
clickbench_q30/datafusion:parquet 89568894 / 89694040 / -0.1% 176197250 / 166917361 / +5.6% 0.51 / 0.54 / -5.4%
clickbench_q31/datafusion:parquet 103790664 / 105442104 / -1.6% 202441898 / 188682672 / +7.3% 0.51 / 0.56 / -8.3%
clickbench_q32/datafusion:parquet 322999952 / 324829883 / -0.6% 433415023 / 435001585 / -0.4% 0.75 / 0.75 / -0.2%
clickbench_q33/datafusion:parquet 381847615 / 381826780 / +0.0% 477964859 / 473514855 / +0.9% 0.80 / 0.81 / -0.9%
clickbench_q34/datafusion:parquet 383298970 / 385813897 / -0.7% 482899609 / 484025471 / -0.2% 0.79 / 0.80 / -0.4%
clickbench_q35/datafusion:parquet 65244612 / 64416977 / +1.3% 128586348 / 123776346 / +3.9% 0.51 / 0.52 / -2.5%
clickbench_q36/datafusion:parquet 73622860 / 73331806 / +0.4% 137708440 / 134083803 / +2.7% 0.53 / 0.55 / -2.2%
clickbench_q37/datafusion:parquet 35820228 / 35404302 / +1.2% 93207318 / 91651675 / +1.7% 0.38 / 0.39 / -0.5%
clickbench_q38/datafusion:parquet 47770578 / 47398830 / +0.8% 112404388 / 105957002 / +6.1% 0.42 / 0.45 / -5.0%
clickbench_q39/datafusion:parquet 143523391 / 144298696 / -0.5% 214920888 / 206783845 / +3.9% 0.67 / 0.70 / -4.3%
clickbench_q40/datafusion:parquet 20240716 / 20223006 / +0.1% 79763059 / 78246509 / +1.9% 0.25 / 0.26 / -1.8%
clickbench_q41/datafusion:parquet 18818040 / 18769183 / +0.3% 77908774 / 77013575 / +1.2% 0.24 / 0.24 / -0.9%
clickbench_q42/datafusion:parquet 19526748 / 19301112 / +1.2% 76801409 / 74301583 / +3.4% 0.25 / 0.26 / -2.1%
duckdb / vortex-file-compressed / ns (0.995x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1595676 / 1526868 / +4.5% 23277825 / 22440854 / +3.7% 0.07 / 0.07 / +0.7%
clickbench_q01/duckdb:vortex-file-compressed 11950785 / 13383908 / -10.7% 🟢 30503228 / 30690241 / -0.6% 0.39 / 0.44 / -10.2%
clickbench_q02/duckdb:vortex-file-compressed 13774628 / 13382685 / +2.9% 35147466 / 31474838 / +11.7% 🔴 0.39 / 0.43 / -7.8%
clickbench_q03/duckdb:vortex-file-compressed 17286986 / 17438132 / -0.9% 52726875 / 46384878 / +13.7% 🔴 0.33 / 0.38 / -12.8%
clickbench_q04/duckdb:vortex-file-compressed 68335245 / 69834624 / -2.1% 103363964 / 104233511 / -0.8% 0.66 / 0.67 / -1.3%
clickbench_q05/duckdb:vortex-file-compressed 69476266 / 71385180 / -2.7% 95624118 / 97574705 / -2.0% 0.73 / 0.73 / -0.7%
clickbench_q06/duckdb:vortex-file-compressed 1804624 / 1826162 / -1.2% 33879587 / 32470970 / +4.3% 0.05 / 0.06 / -5.3%
clickbench_q07/duckdb:vortex-file-compressed 13661906 / 13621281 / +0.3% 30793966 / 32331386 / -4.8% 0.44 / 0.42 / +5.3%
clickbench_q08/duckdb:vortex-file-compressed 83915148 / 81714584 / +2.7% 125619760 / 120264777 / +4.5% 0.67 / 0.68 / -1.7%
clickbench_q09/duckdb:vortex-file-compressed 106091324 / 108455640 / -2.2% 148966338 / 155127787 / -4.0% 0.71 / 0.70 / +1.9%
clickbench_q10/duckdb:vortex-file-compressed 32206032 / 33905806 / -5.0% 69528305 / 65155394 / +6.7% 0.46 / 0.52 / -11.0%
clickbench_q11/duckdb:vortex-file-compressed 34636276 / 37590728 / -7.9% 73402483 / 68403685 / +7.3% 0.47 / 0.55 / -14.1%
clickbench_q12/duckdb:vortex-file-compressed 74832202 / 77171540 / -3.0% 109938973 / 106574870 / +3.2% 0.68 / 0.72 / -6.0%
clickbench_q13/duckdb:vortex-file-compressed 134361306 / 139892862 / -4.0% 189821968 / 172997357 / +9.7% 0.71 / 0.81 / -12.5%
clickbench_q14/duckdb:vortex-file-compressed 79155017 / 80765928 / -2.0% 107598299 / 112012997 / -3.9% 0.74 / 0.72 / +2.0%
clickbench_q15/duckdb:vortex-file-compressed 93221413 / 91741782 / +1.6% 128725692 / 128542194 / +0.1% 0.72 / 0.71 / +1.5%
clickbench_q16/duckdb:vortex-file-compressed 160263702 / 160812912 / -0.3% 211848569 / 207379973 / +2.2% 0.76 / 0.78 / -2.4%
clickbench_q17/duckdb:vortex-file-compressed 162602664 / 163294572 / -0.4% 210632036 / 209472180 / +0.6% 0.77 / 0.78 / -1.0%
clickbench_q18/duckdb:vortex-file-compressed 308286248 / 323959718 / -4.8% 373165271 / 377715499 / -1.2% 0.83 / 0.86 / -3.7%
clickbench_q19/duckdb:vortex-file-compressed 17031691 / 15710866 / +8.4% 41180626 / 39321594 / +4.7% 0.41 / 0.40 / +3.5%
clickbench_q20/duckdb:vortex-file-compressed 113332700 / 111052490 / +2.1% 196496489 / 183542986 / +7.1% 0.58 / 0.61 / -4.7%
clickbench_q21/duckdb:vortex-file-compressed 161766597 / 160218532 / +1.0% 311799202 / 295061983 / +5.7% 0.52 / 0.54 / -4.5%
clickbench_q22/duckdb:vortex-file-compressed 242136330 / 247785234 / -2.3% 462106998 / 438731426 / +5.3% 0.52 / 0.56 / -7.2%
clickbench_q23/duckdb:vortex-file-compressed 58749182 / 57723682 / +1.8% 100860297 / 113023584 / -10.8% 🟢 0.58 / 0.51 / +14.1%
clickbench_q24/duckdb:vortex-file-compressed 24973550 / 26257796 / -4.9% 47698292 / 45376767 / +5.1% 0.52 / 0.58 / -9.5%
clickbench_q25/duckdb:vortex-file-compressed 31949353 / 32441638 / -1.5% 55583684 / 51456418 / +8.0% 0.57 / 0.63 / -8.8%
clickbench_q26/duckdb:vortex-file-compressed 20865598 / 20567375 / +1.4% 36157351 / 37249292 / -2.9% 0.58 / 0.55 / +4.5%
clickbench_q27/duckdb:vortex-file-compressed 146451480 / 144094184 / +1.6% 260415108 / 240659042 / +8.2% 0.56 / 0.60 / -6.1%
clickbench_q28/duckdb:vortex-file-compressed 623099820 / 552458754 / +12.8% 🔴 672958334 / 657815937 / +2.3% 0.93 / 0.84 / +10.2%
clickbench_q29/duckdb:vortex-file-compressed 18144014 / 17588826 / +3.2% 38423883 / 38478627 / -0.1% 0.47 / 0.46 / +3.3%
clickbench_q30/duckdb:vortex-file-compressed 65385592 / 66136270 / -1.1% 114216808 / 106152881 / +7.6% 0.57 / 0.62 / -8.1%
clickbench_q31/duckdb:vortex-file-compressed 125286438 / 124350934 / +0.8% 214425723 / 195442588 / +9.7% 0.58 / 0.64 / -8.2%
clickbench_q32/duckdb:vortex-file-compressed 431332364 / 438951058 / -1.7% 473445799 / 484561134 / -2.3% 0.91 / 0.91 / +0.6%
clickbench_q33/duckdb:vortex-file-compressed 397491328 / 397095222 / +0.1% 502002497 / 496829052 / +1.0% 0.79 / 0.80 / -0.9%
clickbench_q34/duckdb:vortex-file-compressed 401904567 / 415503171 / -3.3% 533196742 / 525461866 / +1.5% 0.75 / 0.79 / -4.7%
clickbench_q35/duckdb:vortex-file-compressed 100209724 / 104832369 / -4.4% 136056782 / 135464662 / +0.4% 0.74 / 0.77 / -4.8%
clickbench_q36/duckdb:vortex-file-compressed 15467320 / 15160924 / +2.0% 33859691 / 32602444 / +3.9% 0.46 / 0.47 / -1.8%
clickbench_q37/duckdb:vortex-file-compressed 11318708 / 11778855 / -3.9% 27309121 / 39197928 / -30.3% 🟢 0.41 / 0.30 / +37.9%
clickbench_q38/duckdb:vortex-file-compressed 13245612 / 13755990 / -3.7% 33174257 / 28815999 / +15.1% 🔴 0.40 / 0.48 / -16.4%
clickbench_q39/duckdb:vortex-file-compressed 23519766 / 23221028 / +1.3% 39875773 / 40588273 / -1.8% 0.59 / 0.57 / +3.1%
clickbench_q40/duckdb:vortex-file-compressed 11457256 / 11165176 / +2.6% 28690654 / 28395880 / +1.0% 0.40 / 0.39 / +1.6%
clickbench_q41/duckdb:vortex-file-compressed 11176199 / 11591086 / -3.6% 29043565 / 27463065 / +5.8% 0.38 / 0.42 / -8.8%
clickbench_q42/duckdb:vortex-file-compressed 11918530 / 11170560 / +6.7% 28801769 / 29855370 / -3.5% 0.41 / 0.37 / +10.6%
duckdb / vortex-compact / ns (1.015x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1604212 / 1533744 / +4.6% 26926614 / 23378862 / +15.2% 🔴 0.06 / 0.07 / -9.2%
clickbench_q01/duckdb:vortex-compact 15547474 / 12635013 / +23.1% 🔴 32728046 / 29362583 / +11.5% 🔴 0.48 / 0.43 / +10.4%
clickbench_q02/duckdb:vortex-compact 18818650 / 19925026 / -5.6% 37714607 / 39946353 / -5.6% 0.50 / 0.50 / +0.0%
clickbench_q03/duckdb:vortex-compact 20199974 / 19737643 / +2.3% 51067308 / 43454562 / +17.5% 🔴 0.40 / 0.45 / -12.9%
clickbench_q04/duckdb:vortex-compact 74738269 / 74694656 / +0.1% 106157960 / 101881730 / +4.2% 0.70 / 0.73 / -4.0%
clickbench_q05/duckdb:vortex-compact 75992296 / 77540172 / -2.0% 103200066 / 105994261 / -2.6% 0.74 / 0.73 / +0.7%
clickbench_q06/duckdb:vortex-compact 1827308 / 1778968 / +2.7% 32576046 / 30400878 / +7.2% 0.06 / 0.06 / -4.1%
clickbench_q07/duckdb:vortex-compact 17410780 / 14763520 / +17.9% 🔴 32547831 / 34158437 / -4.7% 0.53 / 0.43 / +23.8%
clickbench_q08/duckdb:vortex-compact 105406695 / 95922923 / +9.9% 133540375 / 133655657 / -0.1% 0.79 / 0.72 / +10.0%
clickbench_q09/duckdb:vortex-compact 145744074 / 145524348 / +0.2% 184105327 / 180756584 / +1.9% 0.79 / 0.81 / -1.7%
clickbench_q10/duckdb:vortex-compact 53351257 / 52565204 / +1.5% 91581056 / 88192723 / +3.8% 0.58 / 0.60 / -2.3%
clickbench_q11/duckdb:vortex-compact 64818262 / 69132712 / -6.2% 108640117 / 101538673 / +7.0% 0.60 / 0.68 / -12.4%
clickbench_q12/duckdb:vortex-compact 89590201 / 87151730 / +2.8% 123631963 / 119788139 / +3.2% 0.72 / 0.73 / -0.4%
clickbench_q13/duckdb:vortex-compact 172235444 / 161226830 / +6.8% 214909805 / 207555027 / +3.5% 0.80 / 0.78 / +3.2%
clickbench_q14/duckdb:vortex-compact 94811098 / 97890886 / -3.1% 128990872 / 128591208 / +0.3% 0.74 / 0.76 / -3.4%
clickbench_q15/duckdb:vortex-compact 93370788 / 97510115 / -4.2% 132612305 / 127928949 / +3.7% 0.70 / 0.76 / -7.6%
clickbench_q16/duckdb:vortex-compact 179507942 / 192630584 / -6.8% 226399136 / 222567222 / +1.7% 0.79 / 0.87 / -8.4%
clickbench_q17/duckdb:vortex-compact 181048474 / 184885542 / -2.1% 223596819 / 245398142 / -8.9% 0.81 / 0.75 / +7.5%
clickbench_q18/duckdb:vortex-compact 324827652 / 330950661 / -1.9% 396805894 / 376869372 / +5.3% 0.82 / 0.88 / -6.8%
clickbench_q19/duckdb:vortex-compact 17119516 / 17407490 / -1.7% 41892522 / 36959263 / +13.3% 🔴 0.41 / 0.47 / -13.2%
clickbench_q20/duckdb:vortex-compact 107098542 / 112846333 / -5.1% 182436363 / 171471900 / +6.4% 0.59 / 0.66 / -10.8%
clickbench_q21/duckdb:vortex-compact 175829238 / 174891148 / +0.5% 321483184 / 287121051 / +12.0% 🔴 0.55 / 0.61 / -10.2%
clickbench_q22/duckdb:vortex-compact 352458940 / 349345452 / +0.9% 560118513 / 501456442 / +11.7% 🔴 0.63 / 0.70 / -9.7%
clickbench_q23/duckdb:vortex-compact 91810173 / 93457266 / -1.8% 134882454 / 128016251 / +5.4% 0.68 / 0.73 / -6.8%
clickbench_q24/duckdb:vortex-compact 32829426 / 30964854 / +6.0% 49430790 / 53745743 / -8.0% 0.66 / 0.58 / +15.3%
clickbench_q25/duckdb:vortex-compact 49455372 / 47176246 / +4.8% 74588145 / 70763893 / +5.4% 0.66 / 0.67 / -0.5%
clickbench_q26/duckdb:vortex-compact 25410636 / 25203903 / +0.8% 44593976 / 43148284 / +3.4% 0.57 / 0.58 / -2.4%
clickbench_q27/duckdb:vortex-compact 193052749 / 196964058 / -2.0% 311320799 / 288303242 / +8.0% 0.62 / 0.68 / -9.2%
clickbench_q28/duckdb:vortex-compact 578799942 / 584306030 / -0.9% 711143456 / 718711733 / -1.1% 0.81 / 0.81 / +0.1%
clickbench_q29/duckdb:vortex-compact 23660216 / 21786740 / +8.6% 42591821 / 42826018 / -0.5% 0.56 / 0.51 / +9.2%
clickbench_q30/duckdb:vortex-compact 112206990 / 110672218 / +1.4% 151718438 / 147124382 / +3.1% 0.74 / 0.75 / -1.7%
clickbench_q31/duckdb:vortex-compact 175142825 / 172595476 / +1.5% 249484049 / 241752057 / +3.2% 0.70 / 0.71 / -1.7%
clickbench_q32/duckdb:vortex-compact 460152450 / 453371034 / +1.5% 496047608 / 532116153 / -6.8% 0.93 / 0.85 / +8.9%
clickbench_q33/duckdb:vortex-compact 396472219 / 402073374 / -1.4% 508748264 / 489234349 / +4.0% 0.78 / 0.82 / -5.2%
clickbench_q34/duckdb:vortex-compact 410745960 / 419836646 / -2.2% 542051530 / 517425339 / +4.8% 0.76 / 0.81 / -6.6%
clickbench_q35/duckdb:vortex-compact 107728881 / 108139378 / -0.4% 153135426 / 137263780 / +11.6% 🔴 0.70 / 0.79 / -10.7%
clickbench_q36/duckdb:vortex-compact 16172268 / 16752579 / -3.5% 35951473 / 32147388 / +11.8% 🔴 0.45 / 0.52 / -13.7%
clickbench_q37/duckdb:vortex-compact 15326858 / 13225160 / +15.9% 🔴 32318790 / 31539492 / +2.5% 0.47 / 0.42 / +13.1%
clickbench_q38/duckdb:vortex-compact 13528160 / 13261216 / +2.0% 28941745 / 29092038 / -0.5% 0.47 / 0.46 / +2.5%
clickbench_q39/duckdb:vortex-compact 27643494 / 25304580 / +9.2% 42393486 / 41372743 / +2.5% 0.65 / 0.61 / +6.6%
clickbench_q40/duckdb:vortex-compact 12405900 / 12473042 / -0.5% 30673978 / 31970804 / -4.1% 0.40 / 0.39 / +3.7%
clickbench_q41/duckdb:vortex-compact 12597072 / 11662326 / +8.0% 27840550 / 28827510 / -3.4% 0.45 / 0.40 / +11.8%
clickbench_q42/duckdb:vortex-compact 11464276 / 12559953 / -8.7% 33580720 / 30909524 / +8.6% 0.34 / 0.41 / -16.0%
duckdb / parquet / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8561876 / 8127206 / +5.3% 21287003 / 20340665 / +4.7% 0.40 / 0.40 / +0.7%
clickbench_q01/duckdb:parquet 10042887 / 9991701 / +0.5% 19839401 / 21748184 / -8.8% 0.51 / 0.46 / +10.2%
clickbench_q02/duckdb:parquet 14958192 / 16198280 / -7.7% 33324383 / 30976144 / +7.6% 0.45 / 0.52 / -14.2%
clickbench_q03/duckdb:parquet 17764544 / 16447523 / +8.0% 56584571 / 53425040 / +5.9% 0.31 / 0.31 / +2.0%
clickbench_q04/duckdb:parquet 71047568 / 70699196 / +0.5% 93082479 / 107383439 / -13.3% 🟢 0.76 / 0.66 / +15.9%
clickbench_q05/duckdb:parquet 80545218 / 80279364 / +0.3% 122031267 / 123791007 / -1.4% 0.66 / 0.65 / +1.8%
clickbench_q06/duckdb:parquet 16691266 / 15455584 / +8.0% 24232936 / 26151250 / -7.3% 0.69 / 0.59 / +16.5%
clickbench_q07/duckdb:parquet 12065011 / 10583228 / +14.0% 🔴 23871629 / 20426049 / +16.9% 🔴 0.51 / 0.52 / -2.5%
clickbench_q08/duckdb:parquet 85007345 / 85146700 / -0.2% 123565964 / 134343371 / -8.0% 0.69 / 0.63 / +8.5%
clickbench_q09/duckdb:parquet 115485326 / 115008072 / +0.4% 156280898 / 154437699 / +1.2% 0.74 / 0.74 / -0.8%
clickbench_q10/duckdb:parquet 33022842 / 33471058 / -1.3% 71208850 / 68317735 / +4.2% 0.46 / 0.49 / -5.3%
clickbench_q11/duckdb:parquet 36394028 / 36934335 / -1.5% 80898156 / 75299972 / +7.4% 0.45 / 0.49 / -8.3%
clickbench_q12/duckdb:parquet 90302368 / 92297466 / -2.2% 129080728 / 134165233 / -3.8% 0.70 / 0.69 / +1.7%
clickbench_q13/duckdb:parquet 151941096 / 148548660 / +2.3% 206789137 / 212925083 / -2.9% 0.73 / 0.70 / +5.3%
clickbench_q14/duckdb:parquet 95267532 / 98623422 / -3.4% 143765466 / 150202275 / -4.3% 0.66 / 0.66 / +0.9%
clickbench_q15/duckdb:parquet 92180922 / 93204492 / -1.1% 119804077 / 123057030 / -2.6% 0.77 / 0.76 / +1.6%
clickbench_q16/duckdb:parquet 172096288 / 169008126 / +1.8% 234345814 / 223882619 / +4.7% 0.73 / 0.75 / -2.7%
clickbench_q17/duckdb:parquet 176576659 / 174437151 / +1.2% 235606397 / 238209254 / -1.1% 0.75 / 0.73 / +2.3%
clickbench_q18/duckdb:parquet 326585850 / 350360718 / -6.8% 430563528 / 404810112 / +6.4% 0.76 / 0.87 / -12.4%
clickbench_q19/duckdb:parquet 12997460 / 13547786 / -4.1% 44037971 / 42431168 / +3.8% 0.30 / 0.32 / -7.6%
clickbench_q20/duckdb:parquet 134813330 / 132269040 / +1.9% 243418746 / 238664658 / +2.0% 0.55 / 0.55 / -0.1%
clickbench_q21/duckdb:parquet 181993480 / 192201476 / -5.3% 318256896 / 324408478 / -1.9% 0.57 / 0.59 / -3.5%
clickbench_q22/duckdb:parquet 238259286 / 247934029 / -3.9% 420359429 / 411094460 / +2.3% 0.57 / 0.60 / -6.0%
clickbench_q23/duckdb:parquet 149562254 / 146921917 / +1.8% 173961980 / 176904484 / -1.7% 0.86 / 0.83 / +3.5%
clickbench_q24/duckdb:parquet 43431554 / 43817096 / -0.9% 60842869 / 58095497 / +4.7% 0.71 / 0.75 / -5.4%
clickbench_q25/duckdb:parquet 39894526 / 39484234 / +1.0% 93569472 / 89213326 / +4.9% 0.43 / 0.44 / -3.7%
clickbench_q26/duckdb:parquet 30554778 / 29189626 / +4.7% 47052442 / 43808309 / +7.4% 0.65 / 0.67 / -2.5%
clickbench_q27/duckdb:parquet 144758096 / 146029349 / -0.9% 260751717 / 250584032 / +4.1% 0.56 / 0.58 / -4.7%
clickbench_q28/duckdb:parquet 906585188 / 899963815 / +0.7% 1001009208 / 976580640 / +2.5% 0.91 / 0.92 / -1.7%
clickbench_q29/duckdb:parquet 17059104 / 17303426 / -1.4% 33046962 / 29995145 / +10.2% 🔴 0.52 / 0.58 / -10.5%
clickbench_q30/duckdb:parquet 90581258 / 93699655 / -3.3% 170610913 / 168576207 / +1.2% 0.53 / 0.56 / -4.5%
clickbench_q31/duckdb:parquet 143520246 / 152567084 / -5.9% 268392853 / 287056731 / -6.5% 0.53 / 0.53 / +0.6%
clickbench_q32/duckdb:parquet 453994051 / 457730114 / -0.8% 497380072 / 505729681 / -1.7% 0.91 / 0.91 / +0.8%
clickbench_q33/duckdb:parquet 453544650 / 456457618 / -0.6% 480979418 / 476071068 / +1.0% 0.94 / 0.96 / -1.7%
clickbench_q34/duckdb:parquet 465612694 / 472778125 / -1.5% 485300871 / 495016957 / -2.0% 0.96 / 0.96 / +0.5%
clickbench_q35/duckdb:parquet 101014848 / 102054308 / -1.0% 119825457 / 129849209 / -7.7% 0.84 / 0.79 / +7.3%
clickbench_q36/duckdb:parquet 32305514 / 30913964 / +4.5% 41095699 / 40598669 / +1.2% 0.79 / 0.76 / +3.2%
clickbench_q37/duckdb:parquet 22662636 / 23010107 / -1.5% 31635262 / 31360299 / +0.9% 0.72 / 0.73 / -2.4%
clickbench_q38/duckdb:parquet 23717844 / 23938236 / -0.9% 33946055 / 35251926 / -3.7% 0.70 / 0.68 / +2.9%
clickbench_q39/duckdb:parquet 56185988 / 57020960 / -1.5% 67042493 / 65734510 / +2.0% 0.84 / 0.87 / -3.4%
clickbench_q40/duckdb:parquet 12509988 / 12967466 / -3.5% 21658147 / 21853960 / -0.9% 0.58 / 0.59 / -2.7%
clickbench_q41/duckdb:parquet 12637474 / 12990480 / -2.7% 22548910 / 21715998 / +3.8% 0.56 / 0.60 / -6.3%
clickbench_q42/duckdb:parquet 13993643 / 14349692 / -2.5% 23210705 / 24020453 / -3.4% 0.60 / 0.60 / +0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24126928 / 24455806 / -1.3% 44564696 / 43926003 / +1.5% 0.54 / 0.56 / -2.8%
tpcds_q02/datafusion:vortex-file-compressed 45715629 / 45674174 / +0.1% 63262808 / 63753026 / -0.8% 0.72 / 0.72 / +0.9%
tpcds_q03/datafusion:vortex-file-compressed 11888150 / 11915451 / -0.2% 29413538 / 29642082 / -0.8% 0.40 / 0.40 / +0.5%
tpcds_q04/datafusion:vortex-file-compressed 114109037 / 113095915 / +0.9% 145717540 / 141541057 / +3.0% 0.78 / 0.80 / -2.0%
tpcds_q05/datafusion:vortex-file-compressed 60407310 / 60272012 / +0.2% 83041377 / 82267934 / +0.9% 0.73 / 0.73 / -0.7%
tpcds_q06/datafusion:vortex-file-compressed 23639604 / 23794687 / -0.7% 46057517 / 48186281 / -4.4% 0.51 / 0.49 / +3.9%
tpcds_q07/datafusion:vortex-file-compressed 32894370 / 33531127 / -1.9% 58290860 / 56658255 / +2.9% 0.56 / 0.59 / -4.6%
tpcds_q08/datafusion:vortex-file-compressed 25549864 / 25501596 / +0.2% 45188762 / 46008556 / -1.8% 0.57 / 0.55 / +2.0%
tpcds_q09/datafusion:vortex-file-compressed 17731700 / 16986904 / +4.4% 36431202 / 37024405 / -1.6% 0.49 / 0.46 / +6.1%
tpcds_q10/datafusion:vortex-file-compressed 29292004 / 29069648 / +0.8% 50998972 / 50918318 / +0.2% 0.57 / 0.57 / +0.6%
tpcds_q11/datafusion:vortex-file-compressed 63607768 / 63480121 / +0.2% 95244646 / 90229858 / +5.6% 0.67 / 0.70 / -5.1%
tpcds_q12/datafusion:vortex-file-compressed 16753692 / 16198120 / +3.4% 33421450 / 33577902 / -0.5% 0.50 / 0.48 / +3.9%
tpcds_q13/datafusion:vortex-file-compressed 34139450 / 34005542 / +0.4% 54526645 / 54021915 / +0.9% 0.63 / 0.63 / -0.5%
tpcds_q14/datafusion:vortex-file-compressed 92866110 / 92301594 / +0.6% 123678681 / 120799568 / +2.4% 0.75 / 0.76 / -1.7%
tpcds_q15/datafusion:vortex-file-compressed 23863692 / 23883885 / -0.1% 45040733 / 44358772 / +1.5% 0.53 / 0.54 / -1.6%
tpcds_q16/datafusion:vortex-file-compressed 20494423 / 20714822 / -1.1% 41930684 / 42552904 / -1.5% 0.49 / 0.49 / +0.4%
tpcds_q17/datafusion:vortex-file-compressed 62384826 / 54812686 / +13.8% 🔴 78394384 / 86095894 / -8.9% 0.80 / 0.64 / +25.0%
tpcds_q18/datafusion:vortex-file-compressed 70021384 / 68021632 / +2.9% 95418678 / 96211565 / -0.8% 0.73 / 0.71 / +3.8%
tpcds_q19/datafusion:vortex-file-compressed 18623004 / 18410822 / +1.2% 42623939 / 41860551 / +1.8% 0.44 / 0.44 / -0.7%
tpcds_q20/datafusion:vortex-file-compressed 17730388 / 18242716 / -2.8% 37531788 / 37277296 / +0.7% 0.47 / 0.49 / -3.5%
tpcds_q21/datafusion:vortex-file-compressed 17662546 / 17435224 / +1.3% 41092475 / 39971610 / +2.8% 0.43 / 0.44 / -1.5%
tpcds_q22/datafusion:vortex-file-compressed 49620473 / 50099784 / -1.0% 72409303 / 69248297 / +4.6% 0.69 / 0.72 / -5.3%
tpcds_q23/datafusion:vortex-file-compressed 72739174 / 72997840 / -0.4% 105297019 / 102285288 / +2.9% 0.69 / 0.71 / -3.2%
tpcds_q24/datafusion:vortex-file-compressed 70650553 / 70693210 / -0.1% 95921066 / 97662859 / -1.8% 0.74 / 0.72 / +1.8%
tpcds_q25/datafusion:vortex-file-compressed 55662316 / 52186239 / +6.7% 75847153 / 84563517 / -10.3% 🟢 0.73 / 0.62 / +18.9%
tpcds_q26/datafusion:vortex-file-compressed 30048734 / 29806298 / +0.8% 53256573 / 51231814 / +4.0% 0.56 / 0.58 / -3.0%
tpcds_q27/datafusion:vortex-file-compressed 62404650 / 64526599 / -3.3% 86896929 / 90218871 / -3.7% 0.72 / 0.72 / +0.4%
tpcds_q28/datafusion:vortex-file-compressed 18482438 / 17889322 / +3.3% 38878233 / 37874313 / +2.7% 0.48 / 0.47 / +0.6%
tpcds_q29/datafusion:vortex-file-compressed 58148763 / 55588428 / +4.6% 85140519 / 88679672 / -4.0% 0.68 / 0.63 / +9.0%
tpcds_q30/datafusion:vortex-file-compressed 27559464 / 27119308 / +1.6% 45458109 / 44959594 / +1.1% 0.61 / 0.60 / +0.5%
tpcds_q31/datafusion:vortex-file-compressed 64731426 / 64311210 / +0.7% 92995226 / 94013595 / -1.1% 0.70 / 0.68 / +1.8%
tpcds_q32/datafusion:vortex-file-compressed 13476232 / 13556327 / -0.6% 32487424 / 33732301 / -3.7% 0.41 / 0.40 / +3.2%
tpcds_q33/datafusion:vortex-file-compressed 26985039 / 27089624 / -0.4% 50710764 / 49763657 / +1.9% 0.53 / 0.54 / -2.2%
tpcds_q34/datafusion:vortex-file-compressed 18625584 / 18314488 / +1.7% 40054839 / 40563403 / -1.3% 0.47 / 0.45 / +3.0%
tpcds_q35/datafusion:vortex-file-compressed 35269512 / 35268110 / +0.0% 59495427 / 59285340 / +0.4% 0.59 / 0.59 / -0.3%
tpcds_q36/datafusion:vortex-file-compressed 48429554 / 48898160 / -1.0% 75247049 / 70776309 / +6.3% 0.64 / 0.69 / -6.8%
tpcds_q37/datafusion:vortex-file-compressed 13731489 / 13571660 / +1.2% 35120822 / 35911800 / -2.2% 0.39 / 0.38 / +3.5%
tpcds_q38/datafusion:vortex-file-compressed 29910472 / 29377410 / +1.8% 53185614 / 52482514 / +1.3% 0.56 / 0.56 / +0.5%
tpcds_q39/datafusion:vortex-file-compressed 65712351 / 64594038 / +1.7% 90759450 / 91862882 / -1.2% 0.72 / 0.70 / +3.0%
tpcds_q40/datafusion:vortex-file-compressed 25034320 / 25034572 / -0.0% 47985231 / 46027171 / +4.3% 0.52 / 0.54 / -4.1%
tpcds_q41/datafusion:vortex-file-compressed 16489848 / 16477393 / +0.1% 31732888 / 30784625 / +3.1% 0.52 / 0.54 / -2.9%
tpcds_q42/datafusion:vortex-file-compressed 11493983 / 11127880 / +3.3% 29946578 / 28593550 / +4.7% 0.38 / 0.39 / -1.4%
tpcds_q43/datafusion:vortex-file-compressed 13428301 / 13432176 / -0.0% 34271181 / 32927053 / +4.1% 0.39 / 0.41 / -3.9%
tpcds_q44/datafusion:vortex-file-compressed 26473820 / 27114528 / -2.4% 52279667 / 52270606 / +0.0% 0.51 / 0.52 / -2.4%
tpcds_q45/datafusion:vortex-file-compressed 27935800 / 27143412 / +2.9% 49455668 / 48691235 / +1.6% 0.56 / 0.56 / +1.3%
tpcds_q46/datafusion:vortex-file-compressed 24426046 / 24484626 / -0.2% 48301054 / 49826621 / -3.1% 0.51 / 0.49 / +2.9%
tpcds_q47/datafusion:vortex-file-compressed 77990000 / 77625464 / +0.5% 107344673 / 105923212 / +1.3% 0.73 / 0.73 / -0.9%
tpcds_q48/datafusion:vortex-file-compressed 31309375 / 31405528 / -0.3% 52578948 / 51967314 / +1.2% 0.60 / 0.60 / -1.5%
tpcds_q49/datafusion:vortex-file-compressed 59311112 / 59452733 / -0.2% 82990075 / 93021379 / -10.8% 🟢 0.71 / 0.64 / +11.8%
tpcds_q50/datafusion:vortex-file-compressed 34756112 / 34062964 / +2.0% 56051865 / 56652512 / -1.1% 0.62 / 0.60 / +3.1%
tpcds_q51/datafusion:vortex-file-compressed 61084226 / 60989536 / +0.2% 84850087 / 85697077 / -1.0% 0.72 / 0.71 / +1.2%
tpcds_q52/datafusion:vortex-file-compressed 11745411 / 11802838 / -0.5% 29053246 / 30141310 / -3.6% 0.40 / 0.39 / +3.2%
tpcds_q53/datafusion:vortex-file-compressed 18738352 / 18712274 / +0.1% 39540433 / 38101854 / +3.8% 0.47 / 0.49 / -3.5%
tpcds_q54/datafusion:vortex-file-compressed 34283096 / 34517595 / -0.7% 59844745 / 61856600 / -3.3% 0.57 / 0.56 / +2.7%
tpcds_q55/datafusion:vortex-file-compressed 11156182 / 11324876 / -1.5% 28996241 / 29653081 / -2.2% 0.38 / 0.38 / +0.7%
tpcds_q56/datafusion:vortex-file-compressed 26945923 / 27030761 / -0.3% 49949560 / 48964657 / +2.0% 0.54 / 0.55 / -2.3%
tpcds_q57/datafusion:vortex-file-compressed 73799506 / 73203078 / +0.8% 98299636 / 98802209 / -0.5% 0.75 / 0.74 / +1.3%
tpcds_q58/datafusion:vortex-file-compressed 40721432 / 40620619 / +0.2% 67478887 / 67523734 / -0.1% 0.60 / 0.60 / +0.3%
tpcds_q59/datafusion:vortex-file-compressed 32390160 / 32323617 / +0.2% 54943793 / 53213258 / +3.3% 0.59 / 0.61 / -3.0%
tpcds_q60/datafusion:vortex-file-compressed 26763344 / 26585146 / +0.7% 49994415 / 49691959 / +0.6% 0.54 / 0.53 / +0.1%
tpcds_q61/datafusion:vortex-file-compressed 24724493 / 24699118 / +0.1% 48038479 / 48623658 / -1.2% 0.51 / 0.51 / +1.3%
tpcds_q62/datafusion:vortex-file-compressed 17223456 / 17088875 / +0.8% 37122304 / 37487208 / -1.0% 0.46 / 0.46 / +1.8%
tpcds_q63/datafusion:vortex-file-compressed 18409540 / 18422747 / -0.1% 39224584 / 38835155 / +1.0% 0.47 / 0.47 / -1.1%
tpcds_q64/datafusion:vortex-file-compressed 323426044 / 325556184 / -0.7% 354801582 / 359671481 / -1.4% 0.91 / 0.91 / +0.7%
tpcds_q65/datafusion:vortex-file-compressed 75566038 / 75461286 / +0.1% 97685263 / 97378230 / +0.3% 0.77 / 0.77 / -0.2%
tpcds_q66/datafusion:vortex-file-compressed 53115188 / 53341564 / -0.4% 77196661 / 77929718 / -0.9% 0.69 / 0.68 / +0.5%
tpcds_q67/datafusion:vortex-file-compressed 55820496 / 55009356 / +1.5% 86784794 / 85559208 / +1.4% 0.64 / 0.64 / +0.0%
tpcds_q68/datafusion:vortex-file-compressed 24213140 / 24170380 / +0.2% 48030969 / 47623484 / +0.9% 0.50 / 0.51 / -0.7%
tpcds_q69/datafusion:vortex-file-compressed 29286168 / 27877012 / +5.1% 50572242 / 48692393 / +3.9% 0.58 / 0.57 / +1.1%
tpcds_q70/datafusion:vortex-file-compressed 71368420 / 71406412 / -0.1% 94952499 / 96071856 / -1.2% 0.75 / 0.74 / +1.1%
tpcds_q71/datafusion:vortex-file-compressed 19308046 / 19861291 / -2.8% 39840198 / 40529510 / -1.7% 0.48 / 0.49 / -1.1%
tpcds_q72/datafusion:vortex-file-compressed 465166628 / 464743610 / +0.1% 493313221 / 496804851 / -0.7% 0.94 / 0.94 / +0.8%
tpcds_q73/datafusion:vortex-file-compressed 17540492 / 17527317 / +0.1% 39156941 / 38406275 / +2.0% 0.45 / 0.46 / -1.8%
tpcds_q74/datafusion:vortex-file-compressed 45222718 / 44958119 / +0.6% 71318499 / 71317365 / +0.0% 0.63 / 0.63 / +0.6%
tpcds_q75/datafusion:vortex-file-compressed 131654588 / 131944185 / -0.2% 164560604 / 159692915 / +3.0% 0.80 / 0.83 / -3.2%
tpcds_q76/datafusion:vortex-file-compressed 44160279 / 44772150 / -1.4% 64972735 / 66402402 / -2.2% 0.68 / 0.67 / +0.8%
tpcds_q77/datafusion:vortex-file-compressed 35157477 / 33574820 / +4.7% 62041123 / 60617309 / +2.3% 0.57 / 0.55 / +2.3%
tpcds_q78/datafusion:vortex-file-compressed 80016563 / 79746558 / +0.3% 111522452 / 110173092 / +1.2% 0.72 / 0.72 / -0.9%
tpcds_q79/datafusion:vortex-file-compressed 21199797 / 21127389 / +0.3% 45269342 / 44960904 / +0.7% 0.47 / 0.47 / -0.3%
tpcds_q80/datafusion:vortex-file-compressed 76392251 / 76854732 / -0.6% 110481762 / 109016056 / +1.3% 0.69 / 0.70 / -1.9%
tpcds_q81/datafusion:vortex-file-compressed 28195476 / 27886558 / +1.1% 46856412 / 48140170 / -2.7% 0.60 / 0.58 / +3.9%
tpcds_q82/datafusion:vortex-file-compressed 13996298 / 12765018 / +9.6% 36530263 / 35910846 / +1.7% 0.38 / 0.36 / +7.8%
tpcds_q83/datafusion:vortex-file-compressed 36749047 / 36027390 / +2.0% 58969665 / 58013539 / +1.6% 0.62 / 0.62 / +0.3%
tpcds_q84/datafusion:vortex-file-compressed 12190010 / 11873246 / +2.7% 29751359 / 29550479 / +0.7% 0.41 / 0.40 / +2.0%
tpcds_q85/datafusion:vortex-file-compressed 59342867 / 59229739 / +0.2% 84535703 / 84724947 / -0.2% 0.70 / 0.70 / +0.4%
tpcds_q86/datafusion:vortex-file-compressed 16565536 / 16636298 / -0.4% 34182424 / 34013502 / +0.5% 0.48 / 0.49 / -0.9%
tpcds_q87/datafusion:vortex-file-compressed 29813018 / 29836948 / -0.1% 52522616 / 53305846 / -1.5% 0.57 / 0.56 / +1.4%
tpcds_q88/datafusion:vortex-file-compressed 34259146 / 34298074 / -0.1% 64199258 / 61497756 / +4.4% 0.53 / 0.56 / -4.3%
tpcds_q89/datafusion:vortex-file-compressed 21088170 / 21088624 / -0.0% 42659973 / 42671133 / -0.0% 0.49 / 0.49 / +0.0%
tpcds_q90/datafusion:vortex-file-compressed 10309588 / 10177534 / +1.3% 27383722 / 27960005 / -2.1% 0.38 / 0.36 / +3.4%
tpcds_q91/datafusion:vortex-file-compressed 16624088 / 17249626 / -3.6% 36374499 / 36102863 / +0.8% 0.46 / 0.48 / -4.3%
tpcds_q92/datafusion:vortex-file-compressed 13826884 / 13771622 / +0.4% 33136407 / 33228513 / -0.3% 0.42 / 0.41 / +0.7%
tpcds_q93/datafusion:vortex-file-compressed 23889184 / 23434864 / +1.9% 46990323 / 47827455 / -1.8% 0.51 / 0.49 / +3.8%
tpcds_q94/datafusion:vortex-file-compressed 20194872 / 19625468 / +2.9% 39772210 / 40152062 / -0.9% 0.51 / 0.49 / +3.9%
tpcds_q95/datafusion:vortex-file-compressed 46096334 / 46096948 / -0.0% 69130085 / 70263606 / -1.6% 0.67 / 0.66 / +1.6%
tpcds_q96/datafusion:vortex-file-compressed 8803368 / 9333683 / -5.7% 26601836 / 25553241 / +4.1% 0.33 / 0.37 / -9.4%
tpcds_q97/datafusion:vortex-file-compressed 21357243 / 21087382 / +1.3% 45540176 / 44111968 / +3.2% 0.47 / 0.48 / -1.9%
tpcds_q98/datafusion:vortex-file-compressed 16947772 / 17076336 / -0.8% 37232254 / 37673999 / -1.2% 0.46 / 0.45 / +0.4%
tpcds_q99/datafusion:vortex-file-compressed 19264901 / 19494663 / -1.2% 39700840 / 38945092 / +1.9% 0.49 / 0.50 / -3.1%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 26129901 / 25684756 / +1.7% 46323245 / 45587278 / +1.6% 0.56 / 0.56 / +0.1%
tpcds_q02/datafusion:vortex-compact 48680736 / 48544317 / +0.3% 67956265 / 68590282 / -0.9% 0.72 / 0.71 / +1.2%
tpcds_q03/datafusion:vortex-compact 13231500 / 13120416 / +0.8% 33732620 / 36128223 / -6.6% 0.39 / 0.36 / +8.0%
tpcds_q04/datafusion:vortex-compact 125456711 / 123206096 / +1.8% 152057223 / 152255484 / -0.1% 0.83 / 0.81 / +2.0%
tpcds_q05/datafusion:vortex-compact 62506214 / 62122727 / +0.6% 85331474 / 86373649 / -1.2% 0.73 / 0.72 / +1.8%
tpcds_q06/datafusion:vortex-compact 26045520 / 25879039 / +0.6% 49159591 / 48048172 / +2.3% 0.53 / 0.54 / -1.6%
tpcds_q07/datafusion:vortex-compact 35242232 / 35520727 / -0.8% 57915604 / 56909902 / +1.8% 0.61 / 0.62 / -2.5%
tpcds_q08/datafusion:vortex-compact 29913890 / 30449356 / -1.8% 48991064 / 50452817 / -2.9% 0.61 / 0.60 / +1.2%
tpcds_q09/datafusion:vortex-compact 21985846 / 22121563 / -0.6% 39709956 / 42118708 / -5.7% 0.55 / 0.53 / +5.4%
tpcds_q10/datafusion:vortex-compact 36805959 / 37914942 / -2.9% 62157752 / 60328190 / +3.0% 0.59 / 0.63 / -5.8%
tpcds_q11/datafusion:vortex-compact 68302680 / 68194529 / +0.2% 94672317 / 93201503 / +1.6% 0.72 / 0.73 / -1.4%
tpcds_q12/datafusion:vortex-compact 20768168 / 20859076 / -0.4% 39884543 / 40627157 / -1.8% 0.52 / 0.51 / +1.4%
tpcds_q13/datafusion:vortex-compact 56120190 / 56088113 / +0.1% 74176223 / 74484100 / -0.4% 0.76 / 0.75 / +0.5%
tpcds_q14/datafusion:vortex-compact 96831791 / 98308066 / -1.5% 122862106 / 126370049 / -2.8% 0.79 / 0.78 / +1.3%
tpcds_q15/datafusion:vortex-compact 27035197 / 27102734 / -0.2% 46891302 / 48767774 / -3.8% 0.58 / 0.56 / +3.7%
tpcds_q16/datafusion:vortex-compact 23948083 / 23204406 / +3.2% 43294774 / 43816582 / -1.2% 0.55 / 0.53 / +4.4%
tpcds_q17/datafusion:vortex-compact 67284478 / 64009634 / +5.1% 93492987 / 94663535 / -1.2% 0.72 / 0.68 / +6.4%
tpcds_q18/datafusion:vortex-compact 68688954 / 68786259 / -0.1% 95764732 / 93161840 / +2.8% 0.72 / 0.74 / -2.9%
tpcds_q19/datafusion:vortex-compact 22778848 / 21770630 / +4.6% 43375675 / 43553057 / -0.4% 0.53 / 0.50 / +5.1%
tpcds_q20/datafusion:vortex-compact 22460256 / 22114570 / +1.6% 42330302 / 43545699 / -2.8% 0.53 / 0.51 / +4.5%
tpcds_q21/datafusion:vortex-compact 18703041 / 18473234 / +1.2% 42953567 / 43767992 / -1.9% 0.44 / 0.42 / +3.2%
tpcds_q22/datafusion:vortex-compact 50773338 / 50016964 / +1.5% 74080056 / 74434569 / -0.5% 0.69 / 0.67 / +2.0%
tpcds_q23/datafusion:vortex-compact 75992506 / 76999880 / -1.3% 105548623 / 105628856 / -0.1% 0.72 / 0.73 / -1.2%
tpcds_q24/datafusion:vortex-compact 78641098 / 78169043 / +0.6% 103237761 / 103003157 / +0.2% 0.76 / 0.76 / +0.4%
tpcds_q25/datafusion:vortex-compact 59200485 / 58407151 / +1.4% 91860906 / 89906479 / +2.2% 0.64 / 0.65 / -0.8%
tpcds_q26/datafusion:vortex-compact 32812155 / 33365690 / -1.7% 51651088 / 55391891 / -6.8% 0.64 / 0.60 / +5.5%
tpcds_q27/datafusion:vortex-compact 64532278 / 62546724 / +3.2% 93924714 / 88706841 / +5.9% 0.69 / 0.71 / -2.6%
tpcds_q28/datafusion:vortex-compact 28130520 / 28556408 / -1.5% 50141348 / 52311234 / -4.1% 0.56 / 0.55 / +2.8%
tpcds_q29/datafusion:vortex-compact 61508284 / 67001812 / -8.2% 96874659 / 92722002 / +4.5% 0.63 / 0.72 / -12.1%
tpcds_q30/datafusion:vortex-compact 30776276 / 30839776 / -0.2% 49189707 / 48970898 / +0.4% 0.63 / 0.63 / -0.6%
tpcds_q31/datafusion:vortex-compact 76987204 / 76805196 / +0.2% 105844412 / 99796697 / +6.1% 0.73 / 0.77 / -5.5%
tpcds_q32/datafusion:vortex-compact 16948718 / 16530618 / +2.5% 36792315 / 37289919 / -1.3% 0.46 / 0.44 / +3.9%
tpcds_q33/datafusion:vortex-compact 29763703 / 28931324 / +2.9% 51707021 / 52809914 / -2.1% 0.58 / 0.55 / +5.1%
tpcds_q34/datafusion:vortex-compact 22210398 / 21200878 / +4.8% 42468115 / 42115917 / +0.8% 0.52 / 0.50 / +3.9%
tpcds_q35/datafusion:vortex-compact 43209648 / 41732230 / +3.5% 69091911 / 66639940 / +3.7% 0.63 / 0.63 / -0.1%
tpcds_q36/datafusion:vortex-compact 51816658 / 52017322 / -0.4% 79411541 / 76964311 / +3.2% 0.65 / 0.68 / -3.5%
tpcds_q37/datafusion:vortex-compact 15522360 / 15954794 / -2.7% 38083718 / 39212416 / -2.9% 0.41 / 0.41 / +0.2%
tpcds_q38/datafusion:vortex-compact 34102164 / 33970122 / +0.4% 56323651 / 56982349 / -1.2% 0.61 / 0.60 / +1.6%
tpcds_q39/datafusion:vortex-compact 67682136 / 66347246 / +2.0% 90617754 / 89742432 / +1.0% 0.75 / 0.74 / +1.0%
tpcds_q40/datafusion:vortex-compact 27893130 / 28274514 / -1.3% 51383153 / 51193828 / +0.4% 0.54 / 0.55 / -1.7%
tpcds_q41/datafusion:vortex-compact 19072986 / 19169025 / -0.5% 33515034 / 34223617 / -2.1% 0.57 / 0.56 / +1.6%
tpcds_q42/datafusion:vortex-compact 12362828 / 13137650 / -5.9% 35006466 / 34509042 / +1.4% 0.35 / 0.38 / -7.2%
tpcds_q43/datafusion:vortex-compact 16266701 / 14864954 / +9.4% 34762876 / 36625041 / -5.1% 0.47 / 0.41 / +15.3%
tpcds_q44/datafusion:vortex-compact 30127465 / 30394752 / -0.9% 53056326 / 56391309 / -5.9% 0.57 / 0.54 / +5.4%
tpcds_q45/datafusion:vortex-compact 30542603 / 31186260 / -2.1% 50457941 / 50764061 / -0.6% 0.61 / 0.61 / -1.5%
tpcds_q46/datafusion:vortex-compact 28049226 / 28219442 / -0.6% 54615060 / 51275818 / +6.5% 0.51 / 0.55 / -6.7%
tpcds_q47/datafusion:vortex-compact 89880332 / 89257690 / +0.7% 117917632 / 116450651 / +1.3% 0.76 / 0.77 / -0.6%
tpcds_q48/datafusion:vortex-compact 50829054 / 50972680 / -0.3% 68395445 / 70861228 / -3.5% 0.74 / 0.72 / +3.3%
tpcds_q49/datafusion:vortex-compact 66018764 / 64636682 / +2.1% 95205340 / 95553233 / -0.4% 0.69 / 0.68 / +2.5%
tpcds_q50/datafusion:vortex-compact 38957158 / 38809584 / +0.4% 57498012 / 57607535 / -0.2% 0.68 / 0.67 / +0.6%
tpcds_q51/datafusion:vortex-compact 63376464 / 63082502 / +0.5% 89581251 / 87478983 / +2.4% 0.71 / 0.72 / -1.9%
tpcds_q52/datafusion:vortex-compact 13809766 / 12890912 / +7.1% 34262964 / 32946321 / +4.0% 0.40 / 0.39 / +3.0%
tpcds_q53/datafusion:vortex-compact 23389009 / 23036008 / +1.5% 45377964 / 43670320 / +3.9% 0.52 / 0.53 / -2.3%
tpcds_q54/datafusion:vortex-compact 39831991 / 39816682 / +0.0% 67066781 / 65221893 / +2.8% 0.59 / 0.61 / -2.7%
tpcds_q55/datafusion:vortex-compact 12568070 / 12148100 / +3.5% 31923520 / 33374713 / -4.3% 0.39 / 0.36 / +8.2%
tpcds_q56/datafusion:vortex-compact 28104535 / 29000552 / -3.1% 51777610 / 51612115 / +0.3% 0.54 / 0.56 / -3.4%
tpcds_q57/datafusion:vortex-compact 79952672 / 81448236 / -1.8% 108315238 / 105968456 / +2.2% 0.74 / 0.77 / -4.0%
tpcds_q58/datafusion:vortex-compact 48654977 / 47605520 / +2.2% 74574874 / 73261411 / +1.8% 0.65 / 0.65 / +0.4%
tpcds_q59/datafusion:vortex-compact 40850818 / 40731844 / +0.3% 61045213 / 59095596 / +3.3% 0.67 / 0.69 / -2.9%
tpcds_q60/datafusion:vortex-compact 29849690 / 28562545 / +4.5% 52010528 / 51675407 / +0.6% 0.57 / 0.55 / +3.8%
tpcds_q61/datafusion:vortex-compact 28565342 / 27492796 / +3.9% 49179515 / 49285883 / -0.2% 0.58 / 0.56 / +4.1%
tpcds_q62/datafusion:vortex-compact 18006816 / 18331778 / -1.8% 36835054 / 37031392 / -0.5% 0.49 / 0.50 / -1.2%
tpcds_q63/datafusion:vortex-compact 21632752 / 22244018 / -2.7% 42217429 / 43517655 / -3.0% 0.51 / 0.51 / +0.2%
tpcds_q64/datafusion:vortex-compact 447181177 / 451217196 / -0.9% 463914330 / 451967128 / +2.6% 0.96 / 1.00 / -3.4%
tpcds_q65/datafusion:vortex-compact 81610402 / 78871284 / +3.5% 102705474 / 102379239 / +0.3% 0.79 / 0.77 / +3.1%
tpcds_q66/datafusion:vortex-compact 54943128 / 55639873 / -1.3% 77110361 / 81285644 / -5.1% 0.71 / 0.68 / +4.1%
tpcds_q67/datafusion:vortex-compact 60645704 / 60475102 / +0.3% 88934106 / 90275245 / -1.5% 0.68 / 0.67 / +1.8%
tpcds_q68/datafusion:vortex-compact 27626486 / 30572460 / -9.6% 51933174 / 52171187 / -0.5% 0.53 / 0.59 / -9.2%
tpcds_q69/datafusion:vortex-compact 36475593 / 38034654 / -4.1% 60592302 / 58924497 / +2.8% 0.60 / 0.65 / -6.7%
tpcds_q70/datafusion:vortex-compact 76109347 / 76129079 / -0.0% 93854759 / 96052706 / -2.3% 0.81 / 0.79 / +2.3%
tpcds_q71/datafusion:vortex-compact 20374746 / 21040424 / -3.2% 43881803 / 43906822 / -0.1% 0.46 / 0.48 / -3.1%
tpcds_q72/datafusion:vortex-compact 462665522 / 471883128 / -2.0% 494436296 / 487118741 / +1.5% 0.94 / 0.97 / -3.4%
tpcds_q73/datafusion:vortex-compact 19663835 / 19710982 / -0.2% 40848040 / 41170457 / -0.8% 0.48 / 0.48 / +0.5%
tpcds_q74/datafusion:vortex-compact 51604986 / 50939776 / +1.3% 72503269 / 77002144 / -5.8% 0.71 / 0.66 / +7.6%
tpcds_q75/datafusion:vortex-compact 140778580 / 138973633 / +1.3% 168260600 / 166090230 / +1.3% 0.84 / 0.84 / -0.0%
tpcds_q76/datafusion:vortex-compact 40990903 / 42085486 / -2.6% 61100634 / 62123965 / -1.6% 0.67 / 0.68 / -1.0%
tpcds_q77/datafusion:vortex-compact 37772804 / 38480404 / -1.8% 64908732 / 64022418 / +1.4% 0.58 / 0.60 / -3.2%
tpcds_q78/datafusion:vortex-compact 87267358 / 86730993 / +0.6% 118034777 / 114301648 / +3.3% 0.74 / 0.76 / -2.6%
tpcds_q79/datafusion:vortex-compact 24375733 / 24143156 / +1.0% 45407642 / 51499726 / -11.8% 🟢 0.54 / 0.47 / +14.5%
tpcds_q80/datafusion:vortex-compact 78790788 / 79148726 / -0.5% 109023961 / 109418102 / -0.4% 0.72 / 0.72 / -0.1%
tpcds_q81/datafusion:vortex-compact 30194056 / 29902184 / +1.0% 48240382 / 46779669 / +3.1% 0.63 / 0.64 / -2.1%
tpcds_q82/datafusion:vortex-compact 15937853 / 15723460 / +1.4% 39717448 / 37493902 / +5.9% 0.40 / 0.42 / -4.3%
tpcds_q83/datafusion:vortex-compact 36506716 / 36985300 / -1.3% 60697219 / 61432885 / -1.2% 0.60 / 0.60 / -0.1%
tpcds_q84/datafusion:vortex-compact 13155079 / 12864839 / +2.3% 29811773 / 29390715 / +1.4% 0.44 / 0.44 / +0.8%
tpcds_q85/datafusion:vortex-compact 103705416 / 107191252 / -3.3% 128599210 / 128336287 / +0.2% 0.81 / 0.84 / -3.4%
tpcds_q86/datafusion:vortex-compact 17165270 / 16888082 / +1.6% 37061481 / 36934234 / +0.3% 0.46 / 0.46 / +1.3%
tpcds_q87/datafusion:vortex-compact 33854769 / 33375838 / +1.4% 58155881 / 57738369 / +0.7% 0.58 / 0.58 / +0.7%
tpcds_q88/datafusion:vortex-compact 41290184 / 42213244 / -2.2% 67147636 / 69221758 / -3.0% 0.61 / 0.61 / +0.8%
tpcds_q89/datafusion:vortex-compact 25128149 / 26125424 / -3.8% 47745627 / 48822385 / -2.2% 0.53 / 0.54 / -1.6%
tpcds_q90/datafusion:vortex-compact 11644985 / 11314350 / +2.9% 28603759 / 30194412 / -5.3% 0.41 / 0.37 / +8.6%
tpcds_q91/datafusion:vortex-compact 27437536 / 27183252 / +0.9% 47630643 / 48036357 / -0.8% 0.58 / 0.57 / +1.8%
tpcds_q92/datafusion:vortex-compact 15646034 / 15881114 / -1.5% 35506455 / 34551617 / +2.8% 0.44 / 0.46 / -4.1%
tpcds_q93/datafusion:vortex-compact 25163400 / 25763932 / -2.3% 47099871 / 46779103 / +0.7% 0.53 / 0.55 / -3.0%
tpcds_q94/datafusion:vortex-compact 21997022 / 22676998 / -3.0% 41614245 / 41978421 / -0.9% 0.53 / 0.54 / -2.1%
tpcds_q95/datafusion:vortex-compact 50651746 / 50176636 / +0.9% 70586910 / 71289521 / -1.0% 0.72 / 0.70 / +2.0%
tpcds_q96/datafusion:vortex-compact 10687970 / 10278508 / +4.0% 26864180 / 26423989 / +1.7% 0.40 / 0.39 / +2.3%
tpcds_q97/datafusion:vortex-compact 24357424 / 24224339 / +0.5% 45869623 / 46628901 / -1.6% 0.53 / 0.52 / +2.2%
tpcds_q98/datafusion:vortex-compact 22491684 / 21922124 / +2.6% 45088618 / 43301219 / +4.1% 0.50 / 0.51 / -1.5%
tpcds_q99/datafusion:vortex-compact 21103064 / 20827731 / +1.3% 40602719 / 40882737 / -0.7% 0.52 / 0.51 / +2.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31083284 / 31304212 / -0.7% 51388132 / 51195599 / +0.4% 0.60 / 0.61 / -1.1%
tpcds_q02/datafusion:parquet 39257972 / 40119780 / -2.1% 58322488 / 58700592 / -0.6% 0.67 / 0.68 / -1.5%
tpcds_q03/datafusion:parquet 16368746 / 16140538 / +1.4% 32854708 / 30944191 / +6.2% 0.50 / 0.52 / -4.5%
tpcds_q04/datafusion:parquet 199870309 / 199667802 / +0.1% 229862895 / 225312782 / +2.0% 0.87 / 0.89 / -1.9%
tpcds_q05/datafusion:parquet 73428624 / 73924792 / -0.7% 97417538 / 96681688 / +0.8% 0.75 / 0.76 / -1.4%
tpcds_q06/datafusion:parquet 27901654 / 28007998 / -0.4% 50886067 / 50327529 / +1.1% 0.55 / 0.56 / -1.5%
tpcds_q07/datafusion:parquet 46531072 / 46876126 / -0.7% 69294652 / 68286541 / +1.5% 0.67 / 0.69 / -2.2%
tpcds_q08/datafusion:parquet 31392480 / 30250328 / +3.8% 50144868 / 49329490 / +1.7% 0.63 / 0.61 / +2.1%
tpcds_q09/datafusion:parquet 30409418 / 31943758 / -4.8% 42415014 / 42938123 / -1.2% 0.72 / 0.74 / -3.6%
tpcds_q10/datafusion:parquet 42610605 / 41261696 / +3.3% 62879949 / 60649803 / +3.7% 0.68 / 0.68 / -0.4%
tpcds_q11/datafusion:parquet 95063400 / 96469814 / -1.5% 119566085 / 120910047 / -1.1% 0.80 / 0.80 / -0.4%
tpcds_q12/datafusion:parquet 21422612 / 21573977 / -0.7% 36579898 / 36241324 / +0.9% 0.59 / 0.60 / -1.6%
tpcds_q13/datafusion:parquet 41517092 / 42952358 / -3.3% 69551116 / 68877679 / +1.0% 0.60 / 0.62 / -4.3%
tpcds_q14/datafusion:parquet 127303355 / 128768888 / -1.1% 153122786 / 148583489 / +3.1% 0.83 / 0.87 / -4.1%
tpcds_q15/datafusion:parquet 33229438 / 32540732 / +2.1% 50575777 / 50154902 / +0.8% 0.66 / 0.65 / +1.3%
tpcds_q16/datafusion:parquet 37437016 / 37389275 / +0.1% 54816516 / 55267752 / -0.8% 0.68 / 0.68 / +1.0%
tpcds_q17/datafusion:parquet 78458153 / 77565962 / +1.2% 105509799 / 105046725 / +0.4% 0.74 / 0.74 / +0.7%
tpcds_q18/datafusion:parquet 57788098 / 61895112 / -6.6% 85737164 / 81527262 / +5.2% 0.67 / 0.76 / -11.2%
tpcds_q19/datafusion:parquet 26435129 / 26134229 / +1.2% 46659990 / 48881265 / -4.5% 0.57 / 0.53 / +6.0%
tpcds_q20/datafusion:parquet 23522767 / 23163366 / +1.6% 38798045 / 37317430 / +4.0% 0.61 / 0.62 / -2.3%
tpcds_q21/datafusion:parquet 17920286 / 17863284 / +0.3% 33139459 / 33009353 / +0.4% 0.54 / 0.54 / -0.1%
tpcds_q22/datafusion:parquet 76685838 / 76014529 / +0.9% 92001352 / 90351647 / +1.8% 0.83 / 0.84 / -0.9%
tpcds_q23/datafusion:parquet 110123353 / 110083508 / +0.0% 139443788 / 144517195 / -3.5% 0.79 / 0.76 / +3.7%
tpcds_q24/datafusion:parquet 95740086 / 96061702 / -0.3% 125800165 / 121703965 / +3.4% 0.76 / 0.79 / -3.6%
tpcds_q25/datafusion:parquet 78613282 / 78720682 / -0.1% 106371779 / 104329953 / +2.0% 0.74 / 0.75 / -2.1%
tpcds_q26/datafusion:parquet 44114840 / 44212340 / -0.2% 64029419 / 62571654 / +2.3% 0.69 / 0.71 / -2.5%
tpcds_q27/datafusion:parquet 73340001 / 73065002 / +0.4% 96701243 / 101719339 / -4.9% 0.76 / 0.72 / +5.6%
tpcds_q28/datafusion:parquet 27283424 / 27253180 / +0.1% 45736519 / 44887192 / +1.9% 0.60 / 0.61 / -1.7%
tpcds_q29/datafusion:parquet 79221051 / 79406222 / -0.2% 104666868 / 102845463 / +1.8% 0.76 / 0.77 / -2.0%
tpcds_q30/datafusion:parquet 45589768 / 43690196 / +4.3% 67436853 / 67143591 / +0.4% 0.68 / 0.65 / +3.9%
tpcds_q31/datafusion:parquet 79893378 / 79673196 / +0.3% 103489233 / 100970484 / +2.5% 0.77 / 0.79 / -2.2%
tpcds_q32/datafusion:parquet 23001834 / 23714986 / -3.0% 40596963 / 40888309 / -0.7% 0.57 / 0.58 / -2.3%
tpcds_q33/datafusion:parquet 33164484 / 33452826 / -0.9% 51408488 / 52684531 / -2.4% 0.65 / 0.63 / +1.6%
tpcds_q34/datafusion:parquet 22983965 / 23066430 / -0.4% 38876313 / 38278758 / +1.6% 0.59 / 0.60 / -1.9%
tpcds_q35/datafusion:parquet 49570654 / 49594580 / -0.0% 70849471 / 70658572 / +0.3% 0.70 / 0.70 / -0.3%
tpcds_q36/datafusion:parquet 53038696 / 53087238 / -0.1% 73760815 / 73489732 / +0.4% 0.72 / 0.72 / -0.5%
tpcds_q37/datafusion:parquet 22998827 / 23159982 / -0.7% 38579656 / 38492264 / +0.2% 0.60 / 0.60 / -0.9%
tpcds_q38/datafusion:parquet 44373096 / 43990517 / +0.9% 63962703 / 63836096 / +0.2% 0.69 / 0.69 / +0.7%
tpcds_q39/datafusion:parquet 72930963 / 71302566 / +2.3% 91509018 / 87864137 / +4.1% 0.80 / 0.81 / -1.8%
tpcds_q40/datafusion:parquet 30388626 / 30511280 / -0.4% 49858101 / 50465084 / -1.2% 0.61 / 0.60 / +0.8%
tpcds_q41/datafusion:parquet 17358630 / 17288707 / +0.4% 29817861 / 28972377 / +2.9% 0.58 / 0.60 / -2.4%
tpcds_q42/datafusion:parquet 15606864 / 15192428 / +2.7% 30533869 / 29564701 / +3.3% 0.51 / 0.51 / -0.5%
tpcds_q43/datafusion:parquet 17198456 / 17558350 / -2.0% 33694126 / 32315013 / +4.3% 0.51 / 0.54 / -6.1%
tpcds_q44/datafusion:parquet 33550298 / 32968790 / +1.8% 53624865 / 52059542 / +3.0% 0.63 / 0.63 / -1.2%
tpcds_q45/datafusion:parquet 37513884 / 37554166 / -0.1% 56079638 / 56080884 / -0.0% 0.67 / 0.67 / -0.1%
tpcds_q46/datafusion:parquet 28661078 / 28718874 / -0.2% 51088636 / 49939906 / +2.3% 0.56 / 0.58 / -2.4%
tpcds_q47/datafusion:parquet 97039754 / 96716664 / +0.3% 125798393 / 123201328 / +2.1% 0.77 / 0.79 / -1.7%
tpcds_q48/datafusion:parquet 38344598 / 38713868 / -1.0% 58478632 / 59313244 / -1.4% 0.66 / 0.65 / +0.5%
tpcds_q49/datafusion:parquet 73624621 / 73856905 / -0.3% 100081680 / 100497133 / -0.4% 0.74 / 0.73 / +0.1%
tpcds_q50/datafusion:parquet 49289602 / 48601224 / +1.4% 72167848 / 72188438 / -0.0% 0.68 / 0.67 / +1.4%
tpcds_q51/datafusion:parquet 67566748 / 66788456 / +1.2% 92363642 / 91898768 / +0.5% 0.73 / 0.73 / +0.7%
tpcds_q52/datafusion:parquet 16009274 / 15896354 / +0.7% 31490978 / 30867859 / +2.0% 0.51 / 0.51 / -1.3%
tpcds_q53/datafusion:parquet 21838526 / 22106128 / -1.2% 39872134 / 39456445 / +1.1% 0.55 / 0.56 / -2.2%
tpcds_q54/datafusion:parquet 46041380 / 45115190 / +2.1% 70756895 / 65836995 / +7.5% 0.65 / 0.69 / -5.0%
tpcds_q55/datafusion:parquet 15610840 / 15405726 / +1.3% 30739205 / 28692054 / +7.1% 0.51 / 0.54 / -5.4%
tpcds_q56/datafusion:parquet 31644870 / 31884402 / -0.8% 56644063 / 54721028 / +3.5% 0.56 / 0.58 / -4.1%
tpcds_q57/datafusion:parquet 98550836 / 99514966 / -1.0% 123311649 / 123993699 / -0.6% 0.80 / 0.80 / -0.4%
tpcds_q58/datafusion:parquet 64931407 / 65007922 / -0.1% 90296564 / 87216896 / +3.5% 0.72 / 0.75 / -3.5%
tpcds_q59/datafusion:parquet 42960981 / 43258381 / -0.7% 63648423 / 64058547 / -0.6% 0.67 / 0.68 / -0.0%
tpcds_q60/datafusion:parquet 31314250 / 32937862 / -4.9% 53851594 / 54820460 / -1.8% 0.58 / 0.60 / -3.2%
tpcds_q61/datafusion:parquet 33923564 / 34207246 / -0.8% 57666106 / 59085217 / -2.4% 0.59 / 0.58 / +1.6%
tpcds_q62/datafusion:parquet 23983900 / 24288418 / -1.3% 38323444 / 39387957 / -2.7% 0.63 / 0.62 / +1.5%
tpcds_q63/datafusion:parquet 21949942 / 21965768 / -0.1% 38478007 / 39233178 / -1.9% 0.57 / 0.56 / +1.9%
tpcds_q64/datafusion:parquet 203634592 / 206656374 / -1.5% 235942198 / 233679907 / +1.0% 0.86 / 0.88 / -2.4%
tpcds_q65/datafusion:parquet 38598764 / 39007217 / -1.0% 60491330 / 60889765 / -0.7% 0.64 / 0.64 / -0.4%
tpcds_q66/datafusion:parquet 61847603 / 61598766 / +0.4% 80824865 / 80057578 / +1.0% 0.77 / 0.77 / -0.5%
tpcds_q67/datafusion:parquet 70477617 / 69865229 / +0.9% 97013550 / 96472537 / +0.6% 0.73 / 0.72 / +0.3%
tpcds_q68/datafusion:parquet 28950282 / 29557750 / -2.1% 51816569 / 52143455 / -0.6% 0.56 / 0.57 / -1.4%
tpcds_q69/datafusion:parquet 42555054 / 40523487 / +5.0% 60485279 / 60879505 / -0.6% 0.70 / 0.67 / +5.7%
tpcds_q70/datafusion:parquet 32734037 / 33249490 / -1.6% 54587976 / 54924346 / -0.6% 0.60 / 0.61 / -0.9%
tpcds_q71/datafusion:parquet 24839537 / 23565976 / +5.4% 40583023 / 39027373 / +4.0% 0.61 / 0.60 / +1.4%
tpcds_q72/datafusion:parquet 556535090 / 552430120 / +0.7% 574797953 / 584895143 / -1.7% 0.97 / 0.94 / +2.5%
tpcds_q73/datafusion:parquet 21686950 / 21871615 / -0.8% 38915484 / 38458511 / +1.2% 0.56 / 0.57 / -2.0%
tpcds_q74/datafusion:parquet 66350685 / 67654564 / -1.9% 88839900 / 85526588 / +3.9% 0.75 / 0.79 / -5.6%
tpcds_q75/datafusion:parquet 149015589 / 150827066 / -1.2% 173945460 / 177015360 / -1.7% 0.86 / 0.85 / +0.5%
tpcds_q76/datafusion:parquet 49429346 / 47835732 / +3.3% 67247422 / 64136450 / +4.9% 0.74 / 0.75 / -1.4%
tpcds_q77/datafusion:parquet 52618528 / 53323510 / -1.3% 72619470 / 76151288 / -4.6% 0.72 / 0.70 / +3.5%
tpcds_q78/datafusion:parquet 93480362 / 92744844 / +0.8% 126186581 / 124908858 / +1.0% 0.74 / 0.74 / -0.2%
tpcds_q79/datafusion:parquet 26026468 / 25770572 / +1.0% 46333823 / 45907778 / +0.9% 0.56 / 0.56 / +0.1%
tpcds_q80/datafusion:parquet 84104944 / 81494273 / +3.2% 112949593 / 115573687 / -2.3% 0.74 / 0.71 / +5.6%
tpcds_q81/datafusion:parquet 38761168 / 39091330 / -0.8% 57867849 / 60331777 / -4.1% 0.67 / 0.65 / +3.4%
tpcds_q82/datafusion:parquet 25509492 / 25060646 / +1.8% 39785927 / 40863708 / -2.6% 0.64 / 0.61 / +4.5%
tpcds_q83/datafusion:parquet 47821931 / 48003577 / -0.4% 68242456 / 68977832 / -1.1% 0.70 / 0.70 / +0.7%
tpcds_q84/datafusion:parquet 30396324 / 29237018 / +4.0% 45557714 / 48835318 / -6.7% 0.67 / 0.60 / +11.4%
tpcds_q85/datafusion:parquet 85841049 / 85296116 / +0.6% 110761679 / 108709915 / +1.9% 0.78 / 0.78 / -1.2%
tpcds_q86/datafusion:parquet 20974041 / 20955394 / +0.1% 34070349 / 34529484 / -1.3% 0.62 / 0.61 / +1.4%
tpcds_q87/datafusion:parquet 44044222 / 43726570 / +0.7% 61052268 / 62930026 / -3.0% 0.72 / 0.69 / +3.8%
tpcds_q88/datafusion:parquet 38357350 / 37711351 / +1.7% 63098380 / 56918622 / +10.9% 🔴 0.61 / 0.66 / -8.2%
tpcds_q89/datafusion:parquet 25271541 / 25087402 / +0.7% 42512964 / 43337763 / -1.9% 0.59 / 0.58 / +2.7%
tpcds_q90/datafusion:parquet 15863595 / 15309300 / +3.6% 30349010 / 30249530 / +0.3% 0.52 / 0.51 / +3.3%
tpcds_q91/datafusion:parquet 32047649 / 32380710 / -1.0% 50005360 / 50997763 / -1.9% 0.64 / 0.63 / +0.9%
tpcds_q92/datafusion:parquet 23992072 / 23804688 / +0.8% 42000060 / 39840060 / +5.4% 0.57 / 0.60 / -4.4%
tpcds_q93/datafusion:parquet 27470555 / 27328678 / +0.5% 49619657 / 50093132 / -0.9% 0.55 / 0.55 / +1.5%
tpcds_q94/datafusion:parquet 32005484 / 32170244 / -0.5% 49116434 / 48785827 / +0.7% 0.65 / 0.66 / -1.2%
tpcds_q95/datafusion:parquet 65751353 / 65332476 / +0.6% 80687342 / 82377581 / -2.1% 0.81 / 0.79 / +2.7%
tpcds_q96/datafusion:parquet 12816516 / 13122800 / -2.3% 27643331 / 26643970 / +3.8% 0.46 / 0.49 / -5.9%
tpcds_q97/datafusion:parquet 32356108 / 32165847 / +0.6% 53148126 / 52978458 / +0.3% 0.61 / 0.61 / +0.3%
tpcds_q98/datafusion:parquet 22545934 / 22568600 / -0.1% 39829924 / 38639679 / +3.1% 0.57 / 0.58 / -3.1%
tpcds_q99/datafusion:parquet 28822854 / 28689636 / +0.5% 43713369 / 43206090 / +1.2% 0.66 / 0.66 / -0.7%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15006092 / 15134710 / -0.8% 22758851 / 22478251 / +1.2% 0.66 / 0.67 / -2.1%
tpcds_q02/duckdb:vortex-file-compressed 14829989 / 14997682 / -1.1% 21552792 / 20531609 / +5.0% 0.69 / 0.73 / -5.8%
tpcds_q03/duckdb:vortex-file-compressed 11662910 / 11277834 / +3.4% 24035529 / 23394151 / +2.7% 0.49 / 0.48 / +0.7%
tpcds_q04/duckdb:vortex-file-compressed 50388762 / 50116231 / +0.5% 62434289 / 62271026 / +0.3% 0.81 / 0.80 / +0.3%
tpcds_q05/duckdb:vortex-file-compressed 18991924 / 18539741 / +2.4% 26903731 / 26528531 / +1.4% 0.71 / 0.70 / +1.0%
tpcds_q06/duckdb:vortex-file-compressed 26832204 / 26986342 / -0.6% 41722759 / 41865289 / -0.3% 0.64 / 0.64 / -0.2%
tpcds_q07/duckdb:vortex-file-compressed 15604572 / 15669823 / -0.4% 30739895 / 37108924 / -17.2% 🟢 0.51 / 0.42 / +20.2%
tpcds_q08/duckdb:vortex-file-compressed 19133384 / 19081911 / +0.3% 28537649 / 28014909 / +1.9% 0.67 / 0.68 / -1.6%
tpcds_q09/duckdb:vortex-file-compressed 13666117 / 13782375 / -0.8% 23215432 / 22928191 / +1.3% 0.59 / 0.60 / -2.1%
tpcds_q10/duckdb:vortex-file-compressed 27147296 / 27501158 / -1.3% 42822688 / 40602807 / +5.5% 0.63 / 0.68 / -6.4%
tpcds_q11/duckdb:vortex-file-compressed 39667204 / 41263820 / -3.9% 51220499 / 51580986 / -0.7% 0.77 / 0.80 / -3.2%
tpcds_q12/duckdb:vortex-file-compressed 10266442 / 10196797 / +0.7% 18684348 / 15723079 / +18.8% 🔴 0.55 / 0.65 / -15.3%
tpcds_q13/duckdb:vortex-file-compressed 21456574 / 21583409 / -0.6% 35623206 / 35043399 / +1.7% 0.60 / 0.62 / -2.2%
tpcds_q14/duckdb:vortex-file-compressed 57965494 / 57712617 / +0.4% 70623678 / 72976637 / -3.2% 0.82 / 0.79 / +3.8%
tpcds_q15/duckdb:vortex-file-compressed 20803926 / 20885210 / -0.4% 26007229 / 27858499 / -6.6% 0.80 / 0.75 / +6.7%
tpcds_q16/duckdb:vortex-file-compressed 17555332 / 17442470 / +0.6% 28006040 / 26722010 / +4.8% 0.63 / 0.65 / -4.0%
tpcds_q17/duckdb:vortex-file-compressed 30159916 / 30070140 / +0.3% 48308351 / 47630802 / +1.4% 0.62 / 0.63 / -1.1%
tpcds_q18/duckdb:vortex-file-compressed 28254125 / 28671976 / -1.5% 39819246 / 39327304 / +1.3% 0.71 / 0.73 / -2.7%
tpcds_q19/duckdb:vortex-file-compressed 23870028 / 23887130 / -0.1% 34438103 / 37196928 / -7.4% 0.69 / 0.64 / +7.9%
tpcds_q20/duckdb:vortex-file-compressed 10517534 / 11473177 / -8.3% 15754934 / 18900243 / -16.6% 🟢 0.67 / 0.61 / +10.0%
tpcds_q21/duckdb:vortex-file-compressed 9622327 / 9820108 / -2.0% 18072169 / 24463030 / -26.1% 🟢 0.53 / 0.40 / +32.6%
tpcds_q22/duckdb:vortex-file-compressed 28704629 / 29132740 / -1.5% 38836799 / 39412791 / -1.5% 0.74 / 0.74 / -0.0%
tpcds_q23/duckdb:vortex-file-compressed 37326166 / 36186228 / +3.2% 49259707 / 51035076 / -3.5% 0.76 / 0.71 / +6.9%
tpcds_q24/duckdb:vortex-file-compressed 29727696 / 28180546 / +5.5% 41260649 / 38779858 / +6.4% 0.72 / 0.73 / -0.9%
tpcds_q25/duckdb:vortex-file-compressed 25956038 / 25556380 / +1.6% 42395489 / 40530624 / +4.6% 0.61 / 0.63 / -2.9%
tpcds_q26/duckdb:vortex-file-compressed 13458000 / 13971378 / -3.7% 20806607 / 20322293 / +2.4% 0.65 / 0.69 / -5.9%
tpcds_q27/duckdb:vortex-file-compressed 17695314 / 17720978 / -0.1% 33197056 / 30943049 / +7.3% 0.53 / 0.57 / -6.9%
tpcds_q28/duckdb:vortex-file-compressed 12004730 / 12365750 / -2.9% 22564124 / 20857821 / +8.2% 0.53 / 0.59 / -10.3%
tpcds_q29/duckdb:vortex-file-compressed 28483195 / 28776232 / -1.0% 45529853 / 46104258 / -1.2% 0.63 / 0.62 / +0.2%
tpcds_q30/duckdb:vortex-file-compressed 19151336 / 18934021 / +1.1% 28998249 / 28043232 / +3.4% 0.66 / 0.68 / -2.2%
tpcds_q31/duckdb:vortex-file-compressed 19370298 / 19258228 / +0.6% 29426523 / 27848464 / +5.7% 0.66 / 0.69 / -4.8%
tpcds_q32/duckdb:vortex-file-compressed 9807647 / 9818722 / -0.1% 19223756 / 16692895 / +15.2% 🔴 0.51 / 0.59 / -13.3%
tpcds_q33/duckdb:vortex-file-compressed 16823936 / 16655713 / +1.0% 28675208 / 27515914 / +4.2% 0.59 / 0.61 / -3.1%
tpcds_q34/duckdb:vortex-file-compressed 15507139 / 15509774 / -0.0% 22973364 / 23190049 / -0.9% 0.68 / 0.67 / +0.9%
tpcds_q35/duckdb:vortex-file-compressed 46272480 / 46473856 / -0.4% 63063642 / 60291377 / +4.6% 0.73 / 0.77 / -4.8%
tpcds_q36/duckdb:vortex-file-compressed 14919153 / 15431549 / -3.3% 27399354 / 27292716 / +0.4% 0.54 / 0.57 / -3.7%
tpcds_q37/duckdb:vortex-file-compressed 13696034 / 13740458 / -0.3% 22578642 / 2563568 / -11.9% 🟢 0.61 / 0.54 / +13.2%
tpcds_q38/duckdb:vortex-file-compressed 22965112 / 22190954 / +3.5% 28605488 / 28033568 / +2.0% 0.80 / 0.79 / +1.4%
tpcds_q39/duckdb:vortex-file-compressed 18369996 / 18070014 / +1.7% 29641982 / 29767298 / -0.4% 0.62 / 0.61 / +2.1%
tpcds_q40/duckdb:vortex-file-compressed 13106408 / 13124969 / -0.1% 19290430 / 18952438 / +1.8% 0.68 / 0.69 / -1.9%
tpcds_q41/duckdb:vortex-file-compressed 6443333 / 6420256 / +0.4% 9328930 / 8880664 / +5.0% 0.69 / 0.72 / -4.5%
tpcds_q42/duckdb:vortex-file-compressed 9486478 / 8182162 / +15.9% 🔴 21000027 / 17942338 / +17.0% 🔴 0.45 / 0.46 / -0.9%
tpcds_q43/duckdb:vortex-file-compressed 10120974 / 10084462 / +0.4% 18321591 / 18163814 / +0.9% 0.55 / 0.56 / -0.5%
tpcds_q44/duckdb:vortex-file-compressed 15860262 / 15009170 / +5.7% 25403168 / 27626013 / -8.0% 0.62 / 0.54 / +14.9%
tpcds_q45/duckdb:vortex-file-compressed 22164028 / 22374815 / -0.9% 29542791 / 29523357 / +0.1% 0.75 / 0.76 / -1.0%
tpcds_q46/duckdb:vortex-file-compressed 18583540 / 18505815 / +0.4% 31976228 / 29546325 / +8.2% 0.58 / 0.63 / -7.2%
tpcds_q47/duckdb:vortex-file-compressed 30328722 / 31042766 / -2.3% 44673453 / 42958563 / +4.0% 0.68 / 0.72 / -6.1%
tpcds_q48/duckdb:vortex-file-compressed 18871084 / 19194974 / -1.7% 33206739 / 31566684 / +5.2% 0.57 / 0.61 / -6.5%
tpcds_q49/duckdb:vortex-file-compressed 17058848 / 16427236 / +3.8% 32834159 / 31275283 / +5.0% 0.52 / 0.53 / -1.1%
tpcds_q50/duckdb:vortex-file-compressed 16772652 / 16566832 / +1.2% 28730119 / 28617962 / +0.4% 0.58 / 0.58 / +0.8%
tpcds_q51/duckdb:vortex-file-compressed 75662766 / 76768184 / -1.4% 62020337 / 66573186 / -6.8% 1.22 / 1.15 / +5.8%
tpcds_q52/duckdb:vortex-file-compressed 8552264 / 8186352 / +4.5% 19025321 / 18353103 / +3.7% 0.45 / 0.45 / +0.8%
tpcds_q53/duckdb:vortex-file-compressed 14377776 / 15040600 / -4.4% 25505798 / 26104378 / -2.3% 0.56 / 0.58 / -2.2%
tpcds_q54/duckdb:vortex-file-compressed 20508712 / 20353829 / +0.8% 29717713 / 29919602 / -0.7% 0.69 / 0.68 / +1.4%
tpcds_q55/duckdb:vortex-file-compressed 8454015 / 8453117 / +0.0% 18371479 / 21931035 / -16.2% 🟢 0.46 / 0.39 / +19.4%
tpcds_q56/duckdb:vortex-file-compressed 17623930 / 17720805 / -0.5% 30071359 / 32690738 / -8.0% 0.59 / 0.54 / +8.1%
tpcds_q57/duckdb:vortex-file-compressed 23983562 / 23891544 / +0.4% 34043968 / 32100061 / +6.1% 0.70 / 0.74 / -5.3%
tpcds_q58/duckdb:vortex-file-compressed 17490727 / 17857376 / -2.1% 28458294 / 28307245 / +0.5% 0.61 / 0.63 / -2.6%
tpcds_q59/duckdb:vortex-file-compressed 18445976 / 18458286 / -0.1% 24797652 / 25834216 / -4.0% 0.74 / 0.71 / +4.1%
tpcds_q60/duckdb:vortex-file-compressed 17731672 / 18058255 / -1.8% 30328002 / 29930869 / +1.3% 0.58 / 0.60 / -3.1%
tpcds_q61/duckdb:vortex-file-compressed 19296362 / 20609987 / -6.4% 32045975 / 34082662 / -6.0% 0.60 / 0.60 / -0.4%
tpcds_q62/duckdb:vortex-file-compressed 10166434 / 10268537 / -1.0% 15741605 / 15508187 / +1.5% 0.65 / 0.66 / -2.5%
tpcds_q63/duckdb:vortex-file-compressed 13649845 / 13109644 / +4.1% 23811111 / 23435073 / +1.6% 0.57 / 0.56 / +2.5%
tpcds_q64/duckdb:vortex-file-compressed 62944674 / 61716114 / +2.0% 79574034 / 80101934 / -0.7% 0.79 / 0.77 / +2.7%
tpcds_q65/duckdb:vortex-file-compressed 15260178 / 15683801 / -2.7% 26154150 / 29161271 / -10.3% 🟢 0.58 / 0.54 / +8.5%
tpcds_q66/duckdb:vortex-file-compressed 20995590 / 20909420 / +0.4% 30458198 / 28125612 / +8.3% 0.69 / 0.74 / -7.3%
tpcds_q67/duckdb:vortex-file-compressed 65640180 / 66691618 / -1.6% 81784555 / 82107797 / -0.4% 0.80 / 0.81 / -1.2%
tpcds_q68/duckdb:vortex-file-compressed 18516297 / 18465052 / +0.3% 30813840 / 31433163 / -2.0% 0.60 / 0.59 / +2.3%
tpcds_q69/duckdb:vortex-file-compressed 29072836 / 28806910 / +0.9% 42767387 / 42646186 / +0.3% 0.68 / 0.68 / +0.6%
tpcds_q70/duckdb:vortex-file-compressed 18862919 / 18819501 / +0.2% 32281441 / 28449324 / +13.5% 🔴 0.58 / 0.66 / -11.7%
tpcds_q71/duckdb:vortex-file-compressed 12820500 / 12278406 / +4.4% 22817620 / 27983718 / -18.5% 🟢 0.56 / 0.44 / +28.1%
tpcds_q72/duckdb:vortex-file-compressed 62006535 / 61566054 / +0.7% 77132851 / 79189314 / -2.6% 0.80 / 0.78 / +3.4%
tpcds_q73/duckdb:vortex-file-compressed 15024242 / 14988192 / +0.2% 23304219 / 23061771 / +1.1% 0.64 / 0.65 / -0.8%
tpcds_q74/duckdb:vortex-file-compressed 27532239 / 27219537 / +1.1% 38394420 / 37210467 / +3.2% 0.72 / 0.73 / -2.0%
tpcds_q75/duckdb:vortex-file-compressed 28550872 / 28677919 / -0.4% 40065909 / 41773509 / -4.1% 0.71 / 0.69 / +3.8%
tpcds_q76/duckdb:vortex-file-compressed 12256004 / 12524823 / -2.1% 27182712 / 24370387 / +11.5% 🔴 0.45 / 0.51 / -12.3%
tpcds_q77/duckdb:vortex-file-compressed 15904326 / 15892180 / +0.1% 28527080 / 25681490 / +11.1% 🔴 0.56 / 0.62 / -9.9%
tpcds_q78/duckdb:vortex-file-compressed 36931871 / 37383840 / -1.2% 46038844 / 47197609 / -2.5% 0.80 / 0.79 / +1.3%
tpcds_q79/duckdb:vortex-file-compressed 14464140 / 15929250 / -9.2% 31999189 / 27804159 / +15.1% 🔴 0.45 / 0.57 / -21.1%
tpcds_q80/duckdb:vortex-file-compressed 27791001 / 27277050 / +1.9% 43591943 / 45987250 / -5.2% 0.64 / 0.59 / +7.5%
tpcds_q81/duckdb:vortex-file-compressed 22267576 / 22149709 / +0.5% 32302091 / 29688190 / +8.8% 0.69 / 0.75 / -7.6%
tpcds_q82/duckdb:vortex-file-compressed 31926808 / 32087596 / -0.5% 39416381 / 41037372 / -4.0% 0.81 / 0.78 / +3.6%
tpcds_q83/duckdb:vortex-file-compressed 19498547 / 19422312 / +0.4% 25973024 / 25066558 / +3.6% 0.75 / 0.77 / -3.1%
tpcds_q84/duckdb:vortex-file-compressed 13893195 / 12682810 / +9.5% 18607998 / 21233601 / -12.4% 🟢 0.75 / 0.60 / +25.0%
tpcds_q85/duckdb:vortex-file-compressed 31009440 / 30759403 / +0.8% 39784935 / 41041611 / -3.1% 0.78 / 0.75 / +4.0%
tpcds_q86/duckdb:vortex-file-compressed 10779594 / 10681080 / +0.9% 17331019 / 18254036 / -5.1% 0.62 / 0.59 / +6.3%
tpcds_q87/duckdb:vortex-file-compressed 24415426 / 23917790 / +2.1% 30483079 / 30310484 / +0.6% 0.80 / 0.79 / +1.5%
tpcds_q88/duckdb:vortex-file-compressed 32704902 / 32131658 / +1.8% 47415462 / 42985700 / +10.3% 🔴 0.69 / 0.75 / -7.7%
tpcds_q89/duckdb:vortex-file-compressed 14104900 / 13892300 / +1.5% 24101563 / 27726235 / -13.1% 🟢 0.59 / 0.50 / +16.8%
tpcds_q90/duckdb:vortex-file-compressed 8457879 / 8154716 / +3.7% 12604803 / 12051510 / +4.6% 0.67 / 0.68 / -0.8%
tpcds_q91/duckdb:vortex-file-compressed 15051334 / 15505590 / -2.9% 22200706 / 21966773 / +1.1% 0.68 / 0.71 / -4.0%
tpcds_q92/duckdb:vortex-file-compressed 13005028 / 13122750 / -0.9% 25124354 / 21049938 / +19.4% 🔴 0.52 / 0.62 / -17.0%
tpcds_q93/duckdb:vortex-file-compressed 16808268 / 17067348 / -1.5% 26282238 / 25327898 / +3.8% 0.64 / 0.67 / -5.1%
tpcds_q94/duckdb:vortex-file-compressed 16460449 / 16040213 / +2.6% 26002359 / 26133502 / -0.5% 0.63 / 0.61 / +3.1%
tpcds_q95/duckdb:vortex-file-compressed 45201091 / 45090714 / +0.2% 54232370 / 55597607 / -2.5% 0.83 / 0.81 / +2.8%
tpcds_q96/duckdb:vortex-file-compressed 7206690 / 7097279 / +1.5% 22285857 / 17466255 / +27.6% 🔴 0.32 / 0.41 / -20.4%
tpcds_q97/duckdb:vortex-file-compressed 21955969 / 22022230 / -0.3% 28172798 / 31890392 / -11.7% 🟢 0.78 / 0.69 / +12.9%
tpcds_q98/duckdb:vortex-file-compressed 13481976 / 14302734 / -5.7% 23220662 / 23487115 / -1.1% 0.58 / 0.61 / -4.7%
tpcds_q99/duckdb:vortex-file-compressed 13339307 / 13396682 / -0.4% 18995449 / 18942379 / +0.3% 0.70 / 0.71 / -0.7%
duckdb / vortex-compact / ns (1.005x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16552759 / 16358704 / +1.2% 23229498 / 23490952 / -1.1% 0.71 / 0.70 / +2.3%
tpcds_q02/duckdb:vortex-compact 16409020 / 16075930 / +2.1% 21451802 / 21415281 / +0.2% 0.76 / 0.75 / +1.9%
tpcds_q03/duckdb:vortex-compact 21334270 / 22338534 / -4.5% 29551048 / 29594740 / -0.1% 0.72 / 0.75 / -4.4%
tpcds_q04/duckdb:vortex-compact 54467725 / 53239049 / +2.3% 68927910 / 67228842 / +2.5% 0.79 / 0.79 / -0.2%
tpcds_q05/duckdb:vortex-compact 23904581 / 22824916 / +4.7% 30111412 / 31174546 / -3.4% 0.79 / 0.73 / +8.4%
tpcds_q06/duckdb:vortex-compact 34033978 / 33435362 / +1.8% 45093933 / 45272605 / -0.4% 0.75 / 0.74 / +2.2%
tpcds_q07/duckdb:vortex-compact 27061517 / 25593140 / +5.7% 35499958 / 34253632 / +3.6% 0.76 / 0.75 / +2.0%
tpcds_q08/duckdb:vortex-compact 50887988 / 48606384 / +4.7% 56439067 / 57092620 / -1.1% 0.90 / 0.85 / +5.9%
tpcds_q09/duckdb:vortex-compact 19518872 / 19464117 / +0.3% 26840015 / 26320876 / +2.0% 0.73 / 0.74 / -1.7%
tpcds_q10/duckdb:vortex-compact 45490802 / 45418096 / +0.2% 57471339 / 57604524 / -0.2% 0.79 / 0.79 / +0.4%
tpcds_q11/duckdb:vortex-compact 45513196 / 44953720 / +1.2% 56052889 / 58850317 / -4.8% 0.81 / 0.76 / +6.3%
tpcds_q12/duckdb:vortex-compact 13377242 / 13506306 / -1.0% 19311306 / 21275136 / -9.2% 0.69 / 0.63 / +9.1%
tpcds_q13/duckdb:vortex-compact 36719648 / 37180901 / -1.2% 48775909 / 46779562 / +4.3% 0.75 / 0.79 / -5.3%
tpcds_q14/duckdb:vortex-compact 68302284 / 66170996 / +3.2% 80484227 / 85554102 / -5.9% 0.85 / 0.77 / +9.7%
tpcds_q15/duckdb:vortex-compact 25915960 / 26146558 / -0.9% 30246290 / 31089799 / -2.7% 0.86 / 0.84 / +1.9%
tpcds_q16/duckdb:vortex-compact 24971956 / 24918054 / +0.2% 34111220 / 33690910 / +1.2% 0.73 / 0.74 / -1.0%
tpcds_q17/duckdb:vortex-compact 45187078 / 44749290 / +1.0% 57447723 / 56057616 / +2.5% 0.79 / 0.80 / -1.5%
tpcds_q18/duckdb:vortex-compact 35991380 / 35879642 / +0.3% 45108649 / 46678287 / -3.4% 0.80 / 0.77 / +3.8%
tpcds_q19/duckdb:vortex-compact 36594345 / 36157541 / +1.2% 44795730 / 44371166 / +1.0% 0.82 / 0.81 / +0.2%
tpcds_q20/duckdb:vortex-compact 14153024 / 13845989 / +2.2% 21550083 / 19604773 / +9.9% 0.66 / 0.71 / -7.0%
tpcds_q21/duckdb:vortex-compact 10365038 / 10380438 / -0.1% 18046593 / 20041438 / -10.0% 0.57 / 0.52 / +10.9%
tpcds_q22/duckdb:vortex-compact 31118819 / 35511786 / -12.4% 🟢 42479833 / 40215608 / +5.6% 0.73 / 0.88 / -17.0%
tpcds_q23/duckdb:vortex-compact 42456119 / 43575358 / -2.6% 52495757 / 54119501 / -3.0% 0.81 / 0.81 / +0.4%
tpcds_q24/duckdb:vortex-compact 39520704 / 39715130 / -0.5% 51243377 / 48025525 / +6.7% 0.77 / 0.83 / -6.7%
tpcds_q25/duckdb:vortex-compact 43270822 / 43277494 / -0.0% 55314376 / 62380303 / -11.3% 🟢 0.78 / 0.69 / +12.8%
tpcds_q26/duckdb:vortex-compact 23167542 / 21925738 / +5.7% 28694488 / 27373566 / +4.8% 0.81 / 0.80 / +0.8%
tpcds_q27/duckdb:vortex-compact 30988285 / 29551076 / +4.9% 44144526 / 37096102 / +19.0% 🔴 0.70 / 0.80 / -11.9%
tpcds_q28/duckdb:vortex-compact 23474322 / 23131768 / +1.5% 35250913 / 31900170 / +10.5% 🔴 0.67 / 0.73 / -8.2%
tpcds_q29/duckdb:vortex-compact 44415452 / 44111160 / +0.7% 58321166 / 56896187 / +2.5% 0.76 / 0.78 / -1.8%
tpcds_q30/duckdb:vortex-compact 22618366 / 22642994 / -0.1% 30644827 / 30799639 / -0.5% 0.74 / 0.74 / +0.4%
tpcds_q31/duckdb:vortex-compact 23701474 / 23690208 / +0.0% 30524203 / 32218987 / -5.3% 0.78 / 0.74 / +5.6%
tpcds_q32/duckdb:vortex-compact 14269748 / 13949924 / +2.3% 20444679 / 22364932 / -8.6% 0.70 / 0.62 / +11.9%
tpcds_q33/duckdb:vortex-compact 22921300 / 23564720 / -2.7% 35826557 / 35864610 / -0.1% 0.64 / 0.66 / -2.6%
tpcds_q34/duckdb:vortex-compact 22093097 / 22084984 / +0.0% 30694679 / 29088952 / +5.5% 0.72 / 0.76 / -5.2%
tpcds_q35/duckdb:vortex-compact 61860612 / 61641006 / +0.4% 74489816 / 73487510 / +1.4% 0.83 / 0.84 / -1.0%
tpcds_q36/duckdb:vortex-compact 22235975 / 22563933 / -1.5% 32668931 / 32717325 / -0.1% 0.68 / 0.69 / -1.3%
tpcds_q37/duckdb:vortex-compact 15343694 / 15409502 / -0.4% 24491797 / 25936143 / -5.6% 0.63 / 0.59 / +5.4%
tpcds_q38/duckdb:vortex-compact 26337566 / 26201910 / +0.5% 33297145 / 33547276 / -0.7% 0.79 / 0.78 / +1.3%
tpcds_q39/duckdb:vortex-compact 21654604 / 19657754 / +10.2% 🔴 27925583 / 30845624 / -9.5% 0.78 / 0.64 / +21.7%
tpcds_q40/duckdb:vortex-compact 15822614 / 15922564 / -0.6% 21208943 / 21358748 / -0.7% 0.75 / 0.75 / +0.1%
tpcds_q41/duckdb:vortex-compact 7654352 / 7673394 / -0.2% 10589149 / 12213566 / -13.3% 🟢 0.72 / 0.63 / +15.1%
tpcds_q42/duckdb:vortex-compact 12813446 / 11788126 / +8.7% 20087574 / 21426818 / -6.3% 0.64 / 0.55 / +15.9%
tpcds_q43/duckdb:vortex-compact 17702336 / 16344395 / +8.3% 24335065 / 22967787 / +6.0% 0.73 / 0.71 / +2.2%
tpcds_q44/duckdb:vortex-compact 22234368 / 22064572 / +0.8% 37026947 / 35145007 / +5.4% 0.60 / 0.63 / -4.4%
tpcds_q45/duckdb:vortex-compact 27462420 / 27696628 / -0.8% 34179133 / 33360556 / +2.5% 0.80 / 0.83 / -3.2%
tpcds_q46/duckdb:vortex-compact 29394008 / 29236863 / +0.5% 39296692 / 39058169 / +0.6% 0.75 / 0.75 / -0.1%
tpcds_q47/duckdb:vortex-compact 37861132 / 37423656 / +1.2% 58682059 / 48514187 / +21.0% 🔴 0.65 / 0.77 / -16.4%
tpcds_q48/duckdb:vortex-compact 33338677 / 33430992 / -0.3% 45262012 / 51068455 / -11.4% 🟢 0.74 / 0.65 / +12.5%
tpcds_q49/duckdb:vortex-compact 23586550 / 24369444 / -3.2% 39814878 / 37367492 / +6.5% 0.59 / 0.65 / -9.2%
tpcds_q50/duckdb:vortex-compact 27778604 / 27370638 / +1.5% 40290888 / 35923824 / +12.2% 🔴 0.69 / 0.76 / -9.5%
tpcds_q51/duckdb:vortex-compact 53400333 / 53520258 / -0.2% 62026747 / 61511058 / +0.8% 0.86 / 0.87 / -1.1%
tpcds_q52/duckdb:vortex-compact 12290642 / 13128101 / -6.4% 20460870 / 23052390 / -11.2% 🟢 0.60 / 0.57 / +5.5%
tpcds_q53/duckdb:vortex-compact 21926403 / 22118114 / -0.9% 33302268 / 32314183 / +3.1% 0.66 / 0.68 / -3.8%
tpcds_q54/duckdb:vortex-compact 27236164 / 27178632 / +0.2% 35110392 / 35308936 / -0.6% 0.78 / 0.77 / +0.8%
tpcds_q55/duckdb:vortex-compact 12206702 / 12422914 / -1.7% 20999923 / 22325114 / -5.9% 0.58 / 0.56 / +4.5%
tpcds_q56/duckdb:vortex-compact 23683136 / 23783736 / -0.4% 35543006 / 35922678 / -1.1% 0.67 / 0.66 / +0.6%
tpcds_q57/duckdb:vortex-compact 27769170 / 27572800 / +0.7% 33935161 / 34320615 / -1.1% 0.82 / 0.80 / +1.9%
tpcds_q58/duckdb:vortex-compact 24082554 / 23676651 / +1.7% 33603466 / 32388507 / +3.8% 0.72 / 0.73 / -2.0%
tpcds_q59/duckdb:vortex-compact 25390747 / 23116327 / +9.8% 28832157 / 32211121 / -10.5% 🟢 0.88 / 0.72 / +22.7%
tpcds_q60/duckdb:vortex-compact 24814342 / 24515194 / +1.2% 38658454 / 34635427 / +11.6% 🔴 0.64 / 0.71 / -9.3%
tpcds_q61/duckdb:vortex-compact 32249564 / 31633385 / +1.9% 45071430 / 42599419 / +5.8% 0.72 / 0.74 / -3.6%
tpcds_q62/duckdb:vortex-compact 11753707 / 11660692 / +0.8% 16902659 / 17546781 / -3.7% 0.70 / 0.66 / +4.6%
tpcds_q63/duckdb:vortex-compact 21469404 / 21163442 / +1.4% 35491797 / 27873504 / +27.3% 🔴 0.60 / 0.76 / -20.3%
tpcds_q64/duckdb:vortex-compact 85200938 / 83289750 / +2.3% 99245371 / 94244861 / +5.3% 0.86 / 0.88 / -2.9%
tpcds_q65/duckdb:vortex-compact 19864816 / 20165551 / -1.5% 30838064 / 32482977 / -5.1% 0.64 / 0.62 / +3.8%
tpcds_q66/duckdb:vortex-compact 24818656 / 25615313 / -3.1% 33166907 / 34504811 / -3.9% 0.75 / 0.74 / +0.8%
tpcds_q67/duckdb:vortex-compact 71827392 / 71472960 / +0.5% 85669964 / 87389251 / -2.0% 0.84 / 0.82 / +2.5%
tpcds_q68/duckdb:vortex-compact 29175466 / 29856964 / -2.3% 41913752 / 44460626 / -5.7% 0.70 / 0.67 / +3.7%
tpcds_q69/duckdb:vortex-compact 46800408 / 46621344 / +0.4% 57317131 / 58933235 / -2.7% 0.82 / 0.79 / +3.2%
tpcds_q70/duckdb:vortex-compact 31289476 / 31642970 / -1.1% 45625549 / 39388794 / +15.8% 🔴 0.69 / 0.80 / -14.6%
tpcds_q71/duckdb:vortex-compact 19327911 / 19295286 / +0.2% 29351017 / 29991073 / -2.1% 0.66 / 0.64 / +2.4%
tpcds_q72/duckdb:vortex-compact 69912966 / 68997116 / +1.3% 87290307 / 80289321 / +8.7% 0.80 / 0.86 / -6.8%
tpcds_q73/duckdb:vortex-compact 21798279 / 21821910 / -0.1% 32445558 / 28276796 / +14.7% 🔴 0.67 / 0.77 / -12.9%
tpcds_q74/duckdb:vortex-compact 31666791 / 32055267 / -1.2% 40228823 / 41251194 / -2.5% 0.79 / 0.78 / +1.3%
tpcds_q75/duckdb:vortex-compact 32971833 / 32831396 / +0.4% 46433496 / 47233807 / -1.7% 0.71 / 0.70 / +2.2%
tpcds_q76/duckdb:vortex-compact 16634380 / 16246464 / +2.4% 27986810 / 27404690 / +2.1% 0.59 / 0.59 / +0.3%
tpcds_q77/duckdb:vortex-compact 22667080 / 22294250 / +1.7% 30999399 / 32206558 / -3.7% 0.73 / 0.69 / +5.6%
tpcds_q78/duckdb:vortex-compact 41797675 / 41402032 / +1.0% 50523304 / 51062099 / -1.1% 0.83 / 0.81 / +2.0%
tpcds_q79/duckdb:vortex-compact 37531593 / 37766207 / -0.6% 48972470 / 45263428 / +8.2% 0.77 / 0.83 / -8.1%
tpcds_q80/duckdb:vortex-compact 36180354 / 37331201 / -3.1% 55431126 / 50128079 / +10.6% 🔴 0.65 / 0.74 / -12.4%
tpcds_q81/duckdb:vortex-compact 24187808 / 24500916 / -1.3% 31575161 / 31892046 / -1.0% 0.77 / 0.77 / -0.3%
tpcds_q82/duckdb:vortex-compact 36294997 / 35509558 / +2.2% 43311501 / 43420435 / -0.3% 0.84 / 0.82 / +2.5%
tpcds_q83/duckdb:vortex-compact 28928284 / 30017244 / -3.6% 34233033 / 38024129 / -10.0% 0.85 / 0.79 / +7.0%
tpcds_q84/duckdb:vortex-compact 14887287 / 16064892 / -7.3% 25084105 / 26113963 / -3.9% 0.59 / 0.62 / -3.5%
tpcds_q85/duckdb:vortex-compact 41673620 / 41589634 / +0.2% 49473238 / 49887479 / -0.8% 0.84 / 0.83 / +1.0%
tpcds_q86/duckdb:vortex-compact 12731836 / 12187960 / +4.5% 19812965 / 20136092 / -1.6% 0.64 / 0.61 / +6.2%
tpcds_q87/duckdb:vortex-compact 27670972 / 27595393 / +0.3% 37614475 / 34463802 / +9.1% 0.74 / 0.80 / -8.1%
tpcds_q88/duckdb:vortex-compact 66200304 / 67910817 / -2.5% 77856941 / 78729552 / -1.1% 0.85 / 0.86 / -1.4%
tpcds_q89/duckdb:vortex-compact 21203498 / 20860032 / +1.6% 30523492 / 29759930 / +2.6% 0.69 / 0.70 / -0.9%
tpcds_q90/duckdb:vortex-compact 12271007 / 12724576 / -3.6% 17813348 / 19612367 / -9.2% 0.69 / 0.65 / +6.2%
tpcds_q91/duckdb:vortex-compact 30661156 / 30161850 / +1.7% 40452246 / 37533660 / +7.8% 0.76 / 0.80 / -5.7%
tpcds_q92/duckdb:vortex-compact 20665829 / 20278437 / +1.9% 30938542 / 28349333 / +9.1% 0.67 / 0.72 / -6.6%
tpcds_q93/duckdb:vortex-compact 18627120 / 18298034 / +1.8% 25867754 / 26275680 / -1.6% 0.72 / 0.70 / +3.4%
tpcds_q94/duckdb:vortex-compact 22098086 / 22022572 / +0.3% 33257783 / 31671205 / +5.0% 0.66 / 0.70 / -4.4%
tpcds_q95/duckdb:vortex-compact 46373192 / 45313273 / +2.3% 53996854 / 59928099 / -9.9% 0.86 / 0.76 / +13.6%
tpcds_q96/duckdb:vortex-compact 17106402 / 16958629 / +0.9% 28644312 / 23930458 / +19.7% 🔴 0.60 / 0.71 / -15.7%
tpcds_q97/duckdb:vortex-compact 25340711 / 25895557 / -2.1% 32813579 / 34987626 / -6.2% 0.77 / 0.74 / +4.3%
tpcds_q98/duckdb:vortex-compact 18428958 / 18374976 / +0.3% 28579665 / 26957966 / +6.0% 0.64 / 0.68 / -5.4%
tpcds_q99/duckdb:vortex-compact 16910350 / 16828946 / +0.5% 23782210 / 23775208 / +0.0% 0.71 / 0.71 / +0.5%
duckdb / parquet / ns (0.993x ➖, 5↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24643386 / 27619764 / -10.8% 🟢 31165252 / 34408461 / -9.4% 0.79 / 0.80 / -1.5%
tpcds_q02/duckdb:parquet 15678984 / 15731526 / -0.3% 21483237 / 21357751 / +0.6% 0.73 / 0.74 / -0.9%
tpcds_q03/duckdb:parquet 9268936 / 9329459 / -0.6% 16096096 / 15769594 / +2.1% 0.58 / 0.59 / -2.7%
tpcds_q04/duckdb:parquet 129676146 / 129918937 / -0.2% 134773909 / 135182482 / -0.3% 0.96 / 0.96 / +0.1%
tpcds_q05/duckdb:parquet 22388082 / 23685714 / -5.5% 26162489 / 26498556 / -1.3% 0.86 / 0.89 / -4.3%
tpcds_q06/duckdb:parquet 26933002 / 26895164 / +0.1% 36286435 / 37110116 / -2.2% 0.74 / 0.72 / +2.4%
tpcds_q07/duckdb:parquet 15494942 / 18164535 / -14.7% 🟢 25133300 / 25901995 / -3.0% 0.62 / 0.70 / -12.1%
tpcds_q08/duckdb:parquet 26464060 / 26219148 / +0.9% 33676102 / 32934863 / +2.3% 0.79 / 0.80 / -1.3%
tpcds_q09/duckdb:parquet 19762051 / 20375941 / -3.0% 24158301 / 24291125 / -0.5% 0.82 / 0.84 / -2.5%
tpcds_q10/duckdb:parquet 27874690 / 28072570 / -0.7% 37678385 / 40188622 / -6.2% 0.74 / 0.70 / +5.9%
tpcds_q11/duckdb:parquet 73306174 / 74129850 / -1.1% 80977160 / 78450063 / +3.2% 0.91 / 0.94 / -4.2%
tpcds_q12/duckdb:parquet 13038544 / 13038645 / -0.0% 18529780 / 18393180 / +0.7% 0.70 / 0.71 / -0.7%
tpcds_q13/duckdb:parquet 24505836 / 24458456 / +0.2% 31193152 / 31324154 / -0.4% 0.79 / 0.78 / +0.6%
tpcds_q14/duckdb:parquet 62449436 / 61357838 / +1.8% 66508399 / 69213091 / -3.9% 0.94 / 0.89 / +5.9%
tpcds_q15/duckdb:parquet 25314443 / 25431322 / -0.5% 30221033 / 33338599 / -9.4% 0.84 / 0.76 / +9.8%
tpcds_q16/duckdb:parquet 21072523 / 21193776 / -0.6% 29038771 / 28801226 / +0.8% 0.73 / 0.74 / -1.4%
tpcds_q17/duckdb:parquet 32932598 / 33155149 / -0.7% 41005175 / 40588925 / +1.0% 0.80 / 0.82 / -1.7%
tpcds_q18/duckdb:parquet 40301378 / 40271098 / +0.1% 50551062 / 50031219 / +1.0% 0.80 / 0.80 / -1.0%
tpcds_q19/duckdb:parquet 25028061 / 25130996 / -0.4% 32199085 / 32412870 / -0.7% 0.78 / 0.78 / +0.3%
tpcds_q20/duckdb:parquet 13940667 / 13897778 / +0.3% 18730907 / 18598384 / +0.7% 0.74 / 0.75 / -0.4%
tpcds_q21/duckdb:parquet 9542530 / 9445284 / +1.0% 13032271 / 13737778 / -5.1% 0.73 / 0.69 / +6.5%
tpcds_q22/duckdb:parquet 35083534 / 35258320 / -0.5% 38785175 / 38703541 / +0.2% 0.90 / 0.91 / -0.7%
tpcds_q23/duckdb:parquet 41231898 / 41560738 / -0.8% 48100839 / 48006633 / +0.2% 0.86 / 0.87 / -1.0%
tpcds_q24/duckdb:parquet 34063308 / 33855234 / +0.6% 42076334 / 42138494 / -0.1% 0.81 / 0.80 / +0.8%
tpcds_q25/duckdb:parquet 31494578 / 31431422 / +0.2% 39834391 / 39953016 / -0.3% 0.79 / 0.79 / +0.5%
tpcds_q26/duckdb:parquet 31832046 / 31970181 / -0.4% 38311315 / 38269203 / +0.1% 0.83 / 0.84 / -0.5%
tpcds_q27/duckdb:parquet 31970996 / 32224574 / -0.8% 42274159 / 40437116 / +4.5% 0.76 / 0.80 / -5.1%
tpcds_q28/duckdb:parquet 19244720 / 17586236 / +9.4% 21598313 / 23783984 / -9.2% 0.89 / 0.74 / +20.5%
tpcds_q29/duckdb:parquet 31114673 / 31343002 / -0.7% 39231451 / 40052571 / -2.1% 0.79 / 0.78 / +1.3%
tpcds_q30/duckdb:parquet 34501986 / 33579786 / +2.7% 43135515 / 42692006 / +1.0% 0.80 / 0.79 / +1.7%
tpcds_q31/duckdb:parquet 20479626 / 20698870 / -1.1% 27499990 / 30468909 / -9.7% 0.74 / 0.68 / +9.6%
tpcds_q32/duckdb:parquet 12224480 / 12568701 / -2.7% 18077041 / 21912953 / -17.5% 🟢 0.68 / 0.57 / +17.9%
tpcds_q33/duckdb:parquet 16316729 / 16578605 / -1.6% 26663941 / 24019414 / +11.0% 🔴 0.61 / 0.69 / -11.3%
tpcds_q34/duckdb:parquet 16636926 / 16243338 / +2.4% 21867758 / 22289913 / -1.9% 0.76 / 0.73 / +4.4%
tpcds_q35/duckdb:parquet 47490950 / 47436434 / +0.1% 56112458 / 55805288 / +0.6% 0.85 / 0.85 / -0.4%
tpcds_q36/duckdb:parquet 17219804 / 17179794 / +0.2% 23448074 / 23251899 / +0.8% 0.73 / 0.74 / -0.6%
tpcds_q37/duckdb:parquet 11511425 / 13371811 / -13.9% 🟢 18304227 / 17157625 / +6.7% 0.63 / 0.78 / -19.3%
tpcds_q38/duckdb:parquet 26668434 / 26581134 / +0.3% 31152742 / 30722465 / +1.4% 0.86 / 0.87 / -1.1%
tpcds_q39/duckdb:parquet 24431496 / 24399796 / +0.1% 28436939 / 31230463 / -8.9% 0.86 / 0.78 / +10.0%
tpcds_q40/duckdb:parquet 16460409 / 16540249 / -0.5% 21366710 / 20684388 / +3.3% 0.77 / 0.80 / -3.7%
tpcds_q41/duckdb:parquet 10751756 / 8897165 / +20.8% 🔴 16001369 / 14198321 / +12.7% 🔴 0.67 / 0.63 / +7.2%
tpcds_q42/duckdb:parquet 8756280 / 8737628 / +0.2% 15397313 / 14738286 / +4.5% 0.57 / 0.59 / -4.1%
tpcds_q43/duckdb:parquet 10639713 / 10648271 / -0.1% 15318331 / 15321733 / -0.0% 0.69 / 0.69 / -0.1%
tpcds_q44/duckdb:parquet 15974102 / 16306709 / -2.0% 21207507 / 21935777 / -3.3% 0.75 / 0.74 / +1.3%
tpcds_q45/duckdb:parquet 23608317 / 23605440 / +0.0% 29038484 / 29692180 / -2.2% 0.81 / 0.80 / +2.3%
tpcds_q46/duckdb:parquet 37286892 / 36870720 / +1.1% 45426574 / 45599581 / -0.4% 0.82 / 0.81 / +1.5%
tpcds_q47/duckdb:parquet 33293338 / 32519226 / +2.4% 37142585 / 37349556 / -0.6% 0.90 / 0.87 / +3.0%
tpcds_q48/duckdb:parquet 21284228 / 21295642 / -0.1% 27580029 / 27944855 / -1.3% 0.77 / 0.76 / +1.3%
tpcds_q49/duckdb:parquet 19857696 / 20653642 / -3.9% 28371904 / 28590040 / -0.8% 0.70 / 0.72 / -3.1%
tpcds_q50/duckdb:parquet 18069140 / 17986666 / +0.5% 25259940 / 23406860 / +7.9% 0.72 / 0.77 / -6.9%
tpcds_q51/duckdb:parquet 53840674 / 53959788 / -0.2% 84535289 / 60325495 / +40.1% 🔴 0.64 / 0.89 / -28.8%
tpcds_q52/duckdb:parquet 8939336 / 8974308 / -0.4% 15738380 / 15569677 / +1.1% 0.57 / 0.58 / -1.5%
tpcds_q53/duckdb:parquet 11850398 / 11864944 / -0.1% 16448181 / 16662742 / -1.3% 0.72 / 0.71 / +1.2%
tpcds_q54/duckdb:parquet 20801650 / 21124128 / -1.5% 30224982 / 29110748 / +3.8% 0.69 / 0.73 / -5.2%
tpcds_q55/duckdb:parquet 8833192 / 8867618 / -0.4% 15882539 / 15564002 / +2.0% 0.56 / 0.57 / -2.4%
tpcds_q56/duckdb:parquet 18643773 / 16956538 / +10.0% 24023311 / 24333777 / -1.3% 0.78 / 0.70 / +11.4%
tpcds_q57/duckdb:parquet 29227664 / 29208232 / +0.1% 34105234 / 34705601 / -1.7% 0.86 / 0.84 / +1.8%
tpcds_q58/duckdb:parquet 19246322 / 19076006 / +0.9% 26390340 / 26537365 / -0.6% 0.73 / 0.72 / +1.5%
tpcds_q59/duckdb:parquet 19915933 / 20077060 / -0.8% 25059217 / 25361836 / -1.2% 0.79 / 0.79 / +0.4%
tpcds_q60/duckdb:parquet 17436353 / 17616786 / -1.0% 24012981 / 24664645 / -2.6% 0.73 / 0.71 / +1.7%
tpcds_q61/duckdb:parquet 22385140 / 22402185 / -0.1% 28774055 / 28732233 / +0.1% 0.78 / 0.78 / -0.2%
tpcds_q62/duckdb:parquet 10879064 / 10741920 / +1.3% 14568609 / 15027091 / -3.1% 0.75 / 0.71 / +4.5%
tpcds_q63/duckdb:parquet 11203430 / 11142740 / +0.5% 16273204 / 16788752 / -3.1% 0.69 / 0.66 / +3.7%
tpcds_q64/duckdb:parquet 53676042 / 53543972 / +0.2% 63560264 / 65370204 / -2.8% 0.84 / 0.82 / +3.1%
tpcds_q65/duckdb:parquet 14727016 / 16487515 / -10.7% 🟢 20879800 / 23108526 / -9.6% 0.71 / 0.71 / -1.1%
tpcds_q66/duckdb:parquet 24970820 / 24987307 / -0.1% 31882107 / 31445270 / +1.4% 0.78 / 0.79 / -1.4%
tpcds_q67/duckdb:parquet 77396380 / 77069416 / +0.4% 86331307 / 86860692 / -0.6% 0.90 / 0.89 / +1.0%
tpcds_q68/duckdb:parquet 30579394 / 31432298 / -2.7% 39570806 / 38748103 / +2.1% 0.77 / 0.81 / -4.7%
tpcds_q69/duckdb:parquet 29063051 / 30173942 / -3.7% 38955277 / 38860641 / +0.2% 0.75 / 0.78 / -3.9%
tpcds_q70/duckdb:parquet 16268948 / 18136119 / -10.3% 🟢 26862353 / 29304924 / -8.3% 0.61 / 0.62 / -2.1%
tpcds_q71/duckdb:parquet 15074356 / 15108290 / -0.2% 21376950 / 21655529 / -1.3% 0.71 / 0.70 / +1.1%
tpcds_q72/duckdb:parquet 81783865 / 81641839 / +0.2% 86962435 / 87367406 / -0.5% 0.94 / 0.93 / +0.6%
tpcds_q73/duckdb:parquet 13749080 / 13824748 / -0.5% 19256475 / 19493293 / -1.2% 0.71 / 0.71 / +0.7%
tpcds_q74/duckdb:parquet 100660347 / 100934014 / -0.3% 106978788 / 113640080 / -5.9% 0.94 / 0.89 / +5.9%
tpcds_q75/duckdb:parquet 40732439 / 42771283 / -4.8% 51375432 / 51113463 / +0.5% 0.79 / 0.84 / -5.3%
tpcds_q76/duckdb:parquet 14186536 / 15350200 / -7.6% 21547998 / 25169305 / -14.4% 🟢 0.66 / 0.61 / +8.0%
tpcds_q77/duckdb:parquet 17633992 / 17416070 / +1.3% 24743970 / 26191560 / -5.5% 0.71 / 0.66 / +7.2%
tpcds_q78/duckdb:parquet 48801622 / 48374270 / +0.9% 54141903 / 54278903 / -0.3% 0.90 / 0.89 / +1.1%
tpcds_q79/duckdb:parquet 22462574 / 21234234 / +5.8% 29174850 / 36408395 / -19.9% 🟢 0.77 / 0.58 / +32.0%
tpcds_q80/duckdb:parquet 33082520 / 32728902 / +1.1% 39865882 / 40516517 / -1.6% 0.83 / 0.81 / +2.7%
tpcds_q81/duckdb:parquet 31654417 / 31733704 / -0.2% 43454258 / 39168539 / +10.9% 🔴 0.73 / 0.81 / -10.1%
tpcds_q82/duckdb:parquet 13634294 / 13091790 / +4.1% 17321720 / 17543697 / -1.3% 0.79 / 0.75 / +5.5%
tpcds_q83/duckdb:parquet 16536598 / 16645635 / -0.7% 21520991 / 21478962 / +0.2% 0.77 / 0.77 / -0.8%
tpcds_q84/duckdb:parquet 18751452 / 18683364 / +0.4% 23237216 / 25301089 / -8.2% 0.81 / 0.74 / +9.3%
tpcds_q85/duckdb:parquet 35419260 / 37082606 / -4.5% 44462299 / 45751838 / -2.8% 0.80 / 0.81 / -1.7%
tpcds_q86/duckdb:parquet 11401434 / 11498895 / -0.8% 18899151 / 16836562 / +12.3% 🔴 0.60 / 0.68 / -11.7%
tpcds_q87/duckdb:parquet 28834606 / 28349406 / +1.7% 33681550 / 33172552 / +1.5% 0.86 / 0.85 / +0.2%
tpcds_q88/duckdb:parquet 27146630 / 26843378 / +1.1% 37187601 / 31136754 / +19.4% 🔴 0.73 / 0.86 / -15.3%
tpcds_q89/duckdb:parquet 12997283 / 12912791 / +0.7% 18691640 / 18602793 / +0.5% 0.70 / 0.69 / +0.2%
tpcds_q90/duckdb:parquet 7031963 / 6853301 / +2.6% 11478867 / 12757083 / -10.0% 🟢 0.61 / 0.54 / +14.0%
tpcds_q91/duckdb:parquet 21480203 / 21474902 / +0.0% 28376609 / 28731707 / -1.2% 0.76 / 0.75 / +1.3%
tpcds_q92/duckdb:parquet 12581156 / 13934178 / -9.7% 19677465 / 19284130 / +2.0% 0.64 / 0.72 / -11.5%
tpcds_q93/duckdb:parquet 21966634 / 21739396 / +1.0% 26674638 / 31012624 / -14.0% 🟢 0.82 / 0.70 / +17.5%
tpcds_q94/duckdb:parquet 17027336 / 17270358 / -1.4% 24897800 / 26047293 / -4.4% 0.68 / 0.66 / +3.1%
tpcds_q95/duckdb:parquet 91280738 / 90731431 / +0.6% 98205615 / 98891378 / -0.7% 0.93 / 0.92 / +1.3%
tpcds_q96/duckdb:parquet 7016884 / 7080868 / -0.9% 10724300 / 10712056 / +0.1% 0.65 / 0.66 / -1.0%
tpcds_q97/duckdb:parquet 26238182 / 26119764 / +0.5% 33023845 / 31460831 / +5.0% 0.79 / 0.83 / -4.3%
tpcds_q98/duckdb:parquet 14999167 / 16448765 / -8.8% 22525557 / 22355707 / +0.8% 0.67 / 0.74 / -9.5%
tpcds_q99/duckdb:parquet 17206898 / 17562938 / -2.0% 20987650 / 21733267 / -3.4% 0.82 / 0.81 / +1.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95713303 / 99081185 / -3.4% 178065006 / 178179680 / -0.1% 0.54 / 0.56 / -3.3%
tpch_q02/datafusion:vortex-file-compressed 65503299 / 64717730 / +1.2% 99085988 / 96828536 / +2.3% 0.66 / 0.67 / -1.1%
tpch_q03/datafusion:vortex-file-compressed 64710769 / 64718502 / -0.0% 118545500 / 122020396 / -2.8% 0.55 / 0.53 / +2.9%
tpch_q04/datafusion:vortex-file-compressed 35457751 / 36086592 / -1.7% 84091620 / 81942740 / +2.6% 0.42 / 0.44 / -4.3%
tpch_q05/datafusion:vortex-file-compressed 119011922 / 119582023 / -0.5% 190075807 / 181055594 / +5.0% 0.63 / 0.66 / -5.2%
tpch_q06/datafusion:vortex-file-compressed 14527346 / 14685322 / -1.1% 70596348 / 76064872 / -7.2% 0.21 / 0.19 / +6.6%
tpch_q07/datafusion:vortex-file-compressed 140539214 / 142536531 / -1.4% 191879383 / 199173228 / -3.7% 0.73 / 0.72 / +2.3%
tpch_q08/datafusion:vortex-file-compressed 141924208 / 143235160 / -0.9% 211130645 / 237725771 / -11.2% 🟢 0.67 / 0.60 / +11.6%
tpch_q09/datafusion:vortex-file-compressed 187370883 / 191285947 / -2.0% 261857825 / 294714903 / -11.1% 🟢 0.72 / 0.65 / +10.2%
tpch_q10/datafusion:vortex-file-compressed 73601280 / 73765663 / -0.2% 138109036 / 147848428 / -6.6% 0.53 / 0.50 / +6.8%
tpch_q11/datafusion:vortex-file-compressed 42976526 / 43366999 / -0.9% 70191088 / 68506066 / +2.5% 0.61 / 0.63 / -3.3%
tpch_q12/datafusion:vortex-file-compressed 45515398 / 43587600 / +4.4% 97640345 / 102756896 / -5.0% 0.47 / 0.42 / +9.9%
tpch_q13/datafusion:vortex-file-compressed 46557619 / 46475151 / +0.2% 80174512 / 76932912 / +4.2% 0.58 / 0.60 / -3.9%
tpch_q14/datafusion:vortex-file-compressed 25602970 / 25385898 / +0.9% 104788436 / 98994436 / +5.9% 0.24 / 0.26 / -4.7%
tpch_q15/datafusion:vortex-file-compressed 37391350 / 37443243 / -0.1% 104109776 / 100058148 / +4.0% 0.36 / 0.37 / -4.0%
tpch_q16/datafusion:vortex-file-compressed 37902810 / 37221274 / +1.8% 69908714 / 69669236 / +0.3% 0.54 / 0.53 / +1.5%
tpch_q17/datafusion:vortex-file-compressed 182336642 / 174134858 / +4.7% 223838674 / 222542909 / +0.6% 0.81 / 0.78 / +4.1%
tpch_q18/datafusion:vortex-file-compressed 203817124 / 199190065 / +2.3% 274375528 / 263816559 / +4.0% 0.74 / 0.76 / -1.6%
tpch_q19/datafusion:vortex-file-compressed 34866880 / 35403096 / -1.5% 98640273 / 93156435 / +5.9% 0.35 / 0.38 / -7.0%
tpch_q20/datafusion:vortex-file-compressed 62656084 / 63002124 / -0.5% 125894069 / 125595912 / +0.2% 0.50 / 0.50 / -0.8%
tpch_q21/datafusion:vortex-file-compressed 181732309 / 183184185 / -0.8% 241634795 / 246284630 / -1.9% 0.75 / 0.74 / +1.1%
tpch_q22/datafusion:vortex-file-compressed 25682032 / 26003993 / -1.2% 59064613 / 60164698 / -1.8% 0.43 / 0.43 / +0.6%
datafusion / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 99571623 / 98276852 / +1.3% 162651928 / 152533045 / +6.6% 0.61 / 0.64 / -5.0%
tpch_q02/datafusion:vortex-compact 65710705 / 65213795 / +0.8% 95321220 / 95031505 / +0.3% 0.69 / 0.69 / +0.5%
tpch_q03/datafusion:vortex-compact 66956826 / 66709776 / +0.4% 113771831 / 113433831 / +0.3% 0.59 / 0.59 / +0.1%
tpch_q04/datafusion:vortex-compact 41613926 / 41279776 / +0.8% 84791527 / 81537358 / +4.0% 0.49 / 0.51 / -3.1%
tpch_q05/datafusion:vortex-compact 121417816 / 117334472 / +3.5% 187741626 / 175246491 / +7.1% 0.65 / 0.67 / -3.4%
tpch_q06/datafusion:vortex-compact 18464333 / 18031137 / +2.4% 66454691 / 59947800 / +10.9% 🔴 0.28 / 0.30 / -7.6%
tpch_q07/datafusion:vortex-compact 144864459 / 143116027 / +1.2% 183325153 / 185073998 / -0.9% 0.79 / 0.77 / +2.2%
tpch_q08/datafusion:vortex-compact 146890450 / 145961237 / +0.6% 203048146 / 198795461 / +2.1% 0.72 / 0.73 / -1.5%
tpch_q09/datafusion:vortex-compact 185748177 / 185462752 / +0.2% 246321937 / 250700782 / -1.7% 0.75 / 0.74 / +1.9%
tpch_q10/datafusion:vortex-compact 79654164 / 79915164 / -0.3% 129131998 / 127484266 / +1.3% 0.62 / 0.63 / -1.6%
tpch_q11/datafusion:vortex-compact 43890864 / 43693250 / +0.5% 68342046 / 69597056 / -1.8% 0.64 / 0.63 / +2.3%
tpch_q12/datafusion:vortex-compact 57380043 / 57079206 / +0.5% 98087547 / 98673222 / -0.6% 0.58 / 0.58 / +1.1%
tpch_q13/datafusion:vortex-compact 55084830 / 53875292 / +2.2% 79460223 / 84081363 / -5.5% 0.69 / 0.64 / +8.2%
tpch_q14/datafusion:vortex-compact 27324140 / 27786217 / -1.7% 97644059 / 97749187 / -0.1% 0.28 / 0.28 / -1.6%
tpch_q15/datafusion:vortex-compact 45365310 / 45604916 / -0.5% 100698643 / 99657944 / +1.0% 0.45 / 0.46 / -1.6%
tpch_q16/datafusion:vortex-compact 40341440 / 40153445 / +0.5% 70323670 / 70409358 / -0.1% 0.57 / 0.57 / +0.6%
tpch_q17/datafusion:vortex-compact 172874800 / 172540794 / +0.2% 216243517 / 219776153 / -1.6% 0.80 / 0.79 / +1.8%
tpch_q18/datafusion:vortex-compact 206175936 / 204421684 / +0.9% 262115823 / 263121458 / -0.4% 0.79 / 0.78 / +1.2%
tpch_q19/datafusion:vortex-compact 42550803 / 42107055 / +1.1% 88736116 / 91001548 / -2.5% 0.48 / 0.46 / +3.6%
tpch_q20/datafusion:vortex-compact 66004062 / 66822307 / -1.2% 114511834 / 123451674 / -7.2% 0.58 / 0.54 / +6.5%
tpch_q21/datafusion:vortex-compact 192659400 / 193585498 / -0.5% 252041094 / 251303456 / +0.3% 0.76 / 0.77 / -0.8%
tpch_q22/datafusion:vortex-compact 26969278 / 27297311 / -1.2% 57497633 / 56639838 / +1.5% 0.47 / 0.48 / -2.7%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86596648 / 87328703 / -0.8% 141075781 / 135316608 / +4.3% 0.61 / 0.65 / -4.9%
tpch_q02/datafusion:parquet 157459106 / 157382450 / +0.0% 190142053 / 186313044 / +2.1% 0.83 / 0.84 / -2.0%
tpch_q03/datafusion:parquet 143203378 / 143217634 / -0.0% 203399402 / 201905183 / +0.7% 0.70 / 0.71 / -0.7%
tpch_q04/datafusion:parquet 59596346 / 59488602 / +0.2% 101678419 / 104995121 / -3.2% 0.59 / 0.57 / +3.4%
tpch_q05/datafusion:parquet 181837734 / 182506209 / -0.4% 246242601 / 239495517 / +2.8% 0.74 / 0.76 / -3.1%
tpch_q06/datafusion:parquet 35390504 / 35255194 / +0.4% 82608958 / 82560833 / +0.1% 0.43 / 0.43 / +0.3%
tpch_q07/datafusion:parquet 232299625 / 231029122 / +0.5% 300620522 / 297572950 / +1.0% 0.77 / 0.78 / -0.5%
tpch_q08/datafusion:parquet 234411533 / 235606212 / -0.5% 313197865 / 304055222 / +3.0% 0.75 / 0.77 / -3.4%
tpch_q09/datafusion:parquet 315544896 / 312470744 / +1.0% 398892310 / 392728444 / +1.6% 0.79 / 0.80 / -0.6%
tpch_q10/datafusion:parquet 407728440 / 404036463 / +0.9% 472399792 / 480013666 / -1.6% 0.86 / 0.84 / +2.5%
tpch_q11/datafusion:parquet 105084151 / 104650276 / +0.4% 128338491 / 129391262 / -0.8% 0.82 / 0.81 / +1.2%
tpch_q12/datafusion:parquet 84705616 / 84768298 / -0.1% 133347325 / 134685385 / -1.0% 0.64 / 0.63 / +0.9%
tpch_q13/datafusion:parquet 228106703 / 227973348 / +0.1% 262171363 / 262447966 / -0.1% 0.87 / 0.87 / +0.2%
tpch_q14/datafusion:parquet 88879898 / 87548166 / +1.5% 210329043 / 205650932 / +2.3% 0.42 / 0.43 / -0.7%
tpch_q15/datafusion:parquet 90644151 / 90909223 / -0.3% 147955272 / 153572632 / -3.7% 0.61 / 0.59 / +3.5%
tpch_q16/datafusion:parquet 95195808 / 94825153 / +0.4% 124029947 / 123600331 / +0.3% 0.77 / 0.77 / +0.0%
tpch_q17/datafusion:parquet 218829954 / 214817619 / +1.9% 274979807 / 274440423 / +0.2% 0.80 / 0.78 / +1.7%
tpch_q18/datafusion:parquet 290471636 / 290829280 / -0.1% 334458415 / 336073633 / -0.5% 0.87 / 0.87 / +0.4%
tpch_q19/datafusion:parquet 110005204 / 109814102 / +0.2% 181966703 / 177259746 / +2.7% 0.60 / 0.62 / -2.4%
tpch_q20/datafusion:parquet 185580316 / 183291613 / +1.2% 249292103 / 247933691 / +0.5% 0.74 / 0.74 / +0.7%
tpch_q21/datafusion:parquet 243349622 / 244205609 / -0.4% 321719836 / 319477286 / +0.7% 0.76 / 0.76 / -1.0%
tpch_q22/datafusion:parquet 200777954 / 199925599 / +0.4% 224154628 / 225684828 / -0.7% 0.90 / 0.89 / +1.1%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55312893 / 54413355 / +1.7% 103547530 / 96960041 / +6.8% 0.53 / 0.56 / -4.8%
tpch_q02/duckdb:vortex-file-compressed 31541931 / 32032935 / -1.5% 46001287 / 47623131 / -3.4% 0.69 / 0.67 / +1.9%
tpch_q03/duckdb:vortex-file-compressed 56716573 / 58464148 / -3.0% 114807277 / 117691855 / -2.5% 0.49 / 0.50 / -0.6%
tpch_q04/duckdb:vortex-file-compressed 80750323 / 82594602 / -2.2% 122916318 / 124615976 / -1.4% 0.66 / 0.66 / -0.9%
tpch_q05/duckdb:vortex-file-compressed 66771732 / 66174150 / +0.9% 127432414 / 130909496 / -2.7% 0.52 / 0.51 / +3.7%
tpch_q06/duckdb:vortex-file-compressed 21145661 / 21786364 / -2.9% 67153127 / 72827886 / -7.8% 0.31 / 0.30 / +5.3%
tpch_q07/duckdb:vortex-file-compressed 60904866 / 59365342 / +2.6% 148926562 / 137321820 / +8.5% 0.41 / 0.43 / -5.4%
tpch_q08/duckdb:vortex-file-compressed 87057017 / 83545115 / +4.2% 158871706 / 153930601 / +3.2% 0.55 / 0.54 / +1.0%
tpch_q09/duckdb:vortex-file-compressed 167533016 / 168268544 / -0.4% 243156436 / 245942850 / -1.1% 0.69 / 0.68 / +0.7%
tpch_q10/duckdb:vortex-file-compressed 109689414 / 110069471 / -0.3% 174700796 / 175635411 / -0.5% 0.63 / 0.63 / +0.2%
tpch_q11/duckdb:vortex-file-compressed 17755000 / 17724887 / +0.2% 32154157 / 30904692 / +4.0% 0.55 / 0.57 / -3.7%
tpch_q12/duckdb:vortex-file-compressed 56472712 / 54917991 / +2.8% 114015563 / 119640667 / -4.7% 0.50 / 0.46 / +7.9%
tpch_q13/duckdb:vortex-file-compressed 90410886 / 91397825 / -1.1% 148992209 / 146712265 / +1.6% 0.61 / 0.62 / -2.6%
tpch_q14/duckdb:vortex-file-compressed 31077848 / 30473950 / +2.0% 81221925 / 79933091 / +1.6% 0.38 / 0.38 / +0.4%
tpch_q15/duckdb:vortex-file-compressed 42494053 / 42846485 / -0.8% 110687498 / 107934673 / +2.6% 0.38 / 0.40 / -3.3%
tpch_q16/duckdb:vortex-file-compressed 42111546 / 42402175 / -0.7% 54533464 / 56928694 / -4.2% 0.77 / 0.74 / +3.7%
tpch_q17/duckdb:vortex-file-compressed 63654457 / 57318488 / +11.1% 🔴 138409333 / 124288564 / +11.4% 🔴 0.46 / 0.46 / -0.3%
tpch_q18/duckdb:vortex-file-compressed 136640757 / 139710452 / -2.2% 170828523 / 169743318 / +0.6% 0.80 / 0.82 / -2.8%
tpch_q19/duckdb:vortex-file-compressed 41464338 / 40966873 / +1.2% 96075627 / 96495114 / -0.4% 0.43 / 0.42 / +1.7%
tpch_q20/duckdb:vortex-file-compressed 61943588 / 60015495 / +3.2% 133499820 / 128656482 / +3.8% 0.46 / 0.47 / -0.5%
tpch_q21/duckdb:vortex-file-compressed 241137901 / 240743141 / +0.2% 291331239 / 278325815 / +4.7% 0.83 / 0.86 / -4.3%
tpch_q22/duckdb:vortex-file-compressed 41701963 / 41749689 / -0.1% 62994640 / 65621780 / -4.0% 0.66 / 0.64 / +4.1%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 64054526 / 67553210 / -5.2% 103206973 / 105221819 / -1.9% 0.62 / 0.64 / -3.3%
tpch_q02/duckdb:vortex-compact 34839203 / 34315798 / +1.5% 50812502 / 54430685 / -6.6% 0.69 / 0.63 / +8.8%
tpch_q03/duckdb:vortex-compact 61649044 / 61231457 / +0.7% 104849228 / 112365265 / -6.7% 0.59 / 0.54 / +7.9%
tpch_q04/duckdb:vortex-compact 88777431 / 88239491 / +0.6% 118528992 / 118081653 / +0.4% 0.75 / 0.75 / +0.2%
tpch_q05/duckdb:vortex-compact 71245322 / 70902806 / +0.5% 124288845 / 124723073 / -0.3% 0.57 / 0.57 / +0.8%
tpch_q06/duckdb:vortex-compact 24975148 / 24651218 / +1.3% 67569038 / 67144907 / +0.6% 0.37 / 0.37 / +0.7%
tpch_q07/duckdb:vortex-compact 71237795 / 72458703 / -1.7% 145439359 / 142144727 / +2.3% 0.49 / 0.51 / -3.9%
tpch_q08/duckdb:vortex-compact 90102789 / 91446520 / -1.5% 152090389 / 151957659 / +0.1% 0.59 / 0.60 / -1.6%
tpch_q09/duckdb:vortex-compact 172570209 / 173473691 / -0.5% 242177440 / 237709924 / +1.9% 0.71 / 0.73 / -2.4%
tpch_q10/duckdb:vortex-compact 120362699 / 120542312 / -0.1% 165177982 / 174715912 / -5.5% 0.73 / 0.69 / +5.6%
tpch_q11/duckdb:vortex-compact 18944528 / 19453385 / -2.6% 34378079 / 33327925 / +3.2% 0.55 / 0.58 / -5.6%
tpch_q12/duckdb:vortex-compact 73196662 / 69810919 / +4.8% 115802480 / 110503092 / +4.8% 0.63 / 0.63 / +0.1%
tpch_q13/duckdb:vortex-compact 96040182 / 97879063 / -1.9% 145003781 / 145304575 / -0.2% 0.66 / 0.67 / -1.7%
tpch_q14/duckdb:vortex-compact 33551866 / 35765136 / -6.2% 72593658 / 84285853 / -13.9% 🟢 0.46 / 0.42 / +8.9%
tpch_q15/duckdb:vortex-compact 45203147 / 43595371 / +3.7% 99161508 / 111132411 / -10.8% 🟢 0.46 / 0.39 / +16.2%
tpch_q16/duckdb:vortex-compact 44534280 / 44423472 / +0.2% 55145156 / 57067286 / -3.4% 0.81 / 0.78 / +3.7%
tpch_q17/duckdb:vortex-compact 62043363 / 55430202 / +11.9% 🔴 138739959 / 104886295 / +32.3% 🔴 0.45 / 0.53 / -15.4%
tpch_q18/duckdb:vortex-compact 141168200 / 146460023 / -3.6% 160013572 / 159157834 / +0.5% 0.88 / 0.92 / -4.1%
tpch_q19/duckdb:vortex-compact 46385926 / 47504042 / -2.4% 90081061 / 92196868 / -2.3% 0.51 / 0.52 / -0.1%
tpch_q20/duckdb:vortex-compact 66468538 / 66703278 / -0.4% 131955502 / 130401162 / +1.2% 0.50 / 0.51 / -1.5%
tpch_q21/duckdb:vortex-compact 259389323 / 259545352 / -0.1% 293564562 / 286330376 / +2.5% 0.88 / 0.91 / -2.5%
tpch_q22/duckdb:vortex-compact 44299599 / 44164690 / +0.3% 65663532 / 74343822 / -11.7% 🟢 0.67 / 0.59 / +13.6%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72299694 / 72692670 / -0.5% 97106886 / 88167937 / +10.1% 🔴 0.74 / 0.82 / -9.7%
tpch_q02/duckdb:parquet 79993572 / 81037404 / -1.3% 91442922 / 92407652 / -1.0% 0.87 / 0.88 / -0.2%
tpch_q03/duckdb:parquet 118783607 / 124160956 / -4.3% 145307455 / 156971087 / -7.4% 0.82 / 0.79 / +3.3%
tpch_q04/duckdb:parquet 75224663 / 76600476 / -1.8% 106483509 / 107881022 / -1.3% 0.71 / 0.71 / -0.5%
tpch_q05/duckdb:parquet 129489564 / 130050525 / -0.4% 167053764 / 165637955 / +0.9% 0.78 / 0.79 / -1.3%
tpch_q06/duckdb:parquet 33683001 / 34317842 / -1.8% 50876932 / 48085097 / +5.8% 0.66 / 0.71 / -7.2%
tpch_q07/duckdb:parquet 92380024 / 93913275 / -1.6% 132285911 / 132837945 / -0.4% 0.70 / 0.71 / -1.2%
tpch_q08/duckdb:parquet 149348708 / 151095462 / -1.2% 190902285 / 191289260 / -0.2% 0.78 / 0.79 / -1.0%
tpch_q09/duckdb:parquet 228745397 / 230954391 / -1.0% 265656705 / 266969119 / -0.5% 0.86 / 0.87 / -0.5%
tpch_q10/duckdb:parquet 515546585 / 512202494 / +0.7% 558130605 / 550211663 / +1.4% 0.92 / 0.93 / -0.8%
tpch_q11/duckdb:parquet 33478655 / 33870557 / -1.2% 39033013 / 39356274 / -0.8% 0.86 / 0.86 / -0.3%
tpch_q12/duckdb:parquet 76626341 / 78201393 / -2.0% 92324015 / 90102498 / +2.5% 0.83 / 0.87 / -4.4%
tpch_q13/duckdb:parquet 322573477 / 325454371 / -0.9% 337592280 / 335971757 / +0.5% 0.96 / 0.97 / -1.4%
tpch_q14/duckdb:parquet 112341976 / 111361241 / +0.9% 143026551 / 137359619 / +4.1% 0.79 / 0.81 / -3.1%
tpch_q15/duckdb:parquet 43649758 / 43750759 / -0.2% 77320582 / 82342764 / -6.1% 0.56 / 0.53 / +6.2%
tpch_q16/duckdb:parquet 118337257 / 119949332 / -1.3% 127977485 / 128781108 / -0.6% 0.92 / 0.93 / -0.7%
tpch_q17/duckdb:parquet 80265970 / 81702371 / -1.8% 121284772 / 106567255 / +13.8% 🔴 0.66 / 0.77 / -13.7%
tpch_q18/duckdb:parquet 220451159 / 211212731 / +4.4% 193414336 / 173013143 / +11.8% 🔴 1.14 / 1.22 / -6.6%
tpch_q19/duckdb:parquet 168058841 / 167500769 / +0.3% 203134341 / 194359506 / +4.5% 0.83 / 0.86 / -4.0%
tpch_q20/duckdb:parquet 135242716 / 135998922 / -0.6% 174524293 / 171290137 / +1.9% 0.77 / 0.79 / -2.4%
tpch_q21/duckdb:parquet 279265554 / 268976747 / +3.8% 300167231 / 289402806 / +3.7% 0.93 / 0.93 / +0.1%
tpch_q22/duckdb:parquet 267588967 / 267927354 / -0.1% 276492430 / 279429492 / -1.1% 0.97 / 0.96 / +0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.008x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.994x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1818578 / 1792732 / +1.4% 5996689 / 6388062 / -6.1% 0.30 / 0.28 / +8.1%
statpopgen_q01/datafusion:vortex-file-compressed 25760075 / 24781909 / +3.9% 32288291 / 29161180 / +10.7% 🔴 0.80 / 0.85 / -6.1%
statpopgen_q02/datafusion:vortex-file-compressed 109210146 / 107608096 / +1.5% 140655823 / 142768281 / -1.5% 0.78 / 0.75 / +3.0%
statpopgen_q03/datafusion:vortex-file-compressed 350512656 / 348794191 / +0.5% 388890446 / 395446900 / -1.7% 0.90 / 0.88 / +2.2%
statpopgen_q04/datafusion:vortex-file-compressed 353239204 / 350833130 / +0.7% 386190959 / 400244646 / -3.5% 0.91 / 0.88 / +4.3%
statpopgen_q05/datafusion:vortex-file-compressed 210801902 / 213809890 / -1.4% 313070137 / 261832309 / +19.6% 🔴 0.67 / 0.82 / -17.5%
statpopgen_q06/datafusion:vortex-file-compressed 800713246 / 761448578 / +5.2% 843779085 / 801654219 / +5.3% 0.95 / 0.95 / -0.1%
statpopgen_q07/datafusion:vortex-file-compressed 411362388 / 420093376 / -2.1% 436743294 / 429371519 / +1.7% 0.94 / 0.98 / -3.7%
statpopgen_q08/datafusion:vortex-file-compressed 414626450 / 422864934 / -1.9% 425633194 / 428809377 / -0.7% 0.97 / 0.99 / -1.2%
statpopgen_q09/datafusion:vortex-file-compressed 252292224 / 245573094 / +2.7% 302915952 / 288712112 / +4.9% 0.83 / 0.85 / -2.1%
statpopgen_q10/datafusion:vortex-file-compressed 749881218 / 752588716 / -0.4% 793176024 / 777222723 / +2.1% 0.95 / 0.97 / -2.4%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1817812 / 1794815 / +1.3% 6464508 / 5808651 / +11.3% 🔴 0.28 / 0.31 / -9.0%
statpopgen_q01/datafusion:vortex-compact 27816569 / 27633190 / +0.7% 30116115 / 29294925 / +2.8% 0.92 / 0.94 / -2.1%
statpopgen_q02/datafusion:vortex-compact 212445362 / 212388624 / +0.0% 230841297 / 227519030 / +1.5% 0.92 / 0.93 / -1.4%
statpopgen_q03/datafusion:vortex-compact 462688762 / 465337108 / -0.6% 493678501 / 481507588 / +2.5% 0.94 / 0.97 / -3.0%
statpopgen_q04/datafusion:vortex-compact 465399152 / 466775760 / -0.3% 486247827 / 485056842 / +0.2% 0.96 / 0.96 / -0.5%
statpopgen_q05/datafusion:vortex-compact 315923674 / 316776758 / -0.3% 338685642 / 433513484 / -21.9% 🟢 0.93 / 0.73 / +27.7%
statpopgen_q06/datafusion:vortex-compact 924507238 / 889152459 / +4.0% 933573900 / 902123151 / +3.5% 0.99 / 0.99 / +0.5%
statpopgen_q07/datafusion:vortex-compact 968919625 / 976921960 / -0.8% 978696051 / 976833790 / +0.2% 0.99 / 1.00 / -1.0%
statpopgen_q08/datafusion:vortex-compact 971679914 / 976558579 / -0.5% 986185971 / 979216069 / +0.7% 0.99 / 1.00 / -1.2%
statpopgen_q09/datafusion:vortex-compact 368391622 / 369482971 / -0.3% 385332847 / 385316687 / +0.0% 0.96 / 0.96 / -0.3%
statpopgen_q10/datafusion:vortex-compact 971977364 / 978168499 / -0.6% 992083262 / 983492119 / +0.9% 0.98 / 0.99 / -1.5%
datafusion / parquet / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 2013970 / 1978751 / +1.8% 91198549 / 90381587 / +0.9% 0.02 / 0.02 / +0.9%
statpopgen_q01/datafusion:parquet 160875521 / 163117186 / -1.4% 174421593 / 171790503 / +1.5% 0.92 / 0.95 / -2.9%
statpopgen_q02/datafusion:parquet 294572064 / 286008316 / +3.0% 411593929 / 422113472 / -2.5% 0.72 / 0.68 / +5.6%
statpopgen_q03/datafusion:parquet 404769330 / 380194220 / +6.5% 523981289 / 543729167 / -3.6% 0.77 / 0.70 / +10.5%
statpopgen_q04/datafusion:parquet 384258333 / 388027602 / -1.0% 532337209 / 534211114 / -0.4% 0.72 / 0.73 / -0.6%
statpopgen_q05/datafusion:parquet 333808348 / 321707303 / +3.8% 455227850 / 438019962 / +3.9% 0.73 / 0.73 / -0.2%
statpopgen_q06/datafusion:parquet 516284364 / 505232252 / +2.2% 634738581 / 647196313 / -1.9% 0.81 / 0.78 / +4.2%
statpopgen_q07/datafusion:parquet 440669184 / 443582064 / -0.7% 548169331 / 561492098 / -2.4% 0.80 / 0.79 / +1.8%
statpopgen_q08/datafusion:parquet 444513348 / 437552172 / +1.6% 543970831 / 548333791 / -0.8% 0.82 / 0.80 / +2.4%
statpopgen_q09/datafusion:parquet 366654097 / 364529772 / +0.6% 464193634 / 482558165 / -3.8% 0.79 / 0.76 / +4.6%
statpopgen_q10/datafusion:parquet 561833736 / 558393644 / +0.6% 698904171 / 689865779 / +1.3% 0.80 / 0.81 / -0.7%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9043367 / 9000243 / +0.5% 9530175 / 9510387 / +0.2% 0.95 / 0.95 / +0.3%
statpopgen_q01/duckdb:vortex-file-compressed 10386518 / 10416989 / -0.3% 14032214 / 14123682 / -0.6% 0.74 / 0.74 / +0.4%
statpopgen_q02/duckdb:vortex-file-compressed 305917162 / 305157886 / +0.2% 341157564 / 329690075 / +3.5% 0.90 / 0.93 / -3.1%
statpopgen_q03/duckdb:vortex-file-compressed 816406472 / 807517470 / +1.1% 825377274 / 799374911 / +3.3% 0.99 / 1.01 / -2.1%
statpopgen_q04/duckdb:vortex-file-compressed 817230543 / 817106252 / +0.0% 823045990 / 817322508 / +0.7% 0.99 / 1.00 / -0.7%
statpopgen_q05/duckdb:vortex-file-compressed 319754923 / 319664247 / +0.0% 344364642 / 342553143 / +0.5% 0.93 / 0.93 / -0.5%
statpopgen_q06/duckdb:vortex-file-compressed 1146335686 / 1150826061 / -0.4% 1147532563 / 1167866136 / -1.7% 1.00 / 0.99 / +1.4%
statpopgen_q07/duckdb:vortex-file-compressed 376591088 / 381395592 / -1.3% 389402273 / 433463110 / -10.2% 🟢 0.97 / 0.88 / +9.9%
statpopgen_q08/duckdb:vortex-file-compressed 388364012 / 383461118 / +1.3% 437779210 / 394322354 / +11.0% 🔴 0.89 / 0.97 / -8.8%
statpopgen_q09/duckdb:vortex-file-compressed 615940372 / 617961724 / -0.3% 626261967 / 633219474 / -1.1% 0.98 / 0.98 / +0.8%
statpopgen_q10/duckdb:vortex-file-compressed 1919055512 / 1944465298 / -1.3% 1879543881 / 1926902452 / -2.5% 1.02 / 1.01 / +1.2%
duckdb / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 8991266 / 8996512 / -0.1% 9464742 / 9503140 / -0.4% 0.95 / 0.95 / +0.3%
statpopgen_q01/duckdb:vortex-compact 10279552 / 10114758 / +1.6% 13794968 / 13423541 / +2.8% 0.75 / 0.75 / -1.1%
statpopgen_q02/duckdb:vortex-compact 385807583 / 383315772 / +0.7% 403337480 / 394322163 / +2.3% 0.96 / 0.97 / -1.6%
statpopgen_q03/duckdb:vortex-compact 907208359 / 897613848 / +1.1% 908892140 / 904468184 / +0.5% 1.00 / 0.99 / +0.6%
statpopgen_q04/duckdb:vortex-compact 894866108 / 898105865 / -0.4% 906131013 / 904718551 / +0.2% 0.99 / 0.99 / -0.5%
statpopgen_q05/duckdb:vortex-compact 429513661 / 429826608 / -0.1% 439957101 / 442029497 / -0.5% 0.98 / 0.97 / +0.4%
statpopgen_q06/duckdb:vortex-compact 1168896862 / 1171268868 / -0.2% 1174447417 / 1173736859 / +0.1% 1.00 / 1.00 / -0.3%
statpopgen_q07/duckdb:vortex-compact 949564766 / 942758526 / +0.7% 966543776 / 953233840 / +1.4% 0.98 / 0.99 / -0.7%
statpopgen_q08/duckdb:vortex-compact 950841684 / 962877978 / -1.3% 946236331 / 955646885 / -1.0% 1.00 / 1.01 / -0.3%
statpopgen_q09/duckdb:vortex-compact 715336270 / 705427726 / +1.4% 718663854 / 717266032 / +0.2% 1.00 / 0.98 / +1.2%
statpopgen_q10/duckdb:vortex-compact 2020086840 / 1984307918 / +1.8% 1990534624 / 1975646092 / +0.8% 1.01 / 1.00 / +1.0%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245475668 / 244324820 / +0.5% 244627340 / 245836058 / -0.5% 1.00 / 0.99 / +1.0%
statpopgen_q01/duckdb:parquet 303724616 / 301883746 / +0.6% 304036557 / 303439975 / +0.2% 1.00 / 0.99 / +0.4%
statpopgen_q02/duckdb:parquet 559955827 / 561214404 / -0.2% 594399509 / 569811218 / +4.3% 0.94 / 0.98 / -4.4%
statpopgen_q03/duckdb:parquet 863958994 / 864028380 / -0.0% 858892732 / 864748247 / -0.7% 1.01 / 1.00 / +0.7%
statpopgen_q04/duckdb:parquet 845565500 / 829740321 / +1.9% 858894306 / 848076159 / +1.3% 0.98 / 0.98 / +0.6%
statpopgen_q05/duckdb:parquet 538043754 / 578049462 / -6.9% 575886632 / 572927673 / +0.5% 0.93 / 1.01 / -7.4%
statpopgen_q06/duckdb:parquet 728848012 / 743567832 / -2.0% 709511883 / 719532573 / -1.4% 1.03 / 1.03 / -0.6%
statpopgen_q07/duckdb:parquet 608650308 / 609944693 / -0.2% 700043798 / 705946852 / -0.8% 0.87 / 0.86 / +0.6%
statpopgen_q08/duckdb:parquet 622773118 / 623341656 / -0.1% 706875268 / 680894915 / +3.8% 0.88 / 0.92 / -3.8%
statpopgen_q09/duckdb:parquet 794765266 / 805983820 / -1.4% 780184729 / 823691842 / -5.3% 1.02 / 0.98 / +4.1%
statpopgen_q10/duckdb:parquet 1432995550 / 1482695540 / -3.4% 1249948076 / 1336318744 / -6.5% 1.15 / 1.11 / +3.3%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +12.9%
Engines: DataFusion No clear signal (+16.0%, environment too noisy confidence) · DuckDB No clear signal (+9.8%, environment too noisy confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.875x ➖ · cold 0.867x ➖
Shifts: Parquet (control) -12.5% · Median polish -5.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.911x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 264879953 / 212041416 / +24.9% 790521281 / 804852393 / -1.8% 0.34 / 0.26 / +27.2%
tpch_q02/datafusion:vortex-file-compressed 359025502 / 354973172 / +1.1% 770152135 / 903402233 / -14.7% 0.47 / 0.39 / +18.6%
tpch_q03/datafusion:vortex-file-compressed 386481372 / 402554813 / -4.0% 975247664 / 1113358760 / -12.4% 0.40 / 0.36 / +9.6%
tpch_q04/datafusion:vortex-file-compressed 229443410 / 331634092 / -30.8% 🟢 544191053 / 487310753 / +11.7% 0.42 / 0.68 / -38.0%
tpch_q05/datafusion:vortex-file-compressed 406279648 / 573551262 / -29.2% 698608074 / 806966511 / -13.4% 0.58 / 0.71 / -18.2%
tpch_q06/datafusion:vortex-file-compressed 290668413 / 282404721 / +2.9% 403066568 / 547391612 / -26.4% 0.72 / 0.52 / +39.8%
tpch_q07/datafusion:vortex-file-compressed 638579821 / 712141787 / -10.3% 806471455 / 815913033 / -1.2% 0.79 / 0.87 / -9.3%
tpch_q08/datafusion:vortex-file-compressed 540332447 / 522690677 / +3.4% 831404581 / 811625094 / +2.4% 0.65 / 0.64 / +0.9%
tpch_q09/datafusion:vortex-file-compressed 524343700 / 612616445 / -14.4% 639721443 / 588694606 / +8.7% 0.82 / 1.04 / -21.2%
tpch_q10/datafusion:vortex-file-compressed 433812627 / 459707123 / -5.6% 721141622 / 581499479 / +24.0% 0.60 / 0.79 / -23.9%
tpch_q11/datafusion:vortex-file-compressed 282536482 / 281410213 / +0.4% 419124108 / 411814966 / +1.8% 0.67 / 0.68 / -1.4%
tpch_q12/datafusion:vortex-file-compressed 405891669 / 555363797 / -26.9% 641210815 / 550817735 / +16.4% 0.63 / 1.01 / -37.2%
tpch_q13/datafusion:vortex-file-compressed 156057701 / 204089750 / -23.5% 373025631 / 371391814 / +0.4% 0.42 / 0.55 / -23.9%
tpch_q14/datafusion:vortex-file-compressed 195113392 / 227415266 / -14.2% 408003965 / 477056323 / -14.5% 0.48 / 0.48 / +0.3%
tpch_q15/datafusion:vortex-file-compressed 294981886 / 331000961 / -10.9% 462510099 / 574119441 / -19.4% 0.64 / 0.58 / +10.6%
tpch_q16/datafusion:vortex-file-compressed 164830739 / 163891257 / +0.6% 292322567 / 283659098 / +3.1% 0.56 / 0.58 / -2.4%
tpch_q17/datafusion:vortex-file-compressed 313971519 / 301673673 / +4.1% 494454250 / 499821384 / -1.1% 0.63 / 0.60 / +5.2%
tpch_q18/datafusion:vortex-file-compressed 264085922 / 305682204 / -13.6% 412605985 / 523749495 / -21.2% 0.64 / 0.58 / +9.7%
tpch_q19/datafusion:vortex-file-compressed 374400982 / 438428862 / -14.6% 482154990 / 479476949 / +0.6% 0.78 / 0.91 / -15.1%
tpch_q20/datafusion:vortex-file-compressed 290808242 / 286554744 / +1.5% 423885369 / 451942216 / -6.2% 0.69 / 0.63 / +8.2%
tpch_q21/datafusion:vortex-file-compressed 481161091 / 605771003 / -20.6% 658064216 / 747298425 / -11.9% 0.73 / 0.81 / -9.8%
tpch_q22/datafusion:vortex-file-compressed 233193431 / 221959240 / +5.1% 415090515 / 390801631 / +6.2% 0.56 / 0.57 / -1.1%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 217639511 / 212634769 / +2.4% 762296886 / 705594285 / +8.0% 0.29 / 0.30 / -5.3%
tpch_q02/datafusion:vortex-compact 490615199 / 318403626 / +54.1% 🔴 618444153 / 653077370 / -5.3% 0.79 / 0.49 / +62.7%
tpch_q03/datafusion:vortex-compact 359351899 / 345686902 / +4.0% 1001867104 / 797618243 / +25.6% 0.36 / 0.43 / -17.2%
tpch_q04/datafusion:vortex-compact 189548309 / 182972549 / +3.6% 443769893 / 546427874 / -18.8% 0.43 / 0.33 / +27.6%
tpch_q05/datafusion:vortex-compact 387560859 / 445534999 / -13.0% 740172279 / 532554907 / +39.0% 🔴 0.52 / 0.84 / -37.4%
tpch_q06/datafusion:vortex-compact 289769835 / 312821383 / -7.4% 421891790 / 376757439 / +12.0% 0.69 / 0.83 / -17.3%
tpch_q07/datafusion:vortex-compact 370257707 / 425533858 / -13.0% 498583163 / 797409806 / -37.5% 🟢 0.74 / 0.53 / +39.2%
tpch_q08/datafusion:vortex-compact 479837580 / 436174093 / +10.0% 685630574 / 642185021 / +6.8% 0.70 / 0.68 / +3.0%
tpch_q09/datafusion:vortex-compact 323232728 / 304706300 / +6.1% 528166857 / 542192324 / -2.6% 0.61 / 0.56 / +8.9%
tpch_q10/datafusion:vortex-compact 310052759 / 400694725 / -22.6% 453108600 / 525121252 / -13.7% 0.68 / 0.76 / -10.3%
tpch_q11/datafusion:vortex-compact 300424042 / 367475190 / -18.2% 450324723 / 663431038 / -32.1% 🟢 0.67 / 0.55 / +20.4%
tpch_q12/datafusion:vortex-compact 294799131 / 351729793 / -16.2% 482574729 / 607182916 / -20.5% 0.61 / 0.58 / +5.5%
tpch_q13/datafusion:vortex-compact 150963712 / 132200808 / +14.2% 364529661 / 349388518 / +4.3% 0.41 / 0.38 / +9.4%
tpch_q14/datafusion:vortex-compact 194675408 / 200798574 / -3.0% 345330210 / 300231866 / +15.0% 0.56 / 0.67 / -15.7%
tpch_q15/datafusion:vortex-compact 315347743 / 351132684 / -10.2% 477621834 / 565277297 / -15.5% 0.66 / 0.62 / +6.3%
tpch_q16/datafusion:vortex-compact 170693144 / 167879184 / +1.7% 302019332 / 303079559 / -0.3% 0.57 / 0.55 / +2.0%
tpch_q17/datafusion:vortex-compact 485328634 / 333424402 / +45.6% 🔴 931639174 / 455485722 / +104.5% 🔴 0.52 / 0.73 / -28.8%
tpch_q18/datafusion:vortex-compact 242431179 / 275681664 / -12.1% 411949133 / 407226873 / +1.2% 0.59 / 0.68 / -13.1%
tpch_q19/datafusion:vortex-compact 454315339 / 459649241 / -1.2% 523997204 / 544879293 / -3.8% 0.87 / 0.84 / +2.8%
tpch_q20/datafusion:vortex-compact 276714122 / 288833205 / -4.2% 526524774 / 455389280 / +15.6% 0.53 / 0.63 / -17.1%
tpch_q21/datafusion:vortex-compact 560726248 / 483842134 / +15.9% 849389450 / 709694316 / +19.7% 0.66 / 0.68 / -3.2%
tpch_q22/datafusion:vortex-compact 167884298 / 186743418 / -10.1% 339766639 / 400500666 / -15.2% 0.49 / 0.47 / +6.0%
datafusion / parquet / ns (0.821x ➖, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 162786243 / 233778112 / -30.4% 🟢 468619568 / 929259261 / -49.6% 🟢 0.35 / 0.25 / +38.1%
tpch_q02/datafusion:parquet 327427836 / 327365397 / +0.0% 557200835 / 520306966 / +7.1% 0.59 / 0.63 / -6.6%
tpch_q03/datafusion:parquet 276492623 / 404475340 / -31.6% 🟢 725723262 / 916460340 / -20.8% 0.38 / 0.44 / -13.7%
tpch_q04/datafusion:parquet 152420322 / 247153387 / -38.3% 🟢 415417606 / 561873446 / -26.1% 0.37 / 0.44 / -16.6%
tpch_q05/datafusion:parquet 345017886 / 459334220 / -24.9% 445741551 / 541362028 / -17.7% 0.77 / 0.85 / -8.8%
tpch_q06/datafusion:parquet 135731560 / 180207579 / -24.7% 254083905 / 283991733 / -10.5% 0.53 / 0.63 / -15.8%
tpch_q07/datafusion:parquet 368949312 / 408942729 / -9.8% 526129605 / 495280768 / +6.2% 0.70 / 0.83 / -15.1%
tpch_q08/datafusion:parquet 408740467 / 567348506 / -28.0% 642201868 / 723189997 / -11.2% 0.64 / 0.78 / -18.9%
tpch_q09/datafusion:parquet 397839855 / 415291277 / -4.2% 547499647 / 602811967 / -9.2% 0.73 / 0.69 / +5.5%
tpch_q10/datafusion:parquet 365523949 / 396606195 / -7.8% 453040230 / 609975054 / -25.7% 0.81 / 0.65 / +24.1%
tpch_q11/datafusion:parquet 280081701 / 250952130 / +11.6% 396802850 / 398328754 / -0.4% 0.71 / 0.63 / +12.0%
tpch_q12/datafusion:parquet 177177585 / 264142483 / -32.9% 🟢 360806894 / 521585041 / -30.8% 🟢 0.49 / 0.51 / -3.0%
tpch_q13/datafusion:parquet 361503529 / 370671336 / -2.5% 559288291 / 677282812 / -17.4% 0.65 / 0.55 / +18.1%
tpch_q14/datafusion:parquet 219430553 / 175492015 / +25.0% 572615201 / 317458131 / +80.4% 🔴 0.38 / 0.55 / -30.7%
tpch_q15/datafusion:parquet 317449636 / 340994955 / -6.9% 623266651 / 559962298 / +11.3% 0.51 / 0.61 / -16.4%
tpch_q16/datafusion:parquet 123805662 / 119714836 / +3.4% 244469276 / 321185767 / -23.9% 0.51 / 0.37 / +35.9%
tpch_q17/datafusion:parquet 269492148 / 361960490 / -25.5% 439189451 / 456985671 / -3.9% 0.61 / 0.79 / -22.5%
tpch_q18/datafusion:parquet 345031505 / 486632245 / -29.1% 451397756 / 492740718 / -8.4% 0.76 / 0.99 / -22.6%
tpch_q19/datafusion:parquet 160793718 / 232095506 / -30.7% 🟢 336077449 / 410832690 / -18.2% 0.48 / 0.56 / -15.3%
tpch_q20/datafusion:parquet 251838220 / 321914723 / -21.8% 456261650 / 480049286 / -5.0% 0.55 / 0.67 / -17.7%
tpch_q21/datafusion:parquet 315023846 / 464126521 / -32.1% 🟢 457749359 / 655092608 / -30.1% 🟢 0.69 / 0.71 / -2.9%
tpch_q22/datafusion:parquet 152568312 / 187959499 / -18.8% 336602094 / 409052369 / -17.7% 0.45 / 0.46 / -1.4%
duckdb / vortex-file-compressed / ns (0.987x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 195876522 / 209148107 / -6.3% 340201656 / 462063302 / -26.4% 0.58 / 0.45 / +27.2%
tpch_q02/duckdb:vortex-file-compressed 425346665 / 414561232 / +2.6% 480107442 / 563545962 / -14.8% 0.89 / 0.74 / +20.4%
tpch_q03/duckdb:vortex-file-compressed 466702568 / 525376791 / -11.2% 487436114 / 625607993 / -22.1% 0.96 / 0.84 / +14.0%
tpch_q04/duckdb:vortex-file-compressed 326910661 / 320903766 / +1.9% 364652883 / 556166480 / -34.4% 🟢 0.90 / 0.58 / +55.4%
tpch_q05/duckdb:vortex-file-compressed 738884985 / 423099638 / +74.6% 🔴 604594018 / 489788287 / +23.4% 1.22 / 0.86 / +41.5%
tpch_q06/duckdb:vortex-file-compressed 275782745 / 304303562 / -9.4% 292164920 / 360527861 / -19.0% 0.94 / 0.84 / +11.8%
tpch_q07/duckdb:vortex-file-compressed 470050906 / 515231570 / -8.8% 660756346 / 574365352 / +15.0% 0.71 / 0.90 / -20.7%
tpch_q08/duckdb:vortex-file-compressed 683537452 / 683672450 / -0.0% 756906134 / 794405470 / -4.7% 0.90 / 0.86 / +4.9%
tpch_q09/duckdb:vortex-file-compressed 478213579 / 472747782 / +1.2% 484517259 / 501207068 / -3.3% 0.99 / 0.94 / +4.6%
tpch_q10/duckdb:vortex-file-compressed 496062839 / 522677313 / -5.1% 589951577 / 619338721 / -4.7% 0.84 / 0.84 / -0.4%
tpch_q11/duckdb:vortex-file-compressed 195372820 / 213358321 / -8.4% 205375519 / 255950607 / -19.8% 0.95 / 0.83 / +14.1%
tpch_q12/duckdb:vortex-file-compressed 575339729 / 645754996 / -10.9% 665986212 / 624565256 / +6.6% 0.86 / 1.03 / -16.4%
tpch_q13/duckdb:vortex-file-compressed 350052093 / 360744687 / -3.0% 438633928 / 527445659 / -16.8% 0.80 / 0.68 / +16.7%
tpch_q14/duckdb:vortex-file-compressed 266693875 / 254068800 / +5.0% 509363479 / 281178014 / +81.2% 🔴 0.52 / 0.90 / -42.1%
tpch_q15/duckdb:vortex-file-compressed 175357352 / 165334675 / +6.1% 199749575 / 197441802 / +1.2% 0.88 / 0.84 / +4.8%
tpch_q16/duckdb:vortex-file-compressed 186171564 / 179091167 / +4.0% 234189232 / 183083637 / +27.9% 0.79 / 0.98 / -18.7%
tpch_q17/duckdb:vortex-file-compressed 480881209 / 399107960 / +20.5% 573500823 / 523215842 / +9.6% 0.84 / 0.76 / +9.9%
tpch_q18/duckdb:vortex-file-compressed 344816080 / 336590889 / +2.4% 362436922 / 403792842 / -10.2% 0.95 / 0.83 / +14.1%
tpch_q19/duckdb:vortex-file-compressed 299230930 / 338250629 / -11.5% 363425490 / 344492317 / +5.5% 0.82 / 0.98 / -16.1%
tpch_q20/duckdb:vortex-file-compressed 388804910 / 424887866 / -8.5% 523426745 / 460010060 / +13.8% 0.74 / 0.92 / -19.6%
tpch_q21/duckdb:vortex-file-compressed 682831845 / 780327330 / -12.5% 763785994 / 778609336 / -1.9% 0.89 / 1.00 / -10.8%
tpch_q22/duckdb:vortex-file-compressed 199317868 / 253991476 / -21.5% 219172542 / 229671010 / -4.6% 0.91 / 1.11 / -17.8%
duckdb / vortex-compact / ns (1.061x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 219005872 / 211734884 / +3.4% 227102060 / 456853401 / -50.3% 🟢 0.96 / 0.46 / +108.1%
tpch_q02/duckdb:vortex-compact 414942244 / 420535861 / -1.3% 435492215 / 483943897 / -10.0% 0.95 / 0.87 / +9.6%
tpch_q03/duckdb:vortex-compact 515672426 / 407304096 / +26.6% 418455434 / 498375417 / -16.0% 1.23 / 0.82 / +50.8%
tpch_q04/duckdb:vortex-compact 242932708 / 220556714 / +10.1% 389714733 / 262639352 / +48.4% 🔴 0.62 / 0.84 / -25.8%
tpch_q05/duckdb:vortex-compact 373481877 / 362089712 / +3.1% 468400727 / 419527557 / +11.6% 0.80 / 0.86 / -7.6%
tpch_q06/duckdb:vortex-compact 285771116 / 308833884 / -7.5% 307703129 / 281875974 / +9.2% 0.93 / 1.10 / -15.2%
tpch_q07/duckdb:vortex-compact 459198194 / 412249145 / +11.4% 463898905 / 425233869 / +9.1% 0.99 / 0.97 / +2.1%
tpch_q08/duckdb:vortex-compact 605146573 / 565595186 / +7.0% 651479311 / 658809363 / -1.1% 0.93 / 0.86 / +8.2%
tpch_q09/duckdb:vortex-compact 480017017 / 480327539 / -0.1% 566139840 / 425985199 / +32.9% 🔴 0.85 / 1.13 / -24.8%
tpch_q10/duckdb:vortex-compact 425431682 / 411470231 / +3.4% 498192863 / 476740449 / +4.5% 0.85 / 0.86 / -1.1%
tpch_q11/duckdb:vortex-compact 194083663 / 184317310 / +5.3% 217479625 / 238022561 / -8.6% 0.89 / 0.77 / +15.2%
tpch_q12/duckdb:vortex-compact 418964091 / 388121691 / +7.9% 529173690 / 414951660 / +27.5% 0.79 / 0.94 / -15.4%
tpch_q13/duckdb:vortex-compact 229479948 / 390148868 / -41.2% 🟢 292886288 / 647340833 / -54.8% 🟢 0.78 / 0.60 / +30.0%
tpch_q14/duckdb:vortex-compact 226121051 / 237023544 / -4.6% 486551558 / 274388296 / +77.3% 🔴 0.46 / 0.86 / -46.2%
tpch_q15/duckdb:vortex-compact 168808504 / 143749930 / +17.4% 213477798 / 174749108 / +22.2% 0.79 / 0.82 / -3.9%
tpch_q16/duckdb:vortex-compact 201828803 / 186011333 / +8.5% 197836600 / 205597609 / -3.8% 1.02 / 0.90 / +12.8%
tpch_q17/duckdb:vortex-compact 628977963 / 395055018 / +59.2% 🔴 540372541 / 475539102 / +13.6% 1.16 / 0.83 / +40.1%
tpch_q18/duckdb:vortex-compact 482558939 / 276981425 / +74.2% 🔴 493074458 / 313605631 / +57.2% 🔴 0.98 / 0.88 / +10.8%
tpch_q19/duckdb:vortex-compact 347648108 / 345360757 / +0.7% 434501206 / 362638468 / +19.8% 0.80 / 0.95 / -16.0%
tpch_q20/duckdb:vortex-compact 405041929 / 387770891 / +4.5% 444652099 / 423133163 / +5.1% 0.91 / 0.92 / -0.6%
tpch_q21/duckdb:vortex-compact 542935526 / 538877606 / +0.8% 753097053 / 620416953 / +21.4% 0.72 / 0.87 / -17.0%
tpch_q22/duckdb:vortex-compact 176767769 / 189969227 / -6.9% 228199821 / 212681007 / +7.3% 0.77 / 0.89 / -13.3%
duckdb / parquet / ns (0.932x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 275339895 / 297763293 / -7.5% 304218668 / 366692997 / -17.0% 0.91 / 0.81 / +11.5%
tpch_q02/duckdb:parquet 606767770 / 642396220 / -5.5% 652112994 / 738294171 / -11.7% 0.93 / 0.87 / +6.9%
tpch_q03/duckdb:parquet 723529229 / 894250371 / -19.1% 731364434 / 945707201 / -22.7% 0.99 / 0.95 / +4.6%
tpch_q04/duckdb:parquet 491623733 / 478320723 / +2.8% 602301367 / 634576857 / -5.1% 0.82 / 0.75 / +8.3%
tpch_q05/duckdb:parquet 920184134 / 948164212 / -3.0% 801878104 / 1012401156 / -20.8% 1.15 / 0.94 / +22.5%
tpch_q06/duckdb:parquet 379090995 / 419163589 / -9.6% 341827901 / 419535087 / -18.5% 1.11 / 1.00 / +11.0%
tpch_q07/duckdb:parquet 841414643 / 923133234 / -8.9% 840106657 / 905207859 / -7.2% 1.00 / 1.02 / -1.8%
tpch_q08/duckdb:parquet 1121878740 / 1165498865 / -3.7% 1026321802 / 1309040304 / -21.6% 1.09 / 0.89 / +22.8%
tpch_q09/duckdb:parquet 1005339721 / 953805620 / +5.4% 982917758 / 1021952572 / -3.8% 1.02 / 0.93 / +9.6%
tpch_q10/duckdb:parquet 857343804 / 991878144 / -13.6% 906069676 / 875723659 / +3.5% 0.95 / 1.13 / -16.5%
tpch_q11/duckdb:parquet 424614671 / 413465409 / +2.7% 459135751 / 472424565 / -2.8% 0.92 / 0.88 / +5.7%
tpch_q12/duckdb:parquet 555360825 / 621543002 / -10.6% 632201086 / 962231296 / -34.3% 🟢 0.88 / 0.65 / +36.0%
tpch_q13/duckdb:parquet 665034810 / 721132084 / -7.8% 819588872 / 1077644424 / -23.9% 0.81 / 0.67 / +21.3%
tpch_q14/duckdb:parquet 460455006 / 556846089 / -17.3% 464877442 / 570021337 / -18.4% 0.99 / 0.98 / +1.4%
tpch_q15/duckdb:parquet 349290757 / 479741479 / -27.2% 325866061 / 314282791 / +3.7% 1.07 / 1.53 / -29.8%
tpch_q16/duckdb:parquet 520704890 / 485566016 / +7.2% 450177115 / 718191942 / -37.3% 🟢 1.16 / 0.68 / +71.1%
tpch_q17/duckdb:parquet 464394473 / 526291126 / -11.8% 438637871 / 528816989 / -17.1% 1.06 / 1.00 / +6.4%
tpch_q18/duckdb:parquet 619748998 / 628361142 / -1.4% 663855099 / 818516487 / -18.9% 0.93 / 0.77 / +21.6%
tpch_q19/duckdb:parquet 600365821 / 560938133 / +7.0% 528770341 / 574473862 / -8.0% 1.14 / 0.98 / +16.3%
tpch_q20/duckdb:parquet 867603998 / 898748482 / -3.5% 898638787 / 745917472 / +20.5% 0.97 / 1.20 / -19.9%
tpch_q21/duckdb:parquet 701700048 / 730120327 / -3.9% 638929356 / 701844456 / -9.0% 1.10 / 1.04 / +5.6%
tpch_q22/duckdb:parquet 378715726 / 424018315 / -10.7% 421570561 / 503985482 / -16.4% 0.90 / 0.84 / +6.8%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +15.8%
Engines: DataFusion No clear signal (+10.6%, environment too noisy confidence) · DuckDB No clear signal (+21.4%, environment too noisy confidence)
Vortex (geomean): hot 0.982x ➖ · cold 0.913x ➖
Parquet (geomean): hot 0.847x ➖ · cold 0.821x ➖
Shifts: Parquet (control) -15.3% · Median polish -8.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.961x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 327165223 / 476537854 / -31.3% 🟢 1022364420 / 1275462842 / -19.8% 0.32 / 0.37 / -14.3%
tpch_q02/datafusion:vortex-compact 593881646 / 567272774 / +4.7% 1130053376 / 1011181464 / +11.8% 0.53 / 0.56 / -6.3%
tpch_q03/datafusion:vortex-compact 645601152 / 655542773 / -1.5% 1665012690 / 1795293326 / -7.3% 0.39 / 0.37 / +6.2%
tpch_q04/datafusion:vortex-compact 307596566 / 425987247 / -27.8% 652928937 / 795585751 / -17.9% 0.47 / 0.54 / -12.0%
tpch_q05/datafusion:vortex-compact 848558666 / 767618754 / +10.5% 961849061 / 1328907890 / -27.6% 0.88 / 0.58 / +52.7%
tpch_q06/datafusion:vortex-compact 568717908 / 444590547 / +27.9% 615682722 / 861966354 / -28.6% 0.92 / 0.52 / +79.1%
tpch_q07/datafusion:vortex-compact 662962506 / 743731608 / -10.9% 1119088856 / 1026189502 / +9.1% 0.59 / 0.72 / -18.3%
tpch_q08/datafusion:vortex-compact 948552138 / 902202071 / +5.1% 1159016754 / 1151124845 / +0.7% 0.82 / 0.78 / +4.4%
tpch_q09/datafusion:vortex-compact 735267343 / 715153149 / +2.8% 1099539764 / 1066321773 / +3.1% 0.67 / 0.67 / -0.3%
tpch_q10/datafusion:vortex-compact 880813306 / 677632613 / +30.0% 1575014745 / 918248046 / +71.5% 🔴 0.56 / 0.74 / -24.2%
tpch_q11/datafusion:vortex-compact 373718446 / 372144204 / +0.4% 612961699 / 808122048 / -24.1% 0.61 / 0.46 / +32.4%
tpch_q12/datafusion:vortex-compact 571878603 / 641588010 / -10.9% 1053788924 / 824473492 / +27.8% 0.54 / 0.78 / -30.3%
tpch_q13/datafusion:vortex-compact 270950668 / 312014150 / -13.2% 550649403 / 702033472 / -21.6% 0.49 / 0.44 / +10.7%
tpch_q14/datafusion:vortex-compact 381302741 / 298528823 / +27.7% 494525261 / 468828850 / +5.5% 0.77 / 0.64 / +21.1%
tpch_q15/datafusion:vortex-compact 690987002 / 657774485 / +5.0% 841332596 / 907277175 / -7.3% 0.82 / 0.72 / +13.3%
tpch_q16/datafusion:vortex-compact 260264011 / 284279439 / -8.4% 433908097 / 479575085 / -9.5% 0.60 / 0.59 / +1.2%
tpch_q17/datafusion:vortex-compact 759518773 / 745136608 / +1.9% 827398412 / 912124452 / -9.3% 0.92 / 0.82 / +12.4%
tpch_q18/datafusion:vortex-compact 573289542 / 653792263 / -12.3% 573496696 / 880992337 / -34.9% 🟢 1.00 / 0.74 / +34.7%
tpch_q19/datafusion:vortex-compact 662228470 / 1052554683 / -37.1% 🟢 764447119 / 777377777 / -1.7% 0.87 / 1.35 / -36.0%
tpch_q20/datafusion:vortex-compact 671239840 / 628111370 / +6.9% 683274829 / 906113465 / -24.6% 0.98 / 0.69 / +41.7%
tpch_q21/datafusion:vortex-compact 810755184 / 858442532 / -5.6% 1018933740 / 1155632159 / -11.8% 0.80 / 0.74 / +7.1%
tpch_q22/datafusion:vortex-compact 438530698 / 517396562 / -15.2% 654963600 / 849902379 / -22.9% 0.67 / 0.61 / +10.0%
datafusion / parquet / ns (0.869x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 243144599 / 346476769 / -29.8% 666222448 / 768226663 / -13.3% 0.36 / 0.45 / -19.1%
tpch_q02/datafusion:parquet 460309447 / 526853455 / -12.6% 967364670 / 1330230540 / -27.3% 0.48 / 0.40 / +20.1%
tpch_q03/datafusion:parquet 558896300 / 572778492 / -2.4% 1023330144 / 1178653813 / -13.2% 0.55 / 0.49 / +12.4%
tpch_q04/datafusion:parquet 366757368 / 343998033 / +6.6% 590790605 / 587864077 / +0.5% 0.62 / 0.59 / +6.1%
tpch_q05/datafusion:parquet 747930922 / 895686522 / -16.5% 1497919475 / 1349590787 / +11.0% 0.50 / 0.66 / -24.8%
tpch_q06/datafusion:parquet 263814193 / 238077728 / +10.8% 490818082 / 563778861 / -12.9% 0.54 / 0.42 / +27.3%
tpch_q07/datafusion:parquet 616838060 / 789195892 / -21.8% 885638836 / 890481596 / -0.5% 0.70 / 0.89 / -21.4%
tpch_q08/datafusion:parquet 810216122 / 1181880880 / -31.4% 🟢 1091945554 / 1596579212 / -31.6% 🟢 0.74 / 0.74 / +0.2%
tpch_q09/datafusion:parquet 990235795 / 1007502775 / -1.7% 1305030463 / 1212628340 / +7.6% 0.76 / 0.83 / -8.7%
tpch_q10/datafusion:parquet 1363718085 / 1497306733 / -8.9% 1510733836 / 1981159740 / -23.7% 0.90 / 0.76 / +19.4%
tpch_q11/datafusion:parquet 390448488 / 405059747 / -3.6% 547724420 / 692042527 / -20.9% 0.71 / 0.59 / +21.8%
tpch_q12/datafusion:parquet 400575840 / 430728800 / -7.0% 764906922 / 660267763 / +15.8% 0.52 / 0.65 / -19.7%
tpch_q13/datafusion:parquet 472480139 / 502316296 / -5.9% 983053179 / 895419823 / +9.8% 0.48 / 0.56 / -14.3%
tpch_q14/datafusion:parquet 415973201 / 431766251 / -3.7% 683453891 / 1025290900 / -33.3% 🟢 0.61 / 0.42 / +44.5%
tpch_q15/datafusion:parquet 536637555 / 962801789 / -44.3% 🟢 740055786 / 1033821122 / -28.4% 0.73 / 0.93 / -22.1%
tpch_q16/datafusion:parquet 218824673 / 302869841 / -27.7% 536070744 / 620049818 / -13.5% 0.41 / 0.49 / -16.4%
tpch_q17/datafusion:parquet 616312588 / 815725195 / -24.4% 693394452 / 998209068 / -30.5% 🟢 0.89 / 0.82 / +8.8%
tpch_q18/datafusion:parquet 615289439 / 1017501861 / -39.5% 🟢 1002953285 / 917606488 / +9.3% 0.61 / 1.11 / -44.7%
tpch_q19/datafusion:parquet 447989092 / 461609882 / -3.0% 650127866 / 662154371 / -1.8% 0.69 / 0.70 / -1.2%
tpch_q20/datafusion:parquet 1134479821 / 714979116 / +58.7% 🔴 931107924 / 1072305358 / -13.2% 1.22 / 0.67 / +82.7%
tpch_q21/datafusion:parquet 1087618933 / 967575976 / +12.4% 1115027441 / 1303936997 / -14.5% 0.98 / 0.74 / +31.5%
tpch_q22/datafusion:parquet 514053132 / 828191723 / -37.9% 🟢 776580236 / 944013693 / -17.7% 0.66 / 0.88 / -24.5%
duckdb / vortex-compact / ns (1.003x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 964117516 / 1127921877 / -14.5% 1359257616 / 2557906596 / -46.9% 🟢 0.71 / 0.44 / +60.9%
tpch_q02/duckdb:vortex-compact 621713449 / 504120904 / +23.3% 990574861 / 905186226 / +9.4% 0.63 / 0.56 / +12.7%
tpch_q03/duckdb:vortex-compact 1213114763 / 1127651473 / +7.6% 1419701929 / 1873422974 / -24.2% 0.85 / 0.60 / +42.0%
tpch_q04/duckdb:vortex-compact 727389918 / 1163542669 / -37.5% 🟢 790552914 / 1109552166 / -28.8% 0.92 / 1.05 / -12.3%
tpch_q05/duckdb:vortex-compact 1232807535 / 1230880421 / +0.2% 1316643065 / 1488621516 / -11.6% 0.94 / 0.83 / +13.2%
tpch_q06/duckdb:vortex-compact 1181216462 / 1153293265 / +2.4% 1205508419 / 1142294930 / +5.5% 0.98 / 1.01 / -2.9%
tpch_q07/duckdb:vortex-compact 1536079354 / 1570040364 / -2.2% 1577217069 / 1795079915 / -12.1% 0.97 / 0.87 / +11.4%
tpch_q08/duckdb:vortex-compact 1562887510 / 1624696514 / -3.8% 1713031197 / 1831427934 / -6.5% 0.91 / 0.89 / +2.8%
tpch_q09/duckdb:vortex-compact 1928420273 / 1781248591 / +8.3% 1897649538 / 2159147483 / -12.1% 1.02 / 0.82 / +23.2%
tpch_q10/duckdb:vortex-compact 1639989321 / 1560082193 / +5.1% 1795279037 / 2321985571 / -22.7% 0.91 / 0.67 / +36.0%
tpch_q11/duckdb:vortex-compact 521651926 / 487666759 / +7.0% 614147231 / 652151130 / -5.8% 0.85 / 0.75 / +13.6%
tpch_q12/duckdb:vortex-compact 2145616296 / 2250671283 / -4.7% 2110907973 / 2450467948 / -13.9% 1.02 / 0.92 / +10.7%
tpch_q13/duckdb:vortex-compact 1213135862 / 1155483832 / +5.0% 1583229014 / 1576750086 / +0.4% 0.77 / 0.73 / +4.6%
tpch_q14/duckdb:vortex-compact 858003194 / 819253111 / +4.7% 1018963206 / 964541211 / +5.6% 0.84 / 0.85 / -0.9%
tpch_q15/duckdb:vortex-compact 915197856 / 917558571 / -0.3% 979130322 / 979893432 / -0.1% 0.93 / 0.94 / -0.2%
tpch_q16/duckdb:vortex-compact 236347264 / 229988422 / +2.8% 317577359 / 257774036 / +23.2% 0.74 / 0.89 / -16.6%
tpch_q17/duckdb:vortex-compact 1376337379 / 1352739883 / +1.7% 1555644962 / 1367364355 / +13.8% 0.88 / 0.99 / -10.6%
tpch_q18/duckdb:vortex-compact 1147134622 / 1113427933 / +3.0% 1166287396 / 1475196427 / -20.9% 0.98 / 0.75 / +30.3%
tpch_q19/duckdb:vortex-compact 1178069467 / 1325520816 / -11.1% 1201979437 / 1350873550 / -11.0% 0.98 / 0.98 / -0.1%
tpch_q20/duckdb:vortex-compact 2181226740 / 1734477267 / +25.8% 2158048186 / 1858949103 / +16.1% 1.01 / 0.93 / +8.3%
tpch_q21/duckdb:vortex-compact 2493972128 / 2387987109 / +4.4% 2429409923 / 2495633530 / -2.7% 1.03 / 0.96 / +7.3%
tpch_q22/duckdb:vortex-compact 488551053 / 502522282 / -2.8% 610628719 / 734251997 / -16.8% 0.80 / 0.68 / +16.9%
duckdb / parquet / ns (0.826x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 332559743 / 449976888 / -26.1% 366193839 / 553149961 / -33.8% 🟢 0.91 / 0.81 / +11.6%
tpch_q02/duckdb:parquet 720901447 / 799372201 / -9.8% 1175163379 / 1580701195 / -25.7% 0.61 / 0.51 / +21.3%
tpch_q03/duckdb:parquet 972235779 / 1064875306 / -8.7% 1032956856 / 1605439495 / -35.7% 🟢 0.94 / 0.66 / +41.9%
tpch_q04/duckdb:parquet 656719055 / 632140932 / +3.9% 664803954 / 792026546 / -16.1% 0.99 / 0.80 / +23.8%
tpch_q05/duckdb:parquet 1159886346 / 1624447710 / -28.6% 1313915611 / 1498478003 / -12.3% 0.88 / 1.08 / -18.6%
tpch_q06/duckdb:parquet 420760134 / 502893206 / -16.3% 579122350 / 388765855 / +49.0% 🔴 0.73 / 1.29 / -43.8%
tpch_q07/duckdb:parquet 1031771306 / 1388393691 / -25.7% 1171381682 / 2446585520 / -52.1% 🟢 0.88 / 0.57 / +55.2%
tpch_q08/duckdb:parquet 1317434999 / 1538011415 / -14.3% 1458490713 / 1328851880 / +9.8% 0.90 / 1.16 / -22.0%
tpch_q09/duckdb:parquet 1270231084 / 1766845566 / -28.1% 1282061460 / 2056451569 / -37.7% 🟢 0.99 / 0.86 / +15.3%
tpch_q10/duckdb:parquet 1931088446 / 2042738438 / -5.5% 2161254599 / 2406383031 / -10.2% 0.89 / 0.85 / +5.3%
tpch_q11/duckdb:parquet 497892768 / 560584273 / -11.2% 470705779 / 576216733 / -18.3% 1.06 / 0.97 / +8.7%
tpch_q12/duckdb:parquet 589685060 / 818681914 / -28.0% 751182415 / 963536375 / -22.0% 0.79 / 0.85 / -7.6%
tpch_q13/duckdb:parquet 898957284 / 874921395 / +2.7% 990616348 / 1159821694 / -14.6% 0.91 / 0.75 / +20.3%
tpch_q14/duckdb:parquet 860618471 / 882155350 / -2.4% 756583285 / 893916587 / -15.4% 1.14 / 0.99 / +15.3%
tpch_q15/duckdb:parquet 661772746 / 573606891 / +15.4% 743017053 / 974783729 / -23.8% 0.89 / 0.59 / +51.4%
tpch_q16/duckdb:parquet 623557345 / 710754659 / -12.3% 672893221 / 648756113 / +3.7% 0.93 / 1.10 / -15.4%
tpch_q17/duckdb:parquet 619650632 / 788498340 / -21.4% 650814554 / 846147131 / -23.1% 0.95 / 0.93 / +2.2%
tpch_q18/duckdb:parquet 816646567 / 1049904404 / -22.2% 916145086 / 1309836976 / -30.1% 🟢 0.89 / 0.80 / +11.2%
tpch_q19/duckdb:parquet 786680229 / 1527483972 / -48.5% 🟢 894257465 / 1613648161 / -44.6% 🟢 0.88 / 0.95 / -7.1%
tpch_q20/duckdb:parquet 1114609864 / 2172309794 / -48.7% 🟢 1221826943 / 2743518866 / -55.5% 🟢 0.91 / 0.79 / +15.2%
tpch_q21/duckdb:parquet 1019864742 / 1154183211 / -11.6% 928771141 / 1463472365 / -36.5% 🟢 1.10 / 0.79 / +39.2%
tpch_q22/duckdb:parquet 756023532 / 760442880 / -0.6% 884279797 / 902297698 / -2.0% 0.85 / 0.84 / +1.4%

@myrrc
myrrc merged commit f234bc6 into develop Oct 7, 2026
139 of 140 checks passed
@myrrc
myrrc deleted the myrrc/to-mask-kernel branch October 7, 2026 11:46
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Engines: random-access No clear signal (+4.4%, environment too noisy confidence)
Vortex (geomean): hot 1.018x ➖
Parquet (geomean): hot 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.991x ➖, 1↑ 1↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 70501 / 73428 / -4.0%
random-access/arrow-tokio-local-disk-footer 163259 / 163671 / -0.3%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2491289 / 2639221 / -5.6%
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2020723 / 3349868 / -39.7% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk 32495960 / 32503031 / -0.0%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 55781818 / 33340324 / +67.3% 🔴
random-access/nested-lists/correlated/arrow-tokio-local-disk 59155 / 60125 / -1.6%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 103669 / 102395 / +1.2%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1118894 / 1123421 / -0.4%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1211168 / 1189957 / +1.8%
random-access/nested-structs/correlated/arrow-tokio-local-disk 53314 / 54989 / -3.0%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 93644 / 91341 / +2.5%
random-access/nested-structs/uniform/arrow-tokio-local-disk 872730 / 910509 / -4.1%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 910285 / 938900 / -3.0%
random-access/taxi/correlated/arrow-tokio-local-disk 119069 / 122634 / -2.9%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 215436 / 214633 / +0.4%
random-access/taxi/uniform/arrow-tokio-local-disk 2952201 / 2894185 / +2.0%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 3069512 / 3075787 / -0.2%
random-access / vortex-file-compressed / ns (1.018x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 250513 / 245361 / +2.1%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1274796 / 1262356 / +1.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1476977 / 1466366 / +0.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2738598 / 2711943 / +1.0%
random-access/nested-lists/correlated/vortex-tokio-local-disk 210968 / 205263 / +2.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 384356 / 368951 / +4.2%
random-access/nested-lists/uniform/vortex-tokio-local-disk 742246 / 716519 / +3.6%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 975777 / 966330 / +1.0%
random-access/nested-structs/correlated/vortex-tokio-local-disk 267628 / 250642 / +6.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 541806 / 521903 / +3.8%
random-access/nested-structs/uniform/vortex-tokio-local-disk 620396 / 591252 / +4.9%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 977783 / 978326 / -0.1%
random-access/taxi/correlated/vortex-tokio-local-disk 678082 / 682412 / -0.6%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1468847 / 1451808 / +1.2%
random-access/taxi/uniform/vortex-tokio-local-disk 2727780 / 2675364 / +2.0%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3859704 / 3889530 / -0.8%
random-access/vortex-tokio-local-disk 456618 / 450732 / +1.3%
random-access/vortex-tokio-local-disk-footer 1071573 / 1090880 / -1.8%
random-access / parquet / ns (0.975x ➖, 1↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107494481691 / 110280002484 / -2.5%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 107456704311 / 108351190658 / -0.8%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 108086284227 / 113039677062 / -4.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 113910916185 / 158740407559 / -28.2% 🟢
random-access/nested-lists/correlated/parquet-tokio-local-disk 143448428 / 147173015 / -2.5%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 143287427 / 147479402 / -2.8%
random-access/nested-lists/uniform/parquet-tokio-local-disk 143577300 / 147754428 / -2.8%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 143366206 / 144558782 / -0.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44865422 / 44086627 / +1.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 45084309 / 44182449 / +2.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44854737 / 43988258 / +2.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 45031472 / 44194836 / +1.9%
random-access/parquet-tokio-local-disk 118719754 / 118668754 / +0.0%
random-access/parquet-tokio-local-disk-footer 118906736 / 118834773 / +0.1%
random-access/taxi/correlated/parquet-tokio-local-disk 178425576 / 178112889 / +0.2%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 181829864 / 178086370 / +2.1%
random-access/taxi/uniform/parquet-tokio-local-disk 188426260 / 193366183 / -2.6%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 188178395 / 192604938 / -2.3%
random-access / lance / ns (1.001x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 297384 / 295320 / +0.7%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1268551 / 1248976 / +1.6%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1015771 / 1039104 / -2.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2023736 / 1997597 / +1.3%
random-access/lance-tokio-local-disk 527605 / 538432 / -2.0%
random-access/lance-tokio-local-disk-footer 1479116 / 1509944 / -2.0%
random-access/nested-lists/correlated/lance-tokio-local-disk 162191 / 160126 / +1.3%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 729978 / 736798 / -0.9%
random-access/nested-lists/uniform/lance-tokio-local-disk 849622 / 818954 / +3.7%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1437977 / 1434643 / +0.2%
random-access/nested-structs/correlated/lance-tokio-local-disk 272785 / 267276 / +2.1%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 638387 / 634049 / +0.7%
random-access/nested-structs/uniform/lance-tokio-local-disk 2259546 / 2281443 / -1.0%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2619302 / 2702342 / -3.1%
random-access/taxi/correlated/lance-tokio-local-disk 772550 / 756403 / +2.1%
random-access/taxi/correlated/lance-tokio-local-disk-footer 2035230 / 2043034 / -0.4%
random-access/taxi/uniform/lance-tokio-local-disk 8032396 / 8146952 / -1.4%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8922446 / 8807082 / +1.3%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR ad622893 vs base c6e51ba4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +11.4%
Engines: random-access No clear signal (+11.4%, low confidence)
Vortex (geomean): hot 1.100x ➖
Parquet (geomean): hot 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.100x ➖, 0↑ 4↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 43763424 / 47758465 / -8.4%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 106203090 / 111475111 / -4.7%
random-access/feature-vectors/uniform/vortex-tokio-s3 89204943 / 82116368 / +8.6%
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 159618147 / 153709564 / +3.8%
random-access/nested-lists/correlated/vortex-tokio-s3 42007516 / 39319322 / +6.8%
random-access/nested-lists/correlated/vortex-tokio-s3-footer 76502991 / 79848921 / -4.2%
random-access/nested-lists/uniform/vortex-tokio-s3 159997043 / 159667814 / +0.2%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 197470401 / 200051471 / -1.3%
random-access/nested-structs/correlated/vortex-tokio-s3 46245383 / 58141445 / -20.5%
random-access/nested-structs/correlated/vortex-tokio-s3-footer 96210982 / 113004844 / -14.9%
random-access/nested-structs/uniform/vortex-tokio-s3 167600931 / 169835544 / -1.3%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 204184610 / 221921648 / -8.0%
random-access/taxi/correlated/vortex-tokio-s3 190061445 / 97667717 / +94.6% 🔴
random-access/taxi/correlated/vortex-tokio-s3-footer 189953888 / 141238483 / +34.5% 🔴
random-access/taxi/uniform/vortex-tokio-s3 242925174 / 174103198 / +39.5% 🔴
random-access/taxi/uniform/vortex-tokio-s3-footer 232022785 / 233476822 / -0.6%
random-access/vortex-tokio-s3 105452780 / 52822878 / +99.6% 🔴
random-access/vortex-tokio-s3-footer 122506224 / 97468954 / +25.7%
random-access / parquet / ns (0.988x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 177531260659 / 189076333230 / -6.1%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 170281876205 / 176538192682 / -3.5%
random-access/feature-vectors/uniform/parquet-tokio-s3 160902809312 / 175347499256 / -8.2%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 167701499748 / 171342145828 / -2.1%
random-access/nested-lists/correlated/parquet-tokio-s3 1022166567 / 1033859799 / -1.1%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1108075858 / 1147396165 / -3.4%
random-access/nested-lists/uniform/parquet-tokio-s3 1080845176 / 1033907222 / +4.5%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1101566371 / 1099061056 / +0.2%
random-access/nested-structs/correlated/parquet-tokio-s3 453335617 / 453978740 / -0.1%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 531630686 / 530684760 / +0.2%
random-access/nested-structs/uniform/parquet-tokio-s3 452357291 / 451273718 / +0.2%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 524932784 / 527737511 / -0.5%
random-access/parquet-tokio-s3 478073570 / 508037905 / -5.9%
random-access/parquet-tokio-s3-footer 531773034 / 548129243 / -3.0%
random-access/taxi/correlated/parquet-tokio-s3 748171907 / 741694169 / +0.9%
random-access/taxi/correlated/parquet-tokio-s3-footer 804032825 / 791366986 / +1.6%
random-access/taxi/uniform/parquet-tokio-s3 807065606 / 787877188 / +2.4%
random-access/taxi/uniform/parquet-tokio-s3-footer 855475166 / 826681566 / +3.5%
random-access / lance / ns (0.869x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 39257207 / 40240498 / -2.4%
random-access/feature-vectors/correlated/lance-tokio-s3-footer 194874990 / 198483762 / -1.8%
random-access/feature-vectors/uniform/lance-tokio-s3 78742549 / 155395299 / -49.3% 🟢
random-access/feature-vectors/uniform/lance-tokio-s3-footer 231902245 / 240983211 / -3.8%
random-access/lance-tokio-s3 58432704 / 63461747 / -7.9%
random-access/lance-tokio-s3-footer 245870324 / 281923640 / -12.8%
random-access/nested-lists/correlated/lance-tokio-s3 33593188 / 33486796 / +0.3%
random-access/nested-lists/correlated/lance-tokio-s3-footer 221118146 / 207912428 / +6.4%
random-access/nested-lists/uniform/lance-tokio-s3 76476165 / 151860799 / -49.6% 🟢
random-access/nested-lists/uniform/lance-tokio-s3-footer 239516754 / 258870229 / -7.5%
random-access/nested-structs/correlated/lance-tokio-s3 42988508 / 45304397 / -5.1%
random-access/nested-structs/correlated/lance-tokio-s3-footer 229863291 / 234709212 / -2.1%
random-access/nested-structs/uniform/lance-tokio-s3 116153378 / 112106937 / +3.6%
random-access/nested-structs/uniform/lance-tokio-s3-footer 279751038 / 296801594 / -5.7%
random-access/taxi/correlated/lance-tokio-s3 152018029 / 190831474 / -20.3%
random-access/taxi/correlated/lance-tokio-s3-footer 265310560 / 337147469 / -21.3%
random-access/taxi/uniform/lance-tokio-s3 252933277 / 283759234 / -10.9%
random-access/taxi/uniform/lance-tokio-s3-footer 549635579 / 650913367 / -15.6%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR ad622893 vs base c6e51ba4


vortex / vortex-file-compressed / ns (0.981x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 766208291 / 766078471 / +0.0%
compress time/Bimbo 3704301064 / 3742375038 / -1.0%
compress time/CMSprovider 2598812587 / 2520301324 / +3.1%
compress time/Euro2016 268165884 / 265879212 / +0.9%
compress time/Food 281354375 / 280795386 / +0.2%
compress time/HashTags 480509719 / 477673249 / +0.6%
compress time/TPC-H l_comment canonical 625033589 / 625325814 / -0.0%
compress time/TPC-H l_comment chunked 627188737 / 626920000 / +0.0%
compress time/taxi 403177264 / 404593731 / -0.4%
compress time/wide table cols=100 chunks=1 rows=1000 7273522 / 7393171 / -1.6%
compress time/wide table cols=100 chunks=50 rows=1000 7242055 / 7234912 / +0.1%
compress time/wide table cols=1000 chunks=1 rows=1000 71678033 / 71229765 / +0.6%
compress time/wide table cols=1000 chunks=50 rows=1000 71345462 / 71132617 / +0.3%
compress time/wide table cols=10000 chunks=1 rows=1000 770278893 / 796480037 / -3.3%
compress time/wide table cols=10000 chunks=50 rows=1000 780055946 / 790236497 / -1.3%
decompress time/Arade 9124665 / 9758818 / -6.5%
decompress time/Bimbo 59118792 / 62741645 / -5.8%
decompress time/CMSprovider 28838043 / 29295584 / -1.6%
decompress time/Euro2016 7055090 / 7519282 / -6.2%
decompress time/Food 2819455 / 2829396 / -0.4%
decompress time/HashTags 58108976 / 60616919 / -4.1%
decompress time/TPC-H l_comment canonical 20498147 / 22379292 / -8.4%
decompress time/TPC-H l_comment chunked 20582789 / 21853404 / -5.8%
decompress time/taxi 7501148 / 7885368 / -4.9%
decompress time/wide table cols=100 chunks=1 rows=1000 2000373 / 2019139 / -0.9%
decompress time/wide table cols=100 chunks=50 rows=1000 2009556 / 2050747 / -2.0%
decompress time/wide table cols=1000 chunks=1 rows=1000 19365212 / 19474627 / -0.6%
decompress time/wide table cols=1000 chunks=50 rows=1000 19365870 / 19789225 / -2.1%
decompress time/wide table cols=10000 chunks=1 rows=1000 224631419 / 230269750 / -2.4%
decompress time/wide table cols=10000 chunks=50 rows=1000 226220036 / 230365632 / -1.8%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142212028 / 142212028 / +0.0%
vortex-file-compressed size/Bimbo 458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420778804 / 420778804 / +0.0%
vortex-file-compressed size/Euro2016 164045668 / 164045668 / +0.0%
vortex-file-compressed size/Food 38949464 / 38949464 / +0.0%
vortex-file-compressed size/HashTags 190338852 / 190338852 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179845112 / 179845112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179845112 / 179845112 / +0.0%
vortex-file-compressed size/taxi 49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.984x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.34066174 / 0.338953909 / +0.5%
vortex:parquet-zstd ratio compress time/Bimbo 0.314401514 / 0.31628059 / -0.6%
vortex:parquet-zstd ratio compress time/CMSprovider 0.407614217 / 0.394741234 / +3.3%
vortex:parquet-zstd ratio compress time/Euro2016 0.248966633 / 0.245094773 / +1.6%
vortex:parquet-zstd ratio compress time/Food 0.38104094 / 0.379106087 / +0.5%
vortex:parquet-zstd ratio compress time/HashTags 0.262912627 / 0.260573089 / +0.9%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.237471363 / 0.238147536 / -0.3%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.23880858 / 0.237763859 / +0.4%
vortex:parquet-zstd ratio compress time/taxi 0.370007245 / 0.370051099 / -0.0%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.83637097 / 1.86915296 / -1.8%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.82395217 / 1.82908942 / -0.3%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.60497091 / 1.61346624 / -0.5%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.57331356 / 1.60392998 / -1.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.61072089 / 1.70832772 / -5.7%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.69114974 / 1.74198389 / -2.9%
vortex:parquet-zstd ratio decompress time/Arade 0.016359936 / 0.0174023461 / -6.0%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0367972396 / 0.0386789657 / -4.9%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0211843659 / 0.0214348078 / -1.2%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0212329797 / 0.0225819028 / -6.0%
vortex:parquet-zstd ratio decompress time/Food 0.0165582053 / 0.0165180186 / +0.2%
vortex:parquet-zstd ratio decompress time/HashTags 0.11272349 / 0.117427519 / -4.0%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0410851887 / 0.0448473931 / -8.4%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0412600236 / 0.0437407305 / -5.7%
vortex:parquet-zstd ratio decompress time/taxi 0.0343855449 / 0.0360883423 / -4.7%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.966624336 / 0.985017448 / -1.9%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.969127202 / 0.996214791 / -2.7%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.821447098 / 0.828755529 / -0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.783363443 / 0.846469017 / -7.5%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.893101211 / 0.947569441 / -5.7%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.908371929 / 0.964829329 / -5.9%
vortex:parquet-zstd size/Arade 0.551178899 / 0.551178899 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11645609 / 1.11645609 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33393183 / 1.33393183 / -0.0%
vortex:parquet-zstd size/Food 1.09103668 / 1.09103668 / +0.0%
vortex:parquet-zstd size/HashTags 1.42578493 / 1.42578493 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/taxi 0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (1.006x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2249176237 / 2260125786 / -0.5%
parquet_rs-zstd compress time/Bimbo 11782071336 / 11832452436 / -0.4%
parquet_rs-zstd compress time/CMSprovider 6375667183 / 6384692315 / -0.1%
parquet_rs-zstd compress time/Euro2016 1077115759 / 1084801639 / -0.7%
parquet_rs-zstd compress time/Food 738383584 / 740677599 / -0.3%
parquet_rs-zstd compress time/HashTags 1827640328 / 1833164167 / -0.3%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2632037737 / 2625791658 / +0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2626324131 / 2636733783 / -0.4%
parquet_rs-zstd compress time/taxi 1089646944 / 1093345574 / -0.3%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3960813 / 3955359 / +0.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3970529 / 3955472 / +0.4%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44660020 / 44147044 / +1.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 45347262 / 44348954 / +2.3%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 478219969 / 466233750 / +2.6%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 461257764 / 453641679 / +1.7%
parquet_rs-zstd decompress time/Arade 557744543 / 560775998 / -0.5%
parquet_rs-zstd decompress time/Bimbo 1606609425 / 1622112791 / -1.0%
parquet_rs-zstd decompress time/CMSprovider 1361288938 / 1366729491 / -0.4%
parquet_rs-zstd decompress time/Euro2016 332270369 / 332978229 / -0.2%
parquet_rs-zstd decompress time/Food 170275398 / 171291489 / -0.6%
parquet_rs-zstd decompress time/HashTags 515500148 / 516207098 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 498918166 / 499009875 / -0.0%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 498855483 / 499612232 / -0.2%
parquet_rs-zstd decompress time/taxi 218148295 / 218501807 / -0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2069442 / 2049851 / +1.0%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2073573 / 2058539 / +0.7%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23574509 / 23498639 / +0.3%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 24721437 / 23378558 / +5.7%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 251518435 / 243010950 / +3.5%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 249038999 / 238763090 / +4.3%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.992x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98515032 / 99981989 / -1.5%
arrow-ipc compress time/Bimbo 614356280 / 626734768 / -2.0%
arrow-ipc compress time/CMSprovider 381660215 / 385857512 / -1.1%
arrow-ipc compress time/Euro2016 38315848 / 38618536 / -0.8%
arrow-ipc compress time/Food 33697772 / 34196464 / -1.5%
arrow-ipc compress time/HashTags 78490211 / 78996956 / -0.6%
arrow-ipc compress time/TPC-H l_comment canonical 498104104 / 500319604 / -0.4%
arrow-ipc compress time/TPC-H l_comment chunked 501028460 / 505674661 / -0.9%
arrow-ipc compress time/taxi 74377978 / 75338923 / -1.3%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 200555 / 210224 / -4.6%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 201744 / 212452 / -5.0%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2232754 / 2263427 / -1.4%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2217033 / 2274370 / -2.5%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25567877 / 25753757 / -0.7%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25881418 / 25773873 / +0.4%
arrow-ipc decompress time/Arade 180777950 / 182140399 / -0.7%
arrow-ipc decompress time/Bimbo 406868029 / 408720706 / -0.5%
arrow-ipc decompress time/CMSprovider 581844609 / 583316363 / -0.3%
arrow-ipc decompress time/Euro2016 74666212 / 75182976 / -0.7%
arrow-ipc decompress time/Food 58134553 / 58371984 / -0.4%
arrow-ipc decompress time/HashTags 142530036 / 146016988 / -2.4%
arrow-ipc decompress time/TPC-H l_comment canonical 531070340 / 534130987 / -0.6%
arrow-ipc decompress time/TPC-H l_comment chunked 533374936 / 532980942 / +0.1%
arrow-ipc decompress time/taxi 48676982 / 48807998 / -0.3%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 317859 / 323042 / -1.6%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 324022 / 320885 / +1.0%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3561271 / 3621939 / -1.7%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3879258 / 3667934 / +5.8%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 37051853 / 37426454 / -1.0%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 37271457 / 36049039 / +3.4%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/deprecation A change that introduces a series of API deprecations

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants