Bound decimal storage by precision by joseph-isaacs · Pull Request #10305 · vortex-data/vortex

joseph-isaacs · 2026-10-05T13:37:00Z

Decimal arrays currently permit physical storage wider than the smallest type required by their precision. Establish values_type <= DecimalType::smallest_decimal_value_type(decimal_dtype) as the storage contract so compute kernels can rely on this upper bound.

Assert the bound in the shared unchecked handle constructor and validate it when assembling array parts.
Reject oversized storage in the checked constructors (try_new, try_new_handle) rather than narrowing it; storage within the bound is accepted without copying.
Add DecimalData::narrow_to_precision and DecimalArray::try_new_narrowed for importers that receive wider storage than the precision requires. Arrow decimal imports, legacy serialized arrays, and DecimalByteParts assembly narrow explicitly through them; device buffers cannot be narrowed and are rejected. The GPU byte-parts kernel validates its storage instead of constructing unchecked.
Keep constant materialization, fill-null, and explicit storage upcasts within the bound.
Adapt tests across the workspace (array, arrow, row, byte-parts, sparse, fuzz, CUDA) that built decimals with storage wider than their precision allows, and add regression coverage for precision boundaries, rejection of oversized storage, explicit narrowing (including null payloads and empty arrays), device rejection, legacy decoding, unchecked assertions, and fill-null.

Stack 1/2: based on develop. The dispatch macros and kernel migrations are in #10314, based on this PR.

Validation: cargo clippy -p vortex-array -p vortex-arrow --all-targets --all-features -- -D warnings, cargo fmt --all --check with the pinned nightly, and the tests of vortex-array, vortex-arrow, vortex-row, vortex-sparse, vortex-fuzz and vortex-decimal-byte-parts pass locally with the CI profile. CI is green on the current head, including the CUDA, sanitizer and miri jobs.

Compatibility: constructing a decimal array with storage wider than its precision requires is now an error (a panic from the infallible new constructors). Arrow imports of low-precision Decimal128/Decimal256 columns allocate to narrow their storage. Legacy files with oversized decimal storage still decode, with narrowing on the host; on the GPU they are rejected. As before, constructors require non-null values to fit their declared precision; this change does not add per-value precision validation.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

codspeed · 2026-10-06T16:10:50Z

Merging this PR will improve performance by 25.57%

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 3 improved benchmarks
✅ 2222 untouched benchmarks
⏩ 367 skipped benchmarks¹
🗄️ 1 archived benchmark run²

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
⚡	WallTime	`mul_u64_nonnull_neon`	39.5 µs	28.4 µs	+39.44%
⚡	WallTime	`multiply_shapes_neon[(32768, PerRowPerRow)]`	38.5 µs	32.3 µs	+19.28%
⚡	WallTime	`mul_i64_nonnull_neon`	38.5 µs	32.3 µs	+19.03%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing ji/decimal-storage-contract (7b6da81) with develop (c901cf7)}

367 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
1 benchmark was run, but is now archived. If it was deleted in another branch, consider rebasing to remove it from the report. Instead if it was added back, click here to restore it. ↩

…-contract Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

develop now initialises ArrayParts with their slots directly, so the precision-bound regression test passes the slots to the constructor instead of calling the removed with_slots helper. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

Storage is now bounded by precision, so tests that stored values wider than the precision-derived width can no longer be constructed. Move the numeric overflow tests to inputs that overflow within bounded storage, expect i8 storage for a decimal(2, 0) byte-parts split, and drop the row key-width test whose narrowing path is unreachable from a valid array. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

The checked constructors now fail when storage is wider than the type required by the precision. Importers that receive wider storage, the Arrow decimal conversions and legacy serialized arrays, narrow explicitly through DecimalData::narrow_to_precision before constructing the array. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

github-actions · 2026-10-09T14:16:14Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`1ee7132`	random-access-bench	2	Explore Profiling Data
🟢 Done	`1ee7132`	statpopgen	1	Explore Profiling Data
🟢 Done	`1ee7132`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`1ee7132`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`1ee7132`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`1ee7132`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`1ee7132`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`1ee7132`	appian-nvme	1	Explore Profiling Data
🟢 Done	`1ee7132`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`1ee7132`	tpch-s3	1	Explore Profiling Data
🟢 Done	`1ee7132`	polarsignals	1	Explore Profiling Data
🟢 Done	`1ee7132`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`1ee7132`	fineweb	1	Explore Profiling Data
🟢 Done	`1ee7132`	compress-bench	1	Explore Profiling Data
🟢 Done	`1ee7132`	string-bench	1	Explore Profiling Data

Previous Runs (1)

Status	Commit	Job	Attempt	Link
🟢 Done	`1ee7132`	random-access-bench	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-10-09T14:18:43Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 1ee71320 vs base 34148020
Vortex (geomean): hot 1.003x ➖ · cold 0.905x ➖

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	57627861 / 57243734 / +0.7%	101888840 / 109979579 / -7.4%	0.57 / 0.52 / +8.7%
polarsignals_q01/datafusion:vortex-file-compressed	62847280 / 63033400 / -0.3%	120101932 / 130578015 / -8.0%	0.52 / 0.48 / +8.4%
polarsignals_q02/datafusion:vortex-file-compressed	72941829 / 72856148 / +0.1%	110022325 / 114489942 / -3.9%	0.66 / 0.64 / +4.2%
polarsignals_q03/datafusion:vortex-file-compressed	80100378 / 79350716 / +0.9%	136153596 / 148431523 / -8.3%	0.59 / 0.53 / +10.0%
polarsignals_q04/datafusion:vortex-file-compressed	9470720 / 9312222 / +1.7%	48128865 / 55273100 / -12.9% 🟢	0.20 / 0.17 / +16.8%
polarsignals_q05/datafusion:vortex-file-compressed	24735300 / 24541892 / +0.8%	63920927 / 72273825 / -11.6% 🟢	0.39 / 0.34 / +14.0%
polarsignals_q06/datafusion:vortex-file-compressed	21887220 / 21970434 / -0.4%	60516619 / 69007177 / -12.3% 🟢	0.36 / 0.32 / +13.6%
polarsignals_q07/datafusion:vortex-file-compressed	39468490 / 39819178 / -0.9%	77414981 / 86436097 / -10.4% 🟢	0.51 / 0.46 / +10.7%
polarsignals_q08/datafusion:vortex-file-compressed	98579942 / 98579929 / +0.0%	161940082 / 168010306 / -3.6%	0.61 / 0.59 / +3.7%
polarsignals_q09/datafusion:vortex-file-compressed	10320192 / 10255160 / +0.6%	46578500 / 55217726 / -15.6% 🟢	0.22 / 0.19 / +19.3%

No file size changes detected.

github-actions · 2026-10-09T14:18:51Z

Benchmarks: String Encoding 📖

Commits: PR 1ee71320 vs base 30e84dcc

vortex / vortex-file-compressed / ms (0.999x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	32.840213 / 32.903663 / -0.2%
read/clickbench/URL/shard-0/onpair-12	21.17308 / 21.144248 / +0.1%
read/tpch/l_comment/fsst	57.410408 / 57.50183 / -0.2%
read/tpch/l_comment/onpair-12	53.271801 / 53.203456 / +0.1%
write/clickbench/URL/shard-0/fsst	602.664651 / 604.319058 / -0.3%
write/clickbench/URL/shard-0/onpair-12	972.768483 / 973.545769 / -0.1%
write/tpch/l_comment/fsst	1908.21023 / 1915.809 / -0.4%
write/tpch/l_comment/onpair-12	2058.89315 / 2057.50871 / +0.1%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	47.4075024 / 47.4075024 / +0.0%
size/clickbench/URL/shard-0/onpair-12	30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst	30.5867239 / 30.5867239 / +0.0%
size/tpch/l_comment/onpair-12	25.8644092 / 25.8644092 / +0.0%

github-actions · 2026-10-09T14:19:14Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (-6.6%, low confidence)
Vortex (geomean): hot 0.973x ➖ · cold 0.963x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.979x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.026x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6863278 / 6857410 / +0.1%	18109530 / 21398863 / -15.4% 🟢	0.38 / 0.32 / +18.3%
fineweb_q01/datafusion:vortex-file-compressed	12033986 / 12358018 / -2.6%	47593734 / 53411383 / -10.9% 🟢	0.25 / 0.23 / +9.3%
fineweb_q02/datafusion:vortex-file-compressed	13862382 / 13605048 / +1.9%	47845544 / 55734454 / -14.2% 🟢	0.29 / 0.24 / +18.7%
fineweb_q03/datafusion:vortex-file-compressed	22601638 / 21869229 / +3.3%	110620088 / 115519300 / -4.2%	0.20 / 0.19 / +7.9%
fineweb_q04/datafusion:vortex-file-compressed	80774292 / 80949298 / -0.2%	176885445 / 182033499 / -2.8%	0.46 / 0.44 / +2.7%
fineweb_q05/datafusion:vortex-file-compressed	68245089 / 69309277 / -1.5%	155258332 / 167624189 / -7.4%	0.44 / 0.41 / +6.3%
fineweb_q06/datafusion:vortex-file-compressed	20120040 / 20480974 / -1.8%	113966896 / 123103755 / -7.4%	0.18 / 0.17 / +6.1%
fineweb_q07/datafusion:vortex-file-compressed	20267332 / 18496479 / +9.6%	110028562 / 119192602 / -7.7%	0.18 / 0.16 / +18.7%
fineweb_q08/datafusion:vortex-file-compressed	10267483 / 8871266 / +15.7% 🔴	46768740 / 67883748 / -31.1% 🟢	0.22 / 0.13 / +68.0%

datafusion / vortex-compact / ns (1.006x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	7171988 / 7328760 / -2.1%	17962026 / 21125525 / -15.0% 🟢	0.40 / 0.35 / +15.1%
fineweb_q01/datafusion:vortex-compact	44212876 / 44315733 / -0.2%	75717382 / 110425521 / -31.4% 🟢	0.58 / 0.40 / +45.5%
fineweb_q02/datafusion:vortex-compact	44104165 / 44162668 / -0.1%	77785287 / 82433732 / -5.6%	0.57 / 0.54 / +5.8%
fineweb_q03/datafusion:vortex-compact	163521815 / 158721144 / +3.0%	227921348 / 238781471 / -4.5%	0.72 / 0.66 / +7.9%
fineweb_q04/datafusion:vortex-compact	162342123 / 180400248 / -10.0% 🟢	260654130 / 257273643 / +1.3%	0.62 / 0.70 / -11.2%
fineweb_q05/datafusion:vortex-compact	170609892 / 153092427 / +11.4% 🔴	238715651 / 234062070 / +2.0%	0.71 / 0.65 / +9.3%
fineweb_q06/datafusion:vortex-compact	87360766 / 87214173 / +0.2%	168219064 / 177527490 / -5.2%	0.52 / 0.49 / +5.7%
fineweb_q07/datafusion:vortex-compact	92107038 / 89099240 / +3.4%	165816373 / 167281412 / -0.9%	0.56 / 0.53 / +4.3%
fineweb_q08/datafusion:vortex-compact	8406018 / 8318224 / +1.1%	51787309 / 54008484 / -4.1%	0.16 / 0.15 / +5.4%

datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9552078 / 9698265 / -1.5%	33992666 / 35936411 / -5.4%	0.28 / 0.27 / +4.1%
fineweb_q01/datafusion:parquet	75971446 / 74011332 / +2.6%	163362132 / 179961801 / -9.2%	0.47 / 0.41 / +13.1%
fineweb_q02/datafusion:parquet	76102163 / 75445116 / +0.9%	163147204 / 169467725 / -3.7%	0.47 / 0.45 / +4.8%
fineweb_q03/datafusion:parquet	74882592 / 73678280 / +1.6%	163151414 / 169288030 / -3.6%	0.46 / 0.44 / +5.5%
fineweb_q04/datafusion:parquet	81527116 / 83238921 / -2.1%	169471981 / 169236740 / +0.1%	0.48 / 0.49 / -2.2%
fineweb_q05/datafusion:parquet	80863828 / 81633212 / -0.9%	161912883 / 163696976 / -1.1%	0.50 / 0.50 / +0.1%
fineweb_q06/datafusion:parquet	76264112 / 74910388 / +1.8%	167746065 / 172298529 / -2.6%	0.45 / 0.43 / +4.6%
fineweb_q07/datafusion:parquet	74746204 / 74824819 / -0.1%	167128718 / 172355737 / -3.0%	0.45 / 0.43 / +3.0%
fineweb_q08/datafusion:parquet	74877220 / 72913161 / +2.7%	163341561 / 166627867 / -2.0%	0.46 / 0.44 / +4.8%

duckdb / vortex-file-compressed / ns (0.902x ➖, 3↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	2056336 / 5083342 / -59.5% 🟢	5296655 / 5371207 / -1.4%	0.39 / 0.95 / -59.0%
fineweb_q01/duckdb:vortex-file-compressed	20198224 / 18391944 / +9.8%	59450110 / 55633876 / +6.9%	0.34 / 0.33 / +2.8%
fineweb_q02/duckdb:vortex-file-compressed	14276786 / 14419148 / -1.0%	36633037 / 38826253 / -5.6%	0.39 / 0.37 / +4.9%
fineweb_q03/duckdb:vortex-file-compressed	28121698 / 27689098 / +1.6%	121406234 / 142355069 / -14.7% 🟢	0.23 / 0.19 / +19.1%
fineweb_q04/duckdb:vortex-file-compressed	92889312 / 78868303 / +17.8% 🔴	222422523 / 120826200 / +84.1% 🔴	0.42 / 0.65 / -36.0%
fineweb_q05/duckdb:vortex-file-compressed	70296264 / 70862536 / -0.8%	122731426 / 110263717 / +11.3% 🔴	0.57 / 0.64 / -10.9%
fineweb_q06/duckdb:vortex-file-compressed	29953980 / 35404171 / -15.4% 🟢	108963131 / 132823108 / -18.0% 🟢	0.27 / 0.27 / +3.1%
fineweb_q07/duckdb:vortex-file-compressed	28974276 / 33085689 / -12.4% 🟢	107270502 / 121167616 / -11.5% 🟢	0.27 / 0.27 / -1.1%
fineweb_q08/duckdb:vortex-file-compressed	7254648 / 7087763 / +2.4%	15265723 / 14268237 / +7.0%	0.48 / 0.50 / -4.3%

duckdb / vortex-compact / ns (0.961x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	2634121 / 3584742 / -26.5% 🟢	7979934 / 5608496 / +42.3% 🔴	0.33 / 0.64 / -48.4%
fineweb_q01/duckdb:vortex-compact	51454004 / 51459725 / -0.0%	85685832 / 90214672 / -5.0%	0.60 / 0.57 / +5.3%
fineweb_q02/duckdb:vortex-compact	48146516 / 51326257 / -6.2%	75102272 / 83226759 / -9.8%	0.64 / 0.62 / +4.0%
fineweb_q03/duckdb:vortex-compact	184875962 / 191834708 / -3.6%	260908203 / 299159597 / -12.8% 🟢	0.71 / 0.64 / +10.5%
fineweb_q04/duckdb:vortex-compact	186201612 / 186769880 / -0.3%	239267120 / 224799383 / +6.4%	0.78 / 0.83 / -6.3%
fineweb_q05/duckdb:vortex-compact	184274014 / 184843037 / -0.3%	230884088 / 242029166 / -4.6%	0.80 / 0.76 / +4.5%
fineweb_q06/duckdb:vortex-compact	101920616 / 96686388 / +5.4%	178372350 / 151956576 / +17.4% 🔴	0.57 / 0.64 / -10.2%
fineweb_q07/duckdb:vortex-compact	99187318 / 104107488 / -4.7%	155712467 / 178635405 / -12.8% 🟢	0.64 / 0.58 / +9.3%
fineweb_q08/duckdb:vortex-compact	6113330 / 5775378 / +5.9%	13178715 / 12323312 / +6.9%	0.46 / 0.47 / -1.0%

duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	23483904 / 24241424 / -3.1%	22940393 / 26361187 / -13.0% 🟢	1.02 / 0.92 / +11.3%
fineweb_q01/duckdb:parquet	43985836 / 44406534 / -0.9%	56156215 / 56489979 / -0.6%	0.78 / 0.79 / -0.4%
fineweb_q02/duckdb:parquet	43435778 / 44189768 / -1.7%	56146452 / 55199865 / +1.7%	0.77 / 0.80 / -3.4%
fineweb_q03/duckdb:parquet	94575440 / 95236020 / -0.7%	184224638 / 188527797 / -2.3%	0.51 / 0.51 / +1.6%
fineweb_q04/duckdb:parquet	151835144 / 151801780 / +0.0%	208992133 / 207088280 / +0.9%	0.73 / 0.73 / -0.9%
fineweb_q05/duckdb:parquet	144507995 / 143831144 / +0.5%	208238650 / 196464853 / +6.0%	0.69 / 0.73 / -5.2%
fineweb_q06/duckdb:parquet	71356076 / 71919338 / -0.8%	139657678 / 140521671 / -0.6%	0.51 / 0.51 / -0.2%
fineweb_q07/duckdb:parquet	71765692 / 72349368 / -0.8%	161358485 / 160911875 / +0.3%	0.44 / 0.45 / -1.1%
fineweb_q08/duckdb:parquet	24032952 / 22948423 / +4.7%	27562749 / 26841758 / +2.7%	0.87 / 0.85 / +2.0%

No file size changes detected.

github-actions · 2026-10-09T14:20:21Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 1ee71320 vs base 34148020
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.999x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	15858556 / 17019051 / -6.8%	46200331 / 46010339 / +0.4%	0.34 / 0.37 / -7.2%
tpch_q02/datafusion:vortex-file-compressed	17304207 / 17335924 / -0.2%	36266577 / 37171287 / -2.4%	0.48 / 0.47 / +2.3%
tpch_q03/datafusion:vortex-file-compressed	19342147 / 19052688 / +1.5%	47164888 / 45868061 / +2.8%	0.41 / 0.42 / -1.3%
tpch_q04/datafusion:vortex-file-compressed	10159537 / 10049949 / +1.1%	32692021 / 33222993 / -1.6%	0.31 / 0.30 / +2.7%
tpch_q05/datafusion:vortex-file-compressed	36919346 / 37456213 / -1.4%	65607334 / 65103616 / +0.8%	0.56 / 0.58 / -2.2%
tpch_q06/datafusion:vortex-file-compressed	6420108 / 6076861 / +5.6%	29391637 / 28254161 / +4.0%	0.22 / 0.22 / +1.6%
tpch_q07/datafusion:vortex-file-compressed	52128753 / 51826991 / +0.6%	84548847 / 83630762 / +1.1%	0.62 / 0.62 / -0.5%
tpch_q08/datafusion:vortex-file-compressed	51878204 / 52025067 / -0.3%	80867768 / 80295656 / +0.7%	0.64 / 0.65 / -1.0%
tpch_q09/datafusion:vortex-file-compressed	49726403 / 49797636 / -0.1%	76101211 / 79555021 / -4.3%	0.65 / 0.63 / +4.4%
tpch_q10/datafusion:vortex-file-compressed	16740397 / 16985842 / -1.4%	48679371 / 50210804 / -3.1%	0.34 / 0.34 / +1.7%
tpch_q11/datafusion:vortex-file-compressed	15034264 / 15298934 / -1.7%	33833923 / 34146254 / -0.9%	0.44 / 0.45 / -0.8%
tpch_q12/datafusion:vortex-file-compressed	22582666 / 22463413 / +0.5%	46554560 / 46522016 / +0.1%	0.49 / 0.48 / +0.5%
tpch_q13/datafusion:vortex-file-compressed	19682813 / 19753893 / -0.4%	42515906 / 39560184 / +7.5%	0.46 / 0.50 / -7.3%
tpch_q14/datafusion:vortex-file-compressed	14609757 / 14849743 / -1.6%	39863902 / 41705001 / -4.4%	0.37 / 0.36 / +2.9%
tpch_q15/datafusion:vortex-file-compressed	18657302 / 19066680 / -2.1%	45553438 / 44632370 / +2.1%	0.41 / 0.43 / -4.1%
tpch_q16/datafusion:vortex-file-compressed	18412508 / 18701525 / -1.5%	39370239 / 38317002 / +2.7%	0.47 / 0.49 / -4.2%
tpch_q17/datafusion:vortex-file-compressed	29070369 / 28366935 / +2.5%	60233320 / 57924992 / +4.0%	0.48 / 0.49 / -1.4%
tpch_q18/datafusion:vortex-file-compressed	37101065 / 36571039 / +1.4%	56333143 / 57664854 / -2.3%	0.66 / 0.63 / +3.8%
tpch_q19/datafusion:vortex-file-compressed	13267504 / 13610342 / -2.5%	38990207 / 38233613 / +2.0%	0.34 / 0.36 / -4.4%
tpch_q20/datafusion:vortex-file-compressed	20622948 / 20529800 / +0.5%	44721615 / 44777517 / -0.1%	0.46 / 0.46 / +0.6%
tpch_q21/datafusion:vortex-file-compressed	39227348 / 39640955 / -1.0%	66997723 / 66502051 / +0.7%	0.59 / 0.60 / -1.8%
tpch_q22/datafusion:vortex-file-compressed	11444862 / 11335645 / +1.0%	32533106 / 31667389 / +2.7%	0.35 / 0.36 / -1.7%

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	17916479 / 18063848 / -0.8%	43589273 / 44924632 / -3.0%	0.41 / 0.40 / +2.2%
tpch_q02/datafusion:vortex-compact	19867520 / 19769427 / +0.5%	37882749 / 39035381 / -3.0%	0.52 / 0.51 / +3.6%
tpch_q03/datafusion:vortex-compact	20236547 / 20084972 / +0.8%	45498219 / 45027177 / +1.0%	0.44 / 0.45 / -0.3%
tpch_q04/datafusion:vortex-compact	12303991 / 11231542 / +9.5%	31658807 / 35722849 / -11.4% 🟢	0.39 / 0.31 / +23.6%
tpch_q05/datafusion:vortex-compact	37831200 / 38514609 / -1.8%	64510512 / 65811756 / -2.0%	0.59 / 0.59 / +0.2%
tpch_q06/datafusion:vortex-compact	6908087 / 6803482 / +1.5%	27602616 / 28180808 / -2.1%	0.25 / 0.24 / +3.7%
tpch_q07/datafusion:vortex-compact	52651209 / 52855808 / -0.4%	77211849 / 79707319 / -3.1%	0.68 / 0.66 / +2.8%
tpch_q08/datafusion:vortex-compact	52087220 / 52721489 / -1.2%	81965707 / 81475764 / +0.6%	0.64 / 0.65 / -1.8%
tpch_q09/datafusion:vortex-compact	50650339 / 51150535 / -1.0%	76173920 / 78570940 / -3.1%	0.66 / 0.65 / +2.1%
tpch_q10/datafusion:vortex-compact	18517982 / 18760939 / -1.3%	47940994 / 47549987 / +0.8%	0.39 / 0.39 / -2.1%
tpch_q11/datafusion:vortex-compact	15940687 / 16057874 / -0.7%	35831185 / 33873536 / +5.8%	0.44 / 0.47 / -6.2%
tpch_q12/datafusion:vortex-compact	24322607 / 24493927 / -0.7%	45189301 / 47985554 / -5.8%	0.54 / 0.51 / +5.4%
tpch_q13/datafusion:vortex-compact	20764083 / 21001415 / -1.1%	40461973 / 42985431 / -5.9%	0.51 / 0.49 / +5.0%
tpch_q14/datafusion:vortex-compact	16509469 / 16512670 / -0.0%	40721580 / 40684401 / +0.1%	0.41 / 0.41 / -0.1%
tpch_q15/datafusion:vortex-compact	19912108 / 19953196 / -0.2%	46107046 / 45915707 / +0.4%	0.43 / 0.43 / -0.6%
tpch_q16/datafusion:vortex-compact	19405748 / 18961051 / +2.3%	39332586 / 38625399 / +1.8%	0.49 / 0.49 / +0.5%
tpch_q17/datafusion:vortex-compact	29496650 / 28731542 / +2.7%	58974151 / 56652324 / +4.1%	0.50 / 0.51 / -1.4%
tpch_q18/datafusion:vortex-compact	38249504 / 38219044 / +0.1%	57977507 / 59331362 / -2.3%	0.66 / 0.64 / +2.4%
tpch_q19/datafusion:vortex-compact	16182699 / 16270551 / -0.5%	41014002 / 40255893 / +1.9%	0.39 / 0.40 / -2.4%
tpch_q20/datafusion:vortex-compact	21819886 / 22078130 / -1.2%	44152823 / 45764557 / -3.5%	0.49 / 0.48 / +2.4%
tpch_q21/datafusion:vortex-compact	42049619 / 41785868 / +0.6%	66709399 / 71315770 / -6.5%	0.63 / 0.59 / +7.6%
tpch_q22/datafusion:vortex-compact	11624828 / 11501840 / +1.1%	32325433 / 32504568 / -0.6%	0.36 / 0.35 / +1.6%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	71948603 / 72205840 / -0.4%	88728714 / 90258949 / -1.7%	0.81 / 0.80 / +1.4%
tpch_q02/datafusion:parquet	57361789 / 57055147 / +0.5%	75460158 / 77305894 / -2.4%	0.76 / 0.74 / +3.0%
tpch_q03/datafusion:parquet	83760617 / 84544084 / -0.9%	113754314 / 106371975 / +6.9%	0.74 / 0.79 / -7.4%
tpch_q04/datafusion:parquet	46581150 / 46480226 / +0.2%	65769204 / 66253895 / -0.7%	0.71 / 0.70 / +1.0%
tpch_q05/datafusion:parquet	99213225 / 99184386 / +0.0%	128076674 / 126755445 / +1.0%	0.77 / 0.78 / -1.0%
tpch_q06/datafusion:parquet	31888959 / 31910371 / -0.1%	50325109 / 51431484 / -2.2%	0.63 / 0.62 / +2.1%
tpch_q07/datafusion:parquet	104598482 / 107219669 / -2.4%	130675434 / 129529229 / +0.9%	0.80 / 0.83 / -3.3%
tpch_q08/datafusion:parquet	112860645 / 113394509 / -0.5%	136703816 / 137768657 / -0.8%	0.83 / 0.82 / +0.3%
tpch_q09/datafusion:parquet	130671514 / 130343497 / +0.3%	161124188 / 159787092 / +0.8%	0.81 / 0.82 / -0.6%
tpch_q10/datafusion:parquet	103873786 / 104010331 / -0.1%	134566741 / 135978140 / -1.0%	0.77 / 0.76 / +0.9%
tpch_q11/datafusion:parquet	41494258 / 42331680 / -2.0%	65213538 / 66427485 / -1.8%	0.64 / 0.64 / -0.2%
tpch_q12/datafusion:parquet	69763329 / 68208520 / +2.3%	93398327 / 93176776 / +0.2%	0.75 / 0.73 / +2.0%
tpch_q13/datafusion:parquet	186849802 / 186956365 / -0.1%	208486803 / 209240059 / -0.4%	0.90 / 0.89 / +0.3%
tpch_q14/datafusion:parquet	48526263 / 47863026 / +1.4%	76412648 / 74762983 / +2.2%	0.64 / 0.64 / -0.8%
tpch_q15/datafusion:parquet	54554812 / 54352522 / +0.4%	77570143 / 77588563 / -0.0%	0.70 / 0.70 / +0.4%
tpch_q16/datafusion:parquet	41147330 / 40594759 / +1.4%	58640605 / 59415484 / -1.3%	0.70 / 0.68 / +2.7%
tpch_q17/datafusion:parquet	129503531 / 129017900 / +0.4%	153413399 / 151379014 / +1.3%	0.84 / 0.85 / -1.0%
tpch_q18/datafusion:parquet	130698261 / 130925068 / -0.2%	148788160 / 150116897 / -0.9%	0.88 / 0.87 / +0.7%
tpch_q19/datafusion:parquet	58937110 / 59362328 / -0.7%	84403441 / 89792299 / -6.0%	0.70 / 0.66 / +5.6%
tpch_q20/datafusion:parquet	68045215 / 67821349 / +0.3%	90131791 / 92217318 / -2.3%	0.75 / 0.74 / +2.7%
tpch_q21/datafusion:parquet	107766923 / 107615015 / +0.1%	132662649 / 132254072 / +0.3%	0.81 / 0.81 / -0.2%
tpch_q22/datafusion:parquet	46677609 / 46954354 / -0.6%	69531115 / 65800304 / +5.7%	0.67 / 0.71 / -5.9%

duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	11381304 / 10133685 / +12.3% 🔴	20973678 / 18428211 / +13.8% 🔴	0.54 / 0.55 / -1.3%
tpch_q02/duckdb:vortex-file-compressed	17327888 / 17252730 / +0.4%	25402213 / 27790008 / -8.6%	0.68 / 0.62 / +9.9%
tpch_q03/duckdb:vortex-file-compressed	18129055 / 17848473 / +1.6%	35984663 / 33389922 / +7.8%	0.50 / 0.53 / -5.8%
tpch_q04/duckdb:vortex-file-compressed	16985246 / 17793874 / -4.5%	31155244 / 33069419 / -5.8%	0.55 / 0.54 / +1.3%
tpch_q05/duckdb:vortex-file-compressed	22180268 / 22291909 / -0.5%	38541019 / 35331182 / +9.1%	0.58 / 0.63 / -8.8%
tpch_q06/duckdb:vortex-file-compressed	5832877 / 5319232 / +9.7%	16895587 / 13699338 / +23.3% 🔴	0.35 / 0.39 / -11.1%
tpch_q07/duckdb:vortex-file-compressed	20197213 / 20565662 / -1.8%	37409169 / 35180974 / +6.3%	0.54 / 0.58 / -7.6%
tpch_q08/duckdb:vortex-file-compressed	22967000 / 23757155 / -3.3%	40092471 / 40140019 / -0.1%	0.57 / 0.59 / -3.2%
tpch_q09/duckdb:vortex-file-compressed	29922992 / 29422438 / +1.7%	47492189 / 49717133 / -4.5%	0.63 / 0.59 / +6.5%
tpch_q10/duckdb:vortex-file-compressed	27413079 / 28051840 / -2.3%	41132050 / 42755209 / -3.8%	0.67 / 0.66 / +1.6%
tpch_q11/duckdb:vortex-file-compressed	8681660 / 9338173 / -7.0%	14350748 / 14388620 / -0.3%	0.60 / 0.65 / -6.8%
tpch_q12/duckdb:vortex-file-compressed	15446719 / 15931691 / -3.0%	29784337 / 29134683 / +2.2%	0.52 / 0.55 / -5.2%
tpch_q13/duckdb:vortex-file-compressed	22560332 / 21145355 / +6.7%	42563473 / 42250600 / +0.7%	0.53 / 0.50 / +5.9%
tpch_q14/duckdb:vortex-file-compressed	12996932 / 13175041 / -1.4%	24778040 / 25247477 / -1.9%	0.52 / 0.52 / +0.5%
tpch_q15/duckdb:vortex-file-compressed	9956605 / 9735200 / +2.3%	21576228 / 24871796 / -13.3% 🟢	0.46 / 0.39 / +17.9%
tpch_q16/duckdb:vortex-file-compressed	18114955 / 18197412 / -0.5%	23579851 / 26101852 / -9.7%	0.77 / 0.70 / +10.2%
tpch_q17/duckdb:vortex-file-compressed	14199581 / 14678419 / -3.3%	31195420 / 31899437 / -2.2%	0.46 / 0.46 / -1.1%
tpch_q18/duckdb:vortex-file-compressed	25750427 / 25463874 / +1.1%	35531670 / 38396753 / -7.5%	0.72 / 0.66 / +9.3%
tpch_q19/duckdb:vortex-file-compressed	23109536 / 22849300 / +1.1%	35196238 / 36027732 / -2.3%	0.66 / 0.63 / +3.5%
tpch_q20/duckdb:vortex-file-compressed	17282375 / 16914337 / +2.2%	33066242 / 36294973 / -8.9%	0.52 / 0.47 / +12.2%
tpch_q21/duckdb:vortex-file-compressed	67396967 / 67014549 / +0.6%	81829061 / 84602526 / -3.3%	0.82 / 0.79 / +4.0%
tpch_q22/duckdb:vortex-file-compressed	12109604 / 12253195 / -1.2%	19844375 / 20440920 / -2.9%	0.61 / 0.60 / +1.8%

duckdb / vortex-compact / ns (0.993x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	14742532 / 11560880 / +27.5% 🔴	21316554 / 21274409 / +0.2%	0.69 / 0.54 / +27.3%
tpch_q02/duckdb:vortex-compact	19617944 / 19828461 / -1.1%	26930104 / 29208082 / -7.8%	0.73 / 0.68 / +7.3%
tpch_q03/duckdb:vortex-compact	18126846 / 19273054 / -5.9%	33742252 / 35736292 / -5.6%	0.54 / 0.54 / -0.4%
tpch_q04/duckdb:vortex-compact	18033507 / 19071748 / -5.4%	29098765 / 30626360 / -5.0%	0.62 / 0.62 / -0.5%
tpch_q05/duckdb:vortex-compact	22313291 / 23290519 / -4.2%	35759929 / 39400403 / -9.2%	0.62 / 0.59 / +5.6%
tpch_q06/duckdb:vortex-compact	6188582 / 7197818 / -14.0% 🟢	15059489 / 15021052 / +0.3%	0.41 / 0.48 / -14.2%
tpch_q07/duckdb:vortex-compact	22202594 / 21598783 / +2.8%	35372569 / 35935288 / -1.6%	0.63 / 0.60 / +4.4%
tpch_q08/duckdb:vortex-compact	26173105 / 25166491 / +4.0%	41598134 / 40969588 / +1.5%	0.63 / 0.61 / +2.4%
tpch_q09/duckdb:vortex-compact	29719846 / 30432229 / -2.3%	47734325 / 47814292 / -0.2%	0.62 / 0.64 / -2.2%
tpch_q10/duckdb:vortex-compact	29509576 / 29545884 / -0.1%	44675666 / 46626890 / -4.2%	0.66 / 0.63 / +4.2%
tpch_q11/duckdb:vortex-compact	9795555 / 10075677 / -2.8%	18802646 / 16263040 / +15.6% 🔴	0.52 / 0.62 / -15.9%
tpch_q12/duckdb:vortex-compact	17541975 / 17636793 / -0.5%	31947592 / 29974819 / +6.6%	0.55 / 0.59 / -6.7%
tpch_q13/duckdb:vortex-compact	22702942 / 22380145 / +1.4%	40579483 / 37374699 / +8.6%	0.56 / 0.60 / -6.6%
tpch_q14/duckdb:vortex-compact	14149739 / 14385945 / -1.6%	26053009 / 27393514 / -4.9%	0.54 / 0.53 / +3.4%
tpch_q15/duckdb:vortex-compact	10423139 / 9659109 / +7.9%	22155267 / 20445751 / +8.4%	0.47 / 0.47 / -0.4%
tpch_q16/duckdb:vortex-compact	19757250 / 19764588 / -0.0%	24981222 / 24723830 / +1.0%	0.79 / 0.80 / -1.1%
tpch_q17/duckdb:vortex-compact	15693186 / 16361344 / -4.1%	36906786 / 35165780 / +5.0%	0.43 / 0.47 / -8.6%
tpch_q18/duckdb:vortex-compact	26289869 / 27034636 / -2.8%	34360337 / 34249228 / +0.3%	0.77 / 0.79 / -3.1%
tpch_q19/duckdb:vortex-compact	23849299 / 25937514 / -8.1%	34442093 / 37360210 / -7.8%	0.69 / 0.69 / -0.3%
tpch_q20/duckdb:vortex-compact	19188485 / 19116051 / +0.4%	34872893 / 34134272 / +2.2%	0.55 / 0.56 / -1.7%
tpch_q21/duckdb:vortex-compact	69358686 / 67830790 / +2.3%	83991302 / 85016825 / -1.2%	0.83 / 0.80 / +3.5%
tpch_q22/duckdb:vortex-compact	12909303 / 13344333 / -3.3%	21644748 / 21709681 / -0.3%	0.60 / 0.61 / -3.0%

duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	62865816 / 63618211 / -1.2%	69088408 / 70435497 / -1.9%	0.91 / 0.90 / +0.7%
tpch_q02/duckdb:parquet	37672514 / 37534504 / +0.4%	46666170 / 47042174 / -0.8%	0.81 / 0.80 / +1.2%
tpch_q03/duckdb:parquet	67420479 / 67617511 / -0.3%	78593057 / 78008369 / +0.7%	0.86 / 0.87 / -1.0%
tpch_q04/duckdb:parquet	46266631 / 46819614 / -1.2%	55997998 / 56208580 / -0.4%	0.83 / 0.83 / -0.8%
tpch_q05/duckdb:parquet	65585700 / 65731885 / -0.2%	77054935 / 76382999 / +0.9%	0.85 / 0.86 / -1.1%
tpch_q06/duckdb:parquet	22100994 / 21837025 / +1.2%	27848540 / 26188831 / +6.3%	0.79 / 0.83 / -4.8%
tpch_q07/duckdb:parquet	65281753 / 65106532 / +0.3%	74991913 / 75142076 / -0.2%	0.87 / 0.87 / +0.5%
tpch_q08/duckdb:parquet	80130773 / 80348274 / -0.3%	92060467 / 91663741 / +0.4%	0.87 / 0.88 / -0.7%
tpch_q09/duckdb:parquet	120039382 / 119388724 / +0.5%	133277615 / 132155765 / +0.8%	0.90 / 0.90 / -0.3%
tpch_q10/duckdb:parquet	119011446 / 119092578 / -0.1%	130889035 / 130314274 / +0.4%	0.91 / 0.91 / -0.5%
tpch_q11/duckdb:parquet	21260874 / 21203275 / +0.3%	28970089 / 28315160 / +2.3%	0.73 / 0.75 / -2.0%
tpch_q12/duckdb:parquet	44352186 / 44501253 / -0.3%	52310387 / 51679770 / +1.2%	0.85 / 0.86 / -1.5%
tpch_q13/duckdb:parquet	243345183 / 241682341 / +0.7%	253757948 / 250269872 / +1.4%	0.96 / 0.97 / -0.7%
tpch_q14/duckdb:parquet	47504281 / 47260484 / +0.5%	55423038 / 55959690 / -1.0%	0.86 / 0.84 / +1.5%
tpch_q15/duckdb:parquet	26584384 / 26612193 / -0.1%	33013116 / 38985523 / -15.3% 🟢	0.81 / 0.68 / +18.0%
tpch_q16/duckdb:parquet	51773535 / 51318643 / +0.9%	59553330 / 58767015 / +1.3%	0.87 / 0.87 / -0.4%
tpch_q17/duckdb:parquet	51752132 / 48958832 / +5.7%	57946171 / 59217233 / -2.1%	0.89 / 0.83 / +8.0%
tpch_q18/duckdb:parquet	95401905 / 95646582 / -0.3%	107071341 / 104039925 / +2.9%	0.89 / 0.92 / -3.1%
tpch_q19/duckdb:parquet	65062314 / 65225057 / -0.2%	75204059 / 75023701 / +0.2%	0.87 / 0.87 / -0.5%
tpch_q20/duckdb:parquet	61474905 / 61695590 / -0.4%	72877328 / 73289401 / -0.6%	0.84 / 0.84 / +0.2%
tpch_q21/duckdb:parquet	141843776 / 142593610 / -0.5%	153293225 / 153873462 / -0.4%	0.93 / 0.93 / -0.1%
tpch_q22/duckdb:parquet	51542286 / 51387501 / +0.3%	62583910 / 59543502 / +5.1%	0.82 / 0.86 / -4.6%

No file size changes detected.

github-actions · 2026-10-09T14:22:13Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-2.8%, environment too noisy confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.955x ➖
Parquet (geomean): hot 1.013x ➖ · cold 0.955x ➖
Shifts: Parquet (control) +1.3% · Median polish +0.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	181174706 / 171371823 / +5.7%	637396674 / 715977327 / -11.0% 🟢	0.28 / 0.24 / +18.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed	10982400 / 11513705 / -4.6%	45520849 / 49630738 / -8.3%	0.24 / 0.23 / +4.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed	11742985 / 11862062 / -1.0%	49027746 / 50488247 / -2.9%	0.24 / 0.23 / +1.9%
clickbench-sorted_q36/datafusion:vortex-file-compressed	23324376 / 23714434 / -1.6%	65188091 / 69139386 / -5.7%	0.36 / 0.34 / +4.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed	18337848 / 18064396 / +1.5%	56760227 / 57920049 / -2.0%	0.32 / 0.31 / +3.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed	18057046 / 17799778 / +1.4%	59333717 / 60517632 / -2.0%	0.30 / 0.29 / +3.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed	41196036 / 39486247 / +4.3%	88538225 / 92150348 / -3.9%	0.47 / 0.43 / +8.6%
clickbench-sorted_q40/datafusion:vortex-file-compressed	11799350 / 12160499 / -3.0%	40995521 / 45140134 / -9.2%	0.29 / 0.27 / +6.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed	12033572 / 11681958 / +3.0%	42386505 / 45113127 / -6.0%	0.28 / 0.26 / +9.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed	10061368 / 9895271 / +1.7%	32933322 / 36664700 / -10.2% 🟢	0.31 / 0.27 / +13.2%

datafusion / vortex-compact / ns (0.987x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact	188693772 / 195185400 / -3.3%	451481095 / 452069609 / -0.1%	0.42 / 0.43 / -3.2%
clickbench-sorted_q24/datafusion:vortex-compact	22619026 / 22661106 / -0.2%	48167253 / 51520793 / -6.5%	0.47 / 0.44 / +6.8%
clickbench-sorted_q26/datafusion:vortex-compact	22592482 / 22686902 / -0.4%	51325403 / 51515758 / -0.4%	0.44 / 0.44 / -0.0%
clickbench-sorted_q36/datafusion:vortex-compact	26848025 / 25237295 / +6.4%	61505725 / 69529961 / -11.5% 🟢	0.44 / 0.36 / +20.3%
clickbench-sorted_q37/datafusion:vortex-compact	22200886 / 22682722 / -2.1%	62958009 / 66960833 / -6.0%	0.35 / 0.34 / +4.1%
clickbench-sorted_q38/datafusion:vortex-compact	20902883 / 21412060 / -2.4%	62547058 / 65622257 / -4.7%	0.33 / 0.33 / +2.4%
clickbench-sorted_q39/datafusion:vortex-compact	44041579 / 45397570 / -3.0%	85334179 / 86815809 / -1.7%	0.52 / 0.52 / -1.3%
clickbench-sorted_q40/datafusion:vortex-compact	14064950 / 14499420 / -3.0%	39902274 / 43171901 / -7.6%	0.35 / 0.34 / +5.0%
clickbench-sorted_q41/datafusion:vortex-compact	14418537 / 14779312 / -2.4%	42318419 / 49108517 / -13.8% 🟢	0.34 / 0.30 / +13.2%
clickbench-sorted_q42/datafusion:vortex-compact	10783238 / 10998472 / -2.0%	33502068 / 36754514 / -8.8%	0.32 / 0.30 / +7.6%

datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	764498168 / 758517718 / +0.8%	951573740 / 966654155 / -1.6%	0.80 / 0.78 / +2.4%
clickbench-sorted_q24/datafusion:parquet	8822574 / 9591454 / -8.0%	70138688 / 71705304 / -2.2%	0.13 / 0.13 / -6.0%
clickbench-sorted_q26/datafusion:parquet	8880748 / 8979569 / -1.1%	68415418 / 72065822 / -5.1%	0.13 / 0.12 / +4.2%
clickbench-sorted_q36/datafusion:parquet	94373546 / 94072301 / +0.3%	165288654 / 169177737 / -2.3%	0.57 / 0.56 / +2.7%
clickbench-sorted_q37/datafusion:parquet	65135584 / 64530946 / +0.9%	129775447 / 130445831 / -0.5%	0.50 / 0.49 / +1.5%
clickbench-sorted_q38/datafusion:parquet	87956706 / 87466066 / +0.6%	156364720 / 162255565 / -3.6%	0.56 / 0.54 / +4.3%
clickbench-sorted_q39/datafusion:parquet	160674642 / 160384028 / +0.2%	232323472 / 235986420 / -1.6%	0.69 / 0.68 / +1.8%
clickbench-sorted_q40/datafusion:parquet	44985324 / 44227124 / +1.7%	110098354 / 116374541 / -5.4%	0.41 / 0.38 / +7.5%
clickbench-sorted_q41/datafusion:parquet	42334501 / 41828037 / +1.2%	109409457 / 111749931 / -2.1%	0.39 / 0.37 / +3.4%
clickbench-sorted_q42/datafusion:parquet	26055605 / 26129546 / -0.3%	85680254 / 86424905 / -0.9%	0.30 / 0.30 / +0.6%

duckdb / vortex-file-compressed / ns (1.001x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	59917890 / 56122996 / +6.8%	87399624 / 96224237 / -9.2%	0.69 / 0.58 / +17.5%
clickbench-sorted_q24/duckdb:vortex-file-compressed	20710786 / 18176621 / +13.9% 🔴	32957152 / 28308081 / +16.4% 🔴	0.63 / 0.64 / -2.1%
clickbench-sorted_q26/duckdb:vortex-file-compressed	14650714 / 16952588 / -13.6% 🟢	29906923 / 29422175 / +1.6%	0.49 / 0.58 / -15.0%
clickbench-sorted_q36/duckdb:vortex-file-compressed	29986228 / 29485754 / +1.7%	61344080 / 65648159 / -6.6%	0.49 / 0.45 / +8.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed	24602620 / 23786493 / +3.4%	49635696 / 51611274 / -3.8%	0.50 / 0.46 / +7.5%
clickbench-sorted_q38/duckdb:vortex-file-compressed	24802740 / 25350944 / -2.2%	57470138 / 58151475 / -1.2%	0.43 / 0.44 / -1.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed	49021351 / 47682787 / +2.8%	94062728 / 101123034 / -7.0%	0.52 / 0.47 / +10.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed	15507361 / 15857597 / -2.2%	37849299 / 42303468 / -10.5% 🟢	0.41 / 0.37 / +9.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed	16113518 / 15248860 / +5.7%	37538340 / 38561226 / -2.7%	0.43 / 0.40 / +8.5%
clickbench-sorted_q42/duckdb:vortex-file-compressed	12214522 / 13873767 / -12.0% 🟢	30536576 / 36037744 / -15.3% 🟢	0.40 / 0.38 / +3.9%

duckdb / vortex-compact / ns (1.002x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact	65251514 / 66374084 / -1.7%	102682953 / 86131577 / +19.2% 🔴	0.64 / 0.77 / -17.5%
clickbench-sorted_q24/duckdb:vortex-compact	25348075 / 22000132 / +15.2% 🔴	37860647 / 31872257 / +18.8% 🔴	0.67 / 0.69 / -3.0%
clickbench-sorted_q26/duckdb:vortex-compact	17440290 / 18238204 / -4.4%	30022809 / 30661397 / -2.1%	0.58 / 0.59 / -2.3%
clickbench-sorted_q36/duckdb:vortex-compact	32736083 / 33154574 / -1.3%	66577173 / 77473439 / -14.1% 🟢	0.49 / 0.43 / +14.9%
clickbench-sorted_q37/duckdb:vortex-compact	29801760 / 28583670 / +4.3%	60292699 / 69627133 / -13.4% 🟢	0.49 / 0.41 / +20.4%
clickbench-sorted_q38/duckdb:vortex-compact	32739847 / 31008750 / +5.6%	65893533 / 63901729 / +3.1%	0.50 / 0.49 / +2.4%
clickbench-sorted_q39/duckdb:vortex-compact	59743028 / 59079402 / +1.1%	98424801 / 104366222 / -5.7%	0.61 / 0.57 / +7.2%
clickbench-sorted_q40/duckdb:vortex-compact	16949212 / 17018720 / -0.4%	37844937 / 39054080 / -3.1%	0.45 / 0.44 / +2.8%
clickbench-sorted_q41/duckdb:vortex-compact	17234359 / 19607972 / -12.1% 🟢	40807339 / 42481182 / -3.9%	0.42 / 0.46 / -8.5%
clickbench-sorted_q42/duckdb:vortex-compact	13320542 / 13546702 / -1.7%	30609489 / 33457504 / -8.5%	0.44 / 0.40 / +7.5%

duckdb / parquet / ns (1.031x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	127292136 / 127646402 / -0.3%	147764383 / 140485392 / +5.2%	0.86 / 0.91 / -5.2%
clickbench-sorted_q24/duckdb:parquet	18039808 / 18131202 / -0.5%	28311909 / 27821506 / +1.8%	0.64 / 0.65 / -2.2%
clickbench-sorted_q26/duckdb:parquet	13120216 / 12840868 / +2.2%	24590109 / 26974380 / -8.8%	0.53 / 0.48 / +12.1%
clickbench-sorted_q36/duckdb:parquet	47938748 / 44052148 / +8.8%	60254157 / 61805271 / -2.5%	0.80 / 0.71 / +11.6%
clickbench-sorted_q37/duckdb:parquet	36153906 / 31486948 / +14.8% 🔴	48128974 / 49257832 / -2.3%	0.75 / 0.64 / +17.5%
clickbench-sorted_q38/duckdb:parquet	39394168 / 41054451 / -4.0%	55105756 / 56451894 / -2.4%	0.71 / 0.73 / -1.7%
clickbench-sorted_q39/duckdb:parquet	71897120 / 72496342 / -0.8%	87480322 / 90295171 / -3.1%	0.82 / 0.80 / +2.4%
clickbench-sorted_q40/duckdb:parquet	17356360 / 18375428 / -5.5%	36236559 / 45589449 / -20.5% 🟢	0.48 / 0.40 / +18.8%
clickbench-sorted_q41/duckdb:parquet	18456786 / 16005528 / +15.3% 🔴	35338209 / 46875465 / -24.6% 🟢	0.52 / 0.34 / +53.0%
clickbench-sorted_q42/duckdb:parquet	11831196 / 11430602 / +3.5%	22974021 / 23574156 / -2.5%	0.51 / 0.48 / +6.2%

File Size Changes (200 files changed, -0.0% overall, 96↑ 104↓)

File	Scale	Format	Base	HEAD	Change	%
hits_075.vortex	1.0	vortex-file-compressed	189.04 MB	191.82 MB	+2.78 MB	+1.5%
hits_039.vortex	1.0	vortex-compact	123.80 MB	125.44 MB	+1.64 MB	+1.3%
hits_089.vortex	1.0	vortex-compact	98.40 MB	99.49 MB	+1.09 MB	+1.1%
hits_061.vortex	1.0	vortex-compact	123.45 MB	124.75 MB	+1.30 MB	+1.1%
hits_049.vortex	1.0	vortex-file-compressed	191.14 MB	193.12 MB	+1.97 MB	+1.0%
hits_032.vortex	1.0	vortex-file-compressed	152.52 MB	154.00 MB	+1.48 MB	+1.0%
hits_055.vortex	1.0	vortex-file-compressed	199.02 MB	200.74 MB	+1.73 MB	+0.9%
hits_087.vortex	1.0	vortex-file-compressed	160.23 MB	161.57 MB	+1.35 MB	+0.8%
hits_000.vortex	1.0	vortex-compact	97.89 MB	98.67 MB	+799.76 KB	+0.8%
hits_002.vortex	1.0	vortex-compact	124.03 MB	125.01 MB	+994.62 KB	+0.8%
hits_016.vortex	1.0	vortex-compact	126.49 MB	127.44 MB	+974.74 KB	+0.8%
hits_096.vortex	1.0	vortex-file-compressed	199.10 MB	200.56 MB	+1.47 MB	+0.7%
hits_049.vortex	1.0	vortex-compact	139.27 MB	140.25 MB	+997.97 KB	+0.7%
hits_028.vortex	1.0	vortex-file-compressed	152.17 MB	153.10 MB	+957.49 KB	+0.6%
hits_045.vortex	1.0	vortex-file-compressed	139.13 MB	139.97 MB	+859.51 KB	+0.6%
hits_067.vortex	1.0	vortex-compact	98.43 MB	98.89 MB	+468.95 KB	+0.5%
hits_094.vortex	1.0	vortex-file-compressed	158.25 MB	158.94 MB	+714.48 KB	+0.4%
hits_054.vortex	1.0	vortex-file-compressed	147.29 MB	147.93 MB	+660.67 KB	+0.4%
hits_056.vortex	1.0	vortex-file-compressed	135.03 MB	135.56 MB	+543.69 KB	+0.4%
hits_021.vortex	1.0	vortex-compact	110.60 MB	110.98 MB	+389.53 KB	+0.3%
hits_068.vortex	1.0	vortex-compact	111.86 MB	112.22 MB	+365.15 KB	+0.3%
hits_043.vortex	1.0	vortex-file-compressed	126.68 MB	127.07 MB	+390.09 KB	+0.3%
hits_071.vortex	1.0	vortex-file-compressed	139.94 MB	140.31 MB	+378.98 KB	+0.3%
hits_005.vortex	1.0	vortex-file-compressed	167.23 MB	167.66 MB	+445.03 KB	+0.3%
hits_041.vortex	1.0	vortex-compact	97.70 MB	97.95 MB	+256.09 KB	+0.3%
hits_010.vortex	1.0	vortex-compact	123.04 MB	123.35 MB	+319.56 KB	+0.3%
hits_016.vortex	1.0	vortex-file-compressed	179.73 MB	180.16 MB	+442.73 KB	+0.2%
hits_097.vortex	1.0	vortex-compact	140.12 MB	140.46 MB	+344.65 KB	+0.2%
hits_026.vortex	1.0	vortex-file-compressed	130.46 MB	130.77 MB	+319.12 KB	+0.2%
hits_075.vortex	1.0	vortex-compact	137.62 MB	137.94 MB	+330.14 KB	+0.2%
hits_058.vortex	1.0	vortex-file-compressed	154.83 MB	155.19 MB	+368.45 KB	+0.2%
hits_052.vortex	1.0	vortex-compact	97.90 MB	98.12 MB	+231.84 KB	+0.2%
hits_059.vortex	1.0	vortex-compact	152.63 MB	152.98 MB	+361.16 KB	+0.2%
hits_086.vortex	1.0	vortex-compact	139.56 MB	139.86 MB	+312.50 KB	+0.2%
hits_002.vortex	1.0	vortex-file-compressed	161.57 MB	161.92 MB	+355.73 KB	+0.2%
hits_066.vortex	1.0	vortex-file-compressed	163.22 MB	163.56 MB	+345.20 KB	+0.2%
hits_013.vortex	1.0	vortex-file-compressed	161.83 MB	162.16 MB	+335.48 KB	+0.2%
hits_031.vortex	1.0	vortex-compact	111.19 MB	111.37 MB	+187.20 KB	+0.2%
hits_011.vortex	1.0	vortex-compact	152.47 MB	152.72 MB	+251.96 KB	+0.2%
hits_025.vortex	1.0	vortex-compact	133.45 MB	133.66 MB	+219.83 KB	+0.2%
hits_078.vortex	1.0	vortex-file-compressed	130.36 MB	130.57 MB	+211.77 KB	+0.2%
hits_012.vortex	1.0	vortex-file-compressed	190.44 MB	190.74 MB	+302.67 KB	+0.2%
hits_035.vortex	1.0	vortex-file-compressed	102.11 MB	102.26 MB	+156.70 KB	+0.1%
hits_040.vortex	1.0	vortex-compact	110.01 MB	110.16 MB	+152.77 KB	+0.1%
hits_077.vortex	1.0	vortex-compact	134.44 MB	134.62 MB	+183.60 KB	+0.1%
hits_063.vortex	1.0	vortex-file-compressed	130.77 MB	130.92 MB	+154.77 KB	+0.1%
hits_039.vortex	1.0	vortex-file-compressed	161.72 MB	161.89 MB	+175.19 KB	+0.1%
hits_091.vortex	1.0	vortex-compact	111.25 MB	111.37 MB	+120.41 KB	+0.1%
hits_079.vortex	1.0	vortex-compact	127.74 MB	127.87 MB	+135.54 KB	+0.1%
hits_073.vortex	1.0	vortex-compact	133.96 MB	134.09 MB	+136.54 KB	+0.1%
hits_093.vortex	1.0	vortex-file-compressed	130.92 MB	131.04 MB	+131.20 KB	+0.1%
hits_084.vortex	1.0	vortex-file-compressed	154.23 MB	154.38 MB	+152.00 KB	+0.1%
hits_085.vortex	1.0	vortex-compact	153.34 MB	153.48 MB	+150.05 KB	+0.1%
hits_036.vortex	1.0	vortex-compact	133.12 MB	133.23 MB	+111.02 KB	+0.1%
hits_073.vortex	1.0	vortex-file-compressed	173.00 MB	173.12 MB	+128.83 KB	+0.1%
hits_090.vortex	1.0	vortex-compact	140.02 MB	140.12 MB	+103.49 KB	+0.1%
hits_097.vortex	1.0	vortex-file-compressed	192.55 MB	192.68 MB	+136.95 KB	+0.1%
hits_017.vortex	1.0	vortex-compact	111.71 MB	111.79 MB	+78.70 KB	+0.1%
hits_008.vortex	1.0	vortex-compact	105.62 MB	105.69 MB	+69.62 KB	+0.1%
hits_044.vortex	1.0	vortex-compact	153.42 MB	153.52 MB	+94.84 KB	+0.1%
hits_038.vortex	1.0	vortex-file-compressed	189.50 MB	189.60 MB	+101.45 KB	+0.1%
hits_048.vortex	1.0	vortex-compact	153.12 MB	153.19 MB	+72.62 KB	+0.0%
hits_054.vortex	1.0	vortex-compact	111.62 MB	111.67 MB	+51.53 KB	+0.0%
hits_072.vortex	1.0	vortex-file-compressed	101.92 MB	101.96 MB	+45.42 KB	+0.0%
hits_017.vortex	1.0	vortex-file-compressed	147.20 MB	147.26 MB	+65.09 KB	+0.0%
hits_099.vortex	1.0	vortex-file-compressed	171.83 MB	171.90 MB	+73.20 KB	+0.0%
hits_045.vortex	1.0	vortex-compact	105.57 MB	105.61 MB	+44.48 KB	+0.0%
hits_042.vortex	1.0	vortex-compact	136.18 MB	136.24 MB	+55.77 KB	+0.0%
hits_074.vortex	1.0	vortex-compact	153.13 MB	153.19 MB	+62.36 KB	+0.0%
hits_083.vortex	1.0	vortex-file-compressed	156.30 MB	156.36 MB	+60.66 KB	+0.0%
hits_037.vortex	1.0	vortex-compact	132.14 MB	132.19 MB	+50.29 KB	+0.0%
hits_019.vortex	1.0	vortex-compact	105.99 MB	106.02 MB	+37.39 KB	+0.0%
hits_050.vortex	1.0	vortex-file-compressed	161.54 MB	161.59 MB	+55.37 KB	+0.0%
hits_070.vortex	1.0	vortex-compact	153.64 MB	153.69 MB	+48.48 KB	+0.0%
hits_074.vortex	1.0	vortex-file-compressed	200.18 MB	200.24 MB	+57.89 KB	+0.0%
hits_094.vortex	1.0	vortex-compact	110.68 MB	110.71 MB	+27.22 KB	+0.0%
hits_051.vortex	1.0	vortex-file-compressed	173.21 MB	173.25 MB	+41.06 KB	+0.0%
hits_046.vortex	1.0	vortex-compact	74.89 MB	74.91 MB	+17.04 KB	+0.0%
hits_027.vortex	1.0	vortex-file-compressed	189.53 MB	189.57 MB	+41.12 KB	+0.0%
hits_012.vortex	1.0	vortex-compact	138.69 MB	138.71 MB	+26.78 KB	+0.0%
hits_030.vortex	1.0	vortex-compact	98.56 MB	98.58 MB	+17.67 KB	+0.0%
hits_056.vortex	1.0	vortex-compact	100.75 MB	100.77 MB	+17.28 KB	+0.0%
hits_090.vortex	1.0	vortex-file-compressed	192.31 MB	192.33 MB	+23.80 KB	+0.0%
hits_052.vortex	1.0	vortex-file-compressed	130.14 MB	130.15 MB	+14.27 KB	+0.0%
hits_047.vortex	1.0	vortex-compact	110.45 MB	110.46 MB	+12.00 KB	+0.0%
hits_084.vortex	1.0	vortex-compact	110.67 MB	110.68 MB	+9.31 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.60 MB	126.61 MB	+10.21 KB	+0.0%
hits_066.vortex	1.0	vortex-compact	117.42 MB	117.43 MB	+8.58 KB	+0.0%
hits_035.vortex	1.0	vortex-compact	75.91 MB	75.92 MB	+4.64 KB	+0.0%
hits_025.vortex	1.0	vortex-file-compressed	172.37 MB	172.38 MB	+9.12 KB	+0.0%
hits_032.vortex	1.0	vortex-compact	110.58 MB	110.59 MB	+3.68 KB	+0.0%
hits_051.vortex	1.0	vortex-compact	133.98 MB	133.98 MB	+4.18 KB	+0.0%
hits_009.vortex	1.0	vortex-compact	75.21 MB	75.21 MB	+1.38 KB	+0.0%
hits_028.vortex	1.0	vortex-compact	115.19 MB	115.19 MB	+1.88 KB	+0.0%
hits_060.vortex	1.0	vortex-file-compressed	192.91 MB	192.91 MB	+2.73 KB	+0.0%
hits_095.vortex	1.0	vortex-compact	110.63 MB	110.63 MB	+184 B	+0.0%
hits_088.vortex	1.0	vortex-file-compressed	172.59 MB	172.59 MB	968 B	-0.0%
hits_085.vortex	1.0	vortex-file-compressed	200.68 MB	200.68 MB	1.40 KB	-0.0%
hits_082.vortex	1.0	vortex-file-compressed	139.23 MB	139.23 MB	6.60 KB	-0.0%
hits_068.vortex	1.0	vortex-file-compressed	160.47 MB	160.46 MB	7.94 KB	-0.0%
hits_092.vortex	1.0	vortex-compact	153.48 MB	153.48 MB	7.61 KB	-0.0%
hits_042.vortex	1.0	vortex-file-compressed	202.13 MB	202.12 MB	11.48 KB	-0.0%
hits_072.vortex	1.0	vortex-compact	75.61 MB	75.60 MB	4.35 KB	-0.0%
hits_047.vortex	1.0	vortex-file-compressed	153.87 MB	153.85 MB	12.73 KB	-0.0%
hits_086.vortex	1.0	vortex-file-compressed	191.70 MB	191.68 MB	23.88 KB	-0.0%
hits_059.vortex	1.0	vortex-file-compressed	200.13 MB	200.11 MB	26.35 KB	-0.0%
hits_024.vortex	1.0	vortex-file-compressed	161.13 MB	161.11 MB	21.38 KB	-0.0%
hits_064.vortex	1.0	vortex-compact	138.86 MB	138.84 MB	20.67 KB	-0.0%
hits_058.vortex	1.0	vortex-compact	111.05 MB	111.03 MB	21.84 KB	-0.0%
hits_019.vortex	1.0	vortex-file-compressed	140.09 MB	140.06 MB	28.22 KB	-0.0%
hits_011.vortex	1.0	vortex-file-compressed	200.34 MB	200.29 MB	41.79 KB	-0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.08 MB	131.05 MB	28.29 KB	-0.0%
hits_061.vortex	1.0	vortex-file-compressed	161.37 MB	161.33 MB	38.09 KB	-0.0%
hits_022.vortex	1.0	vortex-compact	153.12 MB	153.08 MB	36.63 KB	-0.0%
hits_020.vortex	1.0	vortex-compact	111.65 MB	111.62 MB	28.12 KB	-0.0%
hits_000.vortex	1.0	vortex-file-compressed	130.66 MB	130.62 MB	37.14 KB	-0.0%
hits_004.vortex	1.0	vortex-file-compressed	130.74 MB	130.69 MB	42.41 KB	-0.0%
hits_081.vortex	1.0	vortex-file-compressed	201.02 MB	200.96 MB	67.17 KB	-0.0%
hits_062.vortex	1.0	vortex-file-compressed	171.33 MB	171.27 MB	57.38 KB	-0.0%
hits_096.vortex	1.0	vortex-compact	153.28 MB	153.22 MB	53.82 KB	-0.0%
hits_099.vortex	1.0	vortex-compact	133.23 MB	133.17 MB	53.16 KB	-0.0%
hits_076.vortex	1.0	vortex-file-compressed	161.62 MB	161.55 MB	68.74 KB	-0.0%
hits_005.vortex	1.0	vortex-compact	115.88 MB	115.83 MB	51.35 KB	-0.0%
hits_071.vortex	1.0	vortex-compact	105.58 MB	105.53 MB	48.73 KB	-0.0%
hits_037.vortex	1.0	vortex-file-compressed	178.14 MB	178.05 MB	83.04 KB	-0.0%
hits_036.vortex	1.0	vortex-file-compressed	172.07 MB	171.99 MB	81.81 KB	-0.0%
hits_053.vortex	1.0	vortex-file-compressed	189.52 MB	189.43 MB	91.97 KB	-0.0%
hits_029.vortex	1.0	vortex-file-compressed	201.17 MB	201.07 MB	101.63 KB	-0.0%
hits_021.vortex	1.0	vortex-file-compressed	153.80 MB	153.72 MB	85.25 KB	-0.1%
hits_082.vortex	1.0	vortex-compact	105.76 MB	105.70 MB	61.11 KB	-0.1%
hits_069.vortex	1.0	vortex-file-compressed	142.86 MB	142.78 MB	84.05 KB	-0.1%
hits_062.vortex	1.0	vortex-compact	132.60 MB	132.52 MB	78.16 KB	-0.1%
hits_003.vortex	1.0	vortex-compact	104.60 MB	104.53 MB	70.75 KB	-0.1%
hits_087.vortex	1.0	vortex-compact	125.13 MB	125.05 MB	86.34 KB	-0.1%
hits_044.vortex	1.0	vortex-file-compressed	201.17 MB	201.03 MB	142.02 KB	-0.1%
hits_089.vortex	1.0	vortex-file-compressed	130.72 MB	130.63 MB	92.63 KB	-0.1%
hits_083.vortex	1.0	vortex-compact	110.10 MB	110.02 MB	79.69 KB	-0.1%
hits_015.vortex	1.0	vortex-file-compressed	130.39 MB	130.28 MB	110.52 KB	-0.1%
hits_076.vortex	1.0	vortex-compact	125.44 MB	125.34 MB	106.64 KB	-0.1%
hits_010.vortex	1.0	vortex-file-compressed	168.99 MB	168.85 MB	150.66 KB	-0.1%
hits_024.vortex	1.0	vortex-compact	123.42 MB	123.31 MB	113.23 KB	-0.1%
hits_098.vortex	1.0	vortex-file-compressed	137.82 MB	137.70 MB	126.66 KB	-0.1%
hits_014.vortex	1.0	vortex-file-compressed	173.09 MB	172.93 MB	160.65 KB	-0.1%
hits_023.vortex	1.0	vortex-compact	142.55 MB	142.42 MB	134.98 KB	-0.1%
hits_003.vortex	1.0	vortex-file-compressed	136.62 MB	136.49 MB	129.48 KB	-0.1%
hits_091.vortex	1.0	vortex-file-compressed	147.52 MB	147.38 MB	142.95 KB	-0.1%
hits_046.vortex	1.0	vortex-file-compressed	100.72 MB	100.63 MB	99.78 KB	-0.1%
hits_029.vortex	1.0	vortex-compact	153.55 MB	153.40 MB	152.34 KB	-0.1%
hits_020.vortex	1.0	vortex-file-compressed	160.01 MB	159.83 MB	181.47 KB	-0.1%
hits_064.vortex	1.0	vortex-file-compressed	190.71 MB	190.48 MB	232.22 KB	-0.1%
hits_008.vortex	1.0	vortex-file-compressed	139.45 MB	139.27 MB	176.10 KB	-0.1%
hits_043.vortex	1.0	vortex-compact	94.28 MB	94.16 MB	120.80 KB	-0.1%
hits_014.vortex	1.0	vortex-compact	133.97 MB	133.78 MB	186.33 KB	-0.1%
hits_031.vortex	1.0	vortex-file-compressed	159.38 MB	159.16 MB	223.89 KB	-0.1%
hits_009.vortex	1.0	vortex-file-compressed	101.13 MB	100.99 MB	144.70 KB	-0.1%
hits_057.vortex	1.0	vortex-file-compressed	159.97 MB	159.74 MB	230.37 KB	-0.1%
hits_067.vortex	1.0	vortex-file-compressed	131.15 MB	130.96 MB	197.25 KB	-0.1%
hits_078.vortex	1.0	vortex-compact	97.83 MB	97.68 MB	151.82 KB	-0.2%
hits_065.vortex	1.0	vortex-file-compressed	162.17 MB	161.92 MB	257.31 KB	-0.2%
hits_069.vortex	1.0	vortex-compact	99.58 MB	99.41 MB	167.02 KB	-0.2%
hits_033.vortex	1.0	vortex-file-compressed	201.35 MB	201.02 MB	343.30 KB	-0.2%
hits_013.vortex	1.0	vortex-compact	123.92 MB	123.71 MB	215.88 KB	-0.2%
hits_033.vortex	1.0	vortex-compact	152.75 MB	152.47 MB	278.04 KB	-0.2%
hits_041.vortex	1.0	vortex-file-compressed	130.44 MB	130.21 MB	240.38 KB	-0.2%
hits_095.vortex	1.0	vortex-file-compressed	154.03 MB	153.76 MB	285.24 KB	-0.2%
hits_015.vortex	1.0	vortex-compact	97.35 MB	97.16 MB	196.29 KB	-0.2%
hits_007.vortex	1.0	vortex-compact	153.86 MB	153.55 MB	317.55 KB	-0.2%
hits_060.vortex	1.0	vortex-compact	140.16 MB	139.85 MB	316.82 KB	-0.2%
hits_077.vortex	1.0	vortex-file-compressed	173.38 MB	172.99 MB	393.12 KB	-0.2%
hits_006.vortex	1.0	vortex-compact	94.19 MB	93.97 MB	223.91 KB	-0.2%
hits_079.vortex	1.0	vortex-file-compressed	181.04 MB	180.59 MB	455.90 KB	-0.2%
hits_080.vortex	1.0	vortex-compact	96.68 MB	96.42 MB	274.85 KB	-0.3%
hits_057.vortex	1.0	vortex-compact	111.73 MB	111.40 MB	337.00 KB	-0.3%
hits_001.vortex	1.0	vortex-compact	139.18 MB	138.75 MB	441.85 KB	-0.3%
hits_050.vortex	1.0	vortex-compact	125.51 MB	125.12 MB	400.48 KB	-0.3%
hits_080.vortex	1.0	vortex-file-compressed	127.43 MB	127.00 MB	442.30 KB	-0.3%
hits_088.vortex	1.0	vortex-compact	134.60 MB	134.09 MB	516.57 KB	-0.4%
hits_055.vortex	1.0	vortex-compact	153.19 MB	152.59 MB	609.38 KB	-0.4%
hits_040.vortex	1.0	vortex-file-compressed	144.76 MB	144.06 MB	723.38 KB	-0.5%
hits_026.vortex	1.0	vortex-compact	98.39 MB	97.89 MB	515.66 KB	-0.5%
hits_048.vortex	1.0	vortex-file-compressed	200.59 MB	199.55 MB	1.04 MB	-0.5%
hits_070.vortex	1.0	vortex-file-compressed	201.06 MB	199.97 MB	1.09 MB	-0.5%
hits_081.vortex	1.0	vortex-compact	153.64 MB	152.80 MB	853.41 KB	-0.5%
hits_018.vortex	1.0	vortex-compact	153.70 MB	152.86 MB	856.98 KB	-0.5%
hits_092.vortex	1.0	vortex-file-compressed	200.58 MB	199.48 MB	1.11 MB	-0.6%
hits_034.vortex	1.0	vortex-compact	133.18 MB	132.43 MB	771.76 KB	-0.6%
hits_093.vortex	1.0	vortex-compact	98.23 MB	97.64 MB	603.59 KB	-0.6%
hits_018.vortex	1.0	vortex-file-compressed	200.76 MB	199.55 MB	1.21 MB	-0.6%
hits_063.vortex	1.0	vortex-compact	98.45 MB	97.86 MB	609.65 KB	-0.6%
hits_053.vortex	1.0	vortex-compact	138.35 MB	137.51 MB	859.73 KB	-0.6%
hits_027.vortex	1.0	vortex-compact	139.03 MB	138.13 MB	921.41 KB	-0.6%
hits_038.vortex	1.0	vortex-compact	139.29 MB	138.33 MB	985.71 KB	-0.7%
hits_007.vortex	1.0	vortex-file-compressed	201.22 MB	199.81 MB	1.41 MB	-0.7%
hits_022.vortex	1.0	vortex-file-compressed	200.14 MB	198.65 MB	1.49 MB	-0.7%
hits_004.vortex	1.0	vortex-compact	98.06 MB	97.31 MB	762.96 KB	-0.8%
hits_034.vortex	1.0	vortex-file-compressed	183.33 MB	181.68 MB	1.65 MB	-0.9%
hits_001.vortex	1.0	vortex-file-compressed	193.11 MB	191.06 MB	2.05 MB	-1.1%
hits_023.vortex	1.0	vortex-file-compressed	197.04 MB	194.85 MB	2.18 MB	-1.1%
hits_098.vortex	1.0	vortex-compact	103.67 MB	102.42 MB	1.26 MB	-1.2%
hits_065.vortex	1.0	vortex-compact	125.83 MB	123.97 MB	1.87 MB	-1.5%

Totals:

vortex-compact: 11.91 GB → 11.90 GB (-0.0%)
vortex-file-compressed: 15.97 GB → 15.97 GB (+0.0%)

github-actions · 2026-10-09T14:22:40Z

Benchmarks: FineWeb S3 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.2%
Engines: DataFusion No clear signal (-4.3%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.023x ➖
Parquet (geomean): hot 1.020x ➖ · cold 0.987x ➖
Shifts: Parquet (control) +2.0% · Median polish +4.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.903x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	55383822 / 51745625 / +7.0%	104842774 / 151589383 / -30.8% 🟢	0.53 / 0.34 / +54.8%
fineweb_q01/datafusion:vortex-file-compressed	456745136 / 563403477 / -18.9%	669098591 / 952078776 / -29.7%	0.68 / 0.59 / +15.4%
fineweb_q02/datafusion:vortex-file-compressed	408209516 / 667940817 / -38.9% 🟢	629207517 / 710570095 / -11.5%	0.65 / 0.94 / -31.0%
fineweb_q03/datafusion:vortex-file-compressed	536360618 / 475453639 / +12.8%	1184069528 / 742720109 / +59.4% 🔴	0.45 / 0.64 / -29.2%
fineweb_q04/datafusion:vortex-file-compressed	463880954 / 432567126 / +7.2%	490705477 / 509628618 / -3.7%	0.95 / 0.85 / +11.4%
fineweb_q05/datafusion:vortex-file-compressed	435871354 / 447141030 / -2.5%	461731754 / 457699385 / +0.9%	0.94 / 0.98 / -3.4%
fineweb_q06/datafusion:vortex-file-compressed	841027228 / 745439316 / +12.8%	1126579257 / 717971793 / +56.9% 🔴	0.75 / 1.04 / -28.1%
fineweb_q07/datafusion:vortex-file-compressed	564757826 / 454360232 / +24.3%	514351218 / 499428650 / +3.0%	1.10 / 0.91 / +20.7%
fineweb_q08/datafusion:vortex-file-compressed	215365714 / 471199323 / -54.3% 🟢	222735002 / 339324687 / -34.4% 🟢	0.97 / 1.39 / -30.4%

datafusion / vortex-compact / ns (1.020x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	60153890 / 59827748 / +0.5%	155881289 / 187886650 / -17.0%	0.39 / 0.32 / +21.2%
fineweb_q01/datafusion:vortex-compact	550647422 / 422629730 / +30.3% 🔴	805031740 / 805410028 / -0.0%	0.68 / 0.52 / +30.4%
fineweb_q02/datafusion:vortex-compact	455985456 / 463502960 / -1.6%	533715960 / 584751953 / -8.7%	0.85 / 0.79 / +7.8%
fineweb_q03/datafusion:vortex-compact	533268846 / 559147741 / -4.6%	786461984 / 794192436 / -1.0%	0.68 / 0.70 / -3.7%
fineweb_q04/datafusion:vortex-compact	455862714 / 457395523 / -0.3%	489456858 / 495088570 / -1.1%	0.93 / 0.92 / +0.8%
fineweb_q05/datafusion:vortex-compact	436651216 / 424690534 / +2.8%	500706636 / 479276993 / +4.5%	0.87 / 0.89 / -1.6%
fineweb_q06/datafusion:vortex-compact	621775179 / 743075566 / -16.3%	702553208 / 679018527 / +3.5%	0.89 / 1.09 / -19.1%
fineweb_q07/datafusion:vortex-compact	586520744 / 599530522 / -2.2%	574380157 / 668585569 / -14.1%	1.02 / 0.90 / +13.9%
fineweb_q08/datafusion:vortex-compact	193736590 / 167087772 / +15.9%	179119239 / 241857423 / -25.9%	1.08 / 0.69 / +56.6%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	434860679 / 548975166 / -20.8%	905413821 / 837159526 / +8.2%	0.48 / 0.66 / -26.8%
fineweb_q01/datafusion:parquet	924250999 / 837705994 / +10.3%	801003014 / 1028677177 / -22.1%	1.15 / 0.81 / +41.7%
fineweb_q02/datafusion:parquet	777679423 / 1076892925 / -27.8%	847062177 / 923197126 / -8.2%	0.92 / 1.17 / -21.3%
fineweb_q03/datafusion:parquet	755756760 / 797395424 / -5.2%	691359206 / 745045543 / -7.2%	1.09 / 1.07 / +2.1%
fineweb_q04/datafusion:parquet	796299286 / 768151178 / +3.7%	935571648 / 779966495 / +20.0%	0.85 / 0.98 / -13.6%
fineweb_q05/datafusion:parquet	1010517294 / 863350926 / +17.0%	901500863 / 910830425 / -1.0%	1.12 / 0.95 / +18.3%
fineweb_q06/datafusion:parquet	907696067 / 847290080 / +7.1%	846020443 / 828486316 / +2.1%	1.07 / 1.02 / +4.9%
fineweb_q07/datafusion:parquet	958678168 / 767920688 / +24.8%	911825023 / 842387816 / +8.2%	1.05 / 0.91 / +15.3%
fineweb_q08/datafusion:parquet	812477892 / 767034886 / +5.9%	742023982 / 890499234 / -16.7%	1.09 / 0.86 / +27.1%

duckdb / vortex-file-compressed / ns (0.981x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	65619310 / 59659970 / +10.0%	117486216 / 58157925 / +102.0% 🔴	0.56 / 1.03 / -45.6%
fineweb_q01/duckdb:vortex-file-compressed	471432134 / 570128194 / -17.3%	516394495 / 570591054 / -9.5%	0.91 / 1.00 / -8.6%
fineweb_q02/duckdb:vortex-file-compressed	586520356 / 678889806 / -13.6%	608479925 / 753628095 / -19.3%	0.96 / 0.90 / +7.0%
fineweb_q03/duckdb:vortex-file-compressed	1055951394 / 1104679516 / -4.4%	1151638466 / 1205790330 / -4.5%	0.92 / 0.92 / +0.1%
fineweb_q04/duckdb:vortex-file-compressed	1025254358 / 1024591234 / +0.1%	1110332415 / 981107725 / +13.2%	0.92 / 1.04 / -11.6%
fineweb_q05/duckdb:vortex-file-compressed	887674272 / 989703870 / -10.3%	996074489 / 1015973693 / -2.0%	0.89 / 0.97 / -8.5%
fineweb_q06/duckdb:vortex-file-compressed	1239241235 / 1297806538 / -4.5%	1199168871 / 1195129231 / +0.3%	1.03 / 1.09 / -4.8%
fineweb_q07/duckdb:vortex-file-compressed	1198606920 / 1007987436 / +18.9%	1091903002 / 1076224712 / +1.5%	1.10 / 0.94 / +17.2%
fineweb_q08/duckdb:vortex-file-compressed	521756483 / 474967440 / +9.9%	461494024 / 490277945 / -5.9%	1.13 / 0.97 / +16.7%

duckdb / vortex-compact / ns (1.094x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	64935387 / 74145422 / -12.4%	98210171 / 67172470 / +46.2% 🔴	0.66 / 1.10 / -40.1%
fineweb_q01/duckdb:vortex-compact	610105754 / 437071276 / +39.6% 🔴	605655095 / 551366306 / +9.8%	1.01 / 0.79 / +27.1%
fineweb_q02/duckdb:vortex-compact	612959956 / 545564774 / +12.4%	621780634 / 581332110 / +7.0%	0.99 / 0.94 / +5.0%
fineweb_q03/duckdb:vortex-compact	1203226933 / 1157905477 / +3.9%	1241407366 / 1309284183 / -5.2%	0.97 / 0.88 / +9.6%
fineweb_q04/duckdb:vortex-compact	1139747062 / 1153239281 / -1.2%	1211392417 / 1163499968 / +4.1%	0.94 / 0.99 / -5.1%
fineweb_q05/duckdb:vortex-compact	1065591988 / 874917640 / +21.8%	1603377642 / 1051971723 / +52.4% 🔴	0.66 / 0.83 / -20.1%
fineweb_q06/duckdb:vortex-compact	1442949584 / 1288837008 / +12.0%	1222949332 / 1150512160 / +6.3%	1.18 / 1.12 / +5.3%
fineweb_q07/duckdb:vortex-compact	1015479962 / 952600022 / +6.6%	1065121485 / 1032557501 / +3.2%	0.95 / 0.92 / +3.3%
fineweb_q08/duckdb:vortex-compact	407349581 / 372008842 / +9.5%	618592943 / 424414950 / +45.8% 🔴	0.66 / 0.88 / -24.9%

duckdb / parquet / ns (1.037x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	569332567 / 531516918 / +7.1%	596729674 / 563969021 / +5.8%	0.95 / 0.94 / +1.2%
fineweb_q01/duckdb:parquet	619991514 / 622740416 / -0.4%	660770296 / 623759056 / +5.9%	0.94 / 1.00 / -6.0%
fineweb_q02/duckdb:parquet	620334284 / 649303914 / -4.5%	739961734 / 664612573 / +11.3%	0.84 / 0.98 / -14.2%
fineweb_q03/duckdb:parquet	1549346994 / 1573472268 / -1.5%	1501662337 / 1813471738 / -17.2%	1.03 / 0.87 / +18.9%
fineweb_q04/duckdb:parquet	856527354 / 819476332 / +4.5%	833130221 / 906708746 / -8.1%	1.03 / 0.90 / +13.8%
fineweb_q05/duckdb:parquet	977760302 / 930142186 / +5.1%	1244671072 / 1022365694 / +21.7%	0.79 / 0.91 / -13.7%
fineweb_q06/duckdb:parquet	1811719079 / 1773179466 / +2.2%	1740298661 / 1870222386 / -6.9%	1.04 / 0.95 / +9.8%
fineweb_q07/duckdb:parquet	1332105166 / 1170252358 / +13.8%	1159699999 / 1119222046 / +3.6%	1.15 / 1.05 / +9.9%
fineweb_q08/duckdb:parquet	689834082 / 640408174 / +7.7%	613570476 / 678174360 / -9.5%	1.12 / 0.94 / +19.1%

github-actions · 2026-10-09T14:23:52Z

Benchmarks: Appian on NVME 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.994x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact	52554372 / 52784395 / -0.4%	73215384 / 75324093 / -2.8%	0.72 / 0.70 / +2.4%
appian_q02/datafusion:vortex-compact	235864076 / 236923270 / -0.4%	269266177 / 271107184 / -0.7%	0.88 / 0.87 / +0.2%
appian_q03/datafusion:vortex-compact	146307120 / 147563285 / -0.9%	183024332 / 185608990 / -1.4%	0.80 / 0.80 / +0.5%
appian_q04/datafusion:vortex-compact	9874503949 / 9914912742 / -0.4%	9773939226 / 9723373260 / +0.5%	1.01 / 1.02 / -0.9%
appian_q05/datafusion:vortex-compact	135446482 / 136841153 / -1.0%	167402229 / 166404064 / +0.6%	0.81 / 0.82 / -1.6%
appian_q06/datafusion:vortex-compact	143893304 / 143605241 / +0.2%	164022896 / 165033932 / -0.6%	0.88 / 0.87 / +0.8%
appian_q07/datafusion:vortex-compact	163397543 / 165495435 / -1.3%	191385866 / 195190688 / -1.9%	0.85 / 0.85 / +0.7%
appian_q08/datafusion:vortex-compact	564910075 / 552990271 / +2.2%	599300989 / 598666157 / +0.1%	0.94 / 0.92 / +2.0%

datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	73633501 / 72396422 / +1.7%	92417969 / 94293385 / -2.0%	0.80 / 0.77 / +3.8%
appian_q02/datafusion:parquet	305152684 / 305484167 / -0.1%	342871006 / 336778167 / +1.8%	0.89 / 0.91 / -1.9%
appian_q03/datafusion:parquet	188948318 / 189804993 / -0.5%	227222567 / 233525194 / -2.7%	0.83 / 0.81 / +2.3%
appian_q04/datafusion:parquet	9940675637 / 9934594598 / +0.1%	9861433096 / 9834124350 / +0.3%	1.01 / 1.01 / -0.2%
appian_q05/datafusion:parquet	199183998 / 200277892 / -0.5%	221276756 / 219013917 / +1.0%	0.90 / 0.91 / -1.6%
appian_q06/datafusion:parquet	169475832 / 169706542 / -0.1%	196217389 / 191095337 / +2.7%	0.86 / 0.89 / -2.7%
appian_q07/datafusion:parquet	210613587 / 213150687 / -1.2%	243708893 / 240548684 / +1.3%	0.86 / 0.89 / -2.5%
appian_q08/datafusion:parquet	666911935 / 682048050 / -2.2%	689249093 / 691103361 / -0.3%	0.97 / 0.99 / -2.0%

duckdb / vortex-compact / ns (0.990x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact	90858138 / 90555148 / +0.3%	105336478 / 104978888 / +0.3%	0.86 / 0.86 / -0.0%
appian_q02/duckdb:vortex-compact	212584122 / 215127125 / -1.2%	229291367 / 239632945 / -4.3%	0.93 / 0.90 / +3.3%
appian_q03/duckdb:vortex-compact	122855930 / 121813122 / +0.9%	138264589 / 139330193 / -0.8%	0.89 / 0.87 / +1.6%
appian_q04/duckdb:vortex-compact	569656459 / 565849887 / +0.7%	573751423 / 597448296 / -4.0%	0.99 / 0.95 / +4.8%
appian_q05/duckdb:vortex-compact	135414915 / 137017730 / -1.2%	152108313 / 159030052 / -4.4%	0.89 / 0.86 / +3.3%
appian_q06/duckdb:vortex-compact	408040423 / 415585601 / -1.8%	404868531 / 416535385 / -2.8%	1.01 / 1.00 / +1.0%
appian_q07/duckdb:vortex-compact	138991789 / 137577764 / +1.0%	162968443 / 158162091 / +3.0%	0.85 / 0.87 / -2.0%
appian_q08/duckdb:vortex-compact	420811036 / 449263027 / -6.3%	470046338 / 478516912 / -1.8%	0.90 / 0.94 / -4.6%

duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	100332993 / 99591079 / +0.7%	117805004 / 115075811 / +2.4%	0.85 / 0.87 / -1.6%
appian_q02/duckdb:parquet	197622163 / 191895612 / +3.0%	201821754 / 198931459 / +1.5%	0.98 / 0.96 / +1.5%
appian_q03/duckdb:parquet	123912141 / 124275776 / -0.3%	142863339 / 135812587 / +5.2%	0.87 / 0.92 / -5.2%
appian_q04/duckdb:parquet	455967755 / 443529334 / +2.8%	456999829 / 474735191 / -3.7%	1.00 / 0.93 / +6.8%
appian_q05/duckdb:parquet	144447262 / 142028489 / +1.7%	157453498 / 158955324 / -0.9%	0.92 / 0.89 / +2.7%
appian_q06/duckdb:parquet	249882576 / 263649345 / -5.2%	243127343 / 261862387 / -7.2%	1.03 / 1.01 / +2.1%
appian_q07/duckdb:parquet	153692066 / 154145262 / -0.3%	161723534 / 168602086 / -4.1%	0.95 / 0.91 / +3.9%
appian_q08/duckdb:parquet	381394581 / 376952819 / +1.2%	376709375 / 393058222 / -4.2%	1.01 / 0.96 / +5.6%

No file size changes detected.

github-actions · 2026-10-09T14:24:38Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.4%, environment too noisy confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.983x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.993x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1234664 / 1242883 / -0.7%	20957644 / 21222237 / -1.2%	0.06 / 0.06 / +0.6%
clickbench_q01/datafusion:vortex-file-compressed	5597718 / 5887359 / -4.9%	34632046 / 34031043 / +1.8%	0.16 / 0.17 / -6.6%
clickbench_q02/datafusion:vortex-file-compressed	10127602 / 10467698 / -3.2%	37617258 / 36478330 / +3.1%	0.27 / 0.29 / -6.2%
clickbench_q03/datafusion:vortex-file-compressed	11026350 / 11759486 / -6.2%	52772028 / 55525596 / -5.0%	0.21 / 0.21 / -1.3%
clickbench_q04/datafusion:vortex-file-compressed	55687654 / 56997925 / -2.3%	90420283 / 93437200 / -3.2%	0.62 / 0.61 / +1.0%
clickbench_q05/datafusion:vortex-file-compressed	77976232 / 74343774 / +4.9%	119669061 / 115581237 / +3.5%	0.65 / 0.64 / +1.3%
clickbench_q06/datafusion:vortex-file-compressed	1218138 / 1235782 / -1.4%	20747660 / 21258760 / -2.4%	0.06 / 0.06 / +1.0%
clickbench_q07/datafusion:vortex-file-compressed	9722720 / 9443488 / +3.0%	32552715 / 33579058 / -3.1%	0.30 / 0.28 / +6.2%
clickbench_q08/datafusion:vortex-file-compressed	76699725 / 75929612 / +1.0%	119978121 / 114371754 / +4.9%	0.64 / 0.66 / -3.7%
clickbench_q09/datafusion:vortex-file-compressed	174351600 / 172921256 / +0.8%	208603923 / 211134639 / -1.2%	0.84 / 0.82 / +2.1%
clickbench_q10/datafusion:vortex-file-compressed	23820690 / 23279077 / +2.3%	64826522 / 67364101 / -3.8%	0.37 / 0.35 / +6.3%
clickbench_q11/datafusion:vortex-file-compressed	26848152 / 26132904 / +2.7%	68491108 / 66357993 / +3.2%	0.39 / 0.39 / -0.5%
clickbench_q12/datafusion:vortex-file-compressed	70715218 / 73911475 / -4.3%	116084143 / 117653305 / -1.3%	0.61 / 0.63 / -3.0%
clickbench_q13/datafusion:vortex-file-compressed	116587870 / 118298837 / -1.4%	183259189 / 179802100 / +1.9%	0.64 / 0.66 / -3.3%
clickbench_q14/datafusion:vortex-file-compressed	74649620 / 75087752 / -0.6%	117774592 / 121651377 / -3.2%	0.63 / 0.62 / +2.7%
clickbench_q15/datafusion:vortex-file-compressed	62399276 / 62813857 / -0.7%	96174965 / 96661181 / -0.5%	0.65 / 0.65 / -0.2%
clickbench_q16/datafusion:vortex-file-compressed	150309060 / 154387976 / -2.6%	203540922 / 206161758 / -1.3%	0.74 / 0.75 / -1.4%
clickbench_q17/datafusion:vortex-file-compressed	151104132 / 149078855 / +1.4%	207224394 / 207565326 / -0.2%	0.73 / 0.72 / +1.5%
clickbench_q18/datafusion:vortex-file-compressed	297237430 / 289222644 / +2.8%	363925049 / 373928926 / -2.7%	0.82 / 0.77 / +5.6%
clickbench_q19/datafusion:vortex-file-compressed	7265087 / 7485331 / -2.9%	45858635 / 49109165 / -6.6%	0.16 / 0.15 / +3.9%
clickbench_q20/datafusion:vortex-file-compressed	62261031 / 62092645 / +0.3%	231986397 / 229609953 / +1.0%	0.27 / 0.27 / -0.8%
clickbench_q21/datafusion:vortex-file-compressed	89223614 / 91494594 / -2.5%	275142647 / 270609371 / +1.7%	0.32 / 0.34 / -4.1%
clickbench_q22/datafusion:vortex-file-compressed	100396882 / 100383751 / +0.0%	346521138 / 351562595 / -1.4%	0.29 / 0.29 / +1.5%
clickbench_q23/datafusion:vortex-file-compressed	202449597 / 205693548 / -1.6%	506709605 / 505511067 / +0.2%	0.40 / 0.41 / -1.8%
clickbench_q24/datafusion:vortex-file-compressed	16335867 / 15253974 / +7.1%	62962571 / 65996831 / -4.6%	0.26 / 0.23 / +12.3%
clickbench_q25/datafusion:vortex-file-compressed	17538388 / 18506294 / -5.2%	57070922 / 54804128 / +4.1%	0.31 / 0.34 / -9.0%
clickbench_q26/datafusion:vortex-file-compressed	16326865 / 16688781 / -2.2%	63098435 / 67292385 / -6.2%	0.26 / 0.25 / +4.3%
clickbench_q27/datafusion:vortex-file-compressed	98232091 / 98487868 / -0.3%	247936176 / 243385566 / +1.9%	0.40 / 0.40 / -2.1%
clickbench_q28/datafusion:vortex-file-compressed	568156815 / 556445958 / +2.1%	615522266 / 619085445 / -0.6%	0.92 / 0.90 / +2.7%
clickbench_q29/datafusion:vortex-file-compressed	22698804 / 23064040 / -1.6%	49285370 / 50281653 / -2.0%	0.46 / 0.46 / +0.4%
clickbench_q30/datafusion:vortex-file-compressed	60371368 / 59799745 / +1.0%	104912399 / 114744645 / -8.6%	0.58 / 0.52 / +10.4%
clickbench_q31/datafusion:vortex-file-compressed	71455809 / 70656492 / +1.1%	152235646 / 153506790 / -0.8%	0.47 / 0.46 / +2.0%
clickbench_q32/datafusion:vortex-file-compressed	306898660 / 306659864 / +0.1%	380888475 / 383622501 / -0.7%	0.81 / 0.80 / +0.8%
clickbench_q33/datafusion:vortex-file-compressed	325912576 / 329992304 / -1.2%	418436994 / 427628641 / -2.1%	0.78 / 0.77 / +0.9%
clickbench_q34/datafusion:vortex-file-compressed	329886410 / 334806094 / -1.5%	423730625 / 430018120 / -1.5%	0.78 / 0.78 / -0.0%
clickbench_q35/datafusion:vortex-file-compressed	58417189 / 56152755 / +4.0%	89361474 / 87378026 / +2.3%	0.65 / 0.64 / +1.7%
clickbench_q36/datafusion:vortex-file-compressed	37731354 / 37349106 / +1.0%	65683825 / 68313977 / -3.9%	0.57 / 0.55 / +5.1%
clickbench_q37/datafusion:vortex-file-compressed	21861440 / 21549032 / +1.4%	48827257 / 47034826 / +3.8%	0.45 / 0.46 / -2.3%
clickbench_q38/datafusion:vortex-file-compressed	11600614 / 11805372 / -1.7%	39179925 / 38664714 / +1.3%	0.30 / 0.31 / -3.0%
clickbench_q39/datafusion:vortex-file-compressed	78249912 / 77849546 / +0.5%	109774714 / 110643902 / -0.8%	0.71 / 0.70 / +1.3%
clickbench_q40/datafusion:vortex-file-compressed	11242938 / 11069158 / +1.6%	37317368 / 37722999 / -1.1%	0.30 / 0.29 / +2.7%
clickbench_q41/datafusion:vortex-file-compressed	10535476 / 10655151 / -1.1%	35888477 / 37035701 / -3.1%	0.29 / 0.29 / +2.0%
clickbench_q42/datafusion:vortex-file-compressed	11232502 / 10548982 / +6.5%	35802077 / 35601991 / +0.6%	0.31 / 0.30 / +5.9%

datafusion / vortex-compact / ns (0.994x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact	1225944 / 1264757 / -3.1%	19944928 / 20835129 / -4.3%	0.06 / 0.06 / +1.3%
clickbench_q01/datafusion:vortex-compact	6757066 / 7270979 / -7.1%	29418049 / 34667844 / -15.1% 🟢	0.23 / 0.21 / +9.5%
clickbench_q02/datafusion:vortex-compact	19364527 / 19126004 / +1.2%	41436671 / 42468381 / -2.4%	0.47 / 0.45 / +3.8%
clickbench_q03/datafusion:vortex-compact	14083163 / 14532889 / -3.1%	38530474 / 39577252 / -2.6%	0.37 / 0.37 / -0.5%
clickbench_q04/datafusion:vortex-compact	57695993 / 57361276 / +0.6%	91843678 / 87472313 / +5.0%	0.63 / 0.66 / -4.2%
clickbench_q05/datafusion:vortex-compact	84501114 / 86394783 / -2.2%	120709029 / 123259763 / -2.1%	0.70 / 0.70 / -0.1%
clickbench_q06/datafusion:vortex-compact	1230350 / 1258594 / -2.2%	20091991 / 21207117 / -5.3%	0.06 / 0.06 / +3.2%
clickbench_q07/datafusion:vortex-compact	11833152 / 12280658 / -3.6%	34417421 / 35252975 / -2.4%	0.34 / 0.35 / -1.3%
clickbench_q08/datafusion:vortex-compact	84482419 / 86826820 / -2.7%	114561438 / 116544833 / -1.7%	0.74 / 0.75 / -1.0%
clickbench_q09/datafusion:vortex-compact	188114434 / 189322409 / -0.6%	214941251 / 223744545 / -3.9%	0.88 / 0.85 / +3.4%
clickbench_q10/datafusion:vortex-compact	43537405 / 42418788 / +2.6%	69523308 / 70250332 / -1.0%	0.63 / 0.60 / +3.7%
clickbench_q11/datafusion:vortex-compact	54879897 / 54850324 / +0.1%	81034820 / 83650913 / -3.1%	0.68 / 0.66 / +3.3%
clickbench_q12/datafusion:vortex-compact	86173465 / 86635847 / -0.5%	118702984 / 123615863 / -4.0%	0.73 / 0.70 / +3.6%
clickbench_q13/datafusion:vortex-compact	139774201 / 133211878 / +4.9%	182279454 / 183245947 / -0.5%	0.77 / 0.73 / +5.5%
clickbench_q14/datafusion:vortex-compact	92557870 / 92030903 / +0.6%	133067624 / 123261437 / +8.0%	0.70 / 0.75 / -6.8%
clickbench_q15/datafusion:vortex-compact	63195026 / 61691303 / +2.4%	96986529 / 96573315 / +0.4%	0.65 / 0.64 / +2.0%
clickbench_q16/datafusion:vortex-compact	163338797 / 168129998 / -2.8%	215058842 / 210871069 / +2.0%	0.76 / 0.80 / -4.7%
clickbench_q17/datafusion:vortex-compact	160172196 / 165714201 / -3.3%	214133162 / 216037779 / -0.9%	0.75 / 0.77 / -2.5%
clickbench_q18/datafusion:vortex-compact	303519032 / 298490361 / +1.7%	377379914 / 377220563 / +0.0%	0.80 / 0.79 / +1.6%
clickbench_q19/datafusion:vortex-compact	9677214 / 10860296 / -10.9% 🟢	37750017 / 38522526 / -2.0%	0.26 / 0.28 / -9.1%
clickbench_q20/datafusion:vortex-compact	71154712 / 71292700 / -0.2%	192440422 / 187863556 / +2.4%	0.37 / 0.38 / -2.6%
clickbench_q21/datafusion:vortex-compact	115455552 / 115381981 / +0.1%	228810173 / 228669709 / +0.1%	0.50 / 0.50 / +0.0%
clickbench_q22/datafusion:vortex-compact	182355306 / 182561174 / -0.1%	272246175 / 273921477 / -0.6%	0.67 / 0.67 / +0.5%
clickbench_q23/datafusion:vortex-compact	542691750 / 533612080 / +1.7%	634252149 / 621820168 / +2.0%	0.86 / 0.86 / -0.3%
clickbench_q24/datafusion:vortex-compact	27739791 / 27838780 / -0.4%	59420414 / 59947647 / -0.9%	0.47 / 0.46 / +0.5%
clickbench_q25/datafusion:vortex-compact	34941934 / 35693098 / -2.1%	67534195 / 65977862 / +2.4%	0.52 / 0.54 / -4.4%
clickbench_q26/datafusion:vortex-compact	30015550 / 28265428 / +6.2%	62996209 / 65156310 / -3.3%	0.48 / 0.43 / +9.8%
clickbench_q27/datafusion:vortex-compact	101811583 / 105120410 / -3.1%	210954737 / 209104821 / +0.9%	0.48 / 0.50 / -4.0%
clickbench_q28/datafusion:vortex-compact	613192018 / 577123054 / +6.2%	619600593 / 619876500 / -0.0%	0.99 / 0.93 / +6.3%
clickbench_q29/datafusion:vortex-compact	30953113 / 31364110 / -1.3%	55137063 / 55756952 / -1.1%	0.56 / 0.56 / -0.2%
clickbench_q30/datafusion:vortex-compact	89810968 / 90484715 / -0.7%	126612456 / 127957197 / -1.1%	0.71 / 0.71 / +0.3%
clickbench_q31/datafusion:vortex-compact	97738858 / 97920440 / -0.2%	148019744 / 152119973 / -2.7%	0.66 / 0.64 / +2.6%
clickbench_q32/datafusion:vortex-compact	303173918 / 307004276 / -1.2%	381508700 / 388874616 / -1.9%	0.79 / 0.79 / +0.7%
clickbench_q33/datafusion:vortex-compact	337489124 / 345411384 / -2.3%	419858885 / 428681726 / -2.1%	0.80 / 0.81 / -0.2%
clickbench_q34/datafusion:vortex-compact	342418296 / 341582143 / +0.2%	427706520 / 416858727 / +2.6%	0.80 / 0.82 / -2.3%
clickbench_q35/datafusion:vortex-compact	61951537 / 62962244 / -1.6%	89543026 / 88918401 / +0.7%	0.69 / 0.71 / -2.3%
clickbench_q36/datafusion:vortex-compact	38051853 / 38399937 / -0.9%	66136578 / 69006510 / -4.2%	0.58 / 0.56 / +3.4%
clickbench_q37/datafusion:vortex-compact	22504799 / 22366359 / +0.6%	48263162 / 47563643 / +1.5%	0.47 / 0.47 / -0.8%
clickbench_q38/datafusion:vortex-compact	12611020 / 12791883 / -1.4%	38972504 / 42372548 / -8.0%	0.32 / 0.30 / +7.2%
clickbench_q39/datafusion:vortex-compact	78982964 / 78875446 / +0.1%	109276798 / 111815021 / -2.3%	0.72 / 0.71 / +2.5%
clickbench_q40/datafusion:vortex-compact	12502142 / 12106618 / +3.3%	36026363 / 38154955 / -5.6%	0.35 / 0.32 / +9.4%
clickbench_q41/datafusion:vortex-compact	13016590 / 13029095 / -0.1%	36731242 / 39100158 / -6.1%	0.35 / 0.33 / +6.3%
clickbench_q42/datafusion:vortex-compact	11290958 / 11236861 / +0.5%	34631112 / 36993992 / -6.4%	0.33 / 0.30 / +7.3%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1248490 / 1246776 / +0.1%	49878993 / 49336414 / +1.1%	0.03 / 0.03 / -1.0%
clickbench_q01/datafusion:parquet	15685598 / 16172428 / -3.0%	68819622 / 73633348 / -6.5%	0.23 / 0.22 / +3.8%
clickbench_q02/datafusion:parquet	18989110 / 18780916 / +1.1%	84231504 / 82895359 / +1.6%	0.23 / 0.23 / -0.5%
clickbench_q03/datafusion:parquet	17132838 / 16917730 / +1.3%	79396041 / 80338774 / -1.2%	0.22 / 0.21 / +2.5%
clickbench_q04/datafusion:parquet	61977557 / 63469636 / -2.4%	127299091 / 131261060 / -3.0%	0.49 / 0.48 / +0.7%
clickbench_q05/datafusion:parquet	88978025 / 88869340 / +0.1%	159745077 / 159179632 / +0.4%	0.56 / 0.56 / -0.2%
clickbench_q06/datafusion:parquet	1271228 / 1251228 / +1.6%	49557116 / 49011052 / +1.1%	0.03 / 0.03 / +0.5%
clickbench_q07/datafusion:parquet	16802502 / 16398582 / +2.5%	70027242 / 67649366 / +3.5%	0.24 / 0.24 / -1.0%
clickbench_q08/datafusion:parquet	87588490 / 87369378 / +0.3%	160617952 / 158593046 / +1.3%	0.55 / 0.55 / -1.0%
clickbench_q09/datafusion:parquet	188704600 / 194768455 / -3.1%	268119641 / 274668162 / -2.4%	0.70 / 0.71 / -0.7%
clickbench_q10/datafusion:parquet	37552992 / 35609617 / +5.5%	101645403 / 101647670 / -0.0%	0.37 / 0.35 / +5.5%
clickbench_q11/datafusion:parquet	43251574 / 42384122 / +2.0%	108827781 / 108594271 / +0.2%	0.40 / 0.39 / +1.8%
clickbench_q12/datafusion:parquet	95623463 / 97025792 / -1.4%	162954678 / 161368070 / +1.0%	0.59 / 0.60 / -2.4%
clickbench_q13/datafusion:parquet	150526622 / 147597825 / +2.0%	231470783 / 230229949 / +0.5%	0.65 / 0.64 / +1.4%
clickbench_q14/datafusion:parquet	102035035 / 103102797 / -1.0%	176391268 / 174818345 / +0.9%	0.58 / 0.59 / -1.9%
clickbench_q15/datafusion:parquet	70425472 / 70453571 / -0.0%	135491062 / 133698324 / +1.3%	0.52 / 0.53 / -1.4%
clickbench_q16/datafusion:parquet	155891897 / 156633776 / -0.5%	241745256 / 239490833 / +0.9%	0.64 / 0.65 / -1.4%
clickbench_q17/datafusion:parquet	156721008 / 156506036 / +0.1%	240930055 / 240237281 / +0.3%	0.65 / 0.65 / -0.2%
clickbench_q18/datafusion:parquet	317234225 / 321834657 / -1.4%	424276347 / 421197573 / +0.7%	0.75 / 0.76 / -2.1%
clickbench_q19/datafusion:parquet	19257826 / 18637768 / +3.3%	77752627 / 77279516 / +0.6%	0.25 / 0.24 / +2.7%
clickbench_q20/datafusion:parquet	178465876 / 178272432 / +0.1%	281701223 / 283075172 / -0.5%	0.63 / 0.63 / +0.6%
clickbench_q21/datafusion:parquet	173463557 / 174676102 / -0.7%	292584310 / 301285331 / -2.9%	0.59 / 0.58 / +2.3%
clickbench_q22/datafusion:parquet	260645918 / 263319876 / -1.0%	416529356 / 428888932 / -2.9%	0.63 / 0.61 / +1.9%
clickbench_q23/datafusion:parquet	1124281880 / 1162606140 / -3.3%	1230996544 / 1241680444 / -0.9%	0.91 / 0.94 / -2.5%
clickbench_q24/datafusion:parquet	30026276 / 30338424 / -1.0%	87799750 / 88258849 / -0.5%	0.34 / 0.34 / -0.5%
clickbench_q25/datafusion:parquet	36895556 / 37143150 / -0.7%	101655035 / 103155402 / -1.5%	0.36 / 0.36 / +0.8%
clickbench_q26/datafusion:parquet	30400840 / 30843256 / -1.4%	89071180 / 90424119 / -1.5%	0.34 / 0.34 / +0.1%
clickbench_q27/datafusion:parquet	193289318 / 194083806 / -0.4%	287706534 / 288514011 / -0.3%	0.67 / 0.67 / -0.1%
clickbench_q28/datafusion:parquet	626759739 / 624581030 / +0.3%	695405294 / 707160817 / -1.7%	0.90 / 0.88 / +2.0%
clickbench_q29/datafusion:parquet	29150745 / 30098915 / -3.2%	94419013 / 93396870 / +1.1%	0.31 / 0.32 / -4.2%
clickbench_q30/datafusion:parquet	90915032 / 91082617 / -0.2%	171514264 / 173443591 / -1.1%	0.53 / 0.53 / +0.9%
clickbench_q31/datafusion:parquet	103944926 / 104164124 / -0.2%	190621008 / 198402170 / -3.9%	0.55 / 0.53 / +3.9%
clickbench_q32/datafusion:parquet	327485158 / 322433506 / +1.6%	425579593 / 431829065 / -1.4%	0.77 / 0.75 / +3.1%
clickbench_q33/datafusion:parquet	389494122 / 384228850 / +1.4%	476573100 / 481600866 / -1.0%	0.82 / 0.80 / +2.4%
clickbench_q34/datafusion:parquet	381644918 / 383328088 / -0.4%	478353280 / 483818075 / -1.1%	0.80 / 0.79 / +0.7%
clickbench_q35/datafusion:parquet	65643158 / 64184238 / +2.3%	125363842 / 123511942 / +1.5%	0.52 / 0.52 / +0.8%
clickbench_q36/datafusion:parquet	73608158 / 73706382 / -0.1%	135698845 / 139542614 / -2.8%	0.54 / 0.53 / +2.7%
clickbench_q37/datafusion:parquet	35041202 / 35341280 / -0.8%	92836992 / 92595482 / +0.3%	0.38 / 0.38 / -1.1%
clickbench_q38/datafusion:parquet	47887077 / 47417205 / +1.0%	107632414 / 107550125 / +0.1%	0.44 / 0.44 / +0.9%
clickbench_q39/datafusion:parquet	143800196 / 143609022 / +0.1%	206861454 / 209436118 / -1.2%	0.70 / 0.69 / +1.4%
clickbench_q40/datafusion:parquet	19797691 / 20176276 / -1.9%	77751411 / 79916677 / -2.7%	0.25 / 0.25 / +0.9%
clickbench_q41/datafusion:parquet	19016448 / 19049308 / -0.2%	77828740 / 75194894 / +3.5%	0.24 / 0.25 / -3.6%
clickbench_q42/datafusion:parquet	18988490 / 19159339 / -0.9%	76028411 / 74335985 / +2.3%	0.25 / 0.26 / -3.1%

duckdb / vortex-file-compressed / ns (1.013x ➖, 2↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1789326 / 1602167 / +11.7% 🔴	29459939 / 24865305 / +18.5% 🔴	0.06 / 0.06 / -5.7%
clickbench_q01/duckdb:vortex-file-compressed	12050730 / 12343424 / -2.4%	31799265 / 32503736 / -2.2%	0.38 / 0.38 / -0.2%
clickbench_q02/duckdb:vortex-file-compressed	16229722 / 16104702 / +0.8%	30778828 / 33838129 / -9.0%	0.53 / 0.48 / +10.8%
clickbench_q03/duckdb:vortex-file-compressed	17126710 / 18111714 / -5.4%	44373358 / 54330980 / -18.3% 🟢	0.39 / 0.33 / +15.8%
clickbench_q04/duckdb:vortex-file-compressed	73763968 / 69688739 / +5.8%	101755433 / 107360127 / -5.2%	0.72 / 0.65 / +11.7%
clickbench_q05/duckdb:vortex-file-compressed	68750861 / 68305408 / +0.7%	96703728 / 95938206 / +0.8%	0.71 / 0.71 / -0.1%
clickbench_q06/duckdb:vortex-file-compressed	1998734 / 1803926 / +10.8% 🔴	28009409 / 30310366 / -7.6%	0.07 / 0.06 / +19.9%
clickbench_q07/duckdb:vortex-file-compressed	15530406 / 13885798 / +11.8% 🔴	32867522 / 35709542 / -8.0%	0.47 / 0.39 / +21.5%
clickbench_q08/duckdb:vortex-file-compressed	88879421 / 82359588 / +7.9%	124041596 / 139106665 / -10.8% 🟢	0.72 / 0.59 / +21.0%
clickbench_q09/duckdb:vortex-file-compressed	108259384 / 106017609 / +2.1%	149605312 / 149722410 / -0.1%	0.72 / 0.71 / +2.2%
clickbench_q10/duckdb:vortex-file-compressed	32545073 / 32414147 / +0.4%	67975421 / 72823966 / -6.7%	0.48 / 0.45 / +7.6%
clickbench_q11/duckdb:vortex-file-compressed	35494542 / 35160969 / +0.9%	67705409 / 76608194 / -11.6% 🟢	0.52 / 0.46 / +14.2%
clickbench_q12/duckdb:vortex-file-compressed	73913222 / 73870868 / +0.1%	107333873 / 113217655 / -5.2%	0.69 / 0.65 / +5.5%
clickbench_q13/duckdb:vortex-file-compressed	132571594 / 149616472 / -11.4% 🟢	189628545 / 182417631 / +4.0%	0.70 / 0.82 / -14.8%
clickbench_q14/duckdb:vortex-file-compressed	79538696 / 78216799 / +1.7%	108685044 / 112504445 / -3.4%	0.73 / 0.70 / +5.3%
clickbench_q15/duckdb:vortex-file-compressed	92487796 / 91394136 / +1.2%	129728200 / 132741883 / -2.3%	0.71 / 0.69 / +3.5%
clickbench_q16/duckdb:vortex-file-compressed	158613944 / 160654220 / -1.3%	207273512 / 227132312 / -8.7%	0.77 / 0.71 / +8.2%
clickbench_q17/duckdb:vortex-file-compressed	167964842 / 162510210 / +3.4%	208712383 / 218980028 / -4.7%	0.80 / 0.74 / +8.4%
clickbench_q18/duckdb:vortex-file-compressed	314367511 / 309357820 / +1.6%	374721875 / 374260166 / +0.1%	0.84 / 0.83 / +1.5%
clickbench_q19/duckdb:vortex-file-compressed	17355665 / 19164806 / -9.4%	40870039 / 44134522 / -7.4%	0.42 / 0.43 / -2.2%
clickbench_q20/duckdb:vortex-file-compressed	110249680 / 107970751 / +2.1%	185952898 / 197779759 / -6.0%	0.59 / 0.55 / +8.6%
clickbench_q21/duckdb:vortex-file-compressed	156187655 / 153823554 / +1.5%	287497945 / 295825772 / -2.8%	0.54 / 0.52 / +4.5%
clickbench_q22/duckdb:vortex-file-compressed	233122201 / 229362672 / +1.6%	424742367 / 463727846 / -8.4%	0.55 / 0.49 / +11.0%
clickbench_q23/duckdb:vortex-file-compressed	60801666 / 58116978 / +4.6%	106298691 / 105331726 / +0.9%	0.57 / 0.55 / +3.7%
clickbench_q24/duckdb:vortex-file-compressed	25521278 / 26130275 / -2.3%	45451882 / 41256959 / +10.2% 🔴	0.56 / 0.63 / -11.3%
clickbench_q25/duckdb:vortex-file-compressed	34569102 / 33517666 / +3.1%	55348964 / 57205162 / -3.2%	0.62 / 0.59 / +6.6%
clickbench_q26/duckdb:vortex-file-compressed	19093937 / 20952184 / -8.9%	40869168 / 33917847 / +20.5% 🔴	0.47 / 0.62 / -24.4%
clickbench_q27/duckdb:vortex-file-compressed	134762103 / 133394614 / +1.0%	246946314 / 248020914 / -0.4%	0.55 / 0.54 / +1.5%
clickbench_q28/duckdb:vortex-file-compressed	586555325 / 703717243 / -16.6% 🟢	658321727 / 672164657 / -2.1%	0.89 / 1.05 / -14.9%
clickbench_q29/duckdb:vortex-file-compressed	20151714 / 18794000 / +7.2%	35958985 / 40540446 / -11.3% 🟢	0.56 / 0.46 / +20.9%
clickbench_q30/duckdb:vortex-file-compressed	68674776 / 64026865 / +7.3%	105966948 / 114045073 / -7.1%	0.65 / 0.56 / +15.4%
clickbench_q31/duckdb:vortex-file-compressed	125190998 / 124575404 / +0.5%	197082264 / 205954148 / -4.3%	0.64 / 0.60 / +5.0%
clickbench_q32/duckdb:vortex-file-compressed	458728234 / 433812882 / +5.7%	484421782 / 494540969 / -2.0%	0.95 / 0.88 / +8.0%
clickbench_q33/duckdb:vortex-file-compressed	406398039 / 400371944 / +1.5%	509730914 / 516493934 / -1.3%	0.80 / 0.78 / +2.9%
clickbench_q34/duckdb:vortex-file-compressed	419893975 / 405746239 / +3.5%	517864668 / 537320573 / -3.6%	0.81 / 0.76 / +7.4%
clickbench_q35/duckdb:vortex-file-compressed	103579720 / 102064107 / +1.5%	136971259 / 143856349 / -4.8%	0.76 / 0.71 / +6.6%
clickbench_q36/duckdb:vortex-file-compressed	15318196 / 16171533 / -5.3%	32835352 / 31694631 / +3.6%	0.47 / 0.51 / -8.6%
clickbench_q37/duckdb:vortex-file-compressed	12775138 / 10972335 / +16.4% 🔴	27990175 / 26756069 / +4.6%	0.46 / 0.41 / +11.3%
clickbench_q38/duckdb:vortex-file-compressed	13217075 / 12897344 / +2.5%	29544845 / 28566657 / +3.4%	0.45 / 0.45 / -0.9%
clickbench_q39/duckdb:vortex-file-compressed	24027402 / 23872278 / +0.6%	39762331 / 39219917 / +1.4%	0.60 / 0.61 / -0.7%
clickbench_q40/duckdb:vortex-file-compressed	10796890 / 11902640 / -9.3%	27314545 / 28372144 / -3.7%	0.40 / 0.42 / -5.8%
clickbench_q41/duckdb:vortex-file-compressed	12318598 / 11532932 / +6.8%	28223226 / 27832264 / +1.4%	0.44 / 0.41 / +5.3%
clickbench_q42/duckdb:vortex-file-compressed	12824544 / 11817298 / +8.5%	31106789 / 31691239 / -1.8%	0.41 / 0.37 / +10.6%

duckdb / vortex-compact / ns (1.012x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact	1766541 / 1543942 / +14.4% 🔴	26440431 / 27033531 / -2.2%	0.07 / 0.06 / +17.0%
clickbench_q01/duckdb:vortex-compact	13965814 / 12881888 / +8.4%	31774787 / 31688804 / +0.3%	0.44 / 0.41 / +8.1%
clickbench_q02/duckdb:vortex-compact	20026996 / 18835292 / +6.3%	39928695 / 39886951 / +0.1%	0.50 / 0.47 / +6.2%
clickbench_q03/duckdb:vortex-compact	19575322 / 20027458 / -2.3%	48552431 / 50796086 / -4.4%	0.40 / 0.39 / +2.3%
clickbench_q04/duckdb:vortex-compact	75073414 / 72239982 / +3.9%	105040629 / 109629569 / -4.2%	0.71 / 0.66 / +8.5%
clickbench_q05/duckdb:vortex-compact	79605736 / 77700180 / +2.5%	105365700 / 111661917 / -5.6%	0.76 / 0.70 / +8.6%
clickbench_q06/duckdb:vortex-compact	2006898 / 1836603 / +9.3%	29837268 / 28996098 / +2.9%	0.07 / 0.06 / +6.2%
clickbench_q07/duckdb:vortex-compact	14941998 / 16218552 / -7.9%	31484601 / 32911463 / -4.3%	0.47 / 0.49 / -3.7%
clickbench_q08/duckdb:vortex-compact	96942568 / 95180538 / +1.9%	133420628 / 136914457 / -2.6%	0.73 / 0.70 / +4.5%
clickbench_q09/duckdb:vortex-compact	145491320 / 143441094 / +1.4%	178922216 / 185583284 / -3.6%	0.81 / 0.77 / +5.2%
clickbench_q10/duckdb:vortex-compact	52136146 / 51839140 / +0.6%	88486063 / 91673330 / -3.5%	0.59 / 0.57 / +4.2%
clickbench_q11/duckdb:vortex-compact	65923483 / 65650898 / +0.4%	101705446 / 102683820 / -1.0%	0.65 / 0.64 / +1.4%
clickbench_q12/duckdb:vortex-compact	86095299 / 85513302 / +0.7%	120060367 / 119634791 / +0.4%	0.72 / 0.71 / +0.3%
clickbench_q13/duckdb:vortex-compact	161198694 / 163326362 / -1.3%	224952265 / 211439005 / +6.4%	0.72 / 0.77 / -7.2%
clickbench_q14/duckdb:vortex-compact	95374714 / 97351322 / -2.0%	139256576 / 129177359 / +7.8%	0.68 / 0.75 / -9.1%
clickbench_q15/duckdb:vortex-compact	94839210 / 95551247 / -0.7%	130968703 / 154174239 / -15.1% 🟢	0.72 / 0.62 / +16.8%
clickbench_q16/duckdb:vortex-compact	177077180 / 178603566 / -0.9%	225212844 / 227182281 / -0.9%	0.79 / 0.79 / +0.0%
clickbench_q17/duckdb:vortex-compact	179674077 / 183958830 / -2.3%	222900982 / 224399840 / -0.7%	0.81 / 0.82 / -1.7%
clickbench_q18/duckdb:vortex-compact	336327226 / 327872986 / +2.6%	383152692 / 380823019 / +0.6%	0.88 / 0.86 / +2.0%
clickbench_q19/duckdb:vortex-compact	16632240 / 16750086 / -0.7%	36517997 / 40335202 / -9.5%	0.46 / 0.42 / +9.7%
clickbench_q20/duckdb:vortex-compact	106019884 / 113028728 / -6.2%	171402661 / 178867301 / -4.2%	0.62 / 0.63 / -2.1%
clickbench_q21/duckdb:vortex-compact	174749476 / 169910744 / +2.8%	298397339 / 321635889 / -7.2%	0.59 / 0.53 / +10.9%
clickbench_q22/duckdb:vortex-compact	337669758 / 343852392 / -1.8%	487314211 / 561038668 / -13.1% 🟢	0.69 / 0.61 / +13.1%
clickbench_q23/duckdb:vortex-compact	94191666 / 94464131 / -0.3%	135227903 / 125734236 / +7.6%	0.70 / 0.75 / -7.3%
clickbench_q24/duckdb:vortex-compact	32889453 / 29931292 / +9.9%	46505912 / 54641505 / -14.9% 🟢	0.71 / 0.55 / +29.1%
clickbench_q25/duckdb:vortex-compact	48192683 / 45759718 / +5.3%	68410673 / 72153071 / -5.2%	0.70 / 0.63 / +11.1%
clickbench_q26/duckdb:vortex-compact	25995905 / 25923524 / +0.3%	43552168 / 37854098 / +15.1% 🔴	0.60 / 0.68 / -12.8%
clickbench_q27/duckdb:vortex-compact	191050560 / 199042172 / -4.0%	293814787 / 312253874 / -5.9%	0.65 / 0.64 / +2.0%
clickbench_q28/duckdb:vortex-compact	590004544 / 575750296 / +2.5%	710662608 / 727371842 / -2.3%	0.83 / 0.79 / +4.9%
clickbench_q29/duckdb:vortex-compact	21892962 / 23113644 / -5.3%	43869953 / 45730816 / -4.1%	0.50 / 0.51 / -1.3%
clickbench_q30/duckdb:vortex-compact	113244039 / 110651836 / +2.3%	150789713 / 152709365 / -1.3%	0.75 / 0.72 / +3.6%
clickbench_q31/duckdb:vortex-compact	173824540 / 174660421 / -0.5%	237293666 / 246677656 / -3.8%	0.73 / 0.71 / +3.5%
clickbench_q32/duckdb:vortex-compact	435872209 / 451819980 / -3.5%	499667097 / 504094124 / -0.9%	0.87 / 0.90 / -2.7%
clickbench_q33/duckdb:vortex-compact	393776049 / 397786415 / -1.0%	490660783 / 536300792 / -8.5%	0.80 / 0.74 / +8.2%
clickbench_q34/duckdb:vortex-compact	404948385 / 409263612 / -1.1%	516427972 / 532736723 / -3.1%	0.78 / 0.77 / +2.1%
clickbench_q35/duckdb:vortex-compact	107875053 / 107590814 / +0.3%	141158774 / 143041068 / -1.3%	0.76 / 0.75 / +1.6%
clickbench_q36/duckdb:vortex-compact	16125172 / 15769884 / +2.3%	33896296 / 31978106 / +6.0%	0.48 / 0.49 / -3.5%
clickbench_q37/duckdb:vortex-compact	15270784 / 14374326 / +6.2%	32597555 / 31309439 / +4.1%	0.47 / 0.46 / +2.0%
clickbench_q38/duckdb:vortex-compact	13610576 / 13685414 / -0.5%	32554476 / 30600225 / +6.4%	0.42 / 0.45 / -6.5%
clickbench_q39/duckdb:vortex-compact	25192854 / 25697392 / -2.0%	42233687 / 41515178 / +1.7%	0.60 / 0.62 / -3.6%
clickbench_q40/duckdb:vortex-compact	13226145 / 11570408 / +14.3% 🔴	30759741 / 29945291 / +2.7%	0.43 / 0.39 / +11.3%
clickbench_q41/duckdb:vortex-compact	12468010 / 11551586 / +7.9%	30341076 / 28131185 / +7.9%	0.41 / 0.41 / +0.1%
clickbench_q42/duckdb:vortex-compact	11410483 / 12067152 / -5.4%	27604016 / 26951683 / +2.4%	0.41 / 0.45 / -7.7%

duckdb / parquet / ns (1.017x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	10978377 / 7497340 / +46.4% 🔴	24629210 / 24387996 / +1.0%	0.45 / 0.31 / +45.0%
clickbench_q01/duckdb:parquet	9645518 / 9328424 / +3.4%	20087095 / 23738670 / -15.4% 🟢	0.48 / 0.39 / +22.2%
clickbench_q02/duckdb:parquet	18077839 / 18472186 / -2.1%	30674011 / 37096799 / -17.3% 🟢	0.59 / 0.50 / +18.4%
clickbench_q03/duckdb:parquet	16377826 / 17229098 / -4.9%	51892660 / 53534347 / -3.1%	0.32 / 0.32 / -1.9%
clickbench_q04/duckdb:parquet	70055388 / 69181517 / +1.3%	92116904 / 93023693 / -1.0%	0.76 / 0.74 / +2.3%
clickbench_q05/duckdb:parquet	82730372 / 78980978 / +4.7%	134549221 / 125916329 / +6.9%	0.61 / 0.63 / -2.0%
clickbench_q06/duckdb:parquet	15046412 / 15159854 / -0.7%	26062339 / 27003037 / -3.5%	0.58 / 0.56 / +2.8%
clickbench_q07/duckdb:parquet	11776948 / 11998744 / -1.8%	22150934 / 21125147 / +4.9%	0.53 / 0.57 / -6.4%
clickbench_q08/duckdb:parquet	84232812 / 82086676 / +2.6%	122342845 / 129860263 / -5.8%	0.69 / 0.63 / +8.9%
clickbench_q09/duckdb:parquet	115999456 / 114578782 / +1.2%	165517283 / 161515766 / +2.5%	0.70 / 0.71 / -1.2%
clickbench_q10/duckdb:parquet	33462322 / 33078434 / +1.2%	66925212 / 70271475 / -4.8%	0.50 / 0.47 / +6.2%
clickbench_q11/duckdb:parquet	37099564 / `3543882` / +4.7%	79724388 / 78391724 / +1.7%	0.47 / 0.45 / +2.9%
clickbench_q12/duckdb:parquet	96248568 / 89167362 / +7.9%	132470631 / 138433699 / -4.3%	0.73 / 0.64 / +12.8%
clickbench_q13/duckdb:parquet	144739537 / 163952704 / -11.7% 🟢	207306938 / 214594787 / -3.4%	0.70 / 0.76 / -8.6%
clickbench_q14/duckdb:parquet	98201923 / 94839228 / +3.5%	139707078 / 137593974 / +1.5%	0.70 / 0.69 / +2.0%
clickbench_q15/duckdb:parquet	94086384 / 95538673 / -1.5%	121345021 / 119529014 / +1.5%	0.78 / 0.80 / -3.0%
clickbench_q16/duckdb:parquet	172359918 / 169259432 / +1.8%	233729874 / 225445776 / +3.7%	0.74 / 0.75 / -1.8%
clickbench_q17/duckdb:parquet	172620168 / 181183350 / -4.7%	226621318 / 230962493 / -1.9%	0.76 / 0.78 / -2.9%
clickbench_q18/duckdb:parquet	327784478 / 325031856 / +0.8%	409587314 / 409889694 / -0.1%	0.80 / 0.79 / +0.9%
clickbench_q19/duckdb:parquet	13354251 / 13732542 / -2.8%	41678175 / 42448957 / -1.8%	0.32 / 0.32 / -1.0%
clickbench_q20/duckdb:parquet	132590714 / 132086518 / +0.4%	246211208 / 244027030 / +0.9%	0.54 / 0.54 / -0.5%
clickbench_q21/duckdb:parquet	187137694 / 177372227 / +5.5%	325177868 / 321456487 / +1.2%	0.58 / 0.55 / +4.3%
clickbench_q22/duckdb:parquet	240340138 / 250768749 / -4.2%	405714642 / 414376384 / -2.1%	0.59 / 0.61 / -2.1%
clickbench_q23/duckdb:parquet	149330460 / 146467337 / +2.0%	165595655 / 189531176 / -12.6% 🟢	0.90 / 0.77 / +16.7%
clickbench_q24/duckdb:parquet	45002040 / 42629458 / +5.6%	58589163 / 61446284 / -4.6%	0.77 / 0.69 / +10.7%
clickbench_q25/duckdb:parquet	39827818 / 39453094 / +0.9%	86149620 / 89993593 / -4.3%	0.46 / 0.44 / +5.5%
clickbench_q26/duckdb:parquet	29673448 / 28194628 / +5.2%	48109448 / 46623031 / +3.2%	0.62 / 0.60 / +2.0%
clickbench_q27/duckdb:parquet	146051579 / 141594691 / +3.1%	260242892 / 257542698 / +1.0%	0.56 / 0.55 / +2.1%
clickbench_q28/duckdb:parquet	901332514 / 900069478 / +0.1%	982491527 / 1001717829 / -1.9%	0.92 / 0.90 / +2.1%
clickbench_q29/duckdb:parquet	17494944 / 17000958 / +2.9%	30428013 / 33607072 / -9.5%	0.57 / 0.51 / +13.7%
clickbench_q30/duckdb:parquet	91599688 / 90083677 / +1.7%	173614446 / 175757756 / -1.2%	0.53 / 0.51 / +2.9%
clickbench_q31/duckdb:parquet	143392080 / 148295174 / -3.3%	287195654 / 299428151 / -4.1%	0.50 / 0.50 / +0.8%
clickbench_q32/duckdb:parquet	454452198 / 434236960 / +4.7%	543332707 / 514668898 / +5.6%	0.84 / 0.84 / -0.9%
clickbench_q33/duckdb:parquet	452021858 / 449269774 / +0.6%	482104176 / 463483291 / +4.0%	0.94 / 0.97 / -3.3%
clickbench_q34/duckdb:parquet	449643056 / 447551666 / +0.5%	543445628 / 478094856 / +13.7% 🔴	0.83 / 0.94 / -11.6%
clickbench_q35/duckdb:parquet	101147850 / 100271729 / +0.9%	129993652 / 120718401 / +7.7%	0.78 / 0.83 / -6.3%
clickbench_q36/duckdb:parquet	30748462 / 31051560 / -1.0%	41330196 / 40883626 / +1.1%	0.74 / 0.76 / -2.0%
clickbench_q37/duckdb:parquet	23008104 / 23047898 / -0.2%	31395700 / 32340853 / -2.9%	0.73 / 0.71 / +2.8%
clickbench_q38/duckdb:parquet	23792632 / 23820682 / -0.1%	34451227 / 33542194 / +2.7%	0.69 / 0.71 / -2.8%
clickbench_q39/duckdb:parquet	56280436 / 56731940 / -0.8%	66300926 / 65846813 / +0.7%	0.85 / 0.86 / -1.5%
clickbench_q40/duckdb:parquet	12887107 / 12308416 / +4.7%	22522014 / 22638742 / -0.5%	0.57 / 0.54 / +5.2%
clickbench_q41/duckdb:parquet	13165580 / 12463424 / +5.6%	23974104 / 23833804 / +0.6%	0.55 / 0.52 / +5.0%
clickbench_q42/duckdb:parquet	14710838 / 14738264 / -0.2%	24861114 / 23643236 / +5.2%	0.59 / 0.62 / -5.1%

No file size changes detected.

github-actions · 2026-10-09T14:25:03Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 1ee71320 vs base 34148020
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	24157596 / 24308420 / -0.6%	43021029 / 43961273 / -2.1%	0.56 / 0.55 / +1.6%
tpcds_q02/datafusion:vortex-file-compressed	45755663 / 45129960 / +1.4%	61210926 / 62013481 / -1.3%	0.75 / 0.73 / +2.7%
tpcds_q03/datafusion:vortex-file-compressed	11445470 / 11935788 / -4.1%	29088842 / 29781922 / -2.3%	0.39 / 0.40 / -1.8%
tpcds_q04/datafusion:vortex-file-compressed	112087824 / 113990870 / -1.7%	144618850 / 141377980 / +2.3%	0.78 / 0.81 / -3.9%
tpcds_q05/datafusion:vortex-file-compressed	60407042 / 61045371 / -1.0%	82335666 / 81600612 / +0.9%	0.73 / 0.75 / -1.9%
tpcds_q06/datafusion:vortex-file-compressed	23466570 / 23643974 / -0.8%	46383801 / 46053197 / +0.7%	0.51 / 0.51 / -1.5%
tpcds_q07/datafusion:vortex-file-compressed	32622768 / 32544945 / +0.2%	56384856 / 56021735 / +0.6%	0.58 / 0.58 / -0.4%
tpcds_q08/datafusion:vortex-file-compressed	25588723 / 25316850 / +1.1%	44330307 / 45290477 / -2.1%	0.58 / 0.56 / +3.3%
tpcds_q09/datafusion:vortex-file-compressed	17211434 / 16836153 / +2.2%	33286258 / 35044545 / -5.0%	0.52 / 0.48 / +7.6%
tpcds_q10/datafusion:vortex-file-compressed	28746449 / 28780463 / -0.1%	50265988 / 50271901 / -0.0%	0.57 / 0.57 / -0.1%
tpcds_q11/datafusion:vortex-file-compressed	62225516 / 62507240 / -0.5%	91265446 / 90895661 / +0.4%	0.68 / 0.69 / -0.9%
tpcds_q12/datafusion:vortex-file-compressed	16236462 / 16298223 / -0.4%	33217552 / 33453011 / -0.7%	0.49 / 0.49 / +0.3%
tpcds_q13/datafusion:vortex-file-compressed	33339526 / 34083777 / -2.2%	53040619 / 53668769 / -1.2%	0.63 / 0.64 / -1.0%
tpcds_q14/datafusion:vortex-file-compressed	91216182 / 90438206 / +0.9%	121023631 / 118512375 / +2.1%	0.75 / 0.76 / -1.2%
tpcds_q15/datafusion:vortex-file-compressed	23864626 / 23911894 / -0.2%	43900119 / 42587001 / +3.1%	0.54 / 0.56 / -3.2%
tpcds_q16/datafusion:vortex-file-compressed	20725358 / 20232078 / +2.4%	42157404 / 41402969 / +1.8%	0.49 / 0.49 / +0.6%
tpcds_q17/datafusion:vortex-file-compressed	61944917 / 54841480 / +13.0% 🔴	85019168 / 76902431 / +10.6% 🔴	0.73 / 0.71 / +2.2%
tpcds_q18/datafusion:vortex-file-compressed	67719370 / 68375798 / -1.0%	95978448 / 94387208 / +1.7%	0.71 / 0.72 / -2.6%
tpcds_q19/datafusion:vortex-file-compressed	18698263 / 18301818 / +2.2%	40868907 / 39974143 / +2.2%	0.46 / 0.46 / -0.1%
tpcds_q20/datafusion:vortex-file-compressed	17938218 / 17820776 / +0.7%	35601541 / 34704636 / +2.6%	0.50 / 0.51 / -1.9%
tpcds_q21/datafusion:vortex-file-compressed	16727211 / 17621681 / -5.1%	39950548 / 36661774 / +9.0%	0.42 / 0.48 / -12.9%
tpcds_q22/datafusion:vortex-file-compressed	50185846 / 49655366 / +1.1%	71939062 / 73131694 / -1.6%	0.70 / 0.68 / +2.7%
tpcds_q23/datafusion:vortex-file-compressed	71940005 / 72899011 / -1.3%	97379387 / 103633713 / -6.0%	0.74 / 0.70 / +5.0%
tpcds_q24/datafusion:vortex-file-compressed	70412510 / 70259348 / +0.2%	95049326 / 93497947 / +1.7%	0.74 / 0.75 / -1.4%
tpcds_q25/datafusion:vortex-file-compressed	55705542 / 52587946 / +5.9%	81023293 / 75836444 / +6.8%	0.69 / 0.69 / -0.9%
tpcds_q26/datafusion:vortex-file-compressed	30227330 / 30076208 / +0.5%	50218213 / 52462345 / -4.3%	0.60 / 0.57 / +5.0%
tpcds_q27/datafusion:vortex-file-compressed	62214686 / 63916270 / -2.7%	91505277 / 87216560 / +4.9%	0.68 / 0.73 / -7.2%
tpcds_q28/datafusion:vortex-file-compressed	17750638 / 18080482 / -1.8%	37474607 / 37833906 / -0.9%	0.47 / 0.48 / -0.9%
tpcds_q29/datafusion:vortex-file-compressed	56613646 / 60968778 / -7.1%	84233248 / 85801047 / -1.8%	0.67 / 0.71 / -5.4%
tpcds_q30/datafusion:vortex-file-compressed	27283383 / 27616129 / -1.2%	45864990 / 46100776 / -0.5%	0.59 / 0.60 / -0.7%
tpcds_q31/datafusion:vortex-file-compressed	64217017 / 64246192 / -0.0%	91212108 / 92608831 / -1.5%	0.70 / 0.69 / +1.5%
tpcds_q32/datafusion:vortex-file-compressed	13781092 / 13516789 / +2.0%	31424069 / 31132760 / +0.9%	0.44 / 0.43 / +1.0%
tpcds_q33/datafusion:vortex-file-compressed	27291248 / 27146494 / +0.5%	49155839 / 48706020 / +0.9%	0.56 / 0.56 / -0.4%
tpcds_q34/datafusion:vortex-file-compressed	18506196 / 18462389 / +0.2%	38357023 / 40420215 / -5.1%	0.48 / 0.46 / +5.6%
tpcds_q35/datafusion:vortex-file-compressed	35840428 / 36371036 / -1.5%	58830483 / 59046182 / -0.4%	0.61 / 0.62 / -1.1%
tpcds_q36/datafusion:vortex-file-compressed	49331844 / 47684811 / +3.5%	73981233 / 72283409 / +2.3%	0.67 / 0.66 / +1.1%
tpcds_q37/datafusion:vortex-file-compressed	13070714 / 13751083 / -4.9%	35067186 / 34810762 / +0.7%	0.37 / 0.40 / -5.6%
tpcds_q38/datafusion:vortex-file-compressed	29558113 / 30081235 / -1.7%	53451316 / 51928583 / +2.9%	0.55 / 0.58 / -4.5%
tpcds_q39/datafusion:vortex-file-compressed	65403074 / 65154822 / +0.4%	93708225 / 90090172 / +4.0%	0.70 / 0.72 / -3.5%
tpcds_q40/datafusion:vortex-file-compressed	24791418 / 25449264 / -2.6%	45819110 / 45376749 / +1.0%	0.54 / 0.56 / -3.5%
tpcds_q41/datafusion:vortex-file-compressed	17042910 / 16326771 / +4.4%	31030642 / 31343762 / -1.0%	0.55 / 0.52 / +5.4%
tpcds_q42/datafusion:vortex-file-compressed	11211608 / 11242254 / -0.3%	28162107 / 27684848 / +1.7%	0.40 / 0.41 / -2.0%
tpcds_q43/datafusion:vortex-file-compressed	13586915 / 13498259 / +0.7%	32881920 / 32768672 / +0.3%	0.41 / 0.41 / +0.3%
tpcds_q44/datafusion:vortex-file-compressed	26128611 / 25998635 / +0.5%	51397149 / 51875262 / -0.9%	0.51 / 0.50 / +1.4%
tpcds_q45/datafusion:vortex-file-compressed	27626806 / 27548402 / +0.3%	47453915 / 47130057 / +0.7%	0.58 / 0.58 / -0.4%
tpcds_q46/datafusion:vortex-file-compressed	24475397 / 24511333 / -0.1%	49924585 / 47685686 / +4.7%	0.49 / 0.51 / -4.6%
tpcds_q47/datafusion:vortex-file-compressed	77801573 / 77710568 / +0.1%	105422860 / 106179263 / -0.7%	0.74 / 0.73 / +0.8%
tpcds_q48/datafusion:vortex-file-compressed	31538352 / 31138370 / +1.3%	53028794 / 52942285 / +0.2%	0.59 / 0.59 / +1.1%
tpcds_q49/datafusion:vortex-file-compressed	60123460 / 59859250 / +0.4%	92069903 / 83544104 / +10.2% 🔴	0.65 / 0.72 / -8.9%
tpcds_q50/datafusion:vortex-file-compressed	34445939 / 33921614 / +1.5%	54616272 / 54965327 / -0.6%	0.63 / 0.62 / +2.2%
tpcds_q51/datafusion:vortex-file-compressed	61626546 / 60801348 / +1.4%	83882788 / 84575904 / -0.8%	0.73 / 0.72 / +2.2%
tpcds_q52/datafusion:vortex-file-compressed	11947883 / 11761445 / +1.6%	29387589 / 28613014 / +2.7%	0.41 / 0.41 / -1.1%
tpcds_q53/datafusion:vortex-file-compressed	18197662 / 18449520 / -1.4%	37436062 / 37935978 / -1.3%	0.49 / 0.49 / -0.0%
tpcds_q54/datafusion:vortex-file-compressed	33681706 / 33589135 / +0.3%	58505943 / 59518608 / -1.7%	0.58 / 0.56 / +2.0%
tpcds_q55/datafusion:vortex-file-compressed	11546358 / 11420086 / +1.1%	28366213 / 27330550 / +3.8%	0.41 / 0.42 / -2.6%
tpcds_q56/datafusion:vortex-file-compressed	26731906 / 27151697 / -1.5%	48725783 / 48312172 / +0.9%	0.55 / 0.56 / -2.4%
tpcds_q57/datafusion:vortex-file-compressed	73224356 / 73255364 / -0.0%	97924718 / 97524601 / +0.4%	0.75 / 0.75 / -0.5%
tpcds_q58/datafusion:vortex-file-compressed	40398665 / 41363545 / -2.3%	68899765 / 67650171 / +1.8%	0.59 / 0.61 / -4.1%
tpcds_q59/datafusion:vortex-file-compressed	31842466 / 32327596 / -1.5%	55255566 / 53850144 / +2.6%	0.58 / 0.60 / -4.0%
tpcds_q60/datafusion:vortex-file-compressed	26575407 / 26843584 / -1.0%	48479918 / 47789865 / +1.4%	0.55 / 0.56 / -2.4%
tpcds_q61/datafusion:vortex-file-compressed	24252838 / 23686946 / +2.4%	47755518 / 48415995 / -1.4%	0.51 / 0.49 / +3.8%
tpcds_q62/datafusion:vortex-file-compressed	17434816 / 17307414 / +0.7%	35691065 / 35482831 / +0.6%	0.49 / 0.49 / +0.1%
tpcds_q63/datafusion:vortex-file-compressed	18558258 / 18100328 / +2.5%	37821971 / 38284523 / -1.2%	0.49 / 0.47 / +3.8%
tpcds_q64/datafusion:vortex-file-compressed	323107926 / 321627906 / +0.5%	353665106 / 355928949 / -0.6%	0.91 / 0.90 / +1.1%
tpcds_q65/datafusion:vortex-file-compressed	75377304 / 76454913 / -1.4%	95931403 / 94983266 / +1.0%	0.79 / 0.80 / -2.4%
tpcds_q66/datafusion:vortex-file-compressed	52913963 / 52883256 / +0.1%	75863388 / 74308733 / +2.1%	0.70 / 0.71 / -2.0%
tpcds_q67/datafusion:vortex-file-compressed	56103001 / 55539758 / +1.0%	85804637 / 84341873 / +1.7%	0.65 / 0.66 / -0.7%
tpcds_q68/datafusion:vortex-file-compressed	23983456 / 24609498 / -2.5%	49483298 / 48609536 / +1.8%	0.48 / 0.51 / -4.3%
tpcds_q69/datafusion:vortex-file-compressed	28483416 / 28483064 / +0.0%	49388172 / 51673256 / -4.4%	0.58 / 0.55 / +4.6%
tpcds_q70/datafusion:vortex-file-compressed	71308624 / 72141970 / -1.2%	93018403 / 92925123 / +0.1%	0.77 / 0.78 / -1.3%
tpcds_q71/datafusion:vortex-file-compressed	18786656 / 19276522 / -2.5%	38552238 / 39864900 / -3.3%	0.49 / 0.48 / +0.8%
tpcds_q72/datafusion:vortex-file-compressed	460967798 / 467683233 / -1.4%	501351470 / 509802548 / -1.7%	0.92 / 0.92 / +0.2%
tpcds_q73/datafusion:vortex-file-compressed	17431151 / 17100861 / +1.9%	38688397 / 37480442 / +3.2%	0.45 / 0.46 / -1.3%
tpcds_q74/datafusion:vortex-file-compressed	46107804 / 45587426 / +1.1%	70302079 / 69949570 / +0.5%	0.66 / 0.65 / +0.6%
tpcds_q75/datafusion:vortex-file-compressed	132472940 / 129620466 / +2.2%	161847019 / 163692521 / -1.1%	0.82 / 0.79 / +3.4%
tpcds_q76/datafusion:vortex-file-compressed	42465246 / 43852497 / -3.2%	65108696 / 63791558 / +2.1%	0.65 / 0.69 / -5.1%
tpcds_q77/datafusion:vortex-file-compressed	34806318 / 34979262 / -0.5%	59671991 / 61666565 / -3.2%	0.58 / 0.57 / +2.8%
tpcds_q78/datafusion:vortex-file-compressed	80046142 / 80061496 / -0.0%	110978188 / 110176273 / +0.7%	0.72 / 0.73 / -0.7%
tpcds_q79/datafusion:vortex-file-compressed	21158384 / 20751121 / +2.0%	43213837 / 42480787 / +1.7%	0.49 / 0.49 / +0.2%
tpcds_q80/datafusion:vortex-file-compressed	76891332 / 77310794 / -0.5%	111027676 / 107990296 / +2.8%	0.69 / 0.72 / -3.3%
tpcds_q81/datafusion:vortex-file-compressed	27342277 / 28075724 / -2.6%	45070143 / 45523544 / -1.0%	0.61 / 0.62 / -1.6%
tpcds_q82/datafusion:vortex-file-compressed	14223692 / 13143444 / +8.2%	35824541 / 35240564 / +1.7%	0.40 / 0.37 / +6.5%
tpcds_q83/datafusion:vortex-file-compressed	36050091 / 35889410 / +0.4%	59090419 / 57663286 / +2.5%	0.61 / 0.62 / -2.0%
tpcds_q84/datafusion:vortex-file-compressed	11939446 / 11563820 / +3.2%	29126622 / 27492206 / +5.9%	0.41 / 0.42 / -2.5%
tpcds_q85/datafusion:vortex-file-compressed	59674810 / 58973058 / +1.2%	82845230 / 84326857 / -1.8%	0.72 / 0.70 / +3.0%
tpcds_q86/datafusion:vortex-file-compressed	16467544 / 16520852 / -0.3%	32371490 / 32712196 / -1.0%	0.51 / 0.51 / +0.7%
tpcds_q87/datafusion:vortex-file-compressed	29262700 / 29391188 / -0.4%	53588435 / 52560597 / +2.0%	0.55 / 0.56 / -2.3%
tpcds_q88/datafusion:vortex-file-compressed	34609770 / 34260684 / +1.0%	62593524 / 64548359 / -3.0%	0.55 / 0.53 / +4.2%
tpcds_q89/datafusion:vortex-file-compressed	21351412 / 21207886 / +0.7%	40563840 / 40555314 / +0.0%	0.53 / 0.52 / +0.7%
tpcds_q90/datafusion:vortex-file-compressed	10586606 / 10503626 / +0.8%	27499900 / 26386276 / +4.2%	0.38 / 0.40 / -3.3%
tpcds_q91/datafusion:vortex-file-compressed	16830406 / 16640914 / +1.1%	37363838 / 35729290 / +4.6%	0.45 / 0.47 / -3.3%
tpcds_q92/datafusion:vortex-file-compressed	13506273 / 13838404 / -2.4%	31486170 / 31926834 / -1.4%	0.43 / 0.43 / -1.0%
tpcds_q93/datafusion:vortex-file-compressed	23663514 / 24022678 / -1.5%	44255903 / 44933468 / -1.5%	0.53 / 0.53 / +0.0%
tpcds_q94/datafusion:vortex-file-compressed	19294361 / 19590342 / -1.5%	40029147 / 39169978 / +2.2%	0.48 / 0.50 / -3.6%
tpcds_q95/datafusion:vortex-file-compressed	45830002 / 45579698 / +0.5%	68165897 / 68028029 / +0.2%	0.67 / 0.67 / +0.3%
tpcds_q96/datafusion:vortex-file-compressed	9326342 / 9311932 / +0.2%	26076439 / 25932812 / +0.6%	0.36 / 0.36 / -0.4%
tpcds_q97/datafusion:vortex-file-compressed	21551613 / 21168344 / +1.8%	43817095 / 44559742 / -1.7%	0.49 / 0.48 / +3.5%
tpcds_q98/datafusion:vortex-file-compressed	16670706 / 17011347 / -2.0%	36275188 / 37533627 / -3.4%	0.46 / 0.45 / +1.4%
tpcds_q99/datafusion:vortex-file-compressed	19379570 / 19248134 / +0.7%	38105148 / 37394026 / +1.9%	0.51 / 0.51 / -1.2%

datafusion / vortex-compact / ns (1.001x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	25898061 / 25831616 / +0.3%	45517024 / 44569420 / +2.1%	0.57 / 0.58 / -1.8%
tpcds_q02/datafusion:vortex-compact	48741854 / 48501324 / +0.5%	64868548 / 65666268 / -1.2%	0.75 / 0.74 / +1.7%
tpcds_q03/datafusion:vortex-compact	13079868 / 12747753 / +2.6%	31863788 / 32758531 / -2.7%	0.41 / 0.39 / +5.5%
tpcds_q04/datafusion:vortex-compact	122220042 / 125258930 / -2.4%	157733069 / 147479065 / +7.0%	0.77 / 0.85 / -8.8%
tpcds_q05/datafusion:vortex-compact	61355424 / 62468812 / -1.8%	83413541 / 84738923 / -1.6%	0.74 / 0.74 / -0.2%
tpcds_q06/datafusion:vortex-compact	26393016 / 26275448 / +0.4%	46269852 / 46457952 / -0.4%	0.57 / 0.57 / +0.9%
tpcds_q07/datafusion:vortex-compact	35528146 / 36114260 / -1.6%	56935734 / 58672724 / -3.0%	0.62 / 0.62 / +1.4%
tpcds_q08/datafusion:vortex-compact	30679482 / 30620939 / +0.2%	49671370 / 48328387 / +2.8%	0.62 / 0.63 / -2.5%
tpcds_q09/datafusion:vortex-compact	21922924 / 22015536 / -0.4%	38992876 / 41313558 / -5.6%	0.56 / 0.53 / +5.5%
tpcds_q10/datafusion:vortex-compact	38538914 / 37398766 / +3.0%	61460305 / 62361612 / -1.4%	0.63 / 0.60 / +4.6%
tpcds_q11/datafusion:vortex-compact	67691527 / 67650210 / +0.1%	92667133 / 94172707 / -1.6%	0.73 / 0.72 / +1.7%
tpcds_q12/datafusion:vortex-compact	20908146 / 20679734 / +1.1%	40371217 / 38719728 / +4.3%	0.52 / 0.53 / -3.0%
tpcds_q13/datafusion:vortex-compact	55291394 / 54959236 / +0.6%	74485955 / 73458397 / +1.4%	0.74 / 0.75 / -0.8%
tpcds_q14/datafusion:vortex-compact	96126790 / 95460786 / +0.7%	121308101 / 124955513 / -2.9%	0.79 / 0.76 / +3.7%
tpcds_q15/datafusion:vortex-compact	26775864 / 27228312 / -1.7%	47339896 / 45294546 / +4.5%	0.57 / 0.60 / -5.9%
tpcds_q16/datafusion:vortex-compact	25473954 / 24025186 / +6.0%	46917659 / 44668097 / +5.0%	0.54 / 0.54 / +0.9%
tpcds_q17/datafusion:vortex-compact	60609946 / 62950443 / -3.7%	92038390 / 84344336 / +9.1%	0.66 / 0.75 / -11.8%
tpcds_q18/datafusion:vortex-compact	69072623 / 68878340 / +0.3%	93347816 / 92153610 / +1.3%	0.74 / 0.75 / -1.0%
tpcds_q19/datafusion:vortex-compact	23392044 / 21614802 / +8.2%	43711487 / 44608306 / -2.0%	0.54 / 0.48 / +10.4%
tpcds_q20/datafusion:vortex-compact	22975192 / 22086914 / +4.0%	42538835 / 42015272 / +1.2%	0.54 / 0.53 / +2.7%
tpcds_q21/datafusion:vortex-compact	18454446 / 17944017 / +2.8%	42649953 / 42264998 / +0.9%	0.43 / 0.42 / +1.9%
tpcds_q22/datafusion:vortex-compact	49336374 / 49919270 / -1.2%	75171245 / 72871187 / +3.2%	0.66 / 0.69 / -4.2%
tpcds_q23/datafusion:vortex-compact	75619263 / 78155416 / -3.2%	107210996 / 109370394 / -2.0%	0.71 / 0.71 / -1.3%
tpcds_q24/datafusion:vortex-compact	77605805 / 78590767 / -1.3%	101606319 / 101903784 / -0.3%	0.76 / 0.77 / -1.0%
tpcds_q25/datafusion:vortex-compact	63312202 / 62380916 / +1.5%	80003443 / 80942572 / -1.2%	0.79 / 0.77 / +2.7%
tpcds_q26/datafusion:vortex-compact	32620662 / 32752200 / -0.4%	52038168 / 52188251 / -0.3%	0.63 / 0.63 / -0.1%
tpcds_q27/datafusion:vortex-compact	63218128 / 61962029 / +2.0%	87681058 / 87775337 / -0.1%	0.72 / 0.71 / +2.1%
tpcds_q28/datafusion:vortex-compact	27309749 / 26969857 / +1.3%	47198287 / 48536772 / -2.8%	0.58 / 0.56 / +4.1%
tpcds_q29/datafusion:vortex-compact	67683163 / 67997746 / -0.5%	90963952 / 91463416 / -0.5%	0.74 / 0.74 / +0.1%
tpcds_q30/datafusion:vortex-compact	30649879 / 30985474 / -1.1%	48977635 / 49810897 / -1.7%	0.63 / 0.62 / +0.6%
tpcds_q31/datafusion:vortex-compact	76611636 / 75572834 / +1.4%	104379495 / 104108979 / +0.3%	0.73 / 0.73 / +1.1%
tpcds_q32/datafusion:vortex-compact	16172666 / 16480502 / -1.9%	35879509 / 36427499 / -1.5%	0.45 / 0.45 / -0.4%
tpcds_q33/datafusion:vortex-compact	27966094 / 28808074 / -2.9%	50753401 / 53543290 / -5.2%	0.55 / 0.54 / +2.4%
tpcds_q34/datafusion:vortex-compact	21115554 / 22959232 / -8.0%	45512424 / 45186123 / +0.7%	0.46 / 0.51 / -8.7%
tpcds_q35/datafusion:vortex-compact	42643348 / 41190666 / +3.5%	64979154 / 66969110 / -3.0%	0.66 / 0.62 / +6.7%
tpcds_q36/datafusion:vortex-compact	51339838 / 51008993 / +0.6%	74325360 / 75537561 / -1.6%	0.69 / 0.68 / +2.3%
tpcds_q37/datafusion:vortex-compact	15595752 / 15520587 / +0.5%	38668716 / 40980799 / -5.6%	0.40 / 0.38 / +6.5%
tpcds_q38/datafusion:vortex-compact	34577970 / 34666140 / -0.3%	55817301 / 55064051 / +1.4%	0.62 / 0.63 / -1.6%
tpcds_q39/datafusion:vortex-compact	67432708 / 67027164 / +0.6%	89995625 / 89517650 / +0.5%	0.75 / 0.75 / +0.1%
tpcds_q40/datafusion:vortex-compact	27677877 / 27771708 / -0.3%	50946277 / 50197763 / +1.5%	0.54 / 0.55 / -1.8%
tpcds_q41/datafusion:vortex-compact	18790180 / 18277684 / +2.8%	32816905 / 33159141 / -1.0%	0.57 / 0.55 / +3.9%
tpcds_q42/datafusion:vortex-compact	12843174 / 12548681 / +2.3%	32623347 / 32474700 / +0.5%	0.39 / 0.39 / +1.9%
tpcds_q43/datafusion:vortex-compact	16315232 / 15481622 / +5.4%	34352719 / 33364457 / +3.0%	0.47 / 0.46 / +2.4%
tpcds_q44/datafusion:vortex-compact	30572478 / 31057792 / -1.6%	53722577 / 55161811 / -2.6%	0.57 / 0.56 / +1.1%
tpcds_q45/datafusion:vortex-compact	30808064 / 30798311 / +0.0%	51170281 / 50555058 / +1.2%	0.60 / 0.61 / -1.2%
tpcds_q46/datafusion:vortex-compact	28366506 / 28114898 / +0.9%	50301523 / 53389219 / -5.8%	0.56 / 0.53 / +7.1%
tpcds_q47/datafusion:vortex-compact	88754237 / 89057370 / -0.3%	117340824 / 120198423 / -2.4%	0.76 / 0.74 / +2.1%
tpcds_q48/datafusion:vortex-compact	51071534 / 49797904 / +2.6%	68836827 / 69370243 / -0.8%	0.74 / 0.72 / +3.4%
tpcds_q49/datafusion:vortex-compact	65858139 / 64696458 / +1.8%	89986899 / 89418072 / +0.6%	0.73 / 0.72 / +1.2%
tpcds_q50/datafusion:vortex-compact	36419340 / 37033499 / -1.7%	56997634 / 55204651 / +3.2%	0.64 / 0.67 / -4.8%
tpcds_q51/datafusion:vortex-compact	63420579 / 62872640 / +0.9%	84290809 / 87216549 / -3.4%	0.75 / 0.72 / +4.4%
tpcds_q52/datafusion:vortex-compact	13140119 / 12833879 / +2.4%	33011197 / 32033119 / +3.1%	0.40 / 0.40 / -0.6%
tpcds_q53/datafusion:vortex-compact	23535882 / 22550008 / +4.4%	42628670 / 41554778 / +2.6%	0.55 / 0.54 / +1.7%
tpcds_q54/datafusion:vortex-compact	40882016 / 41202917 / -0.8%	67865063 / 65867574 / +3.0%	0.60 / 0.63 / -3.7%
tpcds_q55/datafusion:vortex-compact	12847062 / 13252138 / -3.1%	31758367 / 31287380 / +1.5%	0.40 / 0.42 / -4.5%
tpcds_q56/datafusion:vortex-compact	29744209 / 29298507 / +1.5%	50386365 / 49647498 / +1.5%	0.59 / 0.59 / +0.0%
tpcds_q57/datafusion:vortex-compact	80916626 / 80480510 / +0.5%	111774628 / 108723794 / +2.8%	0.72 / 0.74 / -2.2%
tpcds_q58/datafusion:vortex-compact	47650060 / 47465540 / +0.4%	74390037 / 73790610 / +0.8%	0.64 / 0.64 / -0.4%
tpcds_q59/datafusion:vortex-compact	38882818 / 40627222 / -4.3%	62400581 / 61508996 / +1.4%	0.62 / 0.66 / -5.7%
tpcds_q60/datafusion:vortex-compact	28467599 / 29587044 / -3.8%	52316174 / 49468983 / +5.8%	0.54 / 0.60 / -9.0%
tpcds_q61/datafusion:vortex-compact	28507453 / 27055292 / +5.4%	49550731 / 49892090 / -0.7%	0.58 / 0.54 / +6.1%
tpcds_q62/datafusion:vortex-compact	17991251 / 17903521 / +0.5%	36428632 / 35765776 / +1.9%	0.49 / 0.50 / -1.3%
tpcds_q63/datafusion:vortex-compact	23179022 / 22521730 / +2.9%	41410862 / 42710978 / -3.0%	0.56 / 0.53 / +6.1%
tpcds_q64/datafusion:vortex-compact	445097486 / 445075765 / +0.0%	464895373 / 463074390 / +0.4%	0.96 / 0.96 / -0.4%
tpcds_q65/datafusion:vortex-compact	80837342 / 81658482 / -1.0%	98392321 / 102722706 / -4.2%	0.82 / 0.79 / +3.4%
tpcds_q66/datafusion:vortex-compact	55274306 / 55429222 / -0.3%	78074973 / 76697761 / +1.8%	0.71 / 0.72 / -2.0%
tpcds_q67/datafusion:vortex-compact	58739517 / 59216403 / -0.8%	90365730 / 88011908 / +2.7%	0.65 / 0.67 / -3.4%
tpcds_q68/datafusion:vortex-compact	27999015 / 30313402 / -7.6%	55661883 / 50563984 / +10.1% 🔴	0.50 / 0.60 / -16.1%
tpcds_q69/datafusion:vortex-compact	37144632 / 39226116 / -5.3%	58583196 / 57322655 / +2.2%	0.63 / 0.68 / -7.3%
tpcds_q70/datafusion:vortex-compact	73893386 / 75947582 / -2.7%	93828912 / 97909568 / -4.2%	0.79 / 0.78 / +1.5%
tpcds_q71/datafusion:vortex-compact	20222754 / 21020862 / -3.8%	41797254 / 40057329 / +4.3%	0.48 / 0.52 / -7.8%
tpcds_q72/datafusion:vortex-compact	473598808 / 467047640 / +1.4%	494024586 / 531100730 / -7.0%	0.96 / 0.88 / +9.0%
tpcds_q73/datafusion:vortex-compact	19555104 / 19686356 / -0.7%	40675532 / 42965495 / -5.3%	0.48 / 0.46 / +4.9%
tpcds_q74/datafusion:vortex-compact	50691702 / 50498838 / +0.4%	76355853 / 72749757 / +5.0%	0.66 / 0.69 / -4.4%
tpcds_q75/datafusion:vortex-compact	137972830 / 139428344 / -1.0%	161247840 / 161729124 / -0.3%	0.86 / 0.86 / -0.7%
tpcds_q76/datafusion:vortex-compact	41278814 / 41427148 / -0.4%	60444102 / 64646248 / -6.5%	0.68 / 0.64 / +6.6%
tpcds_q77/datafusion:vortex-compact	38115310 / 38436332 / -0.8%	66689363 / 62880938 / +6.1%	0.57 / 0.61 / -6.5%
tpcds_q78/datafusion:vortex-compact	86935129 / 86063285 / +1.0%	112891735 / 111695455 / +1.1%	0.77 / 0.77 / -0.1%
tpcds_q79/datafusion:vortex-compact	24810338 / 24723010 / +0.4%	45562434 / 48055439 / -5.2%	0.54 / 0.51 / +5.8%
tpcds_q80/datafusion:vortex-compact	78491269 / 78839826 / -0.4%	106668901 / 112031790 / -4.8%	0.74 / 0.70 / +4.6%
tpcds_q81/datafusion:vortex-compact	30166877 / 29999794 / +0.6%	48192279 / 46707983 / +3.2%	0.63 / 0.64 / -2.5%
tpcds_q82/datafusion:vortex-compact	15836172 / 15583022 / +1.6%	39660049 / 38785460 / +2.3%	0.40 / 0.40 / -0.6%
tpcds_q83/datafusion:vortex-compact	36544312 / 38550284 / -5.2%	59000510 / 60580213 / -2.6%	0.62 / 0.64 / -2.7%
tpcds_q84/datafusion:vortex-compact	12667992 / 13031166 / -2.8%	28571298 / 29579894 / -3.4%	0.44 / 0.44 / +0.6%
tpcds_q85/datafusion:vortex-compact	103257026 / 102650308 / +0.6%	126013144 / 128472552 / -1.9%	0.82 / 0.80 / +2.6%
tpcds_q86/datafusion:vortex-compact	17254638 / 17401518 / -0.8%	34995637 / 34974627 / +0.1%	0.49 / 0.50 / -0.9%
tpcds_q87/datafusion:vortex-compact	32771811 / 34468418 / -4.9%	57451850 / 57125454 / +0.6%	0.57 / 0.60 / -5.5%
tpcds_q88/datafusion:vortex-compact	41627356 / 41919489 / -0.7%	67724001 / 68940166 / -1.8%	0.61 / 0.61 / +1.1%
tpcds_q89/datafusion:vortex-compact	24859296 / 25482116 / -2.4%	45101743 / 45385253 / -0.6%	0.55 / 0.56 / -1.8%
tpcds_q90/datafusion:vortex-compact	12575360 / 11548644 / +8.9%	26816144 / 26613050 / +0.8%	0.47 / 0.43 / +8.1%
tpcds_q91/datafusion:vortex-compact	27341823 / 27096383 / +0.9%	46121625 / 46294767 / -0.4%	0.59 / 0.59 / +1.3%
tpcds_q92/datafusion:vortex-compact	15458944 / 15558260 / -0.6%	35284127 / 33470932 / +5.4%	0.44 / 0.46 / -5.7%
tpcds_q93/datafusion:vortex-compact	25606942 / 25415483 / +0.8%	45579161 / 44392466 / +2.7%	0.56 / 0.57 / -1.9%
tpcds_q94/datafusion:vortex-compact	22464292 / 22384244 / +0.4%	43318467 / 41401987 / +4.6%	0.52 / 0.54 / -4.1%
tpcds_q95/datafusion:vortex-compact	50669360 / 49972108 / +1.4%	69813544 / 69999971 / -0.3%	0.73 / 0.71 / +1.7%
tpcds_q96/datafusion:vortex-compact	12345191 / 10543464 / +17.1% 🔴	25291676 / 26909988 / -6.0%	0.49 / 0.39 / +24.6%
tpcds_q97/datafusion:vortex-compact	24571588 / 25684311 / -4.3%	45480821 / 48341541 / -5.9%	0.54 / 0.53 / +1.7%
tpcds_q98/datafusion:vortex-compact	22285432 / 22454722 / -0.8%	43044741 / 41934810 / +2.6%	0.52 / 0.54 / -3.3%
tpcds_q99/datafusion:vortex-compact	20870103 / 20848684 / +0.1%	41074018 / 38843178 / +5.7%	0.51 / 0.54 / -5.3%

datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	31755032 / 31235901 / +1.7%	50076457 / 49951942 / +0.2%	0.63 / 0.63 / +1.4%
tpcds_q02/datafusion:parquet	39726288 / 40215778 / -1.2%	59466193 / 59084137 / +0.6%	0.67 / 0.68 / -1.9%
tpcds_q03/datafusion:parquet	16416862 / 16397422 / +0.1%	32602445 / 32503493 / +0.3%	0.50 / 0.50 / -0.2%
tpcds_q04/datafusion:parquet	202915586 / 202420614 / +0.2%	227587895 / 229396235 / -0.8%	0.89 / 0.88 / +1.0%
tpcds_q05/datafusion:parquet	71442366 / 72796252 / -1.9%	101079996 / 99984276 / +1.1%	0.71 / 0.73 / -2.9%
tpcds_q06/datafusion:parquet	28657468 / 28426538 / +0.8%	50687636 / 53226550 / -4.8%	0.57 / 0.53 / +5.9%
tpcds_q07/datafusion:parquet	47112706 / 46654642 / +1.0%	69736756 / 69442913 / +0.4%	0.68 / 0.67 / +0.6%
tpcds_q08/datafusion:parquet	30597482 / 31601983 / -3.2%	50409227 / 51326925 / -1.8%	0.61 / 0.62 / -1.4%
tpcds_q09/datafusion:parquet	29465783 / 29151065 / +1.1%	44148526 / 48791796 / -9.5%	0.67 / 0.60 / +11.7%
tpcds_q10/datafusion:parquet	42293333 / 41222222 / +2.6%	62943553 / 64223791 / -2.0%	0.67 / 0.64 / +4.7%
tpcds_q11/datafusion:parquet	94941994 / 94978331 / -0.0%	119130984 / 117609802 / +1.3%	0.80 / 0.81 / -1.3%
tpcds_q12/datafusion:parquet	21579796 / 22089786 / -2.3%	37373691 / 36554142 / +2.2%	0.58 / 0.60 / -4.5%
tpcds_q13/datafusion:parquet	43058488 / 42529949 / +1.2%	68991934 / 69742596 / -1.1%	0.62 / 0.61 / +2.3%
tpcds_q14/datafusion:parquet	126009938 / 126656484 / -0.5%	149443329 / 153107131 / -2.4%	0.84 / 0.83 / +1.9%
tpcds_q15/datafusion:parquet	32882696 / 32713388 / +0.5%	50767576 / 49995488 / +1.5%	0.65 / 0.65 / -1.0%
tpcds_q16/datafusion:parquet	36860786 / 37014892 / -0.4%	55716402 / 54671467 / +1.9%	0.66 / 0.68 / -2.3%
tpcds_q17/datafusion:parquet	77061691 / 77649990 / -0.8%	104192203 / 103249414 / +0.9%	0.74 / 0.75 / -1.7%
tpcds_q18/datafusion:parquet	61706166 / 58474246 / +5.5%	79324771 / 80360953 / -1.3%	0.78 / 0.73 / +6.9%
tpcds_q19/datafusion:parquet	26121294 / 26407186 / -1.1%	44964412 / 46935686 / -4.2%	0.58 / 0.56 / +3.3%
tpcds_q20/datafusion:parquet	23045506 / 23324650 / -1.2%	39070060 / 37451591 / +4.3%	0.59 / 0.62 / -5.3%
tpcds_q21/datafusion:parquet	17702976 / 18039580 / -1.9%	33525663 / 34166423 / -1.9%	0.53 / 0.53 / +0.0%
tpcds_q22/datafusion:parquet	75055735 / 76077389 / -1.3%	91800011 / 90736203 / +1.2%	0.82 / 0.84 / -2.5%
tpcds_q23/datafusion:parquet	110043402 / 108063612 / +1.8%	138093681 / 140024128 / -1.4%	0.80 / 0.77 / +3.3%
tpcds_q24/datafusion:parquet	95776310 / 95992466 / -0.2%	124797187 / 124354463 / +0.4%	0.77 / 0.77 / -0.6%
tpcds_q25/datafusion:parquet	79902854 / 78508160 / +1.8%	105940466 / 105434907 / +0.5%	0.75 / 0.74 / +1.3%
tpcds_q26/datafusion:parquet	43211763 / 42395977 / +1.9%	64514173 / 65366227 / -1.3%	0.67 / 0.65 / +3.3%
tpcds_q27/datafusion:parquet	72722665 / 76807270 / -5.3%	98899391 / 99582900 / -0.7%	0.74 / 0.77 / -4.7%
tpcds_q28/datafusion:parquet	27447512 / 27476614 / -0.1%	44759089 / 46191084 / -3.1%	0.61 / 0.59 / +3.1%
tpcds_q29/datafusion:parquet	79061029 / 78439696 / +0.8%	107976400 / 105430503 / +2.4%	0.73 / 0.74 / -1.6%
tpcds_q30/datafusion:parquet	45858974 / 43930262 / +4.4%	65363056 / 65323257 / +0.1%	0.70 / 0.67 / +4.3%
tpcds_q31/datafusion:parquet	81053810 / 80414309 / +0.8%	103807370 / 106172248 / -2.2%	0.78 / 0.76 / +3.1%
tpcds_q32/datafusion:parquet	23842372 / 23832074 / +0.0%	42168108 / 41839774 / +0.8%	0.57 / 0.57 / -0.7%
tpcds_q33/datafusion:parquet	33448708 / 33738455 / -0.9%	52010121 / 52589663 / -1.1%	0.64 / 0.64 / +0.2%
tpcds_q34/datafusion:parquet	23938784 / 22945976 / +4.3%	40411639 / 39682305 / +1.8%	0.59 / 0.58 / +2.4%
tpcds_q35/datafusion:parquet	50278747 / 49528682 / +1.5%	70598602 / 69319845 / +1.8%	0.71 / 0.71 / -0.3%
tpcds_q36/datafusion:parquet	52704321 / 53203486 / -0.9%	79909938 / 76102078 / +5.0%	0.66 / 0.70 / -5.7%
tpcds_q37/datafusion:parquet	23088858 / 22803076 / +1.3%	40163706 / 38315600 / +4.8%	0.57 / 0.60 / -3.4%
tpcds_q38/datafusion:parquet	43458434 / 43712091 / -0.6%	66084375 / 64218472 / +2.9%	0.66 / 0.68 / -3.4%
tpcds_q39/datafusion:parquet	72348416 / 72294429 / +0.1%	91300775 / 89798224 / +1.7%	0.79 / 0.81 / -1.6%
tpcds_q40/datafusion:parquet	31218272 / 29416860 / +6.1%	52866633 / 50928908 / +3.8%	0.59 / 0.58 / +2.2%
tpcds_q41/datafusion:parquet	17668102 / 17574184 / +0.5%	30477651 / 30305331 / +0.6%	0.58 / 0.58 / -0.0%
tpcds_q42/datafusion:parquet	15507618 / 15605728 / -0.6%	30328922 / 30244838 / +0.3%	0.51 / 0.52 / -0.9%
tpcds_q43/datafusion:parquet	17582176 / 17348491 / +1.3%	32159392 / 33037809 / -2.7%	0.55 / 0.53 / +4.1%
tpcds_q44/datafusion:parquet	33404033 / 33336840 / +0.2%	53712550 / 53361906 / +0.7%	0.62 / 0.62 / -0.5%
tpcds_q45/datafusion:parquet	37160732 / 37543172 / -1.0%	55541752 / 55542770 / -0.0%	0.67 / 0.68 / -1.0%
tpcds_q46/datafusion:parquet	28943066 / 28866378 / +0.3%	50934246 / 50817038 / +0.2%	0.57 / 0.57 / +0.0%
tpcds_q47/datafusion:parquet	96146467 / 96498104 / -0.4%	124392824 / 125535743 / -0.9%	0.77 / 0.77 / +0.6%
tpcds_q48/datafusion:parquet	38889238 / 37852248 / +2.7%	63191527 / 60808286 / +3.9%	0.62 / 0.62 / -1.1%
tpcds_q49/datafusion:parquet	76244918 / 77184605 / -1.2%	98166989 / 101916914 / -3.7%	0.78 / 0.76 / +2.6%
tpcds_q50/datafusion:parquet	49558398 / 49463299 / +0.2%	73270780 / 71125295 / +3.0%	0.68 / 0.70 / -2.7%
tpcds_q51/datafusion:parquet	67495488 / 66845130 / +1.0%	93161370 / 91853352 / +1.4%	0.72 / 0.73 / -0.4%
tpcds_q52/datafusion:parquet	15811426 / 15947922 / -0.9%	31308508 / 30621342 / +2.2%	0.51 / 0.52 / -3.0%
tpcds_q53/datafusion:parquet	21737798 / 21825564 / -0.4%	39901097 / 38359237 / +4.0%	0.54 / 0.57 / -4.3%
tpcds_q54/datafusion:parquet	44971019 / 45373476 / -0.9%	70139493 / 66890975 / +4.9%	0.64 / 0.68 / -5.5%
tpcds_q55/datafusion:parquet	15611508 / 15291195 / +2.1%	30324320 / 30019109 / +1.0%	0.51 / 0.51 / +1.1%
tpcds_q56/datafusion:parquet	31883022 / 31674254 / +0.7%	58463039 / 55814991 / +4.7%	0.55 / 0.57 / -3.9%
tpcds_q57/datafusion:parquet	98367506 / 99483092 / -1.1%	123547153 / 122168853 / +1.1%	0.80 / 0.81 / -2.2%
tpcds_q58/datafusion:parquet	65005487 / 65950491 / -1.4%	89793903 / 89701927 / +0.1%	0.72 / 0.74 / -1.5%
tpcds_q59/datafusion:parquet	43109858 / 43264724 / -0.4%	64186598 / 63406209 / +1.2%	0.67 / 0.68 / -1.6%
tpcds_q60/datafusion:parquet	31368904 / 32137448 / -2.4%	53825151 / 53160684 / +1.2%	0.58 / 0.60 / -3.6%
tpcds_q61/datafusion:parquet	33961004 / 33725360 / +0.7%	59384869 / 55693057 / +6.6%	0.57 / 0.61 / -5.6%
tpcds_q62/datafusion:parquet	24320144 / 24129950 / +0.8%	39614571 / 39883385 / -0.7%	0.61 / 0.61 / +1.5%
tpcds_q63/datafusion:parquet	22593890 / 22169276 / +1.9%	39528601 / 39488883 / +0.1%	0.57 / 0.56 / +1.8%
tpcds_q64/datafusion:parquet	205109784 / 204460443 / +0.3%	232791635 / 237480051 / -2.0%	0.88 / 0.86 / +2.3%
tpcds_q65/datafusion:parquet	38837250 / 38967293 / -0.3%	58818093 / 59787997 / -1.6%	0.66 / 0.65 / +1.3%
tpcds_q66/datafusion:parquet	62038540 / 61439189 / +1.0%	81107635 / 81966887 / -1.0%	0.76 / 0.75 / +2.0%
tpcds_q67/datafusion:parquet	70218210 / 69904079 / +0.4%	97238840 / 95926362 / +1.4%	0.72 / 0.73 / -0.9%
tpcds_q68/datafusion:parquet	29011550 / 28549860 / +1.6%	52653381 / 51556432 / +2.1%	0.55 / 0.55 / -0.5%
tpcds_q69/datafusion:parquet	40969788 / 41351904 / -0.9%	59298208 / 58839538 / +0.8%	0.69 / 0.70 / -1.7%
tpcds_q70/datafusion:parquet	32501297 / 32237605 / +0.8%	55050611 / 55461972 / -0.7%	0.59 / 0.58 / +1.6%
tpcds_q71/datafusion:parquet	24285678 / 23888678 / +1.7%	38824982 / 41046322 / -5.4%	0.63 / 0.58 / +7.5%
tpcds_q72/datafusion:parquet	547866354 / 542719755 / +0.9%	575014247 / 577396643 / -0.4%	0.95 / 0.94 / +1.4%
tpcds_q73/datafusion:parquet	22950346 / 22156691 / +3.6%	38193993 / 37565130 / +1.7%	0.60 / 0.59 / +1.9%
tpcds_q74/datafusion:parquet	66809070 / 66395856 / +0.6%	87709753 / 89567371 / -2.1%	0.76 / 0.74 / +2.8%
tpcds_q75/datafusion:parquet	146550996 / 145836173 / +0.5%	175355565 / 174815446 / +0.3%	0.84 / 0.83 / +0.2%
tpcds_q76/datafusion:parquet	49102416 / 49138312 / -0.1%	63989085 / 67046769 / -4.6%	0.77 / 0.73 / +4.7%
tpcds_q77/datafusion:parquet	52692598 / 52794304 / -0.2%	76938744 / 76250805 / +0.9%	0.68 / 0.69 / -1.1%
tpcds_q78/datafusion:parquet	93370187 / 93706176 / -0.4%	124099673 / 123725578 / +0.3%	0.75 / 0.76 / -0.7%
tpcds_q79/datafusion:parquet	25984712 / 26057448 / -0.3%	45859288 / 44910178 / +2.1%	0.57 / 0.58 / -2.3%
tpcds_q80/datafusion:parquet	82666226 / 82384431 / +0.3%	115634510 / 112812911 / +2.5%	0.71 / 0.73 / -2.1%
tpcds_q81/datafusion:parquet	38639508 / 38803613 / -0.4%	60479225 / 58584605 / +3.2%	0.64 / 0.66 / -3.5%
tpcds_q82/datafusion:parquet	25763352 / 25394456 / +1.5%	40485001 / 41197627 / -1.7%	0.64 / 0.62 / +3.2%
tpcds_q83/datafusion:parquet	48085574 / 47868859 / +0.5%	69948895 / 68214470 / +2.5%	0.69 / 0.70 / -2.0%
tpcds_q84/datafusion:parquet	29008228 / 30421806 / -4.6%	45988450 / 45834559 / +0.3%	0.63 / 0.66 / -5.0%
tpcds_q85/datafusion:parquet	86193256 / 85499512 / +0.8%	110099490 / 108985812 / +1.0%	0.78 / 0.78 / -0.2%
tpcds_q86/datafusion:parquet	20857356 / 20815572 / +0.2%	34690288 / 33722353 / +2.9%	0.60 / 0.62 / -2.6%
tpcds_q87/datafusion:parquet	42402204 / 42017992 / +0.9%	60818761 / 60512411 / +0.5%	0.70 / 0.69 / +0.4%
tpcds_q88/datafusion:parquet	38281278 / 38508645 / -0.6%	55232086 / 55741592 / -0.9%	0.69 / 0.69 / +0.3%
tpcds_q89/datafusion:parquet	25119394 / 25175310 / -0.2%	42631868 / 42381054 / +0.6%	0.59 / 0.59 / -0.8%
tpcds_q90/datafusion:parquet	15282170 / 15428496 / -0.9%	30715913 / 30883335 / -0.5%	0.50 / 0.50 / -0.4%
tpcds_q91/datafusion:parquet	32342662 / 31892709 / +1.4%	49188637 / 47959403 / +2.6%	0.66 / 0.66 / -1.1%
tpcds_q92/datafusion:parquet	23826744 / 24047972 / -0.9%	41454315 / 41754924 / -0.7%	0.57 / 0.58 / -0.2%
tpcds_q93/datafusion:parquet	27786168 / 28059396 / -1.0%	48900188 / 46148341 / +6.0%	0.57 / 0.61 / -6.5%
tpcds_q94/datafusion:parquet	31659626 / 31569472 / +0.3%	49708777 / 50390490 / -1.4%	0.64 / 0.63 / +1.7%
tpcds_q95/datafusion:parquet	64891688 / 64859498 / +0.0%	82785533 / 81094491 / +2.1%	0.78 / 0.80 / -2.0%
tpcds_q96/datafusion:parquet	13082718 / 12873875 / +1.6%	28622458 / 28139639 / +1.7%	0.46 / 0.46 / -0.1%
tpcds_q97/datafusion:parquet	31812316 / 32347824 / -1.7%	52096143 / 52826834 / -1.4%	0.61 / 0.61 / -0.3%
tpcds_q98/datafusion:parquet	22693604 / 22895845 / -0.9%	40228611 / 39201596 / +2.6%	0.56 / 0.58 / -3.4%
tpcds_q99/datafusion:parquet	28952428 / 28481234 / +1.7%	42391059 / 44013115 / -3.7%	0.68 / 0.65 / +5.5%

duckdb / vortex-file-compressed / ns (0.994x ➖, 4↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15131456 / 15695563 / -3.6%	22705944 / 22129037 / +2.6%	0.67 / 0.71 / -6.0%
tpcds_q02/duckdb:vortex-file-compressed	14821685 / 14814999 / +0.0%	20053566 / 20542008 / -2.4%	0.74 / 0.72 / +2.5%
tpcds_q03/duckdb:vortex-file-compressed	11477866 / 10951406 / +4.8%	22691062 / 19635203 / +15.6% 🔴	0.51 / 0.56 / -9.3%
tpcds_q04/duckdb:vortex-file-compressed	49915852 / 50097049 / -0.4%	61303001 / 59382398 / +3.2%	0.81 / 0.84 / -3.5%
tpcds_q05/duckdb:vortex-file-compressed	18721933 / 18311288 / +2.2%	25023449 / 25679315 / -2.6%	0.75 / 0.71 / +4.9%
tpcds_q06/duckdb:vortex-file-compressed	26568000 / 26537158 / +0.1%	40272061 / 41462270 / -2.9%	0.66 / 0.64 / +3.1%
tpcds_q07/duckdb:vortex-file-compressed	15344113 / 15355139 / -0.1%	28756200 / 29545924 / -2.7%	0.53 / 0.52 / +2.7%
tpcds_q08/duckdb:vortex-file-compressed	18869976 / 18577174 / +1.6%	27726294 / 27378504 / +1.3%	0.68 / 0.68 / +0.3%
tpcds_q09/duckdb:vortex-file-compressed	13308516 / 13682410 / -2.7%	24794185 / 22423499 / +10.6% 🔴	0.54 / 0.61 / -12.0%
tpcds_q10/duckdb:vortex-file-compressed	27305373 / 27422918 / -0.4%	39915448 / 41578376 / -4.0%	0.68 / 0.66 / +3.7%
tpcds_q11/duckdb:vortex-file-compressed	39986756 / 40535210 / -1.4%	50556656 / 50296008 / +0.5%	0.79 / 0.81 / -1.9%
tpcds_q12/duckdb:vortex-file-compressed	10447728 / 10277356 / +1.7%	16102329 / 16067701 / +0.2%	0.65 / 0.64 / +1.4%
tpcds_q13/duckdb:vortex-file-compressed	21540924 / 21381081 / +0.7%	34504187 / 32229461 / +7.1%	0.62 / 0.66 / -5.9%
tpcds_q14/duckdb:vortex-file-compressed	57516162 / 57430962 / +0.1%	72219911 / 73757880 / -2.1%	0.80 / 0.78 / +2.3%
tpcds_q15/duckdb:vortex-file-compressed	20630260 / 20342300 / +1.4%	25271453 / 25588335 / -1.2%	0.82 / 0.79 / +2.7%
tpcds_q16/duckdb:vortex-file-compressed	17926496 / 17584174 / +1.9%	28177124 / 26017141 / +8.3%	0.64 / 0.68 / -5.9%
tpcds_q17/duckdb:vortex-file-compressed	29570271 / 29986913 / -1.4%	45668739 / 46659262 / -2.1%	0.65 / 0.64 / +0.7%
tpcds_q18/duckdb:vortex-file-compressed	28115444 / 27998599 / +0.4%	39463447 / 39329869 / +0.3%	0.71 / 0.71 / +0.1%
tpcds_q19/duckdb:vortex-file-compressed	23330234 / 23628370 / -1.3%	37347429 / 34685610 / +7.7%	0.62 / 0.68 / -8.3%
tpcds_q20/duckdb:vortex-file-compressed	10521704 / 10774670 / -2.3%	15314791 / 15655373 / -2.2%	0.69 / 0.69 / -0.2%
tpcds_q21/duckdb:vortex-file-compressed	9693855 / 9564571 / +1.4%	17501558 / 21540484 / -18.8% 🟢	0.55 / 0.44 / +24.7%
tpcds_q22/duckdb:vortex-file-compressed	29875382 / 33236308 / -10.1% 🟢	38349566 / 39864503 / -3.8%	0.78 / 0.83 / -6.6%
tpcds_q23/duckdb:vortex-file-compressed	36497397 / 37584752 / -2.9%	46868634 / 51164060 / -8.4%	0.78 / 0.73 / +6.0%
tpcds_q24/duckdb:vortex-file-compressed	27908119 / 28231841 / -1.1%	38036698 / 40199725 / -5.4%	0.73 / 0.70 / +4.5%
tpcds_q25/duckdb:vortex-file-compressed	24862113 / 25029853 / -0.7%	40130924 / 42553749 / -5.7%	0.62 / 0.59 / +5.3%
tpcds_q26/duckdb:vortex-file-compressed	13639824 / 13245230 / +3.0%	20674060 / 20707985 / -0.2%	0.66 / 0.64 / +3.1%
tpcds_q27/duckdb:vortex-file-compressed	16829866 / 17375206 / -3.1%	29919473 / 32569278 / -8.1%	0.56 / 0.53 / +5.4%
tpcds_q28/duckdb:vortex-file-compressed	11565381 / 11465731 / +0.9%	19943832 / 20127891 / -0.9%	0.58 / 0.57 / +1.8%
tpcds_q29/duckdb:vortex-file-compressed	28008488 / 28795002 / -2.7%	44674131 / 45822675 / -2.5%	0.63 / 0.63 / -0.2%
tpcds_q30/duckdb:vortex-file-compressed	18846290 / 19323278 / -2.5%	27199740 / 28288293 / -3.8%	0.69 / 0.68 / +1.4%
tpcds_q31/duckdb:vortex-file-compressed	19058778 / 19296440 / -1.2%	26326981 / 26740908 / -1.5%	0.72 / 0.72 / +0.3%
tpcds_q32/duckdb:vortex-file-compressed	9733750 / 9725042 / +0.1%	19154308 / 15833653 / +21.0% 🔴	0.51 / 0.61 / -17.3%
tpcds_q33/duckdb:vortex-file-compressed	16847570 / 16884924 / -0.2%	27856662 / 28959345 / -3.8%	0.60 / 0.58 / +3.7%
tpcds_q34/duckdb:vortex-file-compressed	15460036 / 15535462 / -0.5%	21630446 / 21965455 / -1.5%	0.71 / 0.71 / +1.1%
tpcds_q35/duckdb:vortex-file-compressed	46017819 / 45635660 / +0.8%	58347436 / 60137868 / -3.0%	0.79 / 0.76 / +3.9%
tpcds_q36/duckdb:vortex-file-compressed	15213460 / 14795788 / +2.8%	28957334 / 27866020 / +3.9%	0.53 / 0.53 / -1.1%
tpcds_q37/duckdb:vortex-file-compressed	13749661 / 13740869 / +0.1%	22997963 / 21785709 / +5.6%	0.60 / 0.63 / -5.2%
tpcds_q38/duckdb:vortex-file-compressed	22038942 / 22131733 / -0.4%	28627057 / 28736429 / -0.4%	0.77 / 0.77 / -0.0%
tpcds_q39/duckdb:vortex-file-compressed	22019460 / 18138034 / +21.4% 🔴	27854329 / 28281516 / -1.5%	0.79 / 0.64 / +23.3%
tpcds_q40/duckdb:vortex-file-compressed	13068353 / 12995356 / +0.6%	18185899 / 18226715 / -0.2%	0.72 / 0.71 / +0.8%
tpcds_q41/duckdb:vortex-file-compressed	6141778 / 6198455 / -0.9%	12345841 / 9084851 / +35.9% 🔴	0.50 / 0.68 / -27.1%
tpcds_q42/duckdb:vortex-file-compressed	8181782 / 8569912 / -4.5%	20738677 / 19589332 / +5.9%	0.39 / 0.44 / -9.8%
tpcds_q43/duckdb:vortex-file-compressed	10057284 / 10005232 / +0.5%	18579900 / 18414055 / +0.9%	0.54 / 0.54 / -0.4%
tpcds_q44/duckdb:vortex-file-compressed	15618064 / 15132708 / +3.2%	25694601 / 27928609 / -8.0%	0.61 / 0.54 / +12.2%
tpcds_q45/duckdb:vortex-file-compressed	22115136 / 22170136 / -0.2%	28282055 / 30339590 / -6.8%	0.78 / 0.73 / +7.0%
tpcds_q46/duckdb:vortex-file-compressed	18552923 / 18376730 / +1.0%	29769929 / 32824331 / -9.3%	0.62 / 0.56 / +11.3%
tpcds_q47/duckdb:vortex-file-compressed	30711500 / 32079099 / -4.3%	42258677 / 42298882 / -0.1%	0.73 / 0.76 / -4.2%
tpcds_q48/duckdb:vortex-file-compressed	20506874 / 19023472 / +7.8%	35349930 / 31209866 / +13.3% 🔴	0.58 / 0.61 / -4.8%
tpcds_q49/duckdb:vortex-file-compressed	16813363 / 17462280 / -3.7%	29312108 / 35685291 / -17.9% 🟢	0.57 / 0.49 / +17.2%
tpcds_q50/duckdb:vortex-file-compressed	16468418 / 16342806 / +0.8%	27473068 / 27457801 / +0.1%	0.60 / 0.60 / +0.7%
tpcds_q51/duckdb:vortex-file-compressed	76279362 / 77174762 / -1.2%	62224470 / 62097899 / +0.2%	1.23 / 1.24 / -1.4%
tpcds_q52/duckdb:vortex-file-compressed	8301332 / 8233256 / +0.8%	21366073 / 20952407 / +2.0%	0.39 / 0.39 / -1.1%
tpcds_q53/duckdb:vortex-file-compressed	14359175 / 14048312 / +2.2%	24801932 / 24857377 / -0.2%	0.58 / 0.57 / +2.4%
tpcds_q54/duckdb:vortex-file-compressed	19996106 / 20378856 / -1.9%	28894069 / 28933293 / -0.1%	0.69 / 0.70 / -1.7%
tpcds_q55/duckdb:vortex-file-compressed	8107146 / 10515423 / -22.9% 🟢	17871850 / 17659313 / +1.2%	0.45 / 0.60 / -23.8%
tpcds_q56/duckdb:vortex-file-compressed	16969062 / 16824997 / +0.9%	30416073 / 28307089 / +7.5%	0.56 / 0.59 / -6.1%
tpcds_q57/duckdb:vortex-file-compressed	24131951 / 24381714 / -1.0%	31242825 / 31308145 / -0.2%	0.77 / 0.78 / -0.8%
tpcds_q58/duckdb:vortex-file-compressed	17607380 / 17663152 / -0.3%	29850225 / 29026470 / +2.8%	0.59 / 0.61 / -3.1%
tpcds_q59/duckdb:vortex-file-compressed	18986236 / 18360598 / +3.4%	24772621 / 25848775 / -4.2%	0.77 / 0.71 / +7.9%
tpcds_q60/duckdb:vortex-file-compressed	17970308 / 17804333 / +0.9%	29392138 / 29919345 / -1.8%	0.61 / 0.60 / +2.7%
tpcds_q61/duckdb:vortex-file-compressed	19144156 / 19813056 / -3.4%	30821116 / 32713923 / -5.8%	0.62 / 0.61 / +2.6%
tpcds_q62/duckdb:vortex-file-compressed	10138568 / 9934040 / +2.1%	15903781 / 15579952 / +2.1%	0.64 / 0.64 / -0.0%
tpcds_q63/duckdb:vortex-file-compressed	13037264 / 14641444 / -11.0% 🟢	23173792 / 23330011 / -0.7%	0.56 / 0.63 / -10.4%
tpcds_q64/duckdb:vortex-file-compressed	63967863 / 62185296 / +2.9%	83951645 / 78644813 / +6.7%	0.76 / 0.79 / -3.6%
tpcds_q65/duckdb:vortex-file-compressed	16168534 / 15229080 / +6.2%	31300001 / 28698746 / +9.1%	0.52 / 0.53 / -2.7%
tpcds_q66/duckdb:vortex-file-compressed	20688267 / 21239990 / -2.6%	33257528 / 32153300 / +3.4%	0.62 / 0.66 / -5.8%
tpcds_q67/duckdb:vortex-file-compressed	65582659 / 66026745 / -0.7%	86031079 / 81885293 / +5.1%	0.76 / 0.81 / -5.5%
tpcds_q68/duckdb:vortex-file-compressed	18108993 / 18259748 / -0.8%	33034653 / 30345941 / +8.9%	0.55 / 0.60 / -8.9%
tpcds_q69/duckdb:vortex-file-compressed	28632485 / 28608562 / +0.1%	41954929 / 41695712 / +0.6%	0.68 / 0.69 / -0.5%
tpcds_q70/duckdb:vortex-file-compressed	18414164 / 18464901 / -0.3%	29816755 / 28116135 / +6.0%	0.62 / 0.66 / -6.0%
tpcds_q71/duckdb:vortex-file-compressed	12868183 / 13138116 / -2.1%	22392815 / 23724090 / -5.6%	0.57 / 0.55 / +3.8%
tpcds_q72/duckdb:vortex-file-compressed	61473612 / 61802968 / -0.5%	79632877 / 76260219 / +4.4%	0.77 / 0.81 / -4.7%
tpcds_q73/duckdb:vortex-file-compressed	14812791 / 14871034 / -0.4%	21199317 / 21345152 / -0.7%	0.70 / 0.70 / +0.3%
tpcds_q74/duckdb:vortex-file-compressed	27556656 / 27793026 / -0.9%	35787939 / 37692417 / -5.1%	0.77 / 0.74 / +4.4%
tpcds_q75/duckdb:vortex-file-compressed	28317562 / 28770160 / -1.6%	46850944 / 44521065 / +5.2%	0.60 / 0.65 / -6.5%
tpcds_q76/duckdb:vortex-file-compressed	12400900 / 12281336 / +1.0%	24583183 / 23129725 / +6.3%	0.50 / 0.53 / -5.0%
tpcds_q77/duckdb:vortex-file-compressed	15845007 / 15945492 / -0.6%	25884462 / 25114729 / +3.1%	0.61 / 0.63 / -3.6%
tpcds_q78/duckdb:vortex-file-compressed	37144934 / 37333466 / -0.5%	45470429 / 46622124 / -2.5%	0.82 / 0.80 / +2.0%
tpcds_q79/duckdb:vortex-file-compressed	14092838 / 14568078 / -3.3%	28078408 / 27056211 / +3.8%	0.50 / 0.54 / -6.8%
tpcds_q80/duckdb:vortex-file-compressed	27470076 / 28455568 / -3.5%	45022749 / 48455469 / -7.1%	0.61 / 0.59 / +3.9%
tpcds_q81/duckdb:vortex-file-compressed	22283270 / 22381020 / -0.4%	32807061 / 31059949 / +5.6%	0.68 / 0.72 / -5.7%
tpcds_q82/duckdb:vortex-file-compressed	32407551 / 33288018 / -2.6%	38892070 / 39943708 / -2.6%	0.83 / 0.83 / -0.0%
tpcds_q83/duckdb:vortex-file-compressed	19680253 / 19180786 / +2.6%	25058302 / 27670400 / -9.4%	0.79 / 0.69 / +13.3%
tpcds_q84/duckdb:vortex-file-compressed	12806884 / 15618512 / -18.0% 🟢	22292207 / 23874906 / -6.6%	0.57 / 0.65 / -12.2%
tpcds_q85/duckdb:vortex-file-compressed	31106451 / 30779901 / +1.1%	43583493 / 39399523 / +10.6% 🔴	0.71 / 0.78 / -8.6%
tpcds_q86/duckdb:vortex-file-compressed	10641628 / 10755852 / -1.1%	20762267 / 17315086 / +19.9% 🔴	0.51 / 0.62 / -17.5%
tpcds_q87/duckdb:vortex-file-compressed	23971603 / 23795668 / +0.7%	30097498 / 31694721 / -5.0%	0.80 / 0.75 / +6.1%
tpcds_q88/duckdb:vortex-file-compressed	31952049 / 31519280 / +1.4%	46262093 / 46016640 / +0.5%	0.69 / 0.68 / +0.8%
tpcds_q89/duckdb:vortex-file-compressed	13614670 / 13710886 / -0.7%	23396664 / 24263737 / -3.6%	0.58 / 0.57 / +3.0%
tpcds_q90/duckdb:vortex-file-compressed	8042065 / 8428230 / -4.6%	14513199 / 13081144 / +10.9% 🔴	0.55 / 0.64 / -14.0%
tpcds_q91/duckdb:vortex-file-compressed	15033634 / 15364037 / -2.2%	21813294 / 21366505 / +2.1%	0.69 / 0.72 / -4.2%
tpcds_q92/duckdb:vortex-file-compressed	12853860 / 12610310 / +1.9%	20040217 / 19816727 / +1.1%	0.64 / 0.64 / +0.8%
tpcds_q93/duckdb:vortex-file-compressed	17127064 / 18533288 / -7.6%	25414610 / 28374230 / -10.4% 🟢	0.67 / 0.65 / +3.2%
tpcds_q94/duckdb:vortex-file-compressed	16144910 / 16345138 / -1.2%	25622802 / 25794088 / -0.7%	0.63 / 0.63 / -0.6%
tpcds_q95/duckdb:vortex-file-compressed	42685553 / 44645971 / -4.4%	54344087 / 54267629 / +0.1%	0.79 / 0.82 / -4.5%
tpcds_q96/duckdb:vortex-file-compressed	7219294 / 7297251 / -1.1%	14546275 / 16302000 / -10.8% 🟢	0.50 / 0.45 / +10.9%
tpcds_q97/duckdb:vortex-file-compressed	22360742 / 22246614 / +0.5%	28875897 / 28761036 / +0.4%	0.77 / 0.77 / +0.1%
tpcds_q98/duckdb:vortex-file-compressed	15699767 / 13315520 / +17.9% 🔴	23620908 / 25953161 / -9.0%	0.66 / 0.51 / +29.5%
tpcds_q99/duckdb:vortex-file-compressed	13382682 / 13351919 / +0.2%	18676989 / 22044967 / -15.3% 🟢	0.72 / 0.61 / +18.3%

duckdb / vortex-compact / ns (1.001x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	16347104 / 16753152 / -2.4%	23038485 / 24425926 / -5.7%	0.71 / 0.69 / +3.5%
tpcds_q02/duckdb:vortex-compact	16519800 / 16345251 / +1.1%	21214274 / 23865781 / -11.1% 🟢	0.78 / 0.68 / +13.7%
tpcds_q03/duckdb:vortex-compact	21650402 / 20883310 / +3.7%	36619528 / 34503586 / +6.1%	0.59 / 0.61 / -2.3%
tpcds_q04/duckdb:vortex-compact	53892749 / 54043064 / -0.3%	65030172 / 64950114 / +0.1%	0.83 / 0.83 / -0.4%
tpcds_q05/duckdb:vortex-compact	24044058 / 23982172 / +0.3%	33374147 / 30740846 / +8.6%	0.72 / 0.78 / -7.7%
tpcds_q06/duckdb:vortex-compact	33215118 / 34977402 / -5.0%	50055830 / 44639284 / +12.1% 🔴	0.66 / 0.78 / -15.3%
tpcds_q07/duckdb:vortex-compact	25775235 / 24664510 / +4.5%	38416727 / 36964176 / +3.9%	0.67 / 0.67 / +0.6%
tpcds_q08/duckdb:vortex-compact	48525710 / 48664426 / -0.3%	66719116 / 56640168 / +17.8% 🔴	0.73 / 0.86 / -15.3%
tpcds_q09/duckdb:vortex-compact	19574266 / 19232822 / +1.8%	27419761 / 27513625 / -0.3%	0.71 / 0.70 / +2.1%
tpcds_q10/duckdb:vortex-compact	45707361 / 45176869 / +1.2%	57291675 / 56523683 / +1.4%	0.80 / 0.80 / -0.2%
tpcds_q11/duckdb:vortex-compact	45045760 / 45796359 / -1.6%	56128908 / 57979253 / -3.2%	0.80 / 0.79 / +1.6%
tpcds_q12/duckdb:vortex-compact	13474598 / 13537341 / -0.5%	19476278 / 19593333 / -0.6%	0.69 / 0.69 / +0.1%
tpcds_q13/duckdb:vortex-compact	36448728 / 35756012 / +1.9%	50025367 / 51201812 / -2.3%	0.73 / 0.70 / +4.3%
tpcds_q14/duckdb:vortex-compact	68100998 / 67400110 / +1.0%	77718658 / 77452254 / +0.3%	0.88 / 0.87 / +0.7%
tpcds_q15/duckdb:vortex-compact	25927928 / 25970044 / -0.2%	30949753 / 31579875 / -2.0%	0.84 / 0.82 / +1.9%
tpcds_q16/duckdb:vortex-compact	24627694 / 24715600 / -0.4%	34986647 / 32612673 / +7.3%	0.70 / 0.76 / -7.1%
tpcds_q17/duckdb:vortex-compact	44552728 / 44485165 / +0.2%	56547132 / 54897615 / +3.0%	0.79 / 0.81 / -2.8%
tpcds_q18/duckdb:vortex-compact	35420350 / 35983502 / -1.6%	44965011 / 47245626 / -4.8%	0.79 / 0.76 / +3.4%
tpcds_q19/duckdb:vortex-compact	36304443 / 36413590 / -0.3%	43722604 / 53730731 / -18.6% 🟢	0.83 / 0.68 / +22.5%
tpcds_q20/duckdb:vortex-compact	13843277 / 13995654 / -1.1%	18999366 / 19260643 / -1.4%	0.73 / 0.73 / +0.3%
tpcds_q21/duckdb:vortex-compact	10468642 / 10373043 / +0.9%	18682117 / 18706940 / -0.1%	0.56 / 0.55 / +1.1%
tpcds_q22/duckdb:vortex-compact	30668066 / 30478856 / +0.6%	41421106 / 40669349 / +1.8%	0.74 / 0.75 / -1.2%
tpcds_q23/duckdb:vortex-compact	44008164 / 42870745 / +2.7%	57451554 / 54022484 / +6.3%	0.77 / 0.79 / -3.5%
tpcds_q24/duckdb:vortex-compact	39479899 / 39491780 / -0.0%	47664039 / 48750325 / -2.2%	0.83 / 0.81 / +2.2%
tpcds_q25/duckdb:vortex-compact	43355709 / 43165836 / +0.4%	55985240 / 55766203 / +0.4%	0.77 / 0.77 / +0.0%
tpcds_q26/duckdb:vortex-compact	22985036 / 22972196 / +0.1%	27465708 / 27623449 / -0.6%	0.84 / 0.83 / +0.6%
tpcds_q27/duckdb:vortex-compact	28875090 / 31446920 / -8.2%	38065449 / 39150604 / -2.8%	0.76 / 0.80 / -5.6%
tpcds_q28/duckdb:vortex-compact	22277834 / 21300524 / +4.6%	29399455 / 32029521 / -8.2%	0.76 / 0.67 / +13.9%
tpcds_q29/duckdb:vortex-compact	44453874 / 44804826 / -0.8%	57622210 / 56490070 / +2.0%	0.77 / 0.79 / -2.7%
tpcds_q30/duckdb:vortex-compact	22489422 / 22449986 / +0.2%	30561736 / 31034835 / -1.5%	0.74 / 0.72 / +1.7%
tpcds_q31/duckdb:vortex-compact	23725168 / 23904004 / -0.7%	30026743 / 30607384 / -1.9%	0.79 / 0.78 / +1.2%
tpcds_q32/duckdb:vortex-compact	13955913 / 14034880 / -0.6%	20396265 / 20517033 / -0.6%	0.68 / 0.68 / +0.0%
tpcds_q33/duckdb:vortex-compact	22490027 / 22881598 / -1.7%	38834034 / 35942074 / +8.0%	0.58 / 0.64 / -9.0%
tpcds_q34/duckdb:vortex-compact	21844390 / 21852940 / -0.0%	28435497 / 32273477 / -11.9% 🟢	0.77 / 0.68 / +13.5%
tpcds_q35/duckdb:vortex-compact	62126308 / 61643266 / +0.8%	73434823 / 79037656 / -7.1%	0.85 / 0.78 / +8.5%
tpcds_q36/duckdb:vortex-compact	22159433 / 21973947 / +0.8%	32642178 / 38328529 / -14.8% 🟢	0.68 / 0.57 / +18.4%
tpcds_q37/duckdb:vortex-compact	15178006 / 15337783 / -1.0%	22774907 / 24520134 / -7.1%	0.67 / 0.63 / +6.5%
tpcds_q38/duckdb:vortex-compact	26124120 / 26676178 / -2.1%	32504791 / 32241208 / +0.8%	0.80 / 0.83 / -2.9%
tpcds_q39/duckdb:vortex-compact	19662954 / 19954786 / -1.5%	29912232 / 28033229 / +6.7%	0.66 / 0.71 / -7.7%
tpcds_q40/duckdb:vortex-compact	15770246 / 15959310 / -1.2%	20620368 / 21081356 / -2.2%	0.76 / 0.76 / +1.0%
tpcds_q41/duckdb:vortex-compact	7202618 / 7317648 / -1.6%	10269645 / 10540184 / -2.6%	0.70 / 0.69 / +1.0%
tpcds_q42/duckdb:vortex-compact	11783946 / 11871694 / -0.7%	20915421 / 20974783 / -0.3%	0.56 / 0.57 / -0.5%
tpcds_q43/duckdb:vortex-compact	16180352 / 19531570 / -17.2% 🟢	23135752 / 23243130 / -0.5%	0.70 / 0.84 / -16.8%
tpcds_q44/duckdb:vortex-compact	23194080 / 22886222 / +1.3%	33590440 / 34747200 / -3.3%	0.69 / 0.66 / +4.8%
tpcds_q45/duckdb:vortex-compact	27186492 / 27268644 / -0.3%	32772262 / 33357254 / -1.8%	0.83 / 0.82 / +1.5%
tpcds_q46/duckdb:vortex-compact	28760831 / 29028246 / -0.9%	43114314 / 43016612 / +0.2%	0.67 / 0.67 / -1.1%
tpcds_q47/duckdb:vortex-compact	36933118 / 36203117 / +2.0%	46798383 / 50681623 / -7.7%	0.79 / 0.71 / +10.5%
tpcds_q48/duckdb:vortex-compact	33002766 / 33912290 / -2.7%	45793394 / 42724371 / +7.2%	0.72 / 0.79 / -9.2%
tpcds_q49/duckdb:vortex-compact	23923214 / 23988921 / -0.3%	36875751 / 38138823 / -3.3%	0.65 / 0.63 / +3.1%
tpcds_q50/duckdb:vortex-compact	26841832 / 27692532 / -3.1%	35992766 / 41786131 / -13.9% 🟢	0.75 / 0.66 / +12.5%
tpcds_q51/duckdb:vortex-compact	53088645 / 53420368 / -0.6%	64942051 / 63785622 / +1.8%	0.82 / 0.84 / -2.4%
tpcds_q52/duckdb:vortex-compact	14367772 / 11971844 / +20.0% 🔴	20534782 / 20606585 / -0.3%	0.70 / 0.58 / +20.4%
tpcds_q53/duckdb:vortex-compact	21824998 / 21948006 / -0.6%	28400632 / 29615875 / -4.1%	0.77 / 0.74 / +3.7%
tpcds_q54/duckdb:vortex-compact	27138236 / 27245435 / -0.4%	35558818 / 35934416 / -1.0%	0.76 / 0.76 / +0.7%
tpcds_q55/duckdb:vortex-compact	11951580 / 12032770 / -0.7%	24724237 / 20567953 / +20.2% 🔴	0.48 / 0.59 / -17.4%
tpcds_q56/duckdb:vortex-compact	24138164 / 23645258 / +2.1%	35045067 / 33579369 / +4.4%	0.69 / 0.70 / -2.2%
tpcds_q57/duckdb:vortex-compact	27587812 / 28045730 / -1.6%	33520856 / 36769888 / -8.8%	0.82 / 0.76 / +7.9%
tpcds_q58/duckdb:vortex-compact	24826248 / 23922234 / +3.8%	32984602 / 34194742 / -3.5%	0.75 / 0.70 / +7.6%
tpcds_q59/duckdb:vortex-compact	22947722 / 23195656 / -1.1%	31293321 / 29359929 / +6.6%	0.73 / 0.79 / -7.2%
tpcds_q60/duckdb:vortex-compact	24381446 / 24136238 / +1.0%	38585659 / 35268801 / +9.4%	0.63 / 0.68 / -7.7%
tpcds_q61/duckdb:vortex-compact	34181704 / 31421802 / +8.8%	48280942 / 45101311 / +7.0%	0.71 / 0.70 / +1.6%
tpcds_q62/duckdb:vortex-compact	11626156 / 11914734 / -2.4%	20223756 / 17154088 / +17.9% 🔴	0.57 / 0.69 / -17.2%
tpcds_q63/duckdb:vortex-compact	20767706 / 20422930 / +1.7%	32377276 / 28299904 / +14.4% 🔴	0.64 / 0.72 / -11.1%
tpcds_q64/duckdb:vortex-compact	84842933 / 88618992 / -4.3%	102131317 / 103769774 / -1.6%	0.83 / 0.85 / -2.7%
tpcds_q65/duckdb:vortex-compact	20018892 / 19666578 / +1.8%	30418326 / 34103496 / -10.8% 🟢	0.66 / 0.58 / +14.1%
tpcds_q66/duckdb:vortex-compact	25182215 / 25090634 / +0.4%	34147133 / 36841501 / -7.3%	0.74 / 0.68 / +8.3%
tpcds_q67/duckdb:vortex-compact	72309173 / 71163703 / +1.6%	84588084 / 86318510 / -2.0%	0.85 / 0.82 / +3.7%
tpcds_q68/duckdb:vortex-compact	28590018 / 29105927 / -1.8%	40258793 / 40665755 / -1.0%	0.71 / 0.72 / -0.8%
tpcds_q69/duckdb:vortex-compact	46137082 / 46437388 / -0.6%	58020325 / 62910105 / -7.8%	0.80 / 0.74 / +7.7%
tpcds_q70/duckdb:vortex-compact	31045539 / 32634510 / -4.9%	40717112 / 47391887 / -14.1% 🟢	0.76 / 0.69 / +10.7%
tpcds_q71/duckdb:vortex-compact	19709283 / 19473323 / +1.2%	29320544 / 29828683 / -1.7%	0.67 / 0.65 / +3.0%
tpcds_q72/duckdb:vortex-compact	69964714 / 69475936 / +0.7%	82324289 / 81520589 / +1.0%	0.85 / 0.85 / -0.3%
tpcds_q73/duckdb:vortex-compact	21556073 / 22622776 / -4.7%	28872367 / 29998065 / -3.8%	0.75 / 0.75 / -1.0%
tpcds_q74/duckdb:vortex-compact	32099094 / 32236656 / -0.4%	41576945 / 40909029 / +1.6%	0.77 / 0.79 / -2.0%
tpcds_q75/duckdb:vortex-compact	33999543 / 33860278 / +0.4%	46916991 / 44293764 / +5.9%	0.72 / 0.76 / -5.2%
tpcds_q76/duckdb:vortex-compact	17856193 / 17499598 / +2.0%	26588559 / 27664514 / -3.9%	0.67 / 0.63 / +6.2%
tpcds_q77/duckdb:vortex-compact	23652613 / 22908577 / +3.2%	33952460 / 31862752 / +6.6%	0.70 / 0.72 / -3.1%
tpcds_q78/duckdb:vortex-compact	41404032 / 42721918 / -3.1%	50945863 / 50920086 / +0.1%	0.81 / 0.84 / -3.1%
tpcds_q79/duckdb:vortex-compact	37511702 / 37354384 / +0.4%	44565674 / 44336611 / +0.5%	0.84 / 0.84 / -0.1%
tpcds_q80/duckdb:vortex-compact	36924842 / 36626968 / +0.8%	51665928 / 53861774 / -4.1%	0.71 / 0.68 / +5.1%
tpcds_q81/duckdb:vortex-compact	24339224 / 24661140 / -1.3%	33324439 / 32072768 / +3.9%	0.73 / 0.77 / -5.0%
tpcds_q82/duckdb:vortex-compact	35303050 / 35234419 / +0.2%	42200625 / 44504182 / -5.2%	0.84 / 0.79 / +5.7%
tpcds_q83/duckdb:vortex-compact	28943568 / 28859177 / +0.3%	33058299 / 35430921 / -6.7%	0.88 / 0.81 / +7.5%
tpcds_q84/duckdb:vortex-compact	14983662 / 14705138 / +1.9%	20847938 / 21182989 / -1.6%	0.72 / 0.69 / +3.5%
tpcds_q85/duckdb:vortex-compact	41479794 / 41221176 / +0.6%	49900301 / 50278447 / -0.8%	0.83 / 0.82 / +1.4%
tpcds_q86/duckdb:vortex-compact	12099832 / 11973893 / +1.1%	18163108 / 18153080 / +0.1%	0.67 / 0.66 / +1.0%
tpcds_q87/duckdb:vortex-compact	27872941 / 27730402 / +0.5%	34990072 / 34626837 / +1.0%	0.80 / 0.80 / -0.5%
tpcds_q88/duckdb:vortex-compact	68690806 / 66641794 / +3.1%	78038130 / 78067141 / -0.0%	0.88 / 0.85 / +3.1%
tpcds_q89/duckdb:vortex-compact	20331448 / 20950243 / -3.0%	33555618 / 28411306 / +18.1% 🔴	0.61 / 0.74 / -17.8%
tpcds_q90/duckdb:vortex-compact	14142502 / 12994144 / +8.8%	17924760 / 19574539 / -8.4%	0.79 / 0.66 / +18.9%
tpcds_q91/duckdb:vortex-compact	30222631 / 30278276 / -0.2%	37553400 / 36965356 / +1.6%	0.80 / 0.82 / -1.7%
tpcds_q92/duckdb:vortex-compact	20217252 / 20193999 / +0.1%	27003385 / 27953552 / -3.4%	0.75 / 0.72 / +3.6%
tpcds_q93/duckdb:vortex-compact	18995650 / 18236684 / +4.2%	25431949 / 26341088 / -3.5%	0.75 / 0.69 / +7.9%
tpcds_q94/duckdb:vortex-compact	21864145 / 21783922 / +0.4%	32320358 / 30431291 / +6.2%	0.68 / 0.72 / -5.5%
tpcds_q95/duckdb:vortex-compact	50123291 / 46307040 / +8.2%	54847752 / 52975365 / +3.5%	0.91 / 0.87 / +4.5%
tpcds_q96/duckdb:vortex-compact	16951273 / 16836556 / +0.7%	23604111 / 25560998 / -7.7%	0.72 / 0.66 / +9.0%
tpcds_q97/duckdb:vortex-compact	25207077 / 25690044 / -1.9%	31257677 / 38583165 / -19.0% 🟢	0.81 / 0.67 / +21.1%
tpcds_q98/duckdb:vortex-compact	18068026 / 18330848 / -1.4%	27352388 / 27401012 / -0.2%	0.66 / 0.67 / -1.3%
tpcds_q99/duckdb:vortex-compact	16672809 / 16944708 / -1.6%	21698421 / 23416615 / -7.3%	0.77 / 0.72 / +6.2%

duckdb / parquet / ns (0.998x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	26470647 / 24762869 / +6.9%	31185885 / 31774612 / -1.9%	0.85 / 0.78 / +8.9%
tpcds_q02/duckdb:parquet	15547706 / 15614276 / -0.4%	20702071 / 21328391 / -2.9%	0.75 / 0.73 / +2.6%
tpcds_q03/duckdb:parquet	9031674 / 9056130 / -0.3%	15765366 / 15914613 / -0.9%	0.57 / 0.57 / +0.7%
tpcds_q04/duckdb:parquet	130176122 / 130284166 / -0.1%	135370405 / 137388068 / -1.5%	0.96 / 0.95 / +1.4%
tpcds_q05/duckdb:parquet	22082947 / 21952630 / +0.6%	25908916 / 25891020 / +0.1%	0.85 / 0.85 / +0.5%
tpcds_q06/duckdb:parquet	26790340 / 26908778 / -0.4%	35322116 / 36557251 / -3.4%	0.76 / 0.74 / +3.0%
tpcds_q07/duckdb:parquet	15647354 / 15851142 / -1.3%	22891361 / 26137946 / -12.4% 🟢	0.68 / 0.61 / +12.7%
tpcds_q08/duckdb:parquet	26083794 / 26166555 / -0.3%	32988419 / 37088634 / -11.1% 🟢	0.79 / 0.71 / +12.1%
tpcds_q09/duckdb:parquet	19080767 / 19409880 / -1.7%	22767660 / 23001114 / -1.0%	0.84 / 0.84 / -0.7%
tpcds_q10/duckdb:parquet	28122382 / 27997742 / +0.4%	37236348 / 38046236 / -2.1%	0.76 / 0.74 / +2.6%
tpcds_q11/duckdb:parquet	73177658 / 73129710 / +0.1%	77763876 / 81068446 / -4.1%	0.94 / 0.90 / +4.3%
tpcds_q12/duckdb:parquet	14486140 / 14333066 / +1.1%	22138267 / 18272205 / +21.2% 🔴	0.65 / 0.78 / -16.6%
tpcds_q13/duckdb:parquet	24356368 / 24408905 / -0.2%	31057464 / 31069225 / -0.0%	0.78 / 0.79 / -0.2%
tpcds_q14/duckdb:parquet	63875901 / 61776884 / +3.4%	68197741 / 70963605 / -3.9%	0.94 / 0.87 / +7.6%
tpcds_q15/duckdb:parquet	25349365 / 25385928 / -0.1%	30129892 / 29714507 / +1.4%	0.84 / 0.85 / -1.5%
tpcds_q16/duckdb:parquet	21140051 / 20962517 / +0.8%	28134811 / 28353936 / -0.8%	0.75 / 0.74 / +1.6%
tpcds_q17/duckdb:parquet	32739951 / 33022352 / -0.9%	40409692 / 40350001 / +0.1%	0.81 / 0.82 / -1.0%
tpcds_q18/duckdb:parquet	40373687 / 41373743 / -2.4%	57109401 / 55396042 / +3.1%	0.71 / 0.75 / -5.3%
tpcds_q19/duckdb:parquet	25159346 / 25377030 / -0.9%	31894467 / 32121866 / -0.7%	0.79 / 0.79 / -0.2%
tpcds_q20/duckdb:parquet	14036313 / 13922080 / +0.8%	18595656 / 18698787 / -0.6%	0.75 / 0.74 / +1.4%
tpcds_q21/duckdb:parquet	9406003 / 9562480 / -1.6%	15121960 / 15080710 / +0.3%	0.62 / 0.63 / -1.9%
tpcds_q22/duckdb:parquet	34962162 / 35024355 / -0.2%	38935481 / 39201777 / -0.7%	0.90 / 0.89 / +0.5%
tpcds_q23/duckdb:parquet	41476712 / 41328559 / +0.4%	50915539 / 51908331 / -1.9%	0.81 / 0.80 / +2.3%
tpcds_q24/duckdb:parquet	35194266 / 33722642 / +4.4%	42836163 / 41964769 / +2.1%	0.82 / 0.80 / +2.2%
tpcds_q25/duckdb:parquet	31559538 / 31542068 / +0.1%	39084840 / 39936032 / -2.1%	0.81 / 0.79 / +2.2%
tpcds_q26/duckdb:parquet	31586154 / 31708028 / -0.4%	37972713 / 37967661 / +0.0%	0.83 / 0.84 / -0.4%
tpcds_q27/duckdb:parquet	31902266 / 32153858 / -0.8%	39886599 / 39866600 / +0.1%	0.80 / 0.81 / -0.8%
tpcds_q28/duckdb:parquet	18436522 / 17759568 / +3.8%	22292102 / 28137458 / -20.8% 🟢	0.83 / 0.63 / +31.0%
tpcds_q29/duckdb:parquet	31134776 / 31249568 / -0.4%	39147381 / 39839755 / -1.7%	0.80 / 0.78 / +1.4%
tpcds_q30/duckdb:parquet	34094464 / 33725270 / +1.1%	46322420 / 42579229 / +8.8%	0.74 / 0.79 / -7.1%
tpcds_q31/duckdb:parquet	20721075 / 20998596 / -1.3%	26927990 / 30028759 / -10.3% 🟢	0.77 / 0.70 / +10.0%
tpcds_q32/duckdb:parquet	13992324 / 12054816 / +16.1% 🔴	18244031 / 18329461 / -0.5%	0.77 / 0.66 / +16.6%
tpcds_q33/duckdb:parquet	16525112 / 16703006 / -1.1%	24035590 / 23722537 / +1.3%	0.69 / 0.70 / -2.4%
tpcds_q34/duckdb:parquet	16405208 / 16331487 / +0.5%	22150028 / 22345913 / -0.9%	0.74 / 0.73 / +1.3%
tpcds_q35/duckdb:parquet	47790394 / 47649778 / +0.3%	56152581 / 56605576 / -0.8%	0.85 / 0.84 / +1.1%
tpcds_q36/duckdb:parquet	15852322 / 15986272 / -0.8%	23682752 / 23519060 / +0.7%	0.67 / 0.68 / -1.5%
tpcds_q37/duckdb:parquet	11972832 / 12580024 / -4.8%	19403988 / 17346707 / +11.9% 🔴	0.62 / 0.73 / -14.9%
tpcds_q38/duckdb:parquet	26995014 / 26648724 / +1.3%	30343754 / 32037329 / -5.3%	0.89 / 0.83 / +7.0%
tpcds_q39/duckdb:parquet	24359078 / 24382236 / -0.1%	30673687 / 38242683 / -19.8% 🟢	0.79 / 0.64 / +24.6%
tpcds_q40/duckdb:parquet	16470664 / 16604816 / -0.8%	21366640 / 25197917 / -15.2% 🟢	0.77 / 0.66 / +17.0%
tpcds_q41/duckdb:parquet	7639490 / 7787870 / -1.9%	13278479 / 12999571 / +2.1%	0.58 / 0.60 / -4.0%
tpcds_q42/duckdb:parquet	11648336 / 8682224 / +34.2% 🔴	18097302 / 15878011 / +14.0% 🔴	0.64 / 0.55 / +17.7%
tpcds_q43/duckdb:parquet	10819903 / 10642970 / +1.7%	14919195 / 14995082 / -0.5%	0.73 / 0.71 / +2.2%
tpcds_q44/duckdb:parquet	16111953 / 15986026 / +0.8%	25308757 / 21077394 / +20.1% 🔴	0.64 / 0.76 / -16.1%
tpcds_q45/duckdb:parquet	23352890 / 23389248 / -0.2%	29824529 / 29732202 / +0.3%	0.78 / 0.79 / -0.5%
tpcds_q46/duckdb:parquet	37048306 / 36946086 / +0.3%	48233484 / 46108114 / +4.6%	0.77 / 0.80 / -4.1%
tpcds_q47/duckdb:parquet	31233487 / 31202006 / +0.1%	37544726 / 39244071 / -4.3%	0.83 / 0.80 / +4.6%
tpcds_q48/duckdb:parquet	21212432 / 21263246 / -0.2%	27661247 / 28240877 / -2.1%	0.77 / 0.75 / +1.9%
tpcds_q49/duckdb:parquet	20131046 / 20206508 / -0.4%	28273100 / 28453420 / -0.6%	0.71 / 0.71 / +0.3%
tpcds_q50/duckdb:parquet	17992720 / 17774158 / +1.2%	24073949 / 23828876 / +1.0%	0.75 / 0.75 / +0.2%
tpcds_q51/duckdb:parquet	53640585 / 54224683 / -1.1%	59967551 / 60087934 / -0.2%	0.89 / 0.90 / -0.9%
tpcds_q52/duckdb:parquet	8936726 / 8907100 / +0.3%	15589048 / 15897396 / -1.9%	0.57 / 0.56 / +2.3%
tpcds_q53/duckdb:parquet	11986178 / 11646501 / +2.9%	17178115 / 16737563 / +2.6%	0.70 / 0.70 / +0.3%
tpcds_q54/duckdb:parquet	20643858 / 20843482 / -1.0%	29618967 / 29444735 / +0.6%	0.70 / 0.71 / -1.5%
tpcds_q55/duckdb:parquet	8920751 / 8882231 / +0.4%	15235039 / 15287179 / -0.3%	0.59 / 0.58 / +0.8%
tpcds_q56/duckdb:parquet	17030298 / 16996971 / +0.2%	26150571 / 24979617 / +4.7%	0.65 / 0.68 / -4.3%
tpcds_q57/duckdb:parquet	29034710 / 29210360 / -0.6%	34276714 / 38255688 / -10.4% 🟢	0.85 / 0.76 / +10.9%
tpcds_q58/duckdb:parquet	19031180 / 19273287 / -1.3%	30401011 / 26580675 / +14.4% 🔴	0.63 / 0.73 / -13.7%
tpcds_q59/duckdb:parquet	20167974 / 19969600 / +1.0%	25435394 / 25179590 / +1.0%	0.79 / 0.79 / -0.0%
tpcds_q60/duckdb:parquet	17577810 / 17513105 / +0.4%	24419469 / 27174710 / -10.1% 🟢	0.72 / 0.64 / +11.7%
tpcds_q61/duckdb:parquet	21782326 / 22299497 / -2.3%	28144579 / 29113219 / -3.3%	0.77 / 0.77 / +1.0%
tpcds_q62/duckdb:parquet	10986936 / 10940750 / +0.4%	15059850 / 14797722 / +1.8%	0.73 / 0.74 / -1.3%
tpcds_q63/duckdb:parquet	11230601 / 11190166 / +0.4%	16549784 / 16501149 / +0.3%	0.68 / 0.68 / +0.1%
tpcds_q64/duckdb:parquet	53027174 / 55263242 / -4.0%	63423353 / 63750001 / -0.5%	0.84 / 0.87 / -3.6%
tpcds_q65/duckdb:parquet	14624411 / 14740044 / -0.8%	20793805 / 20298135 / +2.4%	0.70 / 0.73 / -3.1%
tpcds_q66/duckdb:parquet	24988386 / 24975738 / +0.1%	32338945 / 32323681 / +0.0%	0.77 / 0.77 / +0.0%
tpcds_q67/duckdb:parquet	77964176 / 78438321 / -0.6%	86561869 / 83397266 / +3.8%	0.90 / 0.94 / -4.2%
tpcds_q68/duckdb:parquet	30440588 / 30287009 / +0.5%	40486407 / 39970670 / +1.3%	0.75 / 0.76 / -0.8%
tpcds_q69/duckdb:parquet	30412871 / 30249640 / +0.5%	38391533 / 39701301 / -3.3%	0.79 / 0.76 / +4.0%
tpcds_q70/duckdb:parquet	16246418 / 17847536 / -9.0%	24688559 / 25047547 / -1.4%	0.66 / 0.71 / -7.6%
tpcds_q71/duckdb:parquet	15095354 / 14934984 / +1.1%	21400157 / 21630601 / -1.1%	0.71 / 0.69 / +2.2%
tpcds_q72/duckdb:parquet	82137178 / 81803656 / +0.4%	90704682 / 89059951 / +1.8%	0.91 / 0.92 / -1.4%
tpcds_q73/duckdb:parquet	13715911 / 14065602 / -2.5%	19171155 / 19494502 / -1.7%	0.72 / 0.72 / -0.8%
tpcds_q74/duckdb:parquet	100578450 / 100317180 / +0.3%	107634477 / 108437028 / -0.7%	0.93 / 0.93 / +1.0%
tpcds_q75/duckdb:parquet	40981884 / 40833978 / +0.4%	51290524 / 51977261 / -1.3%	0.80 / 0.79 / +1.7%
tpcds_q76/duckdb:parquet	13858946 / 14347254 / -3.4%	21963836 / 22212081 / -1.1%	0.63 / 0.65 / -2.3%
tpcds_q77/duckdb:parquet	17342235 / 18049488 / -3.9%	25516064 / 26523302 / -3.8%	0.68 / 0.68 / -0.1%
tpcds_q78/duckdb:parquet	48563710 / 48506636 / +0.1%	54356656 / 54598813 / -0.4%	0.89 / 0.89 / +0.6%
tpcds_q79/duckdb:parquet	21104536 / 21236427 / -0.6%	29129964 / 28583659 / +1.9%	0.72 / 0.74 / -2.5%
tpcds_q80/duckdb:parquet	32982814 / 33077836 / -0.3%	40945723 / 40344484 / +1.5%	0.81 / 0.82 / -1.8%
tpcds_q81/duckdb:parquet	31693840 / 31531652 / +0.5%	46400757 / 43013797 / +7.9%	0.68 / 0.73 / -6.8%
tpcds_q82/duckdb:parquet	14158253 / 12402282 / +14.2% 🔴	19745463 / 17851465 / +10.6% 🔴	0.72 / 0.69 / +3.2%
tpcds_q83/duckdb:parquet	16808496 / 16743018 / +0.4%	21661539 / 21297642 / +1.7%	0.78 / 0.79 / -1.3%
tpcds_q84/duckdb:parquet	18806258 / 18586320 / +1.2%	24239244 / 23853340 / +1.6%	0.78 / 0.78 / -0.4%
tpcds_q85/duckdb:parquet	35930418 / 35720726 / +0.6%	48501486 / 47185091 / +2.8%	0.74 / 0.76 / -2.1%
tpcds_q86/duckdb:parquet	11385358 / 12532788 / -9.2%	16778588 / 16788535 / -0.1%	0.68 / 0.75 / -9.1%
tpcds_q87/duckdb:parquet	28590415 / 28615514 / -0.1%	32750791 / 32350699 / +1.2%	0.87 / 0.88 / -1.3%
tpcds_q88/duckdb:parquet	27158567 / 30374444 / -10.6% 🟢	31467175 / 33253867 / -5.4%	0.86 / 0.91 / -5.5%
tpcds_q89/duckdb:parquet	12846698 / 12875074 / -0.2%	18615234 / 18793354 / -0.9%	0.69 / 0.69 / +0.7%
tpcds_q90/duckdb:parquet	7050188 / 10097984 / -30.2% 🟢	11394715 / 11204117 / +1.7%	0.62 / 0.90 / -31.4%
tpcds_q91/duckdb:parquet	21762420 / 21547662 / +1.0%	28724816 / 28359158 / +1.3%	0.76 / 0.76 / -0.3%
tpcds_q92/duckdb:parquet	12393567 / 13159568 / -5.8%	19784178 / 20194566 / -2.0%	0.63 / 0.65 / -3.9%
tpcds_q93/duckdb:parquet	21694100 / 21858294 / -0.8%	26742637 / 28752405 / -7.0%	0.81 / 0.76 / +6.7%
tpcds_q94/duckdb:parquet	16828400 / 16798702 / +0.2%	26107711 / 25702412 / +1.6%	0.64 / 0.65 / -1.4%
tpcds_q95/duckdb:parquet	90860525 / 91593060 / -0.8%	97838336 / 101034083 / -3.2%	0.93 / 0.91 / +2.4%
tpcds_q96/duckdb:parquet	7123712 / 7011956 / +1.6%	10942436 / 10483885 / +4.4%	0.65 / 0.67 / -2.7%
tpcds_q97/duckdb:parquet	26061205 / 25884200 / +0.7%	32520618 / 32416775 / +0.3%	0.80 / 0.80 / +0.4%
tpcds_q98/duckdb:parquet	15031812 / 15322974 / -1.9%	22867362 / 22167755 / +3.2%	0.66 / 0.69 / -4.9%
tpcds_q99/duckdb:parquet	17194826 / 17374227 / -1.0%	21073426 / 21032864 / +0.2%	0.82 / 0.83 / -1.2%

No file size changes detected.

github-actions · 2026-10-09T14:25:07Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.991x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.979x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	94666862 / 93911744 / +0.8%	174417071 / 171035884 / +2.0%	0.54 / 0.55 / -1.2%
tpch_q02/datafusion:vortex-file-compressed	65025280 / 65191885 / -0.3%	97185135 / 96810380 / +0.4%	0.67 / 0.67 / -0.6%
tpch_q03/datafusion:vortex-file-compressed	64856126 / 65428050 / -0.9%	115210577 / 121665912 / -5.3%	0.56 / 0.54 / +4.7%
tpch_q04/datafusion:vortex-file-compressed	34573343 / 35109249 / -1.5%	78404526 / 78470445 / -0.1%	0.44 / 0.45 / -1.4%
tpch_q05/datafusion:vortex-file-compressed	115174936 / 116246492 / -0.9%	180957523 / 176976565 / +2.2%	0.64 / 0.66 / -3.1%
tpch_q06/datafusion:vortex-file-compressed	14116342 / 13894888 / +1.6%	70912401 / 77131178 / -8.1%	0.20 / 0.18 / +10.5%
tpch_q07/datafusion:vortex-file-compressed	140833034 / 138456736 / +1.7%	199534793 / 197283566 / +1.1%	0.71 / 0.70 / +0.6%
tpch_q08/datafusion:vortex-file-compressed	143755937 / 141663745 / +1.5%	218053750 / 230368225 / -5.3%	0.66 / 0.61 / +7.2%
tpch_q09/datafusion:vortex-file-compressed	184109058 / 184460543 / -0.2%	259385716 / 265227029 / -2.2%	0.71 / 0.70 / +2.1%
tpch_q10/datafusion:vortex-file-compressed	73195497 / 72594313 / +0.8%	139327527 / 140505193 / -0.8%	0.53 / 0.52 / +1.7%
tpch_q11/datafusion:vortex-file-compressed	42992205 / 42581033 / +1.0%	69121493 / 68107775 / +1.5%	0.62 / 0.63 / -0.5%
tpch_q12/datafusion:vortex-file-compressed	44018325 / 42584656 / +3.4%	96561937 / 93648523 / +3.1%	0.46 / 0.45 / +0.2%
tpch_q13/datafusion:vortex-file-compressed	46242501 / 46496693 / -0.5%	82146868 / 78854607 / +4.2%	0.56 / 0.59 / -4.5%
tpch_q14/datafusion:vortex-file-compressed	24248459 / 24898766 / -2.6%	96428615 / 96144073 / +0.3%	0.25 / 0.26 / -2.9%
tpch_q15/datafusion:vortex-file-compressed	37359686 / 36784818 / +1.6%	98298631 / 100664024 / -2.3%	0.38 / 0.37 / +4.0%
tpch_q16/datafusion:vortex-file-compressed	37353951 / 37349678 / +0.0%	69033577 / 72050008 / -4.2%	0.54 / 0.52 / +4.4%
tpch_q17/datafusion:vortex-file-compressed	172029309 / 177558491 / -3.1%	221663036 / 223401030 / -0.8%	0.78 / 0.79 / -2.4%
tpch_q18/datafusion:vortex-file-compressed	199517043 / 202163236 / -1.3%	270708760 / 265026584 / +2.1%	0.74 / 0.76 / -3.4%
tpch_q19/datafusion:vortex-file-compressed	34701616 / 34168714 / +1.6%	90498230 / 105119815 / -13.9% 🟢	0.38 / 0.33 / +18.0%
tpch_q20/datafusion:vortex-file-compressed	63266665 / 63361172 / -0.1%	125487171 / 126460053 / -0.8%	0.50 / 0.50 / +0.6%
tpch_q21/datafusion:vortex-file-compressed	183174698 / 182371602 / +0.4%	243995049 / 244889200 / -0.4%	0.75 / 0.74 / +0.8%
tpch_q22/datafusion:vortex-file-compressed	25470476 / 25132742 / +1.3%	57861006 / 55903685 / +3.5%	0.44 / 0.45 / -2.1%

datafusion / vortex-compact / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	99125853 / 99168039 / -0.0%	157799575 / 167990852 / -6.1%	0.63 / 0.59 / +6.4%
tpch_q02/datafusion:vortex-compact	65081234 / 65969690 / -1.3%	94973371 / 96219525 / -1.3%	0.69 / 0.69 / -0.1%
tpch_q03/datafusion:vortex-compact	66074050 / 67152673 / -1.6%	114107795 / 112872864 / +1.1%	0.58 / 0.59 / -2.7%
tpch_q04/datafusion:vortex-compact	41237898 / 41334884 / -0.2%	83463459 / 81274632 / +2.7%	0.49 / 0.51 / -2.9%
tpch_q05/datafusion:vortex-compact	119062906 / 118492678 / +0.5%	170067923 / 170292210 / -0.1%	0.70 / 0.70 / +0.6%
tpch_q06/datafusion:vortex-compact	18069265 / 18253484 / -1.0%	61777389 / 63080132 / -2.1%	0.29 / 0.29 / +1.1%
tpch_q07/datafusion:vortex-compact	142377801 / 142480533 / -0.1%	190399962 / 190366136 / +0.0%	0.75 / 0.75 / -0.1%
tpch_q08/datafusion:vortex-compact	145585422 / 144297147 / +0.9%	205974386 / 205746417 / +0.1%	0.71 / 0.70 / +0.8%
tpch_q09/datafusion:vortex-compact	186971597 / 197812271 / -5.5%	247813041 / 247360237 / +0.2%	0.75 / 0.80 / -5.7%
tpch_q10/datafusion:vortex-compact	77993971 / 78217323 / -0.3%	127985179 / 130755236 / -2.1%	0.61 / 0.60 / +1.9%
tpch_q11/datafusion:vortex-compact	43617815 / 43947680 / -0.8%	68038501 / 69178361 / -1.6%	0.64 / 0.64 / +0.9%
tpch_q12/datafusion:vortex-compact	57332995 / 57164702 / +0.3%	97427435 / 102515050 / -5.0%	0.59 / 0.56 / +5.5%
tpch_q13/datafusion:vortex-compact	53479187 / 54241518 / -1.4%	82228355 / 76084653 / +8.1%	0.65 / 0.71 / -8.8%
tpch_q14/datafusion:vortex-compact	26990911 / 27698780 / -2.6%	95690503 / 95492258 / +0.2%	0.28 / 0.29 / -2.8%
tpch_q15/datafusion:vortex-compact	44132436 / 44881296 / -1.7%	97332323 / 97705230 / -0.4%	0.45 / 0.46 / -1.3%
tpch_q16/datafusion:vortex-compact	41112256 / 40451766 / +1.6%	69877136 / 71413527 / -2.2%	0.59 / 0.57 / +3.9%
tpch_q17/datafusion:vortex-compact	172086806 / 171458360 / +0.4%	212119610 / 213611432 / -0.7%	0.81 / 0.80 / +1.1%
tpch_q18/datafusion:vortex-compact	203634273 / 203243170 / +0.2%	254297107 / 254806450 / -0.2%	0.80 / 0.80 / +0.4%
tpch_q19/datafusion:vortex-compact	40716316 / 41168587 / -1.1%	85463269 / 92309714 / -7.4%	0.48 / 0.45 / +6.8%
tpch_q20/datafusion:vortex-compact	64826977 / 67025900 / -3.3%	115868189 / 122871295 / -5.7%	0.56 / 0.55 / +2.6%
tpch_q21/datafusion:vortex-compact	189945191 / 190631428 / -0.4%	250627382 / 235596027 / +6.4%	0.76 / 0.81 / -6.3%
tpch_q22/datafusion:vortex-compact	26665729 / 26477316 / +0.7%	52780481 / 57150122 / -7.6%	0.51 / 0.46 / +9.0%

datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	86524065 / 86856845 / -0.4%	131227675 / 139790029 / -6.1%	0.66 / 0.62 / +6.1%
tpch_q02/datafusion:parquet	158096825 / 158804401 / -0.4%	185403396 / 185425079 / -0.0%	0.85 / 0.86 / -0.4%
tpch_q03/datafusion:parquet	142427664 / 143322823 / -0.6%	199118760 / 207168591 / -3.9%	0.72 / 0.69 / +3.4%
tpch_q04/datafusion:parquet	58779993 / 59604019 / -1.4%	98903608 / 106244368 / -6.9%	0.59 / 0.56 / +5.9%
tpch_q05/datafusion:parquet	181143108 / 182844935 / -0.9%	244778381 / 246724369 / -0.8%	0.74 / 0.74 / -0.1%
tpch_q06/datafusion:parquet	35256489 / 35311783 / -0.2%	79702713 / 87047714 / -8.4%	0.44 / 0.41 / +9.0%
tpch_q07/datafusion:parquet	229184227 / 230127371 / -0.4%	296225915 / 300195384 / -1.3%	0.77 / 0.77 / +0.9%
tpch_q08/datafusion:parquet	235562483 / 234208795 / +0.6%	301202357 / 309853786 / -2.8%	0.78 / 0.76 / +3.5%
tpch_q09/datafusion:parquet	313361588 / 319226176 / -1.8%	383981133 / 400271684 / -4.1%	0.82 / 0.80 / +2.3%
tpch_q10/datafusion:parquet	407333456 / 411686933 / -1.1%	462181253 / 466186576 / -0.9%	0.88 / 0.88 / -0.2%
tpch_q11/datafusion:parquet	104732761 / 106636824 / -1.8%	128052314 / 132388541 / -3.3%	0.82 / 0.81 / +1.5%
tpch_q12/datafusion:parquet	85252481 / 84374127 / +1.0%	128788963 / 129768519 / -0.8%	0.66 / 0.65 / +1.8%
tpch_q13/datafusion:parquet	227831543 / 227634635 / +0.1%	257934507 / 261106748 / -1.2%	0.88 / 0.87 / +1.3%
tpch_q14/datafusion:parquet	85654114 / 91022013 / -5.9%	197348489 / 202381905 / -2.5%	0.43 / 0.45 / -3.5%
tpch_q15/datafusion:parquet	90896456 / 90043037 / +0.9%	144144558 / 147958839 / -2.6%	0.63 / 0.61 / +3.6%
tpch_q16/datafusion:parquet	95788563 / 94284921 / +1.6%	121558321 / 124971902 / -2.7%	0.79 / 0.75 / +4.4%
tpch_q17/datafusion:parquet	218117786 / 215458976 / +1.2%	272849432 / 280623259 / -2.8%	0.80 / 0.77 / +4.1%
tpch_q18/datafusion:parquet	294046672 / 290572078 / +1.2%	331154004 / 335509112 / -1.3%	0.89 / 0.87 / +2.5%
tpch_q19/datafusion:parquet	109273414 / 108742186 / +0.5%	170521145 / 176000933 / -3.1%	0.64 / 0.62 / +3.7%
tpch_q20/datafusion:parquet	183491261 / 183684064 / -0.1%	249112693 / 251539717 / -1.0%	0.74 / 0.73 / +0.9%
tpch_q21/datafusion:parquet	244384440 / 245086417 / -0.3%	316123698 / 320096047 / -1.2%	0.77 / 0.77 / +1.0%
tpch_q22/datafusion:parquet	199854312 / 199031627 / +0.4%	223641013 / 223334425 / +0.1%	0.89 / 0.89 / +0.3%

duckdb / vortex-file-compressed / ns (0.993x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	56117914 / 54636026 / +2.7%	108719234 / 97253243 / +11.8% 🔴	0.52 / 0.56 / -8.1%
tpch_q02/duckdb:vortex-file-compressed	31305650 / 31915028 / -1.9%	45337332 / 47334703 / -4.2%	0.69 / 0.67 / +2.4%
tpch_q03/duckdb:vortex-file-compressed	58199608 / 56766761 / +2.5%	117822615 / 109846613 / +7.3%	0.49 / 0.52 / -4.4%
tpch_q04/duckdb:vortex-file-compressed	81271966 / 79321201 / +2.5%	125638560 / 121478200 / +3.4%	0.65 / 0.65 / -0.9%
tpch_q05/duckdb:vortex-file-compressed	64017398 / 64861896 / -1.3%	126286459 / 123010302 / +2.7%	0.51 / 0.53 / -3.9%
tpch_q06/duckdb:vortex-file-compressed	21620402 / 20940846 / +3.2%	72152002 / 71189208 / +1.4%	0.30 / 0.29 / +1.9%
tpch_q07/duckdb:vortex-file-compressed	60269705 / 61470565 / -2.0%	132147475 / 135691818 / -2.6%	0.46 / 0.45 / +0.7%
tpch_q08/duckdb:vortex-file-compressed	82693769 / 87975158 / -6.0%	158292507 / 159434442 / -0.7%	0.52 / 0.55 / -5.3%
tpch_q09/duckdb:vortex-file-compressed	164380818 / 168192597 / -2.3%	242341288 / 245685248 / -1.4%	0.68 / 0.68 / -0.9%
tpch_q10/duckdb:vortex-file-compressed	109828021 / 108590926 / +1.1%	167311440 / 179129694 / -6.6%	0.66 / 0.61 / +8.3%
tpch_q11/duckdb:vortex-file-compressed	16976374 / 17307601 / -1.9%	34412145 / 32375272 / +6.3%	0.49 / 0.53 / -7.7%
tpch_q12/duckdb:vortex-file-compressed	54111359 / 56713350 / -4.6%	104681261 / 118165750 / -11.4% 🟢	0.52 / 0.48 / +7.7%
tpch_q13/duckdb:vortex-file-compressed	90377540 / 90076971 / +0.3%	148001811 / 141256409 / +4.8%	0.61 / 0.64 / -4.2%
tpch_q14/duckdb:vortex-file-compressed	31693452 / 29717730 / +6.6%	81543933 / 76234433 / +7.0%	0.39 / 0.39 / -0.3%
tpch_q15/duckdb:vortex-file-compressed	41911544 / 38719181 / +8.2%	110311218 / 90869126 / +21.4% 🔴	0.38 / 0.43 / -10.8%
tpch_q16/duckdb:vortex-file-compressed	42262108 / 42306679 / -0.1%	53549951 / 52814842 / +1.4%	0.79 / 0.80 / -1.5%
tpch_q17/duckdb:vortex-file-compressed	55269103 / 63403348 / -12.8% 🟢	114271166 / 135653569 / -15.8% 🟢	0.48 / 0.47 / +3.5%
tpch_q18/duckdb:vortex-file-compressed	133009003 / 135281637 / -1.7%	161940765 / 167571821 / -3.4%	0.82 / 0.81 / +1.7%
tpch_q19/duckdb:vortex-file-compressed	40407850 / 42580084 / -5.1%	97801504 / 92789754 / +5.4%	0.41 / 0.46 / -10.0%
tpch_q20/duckdb:vortex-file-compressed	64319643 / 61113074 / +5.2%	139437080 / 137229771 / +1.6%	0.46 / 0.45 / +3.6%
tpch_q21/duckdb:vortex-file-compressed	232902632 / 238245172 / -2.2%	280368140 / 285531518 / -1.8%	0.83 / 0.83 / -0.4%
tpch_q22/duckdb:vortex-file-compressed	41180004 / 42518259 / -3.1%	64781829 / 65481172 / -1.1%	0.64 / 0.65 / -2.1%

duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	70091636 / 69820079 / +0.4%	111616515 / 115199190 / -3.1%	0.63 / 0.61 / +3.6%
tpch_q02/duckdb:vortex-compact	35082396 / 34613378 / +1.4%	52693751 / 52828179 / -0.3%	0.67 / 0.66 / +1.6%
tpch_q03/duckdb:vortex-compact	62541892 / 62395457 / +0.2%	106772004 / 103484515 / +3.2%	0.59 / 0.60 / -2.9%
tpch_q04/duckdb:vortex-compact	88238470 / 89034920 / -0.9%	116209983 / 120210893 / -3.3%	0.76 / 0.74 / +2.5%
tpch_q05/duckdb:vortex-compact	68176138 / 69657464 / -2.1%	123734046 / 119601875 / +3.5%	0.55 / 0.58 / -5.4%
tpch_q06/duckdb:vortex-compact	24659387 / 24822288 / -0.7%	65284131 / 65130782 / +0.2%	0.38 / 0.38 / -0.9%
tpch_q07/duckdb:vortex-compact	71478010 / 71338490 / +0.2%	138576779 / 144920361 / -4.4%	0.52 / 0.49 / +4.8%
tpch_q08/duckdb:vortex-compact	91225827 / 92265884 / -1.1%	150171474 / 149869673 / +0.2%	0.61 / 0.62 / -1.3%
tpch_q09/duckdb:vortex-compact	174347341 / 171963336 / +1.4%	233122875 / 243545461 / -4.3%	0.75 / 0.71 / +5.9%
tpch_q10/duckdb:vortex-compact	118846895 / 118801472 / +0.0%	163001314 / 171794130 / -5.1%	0.73 / 0.69 / +5.4%
tpch_q11/duckdb:vortex-compact	18833296 / 18862715 / -0.2%	33041087 / 37421675 / -11.7% 🟢	0.57 / 0.50 / +13.1%
tpch_q12/duckdb:vortex-compact	70063669 / 69959430 / +0.1%	112249804 / 114678481 / -2.1%	0.62 / 0.61 / +2.3%
tpch_q13/duckdb:vortex-compact	96352015 / 94497669 / +2.0%	149250284 / 149196005 / +0.0%	0.65 / 0.63 / +1.9%
tpch_q14/duckdb:vortex-compact	34432000 / 34364064 / +0.2%	73441732 / 78694592 / -6.7%	0.47 / 0.44 / +7.4%
tpch_q15/duckdb:vortex-compact	39212203 / 42842210 / -8.5%	87909599 / 98654880 / -10.9% 🟢	0.45 / 0.43 / +2.7%
tpch_q16/duckdb:vortex-compact	44025560 / 44059799 / -0.1%	55655773 / 56652953 / -1.8%	0.79 / 0.78 / +1.7%
tpch_q17/duckdb:vortex-compact	59102743 / 60553668 / -2.4%	115475990 / 113668701 / +1.6%	0.51 / 0.53 / -3.9%
tpch_q18/duckdb:vortex-compact	144067458 / 141741676 / +1.6%	165708211 / 162090955 / +2.2%	0.87 / 0.87 / -0.6%
tpch_q19/duckdb:vortex-compact	44417641 / 45440041 / -2.2%	90128253 / 87688678 / +2.8%	0.49 / 0.52 / -4.9%
tpch_q20/duckdb:vortex-compact	67587848 / 68884527 / -1.9%	133277688 / 133764765 / -0.4%	0.51 / 0.51 / -1.5%
tpch_q21/duckdb:vortex-compact	253126551 / 256033274 / -1.1%	289160510 / 289955641 / -0.3%	0.88 / 0.88 / -0.9%
tpch_q22/duckdb:vortex-compact	45404927 / 43991935 / +3.2%	66568949 / 67925408 / -2.0%	0.68 / 0.65 / +5.3%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	72566144 / 72605784 / -0.1%	87964954 / 90046538 / -2.3%	0.82 / 0.81 / +2.3%
tpch_q02/duckdb:parquet	80583822 / 80678131 / -0.1%	91125186 / 91701426 / -0.6%	0.88 / 0.88 / +0.5%
tpch_q03/duckdb:parquet	126259036 / 121918862 / +3.6%	150517378 / 165766270 / -9.2%	0.84 / 0.74 / +14.1%
tpch_q04/duckdb:parquet	75729171 / 76071588 / -0.5%	99063438 / 99955678 / -0.9%	0.76 / 0.76 / +0.4%
tpch_q05/duckdb:parquet	129629804 / 131084254 / -1.1%	172849224 / 165585287 / +4.4%	0.75 / 0.79 / -5.3%
tpch_q06/duckdb:parquet	34062427 / 34140940 / -0.2%	48575940 / 47922288 / +1.4%	0.70 / 0.71 / -1.6%
tpch_q07/duckdb:parquet	92522506 / 93657120 / -1.2%	142297963 / 144472286 / -1.5%	0.65 / 0.65 / +0.3%
tpch_q08/duckdb:parquet	150427942 / 153675623 / -2.1%	208117724 / 213915277 / -2.7%	0.72 / 0.72 / +0.6%
tpch_q09/duckdb:parquet	228276370 / 230297532 / -0.9%	263725663 / 267090457 / -1.3%	0.87 / 0.86 / +0.4%
tpch_q10/duckdb:parquet	511805328 / 513341544 / -0.3%	544634047 / 546242273 / -0.3%	0.94 / 0.94 / -0.0%
tpch_q11/duckdb:parquet	33650405 / 33683864 / -0.1%	38385277 / 38891779 / -1.3%	0.88 / 0.87 / +1.2%
tpch_q12/duckdb:parquet	77241449 / 77085360 / +0.2%	89841580 / 93901358 / -4.3%	0.86 / 0.82 / +4.7%
tpch_q13/duckdb:parquet	322275693 / 321687599 / +0.2%	334955081 / 335467835 / -0.2%	0.96 / 0.96 / +0.3%
tpch_q14/duckdb:parquet	109156679 / 111650479 / -2.2%	141611206 / 134822509 / +5.0%	0.77 / 0.83 / -6.9%
tpch_q15/duckdb:parquet	43346155 / 43430334 / -0.2%	69169514 / 85617755 / -19.2% 🟢	0.63 / 0.51 / +23.5%
tpch_q16/duckdb:parquet	117542290 / 118708680 / -1.0%	127587471 / 130723527 / -2.4%	0.92 / 0.91 / +1.5%
tpch_q17/duckdb:parquet	79905708 / 80506688 / -0.7%	106404753 / 109414537 / -2.8%	0.75 / 0.74 / +2.1%
tpch_q18/duckdb:parquet	214562393 / 215314660 / -0.3%	193320825 / 170851519 / +13.2% 🔴	1.11 / 1.26 / -11.9%
tpch_q19/duckdb:parquet	165296298 / 167284917 / -1.2%	196104974 / 201368060 / -2.6%	0.84 / 0.83 / +1.5%
tpch_q20/duckdb:parquet	135414465 / 135949382 / -0.4%	181772170 / 186949610 / -2.8%	0.74 / 0.73 / +2.4%
tpch_q21/duckdb:parquet	277517036 / 281108521 / -1.3%	285908806 / 291505602 / -1.9%	0.97 / 0.96 / +0.7%
tpch_q22/duckdb:parquet	267884677 / 267175347 / +0.3%	279483180 / 279265009 / +0.1%	0.96 / 0.96 / +0.2%

No file size changes detected.

github-actions · 2026-10-09T14:26:02Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 1ee71320 vs base 34148020
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.012x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed	1804774 / 1820713 / -0.9%	5710763 / 6284754 / -9.1%	0.32 / 0.29 / +9.1%
statpopgen_q01/datafusion:vortex-file-compressed	27242465 / 26988208 / +0.9%	21358484 / 22929268 / -6.9%	1.28 / 1.18 / +8.4%
statpopgen_q02/datafusion:vortex-file-compressed	108470350 / 112205712 / -3.3%	139684477 / 145697595 / -4.1%	0.78 / 0.77 / +0.8%
statpopgen_q03/datafusion:vortex-file-compressed	349357482 / 369904234 / -5.6%	443405917 / 390554713 / +13.5% 🔴	0.79 / 0.95 / -16.8%
statpopgen_q04/datafusion:vortex-file-compressed	348895334 / 363882528 / -4.1%	390048243 / 390205136 / -0.0%	0.89 / 0.93 / -4.1%
statpopgen_q05/datafusion:vortex-file-compressed	213755740 / 213847872 / -0.0%	386836717 / 285286249 / +35.6% 🔴	0.55 / 0.75 / -26.3%
statpopgen_q06/datafusion:vortex-file-compressed	762499344 / 748117658 / +1.9%	919683347 / 788743578 / +16.6% 🔴	0.83 / 0.95 / -12.6%
statpopgen_q07/datafusion:vortex-file-compressed	429501544 / 428943353 / +0.1%	445308467 / 449256120 / -0.9%	0.96 / 0.95 / +1.0%
statpopgen_q08/datafusion:vortex-file-compressed	427738474 / 431326230 / -0.8%	452622313 / 447805157 / +1.1%	0.95 / 0.96 / -1.9%
statpopgen_q09/datafusion:vortex-file-compressed	250375326 / 244435498 / +2.4%	290632294 / 288966492 / +0.6%	0.86 / 0.85 / +1.8%
statpopgen_q10/datafusion:vortex-file-compressed	759067213 / 744950196 / +1.9%	793231584 / 768496313 / +3.2%	0.96 / 0.97 / -1.3%

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact	1810864 / 1804284 / +0.4%	5624210 / 6103480 / -7.9%	0.32 / 0.30 / +8.9%
statpopgen_q01/datafusion:vortex-compact	25765191 / 26830697 / -4.0%	23185247 / 24382028 / -4.9%	1.11 / 1.10 / +1.0%
statpopgen_q02/datafusion:vortex-compact	213398349 / 213673144 / -0.1%	228497596 / 227969111 / +0.2%	0.93 / 0.94 / -0.4%
statpopgen_q03/datafusion:vortex-compact	461987326 / 464305209 / -0.5%	481179792 / 490805175 / -2.0%	0.96 / 0.95 / +1.5%
statpopgen_q04/datafusion:vortex-compact	462139508 / 464593150 / -0.5%	484601779 / 479110744 / +1.1%	0.95 / 0.97 / -1.7%
statpopgen_q05/datafusion:vortex-compact	317916334 / 314632803 / +1.0%	337926338 / 330052190 / +2.4%	0.94 / 0.95 / -1.3%
statpopgen_q06/datafusion:vortex-compact	879379124 / 880147776 / -0.1%	927411401 / 894828002 / +3.6%	0.95 / 0.98 / -3.6%
statpopgen_q07/datafusion:vortex-compact	969848120 / 970143428 / -0.0%	986396556 / 983916534 / +0.3%	0.98 / 0.99 / -0.3%
statpopgen_q08/datafusion:vortex-compact	973195503 / 979587620 / -0.7%	975464279 / 985426363 / -1.0%	1.00 / 0.99 / +0.4%
statpopgen_q09/datafusion:vortex-compact	367733079 / 364115840 / +1.0%	385710924 / 383897496 / +0.5%	0.95 / 0.95 / +0.5%
statpopgen_q10/datafusion:vortex-compact	981976698 / 972832206 / +0.9%	988504419 / 979063677 / +1.0%	0.99 / 0.99 / -0.0%

datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet	1979312 / 1988170 / -0.4%	89970390 / 89876269 / +0.1%	0.02 / 0.02 / -0.5%
statpopgen_q01/datafusion:parquet	161283494 / 159964856 / +0.8%	173063214 / 172852438 / +0.1%	0.93 / 0.93 / +0.7%
statpopgen_q02/datafusion:parquet	283366607 / 294195495 / -3.7%	405139095 / 420876657 / -3.7%	0.70 / 0.70 / +0.1%
statpopgen_q03/datafusion:parquet	392519147 / 391659588 / +0.2%	530503811 / 537380314 / -1.3%	0.74 / 0.73 / +1.5%
statpopgen_q04/datafusion:parquet	396530043 / 391262401 / +1.3%	505208678 / 504985011 / +0.0%	0.78 / 0.77 / +1.3%
statpopgen_q05/datafusion:parquet	323679542 / 314575950 / +2.9%	443721184 / 456476732 / -2.8%	0.73 / 0.69 / +5.9%
statpopgen_q06/datafusion:parquet	503980108 / 493670064 / +2.1%	575119743 / 641553753 / -10.4% 🟢	0.88 / 0.77 / +13.9%
statpopgen_q07/datafusion:parquet	431576533 / 448948104 / -3.9%	568208912 / 547752676 / +3.7%	0.76 / 0.82 / -7.3%
statpopgen_q08/datafusion:parquet	435747862 / 450383752 / -3.2%	541727345 / 544009041 / -0.4%	0.80 / 0.83 / -2.8%
statpopgen_q09/datafusion:parquet	367048969 / 366984667 / +0.0%	493311517 / 495325477 / -0.4%	0.74 / 0.74 / +0.4%
statpopgen_q10/datafusion:parquet	572803628 / 584367112 / -2.0%	690425667 / 647574818 / +6.6%	0.83 / 0.90 / -8.1%

duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	9011966 / 9034482 / -0.2%	9440940 / 9534031 / -1.0%	0.95 / 0.95 / +0.7%
statpopgen_q01/duckdb:vortex-file-compressed	10341744 / 10363598 / -0.2%	14213861 / 14558298 / -2.4%	0.73 / 0.71 / +2.2%
statpopgen_q02/duckdb:vortex-file-compressed	303652662 / 310670236 / -2.3%	360208020 / 351972741 / +2.3%	0.84 / 0.88 / -4.5%
statpopgen_q03/duckdb:vortex-file-compressed	818409427 / 815322034 / +0.4%	819640653 / 830146981 / -1.3%	1.00 / 0.98 / +1.7%
statpopgen_q04/duckdb:vortex-file-compressed	821841058 / 815572828 / +0.8%	837429621 / 818985193 / +2.3%	0.98 / 1.00 / -1.5%
statpopgen_q05/duckdb:vortex-file-compressed	322834040 / 318054005 / +1.5%	350484076 / 347468789 / +0.9%	0.92 / 0.92 / +0.6%
statpopgen_q06/duckdb:vortex-file-compressed	1140397031 / 1149459396 / -0.8%	1170979056 / 1157799853 / +1.1%	0.97 / 0.99 / -1.9%
statpopgen_q07/duckdb:vortex-file-compressed	382083493 / 376905114 / +1.4%	427202837 / 426372432 / +0.2%	0.89 / 0.88 / +1.2%
statpopgen_q08/duckdb:vortex-file-compressed	387262782 / 373380628 / +3.7%	433617717 / 383126854 / +13.2% 🔴	0.89 / 0.97 / -8.4%
statpopgen_q09/duckdb:vortex-file-compressed	617369169 / 618149156 / -0.1%	642923312 / 638859577 / +0.6%	0.96 / 0.97 / -0.8%
statpopgen_q10/duckdb:vortex-file-compressed	1909776674 / 1942897509 / -1.7%	1893661249 / 1897960470 / -0.2%	1.01 / 1.02 / -1.5%

duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	9016334 / 9098364 / -0.9%	9508816 / 9582706 / -0.8%	0.95 / 0.95 / -0.1%
statpopgen_q01/duckdb:vortex-compact	10210054 / 10285211 / -0.7%	13464484 / 13775406 / -2.3%	0.76 / 0.75 / +1.6%
statpopgen_q02/duckdb:vortex-compact	382584368 / 383385151 / -0.2%	400547311 / 398498454 / +0.5%	0.96 / 0.96 / -0.7%
statpopgen_q03/duckdb:vortex-compact	898124615 / 895974508 / +0.2%	906091238 / 904399747 / +0.2%	0.99 / 0.99 / +0.1%
statpopgen_q04/duckdb:vortex-compact	895831158 / 892026566 / +0.4%	898947652 / 908415588 / -1.0%	1.00 / 0.98 / +1.5%
statpopgen_q05/duckdb:vortex-compact	427838635 / 428284768 / -0.1%	438388790 / 435329761 / +0.7%	0.98 / 0.98 / -0.8%
statpopgen_q06/duckdb:vortex-compact	1171746138 / 1167871076 / +0.3%	1168103245 / 1174558186 / -0.5%	1.00 / 0.99 / +0.9%
statpopgen_q07/duckdb:vortex-compact	944045615 / 941131544 / +0.3%	936870515 / 935364461 / +0.2%	1.01 / 1.01 / +0.1%
statpopgen_q08/duckdb:vortex-compact	954630872 / 945458094 / +1.0%	965663645 / 955691490 / +1.0%	0.99 / 0.99 / -0.1%
statpopgen_q09/duckdb:vortex-compact	710669932 / 702562328 / +1.2%	737087506 / 705303134 / +4.5%	0.96 / 1.00 / -3.2%
statpopgen_q10/duckdb:vortex-compact	2023831168 / 2018293702 / +0.3%	1982414608 / 1973518490 / +0.5%	1.02 / 1.02 / -0.2%

duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	245758450 / 245773666 / -0.0%	245777787 / 246173926 / -0.2%	1.00 / 1.00 / +0.2%
statpopgen_q01/duckdb:parquet	300873137 / 302178788 / -0.4%	303332199 / 304727317 / -0.5%	0.99 / 0.99 / +0.0%
statpopgen_q02/duckdb:parquet	559890476 / 562545945 / -0.5%	561975011 / 621062527 / -9.5%	1.00 / 0.91 / +10.0%
statpopgen_q03/duckdb:parquet	851921266 / 876133948 / -2.8%	865226355 / 873132698 / -0.9%	0.98 / 1.00 / -1.9%
statpopgen_q04/duckdb:parquet	861581916 / 848743134 / +1.5%	859892820 / 842842721 / +2.0%	1.00 / 1.01 / -0.5%
statpopgen_q05/duckdb:parquet	594081350 / 616765721 / -3.7%	586921563 / 612484581 / -4.2%	1.01 / 1.01 / +0.5%
statpopgen_q06/duckdb:parquet	739059689 / 684927388 / +7.9%	718436981 / 694137293 / +3.5%	1.03 / 0.99 / +4.3%
statpopgen_q07/duckdb:parquet	609237156 / 608925012 / +0.1%	698770719 / 692403595 / +0.9%	0.87 / 0.88 / -0.9%
statpopgen_q08/duckdb:parquet	615582866 / 613230964 / +0.4%	703649628 / 699757819 / +0.6%	0.87 / 0.88 / -0.2%
statpopgen_q09/duckdb:parquet	828505439 / 806358661 / +2.7%	853240385 / 797161138 / +7.0%	0.97 / 1.01 / -4.0%
statpopgen_q10/duckdb:parquet	1476323312 / 1458008756 / +1.3%	1310675131 / 1257224830 / +4.3%	1.13 / 1.16 / -2.9%

No file size changes detected.

github-actions · 2026-10-09T14:26:10Z

Benchmarks: Compression 📖

Commits: PR 1ee71320 vs base 30e84dcc

vortex / vortex-file-compressed / ns (0.976x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
compress time/Arade	730097378 / 739797782 / -1.3%
compress time/Bimbo	3482639014 / 3542216786 / -1.7%
compress time/CMSprovider	2420496786 / 2444735924 / -1.0%
compress time/Euro2016	255348627 / 256507646 / -0.5%
compress time/Food	272430699 / 272396227 / +0.0%
compress time/HashTags	454948965 / 457274342 / -0.5%
compress time/TPC-H l_comment canonical	563821087 / 607076668 / -7.1%
compress time/TPC-H l_comment chunked	569736830 / 609598952 / -6.5%
compress time/taxi	377573706 / 382218579 / -1.2%
compress time/wide table cols=100 chunks=1 rows=1000	7120954 / 7364805 / -3.3%
compress time/wide table cols=100 chunks=50 rows=1000	7072409 / 7264446 / -2.6%
compress time/wide table cols=1000 chunks=1 rows=1000	70352321 / 71285815 / -1.3%
compress time/wide table cols=1000 chunks=50 rows=1000	70232762 / 73272322 / -4.1%
compress time/wide table cols=10000 chunks=1 rows=1000	770428940 / 773155658 / -0.4%
compress time/wide table cols=10000 chunks=50 rows=1000	772781231 / 786899252 / -1.8%
decompress time/Arade	9014960 / 9374478 / -3.8%
decompress time/Bimbo	38026986 / 38798405 / -2.0%
decompress time/CMSprovider	28291087 / 28876236 / -2.0%
decompress time/Euro2016	6945554 / 7401376 / -6.2%
decompress time/Food	2748034 / 2835560 / -3.1%
decompress time/HashTags	46218172 / 48326370 / -4.4%
decompress time/TPC-H l_comment canonical	20031474 / 21761255 / -7.9%
decompress time/TPC-H l_comment chunked	20965798 / 21764630 / -3.7%
decompress time/taxi	5680643 / 5484206 / +3.6%
decompress time/wide table cols=100 chunks=1 rows=1000	1917086 / 1932357 / -0.8%
decompress time/wide table cols=100 chunks=50 rows=1000	1925739 / 1955081 / -1.5%
decompress time/wide table cols=1000 chunks=1 rows=1000	18350003 / 18676966 / -1.8%
decompress time/wide table cols=1000 chunks=50 rows=1000	18362976 / 18885087 / -2.8%
decompress time/wide table cols=10000 chunks=1 rows=1000	219634455 / 217200014 / +1.1%
decompress time/wide table cols=10000 chunks=50 rows=1000	214046677 / 219029441 / -2.3%

vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
vortex-file-compressed size/Arade	142212268 / 142212268 / +0.0%
vortex-file-compressed size/Bimbo	458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider	420781172 / 420781172 / +0.0%
vortex-file-compressed size/Euro2016	164051500 / 164050964 / +0.0%
vortex-file-compressed size/Food	38949688 / 38949688 / +0.0%
vortex-file-compressed size/HashTags	190348476 / 190348476 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical	179857112 / 179857112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked	179857112 / 179857112 / +0.0%
vortex-file-compressed size/taxi	49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	93117680 / 93117680 / +0.0%

vortex / vortex-file-compressed / ratio (0.984x ➖, 0↑ 0↓)

name	ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade	0.324824921 / 0.328922384 / -1.2%
vortex:parquet-zstd ratio compress time/Bimbo	0.295236879 / 0.299551574 / -1.4%
vortex:parquet-zstd ratio compress time/CMSprovider	0.379321232 / 0.38194551 / -0.7%
vortex:parquet-zstd ratio compress time/Euro2016	0.237094635 / 0.237180981 / -0.0%
vortex:parquet-zstd ratio compress time/Food	0.368514957 / 0.367498734 / +0.3%
vortex:parquet-zstd ratio compress time/HashTags	0.249108259 / 0.250491139 / -0.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0.214832923 / 0.231065491 / -7.0%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0.216503365 / 0.232005701 / -6.7%
vortex:parquet-zstd ratio compress time/taxi	0.346786118 / 0.350497778 / -1.1%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1.77968991 / 1.85063858 / -3.8%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	1.7720708 / 1.82699123 / -3.0%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1.57357004 / 1.57473432 / -0.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1.56809072 / 1.65345323 / -5.2%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1.66688614 / 1.68226137 / -0.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1.64119335 / 1.73981659 / -5.7%
vortex:parquet-zstd ratio decompress time/Arade	0.0161602315 / 0.016784569 / -3.7%
vortex:parquet-zstd ratio decompress time/Bimbo	0.0237158786 / 0.0239666195 / -1.0%
vortex:parquet-zstd ratio decompress time/CMSprovider	0.0207454782 / 0.0210291917 / -1.3%
vortex:parquet-zstd ratio decompress time/Euro2016	0.0208337345 / 0.0221895894 / -6.1%
vortex:parquet-zstd ratio decompress time/Food	0.0161544276 / 0.0166037869 / -2.7%
vortex:parquet-zstd ratio decompress time/HashTags	0.0894922827 / 0.0934062946 / -4.2%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0.0401163136 / 0.0436667391 / -8.1%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0.0420504503 / 0.0436950499 / -3.8%
vortex:parquet-zstd ratio decompress time/taxi	0.0260845265 / 0.0251397813 / +3.8%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	0.922407235 / 0.939310007 / -1.8%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	0.939669529 / 0.950334329 / -1.1%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.782696791 / 0.762645547 / +2.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.784684249 / 0.801841931 / -2.1%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.899476754 / 0.892344435 / +0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.853352771 / 0.897189012 / -4.9%
vortex:parquet-zstd size/Arade	0.55117983 / 0.55117983 / +0.0%
vortex:parquet-zstd size/Bimbo	1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider	1.11646237 / 1.11646237 / -0.0%
vortex:parquet-zstd size/Euro2016	1.33397925 / 1.3339749 / +0.0%
vortex:parquet-zstd size/Food	1.09104296 / 1.09104296 / -0.0%
vortex:parquet-zstd size/HashTags	1.42585702 / 1.42585702 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical	1.13576101 / 1.13576101 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked	1.13576101 / 1.13576101 / +0.0%
vortex:parquet-zstd size/taxi	0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0.998688074 / 0.998688074 / -0.0%

vortex / parquet / ns (1.000x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade	2247664299 / 2249156085 / -0.1%
parquet_rs-zstd compress time/Bimbo	11796083965 / 11825064853 / -0.2%
parquet_rs-zstd compress time/CMSprovider	6381126562 / 6400745285 / -0.3%
parquet_rs-zstd compress time/Euro2016	1076990321 / 1081484886 / -0.4%
parquet_rs-zstd compress time/Food	739266328 / 741216776 / -0.3%
parquet_rs-zstd compress time/HashTags	1826310245 / 1825511050 / +0.0%
parquet_rs-zstd compress time/TPC-H l_comment canonical	2624463138 / 2627292656 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked	2631537988 / 2627517127 / +0.2%
parquet_rs-zstd compress time/taxi	1088779759 / 1090502147 / -0.2%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	4001233 / 3979602 / +0.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	3991042 / 3976180 / +0.4%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	44708732 / 45268471 / -1.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	44788711 / 44314723 / +1.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	462196501 / 459593065 / +0.6%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	470865442 / 452288624 / +4.1%
parquet_rs-zstd decompress time/Arade	557848443 / 558517648 / -0.1%
parquet_rs-zstd decompress time/Bimbo	1603439901 / 1618851798 / -1.0%
parquet_rs-zstd decompress time/CMSprovider	1363723058 / 1373150068 / -0.7%
parquet_rs-zstd decompress time/Euro2016	333380172 / 333551733 / -0.1%
parquet_rs-zstd decompress time/Food	170110267 / 170777908 / -0.4%
parquet_rs-zstd decompress time/HashTags	516448688 / 517378087 / -0.2%
parquet_rs-zstd decompress time/TPC-H l_comment canonical	499334864 / 498348525 / +0.2%
parquet_rs-zstd decompress time/TPC-H l_comment chunked	498586766 / 498102876 / +0.1%
parquet_rs-zstd decompress time/taxi	217778268 / 218148517 / -0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2078351 / 2057209 / +1.0%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2049379 / 2057256 / -0.4%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	23444587 / 24489707 / -4.3%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	23401739 / 23552132 / -0.6%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	244180246 / 243403786 / +0.3%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	250830236 / 244128537 / +2.7%

vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
parquet size/Arade	258014282 / 258014282 / +0.0%
parquet size/Bimbo	384517292 / 384517292 / +0.0%
parquet size/CMSprovider	376887911 / 376887911 / +0.0%
parquet size/Euro2016	122979049 / 122979049 / +0.0%
parquet size/Food	35699500 / 35699500 / +0.0%
parquet size/HashTags	133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical	158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked	158358238 / 158358238 / +0.0%
parquet size/taxi	55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004 / 93240004 / +0.0%

vortex / arrow-ipc / ns (0.987x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
arrow-ipc compress time/Arade	98651077 / 100397960 / -1.7%
arrow-ipc compress time/Bimbo	620337228 / 632148247 / -1.9%
arrow-ipc compress time/CMSprovider	382866598 / 387760687 / -1.3%
arrow-ipc compress time/Euro2016	38410329 / 38851160 / -1.1%
arrow-ipc compress time/Food	33644936 / 34115880 / -1.4%
arrow-ipc compress time/HashTags	78974738 / 79359096 / -0.5%
arrow-ipc compress time/TPC-H l_comment canonical	496397966 / 520186775 / -4.6%
arrow-ipc compress time/TPC-H l_comment chunked	500967588 / 526324942 / -4.8%
arrow-ipc compress time/taxi	74882450 / 75755994 / -1.2%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000	204767 / 206523 / -0.9%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000	203706 / 207428 / -1.8%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000	2248787 / 2284517 / -1.6%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000	2229391 / 2282798 / -2.3%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000	25563454 / 25965725 / -1.5%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000	25827624 / 26054387 / -0.9%
arrow-ipc decompress time/Arade	140192699 / 141057916 / -0.6%
arrow-ipc decompress time/Bimbo	404906282 / 406688076 / -0.4%
arrow-ipc decompress time/CMSprovider	581677168 / 583259083 / -0.3%
arrow-ipc decompress time/Euro2016	63880981 / 64222619 / -0.5%
arrow-ipc decompress time/Food	48718989 / 48808064 / -0.2%
arrow-ipc decompress time/HashTags	121335624 / 120560414 / +0.6%
arrow-ipc decompress time/TPC-H l_comment canonical	530820101 / 534227021 / -0.6%
arrow-ipc decompress time/TPC-H l_comment chunked	532059305 / 530759802 / +0.2%
arrow-ipc decompress time/taxi	45362204 / 45526844 / -0.4%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000	321922 / 324582 / -0.8%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000	319249 / 318471 / +0.2%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000	3502732 / 3693090 / -5.2%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000	3637339 / 3699497 / -1.7%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000	35812601 / 36346401 / -1.5%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000	36799733 / 37362839 / -1.5%

vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
arrow-ipc size/Arade	691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo	3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider	2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016	360582666 / 360582666 / +0.0%
arrow-ipc size/Food	255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags	704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical	4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked	4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi	482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000	125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000	125752506 / 125752506 / +0.0%

Tests that built decimals with storage wider than their precision allows now use the bounded width, or a precision that admits the width they exercise. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

github-actions · 2026-10-09T14:30:06Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 1ee71320 vs base 34148020
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.1%
Engines: DataFusion No clear signal (+9.1%, environment too noisy confidence) · DuckDB No clear signal (+5.2%, environment too noisy confidence)
Vortex (geomean): hot 1.062x ➖ · cold 1.048x ➖
Parquet (geomean): hot 0.992x ➖ · cold 1.012x ➖
Shifts: Parquet (control) -0.8% · Median polish +4.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.032x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	241885803 / 213915410 / +13.1%	1027012674 / 650386308 / +57.9% 🔴	0.24 / 0.33 / -28.4%
tpch_q02/datafusion:vortex-file-compressed	340986156 / 350529562 / -2.7%	1030570497 / 809535158 / +27.3%	0.33 / 0.43 / -23.6%
tpch_q03/datafusion:vortex-file-compressed	430589144 / 401077923 / +7.4%	958967816 / 1314739665 / -27.1%	0.45 / 0.31 / +47.2%
tpch_q04/datafusion:vortex-file-compressed	189577868 / 199741220 / -5.1%	448615886 / 501956200 / -10.6%	0.42 / 0.40 / +6.2%
tpch_q05/datafusion:vortex-file-compressed	432067152 / 408647219 / +5.7%	613478250 / 629034879 / -2.5%	0.70 / 0.65 / +8.4%
tpch_q06/datafusion:vortex-file-compressed	273603949 / 269628979 / +1.5%	591134170 / 495187034 / +19.4%	0.46 / 0.54 / -15.0%
tpch_q07/datafusion:vortex-file-compressed	554182771 / 398540264 / +39.1% 🔴	945355292 / 571720186 / +65.4% 🔴	0.59 / 0.70 / -15.9%
tpch_q08/datafusion:vortex-file-compressed	518040102 / 544230950 / -4.8%	635556496 / 770702530 / -17.5%	0.82 / 0.71 / +15.4%
tpch_q09/datafusion:vortex-file-compressed	331970605 / 463827424 / -28.4%	541020790 / 562245648 / -3.8%	0.61 / 0.82 / -25.6%
tpch_q10/datafusion:vortex-file-compressed	451042153 / 441833531 / +2.1%	611528573 / 873747454 / -30.0% 🟢	0.74 / 0.51 / +45.9%
tpch_q11/datafusion:vortex-file-compressed	335657598 / 325646456 / +3.1%	460415770 / 437788450 / +5.2%	0.73 / 0.74 / -2.0%
tpch_q12/datafusion:vortex-file-compressed	343480089 / 309686314 / +10.9%	788360369 / 535785668 / +47.1% 🔴	0.44 / 0.58 / -24.6%
tpch_q13/datafusion:vortex-file-compressed	144476893 / 168607815 / -14.3%	466447681 / 455254878 / +2.5%	0.31 / 0.37 / -16.4%
tpch_q14/datafusion:vortex-file-compressed	193391268 / 225260969 / -14.1%	446613536 / 416821286 / +7.1%	0.43 / 0.54 / -19.9%
tpch_q15/datafusion:vortex-file-compressed	374474216 / 333282559 / +12.4%	609912822 / 540729308 / +12.8%	0.61 / 0.62 / -0.4%
tpch_q16/datafusion:vortex-file-compressed	163617968 / 184754764 / -11.4%	274995689 / 313173236 / -12.2%	0.59 / 0.59 / +0.9%
tpch_q17/datafusion:vortex-file-compressed	458475919 / 326188262 / +40.6% 🔴	492234465 / 463278895 / +6.3%	0.93 / 0.70 / +32.3%
tpch_q18/datafusion:vortex-file-compressed	300248713 / 393772298 / -23.8%	426595917 / 551047407 / -22.6%	0.70 / 0.71 / -1.5%
tpch_q19/datafusion:vortex-file-compressed	402848547 / 346329023 / +16.3%	529590412 / 540485874 / -2.0%	0.76 / 0.64 / +18.7%
tpch_q20/datafusion:vortex-file-compressed	293856350 / 285776260 / +2.8%	459747531 / 497957000 / -7.7%	0.64 / 0.57 / +11.4%
tpch_q21/datafusion:vortex-file-compressed	535388837 / 523015866 / +2.4%	945510920 / 784381337 / +20.5%	0.57 / 0.67 / -15.1%
tpch_q22/datafusion:vortex-file-compressed	295809716 / 189224162 / +56.3% 🔴	403996036 / 491586515 / -17.8%	0.73 / 0.38 / +90.2%

datafusion / vortex-compact / ns (1.091x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	233079313 / 249193535 / -6.5%	725364520 / 781047677 / -7.1%	0.32 / 0.32 / +0.7%
tpch_q02/datafusion:vortex-compact	357591227 / 327178639 / +9.3%	932350365 / 612410065 / +52.2% 🔴	0.38 / 0.53 / -28.2%
tpch_q03/datafusion:vortex-compact	376008969 / 497539930 / -24.4%	752589319 / 1038113990 / -27.5%	0.50 / 0.48 / +4.2%
tpch_q04/datafusion:vortex-compact	199733145 / 195289256 / +2.3%	453625730 / 393520123 / +15.3%	0.44 / 0.50 / -11.3%
tpch_q05/datafusion:vortex-compact	617522945 / 396915637 / +55.6% 🔴	779625234 / 738527681 / +5.6%	0.79 / 0.54 / +47.4%
tpch_q06/datafusion:vortex-compact	322501287 / 297334255 / +8.5%	462720337 / 399455514 / +15.8%	0.70 / 0.74 / -6.4%
tpch_q07/datafusion:vortex-compact	391360853 / 362364842 / +8.0%	594074027 / 572746279 / +3.7%	0.66 / 0.63 / +4.1%
tpch_q08/datafusion:vortex-compact	430368251 / 510370761 / -15.7%	696056419 / 641843255 / +8.4%	0.62 / 0.80 / -22.2%
tpch_q09/datafusion:vortex-compact	311909008 / 421693837 / -26.0%	571712011 / 706924962 / -19.1%	0.55 / 0.60 / -8.5%
tpch_q10/datafusion:vortex-compact	364726105 / 383838195 / -5.0%	528640257 / 466287704 / +13.4%	0.69 / 0.82 / -16.2%
tpch_q11/datafusion:vortex-compact	437190484 / 292998374 / +49.2% 🔴	437279579 / 418491739 / +4.5%	1.00 / 0.70 / +42.8%
tpch_q12/datafusion:vortex-compact	506819783 / 291709086 / +73.7% 🔴	784922192 / 436230175 / +79.9% 🔴	0.65 / 0.67 / -3.4%
tpch_q13/datafusion:vortex-compact	212573709 / 118471388 / +79.4% 🔴	422473902 / 331751434 / +27.3%	0.50 / 0.36 / +40.9%
tpch_q14/datafusion:vortex-compact	196749146 / 188864637 / +4.2%	371206248 / 302020845 / +22.9%	0.53 / 0.63 / -15.2%
tpch_q15/datafusion:vortex-compact	358070798 / 311030391 / +15.1%	518191960 / 554826067 / -6.6%	0.69 / 0.56 / +23.3%
tpch_q16/datafusion:vortex-compact	203999784 / 168721941 / +20.9%	353779535 / 263006038 / +34.5% 🔴	0.58 / 0.64 / -10.1%
tpch_q17/datafusion:vortex-compact	334487165 / 480392552 / -30.4% 🟢	494677833 / 526675305 / -6.1%	0.68 / 0.91 / -25.9%
tpch_q18/datafusion:vortex-compact	330752276 / 301313720 / +9.8%	491804950 / 657499505 / -25.2%	0.67 / 0.46 / +46.8%
tpch_q19/datafusion:vortex-compact	495530345 / 446708781 / +10.9%	603434424 / 521307744 / +15.8%	0.82 / 0.86 / -4.2%
tpch_q20/datafusion:vortex-compact	333211965 / 293114025 / +13.7%	718050791 / 459329208 / +56.3% 🔴	0.46 / 0.64 / -27.3%
tpch_q21/datafusion:vortex-compact	504590707 / 497221992 / +1.5%	620697295 / 707855873 / -12.3%	0.81 / 0.70 / +15.7%
tpch_q22/datafusion:vortex-compact	218367844 / 179655581 / +21.5%	360000951 / 405169930 / -11.1%	0.61 / 0.44 / +36.8%

datafusion / parquet / ns (0.973x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	165241227 / 177378928 / -6.8%	462938640 / 462543420 / +0.1%	0.36 / 0.38 / -6.9%
tpch_q02/datafusion:parquet	324031163 / 268456685 / +20.7%	526389318 / 477409925 / +10.3%	0.62 / 0.56 / +9.5%
tpch_q03/datafusion:parquet	265272462 / 283399032 / -6.4%	774299594 / 708809125 / +9.2%	0.34 / 0.40 / -14.3%
tpch_q04/datafusion:parquet	214079716 / 187719951 / +14.0%	413825028 / 370458529 / +11.7%	0.52 / 0.51 / +2.1%
tpch_q05/datafusion:parquet	402161368 / 354470341 / +13.5%	534650290 / 474264889 / +12.7%	0.75 / 0.75 / +0.6%
tpch_q06/datafusion:parquet	132895980 / 126970630 / +4.7%	253156825 / 277780070 / -8.9%	0.52 / 0.46 / +14.8%
tpch_q07/datafusion:parquet	332503570 / 346430689 / -4.0%	472126606 / 469133218 / +0.6%	0.70 / 0.74 / -4.6%
tpch_q08/datafusion:parquet	429719042 / 474601333 / -9.5%	512634293 / 750820692 / -31.7% 🟢	0.84 / 0.63 / +32.6%
tpch_q09/datafusion:parquet	398233187 / 449845947 / -11.5%	605394788 / 597593401 / +1.3%	0.66 / 0.75 / -12.6%
tpch_q10/datafusion:parquet	347061459 / 356185263 / -2.6%	456481937 / 445962487 / +2.4%	0.76 / 0.80 / -4.8%
tpch_q11/datafusion:parquet	263402890 / 249297589 / +5.7%	428083682 / 416116926 / +2.9%	0.62 / 0.60 / +2.7%
tpch_q12/datafusion:parquet	197694939 / 193023283 / +2.4%	364887562 / 347022286 / +5.1%	0.54 / 0.56 / -2.6%
tpch_q13/datafusion:parquet	364938962 / 365190565 / -0.1%	564660755 / 587943662 / -4.0%	0.65 / 0.62 / +4.1%
tpch_q14/datafusion:parquet	164947374 / 241532905 / -31.7% 🟢	334659164 / 356921998 / -6.2%	0.49 / 0.68 / -27.2%
tpch_q15/datafusion:parquet	343543401 / 352202321 / -2.5%	638871351 / 565938639 / +12.9%	0.54 / 0.62 / -13.6%
tpch_q16/datafusion:parquet	111092729 / 115209167 / -3.6%	320392268 / 267229639 / +19.9%	0.35 / 0.43 / -19.6%
tpch_q17/datafusion:parquet	293496939 / 383134171 / -23.4%	483423501 / 515290285 / -6.2%	0.61 / 0.74 / -18.3%
tpch_q18/datafusion:parquet	390108243 / 395334676 / -1.3%	562429510 / 569944294 / -1.3%	0.69 / 0.69 / -0.0%
tpch_q19/datafusion:parquet	172886078 / 183632296 / -5.9%	386148130 / 340188908 / +13.5%	0.45 / 0.54 / -17.1%
tpch_q20/datafusion:parquet	298015476 / 287118386 / +3.8%	427103006 / 490104018 / -12.9%	0.70 / 0.59 / +19.1%
tpch_q21/datafusion:parquet	324740384 / 376300788 / -13.7%	456306075 / 487933398 / -6.5%	0.71 / 0.77 / -7.7%
tpch_q22/datafusion:parquet	176988684 / 153729687 / +15.1%	397005298 / 347282494 / +14.3%	0.45 / 0.44 / +0.7%

duckdb / vortex-file-compressed / ns (1.058x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	197767055 / 196300973 / +0.7%	458105140 / 257661314 / +77.8% 🔴	0.43 / 0.76 / -43.3%
tpch_q02/duckdb:vortex-file-compressed	441684708 / 402963337 / +9.6%	452488758 / 418610877 / +8.1%	0.98 / 0.96 / +1.4%
tpch_q03/duckdb:vortex-file-compressed	710344479 / 531230217 / +33.7% 🔴	748485750 / 522818375 / +43.2% 🔴	0.95 / 1.02 / -6.6%
tpch_q04/duckdb:vortex-file-compressed	293660027 / 298755777 / -1.7%	374800653 / 305235426 / +22.8%	0.78 / 0.98 / -19.9%
tpch_q05/duckdb:vortex-file-compressed	466905303 / 444273460 / +5.1%	500632104 / 520828571 / -3.9%	0.93 / 0.85 / +9.3%
tpch_q06/duckdb:vortex-file-compressed	331161603 / 265895167 / +24.5%	337338838 / 314409812 / +7.3%	0.98 / 0.85 / +16.1%
tpch_q07/duckdb:vortex-file-compressed	497843730 / 506160565 / -1.6%	531692124 / 571749743 / -7.0%	0.94 / 0.89 / +5.8%
tpch_q08/duckdb:vortex-file-compressed	679120804 / 642968547 / +5.6%	708885356 / 635761857 / +11.5%	0.96 / 1.01 / -5.3%
tpch_q09/duckdb:vortex-file-compressed	560965748 / 457973118 / +22.5%	527473135 / 504838439 / +4.5%	1.06 / 0.91 / +17.2%
tpch_q10/duckdb:vortex-file-compressed	509504426 / 517815388 / -1.6%	590075711 / 507250807 / +16.3%	0.86 / 1.02 / -15.4%
tpch_q11/duckdb:vortex-file-compressed	203265780 / 195407076 / +4.0%	209497380 / 200048543 / +4.7%	0.97 / 0.98 / -0.7%
tpch_q12/duckdb:vortex-file-compressed	450363912 / 427850475 / +5.3%	538667828 / 529240092 / +1.8%	0.84 / 0.81 / +3.4%
tpch_q13/duckdb:vortex-file-compressed	321281382 / 340996228 / -5.8%	297362230 / 560809598 / -47.0% 🟢	1.08 / 0.61 / +77.7%
tpch_q14/duckdb:vortex-file-compressed	237856546 / 233897307 / +1.7%	276191100 / 264162829 / +4.6%	0.86 / 0.89 / -2.7%
tpch_q15/duckdb:vortex-file-compressed	183304675 / 192428720 / -4.7%	203496406 / 213977747 / -4.9%	0.90 / 0.90 / +0.2%
tpch_q16/duckdb:vortex-file-compressed	215587844 / 193273876 / +11.5%	394445462 / 182547606 / +116.1% 🔴	0.55 / 1.06 / -48.4%
tpch_q17/duckdb:vortex-file-compressed	440478054 / 421872276 / +4.4%	505359621 / 473774309 / +6.7%	0.87 / 0.89 / -2.1%
tpch_q18/duckdb:vortex-file-compressed	348976897 / 330955359 / +5.4%	456953020 / 506677773 / -9.8%	0.76 / 0.65 / +16.9%
tpch_q19/duckdb:vortex-file-compressed	344638977 / 327184094 / +5.3%	421434433 / 290330063 / +45.2% 🔴	0.82 / 1.13 / -27.4%
tpch_q20/duckdb:vortex-file-compressed	407742570 / 344309619 / +18.4%	448088525 / 402382147 / +11.4%	0.91 / 0.86 / +6.3%
tpch_q21/duckdb:vortex-file-compressed	652453376 / 662409384 / -1.5%	708490771 / 698283407 / +1.5%	0.92 / 0.95 / -2.9%
tpch_q22/duckdb:vortex-file-compressed	194340469 / 199822618 / -2.7%	219670264 / 202318455 / +8.6%	0.88 / 0.99 / -10.4%

duckdb / vortex-compact / ns (1.069x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	220456912 / 210108399 / +4.9%	235954973 / 337500630 / -30.1% 🟢	0.93 / 0.62 / +50.1%
tpch_q02/duckdb:vortex-compact	424624656 / 404442375 / +5.0%	476485649 / 499429826 / -4.6%	0.89 / 0.81 / +10.0%
tpch_q03/duckdb:vortex-compact	471536953 / 384128560 / +22.8%	463985972 / 417970013 / +11.0%	1.02 / 0.92 / +10.6%
tpch_q04/duckdb:vortex-compact	264641670 / 224102206 / +18.1%	277561152 / 256009691 / +8.4%	0.95 / 0.88 / +8.9%
tpch_q05/duckdb:vortex-compact	418271970 / 395773504 / +5.7%	451828752 / 448807599 / +0.7%	0.93 / 0.88 / +5.0%
tpch_q06/duckdb:vortex-compact	308245253 / 294273487 / +4.7%	287914666 / 278709384 / +3.3%	1.07 / 1.06 / +1.4%
tpch_q07/duckdb:vortex-compact	489688737 / 454035751 / +7.9%	494963103 / 460266257 / +7.5%	0.99 / 0.99 / +0.3%
tpch_q08/duckdb:vortex-compact	629284065 / 569161631 / +10.6%	660887035 / 610923466 / +8.2%	0.95 / 0.93 / +2.2%
tpch_q09/duckdb:vortex-compact	489084312 / 500315150 / -2.2%	490291064 / 430663668 / +13.8%	1.00 / 1.16 / -14.1%
tpch_q10/duckdb:vortex-compact	444184827 / 404461071 / +9.8%	423352849 / 431531530 / -1.9%	1.05 / 0.94 / +11.9%
tpch_q11/duckdb:vortex-compact	190153081 / 190033005 / +0.1%	187673198 / 220550435 / -14.9%	1.01 / 0.86 / +17.6%
tpch_q12/duckdb:vortex-compact	588872449 / 435442774 / +35.2% 🔴	658975048 / 628046351 / +4.9%	0.89 / 0.69 / +28.9%
tpch_q13/duckdb:vortex-compact	242319342 / 213623050 / +13.4%	271170644 / 247350355 / +9.6%	0.89 / 0.86 / +3.5%
tpch_q14/duckdb:vortex-compact	252775493 / 249561043 / +1.3%	373174449 / 305569707 / +22.1%	0.68 / 0.82 / -17.1%
tpch_q15/duckdb:vortex-compact	159808711 / 164550073 / -2.9%	193745419 / 355321044 / -45.5% 🟢	0.82 / 0.46 / +78.1%
tpch_q16/duckdb:vortex-compact	182243555 / 184076111 / -1.0%	179302104 / 203844395 / -12.0%	1.02 / 0.90 / +12.6%
tpch_q17/duckdb:vortex-compact	416866925 / 430734612 / -3.2%	488371374 / 410794618 / +18.9%	0.85 / 1.05 / -18.6%
tpch_q18/duckdb:vortex-compact	337731800 / 334312689 / +1.0%	339263493 / 384198483 / -11.7%	1.00 / 0.87 / +14.4%
tpch_q19/duckdb:vortex-compact	415221144 / 350826953 / +18.4%	359904036 / 351495952 / +2.4%	1.15 / 1.00 / +15.6%
tpch_q20/duckdb:vortex-compact	426311214 / 387225670 / +10.1%	436312594 / 422302886 / +3.3%	0.98 / 0.92 / +6.6%
tpch_q21/duckdb:vortex-compact	569682554 / 568267140 / +0.2%	606679693 / 641165698 / -5.4%	0.94 / 0.89 / +5.9%
tpch_q22/duckdb:vortex-compact	176900621 / 177827202 / -0.5%	205316042 / 182271012 / +12.6%	0.86 / 0.98 / -11.7%

duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	304070805 / 320671527 / -5.2%	320852258 / 408235830 / -21.4%	0.95 / 0.79 / +20.6%
tpch_q02/duckdb:parquet	637806306 / 650192997 / -1.9%	613073106 / 857864058 / -28.5%	1.04 / 0.76 / +37.3%
tpch_q03/duckdb:parquet	796054373 / 772079896 / +3.1%	815034986 / 752922697 / +8.2%	0.98 / 1.03 / -4.8%
tpch_q04/duckdb:parquet	512742191 / 465047640 / +10.3%	668222894 / 482593622 / +38.5% 🔴	0.77 / 0.96 / -20.4%
tpch_q05/duckdb:parquet	953965870 / 880906375 / +8.3%	1023759491 / 842116472 / +21.6%	0.93 / 1.05 / -10.9%
tpch_q06/duckdb:parquet	311412030 / 334930288 / -7.0%	324834495 / 311350447 / +4.3%	0.96 / 1.08 / -10.9%
tpch_q07/duckdb:parquet	889629634 / 912303252 / -2.5%	853696330 / 989394275 / -13.7%	1.04 / 0.92 / +13.0%
tpch_q08/duckdb:parquet	1111864182 / 1056559583 / +5.2%	994550754 / 1273758714 / -21.9%	1.12 / 0.83 / +34.8%
tpch_q09/duckdb:parquet	1029891965 / 1108976930 / -7.1%	1114346444 / 1090491450 / +2.2%	0.92 / 1.02 / -9.1%
tpch_q10/duckdb:parquet	936942387 / 899713899 / +4.1%	956416913 / 894137799 / +7.0%	0.98 / 1.01 / -2.6%
tpch_q11/duckdb:parquet	441699105 / 414108235 / +6.7%	429741133 / 441165175 / -2.6%	1.03 / 0.94 / +9.5%
tpch_q12/duckdb:parquet	540450790 / 554203519 / -2.5%	665038210 / 515099453 / +29.1%	0.81 / 1.08 / -24.5%
tpch_q13/duckdb:parquet	713719541 / 677695280 / +5.3%	772098456 / 871463005 / -11.4%	0.92 / 0.78 / +18.9%
tpch_q14/duckdb:parquet	502330789 / 491839109 / +2.1%	518029838 / 519633408 / -0.3%	0.97 / 0.95 / +2.4%
tpch_q15/duckdb:parquet	417307278 / 348523518 / +19.7%	334390918 / 402726469 / -17.0%	1.25 / 0.87 / +44.2%
tpch_q16/duckdb:parquet	489558134 / 555887688 / -11.9%	579387064 / 527492272 / +9.8%	0.84 / 1.05 / -19.8%
tpch_q17/duckdb:parquet	442258685 / 476225485 / -7.1%	463458118 / 407632776 / +13.7%	0.95 / 1.17 / -18.3%
tpch_q18/duckdb:parquet	613867713 / 590975263 / +3.9%	669075658 / 557113778 / +20.1%	0.92 / 1.06 / -13.5%
tpch_q19/duckdb:parquet	634927589 / 548009467 / +15.9%	685620302 / 583872417 / +17.4%	0.93 / 0.94 / -1.3%
tpch_q20/duckdb:parquet	788474679 / 926833275 / -14.9%	841013478 / 841006627 / +0.0%	0.94 / 1.10 / -14.9%
tpch_q21/duckdb:parquet	713848904 / 656008725 / +8.8%	707571300 / 797051493 / -11.2%	1.01 / 0.82 / +22.6%
tpch_q22/duckdb:parquet	380753728 / 387769921 / -1.8%	456839872 / 395990241 / +15.4%	0.83 / 0.98 / -14.9%

github-actions · 2026-10-09T14:31:15Z

Benchmarks: Random Access (S3) 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Engines: random-access No clear signal (+0.5%, environment too noisy confidence)
Vortex (geomean): hot 1.024x ➖
Parquet (geomean): hot 1.019x ➖
Shifts: Parquet (control) +1.9% · Median polish +0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3	44327239 / 46163313 / -4.0%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer	124470916 / 111762573 / +11.4%
random-access/feature-vectors/uniform/vortex-tokio-s3	96377969 / 82575486 / +16.7%
random-access/feature-vectors/uniform/vortex-tokio-s3-footer	205476701 / 151886741 / +35.3% 🔴
random-access/nested-lists/correlated/vortex-tokio-s3	50879173 / 40984817 / +24.1%
random-access/nested-lists/correlated/vortex-tokio-s3-footer	100794572 / 82896579 / +21.6%
random-access/nested-lists/uniform/vortex-tokio-s3	161990672 / 160157205 / +1.1%
random-access/nested-lists/uniform/vortex-tokio-s3-footer	202777288 / 201827989 / +0.5%
random-access/nested-structs/correlated/vortex-tokio-s3	50494212 / 64856948 / -22.1%
random-access/nested-structs/correlated/vortex-tokio-s3-footer	94384580 / 107533547 / -12.2%
random-access/nested-structs/uniform/vortex-tokio-s3	168508604 / 171191873 / -1.6%
random-access/nested-structs/uniform/vortex-tokio-s3-footer	210749154 / 210829936 / -0.0%
random-access/taxi/correlated/vortex-tokio-s3	71953960 / 99806808 / -27.9%
random-access/taxi/correlated/vortex-tokio-s3-footer	135575637 / 135964108 / -0.3%
random-access/taxi/uniform/vortex-tokio-s3	173752172 / 176341872 / -1.5%
random-access/taxi/uniform/vortex-tokio-s3-footer	248732488 / 216946448 / +14.7%
random-access/vortex-tokio-s3	55703990 / 49370461 / +12.8%
random-access/vortex-tokio-s3-footer	93028713 / 97482847 / -4.6%

random-access / parquet / ns (1.019x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3	186117145729 / 176359929848 / +5.5%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer	183456513955 / 175666684443 / +4.4%
random-access/feature-vectors/uniform/parquet-tokio-s3	173855149065 / 163831650641 / +6.1%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer	169370281891 / 199511227915 / -15.1%
random-access/nested-lists/correlated/parquet-tokio-s3	1024385325 / 1036044327 / -1.1%
random-access/nested-lists/correlated/parquet-tokio-s3-footer	1101434642 / 1153524296 / -4.5%
random-access/nested-lists/uniform/parquet-tokio-s3	1035506902 / 1030682933 / +0.5%
random-access/nested-lists/uniform/parquet-tokio-s3-footer	1094870701 / 1106660945 / -1.1%
random-access/nested-structs/correlated/parquet-tokio-s3	453636147 / 453464506 / +0.0%
random-access/nested-structs/correlated/parquet-tokio-s3-footer	535004963 / 530144179 / +0.9%
random-access/nested-structs/uniform/parquet-tokio-s3	453284243 / 453689011 / -0.1%
random-access/nested-structs/uniform/parquet-tokio-s3-footer	602962818 / 536236024 / +12.4%
random-access/parquet-tokio-s3	565683845 / 483653216 / +17.0%
random-access/parquet-tokio-s3-footer	540669792 / 531487127 / +1.7%
random-access/taxi/correlated/parquet-tokio-s3	849450506 / 737561648 / +15.2%
random-access/taxi/correlated/parquet-tokio-s3-footer	780668013 / 792520826 / -1.5%
random-access/taxi/uniform/parquet-tokio-s3	782277449 / 792722626 / -1.3%
random-access/taxi/uniform/parquet-tokio-s3-footer	836940382 / 839184408 / -0.3%

random-access / lance / ns (1.215x ➖, 0↑ 4↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3	40403941 / 37470861 / +7.8%
random-access/feature-vectors/correlated/lance-tokio-s3-footer	204805862 / 193760146 / +5.7%
random-access/feature-vectors/uniform/lance-tokio-s3	96252779 / 81436461 / +18.2%
random-access/feature-vectors/uniform/lance-tokio-s3-footer	253985131 / 214349437 / +18.5%
random-access/lance-tokio-s3	123153591 / 54924261 / +124.2% 🔴
random-access/lance-tokio-s3-footer	421080683 / 251248609 / +67.6% 🔴
random-access/nested-lists/correlated/lance-tokio-s3	59055922 / 33887704 / +74.3% 🔴
random-access/nested-lists/correlated/lance-tokio-s3-footer	251159165 / 209327472 / +20.0%
random-access/nested-lists/uniform/lance-tokio-s3	83980718 / 71275574 / +17.8%
random-access/nested-lists/uniform/lance-tokio-s3-footer	279179396 / 255324443 / +9.3%
random-access/nested-structs/correlated/lance-tokio-s3	56856326 / 44939744 / +26.5%
random-access/nested-structs/correlated/lance-tokio-s3-footer	228022186 / 216526340 / +5.3%
random-access/nested-structs/uniform/lance-tokio-s3	116930180 / 104620541 / +11.8%
random-access/nested-structs/uniform/lance-tokio-s3-footer	305546800 / 269095307 / +13.5%
random-access/taxi/correlated/lance-tokio-s3	89238524 / 68043518 / +31.1% 🔴
random-access/taxi/correlated/lance-tokio-s3-footer	297902586 / 280376633 / +6.3%
random-access/taxi/uniform/lance-tokio-s3	244024004 / 298905814 / -18.4%
random-access/taxi/uniform/lance-tokio-s3-footer	567810013 / 533983628 / +6.3%

github-actions · 2026-10-09T14:34:50Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 1ee71320 vs base 34148020
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.9%
Engines: DataFusion No clear signal (+12.3%, environment too noisy confidence) · DuckDB No clear signal (-3.9%, environment too noisy confidence)
Vortex (geomean): hot 1.058x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.018x ➖ · cold 0.984x ➖
Shifts: Parquet (control) +1.8% · Median polish +4.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.075x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	358229419 / 341166833 / +5.0%	1076284350 / 1157600897 / -7.0%	0.33 / 0.29 / +12.9%
tpch_q02/datafusion:vortex-compact	577956157 / 514326765 / +12.4%	1234951818 / 1200223401 / +2.9%	0.47 / 0.43 / +9.2%
tpch_q03/datafusion:vortex-compact	833669454 / 540760887 / +54.2% 🔴	1732030538 / 1524104003 / +13.6%	0.48 / 0.35 / +35.7%
tpch_q04/datafusion:vortex-compact	261075494 / 366632188 / -28.8%	642175756 / 666646716 / -3.7%	0.41 / 0.55 / -26.1%
tpch_q05/datafusion:vortex-compact	616604469 / 626672462 / -1.6%	826024757 / 791588314 / +4.4%	0.75 / 0.79 / -5.7%
tpch_q06/datafusion:vortex-compact	408678832 / 413683790 / -1.2%	617209088 / 559054448 / +10.4%	0.66 / 0.74 / -10.5%
tpch_q07/datafusion:vortex-compact	969487298 / 752157634 / +28.9%	963205689 / 874914787 / +10.1%	1.01 / 0.86 / +17.1%
tpch_q08/datafusion:vortex-compact	1114531383 / 908988093 / +22.6%	1684568836 / 1019686718 / +65.2% 🔴	0.66 / 0.89 / -25.8%
tpch_q09/datafusion:vortex-compact	878933583 / 728139393 / +20.7%	1191437635 / 1218340858 / -2.2%	0.74 / 0.60 / +23.4%
tpch_q10/datafusion:vortex-compact	667152979 / 568696535 / +17.3%	1046538784 / 1006800123 / +3.9%	0.64 / 0.56 / +12.9%
tpch_q11/datafusion:vortex-compact	392342301 / 365946559 / +7.2%	681841349 / 627445950 / +8.7%	0.58 / 0.58 / -1.3%
tpch_q12/datafusion:vortex-compact	424980868 / 510604195 / -16.8%	830102928 / 688414689 / +20.6%	0.51 / 0.74 / -31.0%
tpch_q13/datafusion:vortex-compact	259697586 / 269329441 / -3.6%	604530493 / 641138170 / -5.7%	0.43 / 0.42 / +2.3%
tpch_q14/datafusion:vortex-compact	427309391 / 395339373 / +8.1%	495954308 / 519951759 / -4.6%	0.86 / 0.76 / +13.3%
tpch_q15/datafusion:vortex-compact	921932022 / 594960654 / +55.0% 🔴	1010315073 / 684221057 / +47.7% 🔴	0.91 / 0.87 / +4.9%
tpch_q16/datafusion:vortex-compact	296194215 / 282907492 / +4.7%	462132423 / 506471368 / -8.8%	0.64 / 0.56 / +14.7%
tpch_q17/datafusion:vortex-compact	784444867 / 742864333 / +5.6%	1230855383 / 807304756 / +52.5% 🔴	0.64 / 0.92 / -30.7%
tpch_q18/datafusion:vortex-compact	602320151 / 652246580 / -7.7%	605233013 / 991168719 / -38.9% 🟢	1.00 / 0.66 / +51.2%
tpch_q19/datafusion:vortex-compact	563985317 / 604357015 / -6.7%	824312563 / 705880594 / +16.8%	0.68 / 0.86 / -20.1%
tpch_q20/datafusion:vortex-compact	676016972 / 574254028 / +17.7%	854642823 / 866195733 / -1.3%	0.79 / 0.66 / +19.3%
tpch_q21/datafusion:vortex-compact	833796789 / 783659029 / +6.4%	1006868842 / 1135791911 / -11.4%	0.83 / 0.69 / +20.0%
tpch_q22/datafusion:vortex-compact	378125990 / 370764329 / +2.0%	696271550 / 660433825 / +5.4%	0.54 / 0.56 / -3.3%

datafusion / parquet / ns (0.958x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	291662230 / 258582168 / +12.8%	754419469 / 874027843 / -13.7%	0.39 / 0.30 / +30.7%
tpch_q02/datafusion:parquet	527008392 / 487411713 / +8.1%	1168179267 / 1174356990 / -0.5%	0.45 / 0.42 / +8.7%
tpch_q03/datafusion:parquet	672922698 / 545625058 / +23.3%	1279294690 / 1287628782 / -0.6%	0.53 / 0.42 / +24.1%
tpch_q04/datafusion:parquet	290096302 / 294888005 / -1.6%	711707599 / 508942723 / +39.8% 🔴	0.41 / 0.58 / -29.7%
tpch_q05/datafusion:parquet	619283677 / 635053263 / -2.5%	895469488 / 917638245 / -2.4%	0.69 / 0.69 / -0.1%
tpch_q06/datafusion:parquet	232545147 / 182774757 / +27.2%	467429169 / 376100843 / +24.3%	0.50 / 0.49 / +2.4%
tpch_q07/datafusion:parquet	697290401 / 637160217 / +9.4%	864813193 / 913343302 / -5.3%	0.81 / 0.70 / +15.6%
tpch_q08/datafusion:parquet	721174027 / 782084062 / -7.8%	1035120016 / 1101689877 / -6.0%	0.70 / 0.71 / -1.9%
tpch_q09/datafusion:parquet	903158873 / 1416810388 / -36.3% 🟢	1204289768 / 2369660189 / -49.2% 🟢	0.75 / 0.60 / +25.4%
tpch_q10/datafusion:parquet	1379222038 / 1807147868 / -23.7%	2565531869 / 2133553635 / +20.2%	0.54 / 0.85 / -36.5%
tpch_q11/datafusion:parquet	435215645 / 492098278 / -11.6%	686882231 / 759500336 / -9.6%	0.63 / 0.65 / -2.2%
tpch_q12/datafusion:parquet	392496235 / 385548521 / +1.8%	756501674 / 644737034 / +17.3%	0.52 / 0.60 / -13.2%
tpch_q13/datafusion:parquet	468624704 / 509562360 / -8.0%	916819476 / 892007221 / +2.8%	0.51 / 0.57 / -10.5%
tpch_q14/datafusion:parquet	407002381 / 449431036 / -9.4%	682545016 / 895502570 / -23.8%	0.60 / 0.50 / +18.8%
tpch_q15/datafusion:parquet	757087016 / 911108958 / -16.9%	884238660 / 1324875426 / -33.3% 🟢	0.86 / 0.69 / +24.5%
tpch_q16/datafusion:parquet	259621135 / 296452466 / -12.4%	500828787 / 621535139 / -19.4%	0.52 / 0.48 / +8.7%
tpch_q17/datafusion:parquet	736759875 / 821138790 / -10.3%	818922955 / 936967561 / -12.6%	0.90 / 0.88 / +2.7%
tpch_q18/datafusion:parquet	688345313 / 761280116 / -9.6%	867944629 / 993177479 / -12.6%	0.79 / 0.77 / +3.5%
tpch_q19/datafusion:parquet	443704037 / 457147583 / -2.9%	686175673 / 646762198 / +6.1%	0.65 / 0.71 / -8.5%
tpch_q20/datafusion:parquet	912268518 / 742425290 / +22.9%	908722072 / 931579020 / -2.5%	1.00 / 0.80 / +26.0%
tpch_q21/datafusion:parquet	947201004 / 1056612628 / -10.4%	1262941315 / 1476322423 / -14.5%	0.75 / 0.72 / +4.8%
tpch_q22/datafusion:parquet	523112275 / 574763872 / -9.0%	726631749 / 764113851 / -4.9%	0.72 / 0.75 / -4.3%

duckdb / vortex-compact / ns (1.041x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	969374229 / 924143486 / +4.9%	1372987748 / 1970186731 / -30.3% 🟢	0.71 / 0.47 / +50.5%
tpch_q02/duckdb:vortex-compact	489891810 / 580082665 / -15.5%	624883569 / 715093641 / -12.6%	0.78 / 0.81 / -3.4%
tpch_q03/duckdb:vortex-compact	1140774817 / 1083704607 / +5.3%	1313208821 / 1724731749 / -23.9%	0.87 / 0.63 / +38.3%
tpch_q04/duckdb:vortex-compact	778983020 / 719380050 / +8.3%	917018812 / 926719130 / -1.0%	0.85 / 0.78 / +9.4%
tpch_q05/duckdb:vortex-compact	1180582328 / 1195411860 / -1.2%	1345662764 / 1701277153 / -20.9%	0.88 / 0.70 / +24.9%
tpch_q06/duckdb:vortex-compact	1154932180 / 1110742401 / +4.0%	1199061873 / 1186561549 / +1.1%	0.96 / 0.94 / +2.9%
tpch_q07/duckdb:vortex-compact	1501900801 / 1525304585 / -1.5%	1517328922 / 2092624357 / -27.5%	0.99 / 0.73 / +35.8%
tpch_q08/duckdb:vortex-compact	1543740922 / 1436159312 / +7.5%	1741089880 / 1737824983 / +0.2%	0.89 / 0.83 / +7.3%
tpch_q09/duckdb:vortex-compact	1757663220 / 1717021411 / +2.4%	2048907108 / 1944942085 / +5.3%	0.86 / 0.88 / -2.8%
tpch_q10/duckdb:vortex-compact	1619264953 / 1466613707 / +10.4%	1884642213 / 1789168290 / +5.3%	0.86 / 0.82 / +4.8%
tpch_q11/duckdb:vortex-compact	525055869 / 493067697 / +6.5%	675680642 / 731315898 / -7.6%	0.78 / 0.67 / +15.3%
tpch_q12/duckdb:vortex-compact	2089465855 / 2026317622 / +3.1%	2161356717 / 2476707160 / -12.7%	0.97 / 0.82 / +18.2%
tpch_q13/duckdb:vortex-compact	1197751622 / 1107125279 / +8.2%	1689181252 / 1567960741 / +7.7%	0.71 / 0.71 / +0.4%
tpch_q14/duckdb:vortex-compact	926186032 / 832756197 / +11.2%	1177150335 / 923170537 / +27.5%	0.79 / 0.90 / -12.8%
tpch_q15/duckdb:vortex-compact	931865981 / 998160157 / -6.6%	986169481 / 1006651973 / -2.0%	0.94 / 0.99 / -4.7%
tpch_q16/duckdb:vortex-compact	238446933 / 226664777 / +5.2%	375044072 / 338971938 / +10.6%	0.64 / 0.67 / -4.9%
tpch_q17/duckdb:vortex-compact	1605809093 / 1283389130 / +25.1%	1422341879 / 1422606985 / -0.0%	1.13 / 0.90 / +25.1%
tpch_q18/duckdb:vortex-compact	1249873294 / 1214200521 / +2.9%	1334245817 / 1266530108 / +5.3%	0.94 / 0.96 / -2.3%
tpch_q19/duckdb:vortex-compact	1214027684 / 1195808095 / +1.5%	1327550742 / 1244798429 / +6.6%	0.91 / 0.96 / -4.8%
tpch_q20/duckdb:vortex-compact	1784078638 / 1651630491 / +8.0%	1953516968 / 1905503848 / +2.5%	0.91 / 0.87 / +5.4%
tpch_q21/duckdb:vortex-compact	2404536507 / 2337878707 / +2.9%	2442127657 / 2416889450 / +1.0%	0.98 / 0.97 / +1.8%
tpch_q22/duckdb:vortex-compact	506843897 / 492959821 / +2.8%	666846020 / 909934367 / -26.7%	0.76 / 0.54 / +40.3%

duckdb / parquet / ns (1.083x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	557189203 / 407945501 / +36.6% 🔴	466535132 / 513956828 / -9.2%	1.19 / 0.79 / +50.5%
tpch_q02/duckdb:parquet	782349998 / 814533187 / -4.0%	1546802742 / 1549418117 / -0.2%	0.51 / 0.53 / -3.8%
tpch_q03/duckdb:parquet	1084572646 / 1037926798 / +4.5%	1338289196 / 1525634247 / -12.3%	0.81 / 0.68 / +19.1%
tpch_q04/duckdb:parquet	604121998 / 635513977 / -4.9%	622372532 / 1059185207 / -41.2% 🟢	0.97 / 0.60 / +61.8%
tpch_q05/duckdb:parquet	1248562905 / 1096466506 / +13.9%	1406589152 / 1407081808 / -0.0%	0.89 / 0.78 / +13.9%
tpch_q06/duckdb:parquet	730942533 / 398083375 / +83.6% 🔴	693193286 / 418278600 / +65.7% 🔴	1.05 / 0.95 / +10.8%
tpch_q07/duckdb:parquet	1077441219 / 1127605867 / -4.4%	1308637683 / 1663700692 / -21.3%	0.82 / 0.68 / +21.5%
tpch_q08/duckdb:parquet	1317310098 / 1299448173 / +1.4%	1460604037 / 1483213704 / -1.5%	0.90 / 0.88 / +2.9%
tpch_q09/duckdb:parquet	1297042094 / 1517077599 / -14.5%	1470134905 / 1559936216 / -5.8%	0.88 / 0.97 / -9.3%
tpch_q10/duckdb:parquet	1966869393 / 1903561782 / +3.3%	3047395740 / 2279197669 / +33.7% 🔴	0.65 / 0.84 / -22.7%
tpch_q11/duckdb:parquet	554271854 / 525267862 / +5.5%	516552098 / 588205634 / -12.2%	1.07 / 0.89 / +20.2%
tpch_q12/duckdb:parquet	931403471 / 672970068 / +38.4% 🔴	1028814227 / 671156020 / +53.3% 🔴	0.91 / 1.00 / -9.7%
tpch_q13/duckdb:parquet	834801758 / 871664422 / -4.2%	1018793595 / 978058249 / +4.2%	0.82 / 0.89 / -8.1%
tpch_q14/duckdb:parquet	757444527 / 585362151 / +29.4%	1478766771 / 759401304 / +94.7% 🔴	0.51 / 0.77 / -33.5%
tpch_q15/duckdb:parquet	538695050 / 434254378 / +24.1%	579843973 / 437118059 / +32.7% 🔴	0.93 / 0.99 / -6.5%
tpch_q16/duckdb:parquet	668764926 / 686200655 / -2.5%	651990579 / 720156883 / -9.5%	1.03 / 0.95 / +7.6%
tpch_q17/duckdb:parquet	622975290 / 544767398 / +14.4%	611643065 / 620339393 / -1.4%	1.02 / 0.88 / +16.0%
tpch_q18/duckdb:parquet	742129822 / 884644060 / -16.1%	723000364 / 830371074 / -12.9%	1.03 / 1.07 / -3.7%
tpch_q19/duckdb:parquet	813522387 / 772007999 / +5.4%	844347315 / 770646555 / +9.6%	0.96 / 1.00 / -3.8%
tpch_q20/duckdb:parquet	1172118841 / 1076088038 / +8.9%	1251794933 / 1101074353 / +13.7%	0.94 / 0.98 / -4.2%
tpch_q21/duckdb:parquet	942840357 / 922220750 / +2.2%	835618124 / 916663219 / -8.8%	1.13 / 1.01 / +12.2%
tpch_q22/duckdb:parquet	755029871 / 755511007 / -0.1%	768322957 / 867196652 / -11.4%	0.98 / 0.87 / +12.8%

Decimal byte parts written before storage was bounded by precision may be wider than it allows; host assembly narrows them explicitly while the GPU kernel, which cannot narrow device buffers, now validates instead of constructing unchecked. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

github-actions · 2026-10-09T14:47:53Z

Benchmarks: Random Access 📖

Commits: PR 1ee71320 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: random-access No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.994x ➖
Parquet (geomean): hot 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.965x ➖, 2↑ 0↓)

name	ns (PR / base / %diff)
random-access/arrow-tokio-local-disk	72281 / 73541 / -1.7%
random-access/arrow-tokio-local-disk-footer	167112 / 164597 / +1.5%
random-access/feature-vectors/correlated/arrow-tokio-local-disk	2621838 / 2457230 / +6.7%
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer	3452519 / 3516668 / -1.8%
random-access/feature-vectors/uniform/arrow-tokio-local-disk	32947924 / 32718152 / +0.7%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer	33306410 / 33047900 / +0.8%
random-access/nested-lists/correlated/arrow-tokio-local-disk	58056 / 65499 / -11.4% 🟢
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer	105251 / 109431 / -3.8%
random-access/nested-lists/uniform/arrow-tokio-local-disk	1112777 / 1177789 / -5.5%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer	1157022 / 1198124 / -3.4%
random-access/nested-structs/correlated/arrow-tokio-local-disk	52216 / 57438 / -9.1%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer	92128 / 96124 / -4.2%
random-access/nested-structs/uniform/arrow-tokio-local-disk	850439 / 965053 / -11.9% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer	903827 / 980947 / -7.9%
random-access/taxi/correlated/arrow-tokio-local-disk	120288 / 124104 / -3.1%
random-access/taxi/correlated/arrow-tokio-local-disk-footer	220227 / 220164 / +0.0%
random-access/taxi/uniform/arrow-tokio-local-disk	2816697 / 2879278 / -2.2%
random-access/taxi/uniform/arrow-tokio-local-disk-footer	2899329 / 3067897 / -5.5%

random-access / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	243498 / 244609 / -0.5%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	1241899 / 1235862 / +0.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	1425317 / 1437061 / -0.8%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	2696983 / 2698125 / -0.0%
random-access/nested-lists/correlated/vortex-tokio-local-disk	209872 / 220486 / -4.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	377732 / 376634 / +0.3%
random-access/nested-lists/uniform/vortex-tokio-local-disk	710628 / 752205 / -5.5%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	960973 / 922406 / +4.2%
random-access/nested-structs/correlated/vortex-tokio-local-disk	276048 / 285497 / -3.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	520055 / 541088 / -3.9%
random-access/nested-structs/uniform/vortex-tokio-local-disk	631477 / 601545 / +5.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	944214 / 926671 / +1.9%
random-access/taxi/correlated/vortex-tokio-local-disk	667701 / 679135 / -1.7%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1505744 / 1496336 / +0.6%
random-access/taxi/uniform/vortex-tokio-local-disk	2658280 / 2604860 / +2.1%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	3827498 / 3887306 / -1.5%
random-access/vortex-tokio-local-disk	453146 / 455266 / -0.5%
random-access/vortex-tokio-local-disk-footer	1073745 / 1093982 / -1.8%

random-access / parquet / ns (0.991x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	107122633348 / 113346494154 / -5.5%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	107846455224 / 108165617757 / -0.3%
random-access/feature-vectors/uniform/parquet-tokio-local-disk	107596691656 / 112961083545 / -4.7%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	108042091179 / 108370952710 / -0.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk	149406234 / 145400851 / +2.8%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	144578939 / 145149395 / -0.4%
random-access/nested-lists/uniform/parquet-tokio-local-disk	144422233 / 147007300 / -1.8%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	144925969 / 145217439 / -0.2%
random-access/nested-structs/correlated/parquet-tokio-local-disk	44149115 / 45467566 / -2.9%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	44250657 / 45147232 / -2.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk	44343650 / 44993572 / -1.4%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	44371379 / 45194415 / -1.8%
random-access/parquet-tokio-local-disk	118605064 / 118752480 / -0.1%
random-access/parquet-tokio-local-disk-footer	120354140 / 118954367 / +1.2%
random-access/taxi/correlated/parquet-tokio-local-disk	177976864 / 178448068 / -0.3%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	180693163 / 178407453 / +1.3%
random-access/taxi/uniform/parquet-tokio-local-disk	188333100 / 187414195 / +0.5%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	188339424 / 187808938 / +0.3%

random-access / lance / ns (0.983x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	294527 / 299697 / -1.7%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1238522 / 1292393 / -4.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1027522 / 1028041 / -0.1%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	1992905 / 2068406 / -3.7%
random-access/lance-tokio-local-disk	526174 / 541548 / -2.8%
random-access/lance-tokio-local-disk-footer	1496271 / 1499499 / -0.2%
random-access/nested-lists/correlated/lance-tokio-local-disk	158232 / 161327 / -1.9%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	731530 / 746234 / -2.0%
random-access/nested-lists/uniform/lance-tokio-local-disk	838739 / 862641 / -2.8%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1424766 / 1457231 / -2.2%
random-access/nested-structs/correlated/lance-tokio-local-disk	276148 / 272695 / +1.3%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	628248 / 658448 / -4.6%
random-access/nested-structs/uniform/lance-tokio-local-disk	2269733 / 2315532 / -2.0%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2625436 / 2666489 / -1.5%
random-access/taxi/correlated/lance-tokio-local-disk	760139 / 766457 / -0.8%
random-access/taxi/correlated/lance-tokio-local-disk-footer	2051956 / 2048332 / +0.2%
random-access/taxi/uniform/lance-tokio-local-disk	8219464 / 8304778 / -1.0%
random-access/taxi/uniform/lance-tokio-local-disk-footer	8914225 / 8940767 / -0.3%

Byte-parts, sparse, row and fuzz tests that built decimals with storage wider than their precision allows now use the bounded width, or a precision that admits the width they exercise. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

The GPU filter test stores its i256 case at a precision that admits i256, and the Arrow export test for narrowing i256 storage below its precision is removed since such storage can no longer be constructed. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015zQPnFWRi7CWXHpgBE8CiF

Bound decimal storage by precision

ec2b1b5

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

joseph-isaacs force-pushed the ji/decimal-storage-contract branch from 0fff52c to ec2b1b5 Compare October 5, 2026 17:14

joseph-isaacs mentioned this pull request Oct 5, 2026

Add bounded decimal dispatch macros and migrate kernels #10314

Draft

joseph-isaacs changed the title ~~Bound decimal storage by precision and add widening dispatch macros~~ Bound decimal storage by precision Oct 5, 2026

Fix decimal storage regression test lint and formatting

51de229

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

joseph-isaacs added the changelog/break A breaking API change label Oct 6, 2026

joseph-isaacs and others added 3 commits October 9, 2026 13:22

Merge remote-tracking branch 'origin/develop' into ji/decimal-storage…

cd3a0a5

…-contract Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

joseph-isaacs marked this pull request as ready for review October 9, 2026 14:02

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 9, 2026

joseph-isaacs requested a review from robert3005 October 9, 2026 14:02

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 9, 2026

claude added 2 commits October 9, 2026 14:49

Conversation

joseph-isaacs commented Oct 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codspeed Bot commented Oct 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will improve performance by 25.57%

Performance Changes

Footnotes

Uh oh!

github-actions Bot commented Oct 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: String Encoding 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Appian on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Compression 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Oct 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Random Access (S3) 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: TPC-H SF=10 on S3 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Random Access 📖

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

joseph-isaacs commented Oct 5, 2026 •

edited

Loading

codspeed Bot commented Oct 6, 2026 •

edited

Loading

github-actions Bot commented Oct 9, 2026 •

edited

Loading

github-actions Bot commented Oct 9, 2026 •

edited

Loading