Skip to content

Accept DataFusion dynamic filters in VortexSource, with join membership lists - #10415

Draft
joseph-isaacs wants to merge 18 commits into
developfrom
ji/nifty-wright-ahdfl0
Draft

joseph-isaacs wants to merge 18 commits into
developfrom
ji/nifty-wright-ahdfl0

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Follow-up branch on top of #10375 (Accept DataFusion dynamic filters in VortexSource). It carries that PR's commits plus the changes below, merged with develop, so the benchmark workflows can measure the combined result against develop.

Changes

  • list_contains sorted search (vortex-array): a constant list against an array of integer needles was one equality pass over the whole column per list element, OR-ed together. For integer needles and lists of at least four non-null elements the elements are sorted once and each row is answered by a binary search.
  • Join membership lists (vortex-datafusion): complete hash-join filters carry col IN (keys) next to their min/max bounds when the build side has few distinct keys. Those lists become a static in_list in the Vortex scan filter when they prune at least half of the rows the bounds keep. Partitioned joins route keys through a CASE, whose branch lists are unioned.
  • TopK templates track only the leading sort column: a TopK filter over several sort keys only ever bounds the first key, so the other columns cost evaluations on every batch for nothing.
  • Dynamic filter conversions are logged at debug level under vortex_datafusion::convert::dynamic.

Local SF1 results (4-core VM, hot median, ratio vs develop, < 1 is faster): TPC-H geomean 0.92 (q18 0.46, q21 0.57, q7 0.66), TPC-DS geomean 0.78 (q72 0.11, q15/q21 0.26, q40 0.32, q17 0.34). q70 and q94 regress by 1.2x to 1.3x on both Vortex and Parquet once a scan accepts a hash-join dynamic filter; investigation ongoing.

Tests: convert::dynamic unit tests cover membership list conversion, CASE-routed lists, and the leading-column TopK template; list_contains tests cover the sorted search path.

🤖 Generated with Claude Code

https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL


Generated by Claude Code

joseph-isaacs and others added 13 commits October 7, 2026 13:09
Convert TopK and hash-join dynamic filters into live `vortex.dynamic`
comparisons so the scan prunes zones as the filter tightens. Only
`col op literal` bounds are tracked; anything else is relaxed to `true`,
so the Vortex filter never drops rows the operator needs.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FL15XgcyJgZ6xkaMo8p5o3
Hash-join dynamic filters are complete by the time the probe side opens a
file, so read their bounds once and apply them as static comparisons, but
only when the file's min/max statistics suggest they keep at most half of
the column's value range. Non-selective join bounds (e.g. TPC-H order and
customer keys) otherwise add a row-level filter that costs more than it
saves. Filters that are still changing (TopK) keep the live template.

TPC-H SF1, DataFusion over Vortex, 30 samples per mode: geomean on/off
went from 1.065 to 0.981; q07 0.70x, q21 0.71x.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FL15XgcyJgZ6xkaMo8p5o3
When a file's type differs from the table's, the expression adapter wraps
a dynamic filter's columns in casts. The opener then treated the filter
as an unpushable static filter and failed the query (ClickBench q23,
`ORDER BY "EventTime" LIMIT 10`).

Send every dynamic filter down the dynamic path, dropping any that can't
be converted, and look through casts to the underlying column. Bounds on
a cast column are only applied when the literal converts to the file
type and back unchanged, so a lossy cast can never tighten the filter.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FL15XgcyJgZ6xkaMo8p5o3
Multi-column TopK filters have the form `a < v OR (a = v AND b < w)`,
which previously yielded no bounds, leaving every row to pay for an
always-true template (ClickBench q26 regressed 1.24x). Read bounds
recursively: `=` gives both `<=` and `>=`, and an OR keeps, per column
and direction, the looser bound when both sides have one, so the example
yields `a <= v`. Incomparable values yield no bound.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FL15XgcyJgZ6xkaMo8p5o3
Partitioned hash joins publish `CASE route(key) WHEN i THEN bounds_i ...
END`, which previously yielded no bounds, leaving probe-side files with an
always-true filter. Bounds are now the hull over a CASE's results, with
`false`/`NULL` branches (empty partitions) contributing nothing.

When a still-changing filter already has bounds at file open, emit only
the comparisons and columns those bounds use rather than the full
template. Tidy the opener's conjunct split and share a values helper
across the end-to-end tests, adding a hash-join case whose bounds are
selective enough to be applied.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FL15XgcyJgZ6xkaMo8p5o3
The cached bounds are read on every evaluation of the Vortex filter but
replaced only when the DataFusion filter changes, a few dozen times per
query for TopK. Hold them in an ArcSwap instead of a mutex so concurrent
reads don't contend; a refresh never replaces a newer generation.

With four threads reading the same filter, a lookup drops from ~1.3 us
to ~0.3 us.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FL15XgcyJgZ6xkaMo8p5o3
Report each converted dynamic filter with its DataFusion predicate, whether
it is complete, and the resulting Vortex expression, plus the kept fraction
estimated for complete filters. This makes it possible to see which scans
actually receive TopK and join filters in a benchmark run.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
A constant list against an array of needles was answered with one equality
comparison over the whole array per element, OR-ed together, so an `IN` list
of a hundred keys cost a hundred passes over the column. For integer needles
and lists of at least four non-null elements, sort the elements once and
binary search per needle instead.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
Complete hash-join filters carry `col IN (keys)` next to their min/max
bounds whenever the build side has few distinct keys. Convert those lists
into a static `in_list` when they prune a meaningful share of the rows the
bounds keep: a list that is dense in the bounded range adds nothing but a
decode of the column. Partitioned joins route keys through a CASE, whose
branch lists are unioned.

Before a live filter has any bounds, only its leading column gets the
dynamic comparison template. A TopK filter over several sort keys is a
lexicographic disjunction whose hull only ever bounds the first key, so the
other columns cost evaluations on every batch for nothing; on TPC-DS q10
that was 32 dynamic comparisons per batch.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
A misplaced `?` dropped every column that had bounds but no membership
list, so complete join filters that only carry min/max bounds were never
applied.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
Keeps `expect` out of the rstest case expressions, which are inlined into a
test returning `Result`.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Oct 9, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 9, 2026
@codspeed

codspeed Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 14 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 1 regressed benchmark
✅ 2180 untouched benchmarks
⏩ 359 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime starts_with_avx2[64, VarBin] 54.7 µs 62.9 µs -13.09%
⚡ Simulation i64_random_chunked[256] 15,817.7 µs 783.2 µs ×20
⚡ Simulation i64_random[256] 4,360.6 µs 274 µs ×16

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/nifty-wright-ahdfl0 (83102a8) with develop (731a231)

Open in CodSpeed

Footnotes

  1. 359 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

…ilter

Clippy's cognitive complexity limit rejected the closure that built a
column's bounds and membership comparisons inline.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
@github-actions

github-actions Bot commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 1bd8d27 statpopgen 2 Explore Profiling Data
🟢 Done 1bd8d27 clickbench-sorted-nvme 2 Explore Profiling Data
🟢 Done 1bd8d27 tpcds-nvme 2 Explore Profiling Data
🟢 Done 1bd8d27 appian-nvme 2 Explore Profiling Data
🟢 Done 1bd8d27 tpch-nvme 2 Explore Profiling Data
🟢 Done 1bd8d27 fineweb 2 Explore Profiling Data
🟢 Done 1bd8d27 random-access-bench 2 Explore Profiling Data
🟢 Done 1bd8d27 clickbench-nvme 2 Explore Profiling Data
🟢 Done 1bd8d27 polarsignals 2 Explore Profiling Data
🟢 Done 1bd8d27 tpch-s3 2 Explore Profiling Data
🟢 Done 1bd8d27 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 1bd8d27 tpch-s3-10 2 Explore Profiling Data
🟢 Done 1bd8d27 fineweb-s3 2 Explore Profiling Data
🟢 Done 1bd8d27 compress-bench 2 Explore Profiling Data
🟢 Done 1bd8d27 string-bench 2 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6


vortex / vortex-file-compressed / ms (1.014x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.93984 / 33.005608 / -0.2%
read/clickbench/URL/shard-0/onpair-12 21.166356 / 21.010051 / +0.7%
read/tpch/l_comment/fsst 57.571256 / 57.517536 / +0.1%
read/tpch/l_comment/onpair-12 53.256528 / 53.112202 / +0.3%
write/clickbench/URL/shard-0/fsst 602.40291 / 602.631886 / -0.0%
write/clickbench/URL/shard-0/onpair-12 1027.76063 / 974.826165 / +5.4%
write/tpch/l_comment/fsst 1911.45029 / 1918.12411 / -0.3%
write/tpch/l_comment/onpair-12 2173.27692 / 2059.71228 / +5.5%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.4075024 / 47.4075024 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst 30.5867239 / 30.5867239 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Vortex (geomean): hot 1.003x ➖ · cold 1.001x ➖


datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 58061990 / 57277368 / +1.4% 101316461 / 100972360 / +0.3% 0.57 / 0.57 / +1.0%
polarsignals_q01/datafusion:vortex-file-compressed 62949074 / 63594898 / -1.0% 122751937 / 122472384 / +0.2% 0.51 / 0.52 / -1.2%
polarsignals_q02/datafusion:vortex-file-compressed 71980291 / 73026048 / -1.4% 113329796 / 108707193 / +4.3% 0.64 / 0.67 / -5.5%
polarsignals_q03/datafusion:vortex-file-compressed 79966923 / 79375290 / +0.7% 138223796 / 142858742 / -3.2% 0.58 / 0.56 / +4.1%
polarsignals_q04/datafusion:vortex-file-compressed 9478837 / 9590586 / -1.2% 45411925 / 46856790 / -3.1% 0.21 / 0.20 / +2.0%
polarsignals_q05/datafusion:vortex-file-compressed 24548170 / 24808702 / -1.1% 62758515 / 64348900 / -2.5% 0.39 / 0.39 / +1.5%
polarsignals_q06/datafusion:vortex-file-compressed 21880921 / 21865006 / +0.1% 62242903 / 60949470 / +2.1% 0.35 / 0.36 / -2.0%
polarsignals_q07/datafusion:vortex-file-compressed 41251732 / 39719886 / +3.9% 83096401 / 78595611 / +5.7% 0.50 / 0.51 / -1.8%
polarsignals_q08/datafusion:vortex-file-compressed 97875514 / 98373706 / -0.5% 161655813 / 162036383 / -0.2% 0.61 / 0.61 / -0.3%
polarsignals_q09/datafusion:vortex-file-compressed 10389230 / 10198891 / +1.9% 46199967 / 47193236 / -2.1% 0.22 / 0.22 / +4.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.2%
Engines: DataFusion No clear signal (+8.2%, environment too noisy confidence) · DuckDB No clear signal (+8.3%, environment too noisy confidence)
Vortex (geomean): hot 1.018x ➖ · cold 0.978x ➖
Parquet (geomean): hot 0.940x ➖ · cold 0.876x ➖
Shifts: Parquet (control) -6.0% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 54643666 / 52015236 / +5.1% 95142533 / 131312261 / -27.5% 0.57 / 0.40 / +45.0%
fineweb_q01/datafusion:vortex-file-compressed 467037428 / 413833922 / +12.9% 590722875 / 661600095 / -10.7% 0.79 / 0.63 / +26.4%
fineweb_q02/datafusion:vortex-file-compressed 379150948 / 449691734 / -15.7% 566718439 / 653313060 / -13.3% 0.67 / 0.69 / -2.8%
fineweb_q03/datafusion:vortex-file-compressed 496274976 / 552492428 / -10.2% 735571366 / 863854421 / -14.9% 0.67 / 0.64 / +5.5%
fineweb_q04/datafusion:vortex-file-compressed 548717313 / 412419639 / +33.0% 🔴 503967760 / 446459380 / +12.9% 1.09 / 0.92 / +17.9%
fineweb_q05/datafusion:vortex-file-compressed 425684406 / 394796976 / +7.8% 445549813 / 448047097 / -0.6% 0.96 / 0.88 / +8.4%
fineweb_q06/datafusion:vortex-file-compressed 779501658 / 737248220 / +5.7% 742356477 / 865150729 / -14.2% 1.05 / 0.85 / +23.2%
fineweb_q07/datafusion:vortex-file-compressed 512613586 / 502081638 / +2.1% 468097259 / 563231220 / -16.9% 1.10 / 0.89 / +22.8%
fineweb_q08/datafusion:vortex-file-compressed 285583946 / 457696772 / -37.6% 🟢 436784606 / 190877633 / +128.8% 🔴 0.65 / 2.40 / -72.7%
datafusion / vortex-compact / ns (1.032x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 49780054 / 42818560 / +16.3% 119420307 / 178883147 / -33.2% 🟢 0.42 / 0.24 / +74.1%
fineweb_q01/datafusion:vortex-compact 507262400 / 416158778 / +21.9% 772907727 / 884050973 / -12.6% 0.66 / 0.47 / +39.4%
fineweb_q02/datafusion:vortex-compact 421183846 / 412626514 / +2.1% 539677840 / 499631400 / +8.0% 0.78 / 0.83 / -5.5%
fineweb_q03/datafusion:vortex-compact 561212324 / 530773839 / +5.7% 860118381 / 728295808 / +18.1% 0.65 / 0.73 / -10.5%
fineweb_q04/datafusion:vortex-compact 464984182 / 448772374 / +3.6% 473201604 / 526371485 / -10.1% 0.98 / 0.85 / +15.3%
fineweb_q05/datafusion:vortex-compact 436442106 / 449909350 / -3.0% 515500452 / 524695067 / -1.8% 0.85 / 0.86 / -1.3%
fineweb_q06/datafusion:vortex-compact 639030996 / 1024401051 / -37.6% 🟢 720798186 / 727279221 / -0.9% 0.89 / 1.41 / -37.1%
fineweb_q07/datafusion:vortex-compact 593923676 / 506572905 / +17.2% 451687654 / 428484225 / +5.4% 1.31 / 1.18 / +11.2%
fineweb_q08/datafusion:vortex-compact 207149984 / 174727493 / +18.6% 228737168 / 241379635 / -5.2% 0.91 / 0.72 / +25.1%
datafusion / parquet / ns (0.932x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 547375724 / 612740243 / -10.7% 754107328 / 1008570474 / -25.2% 0.73 / 0.61 / +19.5%
fineweb_q01/datafusion:parquet 799880688 / 746674776 / +7.1% 860760506 / 855685051 / +0.6% 0.93 / 0.87 / +6.5%
fineweb_q02/datafusion:parquet 840786052 / 777151706 / +8.2% 797148765 / 738632958 / +7.9% 1.05 / 1.05 / +0.2%
fineweb_q03/datafusion:parquet 739936584 / 844551652 / -12.4% 737266371 / 793863342 / -7.1% 1.00 / 1.06 / -5.7%
fineweb_q04/datafusion:parquet 747278675 / 1121251882 / -33.4% 🟢 706575858 / 1310605645 / -46.1% 🟢 1.06 / 0.86 / +23.6%
fineweb_q05/datafusion:parquet 822032530 / 865397974 / -5.0% 761385216 / 1090176907 / -30.2% 🟢 1.08 / 0.79 / +36.0%
fineweb_q06/datafusion:parquet 840912496 / 733992184 / +14.6% 767381514 / 786795965 / -2.5% 1.10 / 0.93 / +17.5%
fineweb_q07/datafusion:parquet 772499220 / 842173278 / -8.3% 733884206 / 807280072 / -9.1% 1.05 / 1.04 / +0.9%
fineweb_q08/datafusion:parquet 720079242 / 818642106 / -12.0% 682576521 / 886173059 / -23.0% 1.05 / 0.92 / +14.2%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 65797660 / 51974899 / +26.6% 67614715 / 56483978 / +19.7% 0.97 / 0.92 / +5.8%
fineweb_q01/duckdb:vortex-file-compressed 430887954 / 454311502 / -5.2% 464787308 / 427122664 / +8.8% 0.93 / 1.06 / -12.8%
fineweb_q02/duckdb:vortex-file-compressed 588570628 / 554771515 / +6.1% 584633921 / 595602257 / -1.8% 1.01 / 0.93 / +8.1%
fineweb_q03/duckdb:vortex-file-compressed 966286544 / 1063696205 / -9.2% 1006692054 / 1223666770 / -17.7% 0.96 / 0.87 / +10.4%
fineweb_q04/duckdb:vortex-file-compressed 1068813518 / 1045676826 / +2.2% 1009122232 / 1024967121 / -1.5% 1.06 / 1.02 / +3.8%
fineweb_q05/duckdb:vortex-file-compressed 1078748774 / 969138082 / +11.3% 1328581002 / 1019322871 / +30.3% 🔴 0.81 / 0.95 / -14.6%
fineweb_q06/duckdb:vortex-file-compressed 1208359094 / 1281881198 / -5.7% 1249774103 / 1239250243 / +0.8% 0.97 / 1.03 / -6.5%
fineweb_q07/duckdb:vortex-file-compressed 947832686 / 962977642 / -1.6% 1047501338 / 1008221888 / +3.9% 0.90 / 0.96 / -5.3%
fineweb_q08/duckdb:vortex-file-compressed 428387972 / 548902422 / -22.0% 454016347 / 526635333 / -13.8% 0.94 / 1.04 / -9.5%
duckdb / vortex-compact / ns (1.061x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 74609962 / 66450688 / +12.3% 68732200 / 77736070 / -11.6% 1.09 / 0.85 / +27.0%
fineweb_q01/duckdb:vortex-compact 533699918 / 377802819 / +41.3% 🔴 499510713 / 444617628 / +12.3% 1.07 / 0.85 / +25.7%
fineweb_q02/duckdb:vortex-compact 555504018 / 572478827 / -3.0% 577005750 / 614653175 / -6.1% 0.96 / 0.93 / +3.4%
fineweb_q03/duckdb:vortex-compact 1172652084 / 1108304332 / +5.8% 1254884541 / 1419469150 / -11.6% 0.93 / 0.78 / +19.7%
fineweb_q04/duckdb:vortex-compact 1128410257 / 1056306742 / +6.8% 1097999683 / 1042787933 / +5.3% 1.03 / 1.01 / +1.5%
fineweb_q05/duckdb:vortex-compact 921119252 / 943614884 / -2.4% 992614725 / 995285975 / -0.3% 0.93 / 0.95 / -2.1%
fineweb_q06/duckdb:vortex-compact 1098168021 / 1101089956 / -0.3% 1153926883 / 1461945043 / -21.1% 0.95 / 0.75 / +26.4%
fineweb_q07/duckdb:vortex-compact 931408061 / 963329186 / -3.3% 1023714433 / 1097074600 / -6.7% 0.91 / 0.88 / +3.6%
fineweb_q08/duckdb:vortex-compact 377012734 / 361838535 / +4.2% 408914044 / 410604441 / -0.4% 0.92 / 0.88 / +4.6%
duckdb / parquet / ns (0.949x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 498880746 / 542830025 / -8.1% 553089262 / 644159656 / -14.1% 0.90 / 0.84 / +7.0%
fineweb_q01/duckdb:parquet 654925781 / 715970278 / -8.5% 600793330 / 592172381 / +1.5% 1.09 / 1.21 / -9.8%
fineweb_q02/duckdb:parquet 615197806 / 625995555 / -1.7% 716799494 / 670432334 / +6.9% 0.86 / 0.93 / -8.1%
fineweb_q03/duckdb:parquet 1555881707 / 1493628576 / +4.2% 1522805345 / 1498525632 / +1.6% 1.02 / 1.00 / +2.5%
fineweb_q04/duckdb:parquet 961021436 / 930449875 / +3.3% 957082883 / 944817760 / +1.3% 1.00 / 0.98 / +2.0%
fineweb_q05/duckdb:parquet 900786252 / 995235630 / -9.5% 863221101 / 1132595593 / -23.8% 1.04 / 0.88 / +18.8%
fineweb_q06/duckdb:parquet 1721143880 / 1967341812 / -12.5% 1639264450 / 1973698253 / -16.9% 1.05 / 1.00 / +5.3%
fineweb_q07/duckdb:parquet 1067493464 / 1156638054 / -7.7% 1074260440 / 1173735207 / -8.5% 0.99 / 0.99 / +0.8%
fineweb_q08/duckdb:parquet 524736849 / 547113746 / -4.1% 498287711 / 580256109 / -14.1% 1.05 / 0.94 / +11.7%

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 98594884 / 93291149 / +5.7% 174018646 / 167253840 / +4.0% 0.57 / 0.56 / +1.6%
tpch_q02/datafusion:vortex-file-compressed 66322040 / 64987354 / +2.1% 101437562 / 101336068 / +0.1% 0.65 / 0.64 / +2.0%
tpch_q03/datafusion:vortex-file-compressed 65715159 / 64786290 / +1.4% 128560221 / 121167796 / +6.1% 0.51 / 0.53 / -4.4%
tpch_q04/datafusion:vortex-file-compressed 36375846 / 35201513 / +3.3% 80439159 / 81360538 / -1.1% 0.45 / 0.43 / +4.5%
tpch_q05/datafusion:vortex-file-compressed 121535311 / 116365897 / +4.4% 193992524 / 180959608 / +7.2% 0.63 / 0.64 / -2.6%
tpch_q06/datafusion:vortex-file-compressed 14149237 / 14141962 / +0.1% 74326605 / 74549805 / -0.3% 0.19 / 0.19 / +0.4%
tpch_q07/datafusion:vortex-file-compressed 104082263 / 140695662 / -26.0% 🟢 165091099 / 202115334 / -18.3% 🟢 0.63 / 0.70 / -9.4%
tpch_q08/datafusion:vortex-file-compressed 143153731 / 143492820 / -0.2% 208834963 / 209105540 / -0.1% 0.69 / 0.69 / -0.1%
tpch_q09/datafusion:vortex-file-compressed 186307905 / 186426493 / -0.1% 260309909 / 256769660 / +1.4% 0.72 / 0.73 / -1.4%
tpch_q10/datafusion:vortex-file-compressed 75105665 / 73606820 / +2.0% 139853619 / 142880559 / -2.1% 0.54 / 0.52 / +4.2%
tpch_q11/datafusion:vortex-file-compressed 47020528 / 42987138 / +9.4% 74000047 / 69464721 / +6.5% 0.64 / 0.62 / +2.7%
tpch_q12/datafusion:vortex-file-compressed 46451273 / 44665961 / +4.0% 97418829 / 94195810 / +3.4% 0.48 / 0.47 / +0.6%
tpch_q13/datafusion:vortex-file-compressed 47167168 / 46678780 / +1.0% 82511359 / 79889733 / +3.3% 0.57 / 0.58 / -2.2%
tpch_q14/datafusion:vortex-file-compressed 25057415 / 24865785 / +0.8% 101751006 / 100014853 / +1.7% 0.25 / 0.25 / -0.9%
tpch_q15/datafusion:vortex-file-compressed 36662701 / 36158558 / +1.4% 99181843 / 99371507 / -0.2% 0.37 / 0.36 / +1.6%
tpch_q16/datafusion:vortex-file-compressed 38450737 / 37316994 / +3.0% 70350415 / 71134789 / -1.1% 0.55 / 0.52 / +4.2%
tpch_q17/datafusion:vortex-file-compressed 175314688 / 176160767 / -0.5% 229042072 / 223386459 / +2.5% 0.77 / 0.79 / -2.9%
tpch_q18/datafusion:vortex-file-compressed 202180427 / 203276022 / -0.5% 270094788 / 262916736 / +2.7% 0.75 / 0.77 / -3.2%
tpch_q19/datafusion:vortex-file-compressed 35852368 / 33932671 / +5.7% 98409518 / 97046165 / +1.4% 0.36 / 0.35 / +4.2%
tpch_q20/datafusion:vortex-file-compressed 63880629 / 64100726 / -0.3% 123238373 / 124616983 / -1.1% 0.52 / 0.51 / +0.8%
tpch_q21/datafusion:vortex-file-compressed 187263760 / 181923942 / +2.9% 243311097 / 242015675 / +0.5% 0.77 / 0.75 / +2.4%
tpch_q22/datafusion:vortex-file-compressed 26210079 / 25764322 / +1.7% 56734857 / 55982851 / +1.3% 0.46 / 0.46 / +0.4%
datafusion / vortex-compact / ns (1.005x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 98181681 / 101130497 / -2.9% 168520583 / 155500004 / +8.4% 0.58 / 0.65 / -10.4%
tpch_q02/datafusion:vortex-compact 66908276 / 66265412 / +1.0% 98759628 / 94915886 / +4.0% 0.68 / 0.70 / -3.0%
tpch_q03/datafusion:vortex-compact 67397824 / 65658971 / +2.6% 115777229 / 115393516 / +0.3% 0.58 / 0.57 / +2.3%
tpch_q04/datafusion:vortex-compact 42807033 / 41191716 / +3.9% 82994900 / 86873924 / -4.5% 0.52 / 0.47 / +8.8%
tpch_q05/datafusion:vortex-compact 119274862 / 119588927 / -0.3% 181120949 / 167345077 / +8.2% 0.66 / 0.71 / -7.8%
tpch_q06/datafusion:vortex-compact 17758115 / 18230718 / -2.6% 62308871 / 66873449 / -6.8% 0.29 / 0.27 / +4.5%
tpch_q07/datafusion:vortex-compact 108668230 / 143098943 / -24.1% 🟢 156222099 / 193784423 / -19.4% 🟢 0.70 / 0.74 / -5.8%
tpch_q08/datafusion:vortex-compact 149308863 / 143379391 / +4.1% 204148604 / 206215641 / -1.0% 0.73 / 0.70 / +5.2%
tpch_q09/datafusion:vortex-compact 192399895 / 186411286 / +3.2% 269943631 / 252286340 / +7.0% 0.71 / 0.74 / -3.5%
tpch_q10/datafusion:vortex-compact 80713937 / 78989545 / +2.2% 125484296 / 126799464 / -1.0% 0.64 / 0.62 / +3.3%
tpch_q11/datafusion:vortex-compact 48214902 / 43152364 / +11.7% 🔴 72333093 / 67314241 / +7.5% 0.67 / 0.64 / +4.0%
tpch_q12/datafusion:vortex-compact 58208657 / 56962604 / +2.2% 97499220 / 96582483 / +0.9% 0.60 / 0.59 / +1.2%
tpch_q13/datafusion:vortex-compact 54690080 / 53727155 / +1.8% 83520013 / 79322962 / +5.3% 0.65 / 0.68 / -3.3%
tpch_q14/datafusion:vortex-compact 27837843 / 27232335 / +2.2% 101723619 / 98545088 / +3.2% 0.27 / 0.28 / -1.0%
tpch_q15/datafusion:vortex-compact 44518956 / 45371636 / -1.9% 100500899 / 103059628 / -2.5% 0.44 / 0.44 / +0.6%
tpch_q16/datafusion:vortex-compact 40434713 / 40060011 / +0.9% 70014314 / 67429592 / +3.8% 0.58 / 0.59 / -2.8%
tpch_q17/datafusion:vortex-compact 173038498 / 169342121 / +2.2% 220951910 / 215006511 / +2.8% 0.78 / 0.79 / -0.6%
tpch_q18/datafusion:vortex-compact 204080403 / 203050007 / +0.5% 256905889 / 253973739 / +1.2% 0.79 / 0.80 / -0.6%
tpch_q19/datafusion:vortex-compact 42186457 / 41414433 / +1.9% 87644254 / 88217007 / -0.6% 0.48 / 0.47 / +2.5%
tpch_q20/datafusion:vortex-compact 66955948 / 65598068 / +2.1% 117885158 / 116290540 / +1.4% 0.57 / 0.56 / +0.7%
tpch_q21/datafusion:vortex-compact 193825863 / 191815729 / +1.0% 244138063 / 242891654 / +0.5% 0.79 / 0.79 / +0.5%
tpch_q22/datafusion:vortex-compact 27801035 / 26980659 / +3.0% 55512063 / 54338642 / +2.2% 0.50 / 0.50 / +0.9%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86865542 / 87132828 / -0.3% 134435526 / 133479397 / +0.7% 0.65 / 0.65 / -1.0%
tpch_q02/datafusion:parquet 158234788 / 158260690 / -0.0% 184874852 / 186636621 / -0.9% 0.86 / 0.85 / +0.9%
tpch_q03/datafusion:parquet 142718947 / 142694662 / +0.0% 197558532 / 193470169 / +2.1% 0.72 / 0.74 / -2.1%
tpch_q04/datafusion:parquet 59394786 / 59638519 / -0.4% 97826990 / 103750220 / -5.7% 0.61 / 0.57 / +5.6%
tpch_q05/datafusion:parquet 180981408 / 179865367 / +0.6% 237637781 / 241363858 / -1.5% 0.76 / 0.75 / +2.2%
tpch_q06/datafusion:parquet 35277898 / 35185198 / +0.3% 80081278 / 82852895 / -3.3% 0.44 / 0.42 / +3.7%
tpch_q07/datafusion:parquet 228496058 / 230211079 / -0.7% 290102780 / 292213194 / -0.7% 0.79 / 0.79 / -0.0%
tpch_q08/datafusion:parquet 235571059 / 234781031 / +0.3% 295400195 / 304714483 / -3.1% 0.80 / 0.77 / +3.5%
tpch_q09/datafusion:parquet 313498790 / 312855862 / +0.2% 386296415 / 386008602 / +0.1% 0.81 / 0.81 / +0.1%
tpch_q10/datafusion:parquet 408136341 / 406701190 / +0.4% 462905853 / 465079586 / -0.5% 0.88 / 0.87 / +0.8%
tpch_q11/datafusion:parquet 105261209 / 104930246 / +0.3% 128561268 / 131598240 / -2.3% 0.82 / 0.80 / +2.7%
tpch_q12/datafusion:parquet 84937237 / 84856347 / +0.1% 127684556 / 129291102 / -1.2% 0.67 / 0.66 / +1.4%
tpch_q13/datafusion:parquet 227815136 / 228669430 / -0.4% 256281196 / 260745521 / -1.7% 0.89 / 0.88 / +1.4%
tpch_q14/datafusion:parquet 86482083 / 87607499 / -1.3% 195810541 / 192517434 / +1.7% 0.44 / 0.46 / -2.9%
tpch_q15/datafusion:parquet 90253271 / 89869959 / +0.4% 144310432 / 143254626 / +0.7% 0.63 / 0.63 / -0.3%
tpch_q16/datafusion:parquet 94595000 / 94419679 / +0.2% 121705305 / 124993176 / -2.6% 0.78 / 0.76 / +2.9%
tpch_q17/datafusion:parquet 214234885 / 215919463 / -0.8% 275894702 / 276732498 / -0.3% 0.78 / 0.78 / -0.5%
tpch_q18/datafusion:parquet 294784586 / 293455005 / +0.5% 333865255 / 334845721 / -0.3% 0.88 / 0.88 / +0.7%
tpch_q19/datafusion:parquet 109994345 / 109099047 / +0.8% 173850238 / 172671310 / +0.7% 0.63 / 0.63 / +0.1%
tpch_q20/datafusion:parquet 183506908 / 183793562 / -0.2% 248691287 / 244737762 / +1.6% 0.74 / 0.75 / -1.7%
tpch_q21/datafusion:parquet 243557754 / 243144424 / +0.2% 315708403 / 316916670 / -0.4% 0.77 / 0.77 / +0.6%
tpch_q22/datafusion:parquet 199131675 / 198986222 / +0.1% 224708938 / 224226040 / +0.2% 0.89 / 0.89 / -0.1%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 50910869 / 54617200 / -6.8% 86826396 / 102478102 / -15.3% 🟢 0.59 / 0.53 / +10.0%
tpch_q02/duckdb:vortex-file-compressed 32215230 / 31439398 / +2.5% 49316124 / 45634458 / +8.1% 0.65 / 0.69 / -5.2%
tpch_q03/duckdb:vortex-file-compressed 56452480 / 57626315 / -2.0% 109938896 / 113506463 / -3.1% 0.51 / 0.51 / +1.1%
tpch_q04/duckdb:vortex-file-compressed 81721105 / 82303246 / -0.7% 122467824 / 124691792 / -1.8% 0.67 / 0.66 / +1.1%
tpch_q05/duckdb:vortex-file-compressed 63567650 / 64861448 / -2.0% 118798634 / 124542498 / -4.6% 0.54 / 0.52 / +2.7%
tpch_q06/duckdb:vortex-file-compressed 21390080 / 22038093 / -2.9% 67233863 / 69052299 / -2.6% 0.32 / 0.32 / -0.3%
tpch_q07/duckdb:vortex-file-compressed 59625015 / 60298984 / -1.1% 137413337 / 134807659 / +1.9% 0.43 / 0.45 / -3.0%
tpch_q08/duckdb:vortex-file-compressed 86770386 / 86789982 / -0.0% 148710837 / 165016546 / -9.9% 0.58 / 0.53 / +10.9%
tpch_q09/duckdb:vortex-file-compressed 169148103 / 164869653 / +2.6% 249900339 / 248134080 / +0.7% 0.68 / 0.66 / +1.9%
tpch_q10/duckdb:vortex-file-compressed 108761128 / 108773914 / -0.0% 172402169 / 174758489 / -1.3% 0.63 / 0.62 / +1.4%
tpch_q11/duckdb:vortex-file-compressed 17618169 / 17027129 / +3.5% 32167000 / 31826713 / +1.1% 0.55 / 0.53 / +2.4%
tpch_q12/duckdb:vortex-file-compressed 57791520 / 53776073 / +7.5% 114223522 / 104449249 / +9.4% 0.51 / 0.51 / -1.7%
tpch_q13/duckdb:vortex-file-compressed 90418031 / 91821154 / -1.5% 145695136 / 142172488 / +2.5% 0.62 / 0.65 / -3.9%
tpch_q14/duckdb:vortex-file-compressed 29971525 / 31855834 / -5.9% 77168194 / 84092082 / -8.2% 0.39 / 0.38 / +2.5%
tpch_q15/duckdb:vortex-file-compressed 40243738 / 39575855 / +1.7% 104616489 / 91807692 / +14.0% 🔴 0.38 / 0.43 / -10.8%
tpch_q16/duckdb:vortex-file-compressed 42667480 / 42533427 / +0.3% 55469885 / 55143864 / +0.6% 0.77 / 0.77 / -0.3%
tpch_q17/duckdb:vortex-file-compressed 57622003 / 59073824 / -2.5% 126361244 / 125536009 / +0.7% 0.46 / 0.47 / -3.1%
tpch_q18/duckdb:vortex-file-compressed 134705773 / 139961309 / -3.8% 166563825 / 162203031 / +2.7% 0.81 / 0.86 / -6.3%
tpch_q19/duckdb:vortex-file-compressed 39463881 / 39564686 / -0.3% 90464111 / 95113825 / -4.9% 0.44 / 0.42 / +4.9%
tpch_q20/duckdb:vortex-file-compressed 61620902 / 60549000 / +1.8% 130131439 / 124227405 / +4.8% 0.47 / 0.49 / -2.8%
tpch_q21/duckdb:vortex-file-compressed 243111657 / 238884515 / +1.8% 291092304 / 279907346 / +4.0% 0.84 / 0.85 / -2.1%
tpch_q22/duckdb:vortex-file-compressed 41278517 / 42067868 / -1.9% 63383312 / 62551377 / +1.3% 0.65 / 0.67 / -3.2%
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 68266631 / 69767779 / -2.2% 107664411 / 105704427 / +1.9% 0.63 / 0.66 / -3.9%
tpch_q02/duckdb:vortex-compact 34403308 / 35009734 / -1.7% 49291954 / 50430766 / -2.3% 0.70 / 0.69 / +0.5%
tpch_q03/duckdb:vortex-compact 62527884 / 63170850 / -1.0% 111636008 / 104086236 / +7.3% 0.56 / 0.61 / -7.7%
tpch_q04/duckdb:vortex-compact 88966318 / 90040902 / -1.2% 120383665 / 119712284 / +0.6% 0.74 / 0.75 / -1.7%
tpch_q05/duckdb:vortex-compact 71541629 / 70697229 / +1.2% 132015286 / 133489931 / -1.1% 0.54 / 0.53 / +2.3%
tpch_q06/duckdb:vortex-compact 24161056 / 23975971 / +0.8% 65517959 / 64869354 / +1.0% 0.37 / 0.37 / -0.2%
tpch_q07/duckdb:vortex-compact 72004033 / 71300434 / +1.0% 144270800 / 139757801 / +3.2% 0.50 / 0.51 / -2.2%
tpch_q08/duckdb:vortex-compact 90721770 / 92118774 / -1.5% 150434565 / 151369549 / -0.6% 0.60 / 0.61 / -0.9%
tpch_q09/duckdb:vortex-compact 172785355 / 174846361 / -1.2% 239408541 / 236993533 / +1.0% 0.72 / 0.74 / -2.2%
tpch_q10/duckdb:vortex-compact 117118305 / 116130056 / +0.9% 165421820 / 163170965 / +1.4% 0.71 / 0.71 / -0.5%
tpch_q11/duckdb:vortex-compact 18679444 / 18754724 / -0.4% 38119561 / 34595366 / +10.2% 🔴 0.49 / 0.54 / -9.6%
tpch_q12/duckdb:vortex-compact 69159036 / 68909942 / +0.4% 110441595 / 109573990 / +0.8% 0.63 / 0.63 / -0.4%
tpch_q13/duckdb:vortex-compact 94718176 / 96612559 / -2.0% 144022759 / 149889042 / -3.9% 0.66 / 0.64 / +2.0%
tpch_q14/duckdb:vortex-compact 34437006 / 34576279 / -0.4% 76196652 / 76348220 / -0.2% 0.45 / 0.45 / -0.2%
tpch_q15/duckdb:vortex-compact 46138941 / 43482820 / +6.1% 116244029 / 99857262 / +16.4% 🔴 0.40 / 0.44 / -8.8%
tpch_q16/duckdb:vortex-compact 43565724 / 44728985 / -2.6% 54224608 / 55649810 / -2.6% 0.80 / 0.80 / -0.0%
tpch_q17/duckdb:vortex-compact 57164395 / 58126290 / -1.7% 113140580 / 106562018 / +6.2% 0.51 / 0.55 / -7.4%
tpch_q18/duckdb:vortex-compact 143304818 / 146579975 / -2.2% 160432465 / 164163041 / -2.3% 0.89 / 0.89 / +0.0%
tpch_q19/duckdb:vortex-compact 44797891 / 45359628 / -1.2% 93534559 / 93214202 / +0.3% 0.48 / 0.49 / -1.6%
tpch_q20/duckdb:vortex-compact 68245389 / 68798754 / -0.8% 130432840 / 136827739 / -4.7% 0.52 / 0.50 / +4.1%
tpch_q21/duckdb:vortex-compact 256376217 / 260153364 / -1.5% 289864175 / 292641208 / -0.9% 0.88 / 0.89 / -0.5%
tpch_q22/duckdb:vortex-compact 43856747 / 44059655 / -0.5% 67681449 / 67286745 / +0.6% 0.65 / 0.65 / -1.0%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 71708520 / 72442833 / -1.0% 88633492 / 87883030 / +0.9% 0.81 / 0.82 / -1.9%
tpch_q02/duckdb:parquet 80337053 / 81138906 / -1.0% 92233631 / 92253960 / -0.0% 0.87 / 0.88 / -1.0%
tpch_q03/duckdb:parquet 117740146 / 121735789 / -3.3% 153021232 / 147735196 / +3.6% 0.77 / 0.82 / -6.6%
tpch_q04/duckdb:parquet 75729739 / 76345675 / -0.8% 94989663 / 96800292 / -1.9% 0.80 / 0.79 / +1.1%
tpch_q05/duckdb:parquet 128764656 / 129107434 / -0.3% 163734083 / 163486679 / +0.2% 0.79 / 0.79 / -0.4%
tpch_q06/duckdb:parquet 34659476 / 33598280 / +3.2% 47276995 / 46909491 / +0.8% 0.73 / 0.72 / +2.4%
tpch_q07/duckdb:parquet 92999683 / 93280322 / -0.3% 136559831 / 129563916 / +5.4% 0.68 / 0.72 / -5.4%
tpch_q08/duckdb:parquet 149479034 / 150640540 / -0.8% 195363226 / 211600903 / -7.7% 0.77 / 0.71 / +7.5%
tpch_q09/duckdb:parquet 228670251 / 229087854 / -0.2% 261805284 / 289055842 / -9.4% 0.87 / 0.79 / +10.2%
tpch_q10/duckdb:parquet 512907762 / 513994066 / -0.2% 563951069 / 551214961 / +2.3% 0.91 / 0.93 / -2.5%
tpch_q11/duckdb:parquet 33602965 / 33793082 / -0.6% 38929208 / 39204378 / -0.7% 0.86 / 0.86 / +0.1%
tpch_q12/duckdb:parquet 77386313 / 75994564 / +1.8% 97714401 / 87065753 / +12.2% 🔴 0.79 / 0.87 / -9.3%
tpch_q13/duckdb:parquet 319588368 / 324303259 / -1.5% 365396271 / 333281026 / +9.6% 0.87 / 0.97 / -10.1%
tpch_q14/duckdb:parquet 120785448 / 111766463 / +8.1% 137651999 / 134754256 / +2.2% 0.88 / 0.83 / +5.8%
tpch_q15/duckdb:parquet 43191935 / 42952783 / +0.6% 81827594 / 70767699 / +15.6% 🔴 0.53 / 0.61 / -13.0%
tpch_q16/duckdb:parquet 118270916 / 119446077 / -1.0% 127786343 / 128438168 / -0.5% 0.93 / 0.93 / -0.5%
tpch_q17/duckdb:parquet 83170717 / 80230926 / +3.7% 113615518 / 105060949 / +8.1% 0.73 / 0.76 / -4.1%
tpch_q18/duckdb:parquet 216081346 / 214916782 / +0.5% 191960347 / 180231636 / +6.5% 1.13 / 1.19 / -5.6%
tpch_q19/duckdb:parquet 166069059 / 165583788 / +0.3% 199117906 / 194719329 / +2.3% 0.83 / 0.85 / -1.9%
tpch_q20/duckdb:parquet 135520058 / 135311872 / +0.2% 183482894 / 171796208 / +6.8% 0.74 / 0.79 / -6.2%
tpch_q21/duckdb:parquet 281894122 / 278217844 / +1.3% 306325220 / 296823757 / +3.2% 0.92 / 0.94 / -1.8%
tpch_q22/duckdb:parquet 268777668 / 269097700 / -0.1% 281469864 / 280509869 / +0.3% 0.95 / 0.96 / -0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-2.9%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.973x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.967x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1225710 / 1236975 / -0.9% 18919747 / 20625490 / -8.3% 0.06 / 0.06 / +8.0%
clickbench_q01/datafusion:vortex-file-compressed 5930393 / 5649156 / +5.0% 33891315 / 32981222 / +2.8% 0.17 / 0.17 / +2.2%
clickbench_q02/datafusion:vortex-file-compressed 10065347 / 9813354 / +2.6% 37854541 / 40011954 / -5.4% 0.27 / 0.25 / +8.4%
clickbench_q03/datafusion:vortex-file-compressed 11894662 / 11287738 / +5.4% 49422941 / 54447720 / -9.2% 0.24 / 0.21 / +16.1%
clickbench_q04/datafusion:vortex-file-compressed 56120406 / 56042854 / +0.1% 89935770 / 89965692 / -0.0% 0.62 / 0.62 / +0.2%
clickbench_q05/datafusion:vortex-file-compressed 76666512 / 76936827 / -0.4% 115053638 / 122588290 / -6.1% 0.67 / 0.63 / +6.2%
clickbench_q06/datafusion:vortex-file-compressed 1229496 / 1242898 / -1.1% 19468308 / 19744007 / -1.4% 0.06 / 0.06 / +0.3%
clickbench_q07/datafusion:vortex-file-compressed 9373380 / 9645806 / -2.8% 31346711 / 32373047 / -3.2% 0.30 / 0.30 / +0.4%
clickbench_q08/datafusion:vortex-file-compressed 78133410 / 78115198 / +0.0% 113205840 / 116274927 / -2.6% 0.69 / 0.67 / +2.7%
clickbench_q09/datafusion:vortex-file-compressed 173677204 / 166809220 / +4.1% 208901593 / 204658343 / +2.1% 0.83 / 0.82 / +2.0%
clickbench_q10/datafusion:vortex-file-compressed 23545381 / 22639236 / +4.0% 62427822 / 68082602 / -8.3% 0.38 / 0.33 / +13.4%
clickbench_q11/datafusion:vortex-file-compressed 26826248 / 25583567 / +4.9% 65942605 / 65056431 / +1.4% 0.41 / 0.39 / +3.4%
clickbench_q12/datafusion:vortex-file-compressed 72024724 / 72149042 / -0.2% 111230056 / 111719641 / -0.4% 0.65 / 0.65 / +0.3%
clickbench_q13/datafusion:vortex-file-compressed 118468260 / 116680023 / +1.5% 178141627 / 181944942 / -2.1% 0.67 / 0.64 / +3.7%
clickbench_q14/datafusion:vortex-file-compressed 75623712 / 78593074 / -3.8% 118279868 / 121594707 / -2.7% 0.64 / 0.65 / -1.1%
clickbench_q15/datafusion:vortex-file-compressed 62675750 / 60659261 / +3.3% 95701272 / 95286975 / +0.4% 0.65 / 0.64 / +2.9%
clickbench_q16/datafusion:vortex-file-compressed 152927924 / 151083774 / +1.2% 210160592 / 211814293 / -0.8% 0.73 / 0.71 / +2.0%
clickbench_q17/datafusion:vortex-file-compressed 150901968 / 149356338 / +1.0% 208015705 / 214805861 / -3.2% 0.73 / 0.70 / +4.3%
clickbench_q18/datafusion:vortex-file-compressed 304857310 / 298806254 / +2.0% 385461725 / 375751227 / +2.6% 0.79 / 0.80 / -0.5%
clickbench_q19/datafusion:vortex-file-compressed 7660826 / 7583803 / +1.0% 45047022 / 48172585 / -6.5% 0.17 / 0.16 / +8.0%
clickbench_q20/datafusion:vortex-file-compressed 62703606 / 63563507 / -1.4% 228731864 / 228782441 / -0.0% 0.27 / 0.28 / -1.3%
clickbench_q21/datafusion:vortex-file-compressed 89218787 / 88539372 / +0.8% 269229384 / 275540230 / -2.3% 0.33 / 0.32 / +3.1%
clickbench_q22/datafusion:vortex-file-compressed 101061105 / 98609980 / +2.5% 346239677 / 351120295 / -1.4% 0.29 / 0.28 / +3.9%
clickbench_q23/datafusion:vortex-file-compressed 149982718 / 188305512 / -20.4% 🟢 411047687 / 531786676 / -22.7% 🟢 0.36 / 0.35 / +3.0%
clickbench_q24/datafusion:vortex-file-compressed 11342969 / 16097455 / -29.5% 🟢 50698583 / 62474452 / -18.8% 🟢 0.22 / 0.26 / -13.2%
clickbench_q25/datafusion:vortex-file-compressed 17283498 / 17878718 / -3.3% 55926279 / 55658034 / +0.5% 0.31 / 0.32 / -3.8%
clickbench_q26/datafusion:vortex-file-compressed 12904937 / 16273234 / -20.7% 🟢 48367015 / 66894486 / -27.7% 🟢 0.27 / 0.24 / +9.7%
clickbench_q27/datafusion:vortex-file-compressed 97790278 / 97981429 / -0.2% 243742659 / 241989896 / +0.7% 0.40 / 0.40 / -0.9%
clickbench_q28/datafusion:vortex-file-compressed 569500718 / 575016467 / -1.0% 624606817 / 620372050 / +0.7% 0.91 / 0.93 / -1.6%
clickbench_q29/datafusion:vortex-file-compressed 22962340 / 23108874 / -0.6% 49817700 / 49527422 / +0.6% 0.46 / 0.47 / -1.2%
clickbench_q30/datafusion:vortex-file-compressed 58554886 / 59645899 / -1.8% 103657987 / 105173732 / -1.4% 0.56 / 0.57 / -0.4%
clickbench_q31/datafusion:vortex-file-compressed 70848548 / 68864334 / +2.9% 150303691 / 153105792 / -1.8% 0.47 / 0.45 / +4.8%
clickbench_q32/datafusion:vortex-file-compressed 302105118 / 298357048 / +1.3% 379895357 / 388925143 / -2.3% 0.80 / 0.77 / +3.7%
clickbench_q33/datafusion:vortex-file-compressed 324521778 / 332273960 / -2.3% 417798638 / 441084826 / -5.3% 0.78 / 0.75 / +3.1%
clickbench_q34/datafusion:vortex-file-compressed 326565111 / 336267856 / -2.9% 425445116 / 433718215 / -1.9% 0.77 / 0.78 / -1.0%
clickbench_q35/datafusion:vortex-file-compressed 55589096 / 56508762 / -1.6% 86306888 / 88570254 / -2.6% 0.64 / 0.64 / +1.0%
clickbench_q36/datafusion:vortex-file-compressed 37312974 / 37008660 / +0.8% 63649084 / 64469773 / -1.3% 0.59 / 0.57 / +2.1%
clickbench_q37/datafusion:vortex-file-compressed 21764066 / 21521902 / +1.1% 46522110 / 46169424 / +0.8% 0.47 / 0.47 / +0.4%
clickbench_q38/datafusion:vortex-file-compressed 11533103 / 11719320 / -1.6% 37304448 / 37306432 / -0.0% 0.31 / 0.31 / -1.6%
clickbench_q39/datafusion:vortex-file-compressed 78039613 / 77938674 / +0.1% 106785085 / 109854721 / -2.8% 0.73 / 0.71 / +3.0%
clickbench_q40/datafusion:vortex-file-compressed 10980918 / 11363901 / -3.4% 34895003 / 35549515 / -1.8% 0.31 / 0.32 / -1.6%
clickbench_q41/datafusion:vortex-file-compressed 10597680 / 10762950 / -1.5% 33016828 / 34766506 / -5.0% 0.32 / 0.31 / +3.7%
clickbench_q42/datafusion:vortex-file-compressed 10839175 / 11069476 / -2.1% 34378834 / 34250406 / +0.4% 0.32 / 0.32 / -2.4%
datafusion / vortex-compact / ns (0.954x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1202539 / 1235965 / -2.7% 18242001 / 20307195 / -10.2% 🟢 0.07 / 0.06 / +8.3%
clickbench_q01/datafusion:vortex-compact 6993418 / 7103819 / -1.6% 32942790 / 33139011 / -0.6% 0.21 / 0.21 / -1.0%
clickbench_q02/datafusion:vortex-compact 19706319 / 19407472 / +1.5% 41209451 / 41221080 / -0.0% 0.48 / 0.47 / +1.6%
clickbench_q03/datafusion:vortex-compact 13675373 / 14886866 / -8.1% 38735148 / 39671789 / -2.4% 0.35 / 0.38 / -5.9%
clickbench_q04/datafusion:vortex-compact 58474877 / 57142576 / +2.3% 87891537 / 90885684 / -3.3% 0.67 / 0.63 / +5.8%
clickbench_q05/datafusion:vortex-compact 81665951 / 84213984 / -3.0% 119211012 / 118895510 / +0.3% 0.69 / 0.71 / -3.3%
clickbench_q06/datafusion:vortex-compact 1246247 / 1259717 / -1.1% 19881374 / 20368381 / -2.4% 0.06 / 0.06 / +1.4%
clickbench_q07/datafusion:vortex-compact 12213507 / 11867495 / +2.9% 32421126 / 34175827 / -5.1% 0.38 / 0.35 / +8.5%
clickbench_q08/datafusion:vortex-compact 87185655 / 84036539 / +3.7% 114911907 / 117437544 / -2.2% 0.76 / 0.72 / +6.0%
clickbench_q09/datafusion:vortex-compact 187478218 / 190078192 / -1.4% 224872135 / 210208815 / +7.0% 0.83 / 0.90 / -7.8%
clickbench_q10/datafusion:vortex-compact 42986379 / 42682838 / +0.7% 66324166 / 66031679 / +0.4% 0.65 / 0.65 / +0.3%
clickbench_q11/datafusion:vortex-compact 55309492 / 54683782 / +1.1% 82350524 / 79698255 / +3.3% 0.67 / 0.69 / -2.1%
clickbench_q12/datafusion:vortex-compact 87093912 / 85685164 / +1.6% 121059366 / 119891135 / +1.0% 0.72 / 0.71 / +0.7%
clickbench_q13/datafusion:vortex-compact 135399239 / 134306278 / +0.8% 187594264 / 190525826 / -1.5% 0.72 / 0.70 / +2.4%
clickbench_q14/datafusion:vortex-compact 89429384 / 93154280 / -4.0% 122718056 / 129546941 / -5.3% 0.73 / 0.72 / +1.3%
clickbench_q15/datafusion:vortex-compact 64973601 / 63552316 / +2.2% 88453363 / 93315991 / -5.2% 0.73 / 0.68 / +7.9%
clickbench_q16/datafusion:vortex-compact 164757676 / 164574259 / +0.1% 211853058 / 214154456 / -1.1% 0.78 / 0.77 / +1.2%
clickbench_q17/datafusion:vortex-compact 164232033 / 164629470 / -0.2% 213028958 / 214788474 / -0.8% 0.77 / 0.77 / +0.6%
clickbench_q18/datafusion:vortex-compact 297203899 / 304394572 / -2.4% 373253337 / 366260448 / +1.9% 0.80 / 0.83 / -4.2%
clickbench_q19/datafusion:vortex-compact 10136746 / 10597820 / -4.4% 35296005 / 38338062 / -7.9% 0.29 / 0.28 / +3.9%
clickbench_q20/datafusion:vortex-compact 72678238 / 71895168 / +1.1% 188506371 / 191133739 / -1.4% 0.39 / 0.38 / +2.5%
clickbench_q21/datafusion:vortex-compact 117915870 / 115268401 / +2.3% 222793089 / 222347877 / +0.2% 0.53 / 0.52 / +2.1%
clickbench_q22/datafusion:vortex-compact 183327844 / 182618630 / +0.4% 270524009 / 271877003 / -0.5% 0.68 / 0.67 / +0.9%
clickbench_q23/datafusion:vortex-compact 230997950 / 523270836 / -55.9% 🟢 297492470 / 691554689 / -57.0% 🟢 0.78 / 0.76 / +2.6%
clickbench_q24/datafusion:vortex-compact 16429484 / 27277310 / -39.8% 🟢 43484454 / 58835896 / -26.1% 🟢 0.38 / 0.46 / -18.5%
clickbench_q25/datafusion:vortex-compact 35583872 / 35649414 / -0.2% 66746676 / 67317795 / -0.8% 0.53 / 0.53 / +0.7%
clickbench_q26/datafusion:vortex-compact 16603522 / 27951159 / -40.6% 🟢 48459407 / 58897419 / -17.7% 🟢 0.34 / 0.47 / -27.8%
clickbench_q27/datafusion:vortex-compact 101276814 / 103721450 / -2.4% 209259426 / 207926575 / +0.6% 0.48 / 0.50 / -3.0%
clickbench_q28/datafusion:vortex-compact 573371368 / 585478831 / -2.1% 629319208 / 628389983 / +0.1% 0.91 / 0.93 / -2.2%
clickbench_q29/datafusion:vortex-compact 30969276 / 30825534 / +0.5% 52760883 / 54574426 / -3.3% 0.59 / 0.56 / +3.9%
clickbench_q30/datafusion:vortex-compact 91084905 / 89874360 / +1.3% 123805847 / 119488026 / +3.6% 0.74 / 0.75 / -2.2%
clickbench_q31/datafusion:vortex-compact 99555422 / 97505701 / +2.1% 150925050 / 151732331 / -0.5% 0.66 / 0.64 / +2.6%
clickbench_q32/datafusion:vortex-compact 307449385 / 313175544 / -1.8% 374424230 / 381687321 / -1.9% 0.82 / 0.82 / +0.1%
clickbench_q33/datafusion:vortex-compact 338963862 / 340614232 / -0.5% 408910925 / 417925455 / -2.2% 0.83 / 0.82 / +1.7%
clickbench_q34/datafusion:vortex-compact 334775862 / 344253376 / -2.8% 430165381 / 429222551 / +0.2% 0.78 / 0.80 / -3.0%
clickbench_q35/datafusion:vortex-compact 62906515 / 64122478 / -1.9% 89108930 / 90136011 / -1.1% 0.71 / 0.71 / -0.8%
clickbench_q36/datafusion:vortex-compact 38443351 / 38503492 / -0.2% 65733421 / 65114673 / +1.0% 0.58 / 0.59 / -1.1%
clickbench_q37/datafusion:vortex-compact 22410728 / 22404788 / +0.0% 46537069 / 46765050 / -0.5% 0.48 / 0.48 / +0.5%
clickbench_q38/datafusion:vortex-compact 13108154 / 12810260 / +2.3% 38155999 / 39281730 / -2.9% 0.34 / 0.33 / +5.3%
clickbench_q39/datafusion:vortex-compact 79283158 / 78874128 / +0.5% 109226691 / 109328969 / -0.1% 0.73 / 0.72 / +0.6%
clickbench_q40/datafusion:vortex-compact 12328501 / 12351607 / -0.2% 34440003 / 36021936 / -4.4% 0.36 / 0.34 / +4.4%
clickbench_q41/datafusion:vortex-compact 12992502 / 13059653 / -0.5% 34578008 / 36142352 / -4.3% 0.38 / 0.36 / +4.0%
clickbench_q42/datafusion:vortex-compact 10885994 / 11149018 / -2.4% 32822870 / 33700865 / -2.6% 0.33 / 0.33 / +0.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1226830 / 1270971 / -3.5% 47758955 / 48966370 / -2.5% 0.03 / 0.03 / -1.0%
clickbench_q01/datafusion:parquet 16256536 / 15953604 / +1.9% 70312299 / 73388056 / -4.2% 0.23 / 0.22 / +6.4%
clickbench_q02/datafusion:parquet 18447989 / 18295962 / +0.8% 82140483 / 81459290 / +0.8% 0.22 / 0.22 / -0.0%
clickbench_q03/datafusion:parquet 17293063 / 17356559 / -0.4% 79101301 / 79946334 / -1.1% 0.22 / 0.22 / +0.7%
clickbench_q04/datafusion:parquet 64250756 / 62428751 / +2.9% 126717397 / 132999832 / -4.7% 0.51 / 0.47 / +8.0%
clickbench_q05/datafusion:parquet 88175895 / 88373448 / -0.2% 154455991 / 157711563 / -2.1% 0.57 / 0.56 / +1.9%
clickbench_q06/datafusion:parquet 1271188 / 1291786 / -1.6% 47383241 / 49824090 / -4.9% 0.03 / 0.03 / +3.5%
clickbench_q07/datafusion:parquet 16570604 / 16867634 / -1.8% 66729254 / 69184446 / -3.5% 0.25 / 0.24 / +1.9%
clickbench_q08/datafusion:parquet 86658810 / 85679682 / +1.1% 156627510 / 168512536 / -7.1% 0.55 / 0.51 / +8.8%
clickbench_q09/datafusion:parquet 188029184 / 192052550 / -2.1% 271815406 / 274849802 / -1.1% 0.69 / 0.70 / -1.0%
clickbench_q10/datafusion:parquet 36386140 / 36427277 / -0.1% 99129342 / 102082462 / -2.9% 0.37 / 0.36 / +2.9%
clickbench_q11/datafusion:parquet 43309924 / 43465878 / -0.4% 108778666 / 112207315 / -3.1% 0.40 / 0.39 / +2.8%
clickbench_q12/datafusion:parquet 95646910 / 96873433 / -1.3% 159374382 / 163036391 / -2.2% 0.60 / 0.59 / +1.0%
clickbench_q13/datafusion:parquet 147564790 / 147022032 / +0.4% 227236059 / 230521056 / -1.4% 0.65 / 0.64 / +1.8%
clickbench_q14/datafusion:parquet 102385763 / 102600574 / -0.2% 171679653 / 173967748 / -1.3% 0.60 / 0.59 / +1.1%
clickbench_q15/datafusion:parquet 70768566 / 71521016 / -1.1% 131586603 / 132514756 / -0.7% 0.54 / 0.54 / -0.4%
clickbench_q16/datafusion:parquet 157055031 / 156311814 / +0.5% 233330254 / 239119990 / -2.4% 0.67 / 0.65 / +3.0%
clickbench_q17/datafusion:parquet 156309116 / 157970036 / -1.1% 244121496 / 240430731 / +1.5% 0.64 / 0.66 / -2.5%
clickbench_q18/datafusion:parquet 314035358 / 315069182 / -0.3% 421962054 / 425792194 / -0.9% 0.74 / 0.74 / +0.6%
clickbench_q19/datafusion:parquet 18375858 / 18950925 / -3.0% 75196123 / 79739385 / -5.7% 0.24 / 0.24 / +2.8%
clickbench_q20/datafusion:parquet 179930281 / 180313834 / -0.2% 287639842 / 299421213 / -3.9% 0.63 / 0.60 / +3.9%
clickbench_q21/datafusion:parquet 173652078 / 174517002 / -0.5% 306796206 / 317332173 / -3.3% 0.57 / 0.55 / +2.9%
clickbench_q22/datafusion:parquet 264498757 / 262713448 / +0.7% 437479637 / 451857305 / -3.2% 0.60 / 0.58 / +4.0%
clickbench_q23/datafusion:parquet 1156278854 / 1184563930 / -2.4% 1232096482 / 1246144816 / -1.1% 0.94 / 0.95 / -1.3%
clickbench_q24/datafusion:parquet 30100300 / 29957268 / +0.5% 85753198 / 89895309 / -4.6% 0.35 / 0.33 / +5.3%
clickbench_q25/datafusion:parquet 37613848 / 36937738 / +1.8% 98903973 / 105773659 / -6.5% 0.38 / 0.35 / +8.9%
clickbench_q26/datafusion:parquet 30734985 / 31075816 / -1.1% 86304900 / 90283831 / -4.4% 0.36 / 0.34 / +3.5%
clickbench_q27/datafusion:parquet 193748290 / 194236952 / -0.3% 282172261 / 308056141 / -8.4% 0.69 / 0.63 / +8.9%
clickbench_q28/datafusion:parquet 622367770 / 622080154 / +0.0% 699009385 / 703510488 / -0.6% 0.89 / 0.88 / +0.7%
clickbench_q29/datafusion:parquet 29249062 / 28419412 / +2.9% 90364874 / 92358038 / -2.2% 0.32 / 0.31 / +5.2%
clickbench_q30/datafusion:parquet 90203299 / 90396848 / -0.2% 166484837 / 174804997 / -4.8% 0.54 / 0.52 / +4.8%
clickbench_q31/datafusion:parquet 103920620 / 104410434 / -0.5% 189687180 / 201669252 / -5.9% 0.55 / 0.52 / +5.8%
clickbench_q32/datafusion:parquet 326731052 / 324346427 / +0.7% 426963648 / 435102282 / -1.9% 0.77 / 0.75 / +2.7%
clickbench_q33/datafusion:parquet 382006191 / 383264070 / -0.3% 469361689 / 476699855 / -1.5% 0.81 / 0.80 / +1.2%
clickbench_q34/datafusion:parquet 385680568 / 381728692 / +1.0% 468968309 / 473979449 / -1.1% 0.82 / 0.81 / +2.1%
clickbench_q35/datafusion:parquet 64294856 / 64295196 / -0.0% 126690802 / 123840178 / +2.3% 0.51 / 0.52 / -2.3%
clickbench_q36/datafusion:parquet 72956182 / 73497933 / -0.7% 132361606 / 136933462 / -3.3% 0.55 / 0.54 / +2.7%
clickbench_q37/datafusion:parquet 35621619 / 35361230 / +0.7% 90365926 / 90881847 / -0.6% 0.39 / 0.39 / +1.3%
clickbench_q38/datafusion:parquet 47909828 / 47329160 / +1.2% 104620799 / 107739306 / -2.9% 0.46 / 0.44 / +4.2%
clickbench_q39/datafusion:parquet 143829062 / 143615913 / +0.1% 205589402 / 209277745 / -1.8% 0.70 / 0.69 / +1.9%
clickbench_q40/datafusion:parquet 19963680 / 20399270 / -2.1% 74949274 / 77170942 / -2.9% 0.27 / 0.26 / +0.8%
clickbench_q41/datafusion:parquet 18784556 / 18815044 / -0.2% 75245666 / 74127615 / +1.5% 0.25 / 0.25 / -1.6%
clickbench_q42/datafusion:parquet 19291776 / 19380637 / -0.5% 72940462 / 74864323 / -2.6% 0.26 / 0.26 / +2.2%
duckdb / vortex-file-compressed / ns (1.009x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1627416 / 1595528 / +2.0% 26066541 / 24285185 / +7.3% 0.06 / 0.07 / -5.0%
clickbench_q01/duckdb:vortex-file-compressed 11857504 / 12016983 / -1.3% 29585962 / 28448447 / +4.0% 0.40 / 0.42 / -5.1%
clickbench_q02/duckdb:vortex-file-compressed 13065409 / 12743041 / +2.5% 31806353 / 34158969 / -6.9% 0.41 / 0.37 / +10.1%
clickbench_q03/duckdb:vortex-file-compressed 20531384 / 16784340 / +22.3% 🔴 46006601 / 54124888 / -15.0% 🟢 0.45 / 0.31 / +43.9%
clickbench_q04/duckdb:vortex-file-compressed 68550494 / 67676547 / +1.3% 103372860 / 119416650 / -13.4% 🟢 0.66 / 0.57 / +17.0%
clickbench_q05/duckdb:vortex-file-compressed 67614292 / 67928114 / -0.5% 93797744 / 103687515 / -9.5% 0.72 / 0.66 / +10.0%
clickbench_q06/duckdb:vortex-file-compressed 1846249 / 1816086 / +1.7% 30531155 / 27593243 / +10.6% 🔴 0.06 / 0.07 / -8.1%
clickbench_q07/duckdb:vortex-file-compressed 14997656 / 15326474 / -2.1% 33267354 / 28616809 / +16.3% 🔴 0.45 / 0.54 / -15.8%
clickbench_q08/duckdb:vortex-file-compressed 84717500 / 81841310 / +3.5% 122445644 / 125624630 / -2.5% 0.69 / 0.65 / +6.2%
clickbench_q09/duckdb:vortex-file-compressed 106626544 / 106873047 / -0.2% 151355027 / 161547206 / -6.3% 0.70 / 0.66 / +6.5%
clickbench_q10/duckdb:vortex-file-compressed 32272756 / 32249878 / +0.1% 64135599 / 70643638 / -9.2% 0.50 / 0.46 / +10.2%
clickbench_q11/duckdb:vortex-file-compressed 36648453 / 35006443 / +4.7% 69026042 / 75120638 / -8.1% 0.53 / 0.47 / +13.9%
clickbench_q12/duckdb:vortex-file-compressed 73567559 / 74006154 / -0.6% 105319653 / 108809952 / -3.2% 0.70 / 0.68 / +2.7%
clickbench_q13/duckdb:vortex-file-compressed 132226459 / 131039751 / +0.9% 170463988 / 178109549 / -4.3% 0.78 / 0.74 / +5.4%
clickbench_q14/duckdb:vortex-file-compressed 77801144 / 78129796 / -0.4% 105551008 / 111124508 / -5.0% 0.74 / 0.70 / +4.8%
clickbench_q15/duckdb:vortex-file-compressed 91230598 / 93614404 / -2.5% 144782244 / 131904585 / +9.8% 0.63 / 0.71 / -11.2%
clickbench_q16/duckdb:vortex-file-compressed 158967704 / 167499124 / -5.1% 230867544 / 210900319 / +9.5% 0.69 / 0.79 / -13.3%
clickbench_q17/duckdb:vortex-file-compressed 164125384 / 161915470 / +1.4% 208284680 / 211813252 / -1.7% 0.79 / 0.76 / +3.1%
clickbench_q18/duckdb:vortex-file-compressed 322088130 / 314501096 / +2.4% 372688769 / 381832064 / -2.4% 0.86 / 0.82 / +4.9%
clickbench_q19/duckdb:vortex-file-compressed 17893321 / 15920721 / +12.4% 🔴 40177264 / 42955640 / -6.5% 0.45 / 0.37 / +20.2%
clickbench_q20/duckdb:vortex-file-compressed 108316510 / 111684212 / -3.0% 184145841 / 198965775 / -7.4% 0.59 / 0.56 / +4.8%
clickbench_q21/duckdb:vortex-file-compressed 156509100 / 155609538 / +0.6% 284906056 / 299908462 / -5.0% 0.55 / 0.52 / +5.9%
clickbench_q22/duckdb:vortex-file-compressed 236605817 / 234964843 / +0.7% 422000610 / 457181484 / -7.7% 0.56 / 0.51 / +9.1%
clickbench_q23/duckdb:vortex-file-compressed 58410425 / 58432042 / -0.0% 96538980 / 104000982 / -7.2% 0.61 / 0.56 / +7.7%
clickbench_q24/duckdb:vortex-file-compressed 26402466 / 24171824 / +9.2% 44900633 / 44399006 / +1.1% 0.59 / 0.54 / +8.0%
clickbench_q25/duckdb:vortex-file-compressed 32185116 / 30746766 / +4.7% 54486938 / 50616578 / +7.6% 0.59 / 0.61 / -2.8%
clickbench_q26/duckdb:vortex-file-compressed 20864294 / 20196780 / +3.3% 36371531 / 36342351 / +0.1% 0.57 / 0.56 / +3.2%
clickbench_q27/duckdb:vortex-file-compressed 133383124 / 134248772 / -0.6% 242672247 / 244740536 / -0.8% 0.55 / 0.55 / +0.2%
clickbench_q28/duckdb:vortex-file-compressed 633069770 / 812505888 / -22.1% 🟢 746892608 / 693956241 / +7.6% 0.85 / 1.17 / -27.6%
clickbench_q29/duckdb:vortex-file-compressed 17267458 / 17028966 / +1.4% 36948235 / 37030241 / -0.2% 0.47 / 0.46 / +1.6%
clickbench_q30/duckdb:vortex-file-compressed 65960592 / 65011818 / +1.5% 105941083 / 112510766 / -5.8% 0.62 / 0.58 / +7.8%
clickbench_q31/duckdb:vortex-file-compressed 125098682 / 122393724 / +2.2% 198197404 / 208320255 / -4.9% 0.63 / 0.59 / +7.4%
clickbench_q32/duckdb:vortex-file-compressed 463197978 / 439079456 / +5.5% 500758418 / 602209230 / -16.8% 🟢 0.92 / 0.73 / +26.9%
clickbench_q33/duckdb:vortex-file-compressed 394875184 / 396437616 / -0.4% 489489345 / 500232959 / -2.1% 0.81 / 0.79 / +1.8%
clickbench_q34/duckdb:vortex-file-compressed 410648388 / 420582537 / -2.4% 526421154 / 524102162 / +0.4% 0.78 / 0.80 / -2.8%
clickbench_q35/duckdb:vortex-file-compressed 100816238 / 107432695 / -6.2% 138438773 / 144399038 / -4.1% 0.73 / 0.74 / -2.1%
clickbench_q36/duckdb:vortex-file-compressed 15470870 / 16148637 / -4.2% 33088418 / 32808388 / +0.9% 0.47 / 0.49 / -5.0%
clickbench_q37/duckdb:vortex-file-compressed 12340640 / 11308626 / +9.1% 33319229 / 28762456 / +15.8% 🔴 0.37 / 0.39 / -5.8%
clickbench_q38/duckdb:vortex-file-compressed 12523534 / 12850272 / -2.5% 30196281 / 29263717 / +3.2% 0.41 / 0.44 / -5.6%
clickbench_q39/duckdb:vortex-file-compressed 23369148 / 23267372 / +0.4% 43379545 / 40231717 / +7.8% 0.54 / 0.58 / -6.9%
clickbench_q40/duckdb:vortex-file-compressed 11502360 / 11674149 / -1.5% 29355500 / 27940225 / +5.1% 0.39 / 0.42 / -6.2%
clickbench_q41/duckdb:vortex-file-compressed 12813934 / 10972232 / +16.8% 🔴 29808437 / 26151363 / +14.0% 🔴 0.43 / 0.42 / +2.5%
clickbench_q42/duckdb:vortex-file-compressed 11303096 / 12096354 / -6.6% 29291541 / 28561178 / +2.6% 0.39 / 0.42 / -8.9%
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1650931 / 1553492 / +6.3% 25971751 / 24966247 / +4.0% 0.06 / 0.06 / +2.2%
clickbench_q01/duckdb:vortex-compact 12309256 / 12217134 / +0.8% 27867483 / 30676566 / -9.2% 0.44 / 0.40 / +10.9%
clickbench_q02/duckdb:vortex-compact 19059210 / 18783916 / +1.5% 38020414 / 39670923 / -4.2% 0.50 / 0.47 / +5.9%
clickbench_q03/duckdb:vortex-compact 19961927 / 20947032 / -4.7% 46431999 / 51071112 / -9.1% 0.43 / 0.41 / +4.8%
clickbench_q04/duckdb:vortex-compact 72227895 / 73924170 / -2.3% 108712380 / 102898009 / +5.7% 0.66 / 0.72 / -7.5%
clickbench_q05/duckdb:vortex-compact 74221037 / 75419434 / -1.6% 102770318 / 103630746 / -0.8% 0.72 / 0.73 / -0.8%
clickbench_q06/duckdb:vortex-compact 1829004 / 1807120 / +1.2% 29412652 / 27700621 / +6.2% 0.06 / 0.07 / -4.7%
clickbench_q07/duckdb:vortex-compact 14968341 / 14429072 / +3.7% 30090377 / 32448156 / -7.3% 0.50 / 0.44 / +11.9%
clickbench_q08/duckdb:vortex-compact 95548309 / 95111894 / +0.5% 132471589 / 133048416 / -0.4% 0.72 / 0.71 / +0.9%
clickbench_q09/duckdb:vortex-compact 142792323 / 145338246 / -1.8% 187126846 / 178780358 / +4.7% 0.76 / 0.81 / -6.1%
clickbench_q10/duckdb:vortex-compact 53332941 / 53002602 / +0.6% 87271922 / 86114876 / +1.3% 0.61 / 0.62 / -0.7%
clickbench_q11/duckdb:vortex-compact 66254985 / 66250897 / +0.0% 103339079 / 105089870 / -1.7% 0.64 / 0.63 / +1.7%
clickbench_q12/duckdb:vortex-compact 85681306 / 84939792 / +0.9% 123439919 / 122982523 / +0.4% 0.69 / 0.69 / +0.5%
clickbench_q13/duckdb:vortex-compact 163752494 / 158564626 / +3.3% 202171187 / 212651763 / -4.9% 0.81 / 0.75 / +8.6%
clickbench_q14/duckdb:vortex-compact 98850035 / 94909954 / +4.2% 124357989 / 127311108 / -2.3% 0.79 / 0.75 / +6.6%
clickbench_q15/duckdb:vortex-compact 94409328 / 98490610 / -4.1% 130025172 / 132991995 / -2.2% 0.73 / 0.74 / -2.0%
clickbench_q16/duckdb:vortex-compact 178314227 / 180499675 / -1.2% 221853479 / 251611077 / -11.8% 🟢 0.80 / 0.72 / +12.0%
clickbench_q17/duckdb:vortex-compact 180927662 / 179779305 / +0.6% 230805637 / 223986616 / +3.0% 0.78 / 0.80 / -2.3%
clickbench_q18/duckdb:vortex-compact 328566214 / 328499642 / +0.0% 373396116 / 432521418 / -13.7% 🟢 0.88 / 0.76 / +15.9%
clickbench_q19/duckdb:vortex-compact 16372882 / 16763614 / -2.3% 38500777 / 39629597 / -2.8% 0.43 / 0.42 / +0.5%
clickbench_q20/duckdb:vortex-compact 108302968 / 110139736 / -1.7% 171077482 / 181152943 / -5.6% 0.63 / 0.61 / +4.1%
clickbench_q21/duckdb:vortex-compact 171866136 / 171700849 / +0.1% 291081746 / 317876754 / -8.4% 0.59 / 0.54 / +9.3%
clickbench_q22/duckdb:vortex-compact 344206592 / 345040734 / -0.2% 500262415 / 554671391 / -9.8% 0.69 / 0.62 / +10.6%
clickbench_q23/duckdb:vortex-compact 99933697 / 98388206 / +1.6% 132448098 / 138892068 / -4.6% 0.75 / 0.71 / +6.5%
clickbench_q24/duckdb:vortex-compact 33118499 / 31105937 / +6.5% 43284247 / 46142868 / -6.2% 0.77 / 0.67 / +13.5%
clickbench_q25/duckdb:vortex-compact 47115350 / 48049096 / -1.9% 70774216 / 72144417 / -1.9% 0.67 / 0.67 / -0.0%
clickbench_q26/duckdb:vortex-compact 25790168 / 24975102 / +3.3% 40284218 / 43710005 / -7.8% 0.64 / 0.57 / +12.0%
clickbench_q27/duckdb:vortex-compact 189951142 / 193652034 / -1.9% 295250064 / 315667339 / -6.5% 0.64 / 0.61 / +4.9%
clickbench_q28/duckdb:vortex-compact 585750712 / 576852463 / +1.5% 696705939 / 713020982 / -2.3% 0.84 / 0.81 / +3.9%
clickbench_q29/duckdb:vortex-compact 22811150 / 23552816 / -3.1% 45918455 / 45335646 / +1.3% 0.50 / 0.52 / -4.4%
clickbench_q30/duckdb:vortex-compact 111510246 / 108298109 / +3.0% 145627443 / 154301929 / -5.6% 0.77 / 0.70 / +9.1%
clickbench_q31/duckdb:vortex-compact 173709730 / 179408598 / -3.2% 235743414 / 246414056 / -4.3% 0.74 / 0.73 / +1.2%
clickbench_q32/duckdb:vortex-compact 459764672 / 464867222 / -1.1% 512302141 / 513358890 / -0.2% 0.90 / 0.91 / -0.9%
clickbench_q33/duckdb:vortex-compact 408416465 / 388951922 / +5.0% 498859535 / 501870118 / -0.6% 0.82 / 0.78 / +5.6%
clickbench_q34/duckdb:vortex-compact 414019186 / 413642432 / +0.1% 526686013 / 540234835 / -2.5% 0.79 / 0.77 / +2.7%
clickbench_q35/duckdb:vortex-compact 108121484 / 109226386 / -1.0% 139342112 / 142661187 / -2.3% 0.78 / 0.77 / +1.3%
clickbench_q36/duckdb:vortex-compact 17267590 / 16726936 / +3.2% 34276644 / 33096096 / +3.6% 0.50 / 0.51 / -0.3%
clickbench_q37/duckdb:vortex-compact 13893894 / 13379520 / +3.8% 31292611 / 28273987 / +10.7% 🔴 0.44 / 0.47 / -6.2%
clickbench_q38/duckdb:vortex-compact 12930131 / 13706598 / -5.7% 29602780 / 30070370 / -1.6% 0.44 / 0.46 / -4.2%
clickbench_q39/duckdb:vortex-compact 24989626 / 25215372 / -0.9% 42849127 / 43259913 / -0.9% 0.58 / 0.58 / +0.1%
clickbench_q40/duckdb:vortex-compact 12712780 / 12888868 / -1.4% 28190027 / 30310021 / -7.0% 0.45 / 0.43 / +6.1%
clickbench_q41/duckdb:vortex-compact 13797026 / 12635084 / +9.2% 32821781 / 26857179 / +22.2% 🔴 0.42 / 0.47 / -10.6%
clickbench_q42/duckdb:vortex-compact 12469698 / 11432336 / +9.1% 37501082 / 29536714 / +27.0% 🔴 0.33 / 0.39 / -14.1%
duckdb / parquet / ns (0.993x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8338160 / 9597083 / -13.1% 🟢 21016687 / 25478677 / -17.5% 🟢 0.40 / 0.38 / +5.3%
clickbench_q01/duckdb:parquet 9526617 / 9594056 / -0.7% 18016124 / 21405221 / -15.8% 🟢 0.53 / 0.45 / +18.0%
clickbench_q02/duckdb:parquet 15852896 / 15374066 / +3.1% 32594238 / 36177077 / -9.9% 0.49 / 0.42 / +14.4%
clickbench_q03/duckdb:parquet 15691320 / 15812282 / -0.8% 51317450 / 57239162 / -10.3% 🟢 0.31 / 0.28 / +10.7%
clickbench_q04/duckdb:parquet 70143944 / 75835764 / -7.5% 94493061 / 105831356 / -10.7% 🟢 0.74 / 0.72 / +3.6%
clickbench_q05/duckdb:parquet 82131857 / 91179099 / -9.9% 114038821 / 136828497 / -16.7% 🟢 0.72 / 0.67 / +8.1%
clickbench_q06/duckdb:parquet 14405421 / 14714058 / -2.1% 23054691 / 25042208 / -7.9% 0.62 / 0.59 / +6.3%
clickbench_q07/duckdb:parquet 11000662 / 11611015 / -5.3% 21799531 / 25752996 / -15.4% 🟢 0.50 / 0.45 / +11.9%
clickbench_q08/duckdb:parquet 85077120 / 84786348 / +0.3% 126697741 / 125823727 / +0.7% 0.67 / 0.67 / -0.3%
clickbench_q09/duckdb:parquet 114552436 / 114458847 / +0.1% 155781928 / 159781084 / -2.5% 0.74 / 0.72 / +2.7%
clickbench_q10/duckdb:parquet 32762380 / 32088768 / +2.1% 67328501 / 71919589 / -6.4% 0.49 / 0.45 / +9.1%
clickbench_q11/duckdb:parquet 36509202 / 38132616 / -4.3% 75247634 / 79576524 / -5.4% 0.49 / 0.48 / +1.3%
clickbench_q12/duckdb:parquet 91259004 / 89728357 / +1.7% 138030596 / 137117547 / +0.7% 0.66 / 0.65 / +1.0%
clickbench_q13/duckdb:parquet 150346324 / 144140672 / +4.3% 221444340 / 212020391 / +4.4% 0.68 / 0.68 / -0.1%
clickbench_q14/duckdb:parquet 96768933 / 98639674 / -1.9% 138403854 / 140557297 / -1.5% 0.70 / 0.70 / -0.4%
clickbench_q15/duckdb:parquet 92546499 / 93712248 / -1.2% 122296992 / 119218560 / +2.6% 0.76 / 0.79 / -3.7%
clickbench_q16/duckdb:parquet 170964044 / 174282596 / -1.9% 232369641 / 229255413 / +1.4% 0.74 / 0.76 / -3.2%
clickbench_q17/duckdb:parquet 191202522 / 185056731 / +3.3% 225980941 / 234372424 / -3.6% 0.85 / 0.79 / +7.2%
clickbench_q18/duckdb:parquet 333224502 / 323627446 / +3.0% 400790821 / 408317145 / -1.8% 0.83 / 0.79 / +4.9%
clickbench_q19/duckdb:parquet 13368208 / 12867412 / +3.9% 39196849 / 41221004 / -4.9% 0.34 / 0.31 / +9.3%
clickbench_q20/duckdb:parquet 140952335 / 130292602 / +8.2% 248673573 / 246820694 / +0.8% 0.57 / 0.53 / +7.4%
clickbench_q21/duckdb:parquet 182737372 / 174964261 / +4.4% 332288416 / 333807432 / -0.5% 0.55 / 0.52 / +4.9%
clickbench_q22/duckdb:parquet 230746235 / 246113972 / -6.2% 419221305 / 417095457 / +0.5% 0.55 / 0.59 / -6.7%
clickbench_q23/duckdb:parquet 143342312 / 147525945 / -2.8% 170676053 / 167791783 / +1.7% 0.84 / 0.88 / -4.5%
clickbench_q24/duckdb:parquet 44462997 / 42992722 / +3.4% 62119448 / 61124611 / +1.6% 0.72 / 0.70 / +1.8%
clickbench_q25/duckdb:parquet 39870956 / 40072000 / -0.5% 88247600 / 94409786 / -6.5% 0.45 / 0.42 / +6.4%
clickbench_q26/duckdb:parquet 30298899 / 31230570 / -3.0% 48298266 / 48763214 / -1.0% 0.63 / 0.64 / -2.0%
clickbench_q27/duckdb:parquet 145133299 / 143908522 / +0.9% 260896986 / 255420415 / +2.1% 0.56 / 0.56 / -1.3%
clickbench_q28/duckdb:parquet 903772379 / 906697548 / -0.3% 998095163 / 1005835192 / -0.8% 0.91 / 0.90 / +0.5%
clickbench_q29/duckdb:parquet 17223476 / 16735458 / +2.9% 29912844 / 34118535 / -12.3% 🟢 0.58 / 0.49 / +17.4%
clickbench_q30/duckdb:parquet 90013205 / 92870312 / -3.1% 171246995 / 174116765 / -1.6% 0.53 / 0.53 / -1.5%
clickbench_q31/duckdb:parquet 147989439 / 145028702 / +2.0% 268110062 / 291970308 / -8.2% 0.55 / 0.50 / +11.1%
clickbench_q32/duckdb:parquet 448667467 / 450585456 / -0.4% 488174805 / 531994687 / -8.2% 0.92 / 0.85 / +8.5%
clickbench_q33/duckdb:parquet 455410653 / 449551838 / +1.3% 486118786 / 476103719 / +2.1% 0.94 / 0.94 / -0.8%
clickbench_q34/duckdb:parquet 455239398 / 446528592 / +2.0% 484690355 / 512976524 / -5.5% 0.94 / 0.87 / +7.9%
clickbench_q35/duckdb:parquet 100090253 / 99811428 / +0.3% 115839694 / 125747170 / -7.9% 0.86 / 0.79 / +8.9%
clickbench_q36/duckdb:parquet 30919342 / 31510094 / -1.9% 41474282 / 40819515 / +1.6% 0.75 / 0.77 / -3.4%
clickbench_q37/duckdb:parquet 23028984 / 23043446 / -0.1% 33081625 / 31232513 / +5.9% 0.70 / 0.74 / -5.6%
clickbench_q38/duckdb:parquet 23762496 / 24163536 / -1.7% 33069240 / 33062043 / +0.0% 0.72 / 0.73 / -1.7%
clickbench_q39/duckdb:parquet 56647302 / 56682154 / -0.1% 65777039 / 66011117 / -0.4% 0.86 / 0.86 / +0.3%
clickbench_q40/duckdb:parquet 12651388 / 13119926 / -3.6% 22335018 / 21781451 / +2.5% 0.57 / 0.60 / -6.0%
clickbench_q41/duckdb:parquet 13133644 / 13163920 / -0.2% 21533849 / 22279814 / -3.3% 0.61 / 0.59 / +3.2%
clickbench_q42/duckdb:parquet 14295784 / 14376906 / -0.6% 23831902 / 23757026 / +0.3% 0.60 / 0.61 / -0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-2.4%, low confidence) · DuckDB No clear signal (+2.6%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.095x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.039x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.974x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6930587 / 7149346 / -3.1% 22571431 / 20242683 / +11.5% 🔴 0.31 / 0.35 / -13.1%
fineweb_q01/datafusion:vortex-file-compressed 12036263 / 12673774 / -5.0% 52438163 / 46397001 / +13.0% 🔴 0.23 / 0.27 / -16.0%
fineweb_q02/datafusion:vortex-file-compressed 12820443 / 13577434 / -5.6% 58307622 / 46147036 / +26.4% 🔴 0.22 / 0.29 / -25.3%
fineweb_q03/datafusion:vortex-file-compressed 21917658 / 22195181 / -1.3% 119721625 / 110590308 / +8.3% 0.18 / 0.20 / -8.8%
fineweb_q04/datafusion:vortex-file-compressed 79460300 / 81290140 / -2.3% 175003894 / 165415538 / +5.8% 0.45 / 0.49 / -7.6%
fineweb_q05/datafusion:vortex-file-compressed 67338126 / 69377657 / -2.9% 165941425 / 146519605 / +13.3% 🔴 0.41 / 0.47 / -14.3%
fineweb_q06/datafusion:vortex-file-compressed 20216250 / 20035251 / +0.9% 121869179 / 110678355 / +10.1% 🔴 0.17 / 0.18 / -8.4%
fineweb_q07/datafusion:vortex-file-compressed 20280075 / 19634784 / +3.3% 118877034 / 106891387 / +11.2% 🔴 0.17 / 0.18 / -7.1%
fineweb_q08/datafusion:vortex-file-compressed 8727598 / 9372819 / -6.9% 66898802 / 53954720 / +24.0% 🔴 0.13 / 0.17 / -24.9%
datafusion / vortex-compact / ns (0.989x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7078355 / 7093704 / -0.2% 21440529 / 20555501 / +4.3% 0.33 / 0.35 / -4.3%
fineweb_q01/datafusion:vortex-compact 60402439 / 77264118 / -21.8% 🟢 86485946 / 110749692 / -21.9% 🟢 0.70 / 0.70 / +0.1%
fineweb_q02/datafusion:vortex-compact 60790244 / 44128985 / +37.8% 🔴 87244714 / 79284195 / +10.0% 🔴 0.70 / 0.56 / +25.2%
fineweb_q03/datafusion:vortex-compact 171607102 / 158381251 / +8.4% 234016938 / 222838812 / +5.0% 0.73 / 0.71 / +3.2%
fineweb_q04/datafusion:vortex-compact 191341718 / 178898274 / +7.0% 247504155 / 258862689 / -4.4% 0.77 / 0.69 / +11.9%
fineweb_q05/datafusion:vortex-compact 169769635 / 171170607 / -0.8% 269033952 / 231039757 / +16.4% 🔴 0.63 / 0.74 / -14.8%
fineweb_q06/datafusion:vortex-compact 86265926 / 87199181 / -1.1% 180007530 / 164733390 / +9.3% 0.48 / 0.53 / -9.5%
fineweb_q07/datafusion:vortex-compact 88571150 / 88478991 / +0.1% 164213078 / 159138266 / +3.2% 0.54 / 0.56 / -3.0%
fineweb_q08/datafusion:vortex-compact 8005670 / 10827006 / -26.1% 🟢 64360174 / 36074151 / +78.4% 🔴 0.12 / 0.30 / -58.6%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9628300 / 9223406 / +4.4% 34150308 / 34071675 / +0.2% 0.28 / 0.27 / +4.1%
fineweb_q01/datafusion:parquet 75232267 / 74363798 / +1.2% 167831897 / 159401685 / +5.3% 0.45 / 0.47 / -3.9%
fineweb_q02/datafusion:parquet 74338144 / 75118028 / -1.0% 172385083 / 161340070 / +6.8% 0.43 / 0.47 / -7.4%
fineweb_q03/datafusion:parquet 72791074 / 74313364 / -2.0% 161247891 / 159492717 / +1.1% 0.45 / 0.47 / -3.1%
fineweb_q04/datafusion:parquet 83350659 / 82429846 / +1.1% 160704199 / 155661639 / +3.2% 0.52 / 0.53 / -2.1%
fineweb_q05/datafusion:parquet 80297476 / 80611062 / -0.4% 160519777 / 163222060 / -1.7% 0.50 / 0.49 / +1.3%
fineweb_q06/datafusion:parquet 77578830 / 76224448 / +1.8% 170689990 / 165832200 / +2.9% 0.45 / 0.46 / -1.1%
fineweb_q07/datafusion:parquet 73821300 / 74636434 / -1.1% 166437956 / 158978083 / +4.7% 0.44 / 0.47 / -5.5%
fineweb_q08/datafusion:parquet 73192672 / 72429759 / +1.1% 161974475 / 181012910 / -10.5% 🟢 0.45 / 0.40 / +12.9%
duckdb / vortex-file-compressed / ns (1.011x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 4426736 / 3104230 / +42.6% 🔴 5424878 / 6173142 / -12.1% 🟢 0.82 / 0.50 / +62.3%
fineweb_q01/duckdb:vortex-file-compressed 18196096 / 22692156 / -19.8% 🟢 48940051 / 59706379 / -18.0% 🟢 0.37 / 0.38 / -2.2%
fineweb_q02/duckdb:vortex-file-compressed 18214931 / 20243214 / -10.0% 🟢 58950787 / 49188247 / +19.8% 🔴 0.31 / 0.41 / -24.9%
fineweb_q03/duckdb:vortex-file-compressed 27152666 / 30436908 / -10.8% 🟢 155871471 / 106910445 / +45.8% 🔴 0.17 / 0.28 / -38.8%
fineweb_q04/duckdb:vortex-file-compressed 85680630 / 78621026 / +9.0% 165932378 / 119706880 / +38.6% 🔴 0.52 / 0.66 / -21.4%
fineweb_q05/duckdb:vortex-file-compressed 71828834 / 73892700 / -2.8% 127839755 / 157884532 / -19.0% 🟢 0.56 / 0.47 / +20.1%
fineweb_q06/duckdb:vortex-file-compressed 31730486 / 34448418 / -7.9% 115051705 / 116271117 / -1.0% 0.28 / 0.30 / -6.9%
fineweb_q07/duckdb:vortex-file-compressed 28554042 / 20249952 / +41.0% 🔴 134385013 / 93735133 / +43.4% 🔴 0.21 / 0.22 / -1.6%
fineweb_q08/duckdb:vortex-file-compressed 7393822 / 8458548 / -12.6% 🟢 18928336 / 14738984 / +28.4% 🔴 0.39 / 0.57 / -31.9%
duckdb / vortex-compact / ns (1.021x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2917874 / 3588305 / -18.7% 🟢 5027453 / 7425165 / -32.3% 🟢 0.58 / 0.48 / +20.1%
fineweb_q01/duckdb:vortex-compact 49742613 / 45185246 / +10.1% 🔴 100949177 / 67192411 / +50.2% 🔴 0.49 / 0.67 / -26.7%
fineweb_q02/duckdb:vortex-compact 53750229 / 46475571 / +15.7% 🔴 93763582 / 68881241 / +36.1% 🔴 0.57 / 0.67 / -15.0%
fineweb_q03/duckdb:vortex-compact 183291092 / 180514715 / +1.5% 236525860 / 255537970 / -7.4% 0.77 / 0.71 / +9.7%
fineweb_q04/duckdb:vortex-compact 222015189 / 186226270 / +19.2% 🔴 340878122 / 220037404 / +54.9% 🔴 0.65 / 0.85 / -23.0%
fineweb_q05/duckdb:vortex-compact 182361260 / 184295650 / -1.0% 209880326 / 226232214 / -7.2% 0.87 / 0.81 / +6.7%
fineweb_q06/duckdb:vortex-compact 116318817 / 110361040 / +5.4% 220541296 / 242541964 / -9.1% 0.53 / 0.46 / +15.9%
fineweb_q07/duckdb:vortex-compact 101278034 / 102309532 / -1.0% 151183293 / 184001253 / -17.8% 🟢 0.67 / 0.56 / +20.5%
fineweb_q08/duckdb:vortex-compact 6838336 / 7310556 / -6.5% 13167063 / 11819461 / +11.4% 🔴 0.52 / 0.62 / -16.0%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23284248 / 23458958 / -0.7% 28311288 / 24676544 / +14.7% 🔴 0.82 / 0.95 / -13.5%
fineweb_q01/duckdb:parquet 44469588 / 44660136 / -0.4% 58634118 / 54786606 / +7.0% 0.76 / 0.82 / -7.0%
fineweb_q02/duckdb:parquet 43184815 / 43825046 / -1.5% 57944084 / 53570475 / +8.2% 0.75 / 0.82 / -8.9%
fineweb_q03/duckdb:parquet 94008518 / 94352892 / -0.4% 188922438 / 183258686 / +3.1% 0.50 / 0.51 / -3.4%
fineweb_q04/duckdb:parquet 151174269 / 159862688 / -5.4% 217639794 / 200666990 / +8.5% 0.69 / 0.80 / -12.8%
fineweb_q05/duckdb:parquet 143031706 / 142138525 / +0.6% 206306001 / 195904887 / +5.3% 0.69 / 0.73 / -4.4%
fineweb_q06/duckdb:parquet 70890589 / 70794738 / +0.1% 135633054 / 130627778 / +3.8% 0.52 / 0.54 / -3.6%
fineweb_q07/duckdb:parquet 72106596 / 71959097 / +0.2% 161947416 / 158696228 / +2.0% 0.45 / 0.45 / -1.8%
fineweb_q08/duckdb:parquet 22225296 / 22348172 / -0.5% 28579638 / 26691523 / +7.1% 0.78 / 0.84 / -7.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 1bd8d278 vs base 2b4c6822


vortex / vortex-file-compressed / ns (0.984x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 726098479 / 735367647 / -1.3%
compress time/Bimbo 3512985227 / 3547384105 / -1.0%
compress time/CMSprovider 2404787152 / 2441830943 / -1.5%
compress time/Euro2016 254777105 / 256024107 / -0.5%
compress time/Food 271353740 / 272604756 / -0.5%
compress time/HashTags 452624325 / 466880078 / -3.1%
compress time/TPC-H l_comment canonical 584255598 / 603361948 / -3.2%
compress time/TPC-H l_comment chunked 586675319 / 601846520 / -2.5%
compress time/taxi 377967795 / 381328915 / -0.9%
compress time/wide table cols=100 chunks=1 rows=1000 7363367 / 7001905 / +5.2%
compress time/wide table cols=100 chunks=50 rows=1000 7324755 / 7013849 / +4.4%
compress time/wide table cols=1000 chunks=1 rows=1000 70572275 / 69858262 / +1.0%
compress time/wide table cols=1000 chunks=50 rows=1000 71482910 / 70626809 / +1.2%
compress time/wide table cols=10000 chunks=1 rows=1000 756366272 / 759990587 / -0.5%
compress time/wide table cols=10000 chunks=50 rows=1000 765089411 / 764929056 / +0.0%
decompress time/Arade 9261240 / 9327282 / -0.7%
decompress time/Bimbo 36426253 / 39453345 / -7.7%
decompress time/CMSprovider 27650862 / 29455312 / -6.1%
decompress time/Euro2016 7081907 / 7419383 / -4.5%
decompress time/Food 2528061 / 2471973 / +2.3%
decompress time/HashTags 46465171 / 48926159 / -5.0%
decompress time/TPC-H l_comment canonical 20580085 / 21764981 / -5.4%
decompress time/TPC-H l_comment chunked 20346057 / 21933796 / -7.2%
decompress time/taxi 5370569 / 5615241 / -4.4%
decompress time/wide table cols=100 chunks=1 rows=1000 1915770 / 1950667 / -1.8%
decompress time/wide table cols=100 chunks=50 rows=1000 1918234 / 1939543 / -1.1%
decompress time/wide table cols=1000 chunks=1 rows=1000 18565657 / 18649089 / -0.4%
decompress time/wide table cols=1000 chunks=50 rows=1000 18389148 / 18928539 / -2.8%
decompress time/wide table cols=10000 chunks=1 rows=1000 217769315 / 216895404 / +0.4%
decompress time/wide table cols=10000 chunks=50 rows=1000 219405017 / 219394390 / +0.0%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142212268 / 142212268 / +0.0%
vortex-file-compressed size/Bimbo 458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420781172 / 420781172 / +0.0%
vortex-file-compressed size/Euro2016 164051500 / 164051500 / +0.0%
vortex-file-compressed size/Food 38949688 / 38949688 / +0.0%
vortex-file-compressed size/HashTags 190348476 / 190348476 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179857112 / 179857112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179857112 / 179857112 / +0.0%
vortex-file-compressed size/taxi 49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.989x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.322547647 / 0.326953022 / -1.3%
vortex:parquet-zstd ratio compress time/Bimbo 0.297170577 / 0.299143873 / -0.7%
vortex:parquet-zstd ratio compress time/CMSprovider 0.377841406 / 0.381853575 / -1.1%
vortex:parquet-zstd ratio compress time/Euro2016 0.236086068 / 0.236507017 / -0.2%
vortex:parquet-zstd ratio compress time/Food 0.366132736 / 0.368217593 / -0.6%
vortex:parquet-zstd ratio compress time/HashTags 0.246543159 / 0.255452573 / -3.5%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.222238312 / 0.229128645 / -3.0%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.223371836 / 0.229047243 / -2.5%
vortex:parquet-zstd ratio compress time/taxi 0.347055145 / 0.348454683 / -0.4%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.85108798 / 1.7480613 / +5.9%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.82989227 / 1.72929663 / +5.8%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.57580632 / 1.55961126 / +1.0%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.57236608 / 1.57273367 / -0.0%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.6421012 / 1.65472401 / -0.8%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.65883371 / 1.66850436 / -0.6%
vortex:parquet-zstd ratio decompress time/Arade 0.0165978213 / 0.0166446159 / -0.3%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0226553709 / 0.0244416284 / -7.3%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0203153827 / 0.0215124428 / -5.6%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0212708732 / 0.0221690373 / -4.1%
vortex:parquet-zstd ratio decompress time/Food 0.014837238 / 0.0144704566 / +2.5%
vortex:parquet-zstd ratio decompress time/HashTags 0.0898783459 / 0.0943266941 / -4.7%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.041278307 / 0.0436533508 / -5.4%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0408570732 / 0.0439804576 / -7.1%
vortex:parquet-zstd ratio decompress time/taxi 0.0246181975 / 0.0257085578 / -4.2%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.93086524 / 0.941851162 / -1.2%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.921913193 / 0.914238375 / +0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.788280993 / 0.788626286 / -0.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.753620342 / 0.807006904 / -6.6%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.887232819 / 0.894326334 / -0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.883709356 / 0.907143211 / -2.6%
vortex:parquet-zstd size/Arade 0.55117983 / 0.55117983 / +0.0%
vortex:parquet-zstd size/Bimbo 1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11646237 / 1.11646237 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33397925 / 1.33397925 / -0.0%
vortex:parquet-zstd size/Food 1.09104296 / 1.09104296 / -0.0%
vortex:parquet-zstd size/HashTags 1.42585702 / 1.42585702 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13576101 / 1.13576101 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13576101 / 1.13576101 / +0.0%
vortex:parquet-zstd size/taxi 0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (1.000x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2251135563 / 2249153849 / +0.1%
parquet_rs-zstd compress time/Bimbo 11821443639 / 11858454841 / -0.3%
parquet_rs-zstd compress time/CMSprovider 6364541079 / 6394678750 / -0.5%
parquet_rs-zstd compress time/Euro2016 1079170436 / 1082522246 / -0.3%
parquet_rs-zstd compress time/Food 741134876 / 740336044 / +0.1%
parquet_rs-zstd compress time/HashTags 1835882715 / 1827658547 / +0.4%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2628959848 / 2633289028 / -0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2626451611 / 2627608668 / -0.0%
parquet_rs-zstd compress time/taxi 1089071291 / 1094342920 / -0.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3977859 / 4005526 / -0.7%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 4002834 / 4055897 / -1.3%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44784866 / 44792099 / -0.0%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 45462002 / 44907037 / +1.2%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 460608806 / 459285405 / +0.3%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 461221283 / 458451938 / +0.6%
parquet_rs-zstd decompress time/Arade 557979257 / 560378326 / -0.4%
parquet_rs-zstd decompress time/Bimbo 1607841833 / 1614186432 / -0.4%
parquet_rs-zstd decompress time/CMSprovider 1361080045 / 1369222095 / -0.6%
parquet_rs-zstd decompress time/Euro2016 332939176 / 334673215 / -0.5%
parquet_rs-zstd decompress time/Food 170386227 / 170828957 / -0.3%
parquet_rs-zstd decompress time/HashTags 516978484 / 518688368 / -0.3%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 498569018 / 498586720 / -0.0%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 497981265 / 498716867 / -0.1%
parquet_rs-zstd decompress time/taxi 218154436 / 218419137 / -0.1%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2058053 / 2071099 / -0.6%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2080710 / 2121485 / -1.9%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23552080 / 23647562 / -0.4%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 24401077 / 23455238 / +4.0%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 245447768 / 242523781 / +1.2%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 248277350 / 241851989 / +2.7%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (1.027x ➖, 0↑ 5↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98160248 / 100432556 / -2.3%
arrow-ipc compress time/Bimbo 617502779 / 631079380 / -2.2%
arrow-ipc compress time/CMSprovider 380185254 / 387457285 / -1.9%
arrow-ipc compress time/Euro2016 38357969 / 38711466 / -0.9%
arrow-ipc compress time/Food 33890201 / 34079234 / -0.6%
arrow-ipc compress time/HashTags 78697257 / 79220838 / -0.7%
arrow-ipc compress time/TPC-H l_comment canonical 518822246 / 520043450 / -0.2%
arrow-ipc compress time/TPC-H l_comment chunked 524921952 / 521933254 / +0.6%
arrow-ipc compress time/taxi 74079493 / 75652920 / -2.1%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 208811 / 207764 / +0.5%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 206650 / 204121 / +1.2%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2245909 / 2263394 / -0.8%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2220386 / 2276571 / -2.5%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25589917 / 25954284 / -1.4%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25693708 / 25769980 / -0.3%
arrow-ipc decompress time/Arade 180673107 / 141177684 / +28.0% 🔴
arrow-ipc decompress time/Bimbo 421600755 / 412561142 / +2.2%
arrow-ipc decompress time/CMSprovider 579385540 / 473007291 / +22.5% 🔴
arrow-ipc decompress time/Euro2016 74642209 / 64195170 / +16.3% 🔴
arrow-ipc decompress time/Food 58133235 / 48814816 / +19.1% 🔴
arrow-ipc decompress time/HashTags 142703988 / 123273223 / +15.8% 🔴
arrow-ipc decompress time/TPC-H l_comment canonical 532474486 / 544157642 / -2.1%
arrow-ipc decompress time/TPC-H l_comment chunked 528671578 / 541410112 / -2.4%
arrow-ipc decompress time/taxi 48536674 / 45395256 / +6.9%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 321897 / 323390 / -0.5%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 317538 / 317255 / +0.1%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3573011 / 3811686 / -6.3%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3611932 / 3525806 / +2.4%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36362061 / 36662367 / -0.8%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 37234390 / 36814165 / +1.1%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+2.5%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): hot 1.016x ➖ · cold 1.027x ➖
Parquet (geomean): hot 1.010x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +1.0% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.027x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16560569 / 16788518 / -1.4% 49494929 / 46141548 / +7.3% 0.33 / 0.36 / -8.0%
tpch_q02/datafusion:vortex-file-compressed 17558474 / 17332089 / +1.3% 39475865 / 36794676 / +7.3% 0.44 / 0.47 / -5.6%
tpch_q03/datafusion:vortex-file-compressed 20556402 / 19706862 / +4.3% 52862835 / 50146688 / +5.4% 0.39 / 0.39 / -1.0%
tpch_q04/datafusion:vortex-file-compressed 10173858 / 10021239 / +1.5% 37014742 / 33044741 / +12.0% 🔴 0.27 / 0.30 / -9.4%
tpch_q05/datafusion:vortex-file-compressed 38865176 / 37275565 / +4.3% 69755862 / 64307388 / +8.5% 0.56 / 0.58 / -3.9%
tpch_q06/datafusion:vortex-file-compressed 6119544 / 6249028 / -2.1% 32699067 / 29576160 / +10.6% 🔴 0.19 / 0.21 / -11.4%
tpch_q07/datafusion:vortex-file-compressed 56458600 / 51963406 / +8.7% 83044845 / 80919103 / +2.6% 0.68 / 0.64 / +5.9%
tpch_q08/datafusion:vortex-file-compressed 52544290 / 52036963 / +1.0% 86365066 / 82964081 / +4.1% 0.61 / 0.63 / -3.0%
tpch_q09/datafusion:vortex-file-compressed 50463577 / 49477665 / +2.0% 79043544 / 75749769 / +4.3% 0.64 / 0.65 / -2.3%
tpch_q10/datafusion:vortex-file-compressed 19205500 / 17086651 / +12.4% 🔴 51482057 / 49988077 / +3.0% 0.37 / 0.34 / +9.1%
tpch_q11/datafusion:vortex-file-compressed 15840686 / 15154458 / +4.5% 37247402 / 34406089 / +8.3% 0.43 / 0.44 / -3.4%
tpch_q12/datafusion:vortex-file-compressed 23500891 / 22959228 / +2.4% 48757226 / 48060253 / +1.5% 0.48 / 0.48 / +0.9%
tpch_q13/datafusion:vortex-file-compressed 20602869 / 20057618 / +2.7% 42299459 / 42487213 / -0.4% 0.49 / 0.47 / +3.2%
tpch_q14/datafusion:vortex-file-compressed 15479012 / 14802747 / +4.6% 42968298 / 40922167 / +5.0% 0.36 / 0.36 / -0.4%
tpch_q15/datafusion:vortex-file-compressed 18678070 / 18482546 / +1.1% 47547535 / 45743679 / +3.9% 0.39 / 0.40 / -2.8%
tpch_q16/datafusion:vortex-file-compressed 18744440 / 18590795 / +0.8% 38508434 / 39796203 / -3.2% 0.49 / 0.47 / +4.2%
tpch_q17/datafusion:vortex-file-compressed 32364249 / 27868960 / +16.1% 🔴 63672516 / 58777993 / +8.3% 0.51 / 0.47 / +7.2%
tpch_q18/datafusion:vortex-file-compressed 37620168 / 36507260 / +3.0% 60156253 / 55390113 / +8.6% 0.63 / 0.66 / -5.1%
tpch_q19/datafusion:vortex-file-compressed 13520571 / 13167299 / +2.7% 39819147 / 38964021 / +2.2% 0.34 / 0.34 / +0.5%
tpch_q20/datafusion:vortex-file-compressed 21520457 / 21159274 / +1.7% 48572859 / 45094039 / +7.7% 0.44 / 0.47 / -5.6%
tpch_q21/datafusion:vortex-file-compressed 35918278 / 39615724 / -9.3% 64441902 / 67081969 / -3.9% 0.56 / 0.59 / -5.6%
tpch_q22/datafusion:vortex-file-compressed 11350270 / 11491114 / -1.2% 32499704 / 32779653 / -0.9% 0.35 / 0.35 / -0.4%
datafusion / vortex-compact / ns (1.029x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16989321 / 18671667 / -9.0% 47820429 / 43936395 / +8.8% 0.36 / 0.42 / -16.4%
tpch_q02/datafusion:vortex-compact 20505148 / 19587515 / +4.7% 40269436 / 36849275 / +9.3% 0.51 / 0.53 / -4.2%
tpch_q03/datafusion:vortex-compact 20926633 / 19975878 / +4.8% 49794175 / 46742936 / +6.5% 0.42 / 0.43 / -1.7%
tpch_q04/datafusion:vortex-compact 11851179 / 10977648 / +8.0% 34987557 / 33505690 / +4.4% 0.34 / 0.33 / +3.4%
tpch_q05/datafusion:vortex-compact 39726505 / 38045363 / +4.4% 68310030 / 65030489 / +5.0% 0.58 / 0.59 / -0.6%
tpch_q06/datafusion:vortex-compact 6779559 / 7051416 / -3.9% 29894035 / 28754172 / +4.0% 0.23 / 0.25 / -7.5%
tpch_q07/datafusion:vortex-compact 56914991 / 52607895 / +8.2% 83289255 / 81063881 / +2.7% 0.68 / 0.65 / +5.3%
tpch_q08/datafusion:vortex-compact 54615928 / 53496111 / +2.1% 82049034 / 82751188 / -0.8% 0.67 / 0.65 / +3.0%
tpch_q09/datafusion:vortex-compact 52565740 / 50531434 / +4.0% 78491255 / 78065768 / +0.5% 0.67 / 0.65 / +3.5%
tpch_q10/datafusion:vortex-compact 21653982 / 19406189 / +11.6% 🔴 51083940 / 50143115 / +1.9% 0.42 / 0.39 / +9.5%
tpch_q11/datafusion:vortex-compact 16864893 / 16127156 / +4.6% 37092238 / 35226403 / +5.3% 0.45 / 0.46 / -0.7%
tpch_q12/datafusion:vortex-compact 24943345 / 24590975 / +1.4% 49914497 / 45998329 / +8.5% 0.50 / 0.53 / -6.5%
tpch_q13/datafusion:vortex-compact 21882154 / 20546535 / +6.5% 42254426 / 40624267 / +4.0% 0.52 / 0.51 / +2.4%
tpch_q14/datafusion:vortex-compact 16503533 / 16123838 / +2.4% 43082844 / 40036346 / +7.6% 0.38 / 0.40 / -4.9%
tpch_q15/datafusion:vortex-compact 19891367 / 19891331 / +0.0% 47669543 / 46485615 / +2.5% 0.42 / 0.43 / -2.5%
tpch_q16/datafusion:vortex-compact 19481824 / 18476537 / +5.4% 39920997 / 38899055 / +2.6% 0.49 / 0.47 / +2.7%
tpch_q17/datafusion:vortex-compact 33901568 / 29253784 / +15.9% 🔴 63122827 / 57378579 / +10.0% 🔴 0.54 / 0.51 / +5.3%
tpch_q18/datafusion:vortex-compact 39483534 / 37842786 / +4.3% 63035826 / 57076933 / +10.4% 🔴 0.63 / 0.66 / -5.5%
tpch_q19/datafusion:vortex-compact 16434939 / 16546184 / -0.7% 43545976 / 41386647 / +5.2% 0.38 / 0.40 / -5.6%
tpch_q20/datafusion:vortex-compact 22594379 / 21820704 / +3.5% 47902317 / 46385900 / +3.3% 0.47 / 0.47 / +0.3%
tpch_q21/datafusion:vortex-compact 37928300 / 41936769 / -9.6% 61262734 / 68261504 / -10.3% 🟢 0.62 / 0.61 / +0.8%
tpch_q22/datafusion:vortex-compact 11702192 / 11829177 / -1.1% 32090198 / 30970931 / +3.6% 0.36 / 0.38 / -4.5%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72313138 / 72294957 / +0.0% 92480558 / 91344595 / +1.2% 0.78 / 0.79 / -1.2%
tpch_q02/datafusion:parquet 57551351 / 57562951 / -0.0% 79039997 / 77254655 / +2.3% 0.73 / 0.75 / -2.3%
tpch_q03/datafusion:parquet 83701402 / 83749488 / -0.1% 111484710 / 110891278 / +0.5% 0.75 / 0.76 / -0.6%
tpch_q04/datafusion:parquet 46627149 / 47129601 / -1.1% 66946845 / 67444594 / -0.7% 0.70 / 0.70 / -0.3%
tpch_q05/datafusion:parquet 99827071 / 99591003 / +0.2% 130220498 / 131072630 / -0.7% 0.77 / 0.76 / +0.9%
tpch_q06/datafusion:parquet 31952036 / 32170800 / -0.7% 53345847 / 54767643 / -2.6% 0.60 / 0.59 / +2.0%
tpch_q07/datafusion:parquet 109185163 / 104639385 / +4.3% 134945858 / 136591105 / -1.2% 0.81 / 0.77 / +5.6%
tpch_q08/datafusion:parquet 113196378 / 112278601 / +0.8% 144106239 / 142283699 / +1.3% 0.79 / 0.79 / -0.5%
tpch_q09/datafusion:parquet 130788294 / 130666220 / +0.1% 162464780 / 163983250 / -0.9% 0.81 / 0.80 / +1.0%
tpch_q10/datafusion:parquet 104251869 / 104422264 / -0.2% 139889466 / 135725795 / +3.1% 0.75 / 0.77 / -3.1%
tpch_q11/datafusion:parquet 41952649 / 42770715 / -1.9% 68062392 / 68346474 / -0.4% 0.62 / 0.63 / -1.5%
tpch_q12/datafusion:parquet 68758851 / 68456665 / +0.4% 94089666 / 96625221 / -2.6% 0.73 / 0.71 / +3.1%
tpch_q13/datafusion:parquet 187593593 / 186656386 / +0.5% 212192099 / 211148969 / +0.5% 0.88 / 0.88 / +0.0%
tpch_q14/datafusion:parquet 48042727 / 47682619 / +0.8% 77281999 / 78917339 / -2.1% 0.62 / 0.60 / +2.9%
tpch_q15/datafusion:parquet 56181075 / 55090099 / +2.0% 77927249 / 80618799 / -3.3% 0.72 / 0.68 / +5.5%
tpch_q16/datafusion:parquet 41446670 / 41352178 / +0.2% 59862632 / 60929774 / -1.8% 0.69 / 0.68 / +2.0%
tpch_q17/datafusion:parquet 129349649 / 128573342 / +0.6% 156670078 / 154536654 / +1.4% 0.83 / 0.83 / -0.8%
tpch_q18/datafusion:parquet 131549314 / 130307422 / +1.0% 153800909 / 153772301 / +0.0% 0.86 / 0.85 / +0.9%
tpch_q19/datafusion:parquet 59350628 / 59169149 / +0.3% 89092785 / 87955333 / +1.3% 0.67 / 0.67 / -1.0%
tpch_q20/datafusion:parquet 67384573 / 68235654 / -1.2% 94490830 / 93365800 / +1.2% 0.71 / 0.73 / -2.4%
tpch_q21/datafusion:parquet 107945609 / 108809108 / -0.8% 131887497 / 132697867 / -0.6% 0.82 / 0.82 / -0.2%
tpch_q22/datafusion:parquet 48016010 / 47847048 / +0.4% 67710530 / 65490981 / +3.4% 0.71 / 0.73 / -2.9%
duckdb / vortex-file-compressed / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10783168 / 10880141 / -0.9% 22015585 / 24551945 / -10.3% 🟢 0.49 / 0.44 / +10.5%
tpch_q02/duckdb:vortex-file-compressed 17441408 / 17348457 / +0.5% 25922055 / 27156316 / -4.5% 0.67 / 0.64 / +5.3%
tpch_q03/duckdb:vortex-file-compressed 18713502 / 17767408 / +5.3% 35723691 / 32262068 / +10.7% 🔴 0.52 / 0.55 / -4.9%
tpch_q04/duckdb:vortex-file-compressed 17939983 / 17329979 / +3.5% 32278464 / 32111353 / +0.5% 0.56 / 0.54 / +3.0%
tpch_q05/duckdb:vortex-file-compressed 22619301 / 22524529 / +0.4% 39528602 / 39396888 / +0.3% 0.57 / 0.57 / +0.1%
tpch_q06/duckdb:vortex-file-compressed 5487548 / 5110165 / +7.4% 14613318 / 15989880 / -8.6% 0.38 / 0.32 / +17.5%
tpch_q07/duckdb:vortex-file-compressed 20369901 / 20310825 / +0.3% 40466987 / 41673407 / -2.9% 0.50 / 0.49 / +3.3%
tpch_q08/duckdb:vortex-file-compressed 24328178 / 23336642 / +4.2% 39903709 / 39022125 / +2.3% 0.61 / 0.60 / +1.9%
tpch_q09/duckdb:vortex-file-compressed 30635347 / 29205759 / +4.9% 46736128 / 49743592 / -6.0% 0.66 / 0.59 / +11.6%
tpch_q10/duckdb:vortex-file-compressed 28711745 / 27696033 / +3.7% 46803319 / 44618790 / +4.9% 0.61 / 0.62 / -1.2%
tpch_q11/duckdb:vortex-file-compressed 8727619 / 8778205 / -0.6% 14670698 / 14630139 / +0.3% 0.59 / 0.60 / -0.9%
tpch_q12/duckdb:vortex-file-compressed 16990942 / 15964949 / +6.4% 34733528 / 33452867 / +3.8% 0.49 / 0.48 / +2.5%
tpch_q13/duckdb:vortex-file-compressed 21918832 / 21495764 / +2.0% 41249945 / 38408999 / +7.4% 0.53 / 0.56 / -5.1%
tpch_q14/duckdb:vortex-file-compressed 13271972 / 13897748 / -4.5% 26102275 / 26431546 / -1.2% 0.51 / 0.53 / -3.3%
tpch_q15/duckdb:vortex-file-compressed 9586005 / 10140266 / -5.5% 19448828 / 17939058 / +8.4% 0.49 / 0.57 / -12.8%
tpch_q16/duckdb:vortex-file-compressed 18624389 / 18084827 / +3.0% 23192683 / 24054560 / -3.6% 0.80 / 0.75 / +6.8%
tpch_q17/duckdb:vortex-file-compressed 14847469 / 15007971 / -1.1% 33150626 / 31687049 / +4.6% 0.45 / 0.47 / -5.4%
tpch_q18/duckdb:vortex-file-compressed 25283273 / 24985564 / +1.2% 37464992 / 35160089 / +6.6% 0.67 / 0.71 / -5.0%
tpch_q19/duckdb:vortex-file-compressed 24229120 / 24093492 / +0.6% 39927192 / 35993828 / +10.9% 🔴 0.61 / 0.67 / -9.3%
tpch_q20/duckdb:vortex-file-compressed 17648879 / 16765172 / +5.3% 39510167 / 32716154 / +20.8% 🔴 0.45 / 0.51 / -12.8%
tpch_q21/duckdb:vortex-file-compressed 66333194 / 66532192 / -0.3% 82858950 / 84044657 / -1.4% 0.80 / 0.79 / +1.1%
tpch_q22/duckdb:vortex-file-compressed 14663962 / 14560139 / +0.7% 20715493 / 21293130 / -2.7% 0.71 / 0.68 / +3.5%
duckdb / vortex-compact / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 13206875 / 14867381 / -11.2% 🟢 25644259 / 24268900 / +5.7% 0.52 / 0.61 / -15.9%
tpch_q02/duckdb:vortex-compact 19946386 / 19821660 / +0.6% 29915659 / 26738818 / +11.9% 🔴 0.67 / 0.74 / -10.1%
tpch_q03/duckdb:vortex-compact 19105454 / 19477963 / -1.9% 34046238 / 33661339 / +1.1% 0.56 / 0.58 / -3.0%
tpch_q04/duckdb:vortex-compact 18576314 / 18283816 / +1.6% 31258406 / 29846015 / +4.7% 0.59 / 0.61 / -3.0%
tpch_q05/duckdb:vortex-compact 22433867 / 22437816 / -0.0% 36218176 / 36077374 / +0.4% 0.62 / 0.62 / -0.4%
tpch_q06/duckdb:vortex-compact 6031368 / 6194278 / -2.6% 17128128 / 18452254 / -7.2% 0.35 / 0.34 / +4.9%
tpch_q07/duckdb:vortex-compact 21308527 / 21898589 / -2.7% 39857030 / 37326959 / +6.8% 0.53 / 0.59 / -8.9%
tpch_q08/duckdb:vortex-compact 25802670 / 26212190 / -1.6% 43820094 / 40983566 / +6.9% 0.59 / 0.64 / -7.9%
tpch_q09/duckdb:vortex-compact 30860594 / 30182492 / +2.2% 49786456 / 52318240 / -4.8% 0.62 / 0.58 / +7.4%
tpch_q10/duckdb:vortex-compact 30566862 / 29988695 / +1.9% 45001609 / 47152448 / -4.6% 0.68 / 0.64 / +6.8%
tpch_q11/duckdb:vortex-compact 9890268 / 10071813 / -1.8% 17295037 / 17075826 / +1.3% 0.57 / 0.59 / -3.0%
tpch_q12/duckdb:vortex-compact 17876225 / 18176052 / -1.6% 27678892 / 32176262 / -14.0% 🟢 0.65 / 0.56 / +14.3%
tpch_q13/duckdb:vortex-compact 21797286 / 22025124 / -1.0% 37735453 / 39033962 / -3.3% 0.58 / 0.56 / +2.4%
tpch_q14/duckdb:vortex-compact 14507221 / 14224985 / +2.0% 24541118 / 28093405 / -12.6% 🟢 0.59 / 0.51 / +16.7%
tpch_q15/duckdb:vortex-compact 10418783 / 10140330 / +2.7% 22533895 / 22090281 / +2.0% 0.46 / 0.46 / +0.7%
tpch_q16/duckdb:vortex-compact 19523659 / 19723092 / -1.0% 23288112 / 24203481 / -3.8% 0.84 / 0.81 / +2.9%
tpch_q17/duckdb:vortex-compact 16182576 / 15566897 / +4.0% 30495805 / 32345096 / -5.7% 0.53 / 0.48 / +10.3%
tpch_q18/duckdb:vortex-compact 26792227 / 26349962 / +1.7% 37598285 / 34601847 / +8.7% 0.71 / 0.76 / -6.4%
tpch_q19/duckdb:vortex-compact 23789257 / 23829407 / -0.2% 35748822 / 33204931 / +7.7% 0.67 / 0.72 / -7.3%
tpch_q20/duckdb:vortex-compact 18899066 / 19523968 / -3.2% 35403926 / 35923554 / -1.4% 0.53 / 0.54 / -1.8%
tpch_q21/duckdb:vortex-compact 71345432 / 70448594 / +1.3% 88876378 / 88220358 / +0.7% 0.80 / 0.80 / +0.5%
tpch_q22/duckdb:vortex-compact 13031379 / 13116292 / -0.6% 24763361 / 21116325 / +17.3% 🔴 0.53 / 0.62 / -15.3%
duckdb / parquet / ns (1.017x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 63623987 / 63014014 / +1.0% 70234167 / 69133835 / +1.6% 0.91 / 0.91 / -0.6%
tpch_q02/duckdb:parquet 38325814 / 37417572 / +2.4% 49112618 / 47956195 / +2.4% 0.78 / 0.78 / +0.0%
tpch_q03/duckdb:parquet 68141614 / 67695177 / +0.7% 79589872 / 79069830 / +0.7% 0.86 / 0.86 / +0.0%
tpch_q04/duckdb:parquet 49463360 / 46553291 / +6.3% 59786035 / 55709191 / +7.3% 0.83 / 0.84 / -1.0%
tpch_q05/duckdb:parquet 66507913 / 65791511 / +1.1% 78438601 / 76164451 / +3.0% 0.85 / 0.86 / -1.8%
tpch_q06/duckdb:parquet 22146866 / 22067246 / +0.4% 28552801 / 28027693 / +1.9% 0.78 / 0.79 / -1.5%
tpch_q07/duckdb:parquet 65768318 / 65117598 / +1.0% 76222762 / 76234790 / -0.0% 0.86 / 0.85 / +1.0%
tpch_q08/duckdb:parquet 80502887 / 79863513 / +0.8% 94380425 / 92450856 / +2.1% 0.85 / 0.86 / -1.3%
tpch_q09/duckdb:parquet 120432064 / 119440069 / +0.8% 133734755 / 131714449 / +1.5% 0.90 / 0.91 / -0.7%
tpch_q10/duckdb:parquet 119741628 / 119118028 / +0.5% 131868979 / 131734543 / +0.1% 0.91 / 0.90 / +0.4%
tpch_q11/duckdb:parquet 21626912 / 21484263 / +0.7% 25265754 / 24817997 / +1.8% 0.86 / 0.87 / -1.1%
tpch_q12/duckdb:parquet 44997980 / 44309967 / +1.6% 52472498 / 51330631 / +2.2% 0.86 / 0.86 / -0.7%
tpch_q13/duckdb:parquet 245524688 / 242577575 / +1.2% 254738521 / 251190329 / +1.4% 0.96 / 0.97 / -0.2%
tpch_q14/duckdb:parquet 47696778 / 47297463 / +0.8% 57255938 / 56817060 / +0.8% 0.83 / 0.83 / +0.1%
tpch_q15/duckdb:parquet 30066421 / 26530064 / +13.3% 🔴 34276869 / 36731767 / -6.7% 0.88 / 0.72 / +21.4%
tpch_q16/duckdb:parquet 51863329 / 51771852 / +0.2% 58724787 / 61220417 / -4.1% 0.88 / 0.85 / +4.4%
tpch_q17/duckdb:parquet 49425396 / 48997031 / +0.9% 60127237 / 59367351 / +1.3% 0.82 / 0.83 / -0.4%
tpch_q18/duckdb:parquet 98703916 / 96779396 / +2.0% 105513977 / 106601282 / -1.0% 0.94 / 0.91 / +3.0%
tpch_q19/duckdb:parquet 65529785 / 65065347 / +0.7% 75565192 / 75090313 / +0.6% 0.87 / 0.87 / +0.1%
tpch_q20/duckdb:parquet 62272844 / 61449380 / +1.3% 74436350 / 74106438 / +0.4% 0.84 / 0.83 / +0.9%
tpch_q21/duckdb:parquet 143254421 / 143613712 / -0.3% 154210197 / 154160140 / +0.0% 0.93 / 0.93 / -0.3%
tpch_q22/duckdb:parquet 51696691 / 51649027 / +0.1% 59207350 / 59450789 / -0.4% 0.87 / 0.87 / +0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-6.2%, low confidence) · DuckDB No clear signal (+5.3%, low confidence)
Vortex (geomean): hot 0.975x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.981x ➖ · cold 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish -1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.954x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 178680250 / 186581582 / -4.2% 551203245 / 719061723 / -23.3% 🟢 0.32 / 0.26 / +24.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed 8838969 / 10829444 / -18.4% 🟢 47387975 / 57801591 / -18.0% 🟢 0.19 / 0.19 / -0.4%
clickbench-sorted_q26/datafusion:vortex-file-compressed 9947220 / 11022070 / -9.8% 46411517 / 51473616 / -9.8% 0.21 / 0.21 / +0.1%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23693624 / 23382451 / +1.3% 66948173 / 70023558 / -4.4% 0.35 / 0.33 / +6.0%
clickbench-sorted_q37/datafusion:vortex-file-compressed 17515485 / 18922746 / -7.4% 60142456 / 62193886 / -3.3% 0.29 / 0.30 / -4.3%
clickbench-sorted_q38/datafusion:vortex-file-compressed 16974132 / 17884995 / -5.1% 61896385 / 63221104 / -2.1% 0.27 / 0.28 / -3.1%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40521476 / 40725096 / -0.5% 90815888 / 94836690 / -4.2% 0.45 / 0.43 / +3.9%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11944182 / 12442623 / -4.0% 45616932 / 46932287 / -2.8% 0.26 / 0.27 / -1.2%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12544228 / 12088256 / +3.8% 46037038 / 44641315 / +3.1% 0.27 / 0.27 / +0.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9737326 / 9736336 / +0.0% 36792263 / 37036223 / -0.7% 0.26 / 0.26 / +0.7%
datafusion / vortex-compact / ns (0.913x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 213140100 / 195071169 / +9.3% 302476111 / 459897976 / -34.2% 🟢 0.70 / 0.42 / +66.1%
clickbench-sorted_q24/datafusion:vortex-compact 12983250 / 22427649 / -42.1% 🟢 46639182 / 51014457 / -8.6% 0.28 / 0.44 / -36.7%
clickbench-sorted_q26/datafusion:vortex-compact 14616276 / 21712550 / -32.7% 🟢 47452940 / 54204836 / -12.5% 🟢 0.31 / 0.40 / -23.1%
clickbench-sorted_q36/datafusion:vortex-compact 26223182 / 25747959 / +1.8% 69012982 / 72169078 / -4.4% 0.38 / 0.36 / +6.5%
clickbench-sorted_q37/datafusion:vortex-compact 21463249 / 21865167 / -1.8% 69129875 / 69396609 / -0.4% 0.31 / 0.32 / -1.5%
clickbench-sorted_q38/datafusion:vortex-compact 20492992 / 21502647 / -4.7% 66688170 / 65768615 / +1.4% 0.31 / 0.33 / -6.0%
clickbench-sorted_q39/datafusion:vortex-compact 44800618 / 44910272 / -0.2% 82107700 / 90623446 / -9.4% 0.55 / 0.50 / +10.1%
clickbench-sorted_q40/datafusion:vortex-compact 14024152 / 15364607 / -8.7% 45325440 / 45016848 / +0.7% 0.31 / 0.34 / -9.3%
clickbench-sorted_q41/datafusion:vortex-compact 14594162 / 13842999 / +5.4% 47616698 / 47680869 / -0.1% 0.31 / 0.29 / +5.6%
clickbench-sorted_q42/datafusion:vortex-compact 11168608 / 10798544 / +3.4% 36162829 / 38287147 / -5.5% 0.31 / 0.28 / +9.5%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 764415100 / 762031361 / +0.3% 959046081 / 966925215 / -0.8% 0.80 / 0.79 / +1.1%
clickbench-sorted_q24/datafusion:parquet 8712204 / 9123430 / -4.5% 73969736 / 70823929 / +4.4% 0.12 / 0.13 / -8.6%
clickbench-sorted_q26/datafusion:parquet 9194685 / 9673927 / -5.0% 73134237 / 71825358 / +1.8% 0.13 / 0.13 / -6.7%
clickbench-sorted_q36/datafusion:parquet 94077550 / 94296664 / -0.2% 170737889 / 173618214 / -1.7% 0.55 / 0.54 / +1.5%
clickbench-sorted_q37/datafusion:parquet 64891470 / 64307056 / +0.9% 131828696 / 132952090 / -0.8% 0.49 / 0.48 / +1.8%
clickbench-sorted_q38/datafusion:parquet 88196624 / 87927298 / +0.3% 162084514 / 164725955 / -1.6% 0.54 / 0.53 / +1.9%
clickbench-sorted_q39/datafusion:parquet 160516971 / 160025709 / +0.3% 235715582 / 239598245 / -1.6% 0.68 / 0.67 / +2.0%
clickbench-sorted_q40/datafusion:parquet 44664982 / 44481176 / +0.4% 114134095 / 116808686 / -2.3% 0.39 / 0.38 / +2.8%
clickbench-sorted_q41/datafusion:parquet 42818324 / 41876838 / +2.2% 112813314 / 112564542 / +0.2% 0.38 / 0.37 / +2.0%
clickbench-sorted_q42/datafusion:parquet 26258451 / 26150988 / +0.4% 87043907 / 88107372 / -1.2% 0.30 / 0.30 / +1.6%
duckdb / vortex-file-compressed / ns (1.020x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 59177930 / 56192323 / +5.3% 81421495 / 78529078 / +3.7% 0.73 / 0.72 / +1.6%
clickbench-sorted_q24/duckdb:vortex-file-compressed 24311762 / 22585704 / +7.6% 33788761 / 32788971 / +3.0% 0.72 / 0.69 / +4.5%
clickbench-sorted_q26/duckdb:vortex-file-compressed 17769448 / 13391836 / +32.7% 🔴 28903667 / 31512713 / -8.3% 0.61 / 0.42 / +44.7%
clickbench-sorted_q36/duckdb:vortex-file-compressed 31274871 / 28154796 / +11.1% 🔴 66135801 / 62745648 / +5.4% 0.47 / 0.45 / +5.4%
clickbench-sorted_q37/duckdb:vortex-file-compressed 24269376 / 28583309 / -15.1% 🟢 53919256 / 55904288 / -3.6% 0.45 / 0.51 / -12.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26408990 / 25638046 / +3.0% 62136817 / 60342513 / +3.0% 0.43 / 0.42 / +0.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed 49465754 / 48456596 / +2.1% 100854518 / 96849237 / +4.1% 0.49 / 0.50 / -2.0%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15073395 / 16731334 / -9.9% 38389393 / 39527065 / -2.9% 0.39 / 0.42 / -7.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15237758 / 15733107 / -3.1% 39216917 / 45119755 / -13.1% 🟢 0.39 / 0.35 / +11.4%
clickbench-sorted_q42/duckdb:vortex-file-compressed 13081634 / 13911741 / -6.0% 30682844 / 30235886 / +1.5% 0.43 / 0.46 / -7.3%
duckdb / vortex-compact / ns (1.017x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 62734166 / 65942649 / -4.9% 84891947 / 97260942 / -12.7% 🟢 0.74 / 0.68 / +9.0%
clickbench-sorted_q24/duckdb:vortex-compact 24444673 / 21486979 / +13.8% 🔴 36857344 / 32330132 / +14.0% 🔴 0.66 / 0.66 / -0.2%
clickbench-sorted_q26/duckdb:vortex-compact 19288028 / 15763009 / +22.4% 🔴 34468873 / 33190362 / +3.9% 0.56 / 0.47 / +17.8%
clickbench-sorted_q36/duckdb:vortex-compact 33232259 / 34201000 / -2.8% 68975877 / 69024740 / -0.1% 0.48 / 0.50 / -2.8%
clickbench-sorted_q37/duckdb:vortex-compact 29305876 / 30770187 / -4.8% 63426027 / 63163399 / +0.4% 0.46 / 0.49 / -5.2%
clickbench-sorted_q38/duckdb:vortex-compact 30258617 / 29746980 / +1.7% 66819308 / 64128880 / +4.2% 0.45 / 0.46 / -2.4%
clickbench-sorted_q39/duckdb:vortex-compact 58118240 / 59680284 / -2.6% 100487498 / 104799563 / -4.1% 0.58 / 0.57 / +1.6%
clickbench-sorted_q40/duckdb:vortex-compact 17296172 / 18733274 / -7.7% 40956032 / 40835555 / +0.3% 0.42 / 0.46 / -7.9%
clickbench-sorted_q41/duckdb:vortex-compact 17082677 / 17320714 / -1.4% 41426129 / 41647997 / -0.5% 0.41 / 0.42 / -0.8%
clickbench-sorted_q42/duckdb:vortex-compact 14898904 / 13973368 / +6.6% 31450165 / 33390842 / -5.8% 0.47 / 0.42 / +13.2%
duckdb / parquet / ns (0.967x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 126152358 / 127235182 / -0.9% 141974643 / 152413782 / -6.8% 0.89 / 0.83 / +6.4%
clickbench-sorted_q24/duckdb:parquet 17342050 / 19287840 / -10.1% 🟢 28534058 / 32798154 / -13.0% 🟢 0.61 / 0.59 / +3.3%
clickbench-sorted_q26/duckdb:parquet 13013280 / 13212778 / -1.5% 25270709 / 24707616 / +2.3% 0.51 / 0.53 / -3.7%
clickbench-sorted_q36/duckdb:parquet 44384094 / 48580037 / -8.6% 63073758 / 68461014 / -7.9% 0.70 / 0.71 / -0.8%
clickbench-sorted_q37/duckdb:parquet 31345937 / 31778490 / -1.4% 51261444 / 50047421 / +2.4% 0.61 / 0.63 / -3.7%
clickbench-sorted_q38/duckdb:parquet 42266110 / 40642859 / +4.0% 61954811 / 62405639 / -0.7% 0.68 / 0.65 / +4.8%
clickbench-sorted_q39/duckdb:parquet 71509416 / 74312548 / -3.8% 84680658 / 96357211 / -12.1% 🟢 0.84 / 0.77 / +9.5%
clickbench-sorted_q40/duckdb:parquet 17614570 / 17879977 / -1.5% 45582749 / 44019813 / +3.6% 0.39 / 0.41 / -4.9%
clickbench-sorted_q41/duckdb:parquet 16833948 / 17579298 / -4.2% 45126013 / 47908154 / -5.8% 0.37 / 0.37 / +1.7%
clickbench-sorted_q42/duckdb:parquet 11138234 / 11626396 / -4.2% 25319962 / 23717471 / +6.8% 0.44 / 0.49 / -10.3%

File Size Changes (200 files changed, +0.0% overall, 96↑ 104↓)
File Scale Format Base HEAD Change %
hits_004.vortex 1.0 vortex-compact 97.31 MB 98.90 MB +1.59 MB +1.6%
hits_034.vortex 1.0 vortex-file-compressed 181.84 MB 184.70 MB +2.85 MB +1.6%
hits_001.vortex 1.0 vortex-file-compressed 188.85 MB 191.09 MB +2.23 MB +1.2%
hits_027.vortex 1.0 vortex-file-compressed 189.53 MB 191.77 MB +2.24 MB +1.2%
hits_087.vortex 1.0 vortex-file-compressed 159.83 MB 161.67 MB +1.84 MB +1.2%
hits_078.vortex 1.0 vortex-compact 97.20 MB 98.31 MB +1.11 MB +1.1%
hits_015.vortex 1.0 vortex-compact 97.34 MB 98.42 MB +1.07 MB +1.1%
hits_061.vortex 1.0 vortex-compact 123.42 MB 124.73 MB +1.31 MB +1.1%
hits_087.vortex 1.0 vortex-compact 123.89 MB 125.20 MB +1.31 MB +1.1%
hits_056.vortex 1.0 vortex-file-compressed 135.01 MB 136.37 MB +1.36 MB +1.0%
hits_027.vortex 1.0 vortex-compact 138.05 MB 139.07 MB +1.01 MB +0.7%
hits_012.vortex 1.0 vortex-file-compressed 190.43 MB 191.81 MB +1.38 MB +0.7%
hits_063.vortex 1.0 vortex-compact 98.46 MB 99.12 MB +676.73 KB +0.7%
hits_097.vortex 1.0 vortex-compact 140.13 MB 141.06 MB +953.44 KB +0.7%
hits_060.vortex 1.0 vortex-file-compressed 192.83 MB 194.07 MB +1.24 MB +0.6%
hits_066.vortex 1.0 vortex-compact 116.73 MB 117.46 MB +752.33 KB +0.6%
hits_060.vortex 1.0 vortex-compact 140.04 MB 140.91 MB +886.13 KB +0.6%
hits_014.vortex 1.0 vortex-file-compressed 172.75 MB 173.73 MB +1004.12 KB +0.6%
hits_034.vortex 1.0 vortex-compact 132.44 MB 133.15 MB +730.86 KB +0.5%
hits_026.vortex 1.0 vortex-compact 98.64 MB 99.16 MB +541.59 KB +0.5%
hits_099.vortex 1.0 vortex-file-compressed 171.86 MB 172.69 MB +850.57 KB +0.5%
hits_077.vortex 1.0 vortex-compact 133.98 MB 134.60 MB +639.97 KB +0.5%
hits_070.vortex 1.0 vortex-file-compressed 199.98 MB 200.87 MB +911.76 KB +0.4%
hits_086.vortex 1.0 vortex-compact 139.88 MB 140.49 MB +622.25 KB +0.4%
hits_057.vortex 1.0 vortex-compact 111.35 MB 111.76 MB +419.12 KB +0.4%
hits_054.vortex 1.0 vortex-file-compressed 147.36 MB 147.88 MB +535.12 KB +0.4%
hits_018.vortex 1.0 vortex-file-compressed 200.10 MB 200.79 MB +712.73 KB +0.3%
hits_057.vortex 1.0 vortex-file-compressed 159.76 MB 160.28 MB +534.40 KB +0.3%
hits_014.vortex 1.0 vortex-compact 133.85 MB 134.24 MB +398.24 KB +0.3%
hits_040.vortex 1.0 vortex-file-compressed 144.00 MB 144.41 MB +419.41 KB +0.3%
hits_068.vortex 1.0 vortex-compact 111.91 MB 112.20 MB +299.44 KB +0.3%
hits_010.vortex 1.0 vortex-compact 123.09 MB 123.41 MB +324.82 KB +0.3%
hits_062.vortex 1.0 vortex-file-compressed 171.24 MB 171.61 MB +383.81 KB +0.2%
hits_026.vortex 1.0 vortex-file-compressed 130.38 MB 130.66 MB +280.59 KB +0.2%
hits_007.vortex 1.0 vortex-compact 153.41 MB 153.69 MB +281.14 KB +0.2%
hits_019.vortex 1.0 vortex-file-compressed 140.02 MB 140.27 MB +255.57 KB +0.2%
hits_066.vortex 1.0 vortex-file-compressed 162.93 MB 163.18 MB +257.36 KB +0.2%
hits_022.vortex 1.0 vortex-compact 153.01 MB 153.24 MB +232.04 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 200.96 MB 201.25 MB +304.24 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 201.11 MB 201.40 MB +299.93 KB +0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.61 MB 172.85 MB +249.87 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.85 MB 143.05 MB +204.90 KB +0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.66 MB 161.86 MB +208.66 KB +0.1%
hits_081.vortex 1.0 vortex-compact 153.57 MB 153.76 MB +188.39 KB +0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.50 MB 161.69 MB +193.32 KB +0.1%
hits_028.vortex 1.0 vortex-compact 115.17 MB 115.29 MB +127.21 KB +0.1%
hits_074.vortex 1.0 vortex-compact 152.94 MB 153.10 MB +168.23 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.03 MB 202.24 MB +219.25 KB +0.1%
hits_029.vortex 1.0 vortex-compact 153.42 MB 153.58 MB +162.19 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.82 MB 101.92 MB +101.47 KB +0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.50 MB 136.62 MB +130.96 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.86 MB 169.02 MB +160.55 KB +0.1%
hits_012.vortex 1.0 vortex-compact 138.70 MB 138.83 MB +127.12 KB +0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.77 MB 153.91 MB +138.66 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.15 MB 200.32 MB +177.06 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 200.16 MB 200.33 MB +169.09 KB +0.1%
hits_033.vortex 1.0 vortex-compact 152.73 MB 152.85 MB +125.77 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.77 MB 191.92 MB +151.62 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.34 MB 130.44 MB +103.02 KB +0.1%
hits_059.vortex 1.0 vortex-compact 152.73 MB 152.85 MB +119.38 KB +0.1%
hits_056.vortex 1.0 vortex-compact 100.71 MB 100.78 MB +71.47 KB +0.1%
hits_023.vortex 1.0 vortex-compact 142.38 MB 142.48 MB +95.75 KB +0.1%
hits_080.vortex 1.0 vortex-compact 96.00 MB 96.06 MB +60.40 KB +0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.62 MB 137.70 MB +83.83 KB +0.1%
hits_085.vortex 1.0 vortex-compact 153.26 MB 153.35 MB +92.02 KB +0.1%
hits_020.vortex 1.0 vortex-compact 111.66 MB 111.72 MB +66.63 KB +0.1%
hits_050.vortex 1.0 vortex-compact 124.97 MB 125.04 MB +73.45 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.44 MB 190.54 MB +108.62 KB +0.1%
hits_045.vortex 1.0 vortex-compact 105.59 MB 105.64 MB +52.59 KB +0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.84 MB 172.92 MB +85.02 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.87 MB 130.93 MB +60.69 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.85 MB 130.90 MB +48.73 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.10 MB 101.13 MB +31.45 KB +0.0%
hits_054.vortex 1.0 vortex-compact 111.73 MB 111.76 MB +31.73 KB +0.0%
hits_008.vortex 1.0 vortex-compact 105.65 MB 105.68 MB +28.75 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.66 MB 110.69 MB +28.74 KB +0.0%
hits_048.vortex 1.0 vortex-compact 153.37 MB 153.41 MB +39.61 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.61 MB 110.63 MB +24.75 KB +0.0%
hits_040.vortex 1.0 vortex-compact 109.94 MB 109.97 MB +23.82 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.16 MB 134.18 MB +24.51 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.06 MB 111.08 MB +19.95 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.59 MB 126.62 MB +22.45 KB +0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.29 MB 139.31 MB +22.40 KB +0.0%
hits_094.vortex 1.0 vortex-compact 110.77 MB 110.79 MB +16.61 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.49 MB 189.52 MB +25.17 KB +0.0%
hits_053.vortex 1.0 vortex-compact 137.44 MB 137.46 MB +18.06 KB +0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.69 MB 180.71 MB +20.62 KB +0.0%
hits_092.vortex 1.0 vortex-compact 153.37 MB 153.39 MB +17.07 KB +0.0%
hits_049.vortex 1.0 vortex-compact 139.28 MB 139.30 MB +15.40 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.32 MB 172.34 MB +18.61 KB +0.0%
hits_019.vortex 1.0 vortex-compact 106.10 MB 106.11 MB +9.84 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.76 MB 161.77 MB +13.55 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.12 MB 178.13 MB +14.18 KB +0.0%
hits_000.vortex 1.0 vortex-compact 97.69 MB 97.69 MB +1.87 KB +0.0%
hits_075.vortex 1.0 vortex-compact 137.83 MB 137.83 MB +1.78 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.65 MB 105.65 MB +608 B +0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.16 MB 191.15 MB 1.10 KB -0.0%
hits_096.vortex 1.0 vortex-compact 153.26 MB 153.26 MB 1.91 KB -0.0%
hits_047.vortex 1.0 vortex-compact 110.48 MB 110.48 MB 1.41 KB -0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.45 MB 154.45 MB 4.70 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.21 MB 2.71 KB -0.0%
hits_095.vortex 1.0 vortex-compact 110.61 MB 110.60 MB 4.38 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.24 MB 102.23 MB 4.51 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.65 MB 192.64 MB 11.94 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.25 MB 156.23 MB 12.10 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.95 MB 75.94 MB 7.06 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.11 MB 131.09 MB 13.02 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.77 MB 179.75 MB 18.12 KB -0.0%
hits_005.vortex 1.0 vortex-compact 115.84 MB 115.83 MB 12.74 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.88 MB 194.86 MB 21.46 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.22 MB 136.21 MB 16.03 KB -0.0%
hits_072.vortex 1.0 vortex-compact 75.60 MB 75.59 MB 8.90 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.59 MB 110.58 MB 15.46 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.64 MB 130.62 MB 21.42 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.35 MB 159.32 MB 29.90 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.90 MB 161.87 MB 30.45 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 200.17 MB 200.14 MB 39.60 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.95 MB 171.91 MB 39.80 KB -0.0%
hits_001.vortex 1.0 vortex-compact 137.66 MB 137.63 MB 31.91 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.37 MB 130.34 MB 31.41 KB -0.0%
hits_017.vortex 1.0 vortex-compact 111.70 MB 111.67 MB 28.39 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.12 MB 130.09 MB 34.00 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 200.72 MB 200.66 MB 57.89 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.78 MB 126.75 MB 36.58 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.28 MB 147.23 MB 48.65 KB -0.0%
hits_064.vortex 1.0 vortex-compact 138.89 MB 138.85 MB 46.59 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.74 MB 200.67 MB 69.91 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.42 MB 130.38 MB 46.44 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.63 MB 161.57 MB 64.72 KB -0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.16 MB 201.07 MB 85.06 KB -0.0%
hits_079.vortex 1.0 vortex-compact 127.93 MB 127.88 MB 55.35 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.81 MB 153.74 MB 68.81 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.36 MB 147.30 MB 69.62 KB -0.0%
hits_011.vortex 1.0 vortex-compact 152.81 MB 152.74 MB 74.62 KB -0.0%
hits_062.vortex 1.0 vortex-compact 132.58 MB 132.52 MB 65.20 KB -0.0%
hits_083.vortex 1.0 vortex-compact 110.04 MB 109.99 MB 55.64 KB -0.0%
hits_046.vortex 1.0 vortex-compact 74.94 MB 74.91 MB 38.30 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.99 MB 161.91 MB 85.52 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 161.42 MB 161.34 MB 88.51 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.18 MB 161.09 MB 88.62 KB -0.1%
hits_070.vortex 1.0 vortex-compact 153.74 MB 153.64 MB 104.55 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.33 MB 127.24 MB 91.75 KB -0.1%
hits_022.vortex 1.0 vortex-file-compressed 200.33 MB 200.19 MB 145.31 KB -0.1%
hits_069.vortex 1.0 vortex-compact 99.70 MB 99.63 MB 74.49 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 200.70 MB 200.55 MB 150.66 KB -0.1%
hits_071.vortex 1.0 vortex-compact 105.61 MB 105.53 MB 80.85 KB -0.1%
hits_090.vortex 1.0 vortex-compact 140.12 MB 140.00 MB 114.11 KB -0.1%
hits_038.vortex 1.0 vortex-compact 138.24 MB 138.13 MB 114.50 KB -0.1%
hits_088.vortex 1.0 vortex-compact 134.22 MB 134.11 MB 116.31 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.76 MB 130.64 MB 121.29 KB -0.1%
hits_080.vortex 1.0 vortex-file-compressed 127.11 MB 126.99 MB 118.82 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.76 MB 153.60 MB 154.30 KB -0.1%
hits_065.vortex 1.0 vortex-compact 125.60 MB 125.48 MB 128.58 KB -0.1%
hits_044.vortex 1.0 vortex-compact 153.62 MB 153.46 MB 160.89 KB -0.1%
hits_051.vortex 1.0 vortex-compact 133.98 MB 133.84 MB 141.38 KB -0.1%
hits_085.vortex 1.0 vortex-file-compressed 200.94 MB 200.72 MB 223.28 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.72 MB 130.57 MB 151.51 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.64 MB 104.51 MB 124.41 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 173.34 MB 173.13 MB 209.67 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.07 MB 159.87 MB 202.03 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.84 MB 130.68 MB 165.52 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.51 MB 160.31 MB 206.43 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.32 MB 167.10 MB 220.43 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 173.18 MB 172.96 MB 229.51 KB -0.1%
hits_055.vortex 1.0 vortex-compact 153.54 MB 153.33 MB 215.06 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.40 MB 189.13 MB 276.16 KB -0.1%
hits_076.vortex 1.0 vortex-compact 125.09 MB 124.89 MB 205.89 KB -0.2%
hits_030.vortex 1.0 vortex-compact 98.75 MB 98.57 MB 181.79 KB -0.2%
hits_046.vortex 1.0 vortex-file-compressed 100.76 MB 100.58 MB 185.55 KB -0.2%
hits_043.vortex 1.0 vortex-compact 94.25 MB 94.08 MB 175.78 KB -0.2%
hits_032.vortex 1.0 vortex-file-compressed 154.34 MB 154.03 MB 316.41 KB -0.2%
hits_098.vortex 1.0 vortex-compact 103.88 MB 103.61 MB 268.41 KB -0.3%
hits_025.vortex 1.0 vortex-compact 133.70 MB 133.36 MB 348.60 KB -0.3%
hits_099.vortex 1.0 vortex-compact 133.40 MB 133.04 MB 364.59 KB -0.3%
hits_028.vortex 1.0 vortex-file-compressed 152.80 MB 152.37 MB 447.15 KB -0.3%
hits_031.vortex 1.0 vortex-compact 111.47 MB 111.13 MB 347.29 KB -0.3%
hits_071.vortex 1.0 vortex-file-compressed 139.81 MB 139.32 MB 506.95 KB -0.4%
hits_036.vortex 1.0 vortex-compact 133.70 MB 133.23 MB 488.36 KB -0.4%
hits_006.vortex 1.0 vortex-compact 95.79 MB 95.42 MB 384.67 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 139.78 MB 139.19 MB 604.34 KB -0.4%
hits_094.vortex 1.0 vortex-file-compressed 159.08 MB 158.37 MB 727.64 KB -0.4%
hits_089.vortex 1.0 vortex-compact 98.72 MB 98.27 MB 458.58 KB -0.5%
hits_084.vortex 1.0 vortex-file-compressed 154.73 MB 154.02 MB 725.23 KB -0.5%
hits_044.vortex 1.0 vortex-file-compressed 201.03 MB 200.08 MB 973.94 KB -0.5%
hits_018.vortex 1.0 vortex-compact 153.68 MB 152.89 MB 811.70 KB -0.5%
hits_082.vortex 1.0 vortex-file-compressed 140.04 MB 139.26 MB 802.85 KB -0.6%
hits_029.vortex 1.0 vortex-file-compressed 200.88 MB 199.68 MB 1.20 MB -0.6%
hits_091.vortex 1.0 vortex-compact 111.98 MB 111.21 MB 792.95 KB -0.7%
hits_048.vortex 1.0 vortex-file-compressed 200.80 MB 199.39 MB 1.41 MB -0.7%
hits_041.vortex 1.0 vortex-compact 98.71 MB 97.95 MB 783.16 KB -0.8%
hits_093.vortex 1.0 vortex-compact 99.25 MB 98.45 MB 819.77 KB -0.8%
hits_039.vortex 1.0 vortex-compact 124.80 MB 123.78 MB 1.01 MB -0.8%
hits_037.vortex 1.0 vortex-compact 133.58 MB 132.22 MB 1.36 MB -1.0%
hits_067.vortex 1.0 vortex-compact 99.62 MB 98.57 MB 1.05 MB -1.1%
hits_013.vortex 1.0 vortex-compact 125.46 MB 124.04 MB 1.42 MB -1.1%
hits_002.vortex 1.0 vortex-compact 125.34 MB 123.86 MB 1.47 MB -1.2%
hits_024.vortex 1.0 vortex-compact 125.05 MB 123.40 MB 1.66 MB -1.3%
hits_038.vortex 1.0 vortex-file-compressed 192.27 MB 189.57 MB 2.70 MB -1.4%
hits_090.vortex 1.0 vortex-file-compressed 195.23 MB 192.38 MB 2.85 MB -1.5%
hits_052.vortex 1.0 vortex-compact 99.03 MB 97.10 MB 1.93 MB -1.9%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (-0.0%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (+0.0%)

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (+1.9%, environment too noisy confidence) · DuckDB No clear signal (+4.2%, environment too noisy confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.964x ➖
Parquet (geomean): hot 0.975x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -2.5% · Median polish -2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.988x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 215800142 / 232469378 / -7.2% 942190753 / 692868868 / +36.0% 🔴 0.23 / 0.34 / -31.7%
tpch_q02/datafusion:vortex-file-compressed 346469421 / 396206380 / -12.6% 637803680 / 886290465 / -28.0% 0.54 / 0.45 / +21.5%
tpch_q03/datafusion:vortex-file-compressed 376379772 / 418217566 / -10.0% 808162390 / 1093423804 / -26.1% 0.47 / 0.38 / +21.8%
tpch_q04/datafusion:vortex-file-compressed 186827717 / 196852493 / -5.1% 405596002 / 354186581 / +14.5% 0.46 / 0.56 / -17.1%
tpch_q05/datafusion:vortex-file-compressed 528484102 / 416356442 / +26.9% 699374039 / 812066057 / -13.9% 0.76 / 0.51 / +47.4%
tpch_q06/datafusion:vortex-file-compressed 267714296 / 290379125 / -7.8% 413046318 / 403746539 / +2.3% 0.65 / 0.72 / -9.9%
tpch_q07/datafusion:vortex-file-compressed 416771216 / 445723518 / -6.5% 564520919 / 677796369 / -16.7% 0.74 / 0.66 / +12.3%
tpch_q08/datafusion:vortex-file-compressed 528810693 / 458495349 / +15.3% 606847648 / 630307630 / -3.7% 0.87 / 0.73 / +19.8%
tpch_q09/datafusion:vortex-file-compressed 537995699 / 456925190 / +17.7% 556350381 / 484949350 / +14.7% 0.97 / 0.94 / +2.6%
tpch_q10/datafusion:vortex-file-compressed 357510964 / 365021819 / -2.1% 525408349 / 525434433 / -0.0% 0.68 / 0.69 / -2.1%
tpch_q11/datafusion:vortex-file-compressed 283675278 / 282069024 / +0.6% 452127177 / 395699694 / +14.3% 0.63 / 0.71 / -12.0%
tpch_q12/datafusion:vortex-file-compressed 328543007 / 317886301 / +3.4% 492419332 / 500908072 / -1.7% 0.67 / 0.63 / +5.1%
tpch_q13/datafusion:vortex-file-compressed 135094562 / 150427665 / -10.2% 349840184 / 320867671 / +9.0% 0.39 / 0.47 / -17.6%
tpch_q14/datafusion:vortex-file-compressed 201594266 / 184405505 / +9.3% 388832583 / 286216204 / +35.9% 🔴 0.52 / 0.64 / -19.5%
tpch_q15/datafusion:vortex-file-compressed 308264526 / 299554609 / +2.9% 693750274 / 468165679 / +48.2% 🔴 0.44 / 0.64 / -30.6%
tpch_q16/datafusion:vortex-file-compressed 175892808 / 173343498 / +1.5% 288835790 / 319600415 / -9.6% 0.61 / 0.54 / +12.3%
tpch_q17/datafusion:vortex-file-compressed 297815092 / 345329921 / -13.8% 434834506 / 514016316 / -15.4% 0.68 / 0.67 / +1.9%
tpch_q18/datafusion:vortex-file-compressed 448853309 / 303859603 / +47.7% 🔴 580712984 / 430034652 / +35.0% 🔴 0.77 / 0.71 / +9.4%
tpch_q19/datafusion:vortex-file-compressed 340286595 / 515095603 / -33.9% 🟢 480805114 / 520466927 / -7.6% 0.71 / 0.99 / -28.5%
tpch_q20/datafusion:vortex-file-compressed 268609307 / 275127271 / -2.4% 443693954 / 444787010 / -0.2% 0.61 / 0.62 / -2.1%
tpch_q21/datafusion:vortex-file-compressed 444719023 / 508390622 / -12.5% 660207555 / 630943817 / +4.6% 0.67 / 0.81 / -16.4%
tpch_q22/datafusion:vortex-file-compressed 177968506 / 179560660 / -0.9% 321148974 / 427275985 / -24.8% 0.55 / 0.42 / +31.9%
datafusion / vortex-compact / ns (1.050x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 217370699 / 227113342 / -4.3% 672826916 / 729741950 / -7.8% 0.32 / 0.31 / +3.8%
tpch_q02/datafusion:vortex-compact 371210696 / 330688716 / +12.3% 671611125 / 672200890 / -0.1% 0.55 / 0.49 / +12.4%
tpch_q03/datafusion:vortex-compact 317444487 / 376792620 / -15.8% 745279384 / 835489330 / -10.8% 0.43 / 0.45 / -5.6%
tpch_q04/datafusion:vortex-compact 161345423 / 153613842 / +5.0% 340182189 / 440850524 / -22.8% 0.47 / 0.35 / +36.1%
tpch_q05/datafusion:vortex-compact 515867357 / 373147839 / +38.2% 🔴 513917746 / 646052921 / -20.5% 1.00 / 0.58 / +73.8%
tpch_q06/datafusion:vortex-compact 283932191 / 273510876 / +3.8% 402395780 / 481175298 / -16.4% 0.71 / 0.57 / +24.1%
tpch_q07/datafusion:vortex-compact 590798737 / 360780584 / +63.8% 🔴 582972374 / 513939204 / +13.4% 1.01 / 0.70 / +44.4%
tpch_q08/datafusion:vortex-compact 455079851 / 481122321 / -5.4% 603617610 / 616649122 / -2.1% 0.75 / 0.78 / -3.4%
tpch_q09/datafusion:vortex-compact 272178897 / 304665417 / -10.7% 476286623 / 425087431 / +12.0% 0.57 / 0.72 / -20.3%
tpch_q10/datafusion:vortex-compact 337219990 / 330190426 / +2.1% 454231599 / 530260187 / -14.3% 0.74 / 0.62 / +19.2%
tpch_q11/datafusion:vortex-compact 268319418 / 290348806 / -7.6% 475228758 / 420135596 / +13.1% 0.56 / 0.69 / -18.3%
tpch_q12/datafusion:vortex-compact 284671828 / 315230436 / -9.7% 463015881 / 566486532 / -18.3% 0.61 / 0.56 / +10.5%
tpch_q13/datafusion:vortex-compact 126609511 / 116156186 / +9.0% 281677578 / 473039460 / -40.5% 🟢 0.45 / 0.25 / +83.0%
tpch_q14/datafusion:vortex-compact 168858886 / 212987099 / -20.7% 326545720 / 364523227 / -10.4% 0.52 / 0.58 / -11.5%
tpch_q15/datafusion:vortex-compact 309035585 / 349258441 / -11.5% 517157846 / 556033468 / -7.0% 0.60 / 0.63 / -4.9%
tpch_q16/datafusion:vortex-compact 149861487 / 158604434 / -5.5% 274414013 / 335722074 / -18.3% 0.55 / 0.47 / +15.6%
tpch_q17/datafusion:vortex-compact 439447658 / 314440486 / +39.8% 🔴 512489775 / 495732248 / +3.4% 0.86 / 0.63 / +35.2%
tpch_q18/datafusion:vortex-compact 426725904 / 269611119 / +58.3% 🔴 542895578 / 484909604 / +12.0% 0.79 / 0.56 / +41.4%
tpch_q19/datafusion:vortex-compact 410182711 / 444190707 / -7.7% 559404487 / 555560587 / +0.7% 0.73 / 0.80 / -8.3%
tpch_q20/datafusion:vortex-compact 268473812 / 321203967 / -16.4% 491902702 / 521157326 / -5.6% 0.55 / 0.62 / -11.4%
tpch_q21/datafusion:vortex-compact 456837714 / 491737368 / -7.1% 607771675 / 677239887 / -10.3% 0.75 / 0.73 / +3.5%
tpch_q22/datafusion:vortex-compact 256341519 / 162103356 / +58.1% 🔴 367021262 / 361250717 / +1.6% 0.70 / 0.45 / +55.6%
datafusion / parquet / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 154380541 / 157804532 / -2.2% 393421801 / 586340501 / -32.9% 🟢 0.39 / 0.27 / +45.8%
tpch_q02/datafusion:parquet 280503396 / 271296913 / +3.4% 596293161 / 483504738 / +23.3% 0.47 / 0.56 / -16.2%
tpch_q03/datafusion:parquet 248710117 / 261678419 / -5.0% 660337256 / 591171432 / +11.7% 0.38 / 0.44 / -14.9%
tpch_q04/datafusion:parquet 140652688 / 145523623 / -3.3% 370735349 / 334682295 / +10.8% 0.38 / 0.43 / -12.7%
tpch_q05/datafusion:parquet 336112045 / 343639667 / -2.2% 403554106 / 486488370 / -17.0% 0.83 / 0.71 / +17.9%
tpch_q06/datafusion:parquet 118463004 / 117074560 / +1.2% 220494743 / 236844823 / -6.9% 0.54 / 0.49 / +8.7%
tpch_q07/datafusion:parquet 338745870 / 341807548 / -0.9% 458765507 / 447596694 / +2.5% 0.74 / 0.76 / -3.3%
tpch_q08/datafusion:parquet 411733235 / 434691839 / -5.3% 497270258 / 570844580 / -12.9% 0.83 / 0.76 / +8.7%
tpch_q09/datafusion:parquet 386064153 / 396377226 / -2.6% 593027365 / 564119317 / +5.1% 0.65 / 0.70 / -7.3%
tpch_q10/datafusion:parquet 307908125 / 325932661 / -5.5% 428323417 / 466230076 / -8.1% 0.72 / 0.70 / +2.8%
tpch_q11/datafusion:parquet 254187654 / 248910236 / +2.1% 382505168 / 339448433 / +12.7% 0.66 / 0.73 / -9.4%
tpch_q12/datafusion:parquet 176922553 / 172417140 / +2.6% 343806038 / 368057888 / -6.6% 0.51 / 0.47 / +9.9%
tpch_q13/datafusion:parquet 365045662 / 364870288 / +0.0% 498200703 / 487913357 / +2.1% 0.73 / 0.75 / -2.0%
tpch_q14/datafusion:parquet 189735901 / 175015881 / +8.4% 342253061 / 317011600 / +8.0% 0.55 / 0.55 / +0.4%
tpch_q15/datafusion:parquet 359930429 / 291281731 / +23.6% 478819570 / 503929329 / -5.0% 0.75 / 0.58 / +30.0%
tpch_q16/datafusion:parquet 104048914 / 107776886 / -3.5% 271835821 / 229540391 / +18.4% 0.38 / 0.47 / -18.5%
tpch_q17/datafusion:parquet 290275303 / 277963917 / +4.4% 409086891 / 400352014 / +2.2% 0.71 / 0.69 / +2.2%
tpch_q18/datafusion:parquet 382459836 / 355848790 / +7.5% 482526757 / 462070296 / +4.4% 0.79 / 0.77 / +2.9%
tpch_q19/datafusion:parquet 169657046 / 182137860 / -6.9% 300402576 / 280797132 / +7.0% 0.56 / 0.65 / -12.9%
tpch_q20/datafusion:parquet 239309426 / 365385054 / -34.5% 🟢 395627560 / 846127960 / -53.2% 🟢 0.60 / 0.43 / +40.1%
tpch_q21/datafusion:parquet 311427201 / 338347414 / -8.0% 401422140 / 442591846 / -9.3% 0.78 / 0.76 / +1.5%
tpch_q22/datafusion:parquet 251474173 / 173906733 / +44.6% 🔴 1121440747 / 324952330 / +245.1% 🔴 0.22 / 0.54 / -58.1%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 200567146 / 195568647 / +2.6% 268941956 / 265098724 / +1.4% 0.75 / 0.74 / +1.1%
tpch_q02/duckdb:vortex-file-compressed 467962678 / 476183230 / -1.7% 475632306 / 465272850 / +2.2% 0.98 / 1.02 / -3.9%
tpch_q03/duckdb:vortex-file-compressed 475748922 / 433695609 / +9.7% 493297698 / 602702725 / -18.2% 0.96 / 0.72 / +34.0%
tpch_q04/duckdb:vortex-file-compressed 272887043 / 264724779 / +3.1% 304966605 / 304824560 / +0.0% 0.89 / 0.87 / +3.0%
tpch_q05/duckdb:vortex-file-compressed 452625896 / 470545627 / -3.8% 517387661 / 494137857 / +4.7% 0.87 / 0.95 / -8.1%
tpch_q06/duckdb:vortex-file-compressed 259131192 / 279547228 / -7.3% 300923120 / 277176218 / +8.6% 0.86 / 1.01 / -14.6%
tpch_q07/duckdb:vortex-file-compressed 447295714 / 463487746 / -3.5% 511452987 / 532463962 / -3.9% 0.87 / 0.87 / +0.5%
tpch_q08/duckdb:vortex-file-compressed 636935399 / 614504399 / +3.7% 715605247 / 673522513 / +6.2% 0.89 / 0.91 / -2.4%
tpch_q09/duckdb:vortex-file-compressed 490285035 / 500754935 / -2.1% 550402938 / 527153965 / +4.4% 0.89 / 0.95 / -6.2%
tpch_q10/duckdb:vortex-file-compressed 488531906 / 486874741 / +0.3% 463956957 / 488243340 / -5.0% 1.05 / 1.00 / +5.6%
tpch_q11/duckdb:vortex-file-compressed 200495693 / 189629388 / +5.7% 216607347 / 208255444 / +4.0% 0.93 / 0.91 / +1.7%
tpch_q12/duckdb:vortex-file-compressed 399236228 / 415957090 / -4.0% 455102873 / 584698136 / -22.2% 0.88 / 0.71 / +23.3%
tpch_q13/duckdb:vortex-file-compressed 320615006 / 349765868 / -8.3% 354404272 / 401595241 / -11.8% 0.90 / 0.87 / +3.9%
tpch_q14/duckdb:vortex-file-compressed 350216883 / 248549959 / +40.9% 🔴 312928366 / 504718542 / -38.0% 🟢 1.12 / 0.49 / +127.3%
tpch_q15/duckdb:vortex-file-compressed 148034601 / 138442528 / +6.9% 179150391 / 177427377 / +1.0% 0.83 / 0.78 / +5.9%
tpch_q16/duckdb:vortex-file-compressed 183586557 / 186974703 / -1.8% 211505551 / 236787544 / -10.7% 0.87 / 0.79 / +9.9%
tpch_q17/duckdb:vortex-file-compressed 433800003 / 432007672 / +0.4% 529742721 / 543983363 / -2.6% 0.82 / 0.79 / +3.1%
tpch_q18/duckdb:vortex-file-compressed 307667742 / 320072079 / -3.9% 346362443 / 363911910 / -4.8% 0.89 / 0.88 / +1.0%
tpch_q19/duckdb:vortex-file-compressed 306511737 / 313213176 / -2.1% 425412061 / 407143107 / +4.5% 0.72 / 0.77 / -6.3%
tpch_q20/duckdb:vortex-file-compressed 376008977 / 401948999 / -6.5% 429305420 / 604689790 / -29.0% 0.88 / 0.66 / +31.8%
tpch_q21/duckdb:vortex-file-compressed 610735618 / 624381713 / -2.2% 628113656 / 732899133 / -14.3% 0.97 / 0.85 / +14.1%
tpch_q22/duckdb:vortex-file-compressed 195393565 / 213923182 / -8.7% 221081610 / 198959799 / +11.1% 0.88 / 1.08 / -17.8%
duckdb / vortex-compact / ns (0.980x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 210066624 / 211979874 / -0.9% 297894993 / 341517852 / -12.8% 0.71 / 0.62 / +13.6%
tpch_q02/duckdb:vortex-compact 389182307 / 393531488 / -1.1% 414211187 / 407219387 / +1.7% 0.94 / 0.97 / -2.8%
tpch_q03/duckdb:vortex-compact 383414920 / 416976507 / -8.0% 404471446 / 422087137 / -4.2% 0.95 / 0.99 / -4.0%
tpch_q04/duckdb:vortex-compact 238853515 / 212219204 / +12.6% 275703788 / 246389784 / +11.9% 0.87 / 0.86 / +0.6%
tpch_q05/duckdb:vortex-compact 370315303 / 393751803 / -6.0% 417977944 / 584555698 / -28.5% 0.89 / 0.67 / +31.5%
tpch_q06/duckdb:vortex-compact 278778455 / 294813717 / -5.4% 269620516 / 283135537 / -4.8% 1.03 / 1.04 / -0.7%
tpch_q07/duckdb:vortex-compact 427997090 / 422760978 / +1.2% 511707654 / 445974768 / +14.7% 0.84 / 0.95 / -11.8%
tpch_q08/duckdb:vortex-compact 533735179 / 570940127 / -6.5% 587998838 / 625069700 / -5.9% 0.91 / 0.91 / -0.6%
tpch_q09/duckdb:vortex-compact 446036303 / 443820631 / +0.5% 474091034 / 442065576 / +7.2% 0.94 / 1.00 / -6.3%
tpch_q10/duckdb:vortex-compact 416256740 / 405731760 / +2.6% 452368310 / 402401321 / +12.4% 0.92 / 1.01 / -8.7%
tpch_q11/duckdb:vortex-compact 191975968 / 183201367 / +4.8% 196387758 / 199452894 / -1.5% 0.98 / 0.92 / +6.4%
tpch_q12/duckdb:vortex-compact 412258472 / 429014734 / -3.9% 468805290 / 558957723 / -16.1% 0.88 / 0.77 / +14.6%
tpch_q13/duckdb:vortex-compact 216258060 / 393647088 / -45.1% 🟢 282784101 / 448514896 / -37.0% 🟢 0.76 / 0.88 / -12.9%
tpch_q14/duckdb:vortex-compact 236246151 / 228456689 / +3.4% 254299433 / 292525897 / -13.1% 0.93 / 0.78 / +19.0%
tpch_q15/duckdb:vortex-compact 144041052 / 142352903 / +1.2% 210758681 / 148978965 / +41.5% 🔴 0.68 / 0.96 / -28.5%
tpch_q16/duckdb:vortex-compact 176052982 / 170498625 / +3.3% 218749867 / 204878817 / +6.8% 0.80 / 0.83 / -3.3%
tpch_q17/duckdb:vortex-compact 414339055 / 409975415 / +1.1% 436565972 / 476600199 / -8.4% 0.95 / 0.86 / +10.3%
tpch_q18/duckdb:vortex-compact 291850873 / 281064999 / +3.8% 354155024 / 312256534 / +13.4% 0.82 / 0.90 / -8.4%
tpch_q19/duckdb:vortex-compact 344440491 / 342185380 / +0.7% 413725811 / 346984118 / +19.2% 0.83 / 0.99 / -15.6%
tpch_q20/duckdb:vortex-compact 413764961 / 393641848 / +5.1% 444841481 / 410402462 / +8.4% 0.93 / 0.96 / -3.0%
tpch_q21/duckdb:vortex-compact 575230405 / 598698675 / -3.9% 582361245 / 616349110 / -5.5% 0.99 / 0.97 / +1.7%
tpch_q22/duckdb:vortex-compact 185969764 / 161765568 / +15.0% 186469654 / 180603861 / +3.2% 1.00 / 0.90 / +11.3%
duckdb / parquet / ns (0.952x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 434416801 / 313263046 / +38.7% 🔴 336000355 / 299108325 / +12.3% 1.29 / 1.05 / +23.4%
tpch_q02/duckdb:parquet 658611753 / 649822536 / +1.4% 691195710 / 629942262 / +9.7% 0.95 / 1.03 / -7.6%
tpch_q03/duckdb:parquet 684925610 / 750125756 / -8.7% 787296698 / 762328968 / +3.3% 0.87 / 0.98 / -11.6%
tpch_q04/duckdb:parquet 447471670 / 481782378 / -7.1% 530569584 / 440939446 / +20.3% 0.84 / 1.09 / -22.8%
tpch_q05/duckdb:parquet 805948405 / 922634045 / -12.6% 934733541 / 891428521 / +4.9% 0.86 / 1.04 / -16.7%
tpch_q06/duckdb:parquet 302232377 / 318674265 / -5.2% 296055853 / 306941330 / -3.5% 1.02 / 1.04 / -1.7%
tpch_q07/duckdb:parquet 805689153 / 828481702 / -2.8% 740053940 / 870112071 / -14.9% 1.09 / 0.95 / +14.3%
tpch_q08/duckdb:parquet 1018251054 / 982340578 / +3.7% 1204732502 / 1122700837 / +7.3% 0.85 / 0.87 / -3.4%
tpch_q09/duckdb:parquet 904192211 / 1017496651 / -11.1% 922729031 / 1019924186 / -9.5% 0.98 / 1.00 / -1.8%
tpch_q10/duckdb:parquet 949629671 / 955253646 / -0.6% 968526222 / 1013581134 / -4.4% 0.98 / 0.94 / +4.0%
tpch_q11/duckdb:parquet 413947924 / 424179412 / -2.4% 419639778 / 409732682 / +2.4% 0.99 / 1.04 / -4.7%
tpch_q12/duckdb:parquet 471688064 / 540114934 / -12.7% 650633087 / 552969345 / +17.7% 0.72 / 0.98 / -25.8%
tpch_q13/duckdb:parquet 669689899 / 679153350 / -1.4% 633509635 / 796391459 / -20.5% 1.06 / 0.85 / +24.0%
tpch_q14/duckdb:parquet 456063194 / 616524905 / -26.0% 421449336 / 532815887 / -20.9% 1.08 / 1.16 / -6.5%
tpch_q15/duckdb:parquet 356777572 / 404442595 / -11.8% 328827282 / 406052092 / -19.0% 1.08 / 1.00 / +8.9%
tpch_q16/duckdb:parquet 439635324 / 504921539 / -12.9% 450008151 / 469893925 / -4.2% 0.98 / 1.07 / -9.1%
tpch_q17/duckdb:parquet 450778366 / 454465581 / -0.8% 406962099 / 484504835 / -16.0% 1.11 / 0.94 / +18.1%
tpch_q18/duckdb:parquet 590066775 / 686177289 / -14.0% 573876424 / 703101585 / -18.4% 1.03 / 0.98 / +5.4%
tpch_q19/duckdb:parquet 536045855 / 546760269 / -2.0% 529397850 / 593685224 / -10.8% 1.01 / 0.92 / +9.9%
tpch_q20/duckdb:parquet 805435813 / 842190640 / -4.4% 812824047 / 1032650371 / -21.3% 0.99 / 0.82 / +21.5%
tpch_q21/duckdb:parquet 674467421 / 675406376 / -0.1% 644674112 / 665685426 / -3.2% 1.05 / 1.01 / +3.1%
tpch_q22/duckdb:parquet 419728995 / 417724642 / +0.5% 337484695 / 347962257 / -3.0% 1.24 / 1.20 / +3.6%

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 53990454 / 52473417 / +2.9% 77135698 / 73826347 / +4.5% 0.70 / 0.71 / -1.5%
appian_q02/datafusion:vortex-compact 241053425 / 236212882 / +2.0% 272146397 / 272468366 / -0.1% 0.89 / 0.87 / +2.2%
appian_q03/datafusion:vortex-compact 138721963 / 148532475 / -6.6% 173598713 / 181368674 / -4.3% 0.80 / 0.82 / -2.4%
appian_q04/datafusion:vortex-compact 9868819063 / 9911277526 / -0.4% 9846314618 / 9841176330 / +0.1% 1.00 / 1.01 / -0.5%
appian_q05/datafusion:vortex-compact 141652963 / 136160655 / +4.0% 171653700 / 171320506 / +0.2% 0.83 / 0.79 / +3.8%
appian_q06/datafusion:vortex-compact 143806361 / 144205667 / -0.3% 166829624 / 163502063 / +2.0% 0.86 / 0.88 / -2.3%
appian_q07/datafusion:vortex-compact 168915066 / 164504898 / +2.7% 196111004 / 197745485 / -0.8% 0.86 / 0.83 / +3.5%
appian_q08/datafusion:vortex-compact 552068364 / 554391471 / -0.4% 606203946 / 596534039 / +1.6% 0.91 / 0.93 / -2.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72189407 / 73792847 / -2.2% 93872891 / 96146609 / -2.4% 0.77 / 0.77 / +0.2%
appian_q02/datafusion:parquet 306188416 / 303064677 / +1.0% 338147075 / 334087656 / +1.2% 0.91 / 0.91 / -0.2%
appian_q03/datafusion:parquet 192149589 / 190215512 / +1.0% 228655908 / 230515789 / -0.8% 0.84 / 0.83 / +1.8%
appian_q04/datafusion:parquet 9925205662 / 9949407648 / -0.2% 9850507701 / 9767862327 / +0.8% 1.01 / 1.02 / -1.1%
appian_q05/datafusion:parquet 198216422 / 198253177 / -0.0% 224249729 / 223135699 / +0.5% 0.88 / 0.89 / -0.5%
appian_q06/datafusion:parquet 169323616 / 167241690 / +1.2% 190126334 / 196300202 / -3.1% 0.89 / 0.85 / +4.5%
appian_q07/datafusion:parquet 210844180 / 211039198 / -0.1% 246936492 / 242001688 / +2.0% 0.85 / 0.87 / -2.1%
appian_q08/datafusion:parquet 680331357 / 673293284 / +1.0% 688969793 / 700633863 / -1.7% 0.99 / 0.96 / +2.8%
duckdb / vortex-compact / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 90466285 / 89989033 / +0.5% 104262287 / 104164543 / +0.1% 0.87 / 0.86 / +0.4%
appian_q02/duckdb:vortex-compact 212691154 / 213343806 / -0.3% 228476241 / 225677724 / +1.2% 0.93 / 0.95 / -1.5%
appian_q03/duckdb:vortex-compact 119514877 / 122518816 / -2.5% 134920612 / 142845217 / -5.5% 0.89 / 0.86 / +3.3%
appian_q04/duckdb:vortex-compact 566188422 / 589481472 / -4.0% 617207170 / 578279637 / +6.7% 0.92 / 1.02 / -10.0%
appian_q05/duckdb:vortex-compact 133139244 / 127984121 / +4.0% 137639461 / 157422050 / -12.6% 🟢 0.97 / 0.81 / +19.0%
appian_q06/duckdb:vortex-compact 406584168 / 401557353 / +1.3% 419818149 / 415463751 / +1.0% 0.97 / 0.97 / +0.2%
appian_q07/duckdb:vortex-compact 135577133 / 139343642 / -2.7% 156763599 / 155810777 / +0.6% 0.86 / 0.89 / -3.3%
appian_q08/duckdb:vortex-compact 415411663 / 430162723 / -3.4% 461254745 / 470624229 / -2.0% 0.90 / 0.91 / -1.5%
duckdb / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99320887 / 100540830 / -1.2% 115186371 / 113983284 / +1.1% 0.86 / 0.88 / -2.2%
appian_q02/duckdb:parquet 195859784 / 200844077 / -2.5% 195390860 / 196868499 / -0.8% 1.00 / 1.02 / -1.7%
appian_q03/duckdb:parquet 123752661 / 124246104 / -0.4% 132407706 / 131988222 / +0.3% 0.93 / 0.94 / -0.7%
appian_q04/duckdb:parquet 455949861 / 444039335 / +2.7% 442686050 / 451170279 / -1.9% 1.03 / 0.98 / +4.7%
appian_q05/duckdb:parquet 143272699 / 143559805 / -0.2% 163613665 / 157847298 / +3.7% 0.88 / 0.91 / -3.7%
appian_q06/duckdb:parquet 246421688 / 260990971 / -5.6% 230215018 / 250724004 / -8.2% 1.07 / 1.04 / +2.8%
appian_q07/duckdb:parquet 153759413 / 154291367 / -0.3% 165984634 / 170220690 / -2.5% 0.93 / 0.91 / +2.2%
appian_q08/duckdb:parquet 376894846 / 390637467 / -3.5% 379015893 / 390294713 / -2.9% 0.99 / 1.00 / -0.6%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Engines: DataFusion No clear signal (+7.2%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.032x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 9↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24079446 / 24223422 / -0.6% 44876758 / 43424991 / +3.3% 0.54 / 0.56 / -3.8%
tpcds_q02/datafusion:vortex-file-compressed 45135692 / 45067718 / +0.2% 60055332 / 61178308 / -1.8% 0.75 / 0.74 / +2.0%
tpcds_q03/datafusion:vortex-file-compressed 15221735 / 11656553 / +30.6% 🔴 31089178 / 28810430 / +7.9% 0.49 / 0.40 / +21.0%
tpcds_q04/datafusion:vortex-file-compressed 105272162 / 112720384 / -6.6% 135345369 / 141811025 / -4.6% 0.78 / 0.79 / -2.1%
tpcds_q05/datafusion:vortex-file-compressed 57892550 / 60186094 / -3.8% 80552056 / 80809485 / -0.3% 0.72 / 0.74 / -3.5%
tpcds_q06/datafusion:vortex-file-compressed 22682142 / 23887528 / -5.0% 46885953 / 44233744 / +6.0% 0.48 / 0.54 / -10.4%
tpcds_q07/datafusion:vortex-file-compressed 28612839 / 32752478 / -12.6% 🟢 52024926 / 56190650 / -7.4% 0.55 / 0.58 / -5.6%
tpcds_q08/datafusion:vortex-file-compressed 25465628 / 25523942 / -0.2% 46138499 / 44493600 / +3.7% 0.55 / 0.57 / -3.8%
tpcds_q09/datafusion:vortex-file-compressed 15431190 / 17239395 / -10.5% 🟢 35095189 / 34916189 / +0.5% 0.44 / 0.49 / -10.9%
tpcds_q10/datafusion:vortex-file-compressed 40532428 / 28169182 / +43.9% 🔴 65751290 / 49396094 / +33.1% 🔴 0.62 / 0.57 / +8.1%
tpcds_q11/datafusion:vortex-file-compressed 54023492 / 61463097 / -12.1% 🟢 82362491 / 87815516 / -6.2% 0.66 / 0.70 / -6.3%
tpcds_q12/datafusion:vortex-file-compressed 15489802 / 16527126 / -6.3% 33451319 / 32235680 / +3.8% 0.46 / 0.51 / -9.7%
tpcds_q13/datafusion:vortex-file-compressed 34395510 / 33583850 / +2.4% 53740725 / 52323838 / +2.7% 0.64 / 0.64 / -0.3%
tpcds_q14/datafusion:vortex-file-compressed 91276795 / 92953266 / -1.8% 120821936 / 116643427 / +3.6% 0.76 / 0.80 / -5.2%
tpcds_q15/datafusion:vortex-file-compressed 23014958 / 24035556 / -4.2% 43122243 / 42689522 / +1.0% 0.53 / 0.56 / -5.2%
tpcds_q16/datafusion:vortex-file-compressed 20886988 / 20518693 / +1.8% 43403498 / 40673775 / +6.7% 0.48 / 0.50 / -4.6%
tpcds_q17/datafusion:vortex-file-compressed 56175305 / 61133179 / -8.1% 81830279 / 77303288 / +5.9% 0.69 / 0.79 / -13.2%
tpcds_q18/datafusion:vortex-file-compressed 53918874 / 68418778 / -21.2% 🟢 79960497 / 93373441 / -14.4% 🟢 0.67 / 0.73 / -8.0%
tpcds_q19/datafusion:vortex-file-compressed 18046227 / 18359868 / -1.7% 41674976 / 38852725 / +7.3% 0.43 / 0.47 / -8.4%
tpcds_q20/datafusion:vortex-file-compressed 17524272 / 17753816 / -1.3% 36219146 / 34086146 / +6.3% 0.48 / 0.52 / -7.1%
tpcds_q21/datafusion:vortex-file-compressed 16431514 / 16850476 / -2.5% 38415882 / 38713818 / -0.8% 0.43 / 0.44 / -1.7%
tpcds_q22/datafusion:vortex-file-compressed 51523454 / 49946073 / +3.2% 69373643 / 70204246 / -1.2% 0.74 / 0.71 / +4.4%
tpcds_q23/datafusion:vortex-file-compressed 71832615 / 73114280 / -1.8% 101840427 / 99123962 / +2.7% 0.71 / 0.74 / -4.4%
tpcds_q24/datafusion:vortex-file-compressed 67798628 / 70739934 / -4.2% 93561126 / 95780152 / -2.3% 0.72 / 0.74 / -1.9%
tpcds_q25/datafusion:vortex-file-compressed 49074790 / 56165868 / -12.6% 🟢 66210789 / 85457690 / -22.5% 🟢 0.74 / 0.66 / +12.8%
tpcds_q26/datafusion:vortex-file-compressed 29909582 / 30145081 / -0.8% 50060583 / 51839798 / -3.4% 0.60 / 0.58 / +2.7%
tpcds_q27/datafusion:vortex-file-compressed 53626628 / 64346884 / -16.7% 🟢 76419126 / 88757312 / -13.9% 🟢 0.70 / 0.72 / -3.2%
tpcds_q28/datafusion:vortex-file-compressed 17645008 / 17855500 / -1.2% 38580811 / 36952387 / +4.4% 0.46 / 0.48 / -5.3%
tpcds_q29/datafusion:vortex-file-compressed 55274116 / 53279720 / +3.7% 72906463 / 75635375 / -3.6% 0.76 / 0.70 / +7.6%
tpcds_q30/datafusion:vortex-file-compressed 27176142 / 27153938 / +0.1% 46525360 / 45207918 / +2.9% 0.58 / 0.60 / -2.8%
tpcds_q31/datafusion:vortex-file-compressed 63719645 / 64170516 / -0.7% 96133516 / 91059366 / +5.6% 0.66 / 0.70 / -5.9%
tpcds_q32/datafusion:vortex-file-compressed 14670399 / 13520959 / +8.5% 39290444 / 31728767 / +23.8% 🔴 0.37 / 0.43 / -12.4%
tpcds_q33/datafusion:vortex-file-compressed 27731031 / 27251753 / +1.8% 50678530 / 49022101 / +3.4% 0.55 / 0.56 / -1.6%
tpcds_q34/datafusion:vortex-file-compressed 18684206 / 18206176 / +2.6% 40497045 / 37918205 / +6.8% 0.46 / 0.48 / -3.9%
tpcds_q35/datafusion:vortex-file-compressed 36709443 / 35467798 / +3.5% 60879349 / 59062262 / +3.1% 0.60 / 0.60 / +0.4%
tpcds_q36/datafusion:vortex-file-compressed 48896902 / 48143728 / +1.6% 71557899 / 74498660 / -3.9% 0.68 / 0.65 / +5.7%
tpcds_q37/datafusion:vortex-file-compressed 14072158 / 13088696 / +7.5% 35805637 / 33965138 / +5.4% 0.39 / 0.39 / +2.0%
tpcds_q38/datafusion:vortex-file-compressed 29760927 / 29912896 / -0.5% 56789162 / 52698209 / +7.8% 0.52 / 0.57 / -7.7%
tpcds_q39/datafusion:vortex-file-compressed 63516759 / 65712729 / -3.3% 86509029 / 92357764 / -6.3% 0.73 / 0.71 / +3.2%
tpcds_q40/datafusion:vortex-file-compressed 23510694 / 24729766 / -4.9% 44269353 / 44405676 / -0.3% 0.53 / 0.56 / -4.6%
tpcds_q41/datafusion:vortex-file-compressed 16636890 / 16393538 / +1.5% 32412919 / 31019030 / +4.5% 0.51 / 0.53 / -2.9%
tpcds_q42/datafusion:vortex-file-compressed 11122974 / 11226813 / -0.9% 29867040 / 27530332 / +8.5% 0.37 / 0.41 / -8.7%
tpcds_q43/datafusion:vortex-file-compressed 13604652 / 13420526 / +1.4% 34577460 / 31582591 / +9.5% 0.39 / 0.42 / -7.4%
tpcds_q44/datafusion:vortex-file-compressed 26344178 / 26217243 / +0.5% 51947664 / 48677800 / +6.7% 0.51 / 0.54 / -5.8%
tpcds_q45/datafusion:vortex-file-compressed 26424658 / 27309296 / -3.2% 48052646 / 47243754 / +1.7% 0.55 / 0.58 / -4.9%
tpcds_q46/datafusion:vortex-file-compressed 24488501 / 24314218 / +0.7% 48804456 / 48324526 / +1.0% 0.50 / 0.50 / -0.3%
tpcds_q47/datafusion:vortex-file-compressed 77706638 / 77739474 / -0.0% 107349077 / 106881817 / +0.4% 0.72 / 0.73 / -0.5%
tpcds_q48/datafusion:vortex-file-compressed 31521164 / 30701796 / +2.7% 53229864 / 50873982 / +4.6% 0.59 / 0.60 / -1.9%
tpcds_q49/datafusion:vortex-file-compressed 60060784 / 60090317 / -0.0% 87197087 / 89040395 / -2.1% 0.69 / 0.67 / +2.1%
tpcds_q50/datafusion:vortex-file-compressed 33955528 / 34478438 / -1.5% 55920168 / 54911626 / +1.8% 0.61 / 0.63 / -3.3%
tpcds_q51/datafusion:vortex-file-compressed 61661668 / 60724604 / +1.5% 88155502 / 82757839 / +6.5% 0.70 / 0.73 / -4.7%
tpcds_q52/datafusion:vortex-file-compressed 11588318 / 11890310 / -2.5% 30487871 / 28169413 / +8.2% 0.38 / 0.42 / -10.0%
tpcds_q53/datafusion:vortex-file-compressed 19195736 / 18344167 / +4.6% 40227151 / 37951369 / +6.0% 0.48 / 0.48 / -1.3%
tpcds_q54/datafusion:vortex-file-compressed 33820756 / 33976400 / -0.5% 62905874 / 56950456 / +10.5% 🔴 0.54 / 0.60 / -9.9%
tpcds_q55/datafusion:vortex-file-compressed 11515020 / 11118484 / +3.6% 30022291 / 27027315 / +11.1% 🔴 0.38 / 0.41 / -6.8%
tpcds_q56/datafusion:vortex-file-compressed 26313916 / 27030462 / -2.7% 50136745 / 46673917 / +7.4% 0.52 / 0.58 / -9.4%
tpcds_q57/datafusion:vortex-file-compressed 74052216 / 73578555 / +0.6% 100855206 / 96443301 / +4.6% 0.73 / 0.76 / -3.8%
tpcds_q58/datafusion:vortex-file-compressed 40273990 / 40961180 / -1.7% 67444854 / 65945799 / +2.3% 0.60 / 0.62 / -3.9%
tpcds_q59/datafusion:vortex-file-compressed 27479322 / 31955894 / -14.0% 🟢 50004238 / 53452546 / -6.5% 0.55 / 0.60 / -8.1%
tpcds_q60/datafusion:vortex-file-compressed 27051542 / 26708035 / +1.3% 49131840 / 47162540 / +4.2% 0.55 / 0.57 / -2.8%
tpcds_q61/datafusion:vortex-file-compressed 22056427 / 24049834 / -8.3% 45554662 / 44803860 / +1.7% 0.48 / 0.54 / -9.8%
tpcds_q62/datafusion:vortex-file-compressed 16015803 / 17133056 / -6.5% 36141335 / 35241561 / +2.6% 0.44 / 0.49 / -8.8%
tpcds_q63/datafusion:vortex-file-compressed 18799422 / 18300530 / +2.7% 40707323 / 36937223 / +10.2% 🔴 0.46 / 0.50 / -6.8%
tpcds_q64/datafusion:vortex-file-compressed 300004830 / 322241934 / -6.9% 332067457 / 357704255 / -7.2% 0.90 / 0.90 / +0.3%
tpcds_q65/datafusion:vortex-file-compressed 76917064 / 76717788 / +0.3% 99756965 / 94116178 / +6.0% 0.77 / 0.82 / -5.4%
tpcds_q66/datafusion:vortex-file-compressed 50969086 / 52846922 / -3.6% 71941114 / 73054294 / -1.5% 0.71 / 0.72 / -2.1%
tpcds_q67/datafusion:vortex-file-compressed 55912386 / 56240220 / -0.6% 87263828 / 85551066 / +2.0% 0.64 / 0.66 / -2.5%
tpcds_q68/datafusion:vortex-file-compressed 32373812 / 24912900 / +29.9% 🔴 51565739 / 46305792 / +11.4% 🔴 0.63 / 0.54 / +16.7%
tpcds_q69/datafusion:vortex-file-compressed 28807284 / 27952022 / +3.1% 53526434 / 47508659 / +12.7% 🔴 0.54 / 0.59 / -8.5%
tpcds_q70/datafusion:vortex-file-compressed 71871514 / 71437356 / +0.6% 94371142 / 92503391 / +2.0% 0.76 / 0.77 / -1.4%
tpcds_q71/datafusion:vortex-file-compressed 18440149 / 18277944 / +0.9% 41549872 / 39492174 / +5.2% 0.44 / 0.46 / -4.1%
tpcds_q72/datafusion:vortex-file-compressed 285668461 / 454138170 / -37.1% 🟢 326004807 / 520573672 / -37.4% 🟢 0.88 / 0.87 / +0.4%
tpcds_q73/datafusion:vortex-file-compressed 24785718 / 17158725 / +44.4% 🔴 43851415 / 37366697 / +17.4% 🔴 0.57 / 0.46 / +23.1%
tpcds_q74/datafusion:vortex-file-compressed 42122061 / 45200106 / -6.8% 67448099 / 69792247 / -3.4% 0.62 / 0.65 / -3.6%
tpcds_q75/datafusion:vortex-file-compressed 132408590 / 129819092 / +2.0% 164726500 / 159772194 / +3.1% 0.80 / 0.81 / -1.1%
tpcds_q76/datafusion:vortex-file-compressed 45312286 / 42582449 / +6.4% 66257993 / 64769040 / +2.3% 0.68 / 0.66 / +4.0%
tpcds_q77/datafusion:vortex-file-compressed 36357527 / 37730543 / -3.6% 65148091 / 59442897 / +9.6% 0.56 / 0.63 / -12.1%
tpcds_q78/datafusion:vortex-file-compressed 72790196 / 79585692 / -8.5% 108731990 / 106350941 / +2.2% 0.67 / 0.75 / -10.5%
tpcds_q79/datafusion:vortex-file-compressed 20988496 / 20914406 / +0.4% 42849701 / 42099804 / +1.8% 0.49 / 0.50 / -1.4%
tpcds_q80/datafusion:vortex-file-compressed 70476503 / 76984924 / -8.5% 100461319 / 110406035 / -9.0% 0.70 / 0.70 / +0.6%
tpcds_q81/datafusion:vortex-file-compressed 28298568 / 27730084 / +2.1% 47278978 / 45107769 / +4.8% 0.60 / 0.61 / -2.6%
tpcds_q82/datafusion:vortex-file-compressed 18351806 / 14218510 / +29.1% 🔴 38106723 / 33930103 / +12.3% 🔴 0.48 / 0.42 / +14.9%
tpcds_q83/datafusion:vortex-file-compressed 35955498 / 35955114 / +0.0% 56965821 / 57729530 / -1.3% 0.63 / 0.62 / +1.3%
tpcds_q84/datafusion:vortex-file-compressed 12091808 / 11909414 / +1.5% 28406092 / 27920637 / +1.7% 0.43 / 0.43 / -0.2%
tpcds_q85/datafusion:vortex-file-compressed 56923657 / 59597346 / -4.5% 84533025 / 82124041 / +2.9% 0.67 / 0.73 / -7.2%
tpcds_q86/datafusion:vortex-file-compressed 16579668 / 16449310 / +0.8% 34620907 / 32471350 / +6.6% 0.48 / 0.51 / -5.5%
tpcds_q87/datafusion:vortex-file-compressed 29494744 / 29590229 / -0.3% 55382682 / 52521202 / +5.4% 0.53 / 0.56 / -5.5%
tpcds_q88/datafusion:vortex-file-compressed 30600530 / 34210954 / -10.6% 🟢 51138490 / 61247665 / -16.5% 🟢 0.60 / 0.56 / +7.1%
tpcds_q89/datafusion:vortex-file-compressed 21004335 / 21042229 / -0.2% 43839355 / 40330821 / +8.7% 0.48 / 0.52 / -8.2%
tpcds_q90/datafusion:vortex-file-compressed 10261942 / 10357146 / -0.9% 26736234 / 26003511 / +2.8% 0.38 / 0.40 / -3.6%
tpcds_q91/datafusion:vortex-file-compressed 15995469 / 16922692 / -5.5% 36422502 / 32771224 / +11.1% 🔴 0.44 / 0.52 / -15.0%
tpcds_q92/datafusion:vortex-file-compressed 15004284 / 13211454 / +13.6% 🔴 37251855 / 30848014 / +20.8% 🔴 0.40 / 0.43 / -6.0%
tpcds_q93/datafusion:vortex-file-compressed 23697201 / 23949905 / -1.1% 46392478 / 45260485 / +2.5% 0.51 / 0.53 / -3.5%
tpcds_q94/datafusion:vortex-file-compressed 26783672 / 19286888 / +38.9% 🔴 51685814 / 38296334 / +35.0% 🔴 0.52 / 0.50 / +2.9%
tpcds_q95/datafusion:vortex-file-compressed 57721702 / 45759799 / +26.1% 🔴 82586075 / 68220345 / +21.1% 🔴 0.70 / 0.67 / +4.2%
tpcds_q96/datafusion:vortex-file-compressed 9239305 / 9482400 / -2.6% 27206064 / 24678159 / +10.2% 🔴 0.34 / 0.38 / -11.6%
tpcds_q97/datafusion:vortex-file-compressed 21575032 / 20978646 / +2.8% 48546412 / 41124169 / +18.0% 🔴 0.44 / 0.51 / -12.9%
tpcds_q98/datafusion:vortex-file-compressed 16499653 / 16885240 / -2.3% 37247075 / 34522714 / +7.9% 0.44 / 0.49 / -9.4%
tpcds_q99/datafusion:vortex-file-compressed 19855570 / 19640984 / +1.1% 39088679 / 37052150 / +5.5% 0.51 / 0.53 / -4.2%
datafusion / vortex-compact / ns (1.146x ❌, 3↑ 49↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25765688 / 25993858 / -0.9% 47118347 / 43654916 / +7.9% 0.55 / 0.60 / -8.2%
tpcds_q02/datafusion:vortex-compact 49993704 / 48965328 / +2.1% 66480577 / 65580040 / +1.4% 0.75 / 0.75 / +0.7%
tpcds_q03/datafusion:vortex-compact 17094240 / 12665804 / +35.0% 🔴 36372461 / 31422438 / +15.8% 🔴 0.47 / 0.40 / +16.6%
tpcds_q04/datafusion:vortex-compact 127204748 / 122501404 / +3.8% 155273799 / 151092882 / +2.8% 0.82 / 0.81 / +1.0%
tpcds_q05/datafusion:vortex-compact 65867416 / 62659290 / +5.1% 82246434 / 84051307 / -2.1% 0.80 / 0.75 / +7.4%
tpcds_q06/datafusion:vortex-compact 30928228 / 26355011 / +17.4% 🔴 51546483 / 46633086 / +10.5% 🔴 0.60 / 0.57 / +6.2%
tpcds_q07/datafusion:vortex-compact 41472992 / 34006602 / +22.0% 🔴 57948558 / 53932076 / +7.4% 0.72 / 0.63 / +13.5%
tpcds_q08/datafusion:vortex-compact 36213485 / 30396112 / +19.1% 🔴 54021990 / 48101083 / +12.3% 🔴 0.67 / 0.63 / +6.1%
tpcds_q09/datafusion:vortex-compact 22030996 / 22077246 / -0.2% 40380250 / 39558621 / +2.1% 0.55 / 0.56 / -2.2%
tpcds_q10/datafusion:vortex-compact 65021172 / 36591793 / +77.7% 🔴 87168288 / 57222540 / +52.3% 🔴 0.75 / 0.64 / +16.6%
tpcds_q11/datafusion:vortex-compact 78916182 / 69348652 / +13.8% 🔴 101265718 / 93651921 / +8.1% 0.78 / 0.74 / +5.2%
tpcds_q12/datafusion:vortex-compact 20487152 / 20765074 / -1.3% 39268368 / 38052625 / +3.2% 0.52 / 0.55 / -4.4%
tpcds_q13/datafusion:vortex-compact 61752366 / 53879027 / +14.6% 🔴 79933450 / 74598787 / +7.2% 0.77 / 0.72 / +7.0%
tpcds_q14/datafusion:vortex-compact 98391952 / 97209967 / +1.2% 125713329 / 120765190 / +4.1% 0.78 / 0.80 / -2.8%
tpcds_q15/datafusion:vortex-compact 27124882 / 26656541 / +1.8% 47022587 / 45051898 / +4.4% 0.58 / 0.59 / -2.5%
tpcds_q16/datafusion:vortex-compact 27101302 / 24533350 / +10.5% 🔴 50281917 / 43018984 / +16.9% 🔴 0.54 / 0.57 / -5.5%
tpcds_q17/datafusion:vortex-compact 77981724 / 68468197 / +13.9% 🔴 94636453 / 92340614 / +2.5% 0.82 / 0.74 / +11.1%
tpcds_q18/datafusion:vortex-compact 58516746 / 70438104 / -16.9% 🟢 83210727 / 91724068 / -9.3% 0.70 / 0.77 / -8.4%
tpcds_q19/datafusion:vortex-compact 33604134 / 21977914 / +52.9% 🔴 50290109 / 41960956 / +19.8% 🔴 0.67 / 0.52 / +27.6%
tpcds_q20/datafusion:vortex-compact 22250932 / 22405048 / -0.7% 42106944 / 40630101 / +3.6% 0.53 / 0.55 / -4.2%
tpcds_q21/datafusion:vortex-compact 18619219 / 18183472 / +2.4% 37290672 / 39457666 / -5.5% 0.50 / 0.46 / +8.3%
tpcds_q22/datafusion:vortex-compact 52012432 / 50019196 / +4.0% 72746131 / 71451481 / +1.8% 0.71 / 0.70 / +2.1%
tpcds_q23/datafusion:vortex-compact 74577547 / 76485768 / -2.5% 105538614 / 100191667 / +5.3% 0.71 / 0.76 / -7.4%
tpcds_q24/datafusion:vortex-compact 98709972 / 77711621 / +27.0% 🔴 118370651 / 100295290 / +18.0% 🔴 0.83 / 0.77 / +7.6%
tpcds_q25/datafusion:vortex-compact 72052400 / 61341151 / +17.5% 🔴 83093918 / 86464169 / -3.9% 0.87 / 0.71 / +22.2%
tpcds_q26/datafusion:vortex-compact 33529002 / 32574022 / +2.9% 53668260 / 51479279 / +4.3% 0.62 / 0.63 / -1.3%
tpcds_q27/datafusion:vortex-compact 66118262 / 63792249 / +3.6% 86218587 / 85376448 / +1.0% 0.77 / 0.75 / +2.6%
tpcds_q28/datafusion:vortex-compact 2838592 / 27691996 / +2.5% 48591270 / 49372826 / -1.6% 0.58 / 0.56 / +4.2%
tpcds_q29/datafusion:vortex-compact 69235891 / 67673740 / +2.3% 103728413 / 81695565 / +27.0% 🔴 0.67 / 0.83 / -19.4%
tpcds_q30/datafusion:vortex-compact 31534874 / 30556698 / +3.2% 50037845 / 47898642 / +4.5% 0.63 / 0.64 / -1.2%
tpcds_q31/datafusion:vortex-compact 106722750 / 80252138 / +33.0% 🔴 122438332 / 103672065 / +18.1% 🔴 0.87 / 0.77 / +12.6%
tpcds_q32/datafusion:vortex-compact 18771792 / 16544068 / +13.5% 🔴 41966033 / 37269822 / +12.6% 🔴 0.45 / 0.44 / +0.8%
tpcds_q33/datafusion:vortex-compact 35375110 / 28937353 / +22.2% 🔴 58978837 / 48016334 / +22.8% 🔴 0.60 / 0.60 / -0.5%
tpcds_q34/datafusion:vortex-compact 22581418 / 20675810 / +9.2% 43451794 / 41218250 / +5.4% 0.52 / 0.50 / +3.6%
tpcds_q35/datafusion:vortex-compact 51011268 / 40835113 / +24.9% 🔴 76329491 / 66662174 / +14.5% 🔴 0.67 / 0.61 / +9.1%
tpcds_q36/datafusion:vortex-compact 57873372 / 50900918 / +13.7% 🔴 82918465 / 74818358 / +10.8% 🔴 0.70 / 0.68 / +2.6%
tpcds_q37/datafusion:vortex-compact 18065864 / 15565792 / +16.1% 🔴 40647480 / 36718016 / +10.7% 🔴 0.44 / 0.42 / +4.8%
tpcds_q38/datafusion:vortex-compact 45917687 / 33905224 / +35.4% 🔴 68870458 / 58637224 / +17.5% 🔴 0.67 / 0.58 / +15.3%
tpcds_q39/datafusion:vortex-compact 65884426 / 66095258 / -0.3% 87383096 / 88921730 / -1.7% 0.75 / 0.74 / +1.4%
tpcds_q40/datafusion:vortex-compact 26285900 / 28583179 / -8.0% 48091924 / 50263955 / -4.3% 0.55 / 0.57 / -3.9%
tpcds_q41/datafusion:vortex-compact 19218616 / 18620292 / +3.2% 34132822 / 32195377 / +6.0% 0.56 / 0.58 / -2.6%
tpcds_q42/datafusion:vortex-compact 17405398 / 12792590 / +36.1% 🔴 37405895 / 30241986 / +23.7% 🔴 0.47 / 0.42 / +10.0%
tpcds_q43/datafusion:vortex-compact 26058648 / 16088736 / +62.0% 🔴 37672266 / 32810035 / +14.8% 🔴 0.69 / 0.49 / +41.1%
tpcds_q44/datafusion:vortex-compact 30829722 / 31166234 / -1.1% 54009774 / 51364360 / +5.2% 0.57 / 0.61 / -5.9%
tpcds_q45/datafusion:vortex-compact 33125504 / 30545778 / +8.4% 51091792 / 50585277 / +1.0% 0.65 / 0.60 / +7.4%
tpcds_q46/datafusion:vortex-compact 30542868 / 28242452 / +8.1% 54572022 / 54653338 / -0.1% 0.56 / 0.52 / +8.3%
tpcds_q47/datafusion:vortex-compact 101949490 / 87714199 / +16.2% 🔴 132840038 / 115929199 / +14.6% 🔴 0.77 / 0.76 / +1.4%
tpcds_q48/datafusion:vortex-compact 58001364 / 55499434 / +4.5% 76693525 / 67392420 / +13.8% 🔴 0.76 / 0.82 / -8.2%
tpcds_q49/datafusion:vortex-compact 69352104 / 65999884 / +5.1% 98400336 / 87362161 / +12.6% 🔴 0.70 / 0.76 / -6.7%
tpcds_q50/datafusion:vortex-compact 37134698 / 36081256 / +2.9% 56509714 / 56795736 / -0.5% 0.66 / 0.64 / +3.4%
tpcds_q51/datafusion:vortex-compact 68863303 / 62765510 / +9.7% 89978016 / 85717899 / +5.0% 0.77 / 0.73 / +4.5%
tpcds_q52/datafusion:vortex-compact 18691980 / 12892653 / +45.0% 🔴 37788795 / 30943186 / +22.1% 🔴 0.49 / 0.42 / +18.7%
tpcds_q53/datafusion:vortex-compact 30898012 / 21908578 / +41.0% 🔴 47199419 / 40937150 / +15.3% 🔴 0.65 / 0.54 / +22.3%
tpcds_q54/datafusion:vortex-compact 40490816 / 40361286 / +0.3% 68925506 / 63352821 / +8.8% 0.59 / 0.64 / -7.8%
tpcds_q55/datafusion:vortex-compact 17790101 / 12730108 / +39.7% 🔴 36868742 / 32189781 / +14.5% 🔴 0.48 / 0.40 / +22.0%
tpcds_q56/datafusion:vortex-compact 34285479 / 27911864 / +22.8% 🔴 57329398 / 49764049 / +15.2% 🔴 0.60 / 0.56 / +6.6%
tpcds_q57/datafusion:vortex-compact 82826415 / 80814691 / +2.5% 111533548 / 104295669 / +6.9% 0.74 / 0.77 / -4.2%
tpcds_q58/datafusion:vortex-compact 50550843 / 48817975 / +3.5% 76732687 / 71826290 / +6.8% 0.66 / 0.68 / -3.1%
tpcds_q59/datafusion:vortex-compact 52690570 / 41311679 / +27.5% 🔴 72875983 / 61489235 / +18.5% 🔴 0.72 / 0.67 / +7.6%
tpcds_q60/datafusion:vortex-compact 34489578 / 28357124 / +21.6% 🔴 58245686 / 50799586 / +14.7% 🔴 0.59 / 0.56 / +6.1%
tpcds_q61/datafusion:vortex-compact 34228106 / 26815687 / +27.6% 🔴 52708324 / 50605456 / +4.2% 0.65 / 0.53 / +22.5%
tpcds_q62/datafusion:vortex-compact 18191459 / 17769069 / +2.4% 37560641 / 34895257 / +7.6% 0.48 / 0.51 / -4.9%
tpcds_q63/datafusion:vortex-compact 27084306 / 21920188 / +23.6% 🔴 48433176 / 41017786 / +18.1% 🔴 0.56 / 0.53 / +4.6%
tpcds_q64/datafusion:vortex-compact 357054898 / 451888945 / -21.0% 🟢 375115189 / 451175629 / -16.9% 🟢 0.95 / 1.00 / -5.0%
tpcds_q65/datafusion:vortex-compact 91784628 / 81962225 / +12.0% 🔴 114176022 / 97610179 / +17.0% 🔴 0.80 / 0.84 / -4.3%
tpcds_q66/datafusion:vortex-compact 60669922 / 55164376 / +10.0% 77083171 / 76205033 / +1.2% 0.79 / 0.72 / +8.7%
tpcds_q67/datafusion:vortex-compact 65883880 / 60119026 / +9.6% 91917093 / 88378945 / +4.0% 0.72 / 0.68 / +5.4%
tpcds_q68/datafusion:vortex-compact 44569662 / 27871480 / +59.9% 🔴 61603091 / 50593381 / +21.8% 🔴 0.72 / 0.55 / +31.3%
tpcds_q69/datafusion:vortex-compact 46681782 / 36376200 / +28.3% 🔴 70323975 / 58011278 / +21.2% 🔴 0.66 / 0.63 / +5.9%
tpcds_q70/datafusion:vortex-compact 87160868 / 76808660 / +13.5% 🔴 104700022 / 95691238 / +9.4% 0.83 / 0.80 / +3.7%
tpcds_q71/datafusion:vortex-compact 26406774 / 20184896 / +30.8% 🔴 42851770 / 40942832 / +4.7% 0.62 / 0.49 / +25.0%
tpcds_q72/datafusion:vortex-compact 296383382 / 492938594 / -39.9% 🟢 318582870 / 490137071 / -35.0% 🟢 0.93 / 1.01 / -7.5%
tpcds_q73/datafusion:vortex-compact 35175656 / 21371974 / +64.6% 🔴 54622797 / 38654317 / +41.3% 🔴 0.64 / 0.55 / +16.5%
tpcds_q74/datafusion:vortex-compact 60622424 / 50100419 / +21.0% 🔴 87347135 / 74190778 / +17.7% 🔴 0.69 / 0.68 / +2.8%
tpcds_q75/datafusion:vortex-compact 150081697 / 140045400 / +7.2% 167941410 / 165263187 / +1.6% 0.89 / 0.85 / +5.5%
tpcds_q76/datafusion:vortex-compact 42112481 / 41832239 / +0.7% 66155374 / 62055548 / +6.6% 0.64 / 0.67 / -5.6%
tpcds_q77/datafusion:vortex-compact 44958764 / 37337592 / +20.4% 🔴 71037451 / 61682701 / +15.2% 🔴 0.63 / 0.61 / +4.6%
tpcds_q78/datafusion:vortex-compact 93039604 / 86683590 / +7.3% 120706329 / 112444113 / +7.3% 0.77 / 0.77 / -0.0%
tpcds_q79/datafusion:vortex-compact 24443844 / 24625047 / -0.7% 45465971 / 51351155 / -11.5% 🟢 0.54 / 0.48 / +12.1%
tpcds_q80/datafusion:vortex-compact 77572020 / 79190948 / -2.0% 105222369 / 111197898 / -5.4% 0.74 / 0.71 / +3.5%
tpcds_q81/datafusion:vortex-compact 30308892 / 29697454 / +2.1% 49538657 / 46432248 / +6.7% 0.61 / 0.64 / -4.3%
tpcds_q82/datafusion:vortex-compact 21732770 / 15201418 / +43.0% 🔴 44217580 / 40354536 / +9.6% 0.49 / 0.38 / +30.5%
tpcds_q83/datafusion:vortex-compact 40429378 / 37020282 / +9.2% 64023624 / 58898516 / +8.7% 0.63 / 0.63 / +0.5%
tpcds_q84/datafusion:vortex-compact 12664126 / 12975344 / -2.4% 29515037 / 28033649 / +5.3% 0.43 / 0.46 / -7.3%
tpcds_q85/datafusion:vortex-compact 103644580 / 102971729 / +0.7% 126469813 / 128916736 / -1.9% 0.82 / 0.80 / +2.6%
tpcds_q86/datafusion:vortex-compact 17711954 / 17584560 / +0.7% 37460209 / 34109514 / +9.8% 0.47 / 0.52 / -8.3%
tpcds_q87/datafusion:vortex-compact 43918330 / 34056841 / +29.0% 🔴 65789724 / 57765405 / +13.9% 🔴 0.67 / 0.59 / +13.2%
tpcds_q88/datafusion:vortex-compact 80879764 / 40650512 / +99.0% 🔴 98900034 / 65746646 / +50.4% 🔴 0.82 / 0.62 / +32.3%
tpcds_q89/datafusion:vortex-compact 30196406 / 25700896 / +17.5% 🔴 49867297 / 46424070 / +7.4% 0.61 / 0.55 / +9.4%
tpcds_q90/datafusion:vortex-compact 16477383 / 11181998 / +47.4% 🔴 30207103 / 26583238 / +13.6% 🔴 0.55 / 0.42 / +29.7%
tpcds_q91/datafusion:vortex-compact 26683150 / 27005968 / -1.2% 47872369 / 44288896 / +8.1% 0.56 / 0.61 / -8.6%
tpcds_q92/datafusion:vortex-compact 19327789 / 15808290 / +22.3% 🔴 40880285 / 33432946 / +22.3% 🔴 0.47 / 0.47 / -0.0%
tpcds_q93/datafusion:vortex-compact 24943215 / 25369713 / -1.7% 47922356 / 44467341 / +7.8% 0.52 / 0.57 / -8.8%
tpcds_q94/datafusion:vortex-compact 33343232 / 22600513 / +47.5% 🔴 55806435 / 39918623 / +39.8% 🔴 0.60 / 0.57 / +5.5%
tpcds_q95/datafusion:vortex-compact 66175400 / 50029842 / +32.3% 🔴 89926071 / 70373741 / +27.8% 🔴 0.74 / 0.71 / +3.5%
tpcds_q96/datafusion:vortex-compact 22753882 / 10690312 / +112.8% 🔴 37663592 / 25802120 / +46.0% 🔴 0.60 / 0.41 / +45.8%
tpcds_q97/datafusion:vortex-compact 31327558 / 24825702 / +26.2% 🔴 54347559 / 43213995 / +25.8% 🔴 0.58 / 0.57 / +0.3%
tpcds_q98/datafusion:vortex-compact 27232619 / 22353646 / +21.8% 🔴 44933213 / 41708685 / +7.7% 0.61 / 0.54 / +13.1%
tpcds_q99/datafusion:vortex-compact 22052439 / 21039954 / +4.8% 40910411 / 38319097 / +6.8% 0.54 / 0.55 / -1.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30352868 / 31591156 / -3.9% 50830108 / 49831978 / +2.0% 0.60 / 0.63 / -5.8%
tpcds_q02/datafusion:parquet 39530029 / 39794594 / -0.7% 57597610 / 57816006 / -0.4% 0.69 / 0.69 / -0.3%
tpcds_q03/datafusion:parquet 16177964 / 16168274 / +0.1% 30677191 / 30139985 / +1.8% 0.53 / 0.54 / -1.7%
tpcds_q04/datafusion:parquet 201738882 / 200137245 / +0.8% 234085199 / 225653108 / +3.7% 0.86 / 0.89 / -2.8%
tpcds_q05/datafusion:parquet 71506642 / 71585642 / -0.1% 93882173 / 94055907 / -0.2% 0.76 / 0.76 / +0.1%
tpcds_q06/datafusion:parquet 28811658 / 28517142 / +1.0% 48301993 / 48499042 / -0.4% 0.60 / 0.59 / +1.4%
tpcds_q07/datafusion:parquet 46695000 / 45923396 / +1.7% 68354448 / 67041542 / +2.0% 0.68 / 0.68 / -0.3%
tpcds_q08/datafusion:parquet 31166521 / 30436199 / +2.4% 49200325 / 47420903 / +3.8% 0.63 / 0.64 / -1.3%
tpcds_q09/datafusion:parquet 29909161 / 31385614 / -4.7% 49048105 / 38129658 / +28.6% 🔴 0.61 / 0.82 / -25.9%
tpcds_q10/datafusion:parquet 43517321 / 41858844 / +4.0% 61659676 / 60631988 / +1.7% 0.71 / 0.69 / +2.2%
tpcds_q11/datafusion:parquet 94363946 / 94516484 / -0.2% 124469952 / 120222569 / +3.5% 0.76 / 0.79 / -3.6%
tpcds_q12/datafusion:parquet 21466210 / 21695845 / -1.1% 36273664 / 35382296 / +2.5% 0.59 / 0.61 / -3.5%
tpcds_q13/datafusion:parquet 42929210 / 42825130 / +0.2% 68141616 / 67147996 / +1.5% 0.63 / 0.64 / -1.2%
tpcds_q14/datafusion:parquet 124160902 / 125220898 / -0.8% 151102726 / 150514031 / +0.4% 0.82 / 0.83 / -1.2%
tpcds_q15/datafusion:parquet 32948238 / 33301866 / -1.1% 50473908 / 49922390 / +1.1% 0.65 / 0.67 / -2.1%
tpcds_q16/datafusion:parquet 36743788 / 37257649 / -1.4% 53619884 / 54900341 / -2.3% 0.69 / 0.68 / +1.0%
tpcds_q17/datafusion:parquet 76730650 / 77095176 / -0.5% 103758554 / 103670973 / +0.1% 0.74 / 0.74 / -0.6%
tpcds_q18/datafusion:parquet 58861531 / 61799628 / -4.8% 80823980 / 82423748 / -1.9% 0.73 / 0.75 / -2.9%
tpcds_q19/datafusion:parquet 25713953 / 26039939 / -1.3% 46387327 / 46851972 / -1.0% 0.55 / 0.56 / -0.3%
tpcds_q20/datafusion:parquet 22469628 / 23733868 / -5.3% 37673820 / 36325973 / +3.7% 0.60 / 0.65 / -8.7%
tpcds_q21/datafusion:parquet 18180694 / 18277108 / -0.5% 33486977 / 32542718 / +2.9% 0.54 / 0.56 / -3.3%
tpcds_q22/datafusion:parquet 75313878 / 74778075 / +0.7% 90279209 / 90166195 / +0.1% 0.83 / 0.83 / +0.6%
tpcds_q23/datafusion:parquet 108036192 / 107162551 / +0.8% 138106562 / 139674282 / -1.1% 0.78 / 0.77 / +2.0%
tpcds_q24/datafusion:parquet 96770272 / 95951904 / +0.9% 121851471 / 123013726 / -0.9% 0.79 / 0.78 / +1.8%
tpcds_q25/datafusion:parquet 79778185 / 78559948 / +1.6% 104406493 / 104713096 / -0.3% 0.76 / 0.75 / +1.8%
tpcds_q26/datafusion:parquet 43300390 / 43294031 / +0.0% 64020752 / 62324414 / +2.7% 0.68 / 0.69 / -2.6%
tpcds_q27/datafusion:parquet 75021242 / 76315746 / -1.7% 95961655 / 96168381 / -0.2% 0.78 / 0.79 / -1.5%
tpcds_q28/datafusion:parquet 27285327 / 27175460 / +0.4% 45145607 / 43604296 / +3.5% 0.60 / 0.62 / -3.0%
tpcds_q29/datafusion:parquet 78054892 / 79597123 / -1.9% 106259049 / 104247941 / +1.9% 0.73 / 0.76 / -3.8%
tpcds_q30/datafusion:parquet 43209188 / 45305458 / -4.6% 65955908 / 64362866 / +2.5% 0.66 / 0.70 / -6.9%
tpcds_q31/datafusion:parquet 80827690 / 80181736 / +0.8% 101572655 / 101032366 / +0.5% 0.80 / 0.79 / +0.3%
tpcds_q32/datafusion:parquet 23674998 / 23136912 / +2.3% 40354510 / 40213196 / +0.4% 0.59 / 0.58 / +2.0%
tpcds_q33/datafusion:parquet 33359275 / 33217376 / +0.4% 51575042 / 51170790 / +0.8% 0.65 / 0.65 / -0.4%
tpcds_q34/datafusion:parquet 23458694 / 22791886 / +2.9% 38901048 / 38357567 / +1.4% 0.60 / 0.59 / +1.5%
tpcds_q35/datafusion:parquet 49036371 / 49631547 / -1.2% 66477132 / 69403266 / -4.2% 0.74 / 0.72 / +3.1%
tpcds_q36/datafusion:parquet 54702192 / 53263152 / +2.7% 77666112 / 74541331 / +4.2% 0.70 / 0.71 / -1.4%
tpcds_q37/datafusion:parquet 22871368 / 23324152 / -1.9% 37967081 / 37637413 / +0.9% 0.60 / 0.62 / -2.8%
tpcds_q38/datafusion:parquet 43702400 / 43407250 / +0.7% 62869863 / 61934331 / +1.5% 0.70 / 0.70 / -0.8%
tpcds_q39/datafusion:parquet 71666563 / 72093831 / -0.6% 89531712 / 90438543 / -1.0% 0.80 / 0.80 / +0.4%
tpcds_q40/datafusion:parquet 31111466 / 30337812 / +2.6% 51804731 / 49797821 / +4.0% 0.60 / 0.61 / -1.4%
tpcds_q41/datafusion:parquet 17402560 / 17664014 / -1.5% 28975777 / 28711013 / +0.9% 0.60 / 0.62 / -2.4%
tpcds_q42/datafusion:parquet 15658418 / 15670598 / -0.1% 30391580 / 30000361 / +1.3% 0.52 / 0.52 / -1.4%
tpcds_q43/datafusion:parquet 17447458 / 17160740 / +1.7% 33080186 / 32441507 / +2.0% 0.53 / 0.53 / -0.3%
tpcds_q44/datafusion:parquet 33306029 / 33582620 / -0.8% 52770026 / 52634884 / +0.3% 0.63 / 0.64 / -1.1%
tpcds_q45/datafusion:parquet 37532104 / 37622984 / -0.2% 56280716 / 53838564 / +4.5% 0.67 / 0.70 / -4.6%
tpcds_q46/datafusion:parquet 28271664 / 28952233 / -2.4% 51979288 / 49417087 / +5.2% 0.54 / 0.59 / -7.2%
tpcds_q47/datafusion:parquet 96508190 / 96382179 / +0.1% 123817523 / 123402701 / +0.3% 0.78 / 0.78 / -0.2%
tpcds_q48/datafusion:parquet 38425010 / 38025840 / +1.0% 59706369 / 58072373 / +2.8% 0.64 / 0.65 / -1.7%
tpcds_q49/datafusion:parquet 76880949 / 73459451 / +4.7% 100763357 / 99248018 / +1.5% 0.76 / 0.74 / +3.1%
tpcds_q50/datafusion:parquet 49911976 / 49097643 / +1.7% 70641734 / 72341122 / -2.3% 0.71 / 0.68 / +4.1%
tpcds_q51/datafusion:parquet 66840494 / 66689234 / +0.2% 90944048 / 89578639 / +1.5% 0.73 / 0.74 / -1.3%
tpcds_q52/datafusion:parquet 15590410 / 15776932 / -1.2% 30754081 / 30534674 / +0.7% 0.51 / 0.52 / -1.9%
tpcds_q53/datafusion:parquet 21933386 / 21877648 / +0.3% 39234271 / 38304791 / +2.4% 0.56 / 0.57 / -2.1%
tpcds_q54/datafusion:parquet 44957334 / 45017626 / -0.1% 67592132 / 65416796 / +3.3% 0.67 / 0.69 / -3.3%
tpcds_q55/datafusion:parquet 15326378 / 15231194 / +0.6% 30054098 / 29233333 / +2.8% 0.51 / 0.52 / -2.1%
tpcds_q56/datafusion:parquet 31393804 / 31125396 / +0.9% 55552335 / 52630723 / +5.6% 0.57 / 0.59 / -4.4%
tpcds_q57/datafusion:parquet 99170192 / 97956405 / +1.2% 120202585 / 121727968 / -1.3% 0.83 / 0.80 / +2.5%
tpcds_q58/datafusion:parquet 64726288 / 64532660 / +0.3% 88872100 / 85503484 / +3.9% 0.73 / 0.75 / -3.5%
tpcds_q59/datafusion:parquet 42873078 / 42678724 / +0.5% 63619194 / 61693463 / +3.1% 0.67 / 0.69 / -2.6%
tpcds_q60/datafusion:parquet 31692234 / 31579536 / +0.4% 55055812 / 55911451 / -1.5% 0.58 / 0.56 / +1.9%
tpcds_q61/datafusion:parquet 34720174 / 33996340 / +2.1% 56734366 / 55071752 / +3.0% 0.61 / 0.62 / -0.9%
tpcds_q62/datafusion:parquet 24296880 / 24075941 / +0.9% 39857717 / 38186360 / +4.4% 0.61 / 0.63 / -3.3%
tpcds_q63/datafusion:parquet 21880398 / 22012588 / -0.6% 39770375 / 37620794 / +5.7% 0.55 / 0.59 / -6.0%
tpcds_q64/datafusion:parquet 203068782 / 203996915 / -0.5% 238918866 / 234628232 / +1.8% 0.85 / 0.87 / -2.2%
tpcds_q65/datafusion:parquet 38488052 / 38664740 / -0.5% 60427427 / 60001871 / +0.7% 0.64 / 0.64 / -1.2%
tpcds_q66/datafusion:parquet 61344541 / 61914486 / -0.9% 79973253 / 79993288 / -0.0% 0.77 / 0.77 / -0.9%
tpcds_q67/datafusion:parquet 69535883 / 70109080 / -0.8% 96968076 / 95802539 / +1.2% 0.72 / 0.73 / -2.0%
tpcds_q68/datafusion:parquet 28419904 / 29234452 / -2.8% 51853752 / 51051251 / +1.6% 0.55 / 0.57 / -4.3%
tpcds_q69/datafusion:parquet 42231342 / 42145705 / +0.2% 62296336 / 61436528 / +1.4% 0.68 / 0.69 / -1.2%
tpcds_q70/datafusion:parquet 32262170 / 32767228 / -1.5% 56888308 / 51457211 / +10.6% 🔴 0.57 / 0.64 / -10.9%
tpcds_q71/datafusion:parquet 23422168 / 24342676 / -3.8% 39204248 / 39448403 / -0.6% 0.60 / 0.62 / -3.2%
tpcds_q72/datafusion:parquet 548474557 / 547326982 / +0.2% 582052343 / 568335574 / +2.4% 0.94 / 0.96 / -2.2%
tpcds_q73/datafusion:parquet 21725437 / 21616076 / +0.5% 37241981 / 37862726 / -1.6% 0.58 / 0.57 / +2.2%
tpcds_q74/datafusion:parquet 66792604 / 66573690 / +0.3% 85176232 / 88186209 / -3.4% 0.78 / 0.75 / +3.9%
tpcds_q75/datafusion:parquet 147783638 / 148510790 / -0.5% 178913995 / 180622450 / -0.9% 0.83 / 0.82 / +0.5%
tpcds_q76/datafusion:parquet 47713396 / 49104066 / -2.8% 68112362 / 63015175 / +8.1% 0.70 / 0.78 / -10.1%
tpcds_q77/datafusion:parquet 52579725 / 52548898 / +0.1% 75467157 / 74559824 / +1.2% 0.70 / 0.70 / -1.1%
tpcds_q78/datafusion:parquet 93275177 / 94582875 / -1.4% 126396267 / 123099701 / +2.7% 0.74 / 0.77 / -4.0%
tpcds_q79/datafusion:parquet 25902734 / 26147026 / -0.9% 46143667 / 45933297 / +0.5% 0.56 / 0.57 / -1.4%
tpcds_q80/datafusion:parquet 82317040 / 81843780 / +0.6% 112364617 / 110787025 / +1.4% 0.73 / 0.74 / -0.8%
tpcds_q81/datafusion:parquet 39119100 / 38214242 / +2.4% 60407948 / 60250200 / +0.3% 0.65 / 0.63 / +2.1%
tpcds_q82/datafusion:parquet 25264558 / 25915258 / -2.5% 41058574 / 40117281 / +2.3% 0.62 / 0.65 / -4.7%
tpcds_q83/datafusion:parquet 47262352 / 47938228 / -1.4% 68983804 / 66938190 / +3.1% 0.69 / 0.72 / -4.3%
tpcds_q84/datafusion:parquet 29728879 / 29313590 / +1.4% 45405083 / 47990756 / -5.4% 0.65 / 0.61 / +7.2%
tpcds_q85/datafusion:parquet 85905132 / 86627113 / -0.8% 109356450 / 111551467 / -2.0% 0.79 / 0.78 / +1.2%
tpcds_q86/datafusion:parquet 20504349 / 20602028 / -0.5% 34958437 / 33481604 / +4.4% 0.59 / 0.62 / -4.7%
tpcds_q87/datafusion:parquet 43422160 / 42373536 / +2.5% 61796135 / 62047164 / -0.4% 0.70 / 0.68 / +2.9%
tpcds_q88/datafusion:parquet 38277388 / 39126682 / -2.2% 56961736 / 66060958 / -13.8% 🟢 0.67 / 0.59 / +13.5%
tpcds_q89/datafusion:parquet 25400094 / 25348312 / +0.2% 43436680 / 43238764 / +0.5% 0.58 / 0.59 / -0.3%
tpcds_q90/datafusion:parquet 15707380 / 15936496 / -1.4% 30972431 / 30135088 / +2.8% 0.51 / 0.53 / -4.1%
tpcds_q91/datafusion:parquet 31802022 / 31729586 / +0.2% 48664325 / 49666404 / -2.0% 0.65 / 0.64 / +2.3%
tpcds_q92/datafusion:parquet 23565270 / 23788542 / -0.9% 41790252 / 40306937 / +3.7% 0.56 / 0.59 / -4.5%
tpcds_q93/datafusion:parquet 27353925 / 27581443 / -0.8% 49055079 / 49016289 / +0.1% 0.56 / 0.56 / -0.9%
tpcds_q94/datafusion:parquet 32054072 / 31888048 / +0.5% 49952224 / 48798646 / +2.4% 0.64 / 0.65 / -1.8%
tpcds_q95/datafusion:parquet 65320443 / 67923252 / -3.8% 81606832 / 80832904 / +1.0% 0.80 / 0.84 / -4.7%
tpcds_q96/datafusion:parquet 13008607 / 12641378 / +2.9% 28311900 / 27761015 / +2.0% 0.46 / 0.46 / +0.9%
tpcds_q97/datafusion:parquet 32289268 / 31777358 / +1.6% 53906936 / 51798756 / +4.1% 0.60 / 0.61 / -2.4%
tpcds_q98/datafusion:parquet 22507206 / 22441867 / +0.3% 38861394 / 37406893 / +3.9% 0.58 / 0.60 / -3.5%
tpcds_q99/datafusion:parquet 28536140 / 28763192 / -0.8% 41755763 / 42445752 / -1.6% 0.68 / 0.68 / +0.9%
duckdb / vortex-file-compressed / ns (1.005x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15390593 / 15002752 / +2.6% 22400037 / 22018821 / +1.7% 0.69 / 0.68 / +0.8%
tpcds_q02/duckdb:vortex-file-compressed 15073424 / 14843448 / +1.5% 19925473 / 20058745 / -0.7% 0.76 / 0.74 / +2.2%
tpcds_q03/duckdb:vortex-file-compressed 10109405 / 11033230 / -8.4% 21900504 / 21964501 / -0.3% 0.46 / 0.50 / -8.1%
tpcds_q04/duckdb:vortex-file-compressed 50250132 / 50108452 / +0.3% 59305853 / 59996566 / -1.2% 0.85 / 0.84 / +1.5%
tpcds_q05/duckdb:vortex-file-compressed 18586263 / 18647025 / -0.3% 29012383 / 26472937 / +9.6% 0.64 / 0.70 / -9.1%
tpcds_q06/duckdb:vortex-file-compressed 26666114 / 26531120 / +0.5% 40114509 / 39754497 / +0.9% 0.66 / 0.67 / -0.4%
tpcds_q07/duckdb:vortex-file-compressed 15943996 / 15736117 / +1.3% 30629244 / 35030596 / -12.6% 🟢 0.52 / 0.45 / +15.9%
tpcds_q08/duckdb:vortex-file-compressed 18926935 / 19086601 / -0.8% 27505044 / 26212753 / +4.9% 0.69 / 0.73 / -5.5%
tpcds_q09/duckdb:vortex-file-compressed 13415950 / 13396412 / +0.1% 24217095 / 21176001 / +14.4% 🔴 0.55 / 0.63 / -12.4%
tpcds_q10/duckdb:vortex-file-compressed 30281089 / 27508244 / +10.1% 🔴 41851371 / 40831130 / +2.5% 0.72 / 0.67 / +7.4%
tpcds_q11/duckdb:vortex-file-compressed 40121120 / 40383742 / -0.7% 53278177 / 51248503 / +4.0% 0.75 / 0.79 / -4.4%
tpcds_q12/duckdb:vortex-file-compressed 10268050 / 10202384 / +0.6% 15817599 / 15848767 / -0.2% 0.65 / 0.64 / +0.8%
tpcds_q13/duckdb:vortex-file-compressed 21148808 / 22247756 / -4.9% 35872368 / 33086918 / +8.4% 0.59 / 0.67 / -12.3%
tpcds_q14/duckdb:vortex-file-compressed 58635173 / 58377906 / +0.4% 69871530 / 72432093 / -3.5% 0.84 / 0.81 / +4.1%
tpcds_q15/duckdb:vortex-file-compressed 20845929 / 20828594 / +0.1% 25099098 / 24913620 / +0.7% 0.83 / 0.84 / -0.7%
tpcds_q16/duckdb:vortex-file-compressed 18902628 / 17260601 / +9.5% 30662402 / 28319639 / +8.3% 0.62 / 0.61 / +1.1%
tpcds_q17/duckdb:vortex-file-compressed 29921028 / 29919950 / +0.0% 44359234 / 43230555 / +2.6% 0.67 / 0.69 / -2.5%
tpcds_q18/duckdb:vortex-file-compressed 28228523 / 28459909 / -0.8% 38546378 / 37624678 / +2.4% 0.73 / 0.76 / -3.2%
tpcds_q19/duckdb:vortex-file-compressed 23277786 / 23290999 / -0.1% 35226678 / 34267768 / +2.8% 0.66 / 0.68 / -2.8%
tpcds_q20/duckdb:vortex-file-compressed 10722253 / 10587730 / +1.3% 18025625 / 15375239 / +17.2% 🔴 0.59 / 0.69 / -13.6%
tpcds_q21/duckdb:vortex-file-compressed 12321162 / 9433160 / +30.6% 🔴 21044131 / 17581042 / +19.7% 🔴 0.59 / 0.54 / +9.1%
tpcds_q22/duckdb:vortex-file-compressed 29055627 / 29368019 / -1.1% 38665011 / 38028480 / +1.7% 0.75 / 0.77 / -2.7%
tpcds_q23/duckdb:vortex-file-compressed 35988850 / 36377160 / -1.1% 45722122 / 48324292 / -5.4% 0.79 / 0.75 / +4.6%
tpcds_q24/duckdb:vortex-file-compressed 28011480 / 27286456 / +2.7% 41091068 / 37185349 / +10.5% 🔴 0.68 / 0.73 / -7.1%
tpcds_q25/duckdb:vortex-file-compressed 25604488 / 25005614 / +2.4% 46693228 / 38445691 / +21.5% 🔴 0.55 / 0.65 / -15.7%
tpcds_q26/duckdb:vortex-file-compressed 13195223 / 13240342 / -0.3% 20284229 / 21266865 / -4.6% 0.65 / 0.62 / +4.5%
tpcds_q27/duckdb:vortex-file-compressed 17166186 / 16995450 / +1.0% 31283890 / 29753451 / +5.1% 0.55 / 0.57 / -3.9%
tpcds_q28/duckdb:vortex-file-compressed 12893100 / 12556274 / +2.7% 24255568 / 21957824 / +10.5% 🔴 0.53 / 0.57 / -7.0%
tpcds_q29/duckdb:vortex-file-compressed 28745153 / 28660602 / +0.3% 43996547 / 40577326 / +8.4% 0.65 / 0.71 / -7.5%
tpcds_q30/duckdb:vortex-file-compressed 19382659 / 19132122 / +1.3% 31155385 / 26804257 / +16.2% 🔴 0.62 / 0.71 / -12.8%
tpcds_q31/duckdb:vortex-file-compressed 19173558 / 19421876 / -1.3% 25632675 / 27207066 / -5.8% 0.75 / 0.71 / +4.8%
tpcds_q32/duckdb:vortex-file-compressed 9726020 / 9825202 / -1.0% 17631171 / 21937236 / -19.6% 🟢 0.55 / 0.45 / +23.2%
tpcds_q33/duckdb:vortex-file-compressed 16638354 / 16854940 / -1.3% 28168633 / 27731313 / +1.6% 0.59 / 0.61 / -2.8%
tpcds_q34/duckdb:vortex-file-compressed 15272023 / 15154160 / +0.8% 30245409 / 24553094 / +23.2% 🔴 0.50 / 0.62 / -18.2%
tpcds_q35/duckdb:vortex-file-compressed 45717457 / 46221608 / -1.1% 59780138 / 64165695 / -6.8% 0.76 / 0.72 / +6.2%
tpcds_q36/duckdb:vortex-file-compressed 14811961 / 14593092 / +1.5% 29873203 / 28765160 / +3.9% 0.50 / 0.51 / -2.3%
tpcds_q37/duckdb:vortex-file-compressed 13802988 / 14104340 / -2.1% 22522191 / 22072327 / +2.0% 0.61 / 0.64 / -4.1%
tpcds_q38/duckdb:vortex-file-compressed 22360299 / 22221250 / +0.6% 28098878 / 27784479 / +1.1% 0.80 / 0.80 / -0.5%
tpcds_q39/duckdb:vortex-file-compressed 18172756 / 18397704 / -1.2% 27168681 / 30935165 / -12.2% 🟢 0.67 / 0.59 / +12.5%
tpcds_q40/duckdb:vortex-file-compressed 13128448 / 13125852 / +0.0% 21219462 / 20221824 / +4.9% 0.62 / 0.65 / -4.7%
tpcds_q41/duckdb:vortex-file-compressed 6330697 / 6188825 / +2.3% 9440237 / 8645347 / +9.2% 0.67 / 0.72 / -6.3%
tpcds_q42/duckdb:vortex-file-compressed 10843460 / 8111714 / +33.7% 🔴 19042839 / 16429309 / +15.9% 🔴 0.57 / 0.49 / +15.3%
tpcds_q43/duckdb:vortex-file-compressed 10292774 / 10096330 / +1.9% 18014628 / 18801202 / -4.2% 0.57 / 0.54 / +6.4%
tpcds_q44/duckdb:vortex-file-compressed 15280232 / 15149308 / +0.9% 25915337 / 25718527 / +0.8% 0.59 / 0.59 / +0.1%
tpcds_q45/duckdb:vortex-file-compressed 22167432 / 22112638 / +0.2% 29657100 / 28559583 / +3.8% 0.75 / 0.77 / -3.5%
tpcds_q46/duckdb:vortex-file-compressed 18621434 / 18506830 / +0.6% 30976374 / 28253172 / +9.6% 0.60 / 0.66 / -8.2%
tpcds_q47/duckdb:vortex-file-compressed 30882333 / 30220072 / +2.2% 41974986 / 41348583 / +1.5% 0.74 / 0.73 / +0.7%
tpcds_q48/duckdb:vortex-file-compressed 19234850 / 18644623 / +3.2% 30824926 / 32519992 / -5.2% 0.62 / 0.57 / +8.8%
tpcds_q49/duckdb:vortex-file-compressed 16496598 / 17131288 / -3.7% 33315961 / 29176948 / +14.2% 🔴 0.50 / 0.59 / -15.7%
tpcds_q50/duckdb:vortex-file-compressed 16360769 / 16558674 / -1.2% 27664744 / 26187038 / +5.6% 0.59 / 0.63 / -6.5%
tpcds_q51/duckdb:vortex-file-compressed 76210070 / 76814784 / -0.8% 61688809 / 65010856 / -5.1% 1.24 / 1.18 / +4.6%
tpcds_q52/duckdb:vortex-file-compressed 9358324 / 8487855 / +10.3% 🔴 20297200 / 17172903 / +18.2% 🔴 0.46 / 0.49 / -6.7%
tpcds_q53/duckdb:vortex-file-compressed 14658670 / 14622214 / +0.2% 24956269 / 26107801 / -4.4% 0.59 / 0.56 / +4.9%
tpcds_q54/duckdb:vortex-file-compressed 20554876 / 20484586 / +0.3% 28768485 / 28550353 / +0.8% 0.71 / 0.72 / -0.4%
tpcds_q55/duckdb:vortex-file-compressed 8554648 / 8189614 / +4.5% 18209281 / 16570854 / +9.9% 0.47 / 0.49 / -4.9%
tpcds_q56/duckdb:vortex-file-compressed 16982676 / 17149590 / -1.0% 29101857 / 29844263 / -2.5% 0.58 / 0.57 / +1.6%
tpcds_q57/duckdb:vortex-file-compressed 24347378 / 24081956 / +1.1% 30595998 / 33152981 / -7.7% 0.80 / 0.73 / +9.6%
tpcds_q58/duckdb:vortex-file-compressed 17833349 / 17453730 / +2.2% 27635635 / 27572263 / +0.2% 0.65 / 0.63 / +1.9%
tpcds_q59/duckdb:vortex-file-compressed 18418927 / 18566160 / -0.8% 25539329 / 25025410 / +2.1% 0.72 / 0.74 / -2.8%
tpcds_q60/duckdb:vortex-file-compressed 18106800 / 17759928 / +2.0% 30602226 / 28561409 / +7.1% 0.59 / 0.62 / -4.8%
tpcds_q61/duckdb:vortex-file-compressed 18994946 / 20042892 / -5.2% 31048795 / 30392231 / +2.2% 0.61 / 0.66 / -7.2%
tpcds_q62/duckdb:vortex-file-compressed 9997795 / 10302847 / -3.0% 17710606 / 24353568 / -27.3% 🟢 0.56 / 0.42 / +33.4%
tpcds_q63/duckdb:vortex-file-compressed 13368404 / 13071890 / +2.3% 25696484 / 21741627 / +18.2% 🔴 0.52 / 0.60 / -13.5%
tpcds_q64/duckdb:vortex-file-compressed 61884492 / 61459756 / +0.7% 77560441 / 78014174 / -0.6% 0.80 / 0.79 / +1.3%
tpcds_q65/duckdb:vortex-file-compressed 15989561 / 16171732 / -1.1% 27022640 / 26148918 / +3.3% 0.59 / 0.62 / -4.3%
tpcds_q66/duckdb:vortex-file-compressed 21045388 / 21723967 / -3.1% 27662661 / 30611898 / -9.6% 0.76 / 0.71 / +7.2%
tpcds_q67/duckdb:vortex-file-compressed 64352730 / 66720994 / -3.5% 80023755 / 92648018 / -13.6% 🟢 0.80 / 0.72 / +11.7%
tpcds_q68/duckdb:vortex-file-compressed 18184282 / 18467204 / -1.5% 30169473 / 29782555 / +1.3% 0.60 / 0.62 / -2.8%
tpcds_q69/duckdb:vortex-file-compressed 28797636 / 28734999 / +0.2% 41512092 / 41740807 / -0.5% 0.69 / 0.69 / +0.8%
tpcds_q70/duckdb:vortex-file-compressed 18518578 / 18544049 / -0.1% 29428133 / 30066357 / -2.1% 0.63 / 0.62 / +2.0%
tpcds_q71/duckdb:vortex-file-compressed 12781118 / 12739998 / +0.3% 21507184 / 21657206 / -0.7% 0.59 / 0.59 / +1.0%
tpcds_q72/duckdb:vortex-file-compressed 61728378 / 62088674 / -0.6% 77712166 / 76044603 / +2.2% 0.79 / 0.82 / -2.7%
tpcds_q73/duckdb:vortex-file-compressed 14992418 / 15107879 / -0.8% 20711524 / 20314562 / +2.0% 0.72 / 0.74 / -2.7%
tpcds_q74/duckdb:vortex-file-compressed 27395880 / 27676666 / -1.0% 37123976 / 39017509 / -4.9% 0.74 / 0.71 / +4.0%
tpcds_q75/duckdb:vortex-file-compressed 28493258 / 28375176 / +0.4% 40625289 / 38195159 / +6.4% 0.70 / 0.74 / -5.6%
tpcds_q76/duckdb:vortex-file-compressed 12377190 / 12474064 / -0.8% 25574758 / 24270281 / +5.4% 0.48 / 0.51 / -5.8%
tpcds_q77/duckdb:vortex-file-compressed 16048084 / 15654742 / +2.5% 25218941 / 23348060 / +8.0% 0.64 / 0.67 / -5.1%
tpcds_q78/duckdb:vortex-file-compressed 38765492 / 37658736 / +2.9% 46909298 / 45424221 / +3.3% 0.83 / 0.83 / -0.3%
tpcds_q79/duckdb:vortex-file-compressed 14004794 / 14125886 / -0.9% 27889953 / 23558403 / +18.4% 🔴 0.50 / 0.60 / -16.3%
tpcds_q80/duckdb:vortex-file-compressed 27297898 / 27769090 / -1.7% 47950375 / 39485622 / +21.4% 🔴 0.57 / 0.70 / -19.1%
tpcds_q81/duckdb:vortex-file-compressed 22168888 / 22315440 / -0.7% 31093151 / 29728878 / +4.6% 0.71 / 0.75 / -5.0%
tpcds_q82/duckdb:vortex-file-compressed 32343899 / 32515294 / -0.5% 39607459 / 41566636 / -4.7% 0.82 / 0.78 / +4.4%
tpcds_q83/duckdb:vortex-file-compressed 19469032 / 19183096 / +1.5% 24007701 / 24787811 / -3.1% 0.81 / 0.77 / +4.8%
tpcds_q84/duckdb:vortex-file-compressed 12816166 / 12854612 / -0.3% 25943480 / 19212041 / +35.0% 🔴 0.49 / 0.67 / -26.2%
tpcds_q85/duckdb:vortex-file-compressed 30851188 / 30852027 / -0.0% 40193764 / 38304721 / +4.9% 0.77 / 0.81 / -4.7%
tpcds_q86/duckdb:vortex-file-compressed 10713264 / 10895157 / -1.7% 18294393 / 17651563 / +3.6% 0.59 / 0.62 / -5.1%
tpcds_q87/duckdb:vortex-file-compressed 23970070 / 24798672 / -3.3% 29895395 / 30312629 / -1.4% 0.80 / 0.82 / -2.0%
tpcds_q88/duckdb:vortex-file-compressed 31815099 / 31622960 / +0.6% 45531791 / 42838518 / +6.3% 0.70 / 0.74 / -5.3%
tpcds_q89/duckdb:vortex-file-compressed 13629218 / 13571156 / +0.4% 25329944 / 23085025 / +9.7% 0.54 / 0.59 / -8.5%
tpcds_q90/duckdb:vortex-file-compressed 8096328 / 8298057 / -2.4% 11793589 / 13790995 / -14.5% 🟢 0.69 / 0.60 / +14.1%
tpcds_q91/duckdb:vortex-file-compressed 15041444 / 15168080 / -0.8% 22126395 / 21462340 / +3.1% 0.68 / 0.71 / -3.8%
tpcds_q92/duckdb:vortex-file-compressed 12035114 / 12860374 / -6.4% 19602189 / 20830876 / -5.9% 0.61 / 0.62 / -0.6%
tpcds_q93/duckdb:vortex-file-compressed 16655836 / 16837168 / -1.1% 25446594 / 27304424 / -6.8% 0.65 / 0.62 / +6.1%
tpcds_q94/duckdb:vortex-file-compressed 16190142 / 15955177 / +1.5% 28240489 / 26829179 / +5.3% 0.57 / 0.59 / -3.6%
tpcds_q95/duckdb:vortex-file-compressed 44722146 / 45026946 / -0.7% 54313948 / 52343483 / +3.8% 0.82 / 0.86 / -4.3%
tpcds_q96/duckdb:vortex-file-compressed 7122904 / 8425192 / -15.5% 🟢 14699839 / 18922728 / -22.3% 🟢 0.48 / 0.45 / +8.8%
tpcds_q97/duckdb:vortex-file-compressed 22240620 / 22201168 / +0.2% 28958697 / 29221703 / -0.9% 0.77 / 0.76 / +1.1%
tpcds_q98/duckdb:vortex-file-compressed 14352040 / 14764670 / -2.8% 22123900 / 20789959 / +6.4% 0.65 / 0.71 / -8.7%
tpcds_q99/duckdb:vortex-file-compressed 13234532 / 13225488 / +0.1% 18540750 / 18989959 / -2.4% 0.71 / 0.70 / +2.5%
duckdb / vortex-compact / ns (0.986x ➖, 7↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16434507 / 16576664 / -0.9% 27765388 / 24304074 / +14.2% 🔴 0.59 / 0.68 / -13.2%
tpcds_q02/duckdb:vortex-compact 16239877 / 16190870 / +0.3% 21112148 / 21296976 / -0.9% 0.77 / 0.76 / +1.2%
tpcds_q03/duckdb:vortex-compact 14232121 / 22123944 / -35.7% 🟢 25221810 / 28619206 / -11.9% 🟢 0.56 / 0.77 / -27.0%
tpcds_q04/duckdb:vortex-compact 53744747 / 53930746 / -0.3% 65256989 / 64841318 / +0.6% 0.82 / 0.83 / -1.0%
tpcds_q05/duckdb:vortex-compact 23478217 / 22345753 / +5.1% 31869794 / 32028632 / -0.5% 0.74 / 0.70 / +5.6%
tpcds_q06/duckdb:vortex-compact 33599306 / 33482062 / +0.4% 45033852 / 43956182 / +2.5% 0.75 / 0.76 / -2.1%
tpcds_q07/duckdb:vortex-compact 26502096 / 25163460 / +5.3% 38351108 / 33651116 / +14.0% 🔴 0.69 / 0.75 / -7.6%
tpcds_q08/duckdb:vortex-compact 32570712 / 48636348 / -33.0% 🟢 41089124 / 56428359 / -27.2% 🟢 0.79 / 0.86 / -8.0%
tpcds_q09/duckdb:vortex-compact 19015264 / 19035855 / -0.1% 26763355 / 28107877 / -4.8% 0.71 / 0.68 / +4.9%
tpcds_q10/duckdb:vortex-compact 45207985 / 45106970 / +0.2% 64122925 / 56358537 / +13.8% 🔴 0.71 / 0.80 / -11.9%
tpcds_q11/duckdb:vortex-compact 45300754 / 45100027 / +0.4% 55778953 / 56725430 / -1.7% 0.81 / 0.80 / +2.1%
tpcds_q12/duckdb:vortex-compact 13276256 / 13506726 / -1.7% 19413988 / 18375460 / +5.7% 0.68 / 0.74 / -7.0%
tpcds_q13/duckdb:vortex-compact 36185385 / 36226172 / -0.1% 45730173 / 46195835 / -1.0% 0.79 / 0.78 / +0.9%
tpcds_q14/duckdb:vortex-compact 68552634 / 68158837 / +0.6% 80609709 / 78416233 / +2.8% 0.85 / 0.87 / -2.2%
tpcds_q15/duckdb:vortex-compact 26127496 / 26241378 / -0.4% 30295537 / 30876610 / -1.9% 0.86 / 0.85 / +1.5%
tpcds_q16/duckdb:vortex-compact 24798734 / 24787614 / +0.0% 36159050 / 31708053 / +14.0% 🔴 0.69 / 0.78 / -12.3%
tpcds_q17/duckdb:vortex-compact 44654159 / 45582248 / -2.0% 55728360 / 56638394 / -1.6% 0.80 / 0.80 / -0.4%
tpcds_q18/duckdb:vortex-compact 35648128 / 36173924 / -1.5% 45588585 / 45612703 / -0.1% 0.78 / 0.79 / -1.4%
tpcds_q19/duckdb:vortex-compact 35310250 / 35256596 / +0.2% 43966949 / 46145250 / -4.7% 0.80 / 0.76 / +5.1%
tpcds_q20/duckdb:vortex-compact 13997054 / 13984515 / +0.1% 18934874 / 18706627 / +1.2% 0.74 / 0.75 / -1.1%
tpcds_q21/duckdb:vortex-compact 10410844 / 10349038 / +0.6% 18655010 / 19804469 / -5.8% 0.56 / 0.52 / +6.8%
tpcds_q22/duckdb:vortex-compact 31460993 / 30474772 / +3.2% 40917286 / 40601891 / +0.8% 0.77 / 0.75 / +2.4%
tpcds_q23/duckdb:vortex-compact 43384952 / 42211132 / +2.8% 52241497 / 51376284 / +1.7% 0.83 / 0.82 / +1.1%
tpcds_q24/duckdb:vortex-compact 39509378 / 39774872 / -0.7% 48732454 / 47065142 / +3.5% 0.81 / 0.85 / -4.1%
tpcds_q25/duckdb:vortex-compact 43284725 / 43148592 / +0.3% 56183183 / 55912138 / +0.5% 0.77 / 0.77 / -0.2%
tpcds_q26/duckdb:vortex-compact 21510116 / 21945394 / -2.0% 26910378 / 27656477 / -2.7% 0.80 / 0.79 / +0.7%
tpcds_q27/duckdb:vortex-compact 29588998 / 30118008 / -1.8% 37700855 / 37650126 / +0.1% 0.78 / 0.80 / -1.9%
tpcds_q28/duckdb:vortex-compact 24254682 / 23216714 / +4.5% 30214846 / 30972640 / -2.4% 0.80 / 0.75 / +7.1%
tpcds_q29/duckdb:vortex-compact 44018827 / 44287966 / -0.6% 59638589 / 56104768 / +6.3% 0.74 / 0.79 / -6.5%
tpcds_q30/duckdb:vortex-compact 22478110 / 22814468 / -1.5% 33180977 / 28957129 / +14.6% 🔴 0.68 / 0.79 / -14.0%
tpcds_q31/duckdb:vortex-compact 23407927 / 23595290 / -0.8% 35053229 / 30259820 / +15.8% 🔴 0.67 / 0.78 / -14.4%
tpcds_q32/duckdb:vortex-compact 13684706 / 14173354 / -3.4% 20036098 / 19957580 / +0.4% 0.68 / 0.71 / -3.8%
tpcds_q33/duckdb:vortex-compact 24634934 / 24711192 / -0.3% 32203123 / 35758722 / -9.9% 0.76 / 0.69 / +10.7%
tpcds_q34/duckdb:vortex-compact 21957871 / 21923968 / +0.2% 30857081 / 29281533 / +5.4% 0.71 / 0.75 / -5.0%
tpcds_q35/duckdb:vortex-compact 61796380 / 61651678 / +0.2% 74509426 / 77512834 / -3.9% 0.83 / 0.80 / +4.3%
tpcds_q36/duckdb:vortex-compact 22147524 / 22638570 / -2.2% 35027778 / 35439991 / -1.2% 0.63 / 0.64 / -1.0%
tpcds_q37/duckdb:vortex-compact 15416880 / 15423884 / -0.0% 24156087 / 24184388 / -0.1% 0.64 / 0.64 / +0.1%
tpcds_q38/duckdb:vortex-compact 26371876 / 26071676 / +1.2% 32813708 / 35040345 / -6.4% 0.80 / 0.74 / +8.0%
tpcds_q39/duckdb:vortex-compact 19597720 / 19887430 / -1.5% 27116938 / 28672458 / -5.4% 0.72 / 0.69 / +4.2%
tpcds_q40/duckdb:vortex-compact 16055126 / 16065706 / -0.1% 20306623 / 23571371 / -13.9% 🟢 0.79 / 0.68 / +16.0%
tpcds_q41/duckdb:vortex-compact 7201734 / 7351574 / -2.0% 10630171 / 9890494 / +7.5% 0.68 / 0.74 / -8.9%
tpcds_q42/duckdb:vortex-compact 11995750 / 12903964 / -7.0% 20710562 / 19067627 / +8.6% 0.58 / 0.68 / -14.4%
tpcds_q43/duckdb:vortex-compact 17580022 / 16418488 / +7.1% 22900498 / 23107327 / -0.9% 0.77 / 0.71 / +8.0%
tpcds_q44/duckdb:vortex-compact 22740758 / 23340278 / -2.6% 31117961 / 30542826 / +1.9% 0.73 / 0.76 / -4.4%
tpcds_q45/duckdb:vortex-compact 27449552 / 27190190 / +1.0% 32559463 / 32763070 / -0.6% 0.84 / 0.83 / +1.6%
tpcds_q46/duckdb:vortex-compact 29324798 / 28854396 / +1.6% 47734218 / 43280927 / +10.3% 🔴 0.61 / 0.67 / -7.9%
tpcds_q47/duckdb:vortex-compact 36399800 / 37055705 / -1.8% 47391887 / 49292664 / -3.9% 0.77 / 0.75 / +2.2%
tpcds_q48/duckdb:vortex-compact 33115064 / 33159629 / -0.1% 44000080 / 44503343 / -1.1% 0.75 / 0.75 / +1.0%
tpcds_q49/duckdb:vortex-compact 23634938 / 22470747 / +5.2% 35326048 / 36009758 / -1.9% 0.67 / 0.62 / +7.2%
tpcds_q50/duckdb:vortex-compact 27187986 / 27191762 / -0.0% 35614767 / 35404651 / +0.6% 0.76 / 0.77 / -0.6%
tpcds_q51/duckdb:vortex-compact 53483339 / 52845246 / +1.2% 68576205 / 65509924 / +4.7% 0.78 / 0.81 / -3.3%
tpcds_q52/duckdb:vortex-compact 13584184 / 11908406 / +14.1% 🔴 24134250 / 20660047 / +16.8% 🔴 0.56 / 0.58 / -2.3%
tpcds_q53/duckdb:vortex-compact 20899662 / 21377676 / -2.2% 28852141 / 28106265 / +2.7% 0.72 / 0.76 / -4.8%
tpcds_q54/duckdb:vortex-compact 27577427 / 26954482 / +2.3% 39342011 / 34769817 / +13.1% 🔴 0.70 / 0.78 / -9.6%
tpcds_q55/duckdb:vortex-compact 14586654 / 11920781 / +22.4% 🔴 19998900 / 19927064 / +0.4% 0.73 / 0.60 / +21.9%
tpcds_q56/duckdb:vortex-compact 23384300 / 24639164 / -5.1% 34717974 / 33163717 / +4.7% 0.67 / 0.74 / -9.3%
tpcds_q57/duckdb:vortex-compact 27740732 / 27463063 / +1.0% 35577356 / 35000634 / +1.6% 0.78 / 0.78 / -0.6%
tpcds_q58/duckdb:vortex-compact 23616245 / 24498920 / -3.6% 33871706 / 34505176 / -1.8% 0.70 / 0.71 / -1.8%
tpcds_q59/duckdb:vortex-compact 23113814 / 23729125 / -2.6% 29344195 / 37199207 / -21.1% 🟢 0.79 / 0.64 / +23.5%
tpcds_q60/duckdb:vortex-compact 25076686 / 24491030 / +2.4% 35422882 / 36699121 / -3.5% 0.71 / 0.67 / +6.1%
tpcds_q61/duckdb:vortex-compact 32051208 / 31745152 / +1.0% 46815833 / 43220523 / +8.3% 0.68 / 0.73 / -6.8%
tpcds_q62/duckdb:vortex-compact 11730120 / 11722734 / +0.1% 19749361 / 17871997 / +10.5% 🔴 0.59 / 0.66 / -9.4%
tpcds_q63/duckdb:vortex-compact 20523162 / 20401228 / +0.6% 31841514 / 27214389 / +17.0% 🔴 0.64 / 0.75 / -14.0%
tpcds_q64/duckdb:vortex-compact 85489782 / 84365425 / +1.3% 96701029 / 97311995 / -0.6% 0.88 / 0.87 / +2.0%
tpcds_q65/duckdb:vortex-compact 19517616 / 21467414 / -9.1% 30293303 / 32370298 / -6.4% 0.64 / 0.66 / -2.8%
tpcds_q66/duckdb:vortex-compact 28167648 / 25363092 / +11.1% 🔴 38336624 / 37091625 / +3.4% 0.73 / 0.68 / +7.5%
tpcds_q67/duckdb:vortex-compact 71298012 / 74238778 / -4.0% 84973390 / 83636597 / +1.6% 0.84 / 0.89 / -5.5%
tpcds_q68/duckdb:vortex-compact 29083483 / 28808269 / +1.0% 41229680 / 38591077 / +6.8% 0.71 / 0.75 / -5.5%
tpcds_q69/duckdb:vortex-compact 46514934 / 46082034 / +0.9% 70366436 / 58172957 / +21.0% 🔴 0.66 / 0.79 / -16.6%
tpcds_q70/duckdb:vortex-compact 31257934 / 30888058 / +1.2% 41981216 / 38288983 / +9.6% 0.74 / 0.81 / -7.7%
tpcds_q71/duckdb:vortex-compact 19776940 / 20444285 / -3.3% 30765096 / 28908183 / +6.4% 0.64 / 0.71 / -9.1%
tpcds_q72/duckdb:vortex-compact 68719628 / 69379489 / -1.0% 94485437 / 82936362 / +13.9% 🔴 0.73 / 0.84 / -13.1%
tpcds_q73/duckdb:vortex-compact 21295541 / 21336334 / -0.2% 28884841 / 28595121 / +1.0% 0.74 / 0.75 / -1.2%
tpcds_q74/duckdb:vortex-compact 31560951 / 31857106 / -0.9% 45901926 / 40176438 / +14.3% 🔴 0.69 / 0.79 / -13.3%
tpcds_q75/duckdb:vortex-compact 32671546 / 32548656 / +0.4% 42620047 / 42201374 / +1.0% 0.77 / 0.77 / -0.6%
tpcds_q76/duckdb:vortex-compact 15968515 / 16316176 / -2.1% 30670932 / 27268186 / +12.5% 🔴 0.52 / 0.60 / -13.0%
tpcds_q77/duckdb:vortex-compact 22820270 / 22482829 / +1.5% 31321081 / 30704612 / +2.0% 0.73 / 0.73 / -0.5%
tpcds_q78/duckdb:vortex-compact 41816808 / 41703630 / +0.3% 49288922 / 57793370 / -14.7% 🟢 0.85 / 0.72 / +17.6%
tpcds_q79/duckdb:vortex-compact 28541879 / 38361988 / -25.6% 🟢 39158214 / 46972562 / -16.6% 🟢 0.73 / 0.82 / -10.8%
tpcds_q80/duckdb:vortex-compact 36651820 / 36247512 / +1.1% 50597859 / 47558399 / +6.4% 0.72 / 0.76 / -5.0%
tpcds_q81/duckdb:vortex-compact 24459760 / 24248944 / +0.9% 32165305 / 31410040 / +2.4% 0.76 / 0.77 / -1.5%
tpcds_q82/duckdb:vortex-compact 34727858 / 36842104 / -5.7% 42142461 / 42544272 / -0.9% 0.82 / 0.87 / -4.8%
tpcds_q83/duckdb:vortex-compact 21882996 / 28520448 / -23.3% 🟢 26829507 / 32802715 / -18.2% 🟢 0.82 / 0.87 / -6.2%
tpcds_q84/duckdb:vortex-compact 14634278 / 14652711 / -0.1% 26487908 / 20542199 / +28.9% 🔴 0.55 / 0.71 / -22.5%
tpcds_q85/duckdb:vortex-compact 41249744 / 41292580 / -0.1% 50901568 / 51836668 / -1.8% 0.81 / 0.80 / +1.7%
tpcds_q86/duckdb:vortex-compact 12114302 / 14866562 / -18.5% 🟢 17873900 / 18048966 / -1.0% 0.68 / 0.82 / -17.7%
tpcds_q87/duckdb:vortex-compact 27789198 / 28618460 / -2.9% 34232680 / 34931415 / -2.0% 0.81 / 0.82 / -0.9%
tpcds_q88/duckdb:vortex-compact 65346578 / 66178077 / -1.3% 76450322 / 77100523 / -0.8% 0.85 / 0.86 / -0.4%
tpcds_q89/duckdb:vortex-compact 20809292 / 20840148 / -0.1% 31282643 / 29429299 / +6.3% 0.67 / 0.71 / -6.1%
tpcds_q90/duckdb:vortex-compact 15528300 / 12294337 / +26.3% 🔴 19914550 / 19041294 / +4.6% 0.78 / 0.65 / +20.8%
tpcds_q91/duckdb:vortex-compact 30512838 / 30086193 / +1.4% 37307570 / 36411738 / +2.5% 0.82 / 0.83 / -1.0%
tpcds_q92/duckdb:vortex-compact 15147982 / 20281639 / -25.3% 🟢 21863623 / 25664205 / -14.8% 🟢 0.69 / 0.79 / -12.3%
tpcds_q93/duckdb:vortex-compact 18109296 / 18351558 / -1.3% 28278341 / 28344875 / -0.2% 0.64 / 0.65 / -1.1%
tpcds_q94/duckdb:vortex-compact 21987119 / 24707318 / -11.0% 🟢 31937442 / 29650330 / +7.7% 0.69 / 0.83 / -17.4%
tpcds_q95/duckdb:vortex-compact 46276201 / 46352452 / -0.2% 54833697 / 57023341 / -3.8% 0.84 / 0.81 / +3.8%
tpcds_q96/duckdb:vortex-compact 16979534 / 16929898 / +0.3% 25915073 / 25560658 / +1.4% 0.66 / 0.66 / -1.1%
tpcds_q97/duckdb:vortex-compact 25395382 / 25286598 / +0.4% 37552145 / 30951373 / +21.3% 🔴 0.68 / 0.82 / -17.2%
tpcds_q98/duckdb:vortex-compact 18252616 / 18032263 / +1.2% 29804043 / 26946862 / +10.6% 🔴 0.61 / 0.67 / -8.5%
tpcds_q99/duckdb:vortex-compact 19363304 / 16588358 / +16.7% 🔴 21643628 / 22397667 / -3.4% 0.89 / 0.74 / +20.8%
duckdb / parquet / ns (0.995x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24749750 / 26956658 / -8.2% 31741590 / 31925605 / -0.6% 0.78 / 0.84 / -7.7%
tpcds_q02/duckdb:parquet 15512095 / 15712780 / -1.3% 20381862 / 20137192 / +1.2% 0.76 / 0.78 / -2.5%
tpcds_q03/duckdb:parquet 9107434 / 9053672 / +0.6% 15445451 / 16469508 / -6.2% 0.59 / 0.55 / +7.3%
tpcds_q04/duckdb:parquet 129572252 / 130635108 / -0.8% 135494202 / 134610202 / +0.7% 0.96 / 0.97 / -1.5%
tpcds_q05/duckdb:parquet 21963288 / 22272208 / -1.4% 25923337 / 25639081 / +1.1% 0.85 / 0.87 / -2.5%
tpcds_q06/duckdb:parquet 28689928 / 27232070 / +5.4% 38401655 / 41247876 / -6.9% 0.75 / 0.66 / +13.2%
tpcds_q07/duckdb:parquet 15531330 / 15593382 / -0.4% 22529935 / 23456346 / -3.9% 0.69 / 0.66 / +3.7%
tpcds_q08/duckdb:parquet 26505862 / 25493988 / +4.0% 35095712 / 33048380 / +6.2% 0.76 / 0.77 / -2.1%
tpcds_q09/duckdb:parquet 18683464 / 18766907 / -0.4% 22618979 / 26988641 / -16.2% 🟢 0.83 / 0.70 / +18.8%
tpcds_q10/duckdb:parquet 28194590 / 28824818 / -2.2% 37281897 / 40080659 / -7.0% 0.76 / 0.72 / +5.2%
tpcds_q11/duckdb:parquet 72960861 / 73267545 / -0.4% 77514545 / 77743406 / -0.3% 0.94 / 0.94 / -0.1%
tpcds_q12/duckdb:parquet 12863318 / 13970981 / -7.9% 18105896 / 20194269 / -10.3% 🟢 0.71 / 0.69 / +2.7%
tpcds_q13/duckdb:parquet 24413401 / 24392226 / +0.1% 33512028 / 30813801 / +8.8% 0.73 / 0.79 / -8.0%
tpcds_q14/duckdb:parquet 62109862 / 62121991 / -0.0% 77760512 / 68839359 / +13.0% 🔴 0.80 / 0.90 / -11.5%
tpcds_q15/duckdb:parquet 25387929 / 25611900 / -0.9% 30209208 / 30757899 / -1.8% 0.84 / 0.83 / +0.9%
tpcds_q16/duckdb:parquet 20867156 / 20893728 / -0.1% 29066487 / 29352358 / -1.0% 0.72 / 0.71 / +0.9%
tpcds_q17/duckdb:parquet 32912750 / 32719568 / +0.6% 43651771 / 39940487 / +9.3% 0.75 / 0.82 / -8.0%
tpcds_q18/duckdb:parquet 41302598 / 40178320 / +2.8% 49387209 / 50350154 / -1.9% 0.84 / 0.80 / +4.8%
tpcds_q19/duckdb:parquet 25213300 / 25670733 / -1.8% 35049983 / 38980949 / -10.1% 🟢 0.72 / 0.66 / +9.2%
tpcds_q20/duckdb:parquet 13992079 / 14000616 / -0.1% 18603389 / 21373905 / -13.0% 🟢 0.75 / 0.66 / +14.8%
tpcds_q21/duckdb:parquet 9525318 / 9451030 / +0.8% 15233977 / 15589494 / -2.3% 0.63 / 0.61 / +3.1%
tpcds_q22/duckdb:parquet 36816920 / 34787432 / +5.8% 41496548 / 39481074 / +5.1% 0.89 / 0.88 / +0.7%
tpcds_q23/duckdb:parquet 41034998 / 41526985 / -1.2% 50865810 / 48728936 / +4.4% 0.81 / 0.85 / -5.3%
tpcds_q24/duckdb:parquet 33930369 / 33822930 / +0.3% 41760819 / 42474894 / -1.7% 0.81 / 0.80 / +2.0%
tpcds_q25/duckdb:parquet 33250204 / 31496437 / +5.6% 39975439 / 39427841 / +1.4% 0.83 / 0.80 / +4.1%
tpcds_q26/duckdb:parquet 31816980 / 32108754 / -0.9% 38718673 / 41747061 / -7.3% 0.82 / 0.77 / +6.8%
tpcds_q27/duckdb:parquet 31886430 / 32060554 / -0.5% 39883775 / 39526642 / +0.9% 0.80 / 0.81 / -1.4%
tpcds_q28/duckdb:parquet 17517974 / 17650962 / -0.8% 22306346 / 21678485 / +2.9% 0.79 / 0.81 / -3.5%
tpcds_q29/duckdb:parquet 31386494 / 31158077 / +0.7% 39210455 / 41989007 / -6.6% 0.80 / 0.74 / +7.9%
tpcds_q30/duckdb:parquet 34352852 / 35842704 / -4.2% 43419467 / 42256278 / +2.8% 0.79 / 0.85 / -6.7%
tpcds_q31/duckdb:parquet 20682148 / 20662158 / +0.1% 25586038 / 25879372 / -1.1% 0.81 / 0.80 / +1.2%
tpcds_q32/duckdb:parquet 12222628 / 12174482 / +0.4% 18346296 / 18870417 / -2.8% 0.67 / 0.65 / +3.3%
tpcds_q33/duckdb:parquet 16389548 / 16668626 / -1.7% 23287290 / 23292461 / -0.0% 0.70 / 0.72 / -1.7%
tpcds_q34/duckdb:parquet 16493480 / 16477442 / +0.1% 21674167 / 22316574 / -2.9% 0.76 / 0.74 / +3.1%
tpcds_q35/duckdb:parquet 46942110 / 48182414 / -2.6% 55745589 / 56179082 / -0.8% 0.84 / 0.86 / -1.8%
tpcds_q36/duckdb:parquet 15719109 / 15865838 / -0.9% 23471237 / 26571046 / -11.7% 🟢 0.67 / 0.60 / +12.2%
tpcds_q37/duckdb:parquet 12460358 / 12938672 / -3.7% 18126415 / 16489376 / +9.9% 0.69 / 0.78 / -12.4%
tpcds_q38/duckdb:parquet 26510812 / 26907158 / -1.5% 31267458 / 31778747 / -1.6% 0.85 / 0.85 / +0.1%
tpcds_q39/duckdb:parquet 24316334 / 24683538 / -1.5% 27927492 / 29223536 / -4.4% 0.87 / 0.84 / +3.1%
tpcds_q40/duckdb:parquet 16203018 / 16427738 / -1.4% 23824894 / 21312269 / +11.8% 🔴 0.68 / 0.77 / -11.8%
tpcds_q41/duckdb:parquet 7891760 / 7879470 / +0.2% 13292816 / 13452893 / -1.2% 0.59 / 0.59 / +1.4%
tpcds_q42/duckdb:parquet 8644733 / 8761266 / -1.3% 14992531 / 15738878 / -4.7% 0.58 / 0.56 / +3.6%
tpcds_q43/duckdb:parquet 10717135 / 10778515 / -0.6% 14863265 / 15139898 / -1.8% 0.72 / 0.71 / +1.3%
tpcds_q44/duckdb:parquet 16064990 / 16026177 / +0.2% 22507461 / 23805529 / -5.5% 0.71 / 0.67 / +6.0%
tpcds_q45/duckdb:parquet 23597102 / 23429417 / +0.7% 30417344 / 28833548 / +5.5% 0.78 / 0.81 / -4.5%
tpcds_q46/duckdb:parquet 37095610 / 38696288 / -4.1% 46001993 / 44820720 / +2.6% 0.81 / 0.86 / -6.6%
tpcds_q47/duckdb:parquet 31164412 / 31409795 / -0.8% 44410202 / 37139178 / +19.6% 🔴 0.70 / 0.85 / -17.0%
tpcds_q48/duckdb:parquet 21296046 / 21255318 / +0.2% 27428265 / 27191651 / +0.9% 0.78 / 0.78 / -0.7%
tpcds_q49/duckdb:parquet 20182101 / 20306968 / -0.6% 32862474 / 27879149 / +17.9% 🔴 0.61 / 0.73 / -15.7%
tpcds_q50/duckdb:parquet 17974621 / 17997168 / -0.1% 23819872 / 23597101 / +0.9% 0.75 / 0.76 / -1.1%
tpcds_q51/duckdb:parquet 53458530 / 53611218 / -0.3% 61434004 / 60069185 / +2.3% 0.87 / 0.89 / -2.5%
tpcds_q52/duckdb:parquet 10583454 / 8923962 / +18.6% 🔴 15978853 / 16185440 / -1.3% 0.66 / 0.55 / +20.1%
tpcds_q53/duckdb:parquet 13386539 / 11896522 / +12.5% 🔴 19839909 / 16718704 / +18.7% 🔴 0.67 / 0.71 / -5.2%
tpcds_q54/duckdb:parquet 20887736 / 20680196 / +1.0% 29081514 / 29174669 / -0.3% 0.72 / 0.71 / +1.3%
tpcds_q55/duckdb:parquet 9131396 / 8813304 / +3.6% 15944184 / 15884400 / +0.4% 0.57 / 0.55 / +3.2%
tpcds_q56/duckdb:parquet 17039566 / 16876818 / +1.0% 24411808 / 23808275 / +2.5% 0.70 / 0.71 / -1.5%
tpcds_q57/duckdb:parquet 30236080 / 29006792 / +4.2% 34032134 / 34458570 / -1.2% 0.89 / 0.84 / +5.5%
tpcds_q58/duckdb:parquet 19201266 / 19215420 / -0.1% 26176436 / 26684468 / -1.9% 0.73 / 0.72 / +1.9%
tpcds_q59/duckdb:parquet 20230819 / 20247573 / -0.1% 24906502 / 25305190 / -1.6% 0.81 / 0.80 / +1.5%
tpcds_q60/duckdb:parquet 17612465 / 17602131 / +0.1% 24913712 / 24514254 / +1.6% 0.71 / 0.72 / -1.5%
tpcds_q61/duckdb:parquet 22074906 / 22321678 / -1.1% 28943485 / 29297290 / -1.2% 0.76 / 0.76 / +0.1%
tpcds_q62/duckdb:parquet 10890028 / 10894916 / -0.0% 15158516 / 14738305 / +2.9% 0.72 / 0.74 / -2.8%
tpcds_q63/duckdb:parquet 11302441 / 11275326 / +0.2% 16305229 / 16372510 / -0.4% 0.69 / 0.69 / +0.7%
tpcds_q64/duckdb:parquet 52837486 / 53391096 / -1.0% 65540743 / 67584742 / -3.0% 0.81 / 0.79 / +2.0%
tpcds_q65/duckdb:parquet 14527984 / 17319802 / -16.1% 🟢 20317042 / 24932344 / -18.5% 🟢 0.72 / 0.69 / +2.9%
tpcds_q66/duckdb:parquet 24745296 / 25029896 / -1.1% 31485271 / 30558978 / +3.0% 0.79 / 0.82 / -4.0%
tpcds_q67/duckdb:parquet 77413378 / 78984742 / -2.0% 85807718 / 84148527 / +2.0% 0.90 / 0.94 / -3.9%
tpcds_q68/duckdb:parquet 30415760 / 31097649 / -2.2% 39553203 / 38740235 / +2.1% 0.77 / 0.80 / -4.2%
tpcds_q69/duckdb:parquet 28990124 / 30425000 / -4.7% 39150725 / 38971668 / +0.5% 0.74 / 0.78 / -5.2%
tpcds_q70/duckdb:parquet 17394465 / 16229854 / +7.2% 26174550 / 24681884 / +6.0% 0.66 / 0.66 / +1.1%
tpcds_q71/duckdb:parquet 15301865 / 15001563 / +2.0% 21524725 / 20769317 / +3.6% 0.71 / 0.72 / -1.6%
tpcds_q72/duckdb:parquet 82926834 / 81646358 / +1.6% 86439045 / 86641030 / -0.2% 0.96 / 0.94 / +1.8%
tpcds_q73/duckdb:parquet 13840496 / 13836774 / +0.0% 19292767 / 19604856 / -1.6% 0.72 / 0.71 / +1.6%
tpcds_q74/duckdb:parquet 101620598 / 100275444 / +1.3% 108121241 / 110335207 / -2.0% 0.94 / 0.91 / +3.4%
tpcds_q75/duckdb:parquet 41018826 / 41043017 / -0.1% 50604842 / 50466873 / +0.3% 0.81 / 0.81 / -0.3%
tpcds_q76/duckdb:parquet 14125360 / 13723768 / +2.9% 23106851 / 20442303 / +13.0% 🔴 0.61 / 0.67 / -8.9%
tpcds_q77/duckdb:parquet 17506460 / 17406843 / +0.6% 25499350 / 25696434 / -0.8% 0.69 / 0.68 / +1.3%
tpcds_q78/duckdb:parquet 48747167 / 48595350 / +0.3% 56120090 / 61379279 / -8.6% 0.87 / 0.79 / +9.7%
tpcds_q79/duckdb:parquet 21235018 / 21171055 / +0.3% 29080425 / 28549859 / +1.9% 0.73 / 0.74 / -1.5%
tpcds_q80/duckdb:parquet 32814696 / 32806461 / +0.0% 40817002 / 39699621 / +2.8% 0.80 / 0.83 / -2.7%
tpcds_q81/duckdb:parquet 31414710 / 31985348 / -1.8% 40752673 / 42742751 / -4.7% 0.77 / 0.75 / +3.0%
tpcds_q82/duckdb:parquet 12487692 / 14101472 / -11.4% 🟢 19356863 / 19241429 / +0.6% 0.65 / 0.73 / -12.0%
tpcds_q83/duckdb:parquet 16558579 / 16591312 / -0.2% 21139913 / 21703623 / -2.6% 0.78 / 0.76 / +2.5%
tpcds_q84/duckdb:parquet 18576482 / 18683446 / -0.6% 23683080 / 24274772 / -2.4% 0.78 / 0.77 / +1.9%
tpcds_q85/duckdb:parquet 35585994 / 35472398 / +0.3% 45287354 / 44520725 / +1.7% 0.79 / 0.80 / -1.4%
tpcds_q86/duckdb:parquet 11531794 / 11375589 / +1.4% 16646319 / 16262735 / +2.4% 0.69 / 0.70 / -1.0%
tpcds_q87/duckdb:parquet 28562126 / 28318439 / +0.9% 32513403 / 33095421 / -1.8% 0.88 / 0.86 / +2.7%
tpcds_q88/duckdb:parquet 27519184 / 27203098 / +1.2% 32303817 / 32034139 / +0.8% 0.85 / 0.85 / +0.3%
tpcds_q89/duckdb:parquet 12739100 / 12868420 / -1.0% 18231138 / 21982032 / -17.1% 🟢 0.70 / 0.59 / +19.4%
tpcds_q90/duckdb:parquet 7157614 / 9120792 / -21.5% 🟢 12544101 / 11582046 / +8.3% 0.57 / 0.79 / -27.5%
tpcds_q91/duckdb:parquet 21611423 / 21594805 / +0.1% 28687034 / 31438070 / -8.8% 0.75 / 0.69 / +9.7%
tpcds_q92/duckdb:parquet 12524462 / 12400570 / +1.0% 19761789 / 18749242 / +5.4% 0.63 / 0.66 / -4.2%
tpcds_q93/duckdb:parquet 21801624 / 21792529 / +0.0% 27776442 / 26726166 / +3.9% 0.78 / 0.82 / -3.7%
tpcds_q94/duckdb:parquet 17067220 / 16993630 / +0.4% 26949014 / 28470748 / -5.3% 0.63 / 0.60 / +6.1%
tpcds_q95/duckdb:parquet 94553142 / 91467563 / +3.4% 101513559 / 98216877 / +3.4% 0.93 / 0.93 / +0.0%
tpcds_q96/duckdb:parquet 7087829 / 8177072 / -13.3% 🟢 12341778 / 16651453 / -25.9% 🟢 0.57 / 0.49 / +16.9%
tpcds_q97/duckdb:parquet 26249185 / 26158870 / +0.3% 32263573 / 31947630 / +1.0% 0.81 / 0.82 / -0.6%
tpcds_q98/duckdb:parquet 15311206 / 15397912 / -0.6% 22840597 / 22586455 / +1.1% 0.67 / 0.68 / -1.7%
tpcds_q99/duckdb:parquet 17386826 / 17454118 / -0.4% 21159339 / 21762319 / -2.8% 0.82 / 0.80 / +2.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 1bd8d278 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.997x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1809813 / 1845013 / -1.9% 6033994 / 6435400 / -6.2% 0.30 / 0.29 / +4.6%
statpopgen_q01/datafusion:vortex-file-compressed 24506460 / 24646054 / -0.6% 23055916 / 22753451 / +1.3% 1.06 / 1.08 / -1.9%
statpopgen_q02/datafusion:vortex-file-compressed 104960514 / 110248709 / -4.8% 139552637 / 142271864 / -1.9% 0.75 / 0.77 / -2.9%
statpopgen_q03/datafusion:vortex-file-compressed 350099195 / 352330805 / -0.6% 387922640 / 383083517 / +1.3% 0.90 / 0.92 / -1.9%
statpopgen_q04/datafusion:vortex-file-compressed 349532534 / 380980592 / -8.3% 391413575 / 548348127 / -28.6% 🟢 0.89 / 0.69 / +28.5%
statpopgen_q05/datafusion:vortex-file-compressed 211317506 / 212427988 / -0.5% 259781895 / 255941544 / +1.5% 0.81 / 0.83 / -2.0%
statpopgen_q06/datafusion:vortex-file-compressed 749828722 / 745108499 / +0.6% 788303002 / 777456352 / +1.4% 0.95 / 0.96 / -0.8%
statpopgen_q07/datafusion:vortex-file-compressed 428731319 / 428116157 / +0.1% 445659314 / 449865754 / -0.9% 0.96 / 0.95 / +1.1%
statpopgen_q08/datafusion:vortex-file-compressed 433262170 / 429398018 / +0.9% 445483845 / 440103317 / +1.2% 0.97 / 0.98 / -0.3%
statpopgen_q09/datafusion:vortex-file-compressed 247551506 / 244794538 / +1.1% 284341661 / 278204410 / +2.2% 0.87 / 0.88 / -1.1%
statpopgen_q10/datafusion:vortex-file-compressed 745738244 / 750170092 / -0.6% 968454591 / 765406545 / +26.5% 🔴 0.77 / 0.98 / -21.4%
datafusion / vortex-compact / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1860202 / 1797221 / +3.5% 5844334 / 6126713 / -4.6% 0.32 / 0.29 / +8.5%
statpopgen_q01/datafusion:vortex-compact 22229571 / 26126196 / -14.9% 🟢 23871988 / 23323373 / +2.4% 0.93 / 1.12 / -16.9%
statpopgen_q02/datafusion:vortex-compact 211858772 / 211226485 / +0.3% 231015862 / 231142199 / -0.1% 0.92 / 0.91 / +0.4%
statpopgen_q03/datafusion:vortex-compact 463522726 / 459396290 / +0.9% 483258440 / 486094928 / -0.6% 0.96 / 0.95 / +1.5%
statpopgen_q04/datafusion:vortex-compact 461608151 / 463047363 / -0.3% 480331672 / 484637972 / -0.9% 0.96 / 0.96 / +0.6%
statpopgen_q05/datafusion:vortex-compact 317680846 / 316090282 / +0.5% 332332944 / 340323332 / -2.3% 0.96 / 0.93 / +2.9%
statpopgen_q06/datafusion:vortex-compact 881203641 / 871249215 / +1.1% 892018165 / 896010640 / -0.4% 0.99 / 0.97 / +1.6%
statpopgen_q07/datafusion:vortex-compact 973816732 / 973680407 / +0.0% 983823831 / 980144614 / +0.4% 0.99 / 0.99 / -0.4%
statpopgen_q08/datafusion:vortex-compact 967950794 / 975804556 / -0.8% 982494324 / 985468391 / -0.3% 0.99 / 0.99 / -0.5%
statpopgen_q09/datafusion:vortex-compact 370385360 / 364387800 / +1.6% 379904569 / 382601725 / -0.7% 0.97 / 0.95 / +2.4%
statpopgen_q10/datafusion:vortex-compact 975400926 / 972619666 / +0.3% 1007662259 / 989160340 / +1.9% 0.97 / 0.98 / -1.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 2004839 / 1964400 / +2.1% 89808158 / 91052988 / -1.4% 0.02 / 0.02 / +3.5%
statpopgen_q01/datafusion:parquet 163008628 / 164155445 / -0.7% 172832813 / 172030569 / +0.5% 0.94 / 0.95 / -1.2%
statpopgen_q02/datafusion:parquet 284482773 / 290468775 / -2.1% 416741479 / 431850005 / -3.5% 0.68 / 0.67 / +1.5%
statpopgen_q03/datafusion:parquet 388788086 / 402039932 / -3.3% 532139013 / 518684977 / +2.6% 0.73 / 0.78 / -5.7%
statpopgen_q04/datafusion:parquet 399106277 / 382799592 / +4.3% 536409940 / 529628849 / +1.3% 0.74 / 0.72 / +2.9%
statpopgen_q05/datafusion:parquet 325828000 / 327748686 / -0.6% 462135408 / 457438838 / +1.0% 0.71 / 0.72 / -1.6%
statpopgen_q06/datafusion:parquet 501767104 / 509411672 / -1.5% 619342170 / 607899508 / +1.9% 0.81 / 0.84 / -3.3%
statpopgen_q07/datafusion:parquet 434323993 / 445330142 / -2.5% 602500859 / 543754594 / +10.8% 🔴 0.72 / 0.82 / -12.0%
statpopgen_q08/datafusion:parquet 446721390 / 436374002 / +2.4% 549015561 / 572578459 / -4.1% 0.81 / 0.76 / +6.8%
statpopgen_q09/datafusion:parquet 367753025 / 362248775 / +1.5% 474269697 / 473643185 / +0.1% 0.78 / 0.76 / +1.4%
statpopgen_q10/datafusion:parquet 575947967 / 556812390 / +3.4% 691085875 / 697015371 / -0.9% 0.83 / 0.80 / +4.3%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9039653 / 9063798 / -0.3% 9541270 / 9495485 / +0.5% 0.95 / 0.95 / -0.7%
statpopgen_q01/duckdb:vortex-file-compressed 10295074 / 10468786 / -1.7% 14156817 / 14127308 / +0.2% 0.73 / 0.74 / -1.9%
statpopgen_q02/duckdb:vortex-file-compressed 308080889 / 307572776 / +0.2% 332314651 / 333393781 / -0.3% 0.93 / 0.92 / +0.5%
statpopgen_q03/duckdb:vortex-file-compressed 811670842 / 808875450 / +0.3% 821489059 / 811469534 / +1.2% 0.99 / 1.00 / -0.9%
statpopgen_q04/duckdb:vortex-file-compressed 814956443 / 819993600 / -0.6% 816430329 / 823495346 / -0.9% 1.00 / 1.00 / +0.2%
statpopgen_q05/duckdb:vortex-file-compressed 322423978 / 321671590 / +0.2% 375329955 / 343900597 / +9.1% 0.86 / 0.94 / -8.2%
statpopgen_q06/duckdb:vortex-file-compressed 1139490200 / 1151288111 / -1.0% 1170704271 / 1171432925 / -0.1% 0.97 / 0.98 / -1.0%
statpopgen_q07/duckdb:vortex-file-compressed 375331696 / 376683370 / -0.4% 388637022 / 429026993 / -9.4% 0.97 / 0.88 / +10.0%
statpopgen_q08/duckdb:vortex-file-compressed 373071444 / 381334003 / -2.2% 399492886 / 379730719 / +5.2% 0.93 / 1.00 / -7.0%
statpopgen_q09/duckdb:vortex-file-compressed 609978997 / 608716161 / +0.2% 620996964 / 635239022 / -2.2% 0.98 / 0.96 / +2.5%
statpopgen_q10/duckdb:vortex-file-compressed 1938672780 / 1908342628 / +1.6% 1890771775 / 1878800765 / +0.6% 1.03 / 1.02 / +0.9%
duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9052387 / 9077856 / -0.3% 9556575 / 9506824 / +0.5% 0.95 / 0.95 / -0.8%
statpopgen_q01/duckdb:vortex-compact 10284910 / 10243830 / +0.4% 13528470 / 13492348 / +0.3% 0.76 / 0.76 / +0.1%
statpopgen_q02/duckdb:vortex-compact 379182794 / 381756328 / -0.7% 396858829 / 401097841 / -1.1% 0.96 / 0.95 / +0.4%
statpopgen_q03/duckdb:vortex-compact 903045996 / 895379360 / +0.9% 907919199 / 917881655 / -1.1% 0.99 / 0.98 / +2.0%
statpopgen_q04/duckdb:vortex-compact 892611696 / 905057208 / -1.4% 914458879 / 904679262 / +1.1% 0.98 / 1.00 / -2.4%
statpopgen_q05/duckdb:vortex-compact 425718836 / 427148308 / -0.3% 437398531 / 440364044 / -0.7% 0.97 / 0.97 / +0.3%
statpopgen_q06/duckdb:vortex-compact 1170557392 / 1169539950 / +0.1% 1177225379 / 1172137290 / +0.4% 0.99 / 1.00 / -0.3%
statpopgen_q07/duckdb:vortex-compact 937980560 / 941393174 / -0.4% 928425530 / 939123734 / -1.1% 1.01 / 1.00 / +0.8%
statpopgen_q08/duckdb:vortex-compact 943610824 / 957940952 / -1.5% 962965846 / 949851606 / +1.4% 0.98 / 1.01 / -2.8%
statpopgen_q09/duckdb:vortex-compact 712663002 / 702595550 / +1.4% 713257061 / 708410016 / +0.7% 1.00 / 0.99 / +0.7%
statpopgen_q10/duckdb:vortex-compact 2002562823 / 2004472730 / -0.1% 1983724078 / 1979462349 / +0.2% 1.01 / 1.01 / -0.3%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245879010 / 246431826 / -0.2% 244168189 / 248111226 / -1.6% 1.01 / 0.99 / +1.4%
statpopgen_q01/duckdb:parquet 301460828 / 301117986 / +0.1% 303166276 / 302063574 / +0.4% 0.99 / 1.00 / -0.3%
statpopgen_q02/duckdb:parquet 553087980 / 540718662 / +2.3% 566019384 / 554232026 / +2.1% 0.98 / 0.98 / +0.2%
statpopgen_q03/duckdb:parquet 822231405 / 851634718 / -3.5% 809528424 / 850583930 / -4.8% 1.02 / 1.00 / +1.4%
statpopgen_q04/duckdb:parquet 854887930 / 832669622 / +2.7% 845884880 / 834652529 / +1.3% 1.01 / 1.00 / +1.3%
statpopgen_q05/duckdb:parquet 585417473 / 584068577 / +0.2% 601531268 / 594524114 / +1.2% 0.97 / 0.98 / -0.9%
statpopgen_q06/duckdb:parquet 734809296 / 727482668 / +1.0% 721143105 / 745170372 / -3.2% 1.02 / 0.98 / +4.4%
statpopgen_q07/duckdb:parquet 613093446 / 611527780 / +0.3% 713395417 / 709993664 / +0.5% 0.86 / 0.86 / -0.2%
statpopgen_q08/duckdb:parquet 620767968 / 619528578 / +0.2% 690201776 / 693031663 / -0.4% 0.90 / 0.89 / +0.6%
statpopgen_q09/duckdb:parquet 860185310 / 790716872 / +8.8% 860173213 / 808562916 / +6.4% 1.00 / 0.98 / +2.3%
statpopgen_q10/duckdb:parquet 1494257388 / 1480126984 / +1.0% 1291354396 / 1265338928 / +2.1% 1.16 / 1.17 / -1.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 1bd8d278 vs base 2b4c6822
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.7%
Engines: DataFusion No clear signal (+2.1%, environment too noisy confidence) · DuckDB No clear signal (-7.3%, environment too noisy confidence)
Vortex (geomean): hot 0.929x ➖ · cold 0.875x ➖
Parquet (geomean): hot 0.955x ➖ · cold 0.952x ➖
Shifts: Parquet (control) -4.5% · Median polish -5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.968x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 344225203 / 332527414 / +3.5% 713723602 / 1068515350 / -33.2% 🟢 0.48 / 0.31 / +55.0%
tpch_q02/datafusion:vortex-compact 535418186 / 511599518 / +4.7% 976689466 / 1154734725 / -15.4% 0.55 / 0.44 / +23.7%
tpch_q03/datafusion:vortex-compact 558279338 / 456998574 / +22.2% 1540539576 / 1276513074 / +20.7% 0.36 / 0.36 / +1.2%
tpch_q04/datafusion:vortex-compact 365020121 / 305518967 / +19.5% 762036925 / 616088386 / +23.7% 0.48 / 0.50 / -3.4%
tpch_q05/datafusion:vortex-compact 653223300 / 719405598 / -9.2% 964413054 / 888128698 / +8.6% 0.68 / 0.81 / -16.4%
tpch_q06/datafusion:vortex-compact 310156880 / 270709708 / +14.6% 381514069 / 472591261 / -19.3% 0.81 / 0.57 / +41.9%
tpch_q07/datafusion:vortex-compact 723586282 / 589400871 / +22.8% 930517098 / 806112035 / +15.4% 0.78 / 0.73 / +6.4%
tpch_q08/datafusion:vortex-compact 821874457 / 856985469 / -4.1% 1094787615 / 945531040 / +15.8% 0.75 / 0.91 / -17.2%
tpch_q09/datafusion:vortex-compact 703993885 / 747141352 / -5.8% 1108350150 / 984350746 / +12.6% 0.64 / 0.76 / -16.3%
tpch_q10/datafusion:vortex-compact 577085303 / 636274893 / -9.3% 960754044 / 948891316 / +1.3% 0.60 / 0.67 / -10.4%
tpch_q11/datafusion:vortex-compact 473110738 / 397944309 / +18.9% 698709171 / 576829912 / +21.1% 0.68 / 0.69 / -1.8%
tpch_q12/datafusion:vortex-compact 483424884 / 817248259 / -40.8% 🟢 722251913 / 957144034 / -24.5% 0.67 / 0.85 / -21.6%
tpch_q13/datafusion:vortex-compact 208989808 / 289166246 / -27.7% 593365962 / 522455022 / +13.6% 0.35 / 0.55 / -36.4%
tpch_q14/datafusion:vortex-compact 396321295 / 343107939 / +15.5% 500700678 / 644635565 / -22.3% 0.79 / 0.53 / +48.7%
tpch_q15/datafusion:vortex-compact 712665093 / 859410809 / -17.1% 783184096 / 1126017628 / -30.4% 🟢 0.91 / 0.76 / +19.2%
tpch_q16/datafusion:vortex-compact 274708657 / 284344695 / -3.4% 426981029 / 456515541 / -6.5% 0.64 / 0.62 / +3.3%
tpch_q17/datafusion:vortex-compact 772703948 / 715930547 / +7.9% 948721260 / 716646145 / +32.4% 🔴 0.81 / 1.00 / -18.5%
tpch_q18/datafusion:vortex-compact 460387889 / 629557210 / -26.9% 581766200 / 576355359 / +0.9% 0.79 / 1.09 / -27.6%
tpch_q19/datafusion:vortex-compact 494346399 / 631478190 / -21.7% 659341029 / 779950102 / -15.5% 0.75 / 0.81 / -7.4%
tpch_q20/datafusion:vortex-compact 617253143 / 670538979 / -7.9% 808963828 / 923163269 / -12.4% 0.76 / 0.73 / +5.0%
tpch_q21/datafusion:vortex-compact 723223322 / 645155380 / +12.1% 804500199 / 827397925 / -2.8% 0.90 / 0.78 / +15.3%
tpch_q22/datafusion:vortex-compact 317402049 / 325145356 / -2.4% 728013726 / 584079301 / +24.6% 0.44 / 0.56 / -21.7%
datafusion / parquet / ns (0.947x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 277313252 / 338073477 / -18.0% 550423399 / 751344884 / -26.7% 0.50 / 0.45 / +12.0%
tpch_q02/datafusion:parquet 440176575 / 464585483 / -5.3% 1089086180 / 1010662843 / +7.8% 0.40 / 0.46 / -12.1%
tpch_q03/datafusion:parquet 520304973 / 507859159 / +2.5% 877294783 / 894628043 / -1.9% 0.59 / 0.57 / +4.5%
tpch_q04/datafusion:parquet 388674678 / 369055237 / +5.3% 528084034 / 420458118 / +25.6% 0.74 / 0.88 / -16.1%
tpch_q05/datafusion:parquet 676436641 / 953422176 / -29.1% 982050139 / 1056497497 / -7.0% 0.69 / 0.90 / -23.7%
tpch_q06/datafusion:parquet 170920098 / 192378034 / -11.2% 368935653 / 378479835 / -2.5% 0.46 / 0.51 / -8.9%
tpch_q07/datafusion:parquet 637163933 / 600707546 / +6.1% 770591656 / 782130120 / -1.5% 0.83 / 0.77 / +7.7%
tpch_q08/datafusion:parquet 738044956 / 734513134 / +0.5% 876450910 / 1048554671 / -16.4% 0.84 / 0.70 / +20.2%
tpch_q09/datafusion:parquet 1335624166 / 841610483 / +58.7% 🔴 1263713605 / 1142733390 / +10.6% 1.06 / 0.74 / +43.5%
tpch_q10/datafusion:parquet 1372754267 / 1330948802 / +3.1% 1422910280 / 1416637177 / +0.4% 0.96 / 0.94 / +2.7%
tpch_q11/datafusion:parquet 379359859 / 390080742 / -2.7% 537929889 / 595764479 / -9.7% 0.71 / 0.65 / +7.7%
tpch_q12/datafusion:parquet 407270794 / 446636776 / -8.8% 527900827 / 558053616 / -5.4% 0.77 / 0.80 / -3.6%
tpch_q13/datafusion:parquet 431930831 / 679340770 / -36.4% 🟢 800972362 / 822956978 / -2.7% 0.54 / 0.83 / -34.7%
tpch_q14/datafusion:parquet 413528285 / 422542236 / -2.1% 529934402 / 608441828 / -12.9% 0.78 / 0.69 / +12.4%
tpch_q15/datafusion:parquet 505044243 / 590128238 / -14.4% 697624336 / 811273609 / -14.0% 0.72 / 0.73 / -0.5%
tpch_q16/datafusion:parquet 213882340 / 232834783 / -8.1% 489476635 / 555554412 / -11.9% 0.44 / 0.42 / +4.3%
tpch_q17/datafusion:parquet 740869119 / 629771513 / +17.6% 924016095 / 878783372 / +5.1% 0.80 / 0.72 / +11.9%
tpch_q18/datafusion:parquet 693527410 / 805604257 / -13.9% 841009585 / 770919088 / +9.1% 0.82 / 1.04 / -21.1%
tpch_q19/datafusion:parquet 446818413 / 448313325 / -0.3% 632502134 / 533286009 / +18.6% 0.71 / 0.84 / -16.0%
tpch_q20/datafusion:parquet 701233453 / 708355447 / -1.0% 764210246 / 903046801 / -15.4% 0.92 / 0.78 / +17.0%
tpch_q21/datafusion:parquet 965744286 / 1321892854 / -26.9% 1197081514 / 1399104649 / -14.4% 0.81 / 0.94 / -14.6%
tpch_q22/datafusion:parquet 536044946 / 512939660 / +4.5% 723067609 / 1069992614 / -32.4% 🟢 0.74 / 0.48 / +54.6%
duckdb / vortex-compact / ns (0.892x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 897460710 / 1173191402 / -23.5% 1029528125 / 2406959337 / -57.2% 🟢 0.87 / 0.49 / +78.8%
tpch_q02/duckdb:vortex-compact 485310251 / 626601743 / -22.5% 556328983 / 872838038 / -36.3% 🟢 0.87 / 0.72 / +21.5%
tpch_q03/duckdb:vortex-compact 1090228108 / 1244170150 / -12.4% 1134419841 / 2007404480 / -43.5% 🟢 0.96 / 0.62 / +55.1%
tpch_q04/duckdb:vortex-compact 731060604 / 900003652 / -18.8% 862414855 / 1105099546 / -22.0% 0.85 / 0.81 / +4.1%
tpch_q05/duckdb:vortex-compact 1105368176 / 1216231505 / -9.1% 1091133877 / 1614414529 / -32.4% 🟢 1.01 / 0.75 / +34.5%
tpch_q06/duckdb:vortex-compact 1252496190 / 1241827010 / +0.9% 1262369918 / 1299392692 / -2.8% 0.99 / 0.96 / +3.8%
tpch_q07/duckdb:vortex-compact 1507744824 / 1661650367 / -9.3% 1560980551 / 1732918763 / -9.9% 0.97 / 0.96 / +0.7%
tpch_q08/duckdb:vortex-compact 1418477926 / 1552569892 / -8.6% 1485881639 / 1708208786 / -13.0% 0.95 / 0.91 / +5.0%
tpch_q09/duckdb:vortex-compact 1799410194 / 2086279345 / -13.8% 1718355427 / 2406865068 / -28.6% 1.05 / 0.87 / +20.8%
tpch_q10/duckdb:vortex-compact 1452444518 / 1624529555 / -10.6% 1621023974 / 1861788301 / -12.9% 0.90 / 0.87 / +2.7%
tpch_q11/duckdb:vortex-compact 494442494 / 496667359 / -0.4% 613229898 / 748501613 / -18.1% 0.81 / 0.66 / +21.5%
tpch_q12/duckdb:vortex-compact 1978029268 / 2241534057 / -11.8% 2074759519 / 2500633034 / -17.0% 0.95 / 0.90 / +6.4%
tpch_q13/duckdb:vortex-compact 1133789840 / 1164242910 / -2.6% 1554554904 / 1551085529 / +0.2% 0.73 / 0.75 / -2.8%
tpch_q14/duckdb:vortex-compact 807469893 / 987805297 / -18.3% 883318282 / 1144354538 / -22.8% 0.91 / 0.86 / +5.9%
tpch_q15/duckdb:vortex-compact 903920718 / 962094383 / -6.0% 1148433614 / 1109955657 / +3.5% 0.79 / 0.87 / -9.2%
tpch_q16/duckdb:vortex-compact 224790923 / 272718201 / -17.6% 294487642 / 313771850 / -6.1% 0.76 / 0.87 / -12.2%
tpch_q17/duckdb:vortex-compact 1347038258 / 1600448666 / -15.8% 1426089397 / 1915721032 / -25.6% 0.94 / 0.84 / +13.1%
tpch_q18/duckdb:vortex-compact 1527414174 / 1294935020 / +18.0% 1261291089 / 1414280514 / -10.8% 1.21 / 0.92 / +32.3%
tpch_q19/duckdb:vortex-compact 1117409349 / 1334181127 / -16.2% 1151454838 / 1822513127 / -36.8% 🟢 0.97 / 0.73 / +32.6%
tpch_q20/duckdb:vortex-compact 1614999207 / 2038723670 / -20.8% 1717177356 / 2775898343 / -38.1% 🟢 0.94 / 0.73 / +28.1%
tpch_q21/duckdb:vortex-compact 2330582950 / 2454729502 / -5.1% 2397228554 / 2613226220 / -8.3% 0.97 / 0.94 / +3.5%
tpch_q22/duckdb:vortex-compact 469297503 / 488467511 / -3.9% 584752510 / 682215069 / -14.3% 0.80 / 0.72 / +12.1%
duckdb / parquet / ns (0.962x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 348227448 / 351965878 / -1.1% 362222179 / 399452687 / -9.3% 0.96 / 0.88 / +9.1%
tpch_q02/duckdb:parquet 685336756 / 739296749 / -7.3% 786716081 / 1059373070 / -25.7% 0.87 / 0.70 / +24.8%
tpch_q03/duckdb:parquet 1010766819 / 988577577 / +2.2% 1167057200 / 1470126183 / -20.6% 0.87 / 0.67 / +28.8%
tpch_q04/duckdb:parquet 546266120 / 547035034 / -0.1% 781167760 / 635624365 / +22.9% 0.70 / 0.86 / -18.7%
tpch_q05/duckdb:parquet 1059054433 / 1091701524 / -3.0% 1179185424 / 1289225025 / -8.5% 0.90 / 0.85 / +6.1%
tpch_q06/duckdb:parquet 410300250 / 358882831 / +14.3% 398131357 / 381399149 / +4.4% 1.03 / 0.94 / +9.5%
tpch_q07/duckdb:parquet 925974703 / 948402151 / -2.4% 821610289 / 838251360 / -2.0% 1.13 / 1.13 / -0.4%
tpch_q08/duckdb:parquet 1245347110 / 1194916231 / +4.2% 1287989389 / 1211327610 / +6.3% 0.97 / 0.99 / -2.0%
tpch_q09/duckdb:parquet 1059916713 / 1178486243 / -10.1% 1163067807 / 1195716439 / -2.7% 0.91 / 0.99 / -7.5%
tpch_q10/duckdb:parquet 1842485092 / 1797200857 / +2.5% 1988623735 / 2325496020 / -14.5% 0.93 / 0.77 / +19.9%
tpch_q11/duckdb:parquet 456207068 / 475602131 / -4.1% 488959996 / 544136157 / -10.1% 0.93 / 0.87 / +6.7%
tpch_q12/duckdb:parquet 608325693 / 595687504 / +2.1% 985297264 / 689238664 / +43.0% 🔴 0.62 / 0.86 / -28.6%
tpch_q13/duckdb:parquet 764780598 / 841871907 / -9.2% 1051266734 / 1044766747 / +0.6% 0.73 / 0.81 / -9.7%
tpch_q14/duckdb:parquet 536445781 / 742627896 / -27.8% 602332640 / 921141576 / -34.6% 🟢 0.89 / 0.81 / +10.5%
tpch_q15/duckdb:parquet 505437864 / 420072888 / +20.3% 566921587 / 407750897 / +39.0% 🔴 0.89 / 1.03 / -13.5%
tpch_q16/duckdb:parquet 562225065 / 626312514 / -10.2% 635811227 / 658173904 / -3.4% 0.88 / 0.95 / -7.1%
tpch_q17/duckdb:parquet 561017721 / 601800645 / -6.8% 550214709 / 667512974 / -17.6% 1.02 / 0.90 / +13.1%
tpch_q18/duckdb:parquet 710170148 / 694077628 / +2.3% 643173544 / 651295095 / -1.2% 1.10 / 1.07 / +3.6%
tpch_q19/duckdb:parquet 701996060 / 723982994 / -3.0% 798998017 / 734323508 / +8.8% 0.88 / 0.99 / -10.9%
tpch_q20/duckdb:parquet 975009943 / 1227308125 / -20.6% 984745299 / 1074383859 / -8.3% 0.99 / 1.14 / -13.3%
tpch_q21/duckdb:parquet 872474345 / 1022162048 / -14.6% 801706841 / 989396075 / -19.0% 1.09 / 1.03 / +5.3%
tpch_q22/duckdb:parquet 717107985 / 712417102 / +0.7% 825920049 / 875865572 / -5.7% 0.87 / 0.81 / +6.7%

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 1bd8d278 vs base 2b4c6822
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: random-access No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.984x ➖
Parquet (geomean): hot 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.002x ➖, 1↑ 1↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 73253 / 73710 / -0.6%
random-access/arrow-tokio-local-disk-footer 166372 / 167029 / -0.4%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1846051 / 2238740 / -17.5% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 3642330 / 3518850 / +3.5%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 55490650 / 32661099 / +69.9% 🔴
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 33385488 / 33075604 / +0.9%
random-access/nested-lists/correlated/arrow-tokio-local-disk 58668 / 61838 / -5.1%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 105688 / 103737 / +1.9%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1116930 / 1107450 / +0.9%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1162328 / 1180118 / -1.5%
random-access/nested-structs/correlated/arrow-tokio-local-disk 52285 / 57148 / -8.5%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 93972 / 95304 / -1.4%
random-access/nested-structs/uniform/arrow-tokio-local-disk 916128 / 957627 / -4.3%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 924767 / 989456 / -6.5%
random-access/taxi/correlated/arrow-tokio-local-disk 126609 / 124242 / +1.9%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 221698 / 223532 / -0.8%
random-access/taxi/uniform/arrow-tokio-local-disk 2767884 / 2870356 / -3.6%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2927667 / 3113518 / -6.0%
random-access / vortex-file-compressed / ns (0.984x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 246409 / 244264 / +0.9%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1223702 / 1229933 / -0.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1457856 / 1456665 / +0.1%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2627184 / 2679754 / -2.0%
random-access/nested-lists/correlated/vortex-tokio-local-disk 203634 / 215801 / -5.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 363630 / 370250 / -1.8%
random-access/nested-lists/uniform/vortex-tokio-local-disk 714448 / 711254 / +0.4%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 989029 / 997277 / -0.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk 275349 / 292320 / -5.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 527315 / 534226 / -1.3%
random-access/nested-structs/uniform/vortex-tokio-local-disk 592322 / 636995 / -7.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 943536 / 937119 / +0.7%
random-access/taxi/correlated/vortex-tokio-local-disk 663091 / 664550 / -0.2%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1439379 / 1451012 / -0.8%
random-access/taxi/uniform/vortex-tokio-local-disk 2632397 / 2634408 / -0.1%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3821775 / 3866636 / -1.2%
random-access/vortex-tokio-local-disk 444222 / 456378 / -2.7%
random-access/vortex-tokio-local-disk-footer 1070474 / 1070121 / +0.0%
random-access / parquet / ns (0.997x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107168215598 / 107898331948 / -0.7%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 107927261406 / 108065504624 / -0.1%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 107183976976 / 107802980466 / -0.6%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 108269870696 / 107853072926 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk 145743767 / 147413184 / -1.1%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 145760657 / 145983581 / -0.2%
random-access/nested-lists/uniform/parquet-tokio-local-disk 147800406 / 145716124 / +1.4%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 144732351 / 148404879 / -2.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44997571 / 45485311 / -1.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 45123092 / 45637463 / -1.1%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44959033 / 44967649 / -0.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 45099076 / 45551008 / -1.0%
random-access/parquet-tokio-local-disk 120136500 / 118905687 / +1.0%
random-access/parquet-tokio-local-disk-footer 121315331 / 121534866 / -0.2%
random-access/taxi/correlated/parquet-tokio-local-disk 179982144 / 178348152 / +0.9%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 182098213 / 182430385 / -0.2%
random-access/taxi/uniform/parquet-tokio-local-disk 187369098 / 192379355 / -2.6%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 192677451 / 188276917 / +2.3%
random-access / lance / ns (0.993x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 292271 / 297581 / -1.8%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1272939 / 1303304 / -2.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1052496 / 1050233 / +0.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1989139 / 2035243 / -2.3%
random-access/lance-tokio-local-disk 529606 / 535542 / -1.1%
random-access/lance-tokio-local-disk-footer 1468683 / 1508714 / -2.7%
random-access/nested-lists/correlated/lance-tokio-local-disk 158128 / 156742 / +0.9%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 735036 / 750320 / -2.0%
random-access/nested-lists/uniform/lance-tokio-local-disk 861794 / 853187 / +1.0%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1438120 / 1450623 / -0.9%
random-access/nested-structs/correlated/lance-tokio-local-disk 268499 / 269889 / -0.5%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 643582 / 658950 / -2.3%
random-access/nested-structs/uniform/lance-tokio-local-disk 2248095 / 2245149 / +0.1%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2686547 / 2591823 / +3.7%
random-access/taxi/correlated/lance-tokio-local-disk 749060 / 757895 / -1.2%
random-access/taxi/correlated/lance-tokio-local-disk-footer 2032616 / 2082411 / -2.4%
random-access/taxi/uniform/lance-tokio-local-disk 8186835 / 8000368 / +2.3%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8935707 / 8994592 / -0.7%

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 1bd8d278 vs base 30e84dcc
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.5%
Engines: random-access No clear signal (+5.5%, low confidence)
Vortex (geomean): hot 1.040x ➖
Parquet (geomean): hot 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.040x ➖, 0↑ 2↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 46308639 / 46163313 / +0.3%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 126637513 / 111762573 / +13.3%
random-access/feature-vectors/uniform/vortex-tokio-s3 118675786 / 82575486 / +43.7% 🔴
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 196778054 / 151886741 / +29.6%
random-access/nested-lists/correlated/vortex-tokio-s3 54237212 / 40984817 / +32.3% 🔴
random-access/nested-lists/correlated/vortex-tokio-s3-footer 85743136 / 82896579 / +3.4%
random-access/nested-lists/uniform/vortex-tokio-s3 161112901 / 160157205 / +0.6%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 205367170 / 201827989 / +1.8%
random-access/nested-structs/correlated/vortex-tokio-s3 56530681 / 64856948 / -12.8%
random-access/nested-structs/correlated/vortex-tokio-s3-footer 119409048 / 107533547 / +11.0%
random-access/nested-structs/uniform/vortex-tokio-s3 175317493 / 171191873 / +2.4%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 210799134 / 210829936 / -0.0%
random-access/taxi/correlated/vortex-tokio-s3 75168443 / 99806808 / -24.7%
random-access/taxi/correlated/vortex-tokio-s3-footer 136013825 / 135964108 / +0.0%
random-access/taxi/uniform/vortex-tokio-s3 174954921 / 176341872 / -0.8%
random-access/taxi/uniform/vortex-tokio-s3-footer 226213283 / 216946448 / +4.3%
random-access/vortex-tokio-s3 45838753 / 49370461 / -7.2%
random-access/vortex-tokio-s3-footer 92839183 / 97482847 / -4.8%
random-access / parquet / ns (0.986x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 168929580640 / 176359929848 / -4.2%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 177188982351 / 175666684443 / +0.9%
random-access/feature-vectors/uniform/parquet-tokio-s3 177719009272 / 163831650641 / +8.5%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 173427313412 / 199511227915 / -13.1%
random-access/nested-lists/correlated/parquet-tokio-s3 1027777841 / 1036044327 / -0.8%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1108699934 / 1153524296 / -3.9%
random-access/nested-lists/uniform/parquet-tokio-s3 1019231611 / 1030682933 / -1.1%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1117572543 / 1106660945 / +1.0%
random-access/nested-structs/correlated/parquet-tokio-s3 452260079 / 453464506 / -0.3%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 533215691 / 530144179 / +0.6%
random-access/nested-structs/uniform/parquet-tokio-s3 452114496 / 453689011 / -0.3%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 530242051 / 536236024 / -1.1%
random-access/parquet-tokio-s3 478809600 / 483653216 / -1.0%
random-access/parquet-tokio-s3-footer 535057724 / 531487127 / +0.7%
random-access/taxi/correlated/parquet-tokio-s3 717242939 / 737561648 / -2.8%
random-access/taxi/correlated/parquet-tokio-s3-footer 767903893 / 792520826 / -3.1%
random-access/taxi/uniform/parquet-tokio-s3 772465897 / 792722626 / -2.6%
random-access/taxi/uniform/parquet-tokio-s3-footer 822521518 / 839184408 / -2.0%
random-access / lance / ns (1.096x ➖, 0↑ 2↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 51487756 / 37470861 / +37.4% 🔴
random-access/feature-vectors/correlated/lance-tokio-s3-footer 245765377 / 193760146 / +26.8%
random-access/feature-vectors/uniform/lance-tokio-s3 97384377 / 81436461 / +19.6%
random-access/feature-vectors/uniform/lance-tokio-s3-footer 259998055 / 214349437 / +21.3%
random-access/lance-tokio-s3 50731299 / 54924261 / -7.6%
random-access/lance-tokio-s3-footer 241065462 / 251248609 / -4.1%
random-access/nested-lists/correlated/lance-tokio-s3 45185872 / 33887704 / +33.3% 🔴
random-access/nested-lists/correlated/lance-tokio-s3-footer 242581674 / 209327472 / +15.9%
random-access/nested-lists/uniform/lance-tokio-s3 92501788 / 71275574 / +29.8%
random-access/nested-lists/uniform/lance-tokio-s3-footer 284787546 / 255324443 / +11.5%
random-access/nested-structs/correlated/lance-tokio-s3 53237553 / 44939744 / +18.5%
random-access/nested-structs/correlated/lance-tokio-s3-footer 248009038 / 216526340 / +14.5%
random-access/nested-structs/uniform/lance-tokio-s3 130939345 / 104620541 / +25.2%
random-access/nested-structs/uniform/lance-tokio-s3-footer 329449957 / 269095307 / +22.4%
random-access/taxi/correlated/lance-tokio-s3 62720933 / 68043518 / -7.8%
random-access/taxi/correlated/lance-tokio-s3-footer 224030203 / 280376633 / -20.1%
random-access/taxi/uniform/lance-tokio-s3 221667613 / 298905814 / -25.8%
random-access/taxi/uniform/lance-tokio-s3-footer 489109535 / 533983628 / -8.4%

claude added 3 commits October 9, 2026 15:22
Vortex scans now accept DataFusion's dynamic filters, so every probe-side
scan under a hash join or TopK shows them in EXPLAIN output. Regenerated
with `--complete` and the byte ranges replaced per the README.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
Same regeneration as the TPC-DS plans: probe-side scans under hash joins
and TopK now show DataFusion's dynamic filters in EXPLAIN output.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL
SearchSortedPrimitiveArray read every element with a one-shot scalar
probe, so an encoding that must decode a block to serve a single element
paid that decode on every step of the binary search. RunEnd slicing
searches its ends this way, and with Pco-compressed ends each search
decoded the same Pco page about log2(n) times. A dynamic filter that
re-slices those arrays per batch made this dominate TPC-DS on the compact
file variant: q96 spent 69% of worker CPU there.

Hold a RepeatedArrayProbe for the search instead, so the encoding's probe
state (Pco's decoded page) is built once per search.

DCO Remediation Commit for Claude <noreply@anthropic.com>

I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: e9e1ae8
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 89de46e
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 9651809
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: e61228c
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: e745df0
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: a831e08
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 1946187
I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 8d19c9c

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL

Copy link
Copy Markdown
Contributor Author

The CodSpeed Performance Analysis check on c676f03 failed with CodSpeed's own internal error ("Unable to generate the performance report"), not a benchmark regression. Every CodSpeed benchmark job on that commit finished successfully, and the same check passed on the previous head. No fix applies from this PR. The next code push will re-run it.


Generated by Claude Code

Each comparison in a filter expression decodes its column on its own, so
`col >= a AND col <= b` decoded the column twice before the scan decoded
it again for output. Counted on a Pco column: two decodes for the range,
one for `between`.

Emit a single `between` for a lower and upper bound, and when a membership
list applies, emit the list alone: its values already lie within the
bounds.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XGkjCDMVSGtEWhEHHW5wGL

Copy link
Copy Markdown
Contributor Author

CodSpeed Performance Analysis on c676f03 flags one regression: bitpack_blocked_compress_avx2 (WallTime, 6.7 µs → 7.6 µs). I don't think it comes from this PR:

  • The PR doesn't touch encodings/fastlanes, and that benchmark doesn't call sorted search or list_contains.
  • It's a WallTime measurement on a hosted runner, which CodSpeed's own report flags as inconsistent. Two other WallTime microbenchmarks (compare_u8_neon, add_i64_nullable_neon) moved about 10% the other way in the same run.

No fix applies here. The changes this PR does cause are improvements: list_contains_set i64_random[256] is 16x faster and i64_random_chunked[256] is 20x faster.


Generated by Claude Code

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants