Skip to content

Resolve page-cached segments in place with preadv2(RWF_NOWAIT), skipping IO coalescing - #10355

Closed
joseph-isaacs wants to merge 1 commit into
developfrom
ji/practical-hypatia-n2wj5k
Closed

joseph-isaacs wants to merge 1 commit into
developfrom
ji/practical-hypatia-n2wj5k

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Local files currently rely on an in-memory Moka segment cache (in the Python bindings) to avoid re-reading segments. This PR instead leans on the OS page cache, resolving cached segments synchronously at request time.

PageCacheSegmentSource is the outermost segment source for files opened with open_path. Each request(id) first issues a non-blocking preadv2(RWF_NOWAIT) of the segment's byte range on the calling thread. If every byte is resident it returns a ready future, never touching:

  • the SegmentCacheSourceAdapter / InstrumentedSegmentCache async lookups,
  • the SharedSegmentSource in-flight DashMap,
  • the FileSegmentSource coalescing read driver (event channel, Mutex-guarded driver state),
  • the blocking thread pool.

On a miss the request is forwarded unchanged to the existing stack, whose read also populates the page cache.

Changes

  • vortex-io: add std_file::try_read_exact_at_cached, which loops preadv2(..., RWF_NOWAIT) until the buffer is full. EAGAIN, EOPNOTSUPP/EINVAL and EOF are treated as a miss; EINTR retries. Always a miss on non-Linux platforms. Adds a Linux-only rustix dependency. Expose FileReadAt::file().
  • vortex-file: add segments::PageCacheSegmentSource (file + segment specs + allocator + fallback source).
  • VortexOpenOptions::open_path wraps the assembled segment source in PageCacheSegmentSource unless a cache was configured via with_segment_cache. open_read is unchanged and delegates to a private open_read_wrapping_source.
  • vortex-python: the 256 MiB Moka cache is now only used for object stores; local paths use the page cache.

Trade-offs:

  • A cold request costs one extra EAGAIN syscall per segment before it joins the coalescing path.
  • Cached hits are read one segment at a time with the copy done on the requesting thread, and are eager: a request that is later dropped still pays for the copy.
  • Page-cache hits bypass InstrumentedSegmentCache, so vortex.file.segments.cache.* metrics no longer count them, and footer-read segments are re-copied from the page cache rather than served from the initial-read map.

Tested with a new Linux-only unit test, serves_resident_segments_and_forwards_misses, covering a resident read, alignment, and forwarding of a range past EOF to the fallback source.

🤖 Generated with Claude Code

https://claude.ai/code/session_01PHeout6F88LHmMuW8B7kq5

…AIT)

Add PageCacheSegmentCache, a SegmentCache that tries a non-blocking
positional read of a segment's byte range. If the bytes are resident in
the page cache the segment is returned straight from the calling task,
skipping the coalescing read driver and the blocking thread pool;
otherwise it is a miss and the regular read path fetches it. Stores are
no-ops because the OS owns eviction.

open_path now uses it by default when no segment cache is configured.
The Python bindings keep the Moka cache only for object stores.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PHeout6F88LHmMuW8B7kq5
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Oct 7, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions

github-actions Bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done e1111f9 random-access-bench 1 Explore Profiling Data
🟢 Done e1111f9 statpopgen 1 Explore Profiling Data
🟢 Done e1111f9 compress-bench 1 Explore Profiling Data
🟢 Done e1111f9 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e1111f9 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done e1111f9 string-bench 1 Explore Profiling Data
🟢 Done e1111f9 tpch-s3-10 1 Explore Profiling Data
🟢 Done e1111f9 tpcds-nvme 1 Explore Profiling Data
🟢 Done e1111f9 clickbench-nvme 1 Explore Profiling Data
🟢 Done e1111f9 fineweb-s3 1 Explore Profiling Data
🟢 Done e1111f9 appian-nvme 1 Explore Profiling Data
🟢 Done e1111f9 fineweb 1 Explore Profiling Data
🟢 Done e1111f9 polarsignals 1 Explore Profiling Data
🟢 Done e1111f9 tpch-s3 1 Explore Profiling Data
🟢 Done e1111f9 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR e1111f9c vs base 9eb20ba0
Vortex (geomean): hot 0.987x ➖ · cold 1.025x ➖


datafusion / vortex-file-compressed / ns (0.987x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57007197 / 57222864 / -0.4% 103694072 / 104842590 / -1.1% 0.55 / 0.55 / +0.7%
polarsignals_q01/datafusion:vortex-file-compressed 63455216 / 63246726 / +0.3% 130760753 / 129606754 / +0.9% 0.49 / 0.49 / -0.6%
polarsignals_q02/datafusion:vortex-file-compressed 71418286 / 71631605 / -0.3% 114350012 / 112383095 / +1.8% 0.62 / 0.64 / -2.0%
polarsignals_q03/datafusion:vortex-file-compressed 79792432 / 79512498 / +0.4% 139584663 / 143518183 / -2.7% 0.57 / 0.55 / +3.2%
polarsignals_q04/datafusion:vortex-file-compressed 9453232 / 9567134 / -1.2% 53660512 / 50921374 / +5.4% 0.18 / 0.19 / -6.2%
polarsignals_q05/datafusion:vortex-file-compressed 24149782 / 24475040 / -1.3% 70282208 / 67389970 / +4.3% 0.34 / 0.36 / -5.4%
polarsignals_q06/datafusion:vortex-file-compressed 21125500 / 22533736 / -6.2% 68924924 / 63735561 / +8.1% 0.31 / 0.35 / -13.3%
polarsignals_q07/datafusion:vortex-file-compressed 39421136 / 39617288 / -0.5% 84621269 / 80432485 / +5.2% 0.47 / 0.49 / -5.4%
polarsignals_q08/datafusion:vortex-file-compressed 98385202 / 98264744 / +0.1% 168138495 / 168371934 / -0.1% 0.59 / 0.58 / +0.3%
polarsignals_q09/datafusion:vortex-file-compressed 9981520 / 10394784 / -4.0% 53306834 / 51359572 / +3.8% 0.19 / 0.20 / -7.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+6.4%, low confidence)
Vortex (geomean): hot 1.028x ➖ · cold 1.016x ➖
Parquet (geomean): hot 0.993x ➖ · cold 1.046x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6829094 / 6757658 / +1.1% 19998488 / 19494429 / +2.6% 0.34 / 0.35 / -1.5%
fineweb_q01/datafusion:vortex-file-compressed 13122539 / 11568634 / +13.4% 🔴 44062359 / 44814806 / -1.7% 0.30 / 0.26 / +15.4%
fineweb_q02/datafusion:vortex-file-compressed 13101036 / 13228160 / -1.0% 49429923 / 50943477 / -3.0% 0.27 / 0.26 / +2.1%
fineweb_q03/datafusion:vortex-file-compressed 21749908 / 21565186 / +0.9% 107736635 / 106022332 / +1.6% 0.20 / 0.20 / -0.7%
fineweb_q04/datafusion:vortex-file-compressed 82450775 / 81308662 / +1.4% 166024599 / 160127891 / +3.7% 0.50 / 0.51 / -2.2%
fineweb_q05/datafusion:vortex-file-compressed 67990674 / 67229479 / +1.1% 143655836 / 147196060 / -2.4% 0.47 / 0.46 / +3.6%
fineweb_q06/datafusion:vortex-file-compressed 20437862 / 20596226 / -0.8% 109888642 / 104334026 / +5.3% 0.19 / 0.20 / -5.8%
fineweb_q07/datafusion:vortex-file-compressed 19907180 / 18510111 / +7.5% 105941484 / 100720159 / +5.2% 0.19 / 0.18 / +2.2%
fineweb_q08/datafusion:vortex-file-compressed 9355066 / 9448896 / -1.0% 40992863 / 46880986 / -12.6% 🟢 0.23 / 0.20 / +13.2%
datafusion / vortex-compact / ns (0.994x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7145259 / 6904684 / +3.5% 20654574 / 19071773 / +8.3% 0.35 / 0.36 / -4.4%
fineweb_q01/datafusion:vortex-compact 60278186 / 44783591 / +34.6% 🔴 77551421 / 76168122 / +1.8% 0.78 / 0.59 / +32.2%
fineweb_q02/datafusion:vortex-compact 43983160 / 61023542 / -27.9% 🟢 78608390 / 79083046 / -0.6% 0.56 / 0.77 / -27.5%
fineweb_q03/datafusion:vortex-compact 166372660 / 157690274 / +5.5% 222816072 / 224440093 / -0.7% 0.75 / 0.70 / +6.3%
fineweb_q04/datafusion:vortex-compact 164195734 / 192417404 / -14.7% 🟢 252893490 / 241728180 / +4.6% 0.65 / 0.80 / -18.4%
fineweb_q05/datafusion:vortex-compact 156690213 / 154034192 / +1.7% 232795679 / 226044936 / +3.0% 0.67 / 0.68 / -1.2%
fineweb_q06/datafusion:vortex-compact 86940057 / 86802696 / +0.2% 162115766 / 161550263 / +0.4% 0.54 / 0.54 / -0.2%
fineweb_q07/datafusion:vortex-compact 88432570 / 88356356 / +0.1% 160738268 / 159689467 / +0.7% 0.55 / 0.55 / -0.6%
fineweb_q08/datafusion:vortex-compact 8806834 / 8572062 / +2.7% 38839281 / 43461134 / -10.6% 🟢 0.23 / 0.20 / +15.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9598220 / 9388347 / +2.2% 35387256 / 34825205 / +1.6% 0.27 / 0.27 / +0.6%
fineweb_q01/datafusion:parquet 75103249 / 74604340 / +0.7% 158580641 / 146451481 / +8.3% 0.47 / 0.51 / -7.0%
fineweb_q02/datafusion:parquet 75260727 / 74811340 / +0.6% 153611458 / 147826972 / +3.9% 0.49 / 0.51 / -3.2%
fineweb_q03/datafusion:parquet 74076080 / 75022152 / -1.3% 160527234 / 151030126 / +6.3% 0.46 / 0.50 / -7.1%
fineweb_q04/datafusion:parquet 83181594 / 83736832 / -0.7% 150720281 / 144704063 / +4.2% 0.55 / 0.58 / -4.6%
fineweb_q05/datafusion:parquet 80707090 / 81159526 / -0.6% 159555234 / 145513090 / +9.7% 0.51 / 0.56 / -9.3%
fineweb_q06/datafusion:parquet 74654519 / 76239838 / -2.1% 152715503 / 151518872 / +0.8% 0.49 / 0.50 / -2.8%
fineweb_q07/datafusion:parquet 74926065 / 73365638 / +2.1% 152370660 / 146838635 / +3.8% 0.49 / 0.50 / -1.6%
fineweb_q08/datafusion:parquet 74312838 / 73876496 / +0.6% 156798647 / 145676287 / +7.6% 0.47 / 0.51 / -6.5%
duckdb / vortex-file-compressed / ns (1.071x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2015887 / 2453526 / -17.8% 🟢 5057553 / 4677272 / +8.1% 0.40 / 0.52 / -24.0%
fineweb_q01/duckdb:vortex-file-compressed 25327156 / 18522072 / +36.7% 🔴 63742164 / 59650323 / +6.9% 0.40 / 0.31 / +28.0%
fineweb_q02/duckdb:vortex-file-compressed 19337879 / 20146048 / -4.0% 44974065 / 51447351 / -12.6% 🟢 0.43 / 0.39 / +9.8%
fineweb_q03/duckdb:vortex-file-compressed 37968804 / 29897223 / +27.0% 🔴 132985100 / 101340349 / +31.2% 🔴 0.29 / 0.30 / -3.2%
fineweb_q04/duckdb:vortex-file-compressed 78924257 / 79509073 / -0.7% 120321729 / 141774384 / -15.1% 🟢 0.66 / 0.56 / +17.0%
fineweb_q05/duckdb:vortex-file-compressed 67773962 / 69649736 / -2.7% 108297852 / 130306547 / -16.9% 🟢 0.63 / 0.53 / +17.1%
fineweb_q06/duckdb:vortex-file-compressed 44471722 / 36412012 / +22.1% 🔴 146400616 / 116848004 / +25.3% 🔴 0.30 / 0.31 / -2.5%
fineweb_q07/duckdb:vortex-file-compressed 34822010 / 27106654 / +28.5% 🔴 121194571 / 129254652 / -6.2% 0.29 / 0.21 / +37.0%
fineweb_q08/duckdb:vortex-file-compressed 6929155 / 7760633 / -10.7% 🟢 1547002 / 14906459 / +3.8% 0.45 / 0.52 / -14.0%
duckdb / vortex-compact / ns (1.023x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 3624970 / 2738676 / +32.4% 🔴 8036445 / 5005918 / +60.5% 🔴 0.45 / 0.55 / -17.6%
fineweb_q01/duckdb:vortex-compact 53983944 / 50596519 / +6.7% 97691348 / 96446459 / +1.3% 0.55 / 0.52 / +5.3%
fineweb_q02/duckdb:vortex-compact 50091413 / 50960204 / -1.7% 86235949 / 91202109 / -5.4% 0.58 / 0.56 / +4.0%
fineweb_q03/duckdb:vortex-compact 192790964 / 184373670 / +4.6% 243363966 / 323874531 / -24.9% 🟢 0.79 / 0.57 / +39.2%
fineweb_q04/duckdb:vortex-compact 219936492 / 187296047 / +17.4% 🔴 323690976 / 263213640 / +23.0% 🔴 0.68 / 0.71 / -4.5%
fineweb_q05/duckdb:vortex-compact 180419272 / 178375051 / +1.1% 324435391 / 217388606 / +49.2% 🔴 0.56 / 0.82 / -32.2%
fineweb_q06/duckdb:vortex-compact 95158469 / 105238800 / -9.6% 141650030 / 185366501 / -23.6% 🟢 0.67 / 0.57 / +18.3%
fineweb_q07/duckdb:vortex-compact 100235922 / 105282105 / -4.8% 176498897 / 161867712 / +9.0% 0.57 / 0.65 / -12.7%
fineweb_q08/duckdb:vortex-compact 6412940 / 7742180 / -17.2% 🟢 12195054 / 14400629 / -15.3% 🟢 0.53 / 0.54 / -2.2%
duckdb / parquet / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21448190 / 24501164 / -12.5% 🟢 26413722 / 24205749 / +9.1% 0.81 / 1.01 / -19.8%
fineweb_q01/duckdb:parquet 44672196 / 45017236 / -0.8% 55380321 / 52727524 / +5.0% 0.81 / 0.85 / -5.5%
fineweb_q02/duckdb:parquet 43966140 / 44647318 / -1.5% 55843707 / 52923417 / +5.5% 0.79 / 0.84 / -6.7%
fineweb_q03/duckdb:parquet 94815628 / 94648842 / +0.2% 177326117 / 175339172 / +1.1% 0.53 / 0.54 / -0.9%
fineweb_q04/duckdb:parquet 151496240 / 151993604 / -0.3% 205634534 / 208907003 / -1.6% 0.74 / 0.73 / +1.3%
fineweb_q05/duckdb:parquet 143103518 / 143421628 / -0.2% 192675570 / 193073089 / -0.2% 0.74 / 0.74 / -0.0%
fineweb_q06/duckdb:parquet 70659451 / 71680759 / -1.4% 124649146 / 126255738 / -1.3% 0.57 / 0.57 / -0.2%
fineweb_q07/duckdb:parquet 72223008 / 72229511 / -0.0% 163728540 / 152383250 / +7.4% 0.44 / 0.47 / -6.9%
fineweb_q08/duckdb:parquet 23829604 / 23083551 / +3.2% 27182075 / 24178199 / +12.4% 🔴 0.88 / 0.95 / -8.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.038x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16578588 / 16483047 / +0.6% 49548022 / 42846995 / +15.6% 🔴 0.33 / 0.38 / -13.0%
tpch_q02/datafusion:vortex-file-compressed 17340385 / 17288468 / +0.3% 36973989 / 35230210 / +4.9% 0.47 / 0.49 / -4.4%
tpch_q03/datafusion:vortex-file-compressed 19377875 / 19536336 / -0.8% 49365784 / 47342535 / +4.3% 0.39 / 0.41 / -4.9%
tpch_q04/datafusion:vortex-file-compressed 10264437 / 10218197 / +0.5% 36193194 / 31998018 / +13.1% 🔴 0.28 / 0.32 / -11.2%
tpch_q05/datafusion:vortex-file-compressed 37384511 / 36896934 / +1.3% 68114524 / 63897247 / +6.6% 0.55 / 0.58 / -5.0%
tpch_q06/datafusion:vortex-file-compressed 6379811 / 6063862 / +5.2% 33450668 / 28056475 / +19.2% 🔴 0.19 / 0.22 / -11.8%
tpch_q07/datafusion:vortex-file-compressed 51894547 / 51505651 / +0.8% 81116442 / 83179702 / -2.5% 0.64 / 0.62 / +3.3%
tpch_q08/datafusion:vortex-file-compressed 51470402 / 51342081 / +0.2% 82143522 / 82709546 / -0.7% 0.63 / 0.62 / +0.9%
tpch_q09/datafusion:vortex-file-compressed 49497233 / 49369935 / +0.3% 80906726 / 78008367 / +3.7% 0.61 / 0.63 / -3.3%
tpch_q10/datafusion:vortex-file-compressed 16988094 / 17213997 / -1.3% 51362185 / 49579456 / +3.6% 0.33 / 0.35 / -4.7%
tpch_q11/datafusion:vortex-file-compressed 15121445 / 15057819 / +0.4% 34753714 / 33470077 / +3.8% 0.44 / 0.45 / -3.3%
tpch_q12/datafusion:vortex-file-compressed 22559757 / 22811621 / -1.1% 47638294 / 47084948 / +1.2% 0.47 / 0.48 / -2.3%
tpch_q13/datafusion:vortex-file-compressed 20176809 / 19876179 / +1.5% 44599340 / 40237758 / +10.8% 🔴 0.45 / 0.49 / -8.4%
tpch_q14/datafusion:vortex-file-compressed 14641404 / 14877215 / -1.6% 41342179 / 40345707 / +2.5% 0.35 / 0.37 / -4.0%
tpch_q15/datafusion:vortex-file-compressed 18481241 / 18539233 / -0.3% 47470897 / 45818991 / +3.6% 0.39 / 0.40 / -3.8%
tpch_q16/datafusion:vortex-file-compressed 18831911 / 18566490 / +1.4% 37705916 / 37620701 / +0.2% 0.50 / 0.49 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 28213763 / 28282036 / -0.2% 57276092 / 56148529 / +2.0% 0.49 / 0.50 / -2.2%
tpch_q18/datafusion:vortex-file-compressed 37140283 / 37045210 / +0.3% 59126551 / 58758235 / +0.6% 0.63 / 0.63 / -0.4%
tpch_q19/datafusion:vortex-file-compressed 13421669 / 13611848 / -1.4% 41435819 / 37761351 / +9.7% 0.32 / 0.36 / -10.1%
tpch_q20/datafusion:vortex-file-compressed 20725994 / 20685681 / +0.2% 48002975 / 44769051 / +7.2% 0.43 / 0.46 / -6.6%
tpch_q21/datafusion:vortex-file-compressed 38946794 / 39418313 / -1.2% 68192056 / 67821363 / +0.5% 0.57 / 0.58 / -1.7%
tpch_q22/datafusion:vortex-file-compressed 11225868 / 11357161 / -1.2% 32959572 / 32132722 / +2.6% 0.34 / 0.35 / -3.6%
datafusion / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18372675 / 17689161 / +3.9% 45829457 / 42851308 / +6.9% 0.40 / 0.41 / -2.9%
tpch_q02/datafusion:vortex-compact 19864292 / 19694079 / +0.9% 38680735 / 37087774 / +4.3% 0.51 / 0.53 / -3.3%
tpch_q03/datafusion:vortex-compact 20213916 / 20061650 / +0.8% 49117329 / 46833859 / +4.9% 0.41 / 0.43 / -3.9%
tpch_q04/datafusion:vortex-compact 11654980 / 11819861 / -1.4% 33382729 / 30729108 / +8.6% 0.35 / 0.38 / -9.2%
tpch_q05/datafusion:vortex-compact 37654202 / 38351458 / -1.8% 66055629 / 64079476 / +3.1% 0.57 / 0.60 / -4.8%
tpch_q06/datafusion:vortex-compact 6741425 / 6870297 / -1.9% 30210545 / 28417351 / +6.3% 0.22 / 0.24 / -7.7%
tpch_q07/datafusion:vortex-compact 52444489 / 52504064 / -0.1% 75289448 / 78871559 / -4.5% 0.70 / 0.67 / +4.6%
tpch_q08/datafusion:vortex-compact 53202598 / 52843723 / +0.7% 84132260 / 82781910 / +1.6% 0.63 / 0.64 / -0.9%
tpch_q09/datafusion:vortex-compact 50723207 / 50918072 / -0.4% 80168293 / 81247544 / -1.3% 0.63 / 0.63 / +1.0%
tpch_q10/datafusion:vortex-compact 18826545 / 19237282 / -2.1% 49752662 / 47091360 / +5.7% 0.38 / 0.41 / -7.4%
tpch_q11/datafusion:vortex-compact 16107111 / 16365497 / -1.6% 34339949 / 34246826 / +0.3% 0.47 / 0.48 / -1.8%
tpch_q12/datafusion:vortex-compact 23868773 / 24719582 / -3.4% 48376200 / 42645457 / +13.4% 🔴 0.49 / 0.58 / -14.9%
tpch_q13/datafusion:vortex-compact 20846463 / 20719942 / +0.6% 39828804 / 39012669 / +2.1% 0.52 / 0.53 / -1.5%
tpch_q14/datafusion:vortex-compact 16155832 / 16464838 / -1.9% 44824298 / 41440633 / +8.2% 0.36 / 0.40 / -9.3%
tpch_q15/datafusion:vortex-compact 19742904 / 19994870 / -1.3% 48384274 / 46138966 / +4.9% 0.41 / 0.43 / -5.8%
tpch_q16/datafusion:vortex-compact 19232301 / 19147132 / +0.4% 38002477 / 38731142 / -1.9% 0.51 / 0.49 / +2.4%
tpch_q17/datafusion:vortex-compact 28308743 / 29145209 / -2.9% 59819694 / 57775903 / +3.5% 0.47 / 0.50 / -6.2%
tpch_q18/datafusion:vortex-compact 38181673 / 37899857 / +0.7% 59320605 / 57586079 / +3.0% 0.64 / 0.66 / -2.2%
tpch_q19/datafusion:vortex-compact 16505304 / 16804839 / -1.8% 42686489 / 40304119 / +5.9% 0.39 / 0.42 / -7.3%
tpch_q20/datafusion:vortex-compact 21976854 / 21990934 / -0.1% 46480457 / 44793540 / +3.8% 0.47 / 0.49 / -3.7%
tpch_q21/datafusion:vortex-compact 41977409 / 42009859 / -0.1% 67256170 / 67805333 / -0.8% 0.62 / 0.62 / +0.7%
tpch_q22/datafusion:vortex-compact 11683319 / 11416834 / +2.3% 32503284 / 31253275 / +4.0% 0.36 / 0.37 / -1.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72199541 / 72331278 / -0.2% 92274255 / 89362408 / +3.3% 0.78 / 0.81 / -3.3%
tpch_q02/datafusion:parquet 56936528 / 57466167 / -0.9% 78645492 / 76553633 / +2.7% 0.72 / 0.75 / -3.6%
tpch_q03/datafusion:parquet 84681056 / 84709224 / -0.0% 110322151 / 107048255 / +3.1% 0.77 / 0.79 / -3.0%
tpch_q04/datafusion:parquet 46511042 / 46625258 / -0.2% 70909397 / 63314791 / +12.0% 🔴 0.66 / 0.74 / -10.9%
tpch_q05/datafusion:parquet 99618013 / 99802142 / -0.2% 132055550 / 128802534 / +2.5% 0.75 / 0.77 / -2.6%
tpch_q06/datafusion:parquet 31950806 / 31963109 / -0.0% 54409449 / 50367741 / +8.0% 0.59 / 0.63 / -7.5%
tpch_q07/datafusion:parquet 105220280 / 104298747 / +0.9% 137515386 / 137734234 / -0.2% 0.77 / 0.76 / +1.0%
tpch_q08/datafusion:parquet 113440781 / 112102740 / +1.2% 140966139 / 139205017 / +1.3% 0.80 / 0.81 / -0.1%
tpch_q09/datafusion:parquet 130250513 / 130628521 / -0.3% 163540692 / 161748722 / +1.1% 0.80 / 0.81 / -1.4%
tpch_q10/datafusion:parquet 103705753 / 104484584 / -0.7% 136039359 / 135328134 / +0.5% 0.76 / 0.77 / -1.3%
tpch_q11/datafusion:parquet 41623360 / 42057075 / -1.0% 67158925 / 64864599 / +3.5% 0.62 / 0.65 / -4.4%
tpch_q12/datafusion:parquet 69385416 / 68953733 / +0.6% 93355727 / 94332638 / -1.0% 0.74 / 0.73 / +1.7%
tpch_q13/datafusion:parquet 187116403 / 186955940 / +0.1% 212201689 / 207864993 / +2.1% 0.88 / 0.90 / -2.0%
tpch_q14/datafusion:parquet 47780930 / 47995867 / -0.4% 76676126 / 73177752 / +4.8% 0.62 / 0.66 / -5.0%
tpch_q15/datafusion:parquet 54102937 / 54275274 / -0.3% 77262912 / 74469658 / +3.8% 0.70 / 0.73 / -3.9%
tpch_q16/datafusion:parquet 41248956 / 41346672 / -0.2% 60463492 / 59844892 / +1.0% 0.68 / 0.69 / -1.3%
tpch_q17/datafusion:parquet 129501228 / 130042443 / -0.4% 156613884 / 151487257 / +3.4% 0.83 / 0.86 / -3.7%
tpch_q18/datafusion:parquet 129772901 / 131487102 / -1.3% 152860209 / 150200230 / +1.8% 0.85 / 0.88 / -3.0%
tpch_q19/datafusion:parquet 58556738 / 60345985 / -3.0% 87941838 / 84973769 / +3.5% 0.67 / 0.71 / -6.2%
tpch_q20/datafusion:parquet 67422773 / 67738061 / -0.5% 94900191 / 90489264 / +4.9% 0.71 / 0.75 / -5.1%
tpch_q21/datafusion:parquet 107436532 / 108832846 / -1.3% 131571134 / 129133700 / +1.9% 0.82 / 0.84 / -3.1%
tpch_q22/datafusion:parquet 46878756 / 46779079 / +0.2% 70918583 / 65764602 / +7.8% 0.66 / 0.71 / -7.1%
duckdb / vortex-file-compressed / ns (1.006x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11175901 / 11401273 / -2.0% 20536318 / 27336648 / -24.9% 🟢 0.54 / 0.42 / +30.5%
tpch_q02/duckdb:vortex-file-compressed 17404025 / 17326717 / +0.4% 25641268 / 27926850 / -8.2% 0.68 / 0.62 / +9.4%
tpch_q03/duckdb:vortex-file-compressed 18106738 / 18011187 / +0.5% 38170037 / 32704221 / +16.7% 🔴 0.47 / 0.55 / -13.9%
tpch_q04/duckdb:vortex-file-compressed 16997396 / 17416263 / -2.4% 30744269 / 28915398 / +6.3% 0.55 / 0.60 / -8.2%
tpch_q05/duckdb:vortex-file-compressed 21821753 / 21957440 / -0.6% 39619142 / 35800578 / +10.7% 🔴 0.55 / 0.61 / -10.2%
tpch_q06/duckdb:vortex-file-compressed 6207576 / 5289350 / +17.4% 🔴 17676636 / 14803335 / +19.4% 🔴 0.35 / 0.36 / -1.7%
tpch_q07/duckdb:vortex-file-compressed 20449155 / 21171445 / -3.4% 40545974 / 37818997 / +7.2% 0.50 / 0.56 / -9.9%
tpch_q08/duckdb:vortex-file-compressed 23585703 / 23102153 / +2.1% 40686251 / 38642196 / +5.3% 0.58 / 0.60 / -3.0%
tpch_q09/duckdb:vortex-file-compressed 29634372 / 28598399 / +3.6% 49495803 / 48088710 / +2.9% 0.60 / 0.59 / +0.7%
tpch_q10/duckdb:vortex-file-compressed 28553673 / 28482289 / +0.3% 47887090 / 42411602 / +12.9% 🔴 0.60 / 0.67 / -11.2%
tpch_q11/duckdb:vortex-file-compressed 8782107 / 8685537 / +1.1% 14533941 / 15184747 / -4.3% 0.60 / 0.57 / +5.6%
tpch_q12/duckdb:vortex-file-compressed 15406809 / 17304818 / -11.0% 🟢 34775829 / 33840089 / +2.8% 0.44 / 0.51 / -13.4%
tpch_q13/duckdb:vortex-file-compressed 21594121 / 20814154 / +3.7% 40156178 / 37493560 / +7.1% 0.54 / 0.56 / -3.1%
tpch_q14/duckdb:vortex-file-compressed 13093356 / 13166527 / -0.6% 23862898 / 24415624 / -2.3% 0.55 / 0.54 / +1.7%
tpch_q15/duckdb:vortex-file-compressed 9664673 / 9027961 / +7.1% 19408794 / 18183032 / +6.7% 0.50 / 0.50 / +0.3%
tpch_q16/duckdb:vortex-file-compressed 18576817 / 18216431 / +2.0% 24608968 / 23815017 / +3.3% 0.75 / 0.76 / -1.3%
tpch_q17/duckdb:vortex-file-compressed 15009573 / 15429276 / -2.7% 34039212 / 30120707 / +13.0% 🔴 0.44 / 0.51 / -13.9%
tpch_q18/duckdb:vortex-file-compressed 24809153 / 25602848 / -3.1% 34688270 / 39241910 / -11.6% 🟢 0.72 / 0.65 / +9.6%
tpch_q19/duckdb:vortex-file-compressed 23942608 / 23251231 / +3.0% 38896375 / 35039042 / +11.0% 🔴 0.62 / 0.66 / -7.2%
tpch_q20/duckdb:vortex-file-compressed 17508331 / 17636835 / -0.7% 37654880 / 36638945 / +2.8% 0.46 / 0.48 / -3.4%
tpch_q21/duckdb:vortex-file-compressed 66607907 / 66151490 / +0.7% 81695004 / 83753328 / -2.5% 0.82 / 0.79 / +3.2%
tpch_q22/duckdb:vortex-file-compressed 12417348 / 12397149 / +0.2% 21822449 / 23272058 / -6.2% 0.57 / 0.53 / +6.8%
duckdb / vortex-compact / ns (1.011x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 15263722 / 12035507 / +26.8% 🔴 22053082 / 24562508 / -10.2% 🟢 0.69 / 0.49 / +41.3%
tpch_q02/duckdb:vortex-compact 19992906 / 19891622 / +0.5% 27447330 / 29768089 / -7.8% 0.73 / 0.67 / +9.0%
tpch_q03/duckdb:vortex-compact 19944733 / 19191646 / +3.9% 36174982 / 33501876 / +8.0% 0.55 / 0.57 / -3.8%
tpch_q04/duckdb:vortex-compact 19096595 / 18529556 / +3.1% 30375635 / 31269496 / -2.9% 0.63 / 0.59 / +6.1%
tpch_q05/duckdb:vortex-compact 22497947 / 22612410 / -0.5% 36056000 / 34955386 / +3.1% 0.62 / 0.65 / -3.5%
tpch_q06/duckdb:vortex-compact 6023258 / 6119704 / -1.6% 20355298 / 14848048 / +37.1% 🔴 0.30 / 0.41 / -28.2%
tpch_q07/duckdb:vortex-compact 22023233 / 22169582 / -0.7% 39280152 / 36569116 / +7.4% 0.56 / 0.61 / -7.5%
tpch_q08/duckdb:vortex-compact 25580219 / 26916859 / -5.0% 42536657 / 40706818 / +4.5% 0.60 / 0.66 / -9.1%
tpch_q09/duckdb:vortex-compact 31313275 / 30125890 / +3.9% 50812863 / 50468258 / +0.7% 0.62 / 0.60 / +3.2%
tpch_q10/duckdb:vortex-compact 31152332 / 29929493 / +4.1% 51708990 / 45526628 / +13.6% 🔴 0.60 / 0.66 / -8.4%
tpch_q11/duckdb:vortex-compact 9997251 / 9939874 / +0.6% 18556621 / 16341091 / +13.6% 🔴 0.54 / 0.61 / -11.4%
tpch_q12/duckdb:vortex-compact 17035364 / 18584787 / -8.3% 30772156 / 33421313 / -7.9% 0.55 / 0.56 / -0.4%
tpch_q13/duckdb:vortex-compact 22285018 / 21968174 / +1.4% 42011926 / 41070660 / +2.3% 0.53 / 0.53 / -0.8%
tpch_q14/duckdb:vortex-compact 14399552 / 14065049 / +2.4% 26688727 / 26322903 / +1.4% 0.54 / 0.53 / +1.0%
tpch_q15/duckdb:vortex-compact 10276161 / 10406769 / -1.3% 21362448 / 21681811 / -1.5% 0.48 / 0.48 / +0.2%
tpch_q16/duckdb:vortex-compact 19780603 / 20302878 / -2.6% 26305895 / 25805636 / +1.9% 0.75 / 0.79 / -4.4%
tpch_q17/duckdb:vortex-compact 16033028 / 15841040 / +1.2% 34486384 / 31620392 / +9.1% 0.46 / 0.50 / -7.2%
tpch_q18/duckdb:vortex-compact 25906372 / 26712062 / -3.0% 35105807 / 35383430 / -0.8% 0.74 / 0.75 / -2.2%
tpch_q19/duckdb:vortex-compact 24406445 / 24142703 / +1.1% 38347013 / 35777743 / +7.2% 0.64 / 0.67 / -5.7%
tpch_q20/duckdb:vortex-compact 19136108 / 19158523 / -0.1% 38742129 / 33274725 / +16.4% 🔴 0.49 / 0.58 / -14.2%
tpch_q21/duckdb:vortex-compact 71024941 / 69072482 / +2.8% 88551275 / 84552881 / +4.7% 0.80 / 0.82 / -1.8%
tpch_q22/duckdb:vortex-compact 12937365 / 12959296 / -0.2% 21309904 / 22853919 / -6.8% 0.61 / 0.57 / +7.1%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 62826610 / 63027765 / -0.3% 69099682 / 69969828 / -1.2% 0.91 / 0.90 / +0.9%
tpch_q02/duckdb:parquet 37500872 / 37970225 / -1.2% 45569480 / 46592355 / -2.2% 0.82 / 0.81 / +1.0%
tpch_q03/duckdb:parquet 67637873 / 68121261 / -0.7% 78340899 / 78238883 / +0.1% 0.86 / 0.87 / -0.8%
tpch_q04/duckdb:parquet 46829394 / 46803666 / +0.1% 56394187 / 59764334 / -5.6% 0.83 / 0.78 / +6.0%
tpch_q05/duckdb:parquet 65504715 / 66052346 / -0.8% 76085886 / 77889575 / -2.3% 0.86 / 0.85 / +1.5%
tpch_q06/duckdb:parquet 21864949 / 22020124 / -0.7% 27307602 / 26488484 / +3.1% 0.80 / 0.83 / -3.7%
tpch_q07/duckdb:parquet 64971646 / 65516782 / -0.8% 75352327 / 75058703 / +0.4% 0.86 / 0.87 / -1.2%
tpch_q08/duckdb:parquet 79962338 / 80022302 / -0.1% 92848817 / 92557816 / +0.3% 0.86 / 0.86 / -0.4%
tpch_q09/duckdb:parquet 119340496 / 119568808 / -0.2% 132234582 / 132990169 / -0.6% 0.90 / 0.90 / +0.4%
tpch_q10/duckdb:parquet 119752938 / 119389847 / +0.3% 131772347 / 130426874 / +1.0% 0.91 / 0.92 / -0.7%
tpch_q11/duckdb:parquet 21386857 / 21274143 / +0.5% 25180877 / 26121918 / -3.6% 0.85 / 0.81 / +4.3%
tpch_q12/duckdb:parquet 44220892 / 45164290 / -2.1% 52987246 / 52073887 / +1.8% 0.83 / 0.87 / -3.8%
tpch_q13/duckdb:parquet 243498345 / 242650964 / +0.3% 251226506 / 251973145 / -0.3% 0.97 / 0.96 / +0.6%
tpch_q14/duckdb:parquet 47140848 / 47431196 / -0.6% 55937809 / 55668817 / +0.5% 0.84 / 0.85 / -1.1%
tpch_q15/duckdb:parquet 26631608 / 26700433 / -0.3% 33053811 / 32955862 / +0.3% 0.81 / 0.81 / -0.6%
tpch_q16/duckdb:parquet 51448131 / 51347924 / +0.2% 58107220 / 59265793 / -2.0% 0.89 / 0.87 / +2.2%
tpch_q17/duckdb:parquet 48932547 / 48960128 / -0.1% 58576136 / 58233244 / +0.6% 0.84 / 0.84 / -0.6%
tpch_q18/duckdb:parquet 96010260 / 96043803 / -0.0% 107941140 / 104231610 / +3.6% 0.89 / 0.92 / -3.5%
tpch_q19/duckdb:parquet 65091016 / 65057879 / +0.1% 74771736 / 74518035 / +0.3% 0.87 / 0.87 / -0.3%
tpch_q20/duckdb:parquet 64442778 / 61782235 / +4.3% 73330681 / 73454726 / -0.2% 0.88 / 0.84 / +4.5%
tpch_q21/duckdb:parquet 142565772 / 141868782 / +0.5% 152792585 / 155434601 / -1.7% 0.93 / 0.91 / +2.2%
tpch_q22/duckdb:parquet 51322203 / 51483672 / -0.3% 59796802 / 59681445 / +0.2% 0.86 / 0.86 / -0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR e1111f9c vs base 5d5f429a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+3.1%, environment too noisy confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.978x ➖
Parquet (geomean): hot 0.988x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.023x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 189766756 / 167843740 / +13.1% 🔴 590229998 / 646130955 / -8.7% 0.32 / 0.26 / +23.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10972798 / 10901722 / +0.7% 51663253 / 51722256 / -0.1% 0.21 / 0.21 / +0.8%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11153951 / 11167702 / -0.1% 52763210 / 50272065 / +5.0% 0.21 / 0.22 / -4.8%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23051834 / 23060282 / -0.0% 72733024 / 72101045 / +0.9% 0.32 / 0.32 / -0.9%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18169807 / 18645397 / -2.6% 63948818 / 63515188 / +0.7% 0.28 / 0.29 / -3.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed 18006988 / 17232504 / +4.5% 62488456 / 61407790 / +1.8% 0.29 / 0.28 / +2.7%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41200976 / 40501176 / +1.7% 92517332 / 93101606 / -0.6% 0.45 / 0.44 / +2.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12380936 / 11826234 / +4.7% 47396668 / 46237020 / +2.5% 0.26 / 0.26 / +2.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11858314 / 11863790 / -0.0% 45648524 / 47561388 / -4.0% 0.26 / 0.25 / +4.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10136822 / 9931784 / +2.1% 38014812 / 39198839 / -3.0% 0.27 / 0.25 / +5.2%
datafusion / vortex-compact / ns (0.981x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 199224696 / 212144219 / -6.1% 421364094 / 471324283 / -10.6% 🟢 0.47 / 0.45 / +5.0%
clickbench-sorted_q24/datafusion:vortex-compact 21023853 / 21640684 / -2.9% 52647299 / 53064145 / -0.8% 0.40 / 0.41 / -2.1%
clickbench-sorted_q26/datafusion:vortex-compact 22781235 / 22434596 / +1.5% 50815502 / 53200013 / -4.5% 0.45 / 0.42 / +6.3%
clickbench-sorted_q36/datafusion:vortex-compact 25420942 / 26441666 / -3.9% 75957444 / 74949126 / +1.3% 0.33 / 0.35 / -5.1%
clickbench-sorted_q37/datafusion:vortex-compact 22833910 / 22840680 / -0.0% 68694103 / 69315456 / -0.9% 0.33 / 0.33 / +0.9%
clickbench-sorted_q38/datafusion:vortex-compact 21089244 / 21958836 / -4.0% 68223229 / 69501078 / -1.8% 0.31 / 0.32 / -2.2%
clickbench-sorted_q39/datafusion:vortex-compact 45748618 / 45199972 / +1.2% 89940884 / 88991530 / +1.1% 0.51 / 0.51 / +0.1%
clickbench-sorted_q40/datafusion:vortex-compact 14175345 / 14424008 / -1.7% 46561273 / 47179414 / -1.3% 0.30 / 0.31 / -0.4%
clickbench-sorted_q41/datafusion:vortex-compact 14231266 / 14497545 / -1.8% 49104425 / 47381307 / +3.6% 0.29 / 0.31 / -5.3%
clickbench-sorted_q42/datafusion:vortex-compact 11313268 / 11398994 / -0.8% 36892272 / 38802578 / -4.9% 0.31 / 0.29 / +4.4%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 768187711 / 760230140 / +1.0% 985659793 / 975171600 / +1.1% 0.78 / 0.78 / -0.0%
clickbench-sorted_q24/datafusion:parquet 9395850 / 8902146 / +5.5% 73943019 / 72832488 / +1.5% 0.13 / 0.12 / +4.0%
clickbench-sorted_q26/datafusion:parquet 8917789 / 9271778 / -3.8% 70815293 / 74093359 / -4.4% 0.13 / 0.13 / +0.6%
clickbench-sorted_q36/datafusion:parquet 94450420 / 93550788 / +1.0% 176820774 / 171649231 / +3.0% 0.53 / 0.55 / -2.0%
clickbench-sorted_q37/datafusion:parquet 64706868 / 64635272 / +0.1% 134807989 / 134530443 / +0.2% 0.48 / 0.48 / -0.1%
clickbench-sorted_q38/datafusion:parquet 87988904 / 87563164 / +0.5% 169526052 / 167356677 / +1.3% 0.52 / 0.52 / -0.8%
clickbench-sorted_q39/datafusion:parquet 160101882 / 160357065 / -0.2% 241557885 / 239461057 / +0.9% 0.66 / 0.67 / -1.0%
clickbench-sorted_q40/datafusion:parquet 44800542 / 44503523 / +0.7% 120281775 / 116093869 / +3.6% 0.37 / 0.38 / -2.8%
clickbench-sorted_q41/datafusion:parquet 42211337 / 42067746 / +0.3% 113683773 / 111200571 / +2.2% 0.37 / 0.38 / -1.9%
clickbench-sorted_q42/datafusion:parquet 26036233 / 26510522 / -1.8% 88728165 / 87493459 / +1.4% 0.29 / 0.30 / -3.2%
duckdb / vortex-file-compressed / ns (0.976x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 55878024 / 56817707 / -1.7% 75424983 / 98119884 / -23.1% 🟢 0.74 / 0.58 / +27.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 22932428 / 22728765 / +0.9% 37125324 / 35087917 / +5.8% 0.62 / 0.65 / -4.6%
clickbench-sorted_q26/duckdb:vortex-file-compressed 17218134 / 17028773 / +1.1% 27471088 / 23795101 / +15.4% 🔴 0.63 / 0.72 / -12.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 27883568 / 30573502 / -8.8% 62968872 / 65044685 / -3.2% 0.44 / 0.47 / -5.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23815493 / 25092790 / -5.1% 54701598 / 53077564 / +3.1% 0.44 / 0.47 / -7.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed 24889670 / 25438027 / -2.2% 58727423 / 66739515 / -12.0% 🟢 0.42 / 0.38 / +11.2%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48265246 / 48166520 / +0.2% 106377720 / 101490392 / +4.8% 0.45 / 0.47 / -4.4%
clickbench-sorted_q40/duckdb:vortex-file-compressed 16431972 / 16336206 / +0.6% 38676259 / 40152376 / -3.7% 0.42 / 0.41 / +4.4%
clickbench-sorted_q41/duckdb:vortex-file-compressed 14932258 / 16181982 / -7.7% 42812164 / 39157220 / +9.3% 0.35 / 0.41 / -15.6%
clickbench-sorted_q42/duckdb:vortex-file-compressed 13731302 / 13894483 / -1.2% 32580630 / 30294875 / +7.5% 0.42 / 0.46 / -8.1%
duckdb / vortex-compact / ns (1.032x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 65868515 / 64667984 / +1.9% 87603252 / 98872007 / -11.4% 🟢 0.75 / 0.65 / +15.0%
clickbench-sorted_q24/duckdb:vortex-compact 24177112 / 22976624 / +5.2% 35788232 / 32917536 / +8.7% 0.68 / 0.70 / -3.2%
clickbench-sorted_q26/duckdb:vortex-compact 20127064 / 17114137 / +17.6% 🔴 29472704 / 3795239 / -22.3% 🟢 0.68 / 0.45 / +51.4%
clickbench-sorted_q36/duckdb:vortex-compact 32360688 / 33374370 / -3.0% 68285423 / 66859941 / +2.1% 0.47 / 0.50 / -5.1%
clickbench-sorted_q37/duckdb:vortex-compact 29156322 / 29297298 / -0.5% 61696416 / 64764394 / -4.7% 0.47 / 0.45 / +4.5%
clickbench-sorted_q38/duckdb:vortex-compact 30407594 / 30120825 / +1.0% 63460348 / 69090808 / -8.1% 0.48 / 0.44 / +9.9%
clickbench-sorted_q39/duckdb:vortex-compact 61131724 / 59999914 / +1.9% 100523648 / 102565876 / -2.0% 0.61 / 0.58 / +4.0%
clickbench-sorted_q40/duckdb:vortex-compact 17703282 / 16966656 / +4.3% 38931759 / 42735603 / -8.9% 0.45 / 0.40 / +14.5%
clickbench-sorted_q41/duckdb:vortex-compact 17103870 / 16714734 / +2.3% 38528689 / 40116168 / -4.0% 0.44 / 0.42 / +6.5%
clickbench-sorted_q42/duckdb:vortex-compact 14291587 / 13914406 / +2.7% 29648877 / 30906293 / -4.1% 0.48 / 0.45 / +7.1%
duckdb / parquet / ns (0.973x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 124894994 / 126267642 / -1.1% 138954020 / 142936418 / -2.8% 0.90 / 0.88 / +1.7%
clickbench-sorted_q24/duckdb:parquet 17993176 / 17968359 / +0.1% 29383573 / 27184035 / +8.1% 0.61 / 0.66 / -7.4%
clickbench-sorted_q26/duckdb:parquet 12784628 / 14311482 / -10.7% 🟢 23635819 / 23568136 / +0.3% 0.54 / 0.61 / -10.9%
clickbench-sorted_q36/duckdb:parquet 43487636 / 50055390 / -13.1% 🟢 65444181 / 62816612 / +4.2% 0.66 / 0.80 / -16.6%
clickbench-sorted_q37/duckdb:parquet 31427266 / 30630628 / +2.6% 48170657 / 49623943 / -2.9% 0.65 / 0.62 / +5.7%
clickbench-sorted_q38/duckdb:parquet 44549528 / 38849379 / +14.7% 🔴 60889100 / 59491934 / +2.3% 0.73 / 0.65 / +12.0%
clickbench-sorted_q39/duckdb:parquet 71049510 / 75039992 / -5.3% 89236809 / 98413553 / -9.3% 0.80 / 0.76 / +4.4%
clickbench-sorted_q40/duckdb:parquet 16615632 / 17288041 / -3.9% 45549057 / 47163976 / -3.4% 0.36 / 0.37 / -0.5%
clickbench-sorted_q41/duckdb:parquet 16428676 / 16478134 / -0.3% 44513135 / 46286687 / -3.8% 0.37 / 0.36 / +3.7%
clickbench-sorted_q42/duckdb:parquet 11743571 / 12607216 / -6.9% 29127603 / 23984502 / +21.4% 🔴 0.40 / 0.53 / -23.3%

File Size Changes (200 files changed, +0.0% overall, 92↑ 108↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 188.72 MB 193.04 MB +4.32 MB +2.3%
hits_001.vortex 1.0 vortex-compact 137.73 MB 140.24 MB +2.50 MB +1.8%
hits_009.vortex 1.0 vortex-compact 75.25 MB 76.51 MB +1.27 MB +1.7%
hits_094.vortex 1.0 vortex-file-compressed 156.95 MB 158.54 MB +1.59 MB +1.0%
hits_053.vortex 1.0 vortex-file-compressed 189.46 MB 191.23 MB +1.77 MB +0.9%
hits_024.vortex 1.0 vortex-compact 123.52 MB 124.54 MB +1.02 MB +0.8%
hits_059.vortex 1.0 vortex-compact 151.64 MB 152.83 MB +1.19 MB +0.8%
hits_064.vortex 1.0 vortex-compact 138.83 MB 139.89 MB +1.05 MB +0.8%
hits_081.vortex 1.0 vortex-compact 152.64 MB 153.65 MB +1.01 MB +0.7%
hits_092.vortex 1.0 vortex-file-compressed 199.28 MB 200.54 MB +1.26 MB +0.6%
hits_074.vortex 1.0 vortex-file-compressed 198.92 MB 200.13 MB +1.21 MB +0.6%
hits_060.vortex 1.0 vortex-compact 140.08 MB 140.91 MB +851.08 KB +0.6%
hits_036.vortex 1.0 vortex-file-compressed 171.98 MB 172.98 MB +1.01 MB +0.6%
hits_018.vortex 1.0 vortex-compact 152.85 MB 153.72 MB +897.25 KB +0.6%
hits_029.vortex 1.0 vortex-file-compressed 199.75 MB 200.89 MB +1.14 MB +0.6%
hits_029.vortex 1.0 vortex-compact 152.69 MB 153.43 MB +757.29 KB +0.5%
hits_093.vortex 1.0 vortex-compact 98.26 MB 98.71 MB +462.74 KB +0.5%
hits_096.vortex 1.0 vortex-file-compressed 199.43 MB 200.34 MB +930.88 KB +0.5%
hits_074.vortex 1.0 vortex-compact 152.23 MB 152.92 MB +703.23 KB +0.5%
hits_010.vortex 1.0 vortex-compact 123.40 MB 123.88 MB +489.88 KB +0.4%
hits_015.vortex 1.0 vortex-compact 97.47 MB 97.84 MB +372.48 KB +0.4%
hits_064.vortex 1.0 vortex-file-compressed 191.68 MB 192.38 MB +711.88 KB +0.4%
hits_037.vortex 1.0 vortex-compact 132.38 MB 132.85 MB +483.95 KB +0.4%
hits_026.vortex 1.0 vortex-compact 97.58 MB 97.89 MB +317.81 KB +0.3%
hits_073.vortex 1.0 vortex-file-compressed 173.19 MB 173.69 MB +511.01 KB +0.3%
hits_069.vortex 1.0 vortex-compact 99.64 MB 99.92 MB +280.80 KB +0.3%
hits_065.vortex 1.0 vortex-compact 125.11 MB 125.45 MB +342.83 KB +0.3%
hits_066.vortex 1.0 vortex-compact 117.39 MB 117.68 MB +293.34 KB +0.2%
hits_061.vortex 1.0 vortex-compact 124.86 MB 125.14 MB +281.12 KB +0.2%
hits_083.vortex 1.0 vortex-compact 109.90 MB 110.13 MB +239.98 KB +0.2%
hits_044.vortex 1.0 vortex-compact 153.41 MB 153.73 MB +322.87 KB +0.2%
hits_027.vortex 1.0 vortex-file-compressed 189.57 MB 189.93 MB +372.87 KB +0.2%
hits_077.vortex 1.0 vortex-file-compressed 172.86 MB 173.14 MB +288.28 KB +0.2%
hits_025.vortex 1.0 vortex-compact 133.42 MB 133.59 MB +178.84 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.10 MB 200.36 MB +265.76 KB +0.1%
hits_042.vortex 1.0 vortex-compact 136.21 MB 136.39 MB +179.62 KB +0.1%
hits_098.vortex 1.0 vortex-compact 103.68 MB 103.81 MB +135.13 KB +0.1%
hits_051.vortex 1.0 vortex-compact 134.03 MB 134.20 MB +169.72 KB +0.1%
hits_050.vortex 1.0 vortex-compact 125.02 MB 125.17 MB +153.41 KB +0.1%
hits_036.vortex 1.0 vortex-compact 133.22 MB 133.37 MB +158.09 KB +0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.69 MB 137.84 MB +161.59 KB +0.1%
hits_054.vortex 1.0 vortex-compact 111.60 MB 111.71 MB +119.05 KB +0.1%
hits_072.vortex 1.0 vortex-compact 75.61 MB 75.68 MB +77.92 KB +0.1%
hits_012.vortex 1.0 vortex-compact 138.70 MB 138.82 MB +129.63 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.85 MB 159.99 MB +147.52 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.60 MB 161.73 MB +141.09 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.68 MB 153.80 MB +124.05 KB +0.1%
hits_013.vortex 1.0 vortex-compact 123.91 MB 124.00 MB +94.27 KB +0.1%
hits_080.vortex 1.0 vortex-compact 96.64 MB 96.71 MB +70.70 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.77 MB 142.87 MB +102.35 KB +0.1%
hits_079.vortex 1.0 vortex-compact 127.90 MB 127.98 MB +87.02 KB +0.1%
hits_005.vortex 1.0 vortex-compact 115.91 MB 115.99 MB +76.26 KB +0.1%
hits_058.vortex 1.0 vortex-compact 111.04 MB 111.11 MB +72.40 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 200.09 MB 200.21 MB +127.27 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.34 MB 130.42 MB +82.38 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.70 MB 153.79 MB +96.24 KB +0.1%
hits_020.vortex 1.0 vortex-compact 111.58 MB 111.64 MB +62.78 KB +0.1%
hits_049.vortex 1.0 vortex-compact 139.32 MB 139.39 MB +69.04 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.30 MB 192.39 MB +94.99 KB +0.0%
hits_028.vortex 1.0 vortex-compact 115.14 MB 115.20 MB +55.90 KB +0.0%
hits_088.vortex 1.0 vortex-compact 134.10 MB 134.17 MB +63.20 KB +0.0%
hits_046.vortex 1.0 vortex-compact 74.91 MB 74.94 MB +34.73 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.66 MB 135.70 MB +48.58 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.45 MB 110.49 MB +35.58 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.82 MB 171.87 MB +55.20 KB +0.0%
hits_027.vortex 1.0 vortex-compact 138.06 MB 138.09 MB +35.16 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.62 MB 161.66 MB +38.95 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.21 MB 156.24 MB +35.67 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.10 MB 167.14 MB +37.86 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.42 MB 190.46 MB +40.70 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.60 MB 192.64 MB +39.37 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.71 MB 161.74 MB +33.04 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.61 MB 110.63 MB +21.34 KB +0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.67 MB 200.71 MB +36.90 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.26 MB 130.29 MB +23.34 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.74 MB 192.77 MB +32.46 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.74 MB 191.77 MB +31.51 KB +0.0%
hits_031.vortex 1.0 vortex-compact 111.15 MB 111.17 MB +18.20 KB +0.0%
hits_086.vortex 1.0 vortex-compact 140.45 MB 140.47 MB +21.77 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.05 MB 201.08 MB +30.38 KB +0.0%
hits_019.vortex 1.0 vortex-compact 105.98 MB 105.99 MB +13.66 KB +0.0%
hits_044.vortex 1.0 vortex-file-compressed 200.96 MB 200.99 MB +24.77 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.75 MB 130.77 MB +16.08 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 200.95 MB 200.97 MB +23.69 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.91 MB 75.92 MB +8.06 KB +0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.90 MB 172.91 MB +14.55 KB +0.0%
hits_071.vortex 1.0 vortex-file-compressed 140.04 MB 140.05 MB +10.87 KB +0.0%
hits_038.vortex 1.0 vortex-compact 138.24 MB 138.25 MB +6.22 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.61 MB 105.61 MB +3.04 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.88 MB 194.88 MB +4.79 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.92 MB 153.92 MB +3.22 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 183.49 MB 183.49 MB +3.19 KB +0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.11 MB 163.11 MB 512 B -0.0%
hits_084.vortex 1.0 vortex-compact 110.67 MB 110.67 MB 1.05 KB -0.0%
hits_033.vortex 1.0 vortex-file-compressed 201.07 MB 201.07 MB 2.41 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.59 MB 104.59 MB 2.73 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.07 MB 191.06 MB 8.72 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 200.83 MB 200.82 MB 12.66 KB -0.0%
hits_056.vortex 1.0 vortex-compact 100.76 MB 100.75 MB 6.96 KB -0.0%
hits_075.vortex 1.0 vortex-compact 137.82 MB 137.81 MB 9.77 KB -0.0%
hits_034.vortex 1.0 vortex-compact 133.17 MB 133.16 MB 9.93 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.92 MB 168.91 MB 13.47 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.80 MB 130.79 MB 11.95 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.11 MB 127.10 MB 11.72 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.23 MB 147.21 MB 16.22 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.67 MB 126.65 MB 15.32 KB -0.0%
hits_008.vortex 1.0 vortex-compact 105.73 MB 105.72 MB 14.95 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.63 MB 130.62 MB 18.51 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.80 MB 172.78 MB 24.59 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.20 MB 160.17 MB 27.30 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.15 MB 131.13 MB 22.92 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.60 MB 110.58 MB 22.48 KB -0.0%
hits_095.vortex 1.0 vortex-compact 110.61 MB 110.58 MB 23.16 KB -0.0%
hits_073.vortex 1.0 vortex-compact 134.33 MB 134.30 MB 31.57 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.39 MB 161.35 MB 42.56 KB -0.0%
hits_007.vortex 1.0 vortex-compact 153.53 MB 153.49 MB 45.68 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.37 MB 172.31 MB 60.59 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.12 MB 102.09 MB 36.14 KB -0.0%
hits_045.vortex 1.0 vortex-compact 105.64 MB 105.61 MB 38.75 KB -0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.83 MB 100.79 MB 37.55 KB -0.0%
hits_016.vortex 1.0 vortex-compact 127.40 MB 127.35 MB 48.40 KB -0.0%
hits_002.vortex 1.0 vortex-compact 123.72 MB 123.67 MB 49.73 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.80 MB 180.73 MB 72.73 KB -0.0%
hits_017.vortex 1.0 vortex-compact 111.83 MB 111.78 MB 46.12 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.68 MB 161.61 MB 68.20 KB -0.0%
hits_011.vortex 1.0 vortex-compact 152.88 MB 152.81 MB 69.92 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 139.92 MB 139.86 MB 64.51 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.84 MB 159.77 MB 74.08 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.20 MB 159.12 MB 74.49 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.16 MB 130.09 MB 64.42 KB -0.0%
hits_071.vortex 1.0 vortex-compact 105.62 MB 105.56 MB 54.66 KB -0.1%
hits_057.vortex 1.0 vortex-compact 111.70 MB 111.64 MB 58.80 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 201.34 MB 201.23 MB 114.59 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.97 MB 130.90 MB 75.14 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.79 MB 200.68 MB 117.22 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.14 MB 189.03 MB 113.77 KB -0.1%
hits_053.vortex 1.0 vortex-compact 138.28 MB 138.19 MB 84.98 KB -0.1%
hits_090.vortex 1.0 vortex-compact 140.10 MB 140.01 MB 86.63 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.80 MB 179.69 MB 112.25 KB -0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.78 MB 172.67 MB 110.84 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.10 MB 161.00 MB 108.10 KB -0.1%
hits_070.vortex 1.0 vortex-compact 153.61 MB 153.50 MB 108.38 KB -0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.32 MB 139.22 MB 101.02 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.25 MB 153.14 MB 111.56 KB -0.1%
hits_048.vortex 1.0 vortex-compact 152.64 MB 152.53 MB 111.85 KB -0.1%
hits_065.vortex 1.0 vortex-file-compressed 162.10 MB 161.97 MB 135.61 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.59 MB 132.48 MB 113.97 KB -0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.28 MB 152.15 MB 132.24 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 171.57 MB 171.41 MB 160.47 KB -0.1%
hits_022.vortex 1.0 vortex-compact 153.14 MB 153.00 MB 144.26 KB -0.1%
hits_040.vortex 1.0 vortex-compact 110.06 MB 109.96 MB 106.56 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.16 MB 140.02 MB 147.45 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.45 MB 139.31 MB 148.99 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 178.33 MB 178.14 MB 197.52 KB -0.1%
hits_039.vortex 1.0 vortex-compact 123.90 MB 123.77 MB 139.07 KB -0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.60 MB 136.44 MB 168.43 KB -0.1%
hits_063.vortex 1.0 vortex-compact 97.98 MB 97.84 MB 137.84 KB -0.1%
hits_092.vortex 1.0 vortex-compact 153.57 MB 153.35 MB 221.26 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.61 MB 130.42 MB 199.52 KB -0.1%
hits_068.vortex 1.0 vortex-compact 112.18 MB 112.01 MB 173.38 KB -0.2%
hits_032.vortex 1.0 vortex-file-compressed 154.25 MB 154.01 MB 239.57 KB -0.2%
hits_089.vortex 1.0 vortex-file-compressed 130.91 MB 130.67 MB 243.09 KB -0.2%
hits_038.vortex 1.0 vortex-file-compressed 189.92 MB 189.57 MB 353.83 KB -0.2%
hits_058.vortex 1.0 vortex-file-compressed 154.71 MB 154.41 MB 300.94 KB -0.2%
hits_014.vortex 1.0 vortex-compact 134.13 MB 133.87 MB 267.60 KB -0.2%
hits_067.vortex 1.0 vortex-compact 98.45 MB 98.24 MB 213.67 KB -0.2%
hits_004.vortex 1.0 vortex-file-compressed 131.00 MB 130.71 MB 295.72 KB -0.2%
hits_094.vortex 1.0 vortex-compact 110.96 MB 110.71 MB 257.75 KB -0.2%
hits_047.vortex 1.0 vortex-file-compressed 154.24 MB 153.85 MB 402.70 KB -0.3%
hits_085.vortex 1.0 vortex-compact 153.55 MB 153.14 MB 421.95 KB -0.3%
hits_099.vortex 1.0 vortex-compact 133.59 MB 133.20 MB 398.39 KB -0.3%
hits_087.vortex 1.0 vortex-file-compressed 160.35 MB 159.88 MB 478.22 KB -0.3%
hits_072.vortex 1.0 vortex-file-compressed 102.19 MB 101.89 MB 311.14 KB -0.3%
hits_043.vortex 1.0 vortex-file-compressed 127.08 MB 126.70 MB 387.63 KB -0.3%
hits_000.vortex 1.0 vortex-compact 97.88 MB 97.58 MB 306.37 KB -0.3%
hits_009.vortex 1.0 vortex-file-compressed 101.26 MB 100.94 MB 328.50 KB -0.3%
hits_004.vortex 1.0 vortex-compact 99.00 MB 98.68 MB 321.70 KB -0.3%
hits_055.vortex 1.0 vortex-compact 153.18 MB 152.66 MB 522.86 KB -0.3%
hits_026.vortex 1.0 vortex-file-compressed 130.81 MB 130.37 MB 451.19 KB -0.3%
hits_043.vortex 1.0 vortex-compact 94.50 MB 94.18 MB 326.17 KB -0.3%
hits_054.vortex 1.0 vortex-file-compressed 147.86 MB 147.29 MB 580.01 KB -0.4%
hits_033.vortex 1.0 vortex-compact 153.36 MB 152.75 MB 627.46 KB -0.4%
hits_091.vortex 1.0 vortex-file-compressed 148.14 MB 147.48 MB 675.25 KB -0.4%
hits_087.vortex 1.0 vortex-compact 125.60 MB 125.04 MB 576.33 KB -0.4%
hits_041.vortex 1.0 vortex-compact 98.45 MB 98.00 MB 463.17 KB -0.5%
hits_078.vortex 1.0 vortex-compact 98.38 MB 97.91 MB 486.87 KB -0.5%
hits_030.vortex 1.0 vortex-compact 98.25 MB 97.75 MB 512.96 KB -0.5%
hits_022.vortex 1.0 vortex-file-compressed 200.28 MB 199.26 MB 1.02 MB -0.5%
hits_091.vortex 1.0 vortex-compact 111.80 MB 111.18 MB 638.99 KB -0.6%
hits_052.vortex 1.0 vortex-compact 98.33 MB 97.78 MB 571.97 KB -0.6%
hits_042.vortex 1.0 vortex-file-compressed 202.20 MB 201.00 MB 1.19 MB -0.6%
hits_048.vortex 1.0 vortex-file-compressed 200.57 MB 199.36 MB 1.21 MB -0.6%
hits_023.vortex 1.0 vortex-compact 142.51 MB 141.58 MB 948.33 KB -0.6%
hits_097.vortex 1.0 vortex-compact 141.09 MB 140.13 MB 989.41 KB -0.7%
hits_077.vortex 1.0 vortex-compact 134.50 MB 133.57 MB 948.65 KB -0.7%
hits_040.vortex 1.0 vortex-file-compressed 144.96 MB 143.88 MB 1.08 MB -0.7%
hits_089.vortex 1.0 vortex-compact 99.24 MB 98.38 MB 877.91 KB -0.9%
hits_013.vortex 1.0 vortex-file-compressed 161.77 MB 160.37 MB 1.41 MB -0.9%
hits_076.vortex 1.0 vortex-compact 125.69 MB 123.89 MB 1.79 MB -1.4%
hits_006.vortex 1.0 vortex-compact 96.25 MB 93.95 MB 2.30 MB -2.4%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (+0.0%)
  • vortex-file-compressed: 15.96 GB → 15.96 GB (+0.0%)

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR e1111f9c vs base 9eb20ba0


vortex / vortex-file-compressed / ms (1.004x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.99347 / 33.027396 / -0.1%
read/clickbench/URL/shard-0/onpair-12 21.224576 / 21.254798 / -0.1%
read/tpch/l_comment/fsst 57.873473 / 57.826085 / +0.1%
read/tpch/l_comment/onpair-12 53.742692 / 53.640314 / +0.2%
write/clickbench/URL/shard-0/fsst 594.63583 / 591.358395 / +0.6%
write/clickbench/URL/shard-0/onpair-12 967.631615 / 968.460343 / -0.1%
write/tpch/l_comment/fsst 1914.05177 / 1914.47964 / -0.0%
write/tpch/l_comment/onpair-12 2120.84366 / 2065.46214 / +2.7%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.4055438 / 47.4055438 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst 30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Engines: DataFusion No clear signal (+8.4%, environment too noisy confidence) · DuckDB No clear signal (+0.5%, environment too noisy confidence)
Vortex (geomean): hot 0.954x ➖ · cold 0.921x ➖
Parquet (geomean): hot 0.914x ➖ · cold 0.850x ➖
Shifts: Parquet (control) -8.6% · Median polish -3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.909x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 53291919 / 46656930 / +14.2% 137624472 / 119740209 / +14.9% 0.39 / 0.39 / -0.6%
fineweb_q01/datafusion:vortex-file-compressed 484178284 / 563194767 / -14.0% 790574131 / 789102836 / +0.2% 0.61 / 0.71 / -14.2%
fineweb_q02/datafusion:vortex-file-compressed 407586243 / 377682321 / +7.9% 419810403 / 949520776 / -55.8% 🟢 0.97 / 0.40 / +144.1%
fineweb_q03/datafusion:vortex-file-compressed 504136867 / 619896291 / -18.7% 775233866 / 844441536 / -8.2% 0.65 / 0.73 / -11.4%
fineweb_q04/datafusion:vortex-file-compressed 470313974 / 495525595 / -5.1% 551877502 / 545955280 / +1.1% 0.85 / 0.91 / -6.1%
fineweb_q05/datafusion:vortex-file-compressed 515954576 / 474531500 / +8.7% 533161456 / 567422195 / -6.0% 0.97 / 0.84 / +15.7%
fineweb_q06/datafusion:vortex-file-compressed 886462304 / 714399610 / +24.1% 948558897 / 774169802 / +22.5% 0.93 / 0.92 / +1.3%
fineweb_q07/datafusion:vortex-file-compressed 501981444 / 514228908 / -2.4% 478746489 / 431660447 / +10.9% 1.05 / 1.19 / -12.0%
fineweb_q08/datafusion:vortex-file-compressed 192893440 / 491333160 / -60.7% 🟢 245705808 / 326604281 / -24.8% 0.79 / 1.50 / -47.8%
datafusion / vortex-compact / ns (0.885x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 65289434 / 62381571 / +4.7% 184321935 / 133056095 / +38.5% 🔴 0.35 / 0.47 / -24.4%
fineweb_q01/datafusion:vortex-compact 432422745 / 488317345 / -11.4% 786980270 / 906459979 / -13.2% 0.55 / 0.54 / +2.0%
fineweb_q02/datafusion:vortex-compact 447132534 / 560838501 / -20.3% 628550950 / 715508624 / -12.2% 0.71 / 0.78 / -9.2%
fineweb_q03/datafusion:vortex-compact 533525991 / 567381689 / -6.0% 799152916 / 960480193 / -16.8% 0.67 / 0.59 / +13.0%
fineweb_q04/datafusion:vortex-compact 458036949 / 571305158 / -19.8% 505704813 / 586437717 / -13.8% 0.91 / 0.97 / -7.0%
fineweb_q05/datafusion:vortex-compact 442471902 / 433741701 / +2.0% 504358762 / 684482966 / -26.3% 0.88 / 0.63 / +38.4%
fineweb_q06/datafusion:vortex-compact 632416162 / 704750612 / -10.3% 729084761 / 762558855 / -4.4% 0.87 / 0.92 / -6.1%
fineweb_q07/datafusion:vortex-compact 514162374 / 572193014 / -10.1% 539763525 / 558059740 / -3.3% 0.95 / 1.03 / -7.1%
fineweb_q08/datafusion:vortex-compact 205079536 / 281670000 / -27.2% 191382609 / 611316149 / -68.7% 🟢 1.07 / 0.46 / +132.6%
datafusion / parquet / ns (0.827x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 467732312 / 659752743 / -29.1% 865259080 / 1364563096 / -36.6% 🟢 0.54 / 0.48 / +11.8%
fineweb_q01/datafusion:parquet 866180915 / 917068640 / -5.5% 841822130 / 1062567776 / -20.8% 1.03 / 0.86 / +19.2%
fineweb_q02/datafusion:parquet 787047422 / 1137390354 / -30.8% 🟢 756873555 / 1540054829 / -50.9% 🟢 1.04 / 0.74 / +40.8%
fineweb_q03/datafusion:parquet 965469626 / 1025011069 / -5.8% 852163592 / 1289888099 / -33.9% 🟢 1.13 / 0.79 / +42.6%
fineweb_q04/datafusion:parquet 1116249662 / 1041846851 / +7.1% 961358545 / 1147732084 / -16.2% 1.16 / 0.91 / +27.9%
fineweb_q05/datafusion:parquet 886474824 / 953082734 / -7.0% 984691516 / 873026220 / +12.8% 0.90 / 1.09 / -17.5%
fineweb_q06/datafusion:parquet 944385390 / 1352291772 / -30.2% 🟢 1101245746 / 983383558 / +12.0% 0.86 / 1.38 / -37.6%
fineweb_q07/datafusion:parquet 822352918 / 1093610904 / -24.8% 843227072 / 1279723944 / -34.1% 🟢 0.98 / 0.85 / +14.1%
fineweb_q08/datafusion:parquet 774906163 / 976945780 / -20.7% 907904806 / 828451952 / +9.6% 0.85 / 1.18 / -27.6%
duckdb / vortex-file-compressed / ns (1.057x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 65486510 / 62393953 / +5.0% 72275133 / 61867627 / +16.8% 0.91 / 1.01 / -10.2%
fineweb_q01/duckdb:vortex-file-compressed 663020918 / 452236728 / +46.6% 🔴 551376137 / 485531933 / +13.6% 1.20 / 0.93 / +29.1%
fineweb_q02/duckdb:vortex-file-compressed 556719030 / 609115982 / -8.6% 603698035 / 612398213 / -1.4% 0.92 / 0.99 / -7.3%
fineweb_q03/duckdb:vortex-file-compressed 965986732 / 1016974047 / -5.0% 1048608498 / 1240941906 / -15.5% 0.92 / 0.82 / +12.4%
fineweb_q04/duckdb:vortex-file-compressed 1032299164 / 996110682 / +3.6% 980130045 / 1028207379 / -4.7% 1.05 / 0.97 / +8.7%
fineweb_q05/duckdb:vortex-file-compressed 904035941 / 864827062 / +4.5% 1024201283 / 964168627 / +6.2% 0.88 / 0.90 / -1.6%
fineweb_q06/duckdb:vortex-file-compressed 1330898197 / 1224978158 / +8.6% 1435126780 / 1284520307 / +11.7% 0.93 / 0.95 / -2.8%
fineweb_q07/duckdb:vortex-file-compressed 1017411167 / 967172584 / +5.2% 1073007940 / 1033096880 / +3.9% 0.95 / 0.94 / +1.3%
fineweb_q08/duckdb:vortex-file-compressed 402822616 / 404067842 / -0.3% 480136017 / 463415193 / +3.6% 0.84 / 0.87 / -3.8%
duckdb / vortex-compact / ns (0.975x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 65494015 / 64624497 / +1.3% 91373058 / 134892923 / -32.3% 🟢 0.72 / 0.48 / +49.6%
fineweb_q01/duckdb:vortex-compact 441569200 / 397942977 / +11.0% 478385976 / 483526626 / -1.1% 0.92 / 0.82 / +12.2%
fineweb_q02/duckdb:vortex-compact 541676264 / 954704337 / -43.3% 🟢 563328071 / 598062281 / -5.8% 0.96 / 1.60 / -39.8%
fineweb_q03/duckdb:vortex-compact 1093857610 / 1135505472 / -3.7% 1105402943 / 1282570103 / -13.8% 0.99 / 0.89 / +11.8%
fineweb_q04/duckdb:vortex-compact 1076327868 / 1109983084 / -3.0% 1098701058 / 1168438898 / -6.0% 0.98 / 0.95 / +3.1%
fineweb_q05/duckdb:vortex-compact 1014319312 / 901822084 / +12.5% 1042395031 / 1193990097 / -12.7% 0.97 / 0.76 / +28.8%
fineweb_q06/duckdb:vortex-compact 1202725280 / 1104316510 / +8.9% 1229329165 / 1203100596 / +2.2% 0.98 / 0.92 / +6.6%
fineweb_q07/duckdb:vortex-compact 986527812 / 1012962968 / -2.6% 1152963320 / 964834406 / +19.5% 0.86 / 1.05 / -18.5%
fineweb_q08/duckdb:vortex-compact 395360120 / 354665158 / +11.5% 419848903 / 434339884 / -3.3% 0.94 / 0.82 / +15.3%
duckdb / parquet / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 693506596 / 504776418 / +37.4% 🔴 584475090 / 569646856 / +2.6% 1.19 / 0.89 / +33.9%
fineweb_q01/duckdb:parquet 613495001 / 590453952 / +3.9% 690045819 / 695446923 / -0.8% 0.89 / 0.85 / +4.7%
fineweb_q02/duckdb:parquet 611478572 / 634761872 / -3.7% 617278250 / 604414542 / +2.1% 0.99 / 1.05 / -5.7%
fineweb_q03/duckdb:parquet 1535815278 / 1562633226 / -1.7% 1536579802 / 1418979019 / +8.3% 1.00 / 1.10 / -9.2%
fineweb_q04/duckdb:parquet 799058218 / 864494808 / -7.6% 905941165 / 1005073721 / -9.9% 0.88 / 0.86 / +2.5%
fineweb_q05/duckdb:parquet 942943650 / 983564972 / -4.1% 926720610 / 1239463060 / -25.2% 1.02 / 0.79 / +28.2%
fineweb_q06/duckdb:parquet 1689224494 / 1904817080 / -11.3% 1687961414 / 1987119836 / -15.1% 1.00 / 0.96 / +4.4%
fineweb_q07/duckdb:parquet 1058275785 / 1248522760 / -15.2% 1074425775 / 1341707852 / -19.9% 0.98 / 0.93 / +5.8%
fineweb_q08/duckdb:parquet 696239372 / 573015122 / +21.5% 482009146 / 573785532 / -16.0% 1.44 / 1.00 / +44.6%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52734019 / 52645217 / +0.2% 72535095 / 72034115 / +0.7% 0.73 / 0.73 / -0.5%
appian_q02/datafusion:vortex-compact 232420284 / 234564237 / -0.9% 271329241 / 267742189 / +1.3% 0.86 / 0.88 / -2.2%
appian_q03/datafusion:vortex-compact 145830217 / 147312870 / -1.0% 184469825 / 187467207 / -1.6% 0.79 / 0.79 / +0.6%
appian_q04/datafusion:vortex-compact 9877496810 / 9905233264 / -0.3% 9784199455 / 9846466233 / -0.6% 1.01 / 1.01 / +0.4%
appian_q05/datafusion:vortex-compact 138974538 / 138261094 / +0.5% 162346568 / 162019571 / +0.2% 0.86 / 0.85 / +0.3%
appian_q06/datafusion:vortex-compact 143969176 / 144058226 / -0.1% 166383287 / 165005413 / +0.8% 0.87 / 0.87 / -0.9%
appian_q07/datafusion:vortex-compact 162625272 / 166838391 / -2.5% 199310288 / 199894870 / -0.3% 0.82 / 0.83 / -2.2%
appian_q08/datafusion:vortex-compact 557581617 / 556023086 / +0.3% 594242574 / 591694408 / +0.4% 0.94 / 0.94 / -0.1%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 73109688 / 73504103 / -0.5% 94689825 / 92570167 / +2.3% 0.77 / 0.79 / -2.8%
appian_q02/datafusion:parquet 301664923 / 303743209 / -0.7% 336678019 / 330400968 / +1.9% 0.90 / 0.92 / -2.5%
appian_q03/datafusion:parquet 190026315 / 191530938 / -0.8% 226752695 / 230331336 / -1.6% 0.84 / 0.83 / +0.8%
appian_q04/datafusion:parquet 9963677313 / 9936447010 / +0.3% 9842705341 / 9873075226 / -0.3% 1.01 / 1.01 / +0.6%
appian_q05/datafusion:parquet 200920223 / 198840555 / +1.0% 224616588 / 227938870 / -1.5% 0.89 / 0.87 / +2.5%
appian_q06/datafusion:parquet 168625765 / 170709557 / -1.2% 188145251 / 190498769 / -1.2% 0.90 / 0.90 / +0.0%
appian_q07/datafusion:parquet 208138668 / 209319529 / -0.6% 248702139 / 240980499 / +3.2% 0.84 / 0.87 / -3.7%
appian_q08/datafusion:parquet 687975366 / 674279136 / +2.0% 684393710 / 701442601 / -2.4% 1.01 / 0.96 / +4.6%
duckdb / vortex-compact / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 91319561 / 90787578 / +0.6% 104158342 / 105525141 / -1.3% 0.88 / 0.86 / +1.9%
appian_q02/duckdb:vortex-compact 210232370 / 217089521 / -3.2% 235376506 / 231627183 / +1.6% 0.89 / 0.94 / -4.7%
appian_q03/duckdb:vortex-compact 123304611 / 121283635 / +1.7% 138529786 / 135969188 / +1.9% 0.89 / 0.89 / -0.2%
appian_q04/duckdb:vortex-compact 584937563 / 561030329 / +4.3% 577485417 / 571848056 / +1.0% 1.01 / 0.98 / +3.2%
appian_q05/duckdb:vortex-compact 130051491 / 126317303 / +3.0% 151410803 / 150048698 / +0.9% 0.86 / 0.84 / +2.0%
appian_q06/duckdb:vortex-compact 405362462 / 405429215 / -0.0% 418243091 / 410893101 / +1.8% 0.97 / 0.99 / -1.8%
appian_q07/duckdb:vortex-compact 136269867 / 137948309 / -1.2% 156780549 / 151682122 / +3.4% 0.87 / 0.91 / -4.4%
appian_q08/duckdb:vortex-compact 435500653 / 441210330 / -1.3% 464746938 / 467277127 / -0.5% 0.94 / 0.94 / -0.8%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99062492 / 98800697 / +0.3% 114387825 / 107904643 / +6.0% 0.87 / 0.92 / -5.4%
appian_q02/duckdb:parquet 197419617 / 197928902 / -0.3% 196265647 / 198982598 / -1.4% 1.01 / 0.99 / +1.1%
appian_q03/duckdb:parquet 124078741 / 124015944 / +0.1% 137304918 / 132667164 / +3.5% 0.90 / 0.93 / -3.3%
appian_q04/duckdb:parquet 458374090 / 465175909 / -1.5% 460659051 / 457882220 / +0.6% 1.00 / 1.02 / -2.1%
appian_q05/duckdb:parquet 141711395 / 145461808 / -2.6% 162324707 / 157214854 / +3.3% 0.87 / 0.93 / -5.6%
appian_q06/duckdb:parquet 270450214 / 253829999 / +6.5% 243177936 / 244064208 / -0.4% 1.11 / 1.04 / +6.9%
appian_q07/duckdb:parquet 154846378 / 153536396 / +0.9% 171325614 / 164508300 / +4.1% 0.90 / 0.93 / -3.2%
appian_q08/duckdb:parquet 371158751 / 377173998 / -1.6% 375170619 / 384379106 / -2.4% 0.99 / 0.98 / +0.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR e1111f9c vs base 5d5f429a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1238050 / 1249772 / -0.9% 20512133 / 21382852 / -4.1% 0.06 / 0.06 / +3.3%
clickbench_q01/datafusion:vortex-file-compressed 5630570 / 6112813 / -7.9% 33967265 / 36081866 / -5.9% 0.17 / 0.17 / -2.2%
clickbench_q02/datafusion:vortex-file-compressed 10309302 / 9983627 / +3.3% 40061216 / 36368852 / +10.2% 🔴 0.26 / 0.27 / -6.3%
clickbench_q03/datafusion:vortex-file-compressed 11817197 / 11325860 / +4.3% 54889843 / 57863967 / -5.1% 0.22 / 0.20 / +10.0%
clickbench_q04/datafusion:vortex-file-compressed 56170296 / 56228003 / -0.1% 95732159 / 95701297 / +0.0% 0.59 / 0.59 / -0.1%
clickbench_q05/datafusion:vortex-file-compressed 73341434 / 75266498 / -2.6% 122338071 / 117527530 / +4.1% 0.60 / 0.64 / -6.4%
clickbench_q06/datafusion:vortex-file-compressed 1225444 / 1204527 / +1.7% 21191383 / 21422932 / -1.1% 0.06 / 0.06 / +2.8%
clickbench_q07/datafusion:vortex-file-compressed 9522526 / 9653502 / -1.4% 33235309 / 34615948 / -4.0% 0.29 / 0.28 / +2.7%
clickbench_q08/datafusion:vortex-file-compressed 76000079 / 77839848 / -2.4% 115856239 / 114978715 / +0.8% 0.66 / 0.68 / -3.1%
clickbench_q09/datafusion:vortex-file-compressed 170978108 / 169944900 / +0.6% 212964875 / 205468515 / +3.6% 0.80 / 0.83 / -2.9%
clickbench_q10/datafusion:vortex-file-compressed 23076300 / 23519948 / -1.9% 68418031 / 70609798 / -3.1% 0.34 / 0.33 / +1.3%
clickbench_q11/datafusion:vortex-file-compressed 26878912 / 26532370 / +1.3% 70566681 / 68869205 / +2.5% 0.38 / 0.39 / -1.1%
clickbench_q12/datafusion:vortex-file-compressed 72273312 / 72098282 / +0.2% 118979392 / 120023618 / -0.9% 0.61 / 0.60 / +1.1%
clickbench_q13/datafusion:vortex-file-compressed 118943222 / 117891716 / +0.9% 183423872 / 180874179 / +1.4% 0.65 / 0.65 / -0.5%
clickbench_q14/datafusion:vortex-file-compressed 74442241 / 77133332 / -3.5% 121643977 / 121904167 / -0.2% 0.61 / 0.63 / -3.3%
clickbench_q15/datafusion:vortex-file-compressed 60123044 / 60881068 / -1.2% 97979981 / 94590862 / +3.6% 0.61 / 0.64 / -4.7%
clickbench_q16/datafusion:vortex-file-compressed 148920795 / 149919676 / -0.7% 210324622 / 209613850 / +0.3% 0.71 / 0.72 / -1.0%
clickbench_q17/datafusion:vortex-file-compressed 149417382 / 149486223 / -0.0% 216385383 / 215262155 / +0.5% 0.69 / 0.69 / -0.6%
clickbench_q18/datafusion:vortex-file-compressed 298136492 / 295045258 / +1.0% 388811345 / 381933277 / +1.8% 0.77 / 0.77 / -0.7%
clickbench_q19/datafusion:vortex-file-compressed 7755962 / 7588718 / +2.2% 48129116 / 53086084 / -9.3% 0.16 / 0.14 / +12.7%
clickbench_q20/datafusion:vortex-file-compressed 64491008 / 62630622 / +3.0% 223961132 / 236415088 / -5.3% 0.29 / 0.26 / +8.7%
clickbench_q21/datafusion:vortex-file-compressed 91712908 / 92007585 / -0.3% 270581236 / 274903338 / -1.6% 0.34 / 0.33 / +1.3%
clickbench_q22/datafusion:vortex-file-compressed 105445318 / 104253373 / +1.1% 350213632 / 347381344 / +0.8% 0.30 / 0.30 / +0.3%
clickbench_q23/datafusion:vortex-file-compressed 197024324 / 190379974 / +3.5% 516514987 / 513227757 / +0.6% 0.38 / 0.37 / +2.8%
clickbench_q24/datafusion:vortex-file-compressed 16416458 / 16481716 / -0.4% 68806692 / 68383528 / +0.6% 0.24 / 0.24 / -1.0%
clickbench_q25/datafusion:vortex-file-compressed 18860576 / 17946734 / +5.1% 56903596 / 57865824 / -1.7% 0.33 / 0.31 / +6.9%
clickbench_q26/datafusion:vortex-file-compressed 16730984 / 16725898 / +0.0% 67197426 / 66305974 / +1.3% 0.25 / 0.25 / -1.3%
clickbench_q27/datafusion:vortex-file-compressed 99663050 / 98945566 / +0.7% 248985062 / 244402470 / +1.9% 0.40 / 0.40 / -1.1%
clickbench_q28/datafusion:vortex-file-compressed 566031720 / 568896112 / -0.5% 609452659 / 621944208 / -2.0% 0.93 / 0.91 / +1.5%
clickbench_q29/datafusion:vortex-file-compressed 23099174 / 23381045 / -1.2% 51597513 / 53616208 / -3.8% 0.45 / 0.44 / +2.7%
clickbench_q30/datafusion:vortex-file-compressed 60422087 / 57659297 / +4.8% 105618885 / 106102683 / -0.5% 0.57 / 0.54 / +5.3%
clickbench_q31/datafusion:vortex-file-compressed 69871030 / 69273988 / +0.9% 151661559 / 154257599 / -1.7% 0.46 / 0.45 / +2.6%
clickbench_q32/datafusion:vortex-file-compressed 301257004 / 296760564 / +1.5% 381813568 / 382600435 / -0.2% 0.79 / 0.78 / +1.7%
clickbench_q33/datafusion:vortex-file-compressed 330796318 / 327861368 / +0.9% 429571068 / 441659471 / -2.7% 0.77 / 0.74 / +3.7%
clickbench_q34/datafusion:vortex-file-compressed 336718444 / 326005504 / +3.3% 440655371 / 436745981 / +0.9% 0.76 / 0.75 / +2.4%
clickbench_q35/datafusion:vortex-file-compressed 55363332 / 56863599 / -2.6% 87027463 / 90041573 / -3.3% 0.64 / 0.63 / +0.7%
clickbench_q36/datafusion:vortex-file-compressed 37112124 / 37267366 / -0.4% 65767739 / 66410045 / -1.0% 0.56 / 0.56 / +0.6%
clickbench_q37/datafusion:vortex-file-compressed 22256275 / 21669964 / +2.7% 47672001 / 48897381 / -2.5% 0.47 / 0.44 / +5.3%
clickbench_q38/datafusion:vortex-file-compressed 11544208 / 11721062 / -1.5% 40281447 / 39949152 / +0.8% 0.29 / 0.29 / -2.3%
clickbench_q39/datafusion:vortex-file-compressed 78243340 / 77563774 / +0.9% 109745274 / 111512187 / -1.6% 0.71 / 0.70 / +2.5%
clickbench_q40/datafusion:vortex-file-compressed 11225842 / 11466282 / -2.1% 37277818 / 37669553 / -1.0% 0.30 / 0.30 / -1.1%
clickbench_q41/datafusion:vortex-file-compressed 10426541 / 10681742 / -2.4% 36056342 / 37368993 / -3.5% 0.29 / 0.29 / +1.2%
clickbench_q42/datafusion:vortex-file-compressed 10990876 / 10697666 / +2.7% 36034360 / 36290164 / -0.7% 0.31 / 0.29 / +3.5%
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1238745 / 1211883 / +2.2% 20198857 / 20642604 / -2.1% 0.06 / 0.06 / +4.5%
clickbench_q01/datafusion:vortex-compact 6723850 / 7196266 / -6.6% 33826782 / 33080383 / +2.3% 0.20 / 0.22 / -8.6%
clickbench_q02/datafusion:vortex-compact 20715658 / 20278832 / +2.2% 42682067 / 49333472 / -13.5% 🟢 0.49 / 0.41 / +18.1%
clickbench_q03/datafusion:vortex-compact 13852297 / 13716217 / +1.0% 39453904 / 42107833 / -6.3% 0.35 / 0.33 / +7.8%
clickbench_q04/datafusion:vortex-compact 56706603 / 57659558 / -1.7% 86503335 / 88550976 / -2.3% 0.66 / 0.65 / +0.7%
clickbench_q05/datafusion:vortex-compact 85325024 / 82097251 / +3.9% 123795677 / 121912305 / +1.5% 0.69 / 0.67 / +2.4%
clickbench_q06/datafusion:vortex-compact 1245310 / 1211664 / +2.8% 20764262 / 19541598 / +6.3% 0.06 / 0.06 / -3.3%
clickbench_q07/datafusion:vortex-compact 12296222 / 12157934 / +1.1% 36397959 / 35045780 / +3.9% 0.34 / 0.35 / -2.6%
clickbench_q08/datafusion:vortex-compact 87055274 / 85620800 / +1.7% 117049130 / 117185257 / -0.1% 0.74 / 0.73 / +1.8%
clickbench_q09/datafusion:vortex-compact 191589720 / 188114238 / +1.8% 221254138 / 216324161 / +2.3% 0.87 / 0.87 / -0.4%
clickbench_q10/datafusion:vortex-compact 43546952 / 43109190 / +1.0% 72199016 / 69278421 / +4.2% 0.60 / 0.62 / -3.1%
clickbench_q11/datafusion:vortex-compact 55266444 / 55196306 / +0.1% 81238694 / 82932540 / -2.0% 0.68 / 0.67 / +2.2%
clickbench_q12/datafusion:vortex-compact 84733174 / 86780121 / -2.4% 121433558 / 127749231 / -4.9% 0.70 / 0.68 / +2.7%
clickbench_q13/datafusion:vortex-compact 134951472 / 132741280 / +1.7% 183883118 / 178689359 / +2.9% 0.73 / 0.74 / -1.2%
clickbench_q14/datafusion:vortex-compact 88884776 / 94117624 / -5.6% 135805626 / 127555612 / +6.5% 0.65 / 0.74 / -11.3%
clickbench_q15/datafusion:vortex-compact 63648446 / 64058556 / -0.6% 96882499 / 92433429 / +4.8% 0.66 / 0.69 / -5.2%
clickbench_q16/datafusion:vortex-compact 162578098 / 161969550 / +0.4% 219957677 / 219866526 / +0.0% 0.74 / 0.74 / +0.3%
clickbench_q17/datafusion:vortex-compact 161593557 / 160873768 / +0.4% 220773414 / 214099027 / +3.1% 0.73 / 0.75 / -2.6%
clickbench_q18/datafusion:vortex-compact 295898886 / 295214223 / +0.2% 364303813 / 379452073 / -4.0% 0.81 / 0.78 / +4.4%
clickbench_q19/datafusion:vortex-compact 9767150 / 10026920 / -2.6% 39040102 / 38589018 / +1.2% 0.25 / 0.26 / -3.7%
clickbench_q20/datafusion:vortex-compact 71877404 / 71218050 / +0.9% 191719706 / 194632926 / -1.5% 0.37 / 0.37 / +2.5%
clickbench_q21/datafusion:vortex-compact 116774196 / 114953487 / +1.6% 228487553 / 230072388 / -0.7% 0.51 / 0.50 / +2.3%
clickbench_q22/datafusion:vortex-compact 183909176 / 183042372 / +0.5% 271484975 / 270320968 / +0.4% 0.68 / 0.68 / +0.0%
clickbench_q23/datafusion:vortex-compact 527526234 / 583658074 / -9.6% 636576517 / 711009538 / -10.5% 🟢 0.83 / 0.82 / +1.0%
clickbench_q24/datafusion:vortex-compact 27597743 / 28113760 / -1.8% 59824719 / 61592113 / -2.9% 0.46 / 0.46 / +1.1%
clickbench_q25/datafusion:vortex-compact 37562695 / 36607477 / +2.6% 65457189 / 67959787 / -3.7% 0.57 / 0.54 / +6.5%
clickbench_q26/datafusion:vortex-compact 28648724 / 28345088 / +1.1% 59978127 / 61919796 / -3.1% 0.48 / 0.46 / +4.3%
clickbench_q27/datafusion:vortex-compact 104426638 / 103284014 / +1.1% 210182887 / 212756517 / -1.2% 0.50 / 0.49 / +2.3%
clickbench_q28/datafusion:vortex-compact 585445294 / 583242187 / +0.4% 624685869 / 616519699 / +1.3% 0.94 / 0.95 / -0.9%
clickbench_q29/datafusion:vortex-compact 31204434 / 30608138 / +1.9% 55540807 / 55383413 / +0.3% 0.56 / 0.55 / +1.7%
clickbench_q30/datafusion:vortex-compact 94402470 / 96220774 / -1.9% 126125549 / 128619293 / -1.9% 0.75 / 0.75 / +0.1%
clickbench_q31/datafusion:vortex-compact 100601837 / 99652644 / +1.0% 150777515 / 155839246 / -3.2% 0.67 / 0.64 / +4.3%
clickbench_q32/datafusion:vortex-compact 303118549 / 301843114 / +0.4% 383315935 / 383721468 / -0.1% 0.79 / 0.79 / +0.5%
clickbench_q33/datafusion:vortex-compact 337636824 / 337871038 / -0.1% 425780744 / 416166264 / +2.3% 0.79 / 0.81 / -2.3%
clickbench_q34/datafusion:vortex-compact 341692950 / 342434126 / -0.2% 424741557 / 430812133 / -1.4% 0.80 / 0.79 / +1.2%
clickbench_q35/datafusion:vortex-compact 61507140 / 61840180 / -0.5% 89762795 / 94488406 / -5.0% 0.69 / 0.65 / +4.7%
clickbench_q36/datafusion:vortex-compact 38215478 / 38216458 / -0.0% 66896708 / 66108533 / +1.2% 0.57 / 0.58 / -1.2%
clickbench_q37/datafusion:vortex-compact 22201534 / 22554594 / -1.6% 47422696 / 46960147 / +1.0% 0.47 / 0.48 / -2.5%
clickbench_q38/datafusion:vortex-compact 12630677 / 12577096 / +0.4% 39344722 / 38864845 / +1.2% 0.32 / 0.32 / -0.8%
clickbench_q39/datafusion:vortex-compact 78415440 / 78940364 / -0.7% 111195923 / 112534556 / -1.2% 0.71 / 0.70 / +0.5%
clickbench_q40/datafusion:vortex-compact 12304024 / 12618191 / -2.5% 38018353 / 37453253 / +1.5% 0.32 / 0.34 / -3.9%
clickbench_q41/datafusion:vortex-compact 12872098 / 12681346 / +1.5% 36552178 / 37987983 / -3.8% 0.35 / 0.33 / +5.5%
clickbench_q42/datafusion:vortex-compact 11698164 / 10839832 / +7.9% 35084672 / 35412179 / -0.9% 0.33 / 0.31 / +8.9%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1250762 / 1264313 / -1.1% 51071427 / 48724100 / +4.8% 0.02 / 0.03 / -5.6%
clickbench_q01/datafusion:parquet 15693828 / 15681910 / +0.1% 69001891 / 66990387 / +3.0% 0.23 / 0.23 / -2.8%
clickbench_q02/datafusion:parquet 19967838 / 18652594 / +7.1% 82522424 / 83764772 / -1.5% 0.24 / 0.22 / +8.7%
clickbench_q03/datafusion:parquet 16882956 / 16855820 / +0.2% 82236877 / 81476563 / +0.9% 0.21 / 0.21 / -0.8%
clickbench_q04/datafusion:parquet 61717575 / 62354400 / -1.0% 132124097 / 127442228 / +3.7% 0.47 / 0.49 / -4.5%
clickbench_q05/datafusion:parquet 88921541 / 88983424 / -0.1% 163938289 / 159031405 / +3.1% 0.54 / 0.56 / -3.1%
clickbench_q06/datafusion:parquet 1265202 / 1259504 / +0.5% 50157463 / 48216505 / +4.0% 0.03 / 0.03 / -3.4%
clickbench_q07/datafusion:parquet 16465432 / 16663612 / -1.2% 69670686 / 67947591 / +2.5% 0.24 / 0.25 / -3.6%
clickbench_q08/datafusion:parquet 85858088 / 84092782 / +2.1% 164109213 / 161752803 / +1.5% 0.52 / 0.52 / +0.6%
clickbench_q09/datafusion:parquet 189896211 / 190112832 / -0.1% 271107016 / 277721678 / -2.4% 0.70 / 0.68 / +2.3%
clickbench_q10/datafusion:parquet 36592294 / 36243829 / +1.0% 102035564 / 100685896 / +1.3% 0.36 / 0.36 / -0.4%
clickbench_q11/datafusion:parquet 43770306 / 42564531 / +2.8% 112439340 / 111883552 / +0.5% 0.39 / 0.38 / +2.3%
clickbench_q12/datafusion:parquet 96653384 / 95972157 / +0.7% 164255046 / 163905770 / +0.2% 0.59 / 0.59 / +0.5%
clickbench_q13/datafusion:parquet 147919384 / 148170135 / -0.2% 227166181 / 228712423 / -0.7% 0.65 / 0.65 / +0.5%
clickbench_q14/datafusion:parquet 102498089 / 101902802 / +0.6% 177432856 / 173381238 / +2.3% 0.58 / 0.59 / -1.7%
clickbench_q15/datafusion:parquet 70861642 / 69341860 / +2.2% 133957734 / 130659753 / +2.5% 0.53 / 0.53 / -0.3%
clickbench_q16/datafusion:parquet 157623746 / 154183398 / +2.2% 239852059 / 237562163 / +1.0% 0.66 / 0.65 / +1.3%
clickbench_q17/datafusion:parquet 156722172 / 156918136 / -0.1% 240328157 / 242174537 / -0.8% 0.65 / 0.65 / +0.6%
clickbench_q18/datafusion:parquet 314481445 / 314140768 / +0.1% 423507891 / 426881774 / -0.8% 0.74 / 0.74 / +0.9%
clickbench_q19/datafusion:parquet 18372074 / 18823550 / -2.4% 78215887 / 77728434 / +0.6% 0.23 / 0.24 / -3.0%
clickbench_q20/datafusion:parquet 179555716 / 179741969 / -0.1% 288965127 / 290700279 / -0.6% 0.62 / 0.62 / +0.5%
clickbench_q21/datafusion:parquet 173714983 / 174747426 / -0.6% 303625815 / 302686942 / +0.3% 0.57 / 0.58 / -0.9%
clickbench_q22/datafusion:parquet 262522362 / 262731794 / -0.1% 433264150 / 427686623 / +1.3% 0.61 / 0.61 / -1.4%
clickbench_q23/datafusion:parquet 1166006233 / 1179357602 / -1.1% 1259559346 / 1239360958 / +1.6% 0.93 / 0.95 / -2.7%
clickbench_q24/datafusion:parquet 30487181 / 30018656 / +1.6% 89454988 / 87861089 / +1.8% 0.34 / 0.34 / -0.2%
clickbench_q25/datafusion:parquet 37162757 / 37625160 / -1.2% 106840513 / 102899196 / +3.8% 0.35 / 0.37 / -4.9%
clickbench_q26/datafusion:parquet 30512076 / 31137428 / -2.0% 90934744 / 90462672 / +0.5% 0.34 / 0.34 / -2.5%
clickbench_q27/datafusion:parquet 195300340 / 193821272 / +0.8% 294453293 / 286997098 / +2.6% 0.66 / 0.68 / -1.8%
clickbench_q28/datafusion:parquet 627237246 / 619140586 / +1.3% 712559019 / 708044210 / +0.6% 0.88 / 0.87 / +0.7%
clickbench_q29/datafusion:parquet 29482378 / 29558458 / -0.3% 91961050 / 93690736 / -1.8% 0.32 / 0.32 / +1.6%
clickbench_q30/datafusion:parquet 90667892 / 91109589 / -0.5% 176071976 / 173243152 / +1.6% 0.51 / 0.53 / -2.1%
clickbench_q31/datafusion:parquet 104071558 / 103690290 / +0.4% 206119812 / 206020248 / +0.0% 0.50 / 0.50 / +0.3%
clickbench_q32/datafusion:parquet 327969044 / 326182420 / +0.5% 434112162 / 434164702 / -0.0% 0.76 / 0.75 / +0.6%
clickbench_q33/datafusion:parquet 384642002 / 381497446 / +0.8% 484537663 / 479037319 / +1.1% 0.79 / 0.80 / -0.3%
clickbench_q34/datafusion:parquet 382954813 / 381838620 / +0.3% 482273443 / 480957180 / +0.3% 0.79 / 0.79 / +0.0%
clickbench_q35/datafusion:parquet 63757922 / 65706285 / -3.0% 125215464 / 125911404 / -0.6% 0.51 / 0.52 / -2.4%
clickbench_q36/datafusion:parquet 73448458 / 73424006 / +0.0% 137785917 / 135371679 / +1.8% 0.53 / 0.54 / -1.7%
clickbench_q37/datafusion:parquet 35486366 / 35709838 / -0.6% 92149460 / 91508355 / +0.7% 0.39 / 0.39 / -1.3%
clickbench_q38/datafusion:parquet 47276458 / 47756010 / -1.0% 110137206 / 110971578 / -0.8% 0.43 / 0.43 / -0.3%
clickbench_q39/datafusion:parquet 143729257 / 143901402 / -0.1% 212244144 / 212213500 / +0.0% 0.68 / 0.68 / -0.1%
clickbench_q40/datafusion:parquet 19410426 / 20202106 / -3.9% 79259029 / 77865691 / +1.8% 0.24 / 0.26 / -5.6%
clickbench_q41/datafusion:parquet 18723816 / 18672566 / +0.3% 77622074 / 75774572 / +2.4% 0.24 / 0.25 / -2.1%
clickbench_q42/datafusion:parquet 19089999 / 19080939 / +0.0% 76595828 / 75162022 / +1.9% 0.25 / 0.25 / -1.8%
duckdb / vortex-file-compressed / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1533824 / 1561394 / -1.8% 28839081 / 25033300 / +15.2% 🔴 0.05 / 0.06 / -14.7%
clickbench_q01/duckdb:vortex-file-compressed 12351450 / 12398604 / -0.4% 35505381 / 30901897 / +14.9% 🔴 0.35 / 0.40 / -13.3%
clickbench_q02/duckdb:vortex-file-compressed 13149408 / 12679162 / +3.7% 36023541 / 32853074 / +9.7% 0.37 / 0.39 / -5.4%
clickbench_q03/duckdb:vortex-file-compressed 18412525 / 18156829 / +1.4% 53277957 / 54843081 / -2.9% 0.35 / 0.33 / +4.4%
clickbench_q04/duckdb:vortex-file-compressed 69863618 / 71158187 / -1.8% 105669440 / 111553745 / -5.3% 0.66 / 0.64 / +3.6%
clickbench_q05/duckdb:vortex-file-compressed 70963438 / 69081878 / +2.7% 98656523 / 92930346 / +6.2% 0.72 / 0.74 / -3.2%
clickbench_q06/duckdb:vortex-file-compressed 1874495 / 1840296 / +1.9% 29426507 / 29163627 / +0.9% 0.06 / 0.06 / +0.9%
clickbench_q07/duckdb:vortex-file-compressed 13966722 / 13458912 / +3.8% 34789216 / 29479334 / +18.0% 🔴 0.40 / 0.46 / -12.1%
clickbench_q08/duckdb:vortex-file-compressed 82692363 / 84357248 / -2.0% 125650974 / 128663777 / -2.3% 0.66 / 0.66 / +0.4%
clickbench_q09/duckdb:vortex-file-compressed 107505900 / 107883814 / -0.4% 149587296 / 154199371 / -3.0% 0.72 / 0.70 / +2.7%
clickbench_q10/duckdb:vortex-file-compressed 32160825 / 32708958 / -1.7% 71387355 / 73252181 / -2.5% 0.45 / 0.45 / +0.9%
clickbench_q11/duckdb:vortex-file-compressed 34874002 / 34488264 / +1.1% 75501353 / 77858060 / -3.0% 0.46 / 0.44 / +4.3%
clickbench_q12/duckdb:vortex-file-compressed 74374980 / 73960784 / +0.6% 106853768 / 106108376 / +0.7% 0.70 / 0.70 / -0.1%
clickbench_q13/duckdb:vortex-file-compressed 133569214 / 144313326 / -7.4% 186248808 / 183432732 / +1.5% 0.72 / 0.79 / -8.8%
clickbench_q14/duckdb:vortex-file-compressed 78461424 / 78401163 / +0.1% 112824529 / 111148912 / +1.5% 0.70 / 0.71 / -1.4%
clickbench_q15/duckdb:vortex-file-compressed 90536006 / 92207228 / -1.8% 134320134 / 133307902 / +0.8% 0.67 / 0.69 / -2.6%
clickbench_q16/duckdb:vortex-file-compressed 161509036 / 161019895 / +0.3% 213846873 / 229613475 / -6.9% 0.76 / 0.70 / +7.7%
clickbench_q17/duckdb:vortex-file-compressed 164080930 / 166041774 / -1.2% 215641703 / 229609347 / -6.1% 0.76 / 0.72 / +5.2%
clickbench_q18/duckdb:vortex-file-compressed 323930376 / 316062976 / +2.5% 382249336 / 384545384 / -0.6% 0.85 / 0.82 / +3.1%
clickbench_q19/duckdb:vortex-file-compressed 15717318 / 16244759 / -3.2% 43075983 / 43836572 / -1.7% 0.36 / 0.37 / -1.5%
clickbench_q20/duckdb:vortex-file-compressed 109221266 / 110249172 / -0.9% 190251283 / 192646742 / -1.2% 0.57 / 0.57 / +0.3%
clickbench_q21/duckdb:vortex-file-compressed 155634398 / 151915332 / +2.4% 310582923 / 295451981 / +5.1% 0.50 / 0.51 / -2.5%
clickbench_q22/duckdb:vortex-file-compressed 230914824 / 231874526 / -0.4% 464597319 / 468621178 / -0.9% 0.50 / 0.49 / +0.4%
clickbench_q23/duckdb:vortex-file-compressed 57033650 / 59938828 / -4.8% 111342800 / 96969093 / +14.8% 🔴 0.51 / 0.62 / -17.1%
clickbench_q24/duckdb:vortex-file-compressed 26738794 / 26761098 / -0.1% 47046354 / 44797376 / +5.0% 0.57 / 0.60 / -4.9%
clickbench_q25/duckdb:vortex-file-compressed 30541992 / 31503906 / -3.1% 49301353 / 55718721 / -11.5% 🟢 0.62 / 0.57 / +9.6%
clickbench_q26/duckdb:vortex-file-compressed 22336624 / 20743612 / +7.7% 42232050 / 37767474 / +11.8% 🔴 0.53 / 0.55 / -3.7%
clickbench_q27/duckdb:vortex-file-compressed 132247340 / 137118160 / -3.6% 257748805 / 252370050 / +2.1% 0.51 / 0.54 / -5.6%
clickbench_q28/duckdb:vortex-file-compressed 969664084 / 823713560 / +17.7% 🔴 669151047 / 685173628 / -2.3% 1.45 / 1.20 / +20.5%
clickbench_q29/duckdb:vortex-file-compressed 17852638 / 18813340 / -5.1% 41151857 / 38248999 / +7.6% 0.43 / 0.49 / -11.8%
clickbench_q30/duckdb:vortex-file-compressed 66451786 / 64202710 / +3.5% 111701871 / 114660966 / -2.6% 0.59 / 0.56 / +6.2%
clickbench_q31/duckdb:vortex-file-compressed 123412350 / 125114406 / -1.4% 209569638 / 212528843 / -1.4% 0.59 / 0.59 / +0.0%
clickbench_q32/duckdb:vortex-file-compressed 428011674 / 457237921 / -6.4% 475825175 / 498128899 / -4.5% 0.90 / 0.92 / -2.0%
clickbench_q33/duckdb:vortex-file-compressed 389942911 / 400669871 / -2.7% 501520013 / 500980988 / +0.1% 0.78 / 0.80 / -2.8%
clickbench_q34/duckdb:vortex-file-compressed 413648136 / 409792856 / +0.9% 539699320 / 522932245 / +3.2% 0.77 / 0.78 / -2.2%
clickbench_q35/duckdb:vortex-file-compressed 100812570 / 102727690 / -1.9% 155966623 / 148707532 / +4.9% 0.65 / 0.69 / -6.4%
clickbench_q36/duckdb:vortex-file-compressed 16245257 / 15611776 / +4.1% 31711501 / 32167578 / -1.4% 0.51 / 0.49 / +5.6%
clickbench_q37/duckdb:vortex-file-compressed 11904186 / 11900604 / +0.0% 26058562 / 26213386 / -0.6% 0.46 / 0.45 / +0.6%
clickbench_q38/duckdb:vortex-file-compressed 13014374 / 13057770 / -0.3% 28281140 / 28594646 / -1.1% 0.46 / 0.46 / +0.8%
clickbench_q39/duckdb:vortex-file-compressed 23663829 / 22558261 / +4.9% 39319739 / 41028927 / -4.2% 0.60 / 0.55 / +9.5%
clickbench_q40/duckdb:vortex-file-compressed 12136634 / 11546980 / +5.1% 28321042 / 27958571 / +1.3% 0.43 / 0.41 / +3.8%
clickbench_q41/duckdb:vortex-file-compressed 10881142 / 12104156 / -10.1% 🟢 27388341 / 26463545 / +3.5% 0.40 / 0.46 / -13.1%
clickbench_q42/duckdb:vortex-file-compressed 11134551 / 11478740 / -3.0% 29095023 / 29482491 / -1.3% 0.38 / 0.39 / -1.7%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1596298 / 1616970 / -1.3% 24858135 / 24963298 / -0.4% 0.06 / 0.06 / -0.9%
clickbench_q01/duckdb:vortex-compact 15560796 / 12782874 / +21.7% 🔴 28722833 / 29095456 / -1.3% 0.54 / 0.44 / +23.3%
clickbench_q02/duckdb:vortex-compact 18289488 / 19685265 / -7.1% 39878242 / 42826689 / -6.9% 0.46 / 0.46 / -0.2%
clickbench_q03/duckdb:vortex-compact 20744974 / 20605036 / +0.7% 50858114 / 46778555 / +8.7% 0.41 / 0.44 / -7.4%
clickbench_q04/duckdb:vortex-compact 72599124 / 73654494 / -1.4% 107176985 / 109208240 / -1.9% 0.68 / 0.67 / +0.4%
clickbench_q05/duckdb:vortex-compact 74801623 / 81666862 / -8.4% 101937480 / 103961055 / -1.9% 0.73 / 0.79 / -6.6%
clickbench_q06/duckdb:vortex-compact 1826204 / 1845579 / -1.0% 33381030 / 28132353 / +18.7% 🔴 0.05 / 0.07 / -16.6%
clickbench_q07/duckdb:vortex-compact 16311312 / 15998597 / +2.0% 37330235 / 36330613 / +2.8% 0.44 / 0.44 / -0.8%
clickbench_q08/duckdb:vortex-compact 94173120 / 100592540 / -6.4% 134926802 / 130535356 / +3.4% 0.70 / 0.77 / -9.4%
clickbench_q09/duckdb:vortex-compact 143359228 / 143004401 / +0.2% 180500248 / 186432432 / -3.2% 0.79 / 0.77 / +3.5%
clickbench_q10/duckdb:vortex-compact 54392578 / 53665324 / +1.4% 90060107 / 90972383 / -1.0% 0.60 / 0.59 / +2.4%
clickbench_q11/duckdb:vortex-compact 65264872 / 66602134 / -2.0% 101917510 / 104746467 / -2.7% 0.64 / 0.64 / +0.7%
clickbench_q12/duckdb:vortex-compact 87030998 / 87207649 / -0.2% 124655486 / 124353631 / +0.2% 0.70 / 0.70 / -0.4%
clickbench_q13/duckdb:vortex-compact 164328304 / 166532690 / -1.3% 211795954 / 212839955 / -0.5% 0.78 / 0.78 / -0.8%
clickbench_q14/duckdb:vortex-compact 97097296 / 103103278 / -5.8% 135773486 / 134421315 / +1.0% 0.72 / 0.77 / -6.8%
clickbench_q15/duckdb:vortex-compact 99875941 / 95361460 / +4.7% 134911748 / 131709705 / +2.4% 0.74 / 0.72 / +2.2%
clickbench_q16/duckdb:vortex-compact 185079038 / 181348085 / +2.1% 250974730 / 232643135 / +7.9% 0.74 / 0.78 / -5.4%
clickbench_q17/duckdb:vortex-compact 192031255 / 181975060 / +5.5% 231627320 / 245572788 / -5.7% 0.83 / 0.74 / +11.9%
clickbench_q18/duckdb:vortex-compact 332380671 / 339239344 / -2.0% 398658010 / 377851234 / +5.5% 0.83 / 0.90 / -7.1%
clickbench_q19/duckdb:vortex-compact 17712910 / 16286924 / +8.8% 41958275 / 39785645 / +5.5% 0.42 / 0.41 / +3.1%
clickbench_q20/duckdb:vortex-compact 105851424 / 107947165 / -1.9% 177963492 / 183414628 / -3.0% 0.59 / 0.59 / +1.1%
clickbench_q21/duckdb:vortex-compact 172126494 / 172359845 / -0.1% 320734678 / 321864288 / -0.4% 0.54 / 0.54 / +0.2%
clickbench_q22/duckdb:vortex-compact 344537181 / 347933104 / -1.0% 569881406 / 568061154 / +0.3% 0.60 / 0.61 / -1.3%
clickbench_q23/duckdb:vortex-compact 93675780 / 97131911 / -3.6% 124590574 / 129098063 / -3.5% 0.75 / 0.75 / -0.1%
clickbench_q24/duckdb:vortex-compact 31979188 / 31294980 / +2.2% 45224849 / 46173326 / -2.1% 0.71 / 0.68 / +4.3%
clickbench_q25/duckdb:vortex-compact 47359366 / 46358195 / +2.2% 72022329 / 74373917 / -3.2% 0.66 / 0.62 / +5.5%
clickbench_q26/duckdb:vortex-compact 24534030 / 26096526 / -6.0% 40313952 / 41423048 / -2.7% 0.61 / 0.63 / -3.4%
clickbench_q27/duckdb:vortex-compact 189227552 / 182062126 / +3.9% 305253891 / 309803781 / -1.5% 0.62 / 0.59 / +5.5%
clickbench_q28/duckdb:vortex-compact 578581220 / 585117719 / -1.1% 719211375 / 700211393 / +2.7% 0.80 / 0.84 / -3.7%
clickbench_q29/duckdb:vortex-compact 23078414 / 21588723 / +6.9% 42308916 / 44453894 / -4.8% 0.55 / 0.49 / +12.3%
clickbench_q30/duckdb:vortex-compact 112012106 / 111320085 / +0.6% 161710258 / 155191563 / +4.2% 0.69 / 0.72 / -3.4%
clickbench_q31/duckdb:vortex-compact 174997816 / 173959332 / +0.6% 245920224 / 250495388 / -1.8% 0.71 / 0.69 / +2.5%
clickbench_q32/duckdb:vortex-compact 458772962 / 466770510 / -1.7% 498070709 / 511355771 / -2.6% 0.92 / 0.91 / +0.9%
clickbench_q33/duckdb:vortex-compact 400956502 / 394171676 / +1.7% 502232545 / 499798759 / +0.5% 0.80 / 0.79 / +1.2%
clickbench_q34/duckdb:vortex-compact 415796826 / 414327918 / +0.4% 535954766 / 563331610 / -4.9% 0.78 / 0.74 / +5.5%
clickbench_q35/duckdb:vortex-compact 107465109 / 106871352 / +0.6% 136954256 / 140766491 / -2.7% 0.78 / 0.76 / +3.4%
clickbench_q36/duckdb:vortex-compact 16898902 / 17475164 / -3.3% 35234848 / 31613888 / +11.5% 🔴 0.48 / 0.55 / -13.2%
clickbench_q37/duckdb:vortex-compact 13794577 / 14147704 / -2.5% 29035659 / 29565530 / -1.8% 0.48 / 0.48 / -0.7%
clickbench_q38/duckdb:vortex-compact 12655430 / 13269098 / -4.6% 30892653 / 28982125 / +6.6% 0.41 / 0.46 / -10.5%
clickbench_q39/duckdb:vortex-compact 25936081 / 26976520 / -3.9% 49974485 / 47808528 / +4.5% 0.52 / 0.56 / -8.0%
clickbench_q40/duckdb:vortex-compact 12244942 / 11984486 / +2.2% 29767689 / 29152962 / +2.1% 0.41 / 0.41 / +0.1%
clickbench_q41/duckdb:vortex-compact 11721498 / 12142022 / -3.5% 29657541 / 28736857 / +3.2% 0.40 / 0.42 / -6.5%
clickbench_q42/duckdb:vortex-compact 12088750 / 11858356 / +1.9% 27456519 / 29169956 / -5.9% 0.44 / 0.41 / +8.3%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8339800 / 9134626 / -8.7% 22637433 / 30488359 / -25.8% 🟢 0.37 / 0.30 / +23.0%
clickbench_q01/duckdb:parquet 9522900 / 9810858 / -2.9% 20799168 / 21925758 / -5.1% 0.46 / 0.45 / +2.3%
clickbench_q02/duckdb:parquet 16335694 / 17052210 / -4.2% 33354082 / 32178101 / +3.7% 0.49 / 0.53 / -7.6%
clickbench_q03/duckdb:parquet 16044728 / 16807390 / -4.5% 55877592 / 55299167 / +1.0% 0.29 / 0.30 / -5.5%
clickbench_q04/duckdb:parquet 68063951 / 74089885 / -8.1% 99300488 / 90946011 / +9.2% 0.69 / 0.81 / -15.9%
clickbench_q05/duckdb:parquet 81227473 / 79471071 / +2.2% 126995089 / 124251468 / +2.2% 0.64 / 0.64 / +0.0%
clickbench_q06/duckdb:parquet 14785418 / 14764384 / +0.1% 26491998 / 26835799 / -1.3% 0.56 / 0.55 / +1.4%
clickbench_q07/duckdb:parquet 10694910 / 11423430 / -6.4% 25066957 / 23654668 / +6.0% 0.43 / 0.48 / -11.7%
clickbench_q08/duckdb:parquet 90030530 / 88214262 / +2.1% 130500665 / 128926134 / +1.2% 0.69 / 0.68 / +0.8%
clickbench_q09/duckdb:parquet 114839592 / 115247994 / -0.4% 161844184 / 164135297 / -1.4% 0.71 / 0.70 / +1.1%
clickbench_q10/duckdb:parquet 32160700 / 33264970 / -3.3% 72893158 / 69624031 / +4.7% 0.44 / 0.48 / -7.7%
clickbench_q11/duckdb:parquet 37609167 / 37038547 / +1.5% 77586852 / 76042788 / +2.0% 0.48 / 0.49 / -0.5%
clickbench_q12/duckdb:parquet 97776416 / 92996412 / +5.1% 129779177 / 142526935 / -8.9% 0.75 / 0.65 / +15.5%
clickbench_q13/duckdb:parquet 150591474 / 146392821 / +2.9% 221103107 / 210936674 / +4.8% 0.68 / 0.69 / -1.9%
clickbench_q14/duckdb:parquet 97644082 / 96834845 / +0.8% 144802796 / 141895485 / +2.0% 0.67 / 0.68 / -1.2%
clickbench_q15/duckdb:parquet 91253818 / 92437251 / -1.3% 121683098 / 121943536 / -0.2% 0.75 / 0.76 / -1.1%
clickbench_q16/duckdb:parquet 174604736 / 172627216 / +1.1% 234434240 / 227426894 / +3.1% 0.74 / 0.76 / -1.9%
clickbench_q17/duckdb:parquet 189733315 / 176199740 / +7.7% 231922213 / 237401186 / -2.3% 0.82 / 0.74 / +10.2%
clickbench_q18/duckdb:parquet 323613216 / 323907430 / -0.1% 423317630 / 456897027 / -7.3% 0.76 / 0.71 / +7.8%
clickbench_q19/duckdb:parquet 13631424 / 13316024 / +2.4% 41762770 / 42561188 / -1.9% 0.33 / 0.31 / +4.3%
clickbench_q20/duckdb:parquet 135861314 / 132760814 / +2.3% 240032736 / 248189107 / -3.3% 0.57 / 0.53 / +5.8%
clickbench_q21/duckdb:parquet 180592739 / 180463383 / +0.1% 324115601 / 318756815 / +1.7% 0.56 / 0.57 / -1.6%
clickbench_q22/duckdb:parquet 254426052 / 251767773 / +1.1% 418213945 / 415764725 / +0.6% 0.61 / 0.61 / +0.5%
clickbench_q23/duckdb:parquet 143872956 / 147469200 / -2.4% 169275925 / 166462024 / +1.7% 0.85 / 0.89 / -4.1%
clickbench_q24/duckdb:parquet 42772442 / 43064617 / -0.7% 63867236 / 66238694 / -3.6% 0.67 / 0.65 / +3.0%
clickbench_q25/duckdb:parquet 43993999 / 40385302 / +8.9% 89924277 / 91740680 / -2.0% 0.49 / 0.44 / +11.1%
clickbench_q26/duckdb:parquet 29995460 / 32467760 / -7.6% 47095651 / 54936972 / -14.3% 🟢 0.64 / 0.59 / +7.8%
clickbench_q27/duckdb:parquet 148383154 / 145551448 / +1.9% 259391646 / 256701600 / +1.0% 0.57 / 0.57 / +0.9%
clickbench_q28/duckdb:parquet 900135733 / 901163438 / -0.1% 1067901403 / 986624183 / +8.2% 0.84 / 0.91 / -7.7%
clickbench_q29/duckdb:parquet 17952210 / 17469140 / +2.8% 32894713 / 32183078 / +2.2% 0.55 / 0.54 / +0.5%
clickbench_q30/duckdb:parquet 90145448 / 92907712 / -3.0% 176771183 / 176226242 / +0.3% 0.51 / 0.53 / -3.3%
clickbench_q31/duckdb:parquet 144163301 / 153485588 / -6.1% 290403501 / 292761830 / -0.8% 0.50 / 0.52 / -5.3%
clickbench_q32/duckdb:parquet 465251542 / 429139808 / +8.4% 499894826 / 472873666 / +5.7% 0.93 / 0.91 / +2.6%
clickbench_q33/duckdb:parquet 452600570 / 468559710 / -3.4% 503663950 / 496680805 / +1.4% 0.90 / 0.94 / -4.7%
clickbench_q34/duckdb:parquet 465648394 / 469377724 / -0.8% 485348385 / 490466109 / -1.0% 0.96 / 0.96 / +0.3%
clickbench_q35/duckdb:parquet 101957052 / 102096934 / -0.1% 121115840 / 118828417 / +1.9% 0.84 / 0.86 / -2.0%
clickbench_q36/duckdb:parquet 30706954 / 31030177 / -1.0% 41662563 / 40021767 / +4.1% 0.74 / 0.78 / -4.9%
clickbench_q37/duckdb:parquet 22609024 / 22998674 / -1.7% 31516270 / 32222019 / -2.2% 0.72 / 0.71 / +0.5%
clickbench_q38/duckdb:parquet 23961718 / 23617166 / +1.5% 33464196 / 33018625 / +1.3% 0.72 / 0.72 / +0.1%
clickbench_q39/duckdb:parquet 55997169 / 56290754 / -0.5% 66001610 / 64926484 / +1.7% 0.85 / 0.87 / -2.1%
clickbench_q40/duckdb:parquet 12544362 / 12986170 / -3.4% 22654222 / 21756552 / +4.1% 0.55 / 0.60 / -7.2%
clickbench_q41/duckdb:parquet 13239325 / 12935104 / +2.4% 22311349 / 22774362 / -2.0% 0.59 / 0.57 / +4.5%
clickbench_q42/duckdb:parquet 14429992 / 14015284 / +3.0% 24128389 / 24226404 / -0.4% 0.60 / 0.58 / +3.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.993x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24180140 / 24429947 / -1.0% 44952456 / 44902943 / +0.1% 0.54 / 0.54 / -1.1%
tpcds_q02/datafusion:vortex-file-compressed 44815654 / 45687131 / -1.9% 63523755 / 63422819 / +0.2% 0.71 / 0.72 / -2.1%
tpcds_q03/datafusion:vortex-file-compressed 11376302 / 11737884 / -3.1% 30042229 / 30478785 / -1.4% 0.38 / 0.39 / -1.7%
tpcds_q04/datafusion:vortex-file-compressed 113318266 / 113280119 / +0.0% 142456029 / 142008811 / +0.3% 0.80 / 0.80 / -0.3%
tpcds_q05/datafusion:vortex-file-compressed 61643624 / 60109952 / +2.6% 82498600 / 84335989 / -2.2% 0.75 / 0.71 / +4.8%
tpcds_q06/datafusion:vortex-file-compressed 23779283 / 23460251 / +1.4% 47504429 / 47820309 / -0.7% 0.50 / 0.49 / +2.0%
tpcds_q07/datafusion:vortex-file-compressed 32302090 / 32870840 / -1.7% 56361536 / 60691972 / -7.1% 0.57 / 0.54 / +5.8%
tpcds_q08/datafusion:vortex-file-compressed 25157000 / 25385096 / -0.9% 45290327 / 45541184 / -0.6% 0.56 / 0.56 / -0.3%
tpcds_q09/datafusion:vortex-file-compressed 17244940 / 17407064 / -0.9% 35312170 / 35991711 / -1.9% 0.49 / 0.48 / +1.0%
tpcds_q10/datafusion:vortex-file-compressed 28651649 / 28676866 / -0.1% 50034901 / 51625493 / -3.1% 0.57 / 0.56 / +3.1%
tpcds_q11/datafusion:vortex-file-compressed 62950276 / 62837960 / +0.2% 90084739 / 89978595 / +0.1% 0.70 / 0.70 / +0.1%
tpcds_q12/datafusion:vortex-file-compressed 16316307 / 16211500 / +0.6% 33246175 / 33522220 / -0.8% 0.49 / 0.48 / +1.5%
tpcds_q13/datafusion:vortex-file-compressed 34404998 / 33483979 / +2.8% 51968795 / 53245870 / -2.4% 0.66 / 0.63 / +5.3%
tpcds_q14/datafusion:vortex-file-compressed 92951741 / 92546317 / +0.4% 119546310 / 118972084 / +0.5% 0.78 / 0.78 / -0.0%
tpcds_q15/datafusion:vortex-file-compressed 23727278 / 23952837 / -0.9% 44379145 / 44896403 / -1.2% 0.53 / 0.53 / +0.2%
tpcds_q16/datafusion:vortex-file-compressed 20170228 / 20723341 / -2.7% 42972431 / 43297131 / -0.7% 0.47 / 0.48 / -1.9%
tpcds_q17/datafusion:vortex-file-compressed 61926529 / 62257358 / -0.5% 76481957 / 85813404 / -10.9% 🟢 0.81 / 0.73 / +11.6%
tpcds_q18/datafusion:vortex-file-compressed 68239296 / 68574620 / -0.5% 94351833 / 95001266 / -0.7% 0.72 / 0.72 / +0.2%
tpcds_q19/datafusion:vortex-file-compressed 17998183 / 18909510 / -4.8% 38868044 / 41135790 / -5.5% 0.46 / 0.46 / +0.7%
tpcds_q20/datafusion:vortex-file-compressed 17689907 / 17799502 / -0.6% 36115478 / 35633426 / +1.4% 0.49 / 0.50 / -1.9%
tpcds_q21/datafusion:vortex-file-compressed 17391730 / 16536439 / +5.2% 41261965 / 41662882 / -1.0% 0.42 / 0.40 / +6.2%
tpcds_q22/datafusion:vortex-file-compressed 49391454 / 50026416 / -1.3% 71269101 / 70428742 / +1.2% 0.69 / 0.71 / -2.4%
tpcds_q23/datafusion:vortex-file-compressed 73047358 / 73588834 / -0.7% 105335230 / 103456339 / +1.8% 0.69 / 0.71 / -2.5%
tpcds_q24/datafusion:vortex-file-compressed 71126147 / 71191562 / -0.1% 95962511 / 96908376 / -1.0% 0.74 / 0.73 / +0.9%
tpcds_q25/datafusion:vortex-file-compressed 49492032 / 53139297 / -6.9% 74995734 / 75124622 / -0.2% 0.66 / 0.71 / -6.7%
tpcds_q26/datafusion:vortex-file-compressed 30447872 / 30489670 / -0.1% 51517857 / 52875950 / -2.6% 0.59 / 0.58 / +2.5%
tpcds_q27/datafusion:vortex-file-compressed 67335780 / 64817886 / +3.9% 89436646 / 92745914 / -3.6% 0.75 / 0.70 / +7.7%
tpcds_q28/datafusion:vortex-file-compressed 17737829 / 18306030 / -3.1% 37161308 / 37180588 / -0.1% 0.48 / 0.49 / -3.1%
tpcds_q29/datafusion:vortex-file-compressed 53540990 / 60598968 / -11.6% 🟢 78734484 / 84228997 / -6.5% 0.68 / 0.72 / -5.5%
tpcds_q30/datafusion:vortex-file-compressed 27499956 / 27713040 / -0.8% 45868414 / 45676665 / +0.4% 0.60 / 0.61 / -1.2%
tpcds_q31/datafusion:vortex-file-compressed 64769910 / 65025881 / -0.4% 91997840 / 96165890 / -4.3% 0.70 / 0.68 / +4.1%
tpcds_q32/datafusion:vortex-file-compressed 13473429 / 13700614 / -1.7% 31904836 / 31895165 / +0.0% 0.42 / 0.43 / -1.7%
tpcds_q33/datafusion:vortex-file-compressed 26783594 / 27283225 / -1.8% 50326497 / 49168722 / +2.4% 0.53 / 0.55 / -4.1%
tpcds_q34/datafusion:vortex-file-compressed 18793326 / 18927480 / -0.7% 38460351 / 38944297 / -1.2% 0.49 / 0.49 / +0.5%
tpcds_q35/datafusion:vortex-file-compressed 35225967 / 35553798 / -0.9% 59755234 / 60158002 / -0.7% 0.59 / 0.59 / -0.3%
tpcds_q36/datafusion:vortex-file-compressed 48413377 / 47933224 / +1.0% 71248447 / 71861794 / -0.9% 0.68 / 0.67 / +1.9%
tpcds_q37/datafusion:vortex-file-compressed 13479006 / 13513382 / -0.3% 34715919 / 35629491 / -2.6% 0.39 / 0.38 / +2.4%
tpcds_q38/datafusion:vortex-file-compressed 29917714 / 29497893 / +1.4% 52747554 / 52839164 / -0.2% 0.57 / 0.56 / +1.6%
tpcds_q39/datafusion:vortex-file-compressed 65724420 / 65562046 / +0.2% 90197356 / 91521270 / -1.4% 0.73 / 0.72 / +1.7%
tpcds_q40/datafusion:vortex-file-compressed 25949959 / 24985936 / +3.9% 47748430 / 46845504 / +1.9% 0.54 / 0.53 / +1.9%
tpcds_q41/datafusion:vortex-file-compressed 16869957 / 16502418 / +2.2% 33277470 / 31042623 / +7.2% 0.51 / 0.53 / -4.6%
tpcds_q42/datafusion:vortex-file-compressed 11446018 / 11406810 / +0.3% 27684066 / 28707836 / -3.6% 0.41 / 0.40 / +4.1%
tpcds_q43/datafusion:vortex-file-compressed 13220222 / 13519708 / -2.2% 32763936 / 33899159 / -3.3% 0.40 / 0.40 / +1.2%
tpcds_q44/datafusion:vortex-file-compressed 26436478 / 26300734 / +0.5% 50956166 / 51815381 / -1.7% 0.52 / 0.51 / +2.2%
tpcds_q45/datafusion:vortex-file-compressed 27579345 / 27639380 / -0.2% 48634920 / 47782579 / +1.8% 0.57 / 0.58 / -2.0%
tpcds_q46/datafusion:vortex-file-compressed 24481482 / 24506993 / -0.1% 49823096 / 48867717 / +2.0% 0.49 / 0.50 / -2.0%
tpcds_q47/datafusion:vortex-file-compressed 78054452 / 77770770 / +0.4% 106622083 / 106976468 / -0.3% 0.73 / 0.73 / +0.7%
tpcds_q48/datafusion:vortex-file-compressed 30661988 / 31272550 / -2.0% 51470127 / 51643254 / -0.3% 0.60 / 0.61 / -1.6%
tpcds_q49/datafusion:vortex-file-compressed 59694029 / 59591778 / +0.2% 83316392 / 84917706 / -1.9% 0.72 / 0.70 / +2.1%
tpcds_q50/datafusion:vortex-file-compressed 33939009 / 34592172 / -1.9% 55391418 / 55787992 / -0.7% 0.61 / 0.62 / -1.2%
tpcds_q51/datafusion:vortex-file-compressed 61428424 / 60702384 / +1.2% 84606720 / 84975686 / -0.4% 0.73 / 0.71 / +1.6%
tpcds_q52/datafusion:vortex-file-compressed 11596438 / 11989908 / -3.3% 28778812 / 29552422 / -2.6% 0.40 / 0.41 / -0.7%
tpcds_q53/datafusion:vortex-file-compressed 18371530 / 18382496 / -0.1% 37578286 / 39698616 / -5.3% 0.49 / 0.46 / +5.6%
tpcds_q54/datafusion:vortex-file-compressed 33839872 / 33916668 / -0.2% 62218524 / 62534169 / -0.5% 0.54 / 0.54 / +0.3%
tpcds_q55/datafusion:vortex-file-compressed 11423963 / 11350500 / +0.6% 28765227 / 29537198 / -2.6% 0.40 / 0.38 / +3.3%
tpcds_q56/datafusion:vortex-file-compressed 27151552 / 27084248 / +0.2% 49731830 / 49358965 / +0.8% 0.55 / 0.55 / -0.5%
tpcds_q57/datafusion:vortex-file-compressed 73278194 / 73333068 / -0.1% 98053354 / 96892837 / +1.2% 0.75 / 0.76 / -1.3%
tpcds_q58/datafusion:vortex-file-compressed 41205880 / 41075244 / +0.3% 67321456 / 68281474 / -1.4% 0.61 / 0.60 / +1.7%
tpcds_q59/datafusion:vortex-file-compressed 31992784 / 32420118 / -1.3% 53879261 / 54154045 / -0.5% 0.59 / 0.60 / -0.8%
tpcds_q60/datafusion:vortex-file-compressed 26456238 / 26752672 / -1.1% 49669732 / 49268121 / +0.8% 0.53 / 0.54 / -1.9%
tpcds_q61/datafusion:vortex-file-compressed 24397582 / 23825382 / +2.4% 47959367 / 47551634 / +0.9% 0.51 / 0.50 / +1.5%
tpcds_q62/datafusion:vortex-file-compressed 17090022 / 17215124 / -0.7% 36813348 / 36640787 / +0.5% 0.46 / 0.47 / -1.2%
tpcds_q63/datafusion:vortex-file-compressed 18175339 / 18623098 / -2.4% 40456881 / 38548382 / +5.0% 0.45 / 0.48 / -7.0%
tpcds_q64/datafusion:vortex-file-compressed 324011644 / 323745828 / +0.1% 353882371 / 362903794 / -2.5% 0.92 / 0.89 / +2.6%
tpcds_q65/datafusion:vortex-file-compressed 76236954 / 75859484 / +0.5% 99726579 / 98042366 / +1.7% 0.76 / 0.77 / -1.2%
tpcds_q66/datafusion:vortex-file-compressed 52719011 / 53190545 / -0.9% 75346829 / 77447556 / -2.7% 0.70 / 0.69 / +1.9%
tpcds_q67/datafusion:vortex-file-compressed 56077033 / 55842969 / +0.4% 86258713 / 86944708 / -0.8% 0.65 / 0.64 / +1.2%
tpcds_q68/datafusion:vortex-file-compressed 23929592 / 24224951 / -1.2% 48560500 / 48161942 / +0.8% 0.49 / 0.50 / -2.0%
tpcds_q69/datafusion:vortex-file-compressed 28373630 / 29293205 / -3.1% 48806421 / 51152951 / -4.6% 0.58 / 0.57 / +1.5%
tpcds_q70/datafusion:vortex-file-compressed 71240967 / 71145180 / +0.1% 94028514 / 93479181 / +0.6% 0.76 / 0.76 / -0.5%
tpcds_q71/datafusion:vortex-file-compressed 19165246 / 19806414 / -3.2% 40061631 / 39958382 / +0.3% 0.48 / 0.50 / -3.5%
tpcds_q72/datafusion:vortex-file-compressed 473134431 / 482127558 / -1.9% 491083653 / 526005787 / -6.6% 0.96 / 0.92 / +5.1%
tpcds_q73/datafusion:vortex-file-compressed 17528062 / 17106158 / +2.5% 38165597 / 39048205 / -2.3% 0.46 / 0.44 / +4.8%
tpcds_q74/datafusion:vortex-file-compressed 45840722 / 45090682 / +1.7% 70605362 / 72154682 / -2.1% 0.65 / 0.62 / +3.9%
tpcds_q75/datafusion:vortex-file-compressed 129097954 / 128950858 / +0.1% 160496461 / 160882981 / -0.2% 0.80 / 0.80 / +0.4%
tpcds_q76/datafusion:vortex-file-compressed 44206886 / 43648954 / +1.3% 66211552 / 68053897 / -2.7% 0.67 / 0.64 / +4.1%
tpcds_q77/datafusion:vortex-file-compressed 35293466 / 35038789 / +0.7% 58542715 / 58201425 / +0.6% 0.60 / 0.60 / +0.1%
tpcds_q78/datafusion:vortex-file-compressed 79629587 / 80224662 / -0.7% 107689061 / 110870302 / -2.9% 0.74 / 0.72 / +2.2%
tpcds_q79/datafusion:vortex-file-compressed 21487836 / 21195850 / +1.4% 43765828 / 42659068 / +2.6% 0.49 / 0.50 / -1.2%
tpcds_q80/datafusion:vortex-file-compressed 77241735 / 77210228 / +0.0% 109971164 / 110738899 / -0.7% 0.70 / 0.70 / +0.7%
tpcds_q81/datafusion:vortex-file-compressed 28092479 / 28252433 / -0.6% 47085995 / 46068663 / +2.2% 0.60 / 0.61 / -2.7%
tpcds_q82/datafusion:vortex-file-compressed 13045851 / 13969184 / -6.6% 35667497 / 34792433 / +2.5% 0.37 / 0.40 / -8.9%
tpcds_q83/datafusion:vortex-file-compressed 36281284 / 36004113 / +0.8% 58742909 / 57957713 / +1.4% 0.62 / 0.62 / -0.6%
tpcds_q84/datafusion:vortex-file-compressed 12042113 / 11926562 / +1.0% 28127187 / 29306277 / -4.0% 0.43 / 0.41 / +5.2%
tpcds_q85/datafusion:vortex-file-compressed 60201578 / 59780702 / +0.7% 84800306 / 84664654 / +0.2% 0.71 / 0.71 / +0.5%
tpcds_q86/datafusion:vortex-file-compressed 16455276 / 16382340 / +0.4% 34238741 / 34011677 / +0.7% 0.48 / 0.48 / -0.2%
tpcds_q87/datafusion:vortex-file-compressed 29741600 / 30316736 / -1.9% 51355872 / 52996894 / -3.1% 0.58 / 0.57 / +1.2%
tpcds_q88/datafusion:vortex-file-compressed 34998846 / 34360910 / +1.9% 60271892 / 61431852 / -1.9% 0.58 / 0.56 / +3.8%
tpcds_q89/datafusion:vortex-file-compressed 20897378 / 21160478 / -1.2% 41731770 / 41979693 / -0.6% 0.50 / 0.50 / -0.7%
tpcds_q90/datafusion:vortex-file-compressed 10533050 / 10256310 / +2.7% 27587177 / 26912387 / +2.5% 0.38 / 0.38 / +0.2%
tpcds_q91/datafusion:vortex-file-compressed 16708850 / 16394498 / +1.9% 36055430 / 36796158 / -2.0% 0.46 / 0.45 / +4.0%
tpcds_q92/datafusion:vortex-file-compressed 13506308 / 13914226 / -2.9% 33116750 / 32172708 / +2.9% 0.41 / 0.43 / -5.7%
tpcds_q93/datafusion:vortex-file-compressed 23603586 / 24049532 / -1.9% 45145081 / 46137802 / -2.2% 0.52 / 0.52 / +0.3%
tpcds_q94/datafusion:vortex-file-compressed 19538700 / 19570985 / -0.2% 39235992 / 40530233 / -3.2% 0.50 / 0.48 / +3.1%
tpcds_q95/datafusion:vortex-file-compressed 45507285 / 46263422 / -1.6% 68651041 / 67603205 / +1.5% 0.66 / 0.68 / -3.1%
tpcds_q96/datafusion:vortex-file-compressed 9504482 / 9386510 / +1.3% 26375263 / 24473939 / +7.8% 0.36 / 0.38 / -6.0%
tpcds_q97/datafusion:vortex-file-compressed 21064336 / 21256988 / -0.9% 43997975 / 44312742 / -0.7% 0.48 / 0.48 / -0.2%
tpcds_q98/datafusion:vortex-file-compressed 16962838 / 16797412 / +1.0% 37892592 / 36853647 / +2.8% 0.45 / 0.46 / -1.8%
tpcds_q99/datafusion:vortex-file-compressed 19412048 / 19360798 / +0.3% 39251118 / 40080355 / -2.1% 0.49 / 0.48 / +2.4%
datafusion / vortex-compact / ns (1.000x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25870303 / 25952955 / -0.3% 45020600 / 45920998 / -2.0% 0.57 / 0.57 / +1.7%
tpcds_q02/datafusion:vortex-compact 48704216 / 48060546 / +1.3% 68765603 / 67903938 / +1.3% 0.71 / 0.71 / +0.1%
tpcds_q03/datafusion:vortex-compact 13213030 / 12478090 / +5.9% 33252577 / 34165723 / -2.7% 0.40 / 0.37 / +8.8%
tpcds_q04/datafusion:vortex-compact 122317310 / 123556452 / -1.0% 158956358 / 152555990 / +4.2% 0.77 / 0.81 / -5.0%
tpcds_q05/datafusion:vortex-compact 62663308 / 63105998 / -0.7% 85226434 / 85991869 / -0.9% 0.74 / 0.73 / +0.2%
tpcds_q06/datafusion:vortex-compact 26396726 / 26533630 / -0.5% 49167649 / 46373637 / +6.0% 0.54 / 0.57 / -6.2%
tpcds_q07/datafusion:vortex-compact 34879552 / 34487486 / +1.1% 55873166 / 57324568 / -2.5% 0.62 / 0.60 / +3.8%
tpcds_q08/datafusion:vortex-compact 29355582 / 29917704 / -1.9% 48054288 / 49476820 / -2.9% 0.61 / 0.60 / +1.0%
tpcds_q09/datafusion:vortex-compact 21861782 / 22530072 / -3.0% 41527338 / 38687406 / +7.3% 0.53 / 0.58 / -9.6%
tpcds_q10/datafusion:vortex-compact 37247604 / 38771380 / -3.9% 60091330 / 62995764 / -4.6% 0.62 / 0.62 / +0.7%
tpcds_q11/datafusion:vortex-compact 67206948 / 68125488 / -1.3% 96185661 / 94601810 / +1.7% 0.70 / 0.72 / -3.0%
tpcds_q12/datafusion:vortex-compact 20844198 / 20211760 / +3.1% 39650335 / 39732713 / -0.2% 0.53 / 0.51 / +3.3%
tpcds_q13/datafusion:vortex-compact 55538449 / 54672238 / +1.6% 77124106 / 76391419 / +1.0% 0.72 / 0.72 / +0.6%
tpcds_q14/datafusion:vortex-compact 98728976 / 96381246 / +2.4% 124325532 / 121831836 / +2.0% 0.79 / 0.79 / +0.4%
tpcds_q15/datafusion:vortex-compact 28037082 / 26870910 / +4.3% 47642878 / 46583179 / +2.3% 0.59 / 0.58 / +2.0%
tpcds_q16/datafusion:vortex-compact 23577880 / 24877597 / -5.2% 44995484 / 44133184 / +2.0% 0.52 / 0.56 / -7.0%
tpcds_q17/datafusion:vortex-compact 67411406 / 64079234 / +5.2% 92598218 / 95189174 / -2.7% 0.73 / 0.67 / +8.1%
tpcds_q18/datafusion:vortex-compact 68841768 / 68308406 / +0.8% 91548402 / 93095781 / -1.7% 0.75 / 0.73 / +2.5%
tpcds_q19/datafusion:vortex-compact 22301711 / 22782772 / -2.1% 43006110 / 43752262 / -1.7% 0.52 / 0.52 / -0.4%
tpcds_q20/datafusion:vortex-compact 21801024 / 21808046 / -0.0% 42889662 / 42358160 / +1.3% 0.51 / 0.51 / -1.3%
tpcds_q21/datafusion:vortex-compact 18004582 / 17961368 / +0.2% 41728784 / 41839477 / -0.3% 0.43 / 0.43 / +0.5%
tpcds_q22/datafusion:vortex-compact 50286678 / 50726664 / -0.9% 73658991 / 74706636 / -1.4% 0.68 / 0.68 / +0.5%
tpcds_q23/datafusion:vortex-compact 76982474 / 75239626 / +2.3% 106675979 / 103738195 / +2.8% 0.72 / 0.73 / -0.5%
tpcds_q24/datafusion:vortex-compact 77748656 / 78505464 / -1.0% 101874268 / 101107466 / +0.8% 0.76 / 0.78 / -1.7%
tpcds_q25/datafusion:vortex-compact 62368150 / 63304988 / -1.5% 90113756 / 92744106 / -2.8% 0.69 / 0.68 / +1.4%
tpcds_q26/datafusion:vortex-compact 33626486 / 32787498 / +2.6% 53987010 / 51190156 / +5.5% 0.62 / 0.64 / -2.8%
tpcds_q27/datafusion:vortex-compact 64873647 / 62962269 / +3.0% 88926616 / 88710618 / +0.2% 0.73 / 0.71 / +2.8%
tpcds_q28/datafusion:vortex-compact 27931593 / 27944310 / -0.0% 50691610 / 48221693 / +5.1% 0.55 / 0.58 / -4.9%
tpcds_q29/datafusion:vortex-compact 63162752 / 62912900 / +0.4% 90436632 / 93082378 / -2.8% 0.70 / 0.68 / +3.3%
tpcds_q30/datafusion:vortex-compact 30531796 / 30808582 / -0.9% 49255974 / 48911720 / +0.7% 0.62 / 0.63 / -1.6%
tpcds_q31/datafusion:vortex-compact 76757998 / 74421969 / +3.1% 104554763 / 104703747 / -0.1% 0.73 / 0.71 / +3.3%
tpcds_q32/datafusion:vortex-compact 17059247 / 16315294 / +4.6% 36551113 / 35571006 / +2.8% 0.47 / 0.46 / +1.8%
tpcds_q33/datafusion:vortex-compact 28917742 / 28598428 / +1.1% 52476704 / 50969974 / +3.0% 0.55 / 0.56 / -1.8%
tpcds_q34/datafusion:vortex-compact 21566132 / 20928484 / +3.0% 42025915 / 40261513 / +4.4% 0.51 / 0.52 / -1.3%
tpcds_q35/datafusion:vortex-compact 42171332 / 41815861 / +0.9% 66460080 / 66402143 / +0.1% 0.63 / 0.63 / +0.8%
tpcds_q36/datafusion:vortex-compact 51760476 / 50466532 / +2.6% 83130554 / 74627849 / +11.4% 🔴 0.62 / 0.68 / -7.9%
tpcds_q37/datafusion:vortex-compact 15473527 / 16205252 / -4.5% 38676846 / 37423490 / +3.3% 0.40 / 0.43 / -7.6%
tpcds_q38/datafusion:vortex-compact 34333282 / 33725126 / +1.8% 57731695 / 55881705 / +3.3% 0.59 / 0.60 / -1.5%
tpcds_q39/datafusion:vortex-compact 66916246 / 67151401 / -0.4% 89994113 / 91564634 / -1.7% 0.74 / 0.73 / +1.4%
tpcds_q40/datafusion:vortex-compact 27457699 / 28358090 / -3.2% 49940373 / 51058271 / -2.2% 0.55 / 0.56 / -1.0%
tpcds_q41/datafusion:vortex-compact 18568710 / 18810290 / -1.3% 33306296 / 32908742 / +1.2% 0.56 / 0.57 / -2.5%
tpcds_q42/datafusion:vortex-compact 12841088 / 12981748 / -1.1% 32441602 / 33398243 / -2.9% 0.40 / 0.39 / +1.8%
tpcds_q43/datafusion:vortex-compact 16067507 / 15075936 / +6.6% 34756872 / 33937810 / +2.4% 0.46 / 0.44 / +4.1%
tpcds_q44/datafusion:vortex-compact 30231550 / 29918829 / +1.0% 52814212 / 54530192 / -3.1% 0.57 / 0.55 / +4.3%
tpcds_q45/datafusion:vortex-compact 30571052 / 30773880 / -0.7% 50796732 / 50550735 / +0.5% 0.60 / 0.61 / -1.1%
tpcds_q46/datafusion:vortex-compact 30454383 / 27867749 / +9.3% 53725994 / 49429115 / +8.7% 0.57 / 0.56 / +0.5%
tpcds_q47/datafusion:vortex-compact 87377761 / 89216615 / -2.1% 117548841 / 118028476 / -0.4% 0.74 / 0.76 / -1.7%
tpcds_q48/datafusion:vortex-compact 50327690 / 50122740 / +0.4% 69801002 / 70266445 / -0.7% 0.72 / 0.71 / +1.1%
tpcds_q49/datafusion:vortex-compact 64698109 / 66794355 / -3.1% 96389193 / 89054754 / +8.2% 0.67 / 0.75 / -10.5%
tpcds_q50/datafusion:vortex-compact 37733180 / 37265012 / +1.3% 57821248 / 60296097 / -4.1% 0.65 / 0.62 / +5.6%
tpcds_q51/datafusion:vortex-compact 62487531 / 62781016 / -0.5% 86264146 / 85035047 / +1.4% 0.72 / 0.74 / -1.9%
tpcds_q52/datafusion:vortex-compact 14173424 / 13303664 / +6.5% 34109121 / 34005200 / +0.3% 0.42 / 0.39 / +6.2%
tpcds_q53/datafusion:vortex-compact 22210308 / 21884834 / +1.5% 43111501 / 42906579 / +0.5% 0.52 / 0.51 / +1.0%
tpcds_q54/datafusion:vortex-compact 39514960 / 40396666 / -2.2% 70124097 / 64685760 / +8.4% 0.56 / 0.62 / -9.8%
tpcds_q55/datafusion:vortex-compact 13250540 / 12510272 / +5.9% 33817554 / 31998464 / +5.7% 0.39 / 0.39 / +0.2%
tpcds_q56/datafusion:vortex-compact 28710950 / 27874722 / +3.0% 52278404 / 52592470 / -0.6% 0.55 / 0.53 / +3.6%
tpcds_q57/datafusion:vortex-compact 80388410 / 79926168 / +0.6% 107477617 / 106258776 / +1.1% 0.75 / 0.75 / -0.6%
tpcds_q58/datafusion:vortex-compact 47539960 / 47311802 / +0.5% 74702749 / 76081572 / -1.8% 0.64 / 0.62 / +2.3%
tpcds_q59/datafusion:vortex-compact 40500379 / 41753745 / -3.0% 60720550 / 60914237 / -0.3% 0.67 / 0.69 / -2.7%
tpcds_q60/datafusion:vortex-compact 27898972 / 28648674 / -2.6% 51429288 / 53070118 / -3.1% 0.54 / 0.54 / +0.5%
tpcds_q61/datafusion:vortex-compact 27726588 / 27062882 / +2.5% 47589873 / 49108086 / -3.1% 0.58 / 0.55 / +5.7%
tpcds_q62/datafusion:vortex-compact 17856738 / 17870565 / -0.1% 36697670 / 37488322 / -2.1% 0.49 / 0.48 / +2.1%
tpcds_q63/datafusion:vortex-compact 23006445 / 22599642 / +1.8% 43856216 / 45581396 / -3.8% 0.52 / 0.50 / +5.8%
tpcds_q64/datafusion:vortex-compact 446725100 / 445316178 / +0.3% 461921314 / 469801069 / -1.7% 0.97 / 0.95 / +2.0%
tpcds_q65/datafusion:vortex-compact 81088265 / 81546134 / -0.6% 104031899 / 103029602 / +1.0% 0.78 / 0.79 / -1.5%
tpcds_q66/datafusion:vortex-compact 55790556 / 55082048 / +1.3% 77928613 / 78263440 / -0.4% 0.72 / 0.70 / +1.7%
tpcds_q67/datafusion:vortex-compact 59565772 / 59893717 / -0.5% 90580877 / 89590079 / +1.1% 0.66 / 0.67 / -1.6%
tpcds_q68/datafusion:vortex-compact 27656986 / 27600570 / +0.2% 51924793 / 52627393 / -1.3% 0.53 / 0.52 / +1.6%
tpcds_q69/datafusion:vortex-compact 36427956 / 36884835 / -1.2% 59520792 / 59780703 / -0.4% 0.61 / 0.62 / -0.8%
tpcds_q70/datafusion:vortex-compact 76246668 / 76036141 / +0.3% 98331576 / 96282038 / +2.1% 0.78 / 0.79 / -1.8%
tpcds_q71/datafusion:vortex-compact 19682044 / 20796670 / -5.4% 42541297 / 40859348 / +4.1% 0.46 / 0.51 / -9.1%
tpcds_q72/datafusion:vortex-compact 476424214 / 467464744 / +1.9% 510761817 / 480990820 / +6.2% 0.93 / 0.97 / -4.0%
tpcds_q73/datafusion:vortex-compact 19616154 / 19955404 / -1.7% 41268262 / 41049712 / +0.5% 0.48 / 0.49 / -2.2%
tpcds_q74/datafusion:vortex-compact 50091558 / 50588164 / -1.0% 74733254 / 74815998 / -0.1% 0.67 / 0.68 / -0.9%
tpcds_q75/datafusion:vortex-compact 135099088 / 141139378 / -4.3% 173458221 / 170635088 / +1.7% 0.78 / 0.83 / -5.8%
tpcds_q76/datafusion:vortex-compact 40213546 / 43519132 / -7.6% 61554907 / 68114883 / -9.6% 0.65 / 0.64 / +2.3%
tpcds_q77/datafusion:vortex-compact 38206700 / 36572584 / +4.5% 64976837 / 64626839 / +0.5% 0.59 / 0.57 / +3.9%
tpcds_q78/datafusion:vortex-compact 86279362 / 87140464 / -1.0% 115612919 / 117754334 / -1.8% 0.75 / 0.74 / +0.8%
tpcds_q79/datafusion:vortex-compact 24301343 / 29237513 / -16.9% 🟢 46898748 / 46509979 / +0.8% 0.52 / 0.63 / -17.6%
tpcds_q80/datafusion:vortex-compact 79106191 / 79139594 / -0.0% 109426687 / 110989032 / -1.4% 0.72 / 0.71 / +1.4%
tpcds_q81/datafusion:vortex-compact 29659926 / 30140254 / -1.6% 47829015 / 47061347 / +1.6% 0.62 / 0.64 / -3.2%
tpcds_q82/datafusion:vortex-compact 15545874 / 16206265 / -4.1% 38439596 / 37546512 / +2.4% 0.40 / 0.43 / -6.3%
tpcds_q83/datafusion:vortex-compact 37090871 / 37598034 / -1.3% 59118483 / 60543765 / -2.4% 0.63 / 0.62 / +1.0%
tpcds_q84/datafusion:vortex-compact 12889540 / 12988532 / -0.8% 30109258 / 29889282 / +0.7% 0.43 / 0.43 / -1.5%
tpcds_q85/datafusion:vortex-compact 105386260 / 103447204 / +1.9% 128192410 / 128869683 / -0.5% 0.82 / 0.80 / +2.4%
tpcds_q86/datafusion:vortex-compact 16829348 / 17129420 / -1.8% 37430035 / 36973902 / +1.2% 0.45 / 0.46 / -2.9%
tpcds_q87/datafusion:vortex-compact 34003000 / 33452872 / +1.6% 57350486 / 56638844 / +1.3% 0.59 / 0.59 / +0.4%
tpcds_q88/datafusion:vortex-compact 40300974 / 41568962 / -3.1% 71007632 / 68388141 / +3.8% 0.57 / 0.61 / -6.6%
tpcds_q89/datafusion:vortex-compact 25287985 / 24940331 / +1.4% 48051767 / 46275949 / +3.8% 0.53 / 0.54 / -2.4%
tpcds_q90/datafusion:vortex-compact 11363323 / 11302066 / +0.5% 28813248 / 28219930 / +2.1% 0.39 / 0.40 / -1.5%
tpcds_q91/datafusion:vortex-compact 27419064 / 27202662 / +0.8% 46929647 / 46586983 / +0.7% 0.58 / 0.58 / +0.1%
tpcds_q92/datafusion:vortex-compact 15362524 / 15412913 / -0.3% 35686752 / 33745356 / +5.8% 0.43 / 0.46 / -5.7%
tpcds_q93/datafusion:vortex-compact 25236690 / 25207456 / +0.1% 46157456 / 45819152 / +0.7% 0.55 / 0.55 / -0.6%
tpcds_q94/datafusion:vortex-compact 21985453 / 22006959 / -0.1% 40817942 / 44898961 / -9.1% 0.54 / 0.49 / +9.9%
tpcds_q95/datafusion:vortex-compact 49143184 / 49186168 / -0.1% 71559522 / 71823048 / -0.4% 0.69 / 0.68 / +0.3%
tpcds_q96/datafusion:vortex-compact 10494172 / 10594576 / -0.9% 26147047 / 26537314 / -1.5% 0.40 / 0.40 / +0.5%
tpcds_q97/datafusion:vortex-compact 25347682 / 24794701 / +2.2% 45734507 / 46003181 / -0.6% 0.55 / 0.54 / +2.8%
tpcds_q98/datafusion:vortex-compact 22107709 / 22438643 / -1.5% 43093977 / 44798952 / -3.8% 0.51 / 0.50 / +2.4%
tpcds_q99/datafusion:vortex-compact 21029694 / 20838204 / +0.9% 40937067 / 40937139 / -0.0% 0.51 / 0.51 / +0.9%
datafusion / parquet / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31444178 / 32503258 / -3.3% 47018123 / 49350834 / -4.7% 0.67 / 0.66 / +1.5%
tpcds_q02/datafusion:parquet 39530532 / 40048796 / -1.3% 59889815 / 56679964 / +5.7% 0.66 / 0.71 / -6.6%
tpcds_q03/datafusion:parquet 16437985 / 16368380 / +0.4% 31432964 / 31465396 / -0.1% 0.52 / 0.52 / +0.5%
tpcds_q04/datafusion:parquet 202289964 / 202756759 / -0.2% 230896436 / 227017054 / +1.7% 0.88 / 0.89 / -1.9%
tpcds_q05/datafusion:parquet 72919420 / 74388390 / -2.0% 98204461 / 98698194 / -0.5% 0.74 / 0.75 / -1.5%
tpcds_q06/datafusion:parquet 28675538 / 28439084 / +0.8% 52434524 / 48946381 / +7.1% 0.55 / 0.58 / -5.9%
tpcds_q07/datafusion:parquet 46869954 / 47752198 / -1.8% 68144574 / 69936284 / -2.6% 0.69 / 0.68 / +0.7%
tpcds_q08/datafusion:parquet 30785236 / 29976411 / +2.7% 51358210 / 52303019 / -1.8% 0.60 / 0.57 / +4.6%
tpcds_q09/datafusion:parquet 28822022 / 32942876 / -12.5% 🟢 45893588 / 49008704 / -6.4% 0.63 / 0.67 / -6.6%
tpcds_q10/datafusion:parquet 41294738 / 41158083 / +0.3% 63754533 / 61795377 / +3.2% 0.65 / 0.67 / -2.8%
tpcds_q11/datafusion:parquet 95469770 / 95938365 / -0.5% 121391444 / 122148799 / -0.6% 0.79 / 0.79 / +0.1%
tpcds_q12/datafusion:parquet 21630090 / 21510732 / +0.6% 36193841 / 35870827 / +0.9% 0.60 / 0.60 / -0.3%
tpcds_q13/datafusion:parquet 42497424 / 42842381 / -0.8% 67336600 / 69127696 / -2.6% 0.63 / 0.62 / +1.8%
tpcds_q14/datafusion:parquet 125617771 / 126205641 / -0.5% 152158525 / 152848135 / -0.5% 0.83 / 0.83 / -0.0%
tpcds_q15/datafusion:parquet 32739664 / 33237382 / -1.5% 50275950 / 50096016 / +0.4% 0.65 / 0.66 / -1.8%
tpcds_q16/datafusion:parquet 37547480 / 36139165 / +3.9% 55761168 / 54316906 / +2.7% 0.67 / 0.67 / +1.2%
tpcds_q17/datafusion:parquet 77989260 / 77884596 / +0.1% 103351005 / 105234581 / -1.8% 0.75 / 0.74 / +2.0%
tpcds_q18/datafusion:parquet 61234365 / 59343056 / +3.2% 83236378 / 78690230 / +5.8% 0.74 / 0.75 / -2.4%
tpcds_q19/datafusion:parquet 26201522 / 25987516 / +0.8% 45603727 / 44038831 / +3.6% 0.57 / 0.59 / -2.6%
tpcds_q20/datafusion:parquet 23132728 / 23256525 / -0.5% 38433147 / 37842994 / +1.6% 0.60 / 0.61 / -2.1%
tpcds_q21/datafusion:parquet 18221130 / 18572630 / -1.9% 32732889 / 31964246 / +2.4% 0.56 / 0.58 / -4.2%
tpcds_q22/datafusion:parquet 74859152 / 75932462 / -1.4% 91610069 / 90939473 / +0.7% 0.82 / 0.83 / -2.1%
tpcds_q23/datafusion:parquet 111477298 / 108664024 / +2.6% 141011408 / 136112297 / +3.6% 0.79 / 0.80 / -1.0%
tpcds_q24/datafusion:parquet 96558938 / 96441638 / +0.1% 122152273 / 122708720 / -0.5% 0.79 / 0.79 / +0.6%
tpcds_q25/datafusion:parquet 80682148 / 78178140 / +3.2% 106148982 / 104424930 / +1.7% 0.76 / 0.75 / +1.5%
tpcds_q26/datafusion:parquet 43477072 / 44245634 / -1.7% 64795670 / 64084753 / +1.1% 0.67 / 0.69 / -2.8%
tpcds_q27/datafusion:parquet 76084526 / 75857427 / +0.3% 99844651 / 99512924 / +0.3% 0.76 / 0.76 / -0.0%
tpcds_q28/datafusion:parquet 27144212 / 27628649 / -1.8% 45081823 / 44239694 / +1.9% 0.60 / 0.62 / -3.6%
tpcds_q29/datafusion:parquet 80698681 / 80910518 / -0.3% 105047773 / 105104470 / -0.1% 0.77 / 0.77 / -0.2%
tpcds_q30/datafusion:parquet 43587692 / 44271172 / -1.5% 68474995 / 67156233 / +2.0% 0.64 / 0.66 / -3.4%
tpcds_q31/datafusion:parquet 80251240 / 81503154 / -1.5% 102430536 / 103564046 / -1.1% 0.78 / 0.79 / -0.4%
tpcds_q32/datafusion:parquet 23331328 / 23490761 / -0.7% 40889125 / 40859429 / +0.1% 0.57 / 0.57 / -0.8%
tpcds_q33/datafusion:parquet 33629027 / 34191257 / -1.6% 51667047 / 50986067 / +1.3% 0.65 / 0.67 / -2.9%
tpcds_q34/datafusion:parquet 22808888 / 23172478 / -1.6% 39280807 / 38269826 / +2.6% 0.58 / 0.61 / -4.1%
tpcds_q35/datafusion:parquet 49312582 / 50217542 / -1.8% 70124170 / 70233606 / -0.2% 0.70 / 0.72 / -1.6%
tpcds_q36/datafusion:parquet 53192482 / 54266756 / -2.0% 73975347 / 73634333 / +0.5% 0.72 / 0.74 / -2.4%
tpcds_q37/datafusion:parquet 23146749 / 23291750 / -0.6% 38841017 / 37987371 / +2.2% 0.60 / 0.61 / -2.8%
tpcds_q38/datafusion:parquet 44400958 / 44235752 / +0.4% 64602295 / 63679410 / +1.4% 0.69 / 0.69 / -1.1%
tpcds_q39/datafusion:parquet 71501250 / 72339686 / -1.2% 87993705 / 91115645 / -3.4% 0.81 / 0.79 / +2.3%
tpcds_q40/datafusion:parquet 29793900 / 29768082 / +0.1% 51381793 / 50748977 / +1.2% 0.58 / 0.59 / -1.1%
tpcds_q41/datafusion:parquet 17590174 / 17288090 / +1.7% 29150058 / 28478663 / +2.4% 0.60 / 0.61 / -0.6%
tpcds_q42/datafusion:parquet 15291158 / 15703874 / -2.6% 30087175 / 29191724 / +3.1% 0.51 / 0.54 / -5.5%
tpcds_q43/datafusion:parquet 17402010 / 17674144 / -1.5% 32881467 / 32832405 / +0.1% 0.53 / 0.54 / -1.7%
tpcds_q44/datafusion:parquet 33720286 / 33152544 / +1.7% 51960692 / 52742757 / -1.5% 0.65 / 0.63 / +3.2%
tpcds_q45/datafusion:parquet 37502055 / 37347161 / +0.4% 56336532 / 54999398 / +2.4% 0.67 / 0.68 / -2.0%
tpcds_q46/datafusion:parquet 29771820 / 28693780 / +3.8% 50297141 / 49764262 / +1.1% 0.59 / 0.58 / +2.7%
tpcds_q47/datafusion:parquet 96393284 / 96543370 / -0.2% 123135690 / 123917357 / -0.6% 0.78 / 0.78 / +0.5%
tpcds_q48/datafusion:parquet 38249126 / 38173272 / +0.2% 57886546 / 61255864 / -5.5% 0.66 / 0.62 / +6.0%
tpcds_q49/datafusion:parquet 73792078 / 75926055 / -2.8% 98343930 / 98399099 / -0.1% 0.75 / 0.77 / -2.8%
tpcds_q50/datafusion:parquet 49693502 / 49505088 / +0.4% 70463723 / 72146844 / -2.3% 0.71 / 0.69 / +2.8%
tpcds_q51/datafusion:parquet 66838511 / 67535855 / -1.0% 90524572 / 91211260 / -0.8% 0.74 / 0.74 / -0.3%
tpcds_q52/datafusion:parquet 15809544 / 15829985 / -0.1% 29726738 / 30198749 / -1.6% 0.53 / 0.52 / +1.5%
tpcds_q53/datafusion:parquet 21898441 / 21918643 / -0.1% 39803978 / 39108258 / +1.8% 0.55 / 0.56 / -1.8%
tpcds_q54/datafusion:parquet 45032710 / 46300822 / -2.7% 64282574 / 64001369 / +0.4% 0.70 / 0.72 / -3.2%
tpcds_q55/datafusion:parquet 15561510 / 15374082 / +1.2% 29253665 / 28942840 / +1.1% 0.53 / 0.53 / +0.1%
tpcds_q56/datafusion:parquet 31515847 / 31362111 / +0.5% 54548755 / 53722957 / +1.5% 0.58 / 0.58 / -1.0%
tpcds_q57/datafusion:parquet 99275139 / 98928972 / +0.3% 122216373 / 121371203 / +0.7% 0.81 / 0.82 / -0.3%
tpcds_q58/datafusion:parquet 64636493 / 64938196 / -0.5% 86172132 / 88043669 / -2.1% 0.75 / 0.74 / +1.7%
tpcds_q59/datafusion:parquet 43274278 / 42773023 / +1.2% 63543183 / 63021051 / +0.8% 0.68 / 0.68 / +0.3%
tpcds_q60/datafusion:parquet 31698998 / 31679546 / +0.1% 55267930 / 56157647 / -1.6% 0.57 / 0.56 / +1.7%
tpcds_q61/datafusion:parquet 34167830 / 33345024 / +2.5% 56973334 / 56804255 / +0.3% 0.60 / 0.59 / +2.2%
tpcds_q62/datafusion:parquet 24353142 / 24427726 / -0.3% 40059631 / 39454548 / +1.5% 0.61 / 0.62 / -1.8%
tpcds_q63/datafusion:parquet 22011884 / 21898128 / +0.5% 39346777 / 38767748 / +1.5% 0.56 / 0.56 / -1.0%
tpcds_q64/datafusion:parquet 202043528 / 205527712 / -1.7% 243418282 / 230293641 / +5.7% 0.83 / 0.89 / -7.0%
tpcds_q65/datafusion:parquet 38954512 / 38451750 / +1.3% 59640199 / 60894669 / -2.1% 0.65 / 0.63 / +3.4%
tpcds_q66/datafusion:parquet 63490544 / 62183868 / +2.1% 80518318 / 79595938 / +1.2% 0.79 / 0.78 / +0.9%
tpcds_q67/datafusion:parquet 70068188 / 70265017 / -0.3% 96465585 / 96279204 / +0.2% 0.73 / 0.73 / -0.5%
tpcds_q68/datafusion:parquet 28858300 / 28985024 / -0.4% 51935117 / 50994139 / +1.8% 0.56 / 0.57 / -2.2%
tpcds_q69/datafusion:parquet 41738470 / 41756574 / -0.0% 60685415 / 61845916 / -1.9% 0.69 / 0.68 / +1.9%
tpcds_q70/datafusion:parquet 32700473 / 32473856 / +0.7% 55522246 / 54780342 / +1.4% 0.59 / 0.59 / -0.6%
tpcds_q71/datafusion:parquet 22664238 / 23292840 / -2.7% 38763225 / 40339479 / -3.9% 0.58 / 0.58 / +1.3%
tpcds_q72/datafusion:parquet 554601310 / 551861914 / +0.5% 574992434 / 571184057 / +0.7% 0.96 / 0.97 / -0.2%
tpcds_q73/datafusion:parquet 22274920 / 21813926 / +2.1% 38293376 / 38537112 / -0.6% 0.58 / 0.57 / +2.8%
tpcds_q74/datafusion:parquet 67094912 / 66874583 / +0.3% 93490090 / 86480668 / +8.1% 0.72 / 0.77 / -7.2%
tpcds_q75/datafusion:parquet 152478730 / 151074247 / +0.9% 183006100 / 180790462 / +1.2% 0.83 / 0.84 / -0.3%
tpcds_q76/datafusion:parquet 49564900 / 48467356 / +2.3% 65257568 / 67799143 / -3.7% 0.76 / 0.71 / +6.2%
tpcds_q77/datafusion:parquet 52919506 / 52770038 / +0.3% 74349033 / 74379695 / -0.0% 0.71 / 0.71 / +0.3%
tpcds_q78/datafusion:parquet 93031312 / 92464820 / +0.6% 120958612 / 123184689 / -1.8% 0.77 / 0.75 / +2.5%
tpcds_q79/datafusion:parquet 26054604 / 25564666 / +1.9% 45781987 / 45854084 / -0.2% 0.57 / 0.56 / +2.1%
tpcds_q80/datafusion:parquet 82238251 / 82463652 / -0.3% 112370963 / 115716838 / -2.9% 0.73 / 0.71 / +2.7%
tpcds_q81/datafusion:parquet 38575201 / 38994421 / -1.1% 59509841 / 61786792 / -3.7% 0.65 / 0.63 / +2.7%
tpcds_q82/datafusion:parquet 25316055 / 25539154 / -0.9% 40392822 / 40650680 / -0.6% 0.63 / 0.63 / -0.2%
tpcds_q83/datafusion:parquet 47853596 / 47614174 / +0.5% 69255404 / 69311847 / -0.1% 0.69 / 0.69 / +0.6%
tpcds_q84/datafusion:parquet 29489938 / 29121958 / +1.3% 44974928 / 46591848 / -3.5% 0.66 / 0.63 / +4.9%
tpcds_q85/datafusion:parquet 88051414 / 86153986 / +2.2% 107787555 / 111204793 / -3.1% 0.82 / 0.77 / +5.4%
tpcds_q86/datafusion:parquet 20906018 / 20918874 / -0.1% 34515167 / 34190433 / +0.9% 0.61 / 0.61 / -1.0%
tpcds_q87/datafusion:parquet 43393193 / 44160754 / -1.7% 63286726 / 62801573 / +0.8% 0.69 / 0.70 / -2.5%
tpcds_q88/datafusion:parquet 40503502 / 38384692 / +5.5% 54506414 / 54608128 / -0.2% 0.74 / 0.70 / +5.7%
tpcds_q89/datafusion:parquet 25143650 / 25107322 / +0.1% 42788393 / 42973282 / -0.4% 0.59 / 0.58 / +0.6%
tpcds_q90/datafusion:parquet 15518933 / 15214302 / +2.0% 32138647 / 31074875 / +3.4% 0.48 / 0.49 / -1.4%
tpcds_q91/datafusion:parquet 31628264 / 31662102 / -0.1% 50684125 / 49542176 / +2.3% 0.62 / 0.64 / -2.4%
tpcds_q92/datafusion:parquet 23352454 / 23913186 / -2.3% 41894433 / 41466670 / +1.0% 0.56 / 0.58 / -3.3%
tpcds_q93/datafusion:parquet 27602394 / 27959372 / -1.3% 49801855 / 50793192 / -2.0% 0.55 / 0.55 / +0.7%
tpcds_q94/datafusion:parquet 31898756 / 31924886 / -0.1% 49123785 / 49898623 / -1.6% 0.65 / 0.64 / +1.5%
tpcds_q95/datafusion:parquet 65231839 / 65684812 / -0.7% 82328079 / 82128108 / +0.2% 0.79 / 0.80 / -0.9%
tpcds_q96/datafusion:parquet 12865898 / 12852526 / +0.1% 28770195 / 28740339 / +0.1% 0.45 / 0.45 / +0.0%
tpcds_q97/datafusion:parquet 32291533 / 32410392 / -0.4% 52281366 / 53038869 / -1.4% 0.62 / 0.61 / +1.1%
tpcds_q98/datafusion:parquet 22476499 / 22824866 / -1.5% 38551419 / 39115090 / -1.4% 0.58 / 0.58 / -0.1%
tpcds_q99/datafusion:parquet 28267458 / 29176598 / -3.1% 42971960 / 44151657 / -2.7% 0.66 / 0.66 / -0.5%
duckdb / vortex-file-compressed / ns (1.002x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15174408 / 15143618 / +0.2% 24937960 / 22557501 / +10.6% 🔴 0.61 / 0.67 / -9.4%
tpcds_q02/duckdb:vortex-file-compressed 15532930 / 14818800 / +4.8% 19266477 / 20062690 / -4.0% 0.81 / 0.74 / +9.2%
tpcds_q03/duckdb:vortex-file-compressed 11976826 / 11570936 / +3.5% 19229164 / 24172657 / -20.5% 🟢 0.62 / 0.48 / +30.1%
tpcds_q04/duckdb:vortex-file-compressed 49833340 / 50278488 / -0.9% 60012130 / 60525068 / -0.8% 0.83 / 0.83 / -0.0%
tpcds_q05/duckdb:vortex-file-compressed 18854839 / 18322157 / +2.9% 24854705 / 29571224 / -15.9% 🟢 0.76 / 0.62 / +22.4%
tpcds_q06/duckdb:vortex-file-compressed 26626504 / 26712072 / -0.3% 40466489 / 39447927 / +2.6% 0.66 / 0.68 / -2.8%
tpcds_q07/duckdb:vortex-file-compressed 16401527 / 15715168 / +4.4% 27414151 / 31417565 / -12.7% 🟢 0.60 / 0.50 / +19.6%
tpcds_q08/duckdb:vortex-file-compressed 18694228 / 19296877 / -3.1% 26955570 / 27374445 / -1.5% 0.69 / 0.70 / -1.6%
tpcds_q09/duckdb:vortex-file-compressed 13528585 / 15436302 / -12.4% 🟢 21167939 / 24228080 / -12.6% 🟢 0.64 / 0.64 / +0.3%
tpcds_q10/duckdb:vortex-file-compressed 27388780 / 27570348 / -0.7% 43637765 / 40717670 / +7.2% 0.63 / 0.68 / -7.3%
tpcds_q11/duckdb:vortex-file-compressed 40105770 / 40649278 / -1.3% 49996594 / 51435241 / -2.8% 0.80 / 0.79 / +1.5%
tpcds_q12/duckdb:vortex-file-compressed 10980454 / 10402236 / +5.6% 18713240 / 18193596 / +2.9% 0.59 / 0.57 / +2.6%
tpcds_q13/duckdb:vortex-file-compressed 21475407 / 21348929 / +0.6% 32320347 / 33699173 / -4.1% 0.66 / 0.63 / +4.9%
tpcds_q14/duckdb:vortex-file-compressed 57875146 / 58798108 / -1.6% 71781379 / 73426471 / -2.2% 0.81 / 0.80 / +0.7%
tpcds_q15/duckdb:vortex-file-compressed 20522522 / 21583827 / -4.9% 25373935 / 25226122 / +0.6% 0.81 / 0.86 / -5.5%
tpcds_q16/duckdb:vortex-file-compressed 17644688 / 17548426 / +0.5% 29280005 / 26318119 / +11.3% 🔴 0.60 / 0.67 / -9.6%
tpcds_q17/duckdb:vortex-file-compressed 29914028 / 29911476 / +0.0% 43743453 / 45706500 / -4.3% 0.68 / 0.65 / +4.5%
tpcds_q18/duckdb:vortex-file-compressed 28053566 / 27794379 / +0.9% 37701198 / 38764540 / -2.7% 0.74 / 0.72 / +3.8%
tpcds_q19/duckdb:vortex-file-compressed 23320128 / 23946924 / -2.6% 33012268 / 33900703 / -2.6% 0.71 / 0.71 / +0.0%
tpcds_q20/duckdb:vortex-file-compressed 10586778 / 10538485 / +0.5% 15432706 / 15179513 / +1.7% 0.69 / 0.69 / -1.2%
tpcds_q21/duckdb:vortex-file-compressed 9627530 / 9652585 / -0.3% 17369420 / 17815520 / -2.5% 0.55 / 0.54 / +2.3%
tpcds_q22/duckdb:vortex-file-compressed 29336914 / 29063864 / +0.9% 38842567 / 39377734 / -1.4% 0.76 / 0.74 / +2.3%
tpcds_q23/duckdb:vortex-file-compressed 36185543 / 36557960 / -1.0% 46130812 / 46197140 / -0.1% 0.78 / 0.79 / -0.9%
tpcds_q24/duckdb:vortex-file-compressed 28104816 / 27557084 / +2.0% 39803078 / 39296431 / +1.3% 0.71 / 0.70 / +0.7%
tpcds_q25/duckdb:vortex-file-compressed 25235809 / 25521107 / -1.1% 40613543 / 40617408 / -0.0% 0.62 / 0.63 / -1.1%
tpcds_q26/duckdb:vortex-file-compressed 13344675 / 13420905 / -0.6% 21766589 / 21060683 / +3.4% 0.61 / 0.64 / -3.8%
tpcds_q27/duckdb:vortex-file-compressed 16931784 / 17052919 / -0.7% 28202815 / 31163204 / -9.5% 0.60 / 0.55 / +9.7%
tpcds_q28/duckdb:vortex-file-compressed 11632384 / 12302796 / -5.4% 17771360 / 18890624 / -5.9% 0.65 / 0.65 / +0.5%
tpcds_q29/duckdb:vortex-file-compressed 28979720 / 28328143 / +2.3% 42947226 / 44553281 / -3.6% 0.67 / 0.64 / +6.1%
tpcds_q30/duckdb:vortex-file-compressed 19395712 / 19212958 / +1.0% 27749010 / 29980558 / -7.4% 0.70 / 0.64 / +9.1%
tpcds_q31/duckdb:vortex-file-compressed 19120165 / 19372632 / -1.3% 26764083 / 25842028 / +3.6% 0.71 / 0.75 / -4.7%
tpcds_q32/duckdb:vortex-file-compressed 9829200 / 9794859 / +0.4% 16838595 / 15731302 / +7.0% 0.58 / 0.62 / -6.2%
tpcds_q33/duckdb:vortex-file-compressed 16848540 / 16823437 / +0.1% 25446835 / 28061583 / -9.3% 0.66 / 0.60 / +10.4%
tpcds_q34/duckdb:vortex-file-compressed 15276316 / 15382674 / -0.7% 22615276 / 21081613 / +7.3% 0.68 / 0.73 / -7.4%
tpcds_q35/duckdb:vortex-file-compressed 46026585 / 45845180 / +0.4% 60161465 / 60960193 / -1.3% 0.77 / 0.75 / +1.7%
tpcds_q36/duckdb:vortex-file-compressed 15338338 / 15013808 / +2.2% 28542605 / 30207330 / -5.5% 0.54 / 0.50 / +8.1%
tpcds_q37/duckdb:vortex-file-compressed 13739618 / 14019558 / -2.0% 22304594 / 24760936 / -9.9% 0.62 / 0.57 / +8.8%
tpcds_q38/duckdb:vortex-file-compressed 22135362 / 22069066 / +0.3% 28072113 / 29150558 / -3.7% 0.79 / 0.76 / +4.2%
tpcds_q39/duckdb:vortex-file-compressed 18206272 / 19017314 / -4.3% 27091148 / 29234339 / -7.3% 0.67 / 0.65 / +3.3%
tpcds_q40/duckdb:vortex-file-compressed 13216333 / 13904062 / -4.9% 20742352 / 20148579 / +2.9% 0.64 / 0.69 / -7.7%
tpcds_q41/duckdb:vortex-file-compressed 6422801 / 6352792 / +1.1% 9595394 / 9273167 / +3.5% 0.67 / 0.69 / -2.3%
tpcds_q42/duckdb:vortex-file-compressed 7798225 / 8107952 / -3.8% 16566626 / 17563073 / -5.7% 0.47 / 0.46 / +2.0%
tpcds_q43/duckdb:vortex-file-compressed 11054524 / 9775534 / +13.1% 🔴 17964928 / 18266324 / -1.7% 0.62 / 0.54 / +15.0%
tpcds_q44/duckdb:vortex-file-compressed 16085820 / 15057161 / +6.8% 26763895 / 27925320 / -4.2% 0.60 / 0.54 / +11.5%
tpcds_q45/duckdb:vortex-file-compressed 22167882 / 22100485 / +0.3% 29162205 / 28840740 / +1.1% 0.76 / 0.77 / -0.8%
tpcds_q46/duckdb:vortex-file-compressed 18807422 / 18323104 / +2.6% 28629600 / 30050558 / -4.7% 0.66 / 0.61 / +7.7%
tpcds_q47/duckdb:vortex-file-compressed 32220792 / 30861844 / +4.4% 41180583 / 41663330 / -1.2% 0.78 / 0.74 / +5.6%
tpcds_q48/duckdb:vortex-file-compressed 20101922 / 19113758 / +5.2% 30830133 / 30374040 / +1.5% 0.65 / 0.63 / +3.6%
tpcds_q49/duckdb:vortex-file-compressed 16821494 / 17002120 / -1.1% 28680329 / 29896111 / -4.1% 0.59 / 0.57 / +3.1%
tpcds_q50/duckdb:vortex-file-compressed 16907730 / 16637121 / +1.6% 31149061 / 28396859 / +9.7% 0.54 / 0.59 / -7.4%
tpcds_q51/duckdb:vortex-file-compressed 76508099 / 76745722 / -0.3% 60283427 / 87001529 / -30.7% 🟢 1.27 / 0.88 / +43.9%
tpcds_q52/duckdb:vortex-file-compressed 11090200 / 8398557 / +32.0% 🔴 16378287 / 18090609 / -9.5% 0.68 / 0.46 / +45.9%
tpcds_q53/duckdb:vortex-file-compressed 14169532 / 14363638 / -1.4% 24858368 / 24918252 / -0.2% 0.57 / 0.58 / -1.1%
tpcds_q54/duckdb:vortex-file-compressed 20153661 / 20239955 / -0.4% 29062211 / 28693432 / +1.3% 0.69 / 0.71 / -1.7%
tpcds_q55/duckdb:vortex-file-compressed 8434134 / 7993150 / +5.5% 17600181 / 18268724 / -3.7% 0.48 / 0.44 / +9.5%
tpcds_q56/duckdb:vortex-file-compressed 17151650 / 17510936 / -2.1% 27933396 / 29674160 / -5.9% 0.61 / 0.59 / +4.1%
tpcds_q57/duckdb:vortex-file-compressed 23837130 / 24037902 / -0.8% 32620346 / 30898893 / +5.6% 0.73 / 0.78 / -6.1%
tpcds_q58/duckdb:vortex-file-compressed 18025758 / 18160971 / -0.7% 26646327 / 31351720 / -15.0% 🟢 0.68 / 0.58 / +16.8%
tpcds_q59/duckdb:vortex-file-compressed 18506031 / 18581974 / -0.4% 24406747 / 25240804 / -3.3% 0.76 / 0.74 / +3.0%
tpcds_q60/duckdb:vortex-file-compressed 19156673 / 17859108 / +7.3% 28298792 / 30292130 / -6.6% 0.68 / 0.59 / +14.8%
tpcds_q61/duckdb:vortex-file-compressed 19611730 / 19107293 / +2.6% 32092757 / 32028767 / +0.2% 0.61 / 0.60 / +2.4%
tpcds_q62/duckdb:vortex-file-compressed 10277705 / 10111051 / +1.6% 17334129 / 16814543 / +3.1% 0.59 / 0.60 / -1.4%
tpcds_q63/duckdb:vortex-file-compressed 13160403 / 13178520 / -0.1% 23030098 / 22478435 / +2.5% 0.57 / 0.59 / -2.5%
tpcds_q64/duckdb:vortex-file-compressed 62563580 / 62484192 / +0.1% 75202495 / 81705089 / -8.0% 0.83 / 0.76 / +8.8%
tpcds_q65/duckdb:vortex-file-compressed 15411770 / 15612778 / -1.3% 28234914 / 27439843 / +2.9% 0.55 / 0.57 / -4.1%
tpcds_q66/duckdb:vortex-file-compressed 21140126 / 21000215 / +0.7% 32430923 / 30871711 / +5.1% 0.65 / 0.68 / -4.2%
tpcds_q67/duckdb:vortex-file-compressed 65385326 / 65324888 / +0.1% 81492214 / 81614089 / -0.1% 0.80 / 0.80 / +0.2%
tpcds_q68/duckdb:vortex-file-compressed 17976684 / 18496470 / -2.8% 27131012 / 29013066 / -6.5% 0.66 / 0.64 / +3.9%
tpcds_q69/duckdb:vortex-file-compressed 28760384 / 28745082 / +0.1% 41784156 / 42988110 / -2.8% 0.69 / 0.67 / +2.9%
tpcds_q70/duckdb:vortex-file-compressed 18487588 / 18527518 / -0.2% 28324817 / 30425241 / -6.9% 0.65 / 0.61 / +7.2%
tpcds_q71/duckdb:vortex-file-compressed 12550865 / 12328950 / +1.8% 21170006 / 23147528 / -8.5% 0.59 / 0.53 / +11.3%
tpcds_q72/duckdb:vortex-file-compressed 61693121 / 62345568 / -1.0% 75855767 / 77929367 / -2.7% 0.81 / 0.80 / +1.7%
tpcds_q73/duckdb:vortex-file-compressed 15010077 / 14862249 / +1.0% 25586107 / 21426699 / +19.4% 🔴 0.59 / 0.69 / -15.4%
tpcds_q74/duckdb:vortex-file-compressed 27312334 / 27436369 / -0.5% 35540864 / 36182034 / -1.8% 0.77 / 0.76 / +1.3%
tpcds_q75/duckdb:vortex-file-compressed 28974541 / 28026600 / +3.4% 38373951 / 41018551 / -6.4% 0.76 / 0.68 / +10.5%
tpcds_q76/duckdb:vortex-file-compressed 12316040 / 13160544 / -6.4% 26268608 / 24968419 / +5.2% 0.47 / 0.53 / -11.0%
tpcds_q77/duckdb:vortex-file-compressed 15861455 / 15806789 / +0.3% 25046971 / 26250214 / -4.6% 0.63 / 0.60 / +5.2%
tpcds_q78/duckdb:vortex-file-compressed 37435436 / 37001813 / +1.2% 47476788 / 45093426 / +5.3% 0.79 / 0.82 / -3.9%
tpcds_q79/duckdb:vortex-file-compressed 14392614 / 14067037 / +2.3% 27769564 / 28748057 / -3.4% 0.52 / 0.49 / +5.9%
tpcds_q80/duckdb:vortex-file-compressed 27279323 / 27670296 / -1.4% 39138200 / 40698887 / -3.8% 0.70 / 0.68 / +2.5%
tpcds_q81/duckdb:vortex-file-compressed 22126204 / 22023086 / +0.5% 31895888 / 29951705 / +6.5% 0.69 / 0.74 / -5.7%
tpcds_q82/duckdb:vortex-file-compressed 33539846 / 31726530 / +5.7% 38216568 / 40178408 / -4.9% 0.88 / 0.79 / +11.1%
tpcds_q83/duckdb:vortex-file-compressed 19962160 / 19509067 / +2.3% 24794678 / 25320364 / -2.1% 0.81 / 0.77 / +4.5%
tpcds_q84/duckdb:vortex-file-compressed 13747001 / 17662036 / -22.2% 🟢 21510716 / 25945197 / -17.1% 🟢 0.64 / 0.68 / -6.1%
tpcds_q85/duckdb:vortex-file-compressed 30866482 / 30934468 / -0.2% 39585142 / 40299788 / -1.8% 0.78 / 0.77 / +1.6%
tpcds_q86/duckdb:vortex-file-compressed 10658658 / 10617302 / +0.4% 17588325 / 17477559 / +0.6% 0.61 / 0.61 / -0.2%
tpcds_q87/duckdb:vortex-file-compressed 23675292 / 23960342 / -1.2% 30631807 / 29959665 / +2.2% 0.77 / 0.80 / -3.4%
tpcds_q88/duckdb:vortex-file-compressed 32284678 / 32468252 / -0.6% 44614277 / 45909071 / -2.8% 0.72 / 0.71 / +2.3%
tpcds_q89/duckdb:vortex-file-compressed 13499297 / 13693586 / -1.4% 27148080 / 23782351 / +14.2% 🔴 0.50 / 0.58 / -13.6%
tpcds_q90/duckdb:vortex-file-compressed 8084786 / 8399971 / -3.8% 15810906 / 13628080 / +16.0% 🔴 0.51 / 0.62 / -17.0%
tpcds_q91/duckdb:vortex-file-compressed 15258420 / 15236188 / +0.1% 21465467 / 22593349 / -5.0% 0.71 / 0.67 / +5.4%
tpcds_q92/duckdb:vortex-file-compressed 12774370 / 12814571 / -0.3% 22008568 / 20387918 / +7.9% 0.58 / 0.63 / -7.7%
tpcds_q93/duckdb:vortex-file-compressed 16571954 / 16844973 / -1.6% 24198835 / 23337467 / +3.7% 0.68 / 0.72 / -5.1%
tpcds_q94/duckdb:vortex-file-compressed 15932943 / 16257304 / -2.0% 25194274 / 26121855 / -3.6% 0.63 / 0.62 / +1.6%
tpcds_q95/duckdb:vortex-file-compressed 44463574 / 44787502 / -0.7% 54192799 / 53588390 / +1.1% 0.82 / 0.84 / -1.8%
tpcds_q96/duckdb:vortex-file-compressed 7368267 / 7254246 / +1.6% 14308020 / 15027843 / -4.8% 0.51 / 0.48 / +6.7%
tpcds_q97/duckdb:vortex-file-compressed 22464438 / 22429648 / +0.2% 28559124 / 29000294 / -1.5% 0.79 / 0.77 / +1.7%
tpcds_q98/duckdb:vortex-file-compressed 13229435 / 13403510 / -1.3% 21086677 / 25345823 / -16.8% 🟢 0.63 / 0.53 / +18.6%
tpcds_q99/duckdb:vortex-file-compressed 13387840 / 13636215 / -1.8% 21984095 / 20056022 / +9.6% 0.61 / 0.68 / -10.4%
duckdb / vortex-compact / ns (1.002x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16235456 / 16708401 / -2.8% 23950932 / 24411743 / -1.9% 0.68 / 0.68 / -1.0%
tpcds_q02/duckdb:vortex-compact 16726362 / 16365856 / +2.2% 22356341 / 23724405 / -5.8% 0.75 / 0.69 / +8.5%
tpcds_q03/duckdb:vortex-compact 21508370 / 21406370 / +0.5% 33916202 / 35305954 / -3.9% 0.63 / 0.61 / +4.6%
tpcds_q04/duckdb:vortex-compact 53458294 / 54431170 / -1.8% 69031149 / 68207582 / +1.2% 0.77 / 0.80 / -3.0%
tpcds_q05/duckdb:vortex-compact 23646352 / 22573182 / +4.8% 30246710 / 31380054 / -3.6% 0.78 / 0.72 / +8.7%
tpcds_q06/duckdb:vortex-compact 33560746 / 33493873 / +0.2% 44891045 / 44467516 / +1.0% 0.75 / 0.75 / -0.7%
tpcds_q07/duckdb:vortex-compact 25140540 / 24402977 / +3.0% 35836720 / 35084953 / +2.1% 0.70 / 0.70 / +0.9%
tpcds_q08/duckdb:vortex-compact 49026508 / 48973270 / +0.1% 57535898 / 57093361 / +0.8% 0.85 / 0.86 / -0.7%
tpcds_q09/duckdb:vortex-compact 18606265 / 19032266 / -2.2% 28579784 / 26878616 / +6.3% 0.65 / 0.71 / -8.1%
tpcds_q10/duckdb:vortex-compact 45443984 / 45355720 / +0.2% 58782418 / 56563234 / +3.9% 0.77 / 0.80 / -3.6%
tpcds_q11/duckdb:vortex-compact 45945168 / 45312007 / +1.4% 56941041 / 55880427 / +1.9% 0.81 / 0.81 / -0.5%
tpcds_q12/duckdb:vortex-compact 13407959 / 13508736 / -0.7% 19712401 / 20471798 / -3.7% 0.68 / 0.66 / +3.1%
tpcds_q13/duckdb:vortex-compact 37597092 / 37481512 / +0.3% 49207183 / 47342218 / +3.9% 0.76 / 0.79 / -3.5%
tpcds_q14/duckdb:vortex-compact 68564216 / 69767905 / -1.7% 81427256 / 77816404 / +4.6% 0.84 / 0.90 / -6.1%
tpcds_q15/duckdb:vortex-compact 26001960 / 26374774 / -1.4% 31483576 / 29923758 / +5.2% 0.83 / 0.88 / -6.3%
tpcds_q16/duckdb:vortex-compact 24701913 / 24754038 / -0.2% 32230269 / 35510976 / -9.2% 0.77 / 0.70 / +9.9%
tpcds_q17/duckdb:vortex-compact 45597682 / 45465248 / +0.3% 58637899 / 58035807 / +1.0% 0.78 / 0.78 / -0.7%
tpcds_q18/duckdb:vortex-compact 35781340 / 35574325 / +0.6% 44382244 / 45393555 / -2.2% 0.81 / 0.78 / +2.9%
tpcds_q19/duckdb:vortex-compact 36093315 / 35233671 / +2.4% 44050420 / 44293628 / -0.5% 0.82 / 0.80 / +3.0%
tpcds_q20/duckdb:vortex-compact 14298381 / 14118010 / +1.3% 19890616 / 19137929 / +3.9% 0.72 / 0.74 / -2.6%
tpcds_q21/duckdb:vortex-compact 10222562 / 10638309 / -3.9% 18248729 / 18182316 / +0.4% 0.56 / 0.59 / -4.3%
tpcds_q22/duckdb:vortex-compact 31897030 / 30639908 / +4.1% 42456006 / 40495170 / +4.8% 0.75 / 0.76 / -0.7%
tpcds_q23/duckdb:vortex-compact 44106730 / 42093576 / +4.8% 53378549 / 52734551 / +1.2% 0.83 / 0.80 / +3.5%
tpcds_q24/duckdb:vortex-compact 39274646 / 39211180 / +0.2% 48364854 / 54425252 / -11.1% 🟢 0.81 / 0.72 / +12.7%
tpcds_q25/duckdb:vortex-compact 43382890 / 42434440 / +2.2% 54055763 / 55819328 / -3.2% 0.80 / 0.76 / +5.6%
tpcds_q26/duckdb:vortex-compact 21967810 / 22500047 / -2.4% 28369691 / 27962902 / +1.5% 0.77 / 0.80 / -3.8%
tpcds_q27/duckdb:vortex-compact 29172813 / 30711162 / -5.0% 37751958 / 38234615 / -1.3% 0.77 / 0.80 / -3.8%
tpcds_q28/duckdb:vortex-compact 22840177 / 23339122 / -2.1% 31279428 / 33961904 / -7.9% 0.73 / 0.69 / +6.3%
tpcds_q29/duckdb:vortex-compact 44812366 / 44162738 / +1.5% 56526450 / 57193408 / -1.2% 0.79 / 0.77 / +2.7%
tpcds_q30/duckdb:vortex-compact 22490003 / 22503861 / -0.1% 29918250 / 29682539 / +0.8% 0.75 / 0.76 / -0.8%
tpcds_q31/duckdb:vortex-compact 23555034 / 23470548 / +0.4% 32983516 / 30154344 / +9.4% 0.71 / 0.78 / -8.2%
tpcds_q32/duckdb:vortex-compact 14052670 / 14135436 / -0.6% 20383898 / 23669440 / -13.9% 🟢 0.69 / 0.60 / +15.4%
tpcds_q33/duckdb:vortex-compact 23132136 / 25227438 / -8.3% 35082943 / 39199311 / -10.5% 🟢 0.66 / 0.64 / +2.5%
tpcds_q34/duckdb:vortex-compact 21972694 / 21998926 / -0.1% 29218975 / 32517307 / -10.1% 🟢 0.75 / 0.68 / +11.2%
tpcds_q35/duckdb:vortex-compact 61767831 / 61537895 / +0.4% 78958387 / 76710873 / +2.9% 0.78 / 0.80 / -2.5%
tpcds_q36/duckdb:vortex-compact 21908386 / 21971316 / -0.3% 30539982 / 33271286 / -8.2% 0.72 / 0.66 / +8.6%
tpcds_q37/duckdb:vortex-compact 15508494 / 15222852 / +1.9% 26143861 / 23615025 / +10.7% 🔴 0.59 / 0.64 / -8.0%
tpcds_q38/duckdb:vortex-compact 26399654 / 25906900 / +1.9% 33209035 / 36679837 / -9.5% 0.79 / 0.71 / +12.6%
tpcds_q39/duckdb:vortex-compact 19726612 / 19722856 / +0.0% 27416320 / 31798461 / -13.8% 🟢 0.72 / 0.62 / +16.0%
tpcds_q40/duckdb:vortex-compact 15916230 / 16132436 / -1.3% 24093931 / 21152203 / +13.9% 🔴 0.66 / 0.76 / -13.4%
tpcds_q41/duckdb:vortex-compact 7545330 / 7482775 / +0.8% 11027096 / 11068106 / -0.4% 0.68 / 0.68 / +1.2%
tpcds_q42/duckdb:vortex-compact 11825484 / 12748185 / -7.2% 21481941 / 20173763 / +6.5% 0.55 / 0.63 / -12.9%
tpcds_q43/duckdb:vortex-compact 16972875 / 16106383 / +5.4% 23810325 / 22946854 / +3.8% 0.71 / 0.70 / +1.6%
tpcds_q44/duckdb:vortex-compact 22515847 / 22122742 / +1.8% 35000514 / 35456703 / -1.3% 0.64 / 0.62 / +3.1%
tpcds_q45/duckdb:vortex-compact 27450474 / 26895830 / +2.1% 32829645 / 33615978 / -2.3% 0.84 / 0.80 / +4.5%
tpcds_q46/duckdb:vortex-compact 28919358 / 28696863 / +0.8% 36902810 / 38391923 / -3.9% 0.78 / 0.75 / +4.8%
tpcds_q47/duckdb:vortex-compact 36321612 / 36084742 / +0.7% 47953608 / 46048678 / +4.1% 0.76 / 0.78 / -3.3%
tpcds_q48/duckdb:vortex-compact 32969204 / 33218976 / -0.8% 43760605 / 43091482 / +1.6% 0.75 / 0.77 / -2.3%
tpcds_q49/duckdb:vortex-compact 23433526 / 23894052 / -1.9% 40584165 / 34151403 / +18.8% 🔴 0.58 / 0.70 / -17.5%
tpcds_q50/duckdb:vortex-compact 27361686 / 27245050 / +0.4% 36184490 / 36678342 / -1.3% 0.76 / 0.74 / +1.8%
tpcds_q51/duckdb:vortex-compact 53668682 / 65763167 / -18.4% 🟢 62425433 / 60665072 / +2.9% 0.86 / 1.08 / -20.7%
tpcds_q52/duckdb:vortex-compact 14328070 / 12989300 / +10.3% 🔴 19695480 / 20748812 / -5.1% 0.73 / 0.63 / +16.2%
tpcds_q53/duckdb:vortex-compact 21261800 / 21545662 / -1.3% 29610874 / 29016974 / +2.0% 0.72 / 0.74 / -3.3%
tpcds_q54/duckdb:vortex-compact 27324086 / 27519158 / -0.7% 37123388 / 39872324 / -6.9% 0.74 / 0.69 / +6.6%
tpcds_q55/duckdb:vortex-compact 11801046 / 13115980 / -10.0% 🟢 19582031 / 22814378 / -14.2% 🟢 0.60 / 0.57 / +4.8%
tpcds_q56/duckdb:vortex-compact 23950234 / 24197796 / -1.0% 32726402 / 34865986 / -6.1% 0.73 / 0.69 / +5.4%
tpcds_q57/duckdb:vortex-compact 27657913 / 27417257 / +0.9% 37123594 / 33883936 / +9.6% 0.75 / 0.81 / -7.9%
tpcds_q58/duckdb:vortex-compact 23354370 / 24462062 / -4.5% 34271530 / 33885113 / +1.1% 0.68 / 0.72 / -5.6%
tpcds_q59/duckdb:vortex-compact 23069286 / 23148762 / -0.3% 30169327 / 29299130 / +3.0% 0.76 / 0.79 / -3.2%
tpcds_q60/duckdb:vortex-compact 24621309 / 24895334 / -1.1% 35465433 / 36535601 / -2.9% 0.69 / 0.68 / +1.9%
tpcds_q61/duckdb:vortex-compact 31480592 / 31605752 / -0.4% 43793353 / 40901620 / +7.1% 0.72 / 0.77 / -7.0%
tpcds_q62/duckdb:vortex-compact 11756138 / 11652837 / +0.9% 20456347 / 20299789 / +0.8% 0.57 / 0.57 / +0.1%
tpcds_q63/duckdb:vortex-compact 20799270 / 20435303 / +1.8% 30166491 / 28270353 / +6.7% 0.69 / 0.72 / -4.6%
tpcds_q64/duckdb:vortex-compact 83973154 / 84987364 / -1.2% 94510587 / 95983855 / -1.5% 0.89 / 0.89 / +0.3%
tpcds_q65/duckdb:vortex-compact 21099372 / 19895118 / +6.1% 29998905 / 32135296 / -6.6% 0.70 / 0.62 / +13.6%
tpcds_q66/duckdb:vortex-compact 25739270 / 25646981 / +0.4% 33216368 / 37715689 / -11.9% 🟢 0.77 / 0.68 / +14.0%
tpcds_q67/duckdb:vortex-compact 71207324 / 71814088 / -0.8% 85280057 / 85287777 / -0.0% 0.83 / 0.84 / -0.8%
tpcds_q68/duckdb:vortex-compact 29482886 / 28841675 / +2.2% 43186162 / 39780556 / +8.6% 0.68 / 0.73 / -5.8%
tpcds_q69/duckdb:vortex-compact 46510578 / 46386645 / +0.3% 59231526 / 57555401 / +2.9% 0.79 / 0.81 / -2.6%
tpcds_q70/duckdb:vortex-compact 31134308 / 30832231 / +1.0% 38808215 / 37777836 / +2.7% 0.80 / 0.82 / -1.7%
tpcds_q71/duckdb:vortex-compact 19076946 / 19562995 / -2.5% 30848360 / 29405268 / +4.9% 0.62 / 0.67 / -7.0%
tpcds_q72/duckdb:vortex-compact 72397772 / 68704682 / +5.4% 79587137 / 83850513 / -5.1% 0.91 / 0.82 / +11.0%
tpcds_q73/duckdb:vortex-compact 21198718 / 21231104 / -0.2% 28824030 / 28679480 / +0.5% 0.74 / 0.74 / -0.7%
tpcds_q74/duckdb:vortex-compact 32000356 / 31755024 / +0.8% 41716782 / 41390192 / +0.8% 0.77 / 0.77 / -0.0%
tpcds_q75/duckdb:vortex-compact 32353936 / 32897136 / -1.7% 46816184 / 48126287 / -2.7% 0.69 / 0.68 / +1.1%
tpcds_q76/duckdb:vortex-compact 16357433 / 16566722 / -1.3% 28347302 / 29672219 / -4.5% 0.58 / 0.56 / +3.4%
tpcds_q77/duckdb:vortex-compact 23842772 / 22510409 / +5.9% 30184238 / 32509099 / -7.2% 0.79 / 0.69 / +14.1%
tpcds_q78/duckdb:vortex-compact 41722934 / 41644967 / +0.2% 51934770 / 51004628 / +1.8% 0.80 / 0.82 / -1.6%
tpcds_q79/duckdb:vortex-compact 46240722 / 37303913 / +24.0% 🔴 47626566 / 45642723 / +4.3% 0.97 / 0.82 / +18.8%
tpcds_q80/duckdb:vortex-compact 37153202 / 35995986 / +3.2% 47437568 / 49486806 / -4.1% 0.78 / 0.73 / +7.7%
tpcds_q81/duckdb:vortex-compact 24297738 / 24235086 / +0.3% 32570271 / 35001509 / -6.9% 0.75 / 0.69 / +7.7%
tpcds_q82/duckdb:vortex-compact 36124920 / 35514797 / +1.7% 43238394 / 42799851 / +1.0% 0.84 / 0.83 / +0.7%
tpcds_q83/duckdb:vortex-compact 28586348 / 28877218 / -1.0% 33294555 / 33347141 / -0.2% 0.86 / 0.87 / -0.9%
tpcds_q84/duckdb:vortex-compact 14930610 / 14773627 / +1.1% 20965990 / 23051531 / -9.0% 0.71 / 0.64 / +11.1%
tpcds_q85/duckdb:vortex-compact 41133908 / 41136881 / -0.0% 51328959 / 49734394 / +3.2% 0.80 / 0.83 / -3.1%
tpcds_q86/duckdb:vortex-compact 12071337 / 11887126 / +1.5% 19098562 / 20609491 / -7.3% 0.63 / 0.58 / +9.6%
tpcds_q87/duckdb:vortex-compact 28356218 / 28289742 / +0.2% 34368945 / 34577562 / -0.6% 0.83 / 0.82 / +0.8%
tpcds_q88/duckdb:vortex-compact 67258316 / 67719560 / -0.7% 76277484 / 79820477 / -4.4% 0.88 / 0.85 / +3.9%
tpcds_q89/duckdb:vortex-compact 21427908 / 20395738 / +5.1% 30978277 / 28445895 / +8.9% 0.69 / 0.72 / -3.5%
tpcds_q90/duckdb:vortex-compact 12475821 / 14362215 / -13.1% 🟢 18203392 / 21051970 / -13.5% 🟢 0.69 / 0.68 / +0.5%
tpcds_q91/duckdb:vortex-compact 30395741 / 30076636 / +1.1% 40194757 / 37420946 / +7.4% 0.76 / 0.80 / -5.9%
tpcds_q92/duckdb:vortex-compact 20657376 / 20222476 / +2.2% 30226232 / 29523015 / +2.4% 0.68 / 0.68 / -0.2%
tpcds_q93/duckdb:vortex-compact 18436054 / 18352012 / +0.5% 25788800 / 26153133 / -1.4% 0.71 / 0.70 / +1.9%
tpcds_q94/duckdb:vortex-compact 21699731 / 21859738 / -0.7% 29862171 / 30782429 / -3.0% 0.73 / 0.71 / +2.3%
tpcds_q95/duckdb:vortex-compact 46106506 / 46043748 / +0.1% 55985127 / 55098719 / +1.6% 0.82 / 0.84 / -1.4%
tpcds_q96/duckdb:vortex-compact 18246051 / 16876875 / +8.1% 33649108 / 23270502 / +44.6% 🔴 0.54 / 0.73 / -25.2%
tpcds_q97/duckdb:vortex-compact 25102747 / 25197193 / -0.4% 32707446 / 33035660 / -1.0% 0.77 / 0.76 / +0.6%
tpcds_q98/duckdb:vortex-compact 17877030 / 18161512 / -1.6% 27559963 / 27852018 / -1.0% 0.65 / 0.65 / -0.5%
tpcds_q99/duckdb:vortex-compact 16846372 / 16679892 / +1.0% 24091759 / 22180027 / +8.6% 0.70 / 0.75 / -7.0%
duckdb / parquet / ns (0.995x ➖, 4↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24799675 / 24838881 / -0.2% 31977364 / 34045178 / -6.1% 0.78 / 0.73 / +6.3%
tpcds_q02/duckdb:parquet 15922390 / 15757742 / +1.0% 20587289 / 21856107 / -5.8% 0.77 / 0.72 / +7.3%
tpcds_q03/duckdb:parquet 9294371 / 9106602 / +2.1% 19439235 / 15920916 / +22.1% 🔴 0.48 / 0.57 / -16.4%
tpcds_q04/duckdb:parquet 129668235 / 129601646 / +0.1% 134381345 / 135187549 / -0.6% 0.96 / 0.96 / +0.7%
tpcds_q05/duckdb:parquet 22126610 / 22992768 / -3.8% 29011341 / 26052133 / +11.4% 🔴 0.76 / 0.88 / -13.6%
tpcds_q06/duckdb:parquet 26973780 / 27082650 / -0.4% 41751890 / 36749060 / +13.6% 🔴 0.65 / 0.74 / -12.3%
tpcds_q07/duckdb:parquet 18292940 / 15487555 / +18.1% 🔴 26063673 / 23898342 / +9.1% 0.70 / 0.65 / +8.3%
tpcds_q08/duckdb:parquet 26115457 / 25971935 / +0.6% 33189224 / 33241691 / -0.2% 0.79 / 0.78 / +0.7%
tpcds_q09/duckdb:parquet 19733038 / 19503238 / +1.2% 23285704 / 24295412 / -4.2% 0.85 / 0.80 / +5.6%
tpcds_q10/duckdb:parquet 28111779 / 27979538 / +0.5% 38522237 / 37909740 / +1.6% 0.73 / 0.74 / -1.1%
tpcds_q11/duckdb:parquet 73067237 / 73548240 / -0.7% 78245337 / 78477012 / -0.3% 0.93 / 0.94 / -0.4%
tpcds_q12/duckdb:parquet 12948635 / 15423039 / -16.0% 🟢 17743968 / 21118023 / -16.0% 🟢 0.73 / 0.73 / -0.1%
tpcds_q13/duckdb:parquet 24594130 / 24258672 / +1.4% 30442924 / 30640499 / -0.6% 0.81 / 0.79 / +2.0%
tpcds_q14/duckdb:parquet 61958121 / 61611074 / +0.6% 67450491 / 73926024 / -8.8% 0.92 / 0.83 / +10.2%
tpcds_q15/duckdb:parquet 25443861 / 25315742 / +0.5% 30777565 / 29729058 / +3.5% 0.83 / 0.85 / -2.9%
tpcds_q16/duckdb:parquet 21003851 / 20952604 / +0.2% 28839880 / 29359700 / -1.8% 0.73 / 0.71 / +2.1%
tpcds_q17/duckdb:parquet 32778516 / 32743138 / +0.1% 40960581 / 40676111 / +0.7% 0.80 / 0.80 / -0.6%
tpcds_q18/duckdb:parquet 40167103 / 42163642 / -4.7% 50425346 / 50057322 / +0.7% 0.80 / 0.84 / -5.4%
tpcds_q19/duckdb:parquet 26279990 / 25113590 / +4.6% 37345607 / 32224280 / +15.9% 🔴 0.70 / 0.78 / -9.7%
tpcds_q20/duckdb:parquet 13966152 / 13844587 / +0.9% 18739978 / 18525232 / +1.2% 0.75 / 0.75 / -0.3%
tpcds_q21/duckdb:parquet 9475349 / 9456202 / +0.2% 12146991 / 12826139 / -5.3% 0.78 / 0.74 / +5.8%
tpcds_q22/duckdb:parquet 37097286 / 36259556 / +2.3% 39043829 / 41964189 / -7.0% 0.95 / 0.86 / +10.0%
tpcds_q23/duckdb:parquet 41195078 / 41726568 / -1.3% 47183510 / 48450772 / -2.6% 0.87 / 0.86 / +1.4%
tpcds_q24/duckdb:parquet 33772156 / 37362073 / -9.6% 41723340 / 44861535 / -7.0% 0.81 / 0.83 / -2.8%
tpcds_q25/duckdb:parquet 31616388 / 31627847 / -0.0% 39675278 / 39223880 / +1.2% 0.80 / 0.81 / -1.2%
tpcds_q26/duckdb:parquet 31786040 / 31767012 / +0.1% 38945137 / 37966363 / +2.6% 0.82 / 0.84 / -2.5%
tpcds_q27/duckdb:parquet 31625240 / 32613528 / -3.0% 38893204 / 41911160 / -7.2% 0.81 / 0.78 / +4.5%
tpcds_q28/duckdb:parquet 18084411 / 17650806 / +2.5% 26531040 / 23692242 / +12.0% 🔴 0.68 / 0.75 / -8.5%
tpcds_q29/duckdb:parquet 31283378 / 31239849 / +0.1% 39357101 / 39465306 / -0.3% 0.79 / 0.79 / +0.4%
tpcds_q30/duckdb:parquet 33923580 / 34628578 / -2.0% 42544748 / 42810125 / -0.6% 0.80 / 0.81 / -1.4%
tpcds_q31/duckdb:parquet 20862938 / 20893259 / -0.1% 25707820 / 25521678 / +0.7% 0.81 / 0.82 / -0.9%
tpcds_q32/duckdb:parquet 12053678 / 12199460 / -1.2% 18338074 / 18283373 / +0.3% 0.66 / 0.67 / -1.5%
tpcds_q33/duckdb:parquet 16369092 / 16642879 / -1.6% 22805246 / 24105935 / -5.4% 0.72 / 0.69 / +4.0%
tpcds_q34/duckdb:parquet 16629379 / 16548498 / +0.5% 22060625 / 22518186 / -2.0% 0.75 / 0.73 / +2.6%
tpcds_q35/duckdb:parquet 48501146 / 48098457 / +0.8% 56523282 / 56401187 / +0.2% 0.86 / 0.85 / +0.6%
tpcds_q36/duckdb:parquet 15848138 / 15868442 / -0.1% 23420805 / 24050598 / -2.6% 0.68 / 0.66 / +2.6%
tpcds_q37/duckdb:parquet 12254314 / 12536760 / -2.3% 19333442 / 16297669 / +18.6% 🔴 0.63 / 0.77 / -17.6%
tpcds_q38/duckdb:parquet 27361004 / 26762246 / +2.2% 31530419 / 30329138 / +4.0% 0.87 / 0.88 / -1.7%
tpcds_q39/duckdb:parquet 24515100 / 24512606 / +0.0% 28693438 / 29559754 / -2.9% 0.85 / 0.83 / +3.0%
tpcds_q40/duckdb:parquet 16471112 / 16646271 / -1.1% 21283339 / 21084823 / +0.9% 0.77 / 0.79 / -2.0%
tpcds_q41/duckdb:parquet 7878162 / 10287631 / -23.4% 🟢 12929943 / 15617075 / -17.2% 🟢 0.61 / 0.66 / -7.5%
tpcds_q42/duckdb:parquet 8712540 / 8755154 / -0.5% 15480337 / 15220779 / +1.7% 0.56 / 0.58 / -2.2%
tpcds_q43/duckdb:parquet 10689686 / 10731144 / -0.4% 14786186 / 14987996 / -1.3% 0.72 / 0.72 / +1.0%
tpcds_q44/duckdb:parquet 18110454 / 16088978 / +12.6% 🔴 24763972 / 28147127 / -12.0% 🟢 0.73 / 0.57 / +27.9%
tpcds_q45/duckdb:parquet 23777132 / 23662770 / +0.5% 28833716 / 29754957 / -3.1% 0.82 / 0.80 / +3.7%
tpcds_q46/duckdb:parquet 37252404 / 36965034 / +0.8% 44601836 / 49905536 / -10.6% 🟢 0.84 / 0.74 / +12.8%
tpcds_q47/duckdb:parquet 31361262 / 31478466 / -0.4% 40632889 / 38164398 / +6.5% 0.77 / 0.82 / -6.4%
tpcds_q48/duckdb:parquet 21065165 / 21221376 / -0.7% 26852050 / 30030061 / -10.6% 🟢 0.78 / 0.71 / +11.0%
tpcds_q49/duckdb:parquet 20201701 / 20525513 / -1.6% 27648048 / 27972953 / -1.2% 0.73 / 0.73 / -0.4%
tpcds_q50/duckdb:parquet 18015678 / 17993552 / +0.1% 24643993 / 23975679 / +2.8% 0.73 / 0.75 / -2.6%
tpcds_q51/duckdb:parquet 53684684 / 54090228 / -0.7% 62366303 / 60567012 / +3.0% 0.86 / 0.89 / -3.6%
tpcds_q52/duckdb:parquet 8940861 / 9006282 / -0.7% 15698739 / 15173532 / +3.5% 0.57 / 0.59 / -4.0%
tpcds_q53/duckdb:parquet 11928150 / 11951728 / -0.2% 16989896 / 19295604 / -11.9% 🟢 0.70 / 0.62 / +13.3%
tpcds_q54/duckdb:parquet 21181774 / 20975758 / +1.0% 29720709 / 31879768 / -6.8% 0.71 / 0.66 / +8.3%
tpcds_q55/duckdb:parquet 8789471 / 8907126 / -1.3% 15937878 / 15250604 / +4.5% 0.55 / 0.58 / -5.6%
tpcds_q56/duckdb:parquet 17167000 / 16857072 / +1.8% 23865440 / 24847443 / -4.0% 0.72 / 0.68 / +6.0%
tpcds_q57/duckdb:parquet 28876862 / 29211828 / -1.1% 34348224 / 34024727 / +1.0% 0.84 / 0.86 / -2.1%
tpcds_q58/duckdb:parquet 19069850 / 19213601 / -0.7% 26236196 / 26274840 / -0.1% 0.73 / 0.73 / -0.6%
tpcds_q59/duckdb:parquet 20134788 / 20129620 / +0.0% 24763773 / 25041652 / -1.1% 0.81 / 0.80 / +1.1%
tpcds_q60/duckdb:parquet 17349526 / 17334191 / +0.1% 26195602 / 24733884 / +5.9% 0.66 / 0.70 / -5.5%
tpcds_q61/duckdb:parquet 22623862 / 22794023 / -0.7% 28449814 / 28931283 / -1.7% 0.80 / 0.79 / +0.9%
tpcds_q62/duckdb:parquet 10960998 / 10803906 / +1.5% 14728233 / 15014040 / -1.9% 0.74 / 0.72 / +3.4%
tpcds_q63/duckdb:parquet 11295046 / 11341724 / -0.4% 16495653 / 16101617 / +2.4% 0.68 / 0.70 / -2.8%
tpcds_q64/duckdb:parquet 53507498 / 52972316 / +1.0% 65657892 / 69576642 / -5.6% 0.81 / 0.76 / +7.0%
tpcds_q65/duckdb:parquet 14766495 / 14742418 / +0.2% 20175495 / 20269270 / -0.5% 0.73 / 0.73 / +0.6%
tpcds_q66/duckdb:parquet 25040432 / 25083822 / -0.2% 31361083 / 33700170 / -6.9% 0.80 / 0.74 / +7.3%
tpcds_q67/duckdb:parquet 77285065 / 77383638 / -0.1% 91372827 / 84258847 / +8.4% 0.85 / 0.92 / -7.9%
tpcds_q68/duckdb:parquet 30502179 / 30331446 / +0.6% 39398254 / 39764816 / -0.9% 0.77 / 0.76 / +1.5%
tpcds_q69/duckdb:parquet 29150575 / 29085092 / +0.2% 38896529 / 39284062 / -1.0% 0.75 / 0.74 / +1.2%
tpcds_q70/duckdb:parquet 16435425 / 19289978 / -14.8% 🟢 24756624 / 25240847 / -1.9% 0.66 / 0.76 / -13.1%
tpcds_q71/duckdb:parquet 15185652 / 15040244 / +1.0% 20632956 / 22762750 / -9.4% 0.74 / 0.66 / +11.4%
tpcds_q72/duckdb:parquet 81743076 / 81711558 / +0.0% 89120214 / 86556933 / +3.0% 0.92 / 0.94 / -2.8%
tpcds_q73/duckdb:parquet 13725293 / 13751363 / -0.2% 19265227 / 19254528 / +0.1% 0.71 / 0.71 / -0.2%
tpcds_q74/duckdb:parquet 100298738 / 99921828 / +0.4% 106492023 / 106841931 / -0.3% 0.94 / 0.94 / +0.7%
tpcds_q75/duckdb:parquet 41147643 / 40631800 / +1.3% 52135193 / 50722119 / +2.8% 0.79 / 0.80 / -1.5%
tpcds_q76/duckdb:parquet 13870259 / 13773352 / +0.7% 24926243 / 21382178 / +16.6% 🔴 0.56 / 0.64 / -13.6%
tpcds_q77/duckdb:parquet 17751887 / 18311562 / -3.1% 24736431 / 24680434 / +0.2% 0.72 / 0.74 / -3.3%
tpcds_q78/duckdb:parquet 48266053 / 48611390 / -0.7% 53700301 / 53777750 / -0.1% 0.90 / 0.90 / -0.6%
tpcds_q79/duckdb:parquet 21265683 / 20870575 / +1.9% 27876047 / 30953938 / -9.9% 0.76 / 0.67 / +13.1%
tpcds_q80/duckdb:parquet 32707201 / 32876670 / -0.5% 40083453 / 40714571 / -1.6% 0.82 / 0.81 / +1.1%
tpcds_q81/duckdb:parquet 31532096 / 33969600 / -7.2% 40249718 / 39278981 / +2.5% 0.78 / 0.86 / -9.4%
tpcds_q82/duckdb:parquet 13167693 / 12544904 / +5.0% 18362661 / 17094324 / +7.4% 0.72 / 0.73 / -2.3%
tpcds_q83/duckdb:parquet 16413922 / 17988529 / -8.8% 21382371 / 21659332 / -1.3% 0.77 / 0.83 / -7.6%
tpcds_q84/duckdb:parquet 18667694 / 18593622 / +0.4% 24312460 / 24035060 / +1.2% 0.77 / 0.77 / -0.7%
tpcds_q85/duckdb:parquet 35371727 / 35367869 / +0.0% 47696272 / 44339356 / +7.6% 0.74 / 0.80 / -7.0%
tpcds_q86/duckdb:parquet 13982495 / 12285362 / +13.8% 🔴 18382536 / 19293870 / -4.7% 0.76 / 0.64 / +19.5%
tpcds_q87/duckdb:parquet 28318119 / 28476957 / -0.6% 34144401 / 36225915 / -5.7% 0.83 / 0.79 / +5.5%
tpcds_q88/duckdb:parquet 28515768 / 27002582 / +5.6% 35657674 / 31843886 / +12.0% 🔴 0.80 / 0.85 / -5.7%
tpcds_q89/duckdb:parquet 14355503 / 12966993 / +10.7% 🔴 18047228 / 22431118 / -19.5% 🟢 0.80 / 0.58 / +37.6%
tpcds_q90/duckdb:parquet 8728898 / 7465809 / +16.9% 🔴 12412333 / 12762103 / -2.7% 0.70 / 0.58 / +20.2%
tpcds_q91/duckdb:parquet 21577988 / 21504930 / +0.3% 31773623 / 28179415 / +12.8% 🔴 0.68 / 0.76 / -11.0%
tpcds_q92/duckdb:parquet 12509602 / 15310119 / -18.3% 🟢 18707046 / 22785751 / -17.9% 🟢 0.67 / 0.67 / -0.5%
tpcds_q93/duckdb:parquet 21782300 / 23017035 / -5.4% 26572979 / 27123018 / -2.0% 0.82 / 0.85 / -3.4%
tpcds_q94/duckdb:parquet 16910216 / 16937506 / -0.2% 25162320 / 25475525 / -1.2% 0.67 / 0.66 / +1.1%
tpcds_q95/duckdb:parquet 90785436 / 90696609 / +0.1% 98030211 / 99826381 / -1.8% 0.93 / 0.91 / +1.9%
tpcds_q96/duckdb:parquet 7031167 / 7062659 / -0.4% 10358576 / 10958694 / -5.5% 0.68 / 0.64 / +5.3%
tpcds_q97/duckdb:parquet 26042080 / 26261618 / -0.8% 32072511 / 32116614 / -0.1% 0.81 / 0.82 / -0.7%
tpcds_q98/duckdb:parquet 15205332 / 16842838 / -9.7% 22519975 / 22465674 / +0.2% 0.68 / 0.75 / -9.9%
tpcds_q99/duckdb:parquet 17345682 / 17404396 / -0.3% 21679566 / 21523666 / +0.7% 0.80 / 0.81 / -1.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 96150276 / 95523314 / +0.7% 155550604 / 171960873 / -9.5% 0.62 / 0.56 / +11.3%
tpch_q02/datafusion:vortex-file-compressed 64004650 / 65374262 / -2.1% 99831482 / 96114655 / +3.9% 0.64 / 0.68 / -5.7%
tpch_q03/datafusion:vortex-file-compressed 65585788 / 64512872 / +1.7% 120866346 / 118587917 / +1.9% 0.54 / 0.54 / -0.3%
tpch_q04/datafusion:vortex-file-compressed 35020146 / 35421610 / -1.1% 80552963 / 80222392 / +0.4% 0.43 / 0.44 / -1.5%
tpch_q05/datafusion:vortex-file-compressed 118161848 / 117454099 / +0.6% 185580728 / 184724564 / +0.5% 0.64 / 0.64 / +0.1%
tpch_q06/datafusion:vortex-file-compressed 13784859 / 14241331 / -3.2% 76593389 / 73769845 / +3.8% 0.18 / 0.19 / -6.8%
tpch_q07/datafusion:vortex-file-compressed 142535370 / 138850071 / +2.7% 196217301 / 198776342 / -1.3% 0.73 / 0.70 / +4.0%
tpch_q08/datafusion:vortex-file-compressed 144465952 / 142666968 / +1.3% 212969579 / 202008979 / +5.4% 0.68 / 0.71 / -4.0%
tpch_q09/datafusion:vortex-file-compressed 192492156 / 186944099 / +3.0% 267923649 / 253709956 / +5.6% 0.72 / 0.74 / -2.5%
tpch_q10/datafusion:vortex-file-compressed 73924221 / 73770805 / +0.2% 140569739 / 142252841 / -1.2% 0.53 / 0.52 / +1.4%
tpch_q11/datafusion:vortex-file-compressed 43785439 / 42692543 / +2.6% 67255895 / 69154892 / -2.7% 0.65 / 0.62 / +5.5%
tpch_q12/datafusion:vortex-file-compressed 44552607 / 44432886 / +0.3% 99655117 / 95906542 / +3.9% 0.45 / 0.46 / -3.5%
tpch_q13/datafusion:vortex-file-compressed 46705243 / 46431527 / +0.6% 81167230 / 76840827 / +5.6% 0.58 / 0.60 / -4.8%
tpch_q14/datafusion:vortex-file-compressed 25660966 / 24881100 / +3.1% 100848075 / 99435470 / +1.4% 0.25 / 0.25 / +1.7%
tpch_q15/datafusion:vortex-file-compressed 36768409 / 36532136 / +0.6% 103916321 / 102630733 / +1.3% 0.35 / 0.36 / -0.6%
tpch_q16/datafusion:vortex-file-compressed 37488410 / 37888675 / -1.1% 71238178 / 68885265 / +3.4% 0.53 / 0.55 / -4.3%
tpch_q17/datafusion:vortex-file-compressed 175090523 / 170535095 / +2.7% 227789525 / 227349402 / +0.2% 0.77 / 0.75 / +2.5%
tpch_q18/datafusion:vortex-file-compressed 203629525 / 201563233 / +1.0% 262643917 / 267579796 / -1.8% 0.78 / 0.75 / +2.9%
tpch_q19/datafusion:vortex-file-compressed 33993832 / 34337976 / -1.0% 95608746 / 96952254 / -1.4% 0.36 / 0.35 / +0.4%
tpch_q20/datafusion:vortex-file-compressed 63179678 / 63270097 / -0.1% 128667673 / 125767722 / +2.3% 0.49 / 0.50 / -2.4%
tpch_q21/datafusion:vortex-file-compressed 182166375 / 183899328 / -0.9% 243495442 / 249741544 / -2.5% 0.75 / 0.74 / +1.6%
tpch_q22/datafusion:vortex-file-compressed 26346299 / 25761892 / +2.3% 54643751 / 55959583 / -2.4% 0.48 / 0.46 / +4.7%
datafusion / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 100715774 / 99949914 / +0.8% 167406042 / 160780702 / +4.1% 0.60 / 0.62 / -3.2%
tpch_q02/datafusion:vortex-compact 65719408 / 65769462 / -0.1% 98865400 / 96457851 / +2.5% 0.66 / 0.68 / -2.5%
tpch_q03/datafusion:vortex-compact 66830360 / 65974962 / +1.3% 117885643 / 116004041 / +1.6% 0.57 / 0.57 / -0.3%
tpch_q04/datafusion:vortex-compact 41264296 / 40738913 / +1.3% 79794634 / 85521324 / -6.7% 0.52 / 0.48 / +8.6%
tpch_q05/datafusion:vortex-compact 118910616 / 117014221 / +1.6% 167117024 / 172719698 / -3.2% 0.71 / 0.68 / +5.0%
tpch_q06/datafusion:vortex-compact 18020460 / 18814516 / -4.2% 63108528 / 66961244 / -5.8% 0.29 / 0.28 / +1.6%
tpch_q07/datafusion:vortex-compact 142763292 / 144921146 / -1.5% 189811237 / 186868579 / +1.6% 0.75 / 0.78 / -3.0%
tpch_q08/datafusion:vortex-compact 144896962 / 145082054 / -0.1% 196798681 / 194975258 / +0.9% 0.74 / 0.74 / -1.1%
tpch_q09/datafusion:vortex-compact 184824108 / 185200386 / -0.2% 253153278 / 248133589 / +2.0% 0.73 / 0.75 / -2.2%
tpch_q10/datafusion:vortex-compact 79332657 / 79500228 / -0.2% 130244781 / 134890476 / -3.4% 0.61 / 0.59 / +3.3%
tpch_q11/datafusion:vortex-compact 43598856 / 43594961 / +0.0% 66907342 / 65883130 / +1.6% 0.65 / 0.66 / -1.5%
tpch_q12/datafusion:vortex-compact 57919717 / 56861870 / +1.9% 93782902 / 95748247 / -2.1% 0.62 / 0.59 / +4.0%
tpch_q13/datafusion:vortex-compact 53560122 / 53581002 / -0.0% 83677394 / 85552648 / -2.2% 0.64 / 0.63 / +2.2%
tpch_q14/datafusion:vortex-compact 28162110 / 27725128 / +1.6% 95315301 / 93495244 / +1.9% 0.30 / 0.30 / -0.4%
tpch_q15/datafusion:vortex-compact 44421110 / 45144920 / -1.6% 102513061 / 98308872 / +4.3% 0.43 / 0.46 / -5.6%
tpch_q16/datafusion:vortex-compact 40659470 / 40630483 / +0.1% 69988325 / 69753491 / +0.3% 0.58 / 0.58 / -0.3%
tpch_q17/datafusion:vortex-compact 172399324 / 172845235 / -0.3% 215105498 / 213904594 / +0.6% 0.80 / 0.81 / -0.8%
tpch_q18/datafusion:vortex-compact 204094907 / 204321494 / -0.1% 251928223 / 261856668 / -3.8% 0.81 / 0.78 / +3.8%
tpch_q19/datafusion:vortex-compact 41626226 / 42482923 / -2.0% 90648149 / 87240413 / +3.9% 0.46 / 0.49 / -5.7%
tpch_q20/datafusion:vortex-compact 66260703 / 66145736 / +0.2% 117365078 / 118802408 / -1.2% 0.56 / 0.56 / +1.4%
tpch_q21/datafusion:vortex-compact 193146424 / 190088047 / +1.6% 248676415 / 245810119 / +1.2% 0.78 / 0.77 / +0.4%
tpch_q22/datafusion:vortex-compact 26879897 / 27295223 / -1.5% 56948041 / 56332608 / +1.1% 0.47 / 0.48 / -2.6%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87544103 / 86288724 / +1.5% 128036967 / 132910728 / -3.7% 0.68 / 0.65 / +5.3%
tpch_q02/datafusion:parquet 158693081 / 158329155 / +0.2% 183889819 / 190770446 / -3.6% 0.86 / 0.83 / +4.0%
tpch_q03/datafusion:parquet 142565708 / 142691102 / -0.1% 199415643 / 200346783 / -0.5% 0.71 / 0.71 / +0.4%
tpch_q04/datafusion:parquet 59197752 / 59198833 / -0.0% 98047667 / 104688928 / -6.3% 0.60 / 0.57 / +6.8%
tpch_q05/datafusion:parquet 180444109 / 180324833 / +0.1% 237642570 / 241859980 / -1.7% 0.76 / 0.75 / +1.8%
tpch_q06/datafusion:parquet 34963720 / 35058510 / -0.3% 78892193 / 86908166 / -9.2% 0.44 / 0.40 / +9.9%
tpch_q07/datafusion:parquet 231624275 / 234625107 / -1.3% 302921351 / 299310380 / +1.2% 0.76 / 0.78 / -2.5%
tpch_q08/datafusion:parquet 235042241 / 233147504 / +0.8% 302074789 / 306440079 / -1.4% 0.78 / 0.76 / +2.3%
tpch_q09/datafusion:parquet 313236526 / 314505051 / -0.4% 382141063 / 394201197 / -3.1% 0.82 / 0.80 / +2.7%
tpch_q10/datafusion:parquet 405406724 / 408859636 / -0.8% 467102914 / 464756473 / +0.5% 0.87 / 0.88 / -1.3%
tpch_q11/datafusion:parquet 104795245 / 105631529 / -0.8% 130756513 / 132980955 / -1.7% 0.80 / 0.79 / +0.9%
tpch_q12/datafusion:parquet 84946548 / 84905036 / +0.0% 127469334 / 129883619 / -1.9% 0.67 / 0.65 / +1.9%
tpch_q13/datafusion:parquet 227803479 / 228272634 / -0.2% 257858569 / 258821820 / -0.4% 0.88 / 0.88 / +0.2%
tpch_q14/datafusion:parquet 86959733 / 89369892 / -2.7% 197719524 / 201511553 / -1.9% 0.44 / 0.44 / -0.8%
tpch_q15/datafusion:parquet 90020553 / 89775069 / +0.3% 139869049 / 145195144 / -3.7% 0.64 / 0.62 / +4.1%
tpch_q16/datafusion:parquet 95588067 / 94994580 / +0.6% 123306773 / 122821448 / +0.4% 0.78 / 0.77 / +0.2%
tpch_q17/datafusion:parquet 216932633 / 214501916 / +1.1% 271743598 / 272359657 / -0.2% 0.80 / 0.79 / +1.4%
tpch_q18/datafusion:parquet 292692128 / 290965176 / +0.6% 341340194 / 333555401 / +2.3% 0.86 / 0.87 / -1.7%
tpch_q19/datafusion:parquet 109147060 / 109841118 / -0.6% 173722298 / 172583378 / +0.7% 0.63 / 0.64 / -1.3%
tpch_q20/datafusion:parquet 185112344 / 184027032 / +0.6% 246251467 / 245792882 / +0.2% 0.75 / 0.75 / +0.4%
tpch_q21/datafusion:parquet 245448468 / 240800804 / +1.9% 315413227 / 319281639 / -1.2% 0.78 / 0.75 / +3.2%
tpch_q22/datafusion:parquet 199421382 / 199193123 / +0.1% 226583353 / 221953074 / +2.1% 0.88 / 0.90 / -1.9%
duckdb / vortex-file-compressed / ns (0.997x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54939066 / 56331271 / -2.5% 101466986 / 101151322 / +0.3% 0.54 / 0.56 / -2.8%
tpch_q02/duckdb:vortex-file-compressed 31647179 / 32222271 / -1.8% 50460326 / 49235939 / +2.5% 0.63 / 0.65 / -4.2%
tpch_q03/duckdb:vortex-file-compressed 59114442 / 59140788 / -0.0% 116211568 / 119422961 / -2.7% 0.51 / 0.50 / +2.7%
tpch_q04/duckdb:vortex-file-compressed 82355758 / 80212178 / +2.7% 127689118 / 127691492 / -0.0% 0.64 / 0.63 / +2.7%
tpch_q05/duckdb:vortex-file-compressed 63703778 / 65942801 / -3.4% 120433310 / 130349546 / -7.6% 0.53 / 0.51 / +4.6%
tpch_q06/duckdb:vortex-file-compressed 20843218 / 21747737 / -4.2% 70215993 / 67356356 / +4.2% 0.30 / 0.32 / -8.1%
tpch_q07/duckdb:vortex-file-compressed 60426064 / 59773980 / +1.1% 140733434 / 135891128 / +3.6% 0.43 / 0.44 / -2.4%
tpch_q08/duckdb:vortex-file-compressed 87317714 / 84223582 / +3.7% 155674246 / 156172623 / -0.3% 0.56 / 0.54 / +4.0%
tpch_q09/duckdb:vortex-file-compressed 165603175 / 165193545 / +0.2% 250226479 / 242693761 / +3.1% 0.66 / 0.68 / -2.8%
tpch_q10/duckdb:vortex-file-compressed 111279696 / 112624367 / -1.2% 182213816 / 171552917 / +6.2% 0.61 / 0.66 / -7.0%
tpch_q11/duckdb:vortex-file-compressed 17269056 / 16714245 / +3.3% 30194890 / 29615623 / +2.0% 0.57 / 0.56 / +1.3%
tpch_q12/duckdb:vortex-file-compressed 57467079 / 52349707 / +9.8% 109892959 / 105689822 / +4.0% 0.52 / 0.50 / +5.6%
tpch_q13/duckdb:vortex-file-compressed 91013924 / 89757171 / +1.4% 142041843 / 138234427 / +2.8% 0.64 / 0.65 / -1.3%
tpch_q14/duckdb:vortex-file-compressed 31302037 / 30372198 / +3.1% 84307216 / 78672396 / +7.2% 0.37 / 0.39 / -3.8%
tpch_q15/duckdb:vortex-file-compressed 39077386 / 41374003 / -5.6% 94518663 / 105053114 / -10.0% 🟢 0.41 / 0.39 / +5.0%
tpch_q16/duckdb:vortex-file-compressed 42797495 / 42289414 / +1.2% 62224549 / 53625255 / +16.0% 🔴 0.69 / 0.79 / -12.8%
tpch_q17/duckdb:vortex-file-compressed 54480126 / 62552283 / -12.9% 🟢 116712937 / 129619284 / -10.0% 0.47 / 0.48 / -3.3%
tpch_q18/duckdb:vortex-file-compressed 138087926 / 137529225 / +0.4% 191668865 / 159696802 / +20.0% 🔴 0.72 / 0.86 / -16.3%
tpch_q19/duckdb:vortex-file-compressed 42353021 / 42477835 / -0.3% 103731051 / 101182513 / +2.5% 0.41 / 0.42 / -2.7%
tpch_q20/duckdb:vortex-file-compressed 61547767 / 61091998 / +0.7% 129185089 / 127845464 / +1.0% 0.48 / 0.48 / -0.3%
tpch_q21/duckdb:vortex-file-compressed 239259787 / 243199254 / -1.6% 284125116 / 286582615 / -0.9% 0.84 / 0.85 / -0.8%
tpch_q22/duckdb:vortex-file-compressed 42386857 / 42305209 / +0.2% 62805682 / 62946962 / -0.2% 0.67 / 0.67 / +0.4%
duckdb / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 65759332 / 67290086 / -2.3% 101360751 / 107607792 / -5.8% 0.65 / 0.63 / +3.7%
tpch_q02/duckdb:vortex-compact 34726687 / 35654660 / -2.6% 54944385 / 53339970 / +3.0% 0.63 / 0.67 / -5.4%
tpch_q03/duckdb:vortex-compact 61844262 / 60744351 / +1.8% 103584618 / 107511919 / -3.7% 0.60 / 0.57 / +5.7%
tpch_q04/duckdb:vortex-compact 88791701 / 87824289 / +1.1% 119780479 / 123059503 / -2.7% 0.74 / 0.71 / +3.9%
tpch_q05/duckdb:vortex-compact 70151287 / 70798641 / -0.9% 118960462 / 130698264 / -9.0% 0.59 / 0.54 / +8.9%
tpch_q06/duckdb:vortex-compact 24295314 / 24422522 / -0.5% 63366593 / 64504744 / -1.8% 0.38 / 0.38 / +1.3%
tpch_q07/duckdb:vortex-compact 70613492 / 72407408 / -2.5% 134758582 / 138059936 / -2.4% 0.52 / 0.52 / -0.1%
tpch_q08/duckdb:vortex-compact 90970437 / 91288909 / -0.3% 156627671 / 146719605 / +6.8% 0.58 / 0.62 / -6.7%
tpch_q09/duckdb:vortex-compact 174749975 / 173258791 / +0.9% 245943106 / 241153388 / +2.0% 0.71 / 0.72 / -1.1%
tpch_q10/duckdb:vortex-compact 116107598 / 116481891 / -0.3% 167714462 / 163239620 / +2.7% 0.69 / 0.71 / -3.0%
tpch_q11/duckdb:vortex-compact 19239473 / 19419205 / -0.9% 38541713 / 37202940 / +3.6% 0.50 / 0.52 / -4.4%
tpch_q12/duckdb:vortex-compact 71893622 / 69497909 / +3.4% 113485546 / 111061182 / +2.2% 0.63 / 0.63 / +1.2%
tpch_q13/duckdb:vortex-compact 94282929 / 95597756 / -1.4% 144121810 / 140392021 / +2.7% 0.65 / 0.68 / -3.9%
tpch_q14/duckdb:vortex-compact 33764755 / 35174380 / -4.0% 74141169 / 78843560 / -6.0% 0.46 / 0.45 / +2.1%
tpch_q15/duckdb:vortex-compact 41028065 / 43406482 / -5.5% 97135056 / 104656354 / -7.2% 0.42 / 0.41 / +1.8%
tpch_q16/duckdb:vortex-compact 44615898 / 43930971 / +1.6% 54905410 / 57164561 / -4.0% 0.81 / 0.77 / +5.7%
tpch_q17/duckdb:vortex-compact 59184913 / 60534416 / -2.2% 108932737 / 123082728 / -11.5% 🟢 0.54 / 0.49 / +10.5%
tpch_q18/duckdb:vortex-compact 144212845 / 146210709 / -1.4% 162349025 / 169273196 / -4.1% 0.89 / 0.86 / +2.8%
tpch_q19/duckdb:vortex-compact 45262404 / 45050412 / +0.5% 90204082 / 98153725 / -8.1% 0.50 / 0.46 / +9.3%
tpch_q20/duckdb:vortex-compact 68068660 / 66408659 / +2.5% 136740875 / 134120738 / +2.0% 0.50 / 0.50 / +0.5%
tpch_q21/duckdb:vortex-compact 255921150 / 255511041 / +0.2% 300165604 / 299142522 / +0.3% 0.85 / 0.85 / -0.2%
tpch_q22/duckdb:vortex-compact 43141798 / 44145390 / -2.3% 73699719 / 68523716 / +7.6% 0.59 / 0.64 / -9.1%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72540808 / 72009118 / +0.7% 88600457 / 87116451 / +1.7% 0.82 / 0.83 / -0.9%
tpch_q02/duckdb:parquet 80722304 / 80749567 / -0.0% 92701054 / 91723679 / +1.1% 0.87 / 0.88 / -1.1%
tpch_q03/duckdb:parquet 121160519 / 119968931 / +1.0% 149595501 / 149495421 / +0.1% 0.81 / 0.80 / +0.9%
tpch_q04/duckdb:parquet 75946143 / 75429384 / +0.7% 105635741 / 94222159 / +12.1% 🔴 0.72 / 0.80 / -10.2%
tpch_q05/duckdb:parquet 129689092 / 129280488 / +0.3% 163655332 / 162089440 / +1.0% 0.79 / 0.80 / -0.6%
tpch_q06/duckdb:parquet 34460932 / 33709706 / +2.2% 47154272 / 48221079 / -2.2% 0.73 / 0.70 / +4.5%
tpch_q07/duckdb:parquet 93765102 / 93335597 / +0.5% 131026794 / 131627638 / -0.5% 0.72 / 0.71 / +0.9%
tpch_q08/duckdb:parquet 150727737 / 163411476 / -7.8% 202128569 / 193238975 / +4.6% 0.75 / 0.85 / -11.8%
tpch_q09/duckdb:parquet 228219574 / 228602044 / -0.2% 267630161 / 265541926 / +0.8% 0.85 / 0.86 / -0.9%
tpch_q10/duckdb:parquet 515586424 / 510321683 / +1.0% 545890950 / 545386879 / +0.1% 0.94 / 0.94 / +0.9%
tpch_q11/duckdb:parquet 33853259 / 33511761 / +1.0% 39408634 / 38946253 / +1.2% 0.86 / 0.86 / -0.2%
tpch_q12/duckdb:parquet 77534569 / 77263317 / +0.4% 89152456 / 95128115 / -6.3% 0.87 / 0.81 / +7.1%
tpch_q13/duckdb:parquet 323257610 / 324099431 / -0.3% 337594223 / 333112295 / +1.3% 0.96 / 0.97 / -1.6%
tpch_q14/duckdb:parquet 111383697 / 108286077 / +2.9% 147407099 / 145277467 / +1.5% 0.76 / 0.75 / +1.4%
tpch_q15/duckdb:parquet 43509355 / 42973358 / +1.2% 69089692 / 67247375 / +2.7% 0.63 / 0.64 / -1.5%
tpch_q16/duckdb:parquet 119077814 / 117723816 / +1.2% 129186275 / 127561189 / +1.3% 0.92 / 0.92 / -0.1%
tpch_q17/duckdb:parquet 81470054 / 80331701 / +1.4% 123966251 / 105214705 / +17.8% 🔴 0.66 / 0.76 / -13.9%
tpch_q18/duckdb:parquet 213126545 / 205183045 / +3.9% 178468084 / 169482758 / +5.3% 1.19 / 1.21 / -1.4%
tpch_q19/duckdb:parquet 167504049 / 164754646 / +1.7% 197260609 / 196775867 / +0.2% 0.85 / 0.84 / +1.4%
tpch_q20/duckdb:parquet 135789874 / 136016947 / -0.2% 169178814 / 170875213 / -1.0% 0.80 / 0.80 / +0.8%
tpch_q21/duckdb:parquet 274276329 / 273906893 / +0.1% 287852773 / 291840007 / -1.4% 0.95 / 0.94 / +1.5%
tpch_q22/duckdb:parquet 268208712 / 267757993 / +0.2% 285545846 / 278287361 / +2.6% 0.94 / 0.96 / -2.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-2.0%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.009x ➖
Parquet (geomean): hot 1.018x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +1.8% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1796726 / 1822042 / -1.4% 5993473 / 5449804 / +10.0% 0.30 / 0.33 / -10.3%
statpopgen_q01/datafusion:vortex-file-compressed 25376122 / 26744936 / -5.1% 28517790 / 31536655 / -9.6% 0.89 / 0.85 / +4.9%
statpopgen_q02/datafusion:vortex-file-compressed 113884194 / 113889959 / -0.0% 148165447 / 137714909 / +7.6% 0.77 / 0.83 / -7.1%
statpopgen_q03/datafusion:vortex-file-compressed 362834612 / 347176644 / +4.5% 410604535 / 553840560 / -25.9% 🟢 0.88 / 0.63 / +41.0%
statpopgen_q04/datafusion:vortex-file-compressed 365696359 / 350093268 / +4.5% 410086636 / 547060696 / -25.0% 🟢 0.89 / 0.64 / +39.3%
statpopgen_q05/datafusion:vortex-file-compressed 216305022 / 214150780 / +1.0% 408993440 / 310156832 / +31.9% 🔴 0.53 / 0.69 / -23.4%
statpopgen_q06/datafusion:vortex-file-compressed 800417860 / 756693596 / +5.8% 848232816 / 790733222 / +7.3% 0.94 / 0.96 / -1.4%
statpopgen_q07/datafusion:vortex-file-compressed 413812518 / 413576894 / +0.1% 421575401 / 427045021 / -1.3% 0.98 / 0.97 / +1.4%
statpopgen_q08/datafusion:vortex-file-compressed 418647157 / 417860971 / +0.2% 428238001 / 424790796 / +0.8% 0.98 / 0.98 / -0.6%
statpopgen_q09/datafusion:vortex-file-compressed 261731364 / 250290545 / +4.6% 302613355 / 293993792 / +2.9% 0.86 / 0.85 / +1.6%
statpopgen_q10/datafusion:vortex-file-compressed 767061576 / 754302380 / +1.7% 800928999 / 767695903 / +4.3% 0.96 / 0.98 / -2.5%
datafusion / vortex-compact / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1787277 / 1811708 / -1.3% 5693706 / 5370464 / +6.0% 0.31 / 0.34 / -6.9%
statpopgen_q01/datafusion:vortex-compact 29884849 / 28738966 / +4.0% 30420865 / 26675553 / +14.0% 🔴 0.98 / 1.08 / -8.8%
statpopgen_q02/datafusion:vortex-compact 210936460 / 213266262 / -1.1% 229834642 / 228651297 / +0.5% 0.92 / 0.93 / -1.6%
statpopgen_q03/datafusion:vortex-compact 477582352 / 473610286 / +0.8% 499628828 / 481905829 / +3.7% 0.96 / 0.98 / -2.7%
statpopgen_q04/datafusion:vortex-compact 479425535 / 467069078 / +2.6% 497518245 / 487576623 / +2.0% 0.96 / 0.96 / +0.6%
statpopgen_q05/datafusion:vortex-compact 319527004 / 317395315 / +0.7% 332676695 / 336750355 / -1.2% 0.96 / 0.94 / +1.9%
statpopgen_q06/datafusion:vortex-compact 909357107 / 877517220 / +3.6% 918240929 / 895232191 / +2.6% 0.99 / 0.98 / +1.0%
statpopgen_q07/datafusion:vortex-compact 969581155 / 974347124 / -0.5% 985054419 / 976675917 / +0.9% 0.98 / 1.00 / -1.3%
statpopgen_q08/datafusion:vortex-compact 970112372 / 976012069 / -0.6% 993399625 / 972175667 / +2.2% 0.98 / 1.00 / -2.7%
statpopgen_q09/datafusion:vortex-compact 373515646 / 365319050 / +2.2% 397009544 / 385671097 / +2.9% 0.94 / 0.95 / -0.7%
statpopgen_q10/datafusion:vortex-compact 990852352 / 978965637 / +1.2% 997846006 / 985910350 / +1.2% 0.99 / 0.99 / +0.0%
datafusion / parquet / ns (1.019x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1978362 / 1997666 / -1.0% 90026363 / 89465046 / +0.6% 0.02 / 0.02 / -1.6%
statpopgen_q01/datafusion:parquet 164610346 / 161518576 / +1.9% 173041203 / 172228052 / +0.5% 0.95 / 0.94 / +1.4%
statpopgen_q02/datafusion:parquet 288546578 / 284056038 / +1.6% 429003152 / 409263947 / +4.8% 0.67 / 0.69 / -3.1%
statpopgen_q03/datafusion:parquet 408797919 / 401397942 / +1.8% 516612382 / 524239432 / -1.5% 0.79 / 0.77 / +3.3%
statpopgen_q04/datafusion:parquet 388738831 / 371970849 / +4.5% 533725853 / 501255965 / +6.5% 0.73 / 0.74 / -1.8%
statpopgen_q05/datafusion:parquet 316504829 / 310270458 / +2.0% 446258128 / 454089700 / -1.7% 0.71 / 0.68 / +3.8%
statpopgen_q06/datafusion:parquet 523730056 / 502276390 / +4.3% 673649762 / 643518584 / +4.7% 0.78 / 0.78 / -0.4%
statpopgen_q07/datafusion:parquet 441571322 / 438459369 / +0.7% 554557455 / 554180397 / +0.1% 0.80 / 0.79 / +0.6%
statpopgen_q08/datafusion:parquet 435175940 / 444610128 / -2.1% 563037122 / 565667414 / -0.5% 0.77 / 0.79 / -1.7%
statpopgen_q09/datafusion:parquet 374787560 / 344835948 / +8.7% 497715053 / 487068201 / +2.2% 0.75 / 0.71 / +6.4%
statpopgen_q10/datafusion:parquet 567534580 / 572816008 / -0.9% 705954376 / 687975301 / +2.6% 0.80 / 0.83 / -3.4%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9155276 / 8948820 / +2.3% 9460420 / 9334687 / +1.3% 0.97 / 0.96 / +0.9%
statpopgen_q01/duckdb:vortex-file-compressed 10364750 / 10243812 / +1.2% 14394191 / 12965491 / +11.0% 🔴 0.72 / 0.79 / -8.9%
statpopgen_q02/duckdb:vortex-file-compressed 307475168 / 305639622 / +0.6% 333542884 / 331008234 / +0.8% 0.92 / 0.92 / -0.2%
statpopgen_q03/duckdb:vortex-file-compressed 814881978 / 813916013 / +0.1% 834909709 / 818908325 / +2.0% 0.98 / 0.99 / -1.8%
statpopgen_q04/duckdb:vortex-file-compressed 812944828 / 820787561 / -1.0% 813165348 / 823016589 / -1.2% 1.00 / 1.00 / +0.2%
statpopgen_q05/duckdb:vortex-file-compressed 321507756 / 323516962 / -0.6% 361013186 / 350138852 / +3.1% 0.89 / 0.92 / -3.6%
statpopgen_q06/duckdb:vortex-file-compressed 1138593708 / 1147581665 / -0.8% 1176266330 / 1169668550 / +0.6% 0.97 / 0.98 / -1.3%
statpopgen_q07/duckdb:vortex-file-compressed 374816027 / 380762388 / -1.6% 384340943 / 434563091 / -11.6% 🟢 0.98 / 0.88 / +11.3%
statpopgen_q08/duckdb:vortex-file-compressed 393206732 / 391679458 / +0.4% 435905350 / 437572020 / -0.4% 0.90 / 0.90 / +0.8%
statpopgen_q09/duckdb:vortex-file-compressed 609485857 / 609725740 / -0.0% 634823279 / 624870931 / +1.6% 0.96 / 0.98 / -1.6%
statpopgen_q10/duckdb:vortex-file-compressed 1914642262 / 1933262094 / -1.0% 1884180830 / 1908314921 / -1.3% 1.02 / 1.01 / +0.3%
duckdb / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9055860 / 9032546 / +0.3% 9559225 / 9490293 / +0.7% 0.95 / 0.95 / -0.5%
statpopgen_q01/duckdb:vortex-compact 10217714 / 10259986 / -0.4% 14326753 / 12701226 / +12.8% 🔴 0.71 / 0.81 / -11.7%
statpopgen_q02/duckdb:vortex-compact 377333533 / 382070309 / -1.2% 399664270 / 399820235 / -0.0% 0.94 / 0.96 / -1.2%
statpopgen_q03/duckdb:vortex-compact 900806671 / 896389638 / +0.5% 906657873 / 902328580 / +0.5% 0.99 / 0.99 / +0.0%
statpopgen_q04/duckdb:vortex-compact 894977426 / 903066506 / -0.9% 900490814 / 905316012 / -0.5% 0.99 / 1.00 / -0.4%
statpopgen_q05/duckdb:vortex-compact 425253808 / 427101475 / -0.4% 435774502 / 436724015 / -0.2% 0.98 / 0.98 / -0.2%
statpopgen_q06/duckdb:vortex-compact 1166929087 / 1168289934 / -0.1% 1175294556 / 1169005839 / +0.5% 0.99 / 1.00 / -0.7%
statpopgen_q07/duckdb:vortex-compact 943733697 / 942681297 / +0.1% 939302798 / 945835472 / -0.7% 1.00 / 1.00 / +0.8%
statpopgen_q08/duckdb:vortex-compact 947209393 / 952101390 / -0.5% 951413179 / 937754097 / +1.5% 1.00 / 1.02 / -1.9%
statpopgen_q09/duckdb:vortex-compact 702706876 / 714395856 / -1.6% 712112490 / 720951357 / -1.2% 0.99 / 0.99 / -0.4%
statpopgen_q10/duckdb:vortex-compact 2025524496 / 2033929004 / -0.4% 1996192149 / 1984675462 / +0.6% 1.01 / 1.02 / -1.0%
duckdb / parquet / ns (1.018x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245362270 / 245145134 / +0.1% 244413229 / 243855314 / +0.2% 1.00 / 1.01 / -0.1%
statpopgen_q01/duckdb:parquet 302012530 / 301367738 / +0.2% 302650559 / 304381781 / -0.6% 1.00 / 0.99 / +0.8%
statpopgen_q02/duckdb:parquet 565989047 / 563028221 / +0.5% 592298811 / 585318808 / +1.2% 0.96 / 0.96 / -0.7%
statpopgen_q03/duckdb:parquet 845015516 / 841531825 / +0.4% 840038798 / 883881692 / -5.0% 1.01 / 0.95 / +5.7%
statpopgen_q04/duckdb:parquet 865274874 / 811235994 / +6.7% 857578787 / 825856094 / +3.8% 1.01 / 0.98 / +2.7%
statpopgen_q05/duckdb:parquet 597096186 / 596699510 / +0.1% 596118924 / 623747130 / -4.4% 1.00 / 0.96 / +4.7%
statpopgen_q06/duckdb:parquet 724648722 / 682744684 / +6.1% 738762213 / 705886626 / +4.7% 0.98 / 0.97 / +1.4%
statpopgen_q07/duckdb:parquet 609189942 / 607338294 / +0.3% 698155011 / 694277496 / +0.6% 0.87 / 0.87 / -0.3%
statpopgen_q08/duckdb:parquet 618346728 / 617846262 / +0.1% 709150183 / 710080292 / -0.1% 0.87 / 0.87 / +0.2%
statpopgen_q09/duckdb:parquet 794480226 / 813306908 / -2.3% 813994936 / 839541000 / -3.0% 0.98 / 0.97 / +0.8%
statpopgen_q10/duckdb:parquet 1480560206 / 1375783176 / +7.6% 1264312060 / 1232068905 / +2.6% 1.17 / 1.12 / +4.9%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.0%
Engines: DataFusion No clear signal (-5.6%, environment too noisy confidence) · DuckDB No clear signal (-2.4%, environment too noisy confidence)
Vortex (geomean): hot 0.955x ➖ · cold 1.005x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -0.5% · Median polish -2.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.944x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 218929222 / 213056758 / +2.8% 846775740 / 764763403 / +10.7% 0.26 / 0.28 / -7.2%
tpch_q02/datafusion:vortex-file-compressed 373422683 / 343323678 / +8.8% 762379926 / 591697776 / +28.8% 0.49 / 0.58 / -15.6%
tpch_q03/datafusion:vortex-file-compressed 360844284 / 377663560 / -4.5% 1213716413 / 1028747092 / +18.0% 0.30 / 0.37 / -19.0%
tpch_q04/datafusion:vortex-file-compressed 184108746 / 198117631 / -7.1% 408472061 / 411573263 / -0.8% 0.45 / 0.48 / -6.4%
tpch_q05/datafusion:vortex-file-compressed 408023841 / 389509348 / +4.8% 607340845 / 619640477 / -2.0% 0.67 / 0.63 / +6.9%
tpch_q06/datafusion:vortex-file-compressed 329488349 / 268057554 / +22.9% 465718398 / 435137661 / +7.0% 0.71 / 0.62 / +14.8%
tpch_q07/datafusion:vortex-file-compressed 506828613 / 353071669 / +43.5% 🔴 675242082 / 476302924 / +41.8% 🔴 0.75 / 0.74 / +1.3%
tpch_q08/datafusion:vortex-file-compressed 509200674 / 1070568607 / -52.4% 🟢 689552063 / 605385644 / +13.9% 0.74 / 1.77 / -58.2%
tpch_q09/datafusion:vortex-file-compressed 444156863 / 461101387 / -3.7% 693048639 / 563365320 / +23.0% 0.64 / 0.82 / -21.7%
tpch_q10/datafusion:vortex-file-compressed 485077429 / 375767059 / +29.1% 574641777 / 475663423 / +20.8% 0.84 / 0.79 / +6.9%
tpch_q11/datafusion:vortex-file-compressed 285841569 / 291823563 / -2.0% 399654834 / 422221970 / -5.3% 0.72 / 0.69 / +3.5%
tpch_q12/datafusion:vortex-file-compressed 315277354 / 307012073 / +2.7% 539471917 / 473978705 / +13.8% 0.58 / 0.65 / -9.8%
tpch_q13/datafusion:vortex-file-compressed 149800074 / 157503663 / -4.9% 474674121 / 350487756 / +35.4% 🔴 0.32 / 0.45 / -29.8%
tpch_q14/datafusion:vortex-file-compressed 176562103 / 190640249 / -7.4% 365446305 / 485772958 / -24.8% 0.48 / 0.39 / +23.1%
tpch_q15/datafusion:vortex-file-compressed 303427344 / 338455616 / -10.3% 577059664 / 498252250 / +15.8% 0.53 / 0.68 / -22.6%
tpch_q16/datafusion:vortex-file-compressed 171521612 / 214171111 / -19.9% 316036644 / 347206529 / -9.0% 0.54 / 0.62 / -12.0%
tpch_q17/datafusion:vortex-file-compressed 321504705 / 287594677 / +11.8% 446709223 / 601165945 / -25.7% 0.72 / 0.48 / +50.4%
tpch_q18/datafusion:vortex-file-compressed 249960480 / 276168628 / -9.5% 507560628 / 598111491 / -15.1% 0.49 / 0.46 / +6.7%
tpch_q19/datafusion:vortex-file-compressed 373228926 / 457335791 / -18.4% 508760345 / 457996789 / +11.1% 0.73 / 1.00 / -26.5%
tpch_q20/datafusion:vortex-file-compressed 281166593 / 491757077 / -42.8% 🟢 455562483 / 447040988 / +1.9% 0.62 / 1.10 / -43.9%
tpch_q21/datafusion:vortex-file-compressed 505409636 / 542410477 / -6.8% 682448411 / 628147634 / +8.6% 0.74 / 0.86 / -14.2%
tpch_q22/datafusion:vortex-file-compressed 172989100 / 188105050 / -8.0% 316037346 / 369085423 / -14.4% 0.55 / 0.51 / +7.4%
datafusion / vortex-compact / ns (0.898x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 219546468 / 219319204 / +0.1% 791997272 / 608373337 / +30.2% 🔴 0.28 / 0.36 / -23.1%
tpch_q02/datafusion:vortex-compact 297347808 / 338083928 / -12.0% 614219537 / 761902925 / -19.4% 0.48 / 0.44 / +9.1%
tpch_q03/datafusion:vortex-compact 361111852 / 329049275 / +9.7% 809218369 / 819360741 / -1.2% 0.45 / 0.40 / +11.1%
tpch_q04/datafusion:vortex-compact 175862958 / 155723259 / +12.9% 413824690 / 393850594 / +5.1% 0.42 / 0.40 / +7.5%
tpch_q05/datafusion:vortex-compact 386088522 / 630482556 / -38.8% 🟢 698222264 / 521422111 / +33.9% 🔴 0.55 / 1.21 / -54.3%
tpch_q06/datafusion:vortex-compact 273191341 / 264338448 / +3.3% 537856514 / 455057152 / +18.2% 0.51 / 0.58 / -12.6%
tpch_q07/datafusion:vortex-compact 393973594 / 853517489 / -53.8% 🟢 623591408 / 879364994 / -29.1% 0.63 / 0.97 / -34.9%
tpch_q08/datafusion:vortex-compact 735714073 / 412933366 / +78.2% 🔴 832825309 / 548646035 / +51.8% 🔴 0.88 / 0.75 / +17.4%
tpch_q09/datafusion:vortex-compact 314111834 / 681662178 / -53.9% 🟢 517163033 / 783695518 / -34.0% 🟢 0.61 / 0.87 / -30.2%
tpch_q10/datafusion:vortex-compact 331474047 / 342596896 / -3.2% 468432708 / 629658350 / -25.6% 0.71 / 0.54 / +30.1%
tpch_q11/datafusion:vortex-compact 289245824 / 333336595 / -13.2% 400373040 / 429387855 / -6.8% 0.72 / 0.78 / -6.9%
tpch_q12/datafusion:vortex-compact 294313487 / 928234974 / -68.3% 🟢 529324418 / 937836012 / -43.6% 🟢 0.56 / 0.99 / -43.8%
tpch_q13/datafusion:vortex-compact 143826444 / 137206835 / +4.8% 352425858 / 323094587 / +9.1% 0.41 / 0.42 / -3.9%
tpch_q14/datafusion:vortex-compact 178864058 / 177123725 / +1.0% 321330048 / 280049269 / +14.7% 0.56 / 0.63 / -12.0%
tpch_q15/datafusion:vortex-compact 384336038 / 317653833 / +21.0% 499817947 / 533408598 / -6.3% 0.77 / 0.60 / +29.1%
tpch_q16/datafusion:vortex-compact 162760049 / 156893069 / +3.7% 279565846 / 305626596 / -8.5% 0.58 / 0.51 / +13.4%
tpch_q17/datafusion:vortex-compact 506313362 / 308115737 / +64.3% 🔴 679311971 / 439152831 / +54.7% 🔴 0.75 / 0.70 / +6.2%
tpch_q18/datafusion:vortex-compact 271057297 / 315876842 / -14.2% 551011501 / 422821460 / +30.3% 🔴 0.49 / 0.75 / -34.2%
tpch_q19/datafusion:vortex-compact 440587853 / 566689952 / -22.3% 507825692 / 634694832 / -20.0% 0.87 / 0.89 / -2.8%
tpch_q20/datafusion:vortex-compact 289956234 / 332962147 / -12.9% 574578081 / 772644892 / -25.6% 0.50 / 0.43 / +17.1%
tpch_q21/datafusion:vortex-compact 646337964 / 518922387 / +24.6% 914864536 / 818031835 / +11.8% 0.71 / 0.63 / +11.4%
tpch_q22/datafusion:vortex-compact 168842147 / 199768452 / -15.5% 343900257 / 475829515 / -27.7% 0.49 / 0.42 / +16.9%
datafusion / parquet / ns (0.975x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 187763856 / 178016017 / +5.5% 431156134 / 495450318 / -13.0% 0.44 / 0.36 / +21.2%
tpch_q02/datafusion:parquet 245798332 / 306628301 / -19.8% 436143145 / 519796968 / -16.1% 0.56 / 0.59 / -4.5%
tpch_q03/datafusion:parquet 253599692 / 292543749 / -13.3% 670376783 / 912095687 / -26.5% 0.38 / 0.32 / +17.9%
tpch_q04/datafusion:parquet 175169269 / 164998718 / +6.2% 399814057 / 335045317 / +19.3% 0.44 / 0.49 / -11.0%
tpch_q05/datafusion:parquet 342752618 / 373460618 / -8.2% 483786620 / 541110527 / -10.6% 0.71 / 0.69 / +2.7%
tpch_q06/datafusion:parquet 117244413 / 120578213 / -2.8% 228913180 / 238244559 / -3.9% 0.51 / 0.51 / +1.2%
tpch_q07/datafusion:parquet 352838183 / 398402508 / -11.4% 481419796 / 625993677 / -23.1% 0.73 / 0.64 / +15.2%
tpch_q08/datafusion:parquet 413841465 / 493688105 / -16.2% 565375979 / 528320312 / +7.0% 0.73 / 0.93 / -21.7%
tpch_q09/datafusion:parquet 413104744 / 504326202 / -18.1% 570215948 / 759184644 / -24.9% 0.72 / 0.66 / +9.1%
tpch_q10/datafusion:parquet 322901901 / 342149568 / -5.6% 485113752 / 573847613 / -15.5% 0.67 / 0.60 / +11.6%
tpch_q11/datafusion:parquet 244432493 / 298138811 / -18.0% 363656975 / 445897151 / -18.4% 0.67 / 0.67 / +0.5%
tpch_q12/datafusion:parquet 196495920 / 255589207 / -23.1% 434309022 / 361728412 / +20.1% 0.45 / 0.71 / -36.0%
tpch_q13/datafusion:parquet 371519882 / 374566865 / -0.8% 587850925 / 507762316 / +15.8% 0.63 / 0.74 / -14.3%
tpch_q14/datafusion:parquet 178624837 / 164213936 / +8.8% 262354330 / 317040765 / -17.2% 0.68 / 0.52 / +31.4%
tpch_q15/datafusion:parquet 310241041 / 311124245 / -0.3% 462380764 / 453291951 / +2.0% 0.67 / 0.69 / -2.2%
tpch_q16/datafusion:parquet 136176912 / 108655308 / +25.3% 267097501 / 251800031 / +6.1% 0.51 / 0.43 / +18.2%
tpch_q17/datafusion:parquet 414902487 / 284328021 / +45.9% 🔴 611361025 / 450963338 / +35.6% 🔴 0.68 / 0.63 / +7.6%
tpch_q18/datafusion:parquet 347225836 / 455480163 / -23.8% 515854393 / 537131737 / -4.0% 0.67 / 0.85 / -20.6%
tpch_q19/datafusion:parquet 206087315 / 162957226 / +26.5% 558555128 / 353531303 / +58.0% 🔴 0.37 / 0.46 / -20.0%
tpch_q20/datafusion:parquet 352725850 / 266459575 / +32.4% 🔴 499809402 / 449827599 / +11.1% 0.71 / 0.59 / +19.1%
tpch_q21/datafusion:parquet 324822362 / 409385342 / -20.7% 454677549 / 494695184 / -8.1% 0.71 / 0.83 / -13.7%
tpch_q22/datafusion:parquet 163524716 / 143001852 / +14.4% 342042621 / 303152925 / +12.8% 0.48 / 0.47 / +1.3%
duckdb / vortex-file-compressed / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 203602258 / 200985088 / +1.3% 354274706 / 299305583 / +18.4% 0.57 / 0.67 / -14.4%
tpch_q02/duckdb:vortex-file-compressed 408395388 / 399297427 / +2.3% 441232170 / 434731490 / +1.5% 0.93 / 0.92 / +0.8%
tpch_q03/duckdb:vortex-file-compressed 525493623 / 476761353 / +10.2% 591103987 / 656548464 / -10.0% 0.89 / 0.73 / +22.4%
tpch_q04/duckdb:vortex-file-compressed 285149672 / 312109713 / -8.6% 300701414 / 307371315 / -2.2% 0.95 / 1.02 / -6.6%
tpch_q05/duckdb:vortex-file-compressed 425280551 / 416078269 / +2.2% 439531786 / 737458180 / -40.4% 🟢 0.97 / 0.56 / +71.5%
tpch_q06/duckdb:vortex-file-compressed 283486995 / 281935095 / +0.6% 284936582 / 315990233 / -9.8% 0.99 / 0.89 / +11.5%
tpch_q07/duckdb:vortex-file-compressed 488094616 / 552045963 / -11.6% 522238686 / 550854672 / -5.2% 0.93 / 1.00 / -6.7%
tpch_q08/duckdb:vortex-file-compressed 615163905 / 655930356 / -6.2% 598711223 / 740011782 / -19.1% 1.03 / 0.89 / +15.9%
tpch_q09/duckdb:vortex-file-compressed 455613062 / 461055743 / -1.2% 429066303 / 447444196 / -4.1% 1.06 / 1.03 / +3.1%
tpch_q10/duckdb:vortex-file-compressed 466665126 / 482504350 / -3.3% 640302999 / 631996780 / +1.3% 0.73 / 0.76 / -4.5%
tpch_q11/duckdb:vortex-file-compressed 199284333 / 180540946 / +10.4% 198613935 / 218558498 / -9.1% 1.00 / 0.83 / +21.5%
tpch_q12/duckdb:vortex-file-compressed 456109116 / 439758855 / +3.7% 582085708 / 569291854 / +2.2% 0.78 / 0.77 / +1.4%
tpch_q13/duckdb:vortex-file-compressed 336832728 / 375644234 / -10.3% 438137238 / 370181084 / +18.4% 0.77 / 1.01 / -24.2%
tpch_q14/duckdb:vortex-file-compressed 229010256 / 239386768 / -4.3% 305235859 / 319772479 / -4.5% 0.75 / 0.75 / +0.2%
tpch_q15/duckdb:vortex-file-compressed 138223613 / 150249059 / -8.0% 167225346 / 272687652 / -38.7% 🟢 0.83 / 0.55 / +50.0%
tpch_q16/duckdb:vortex-file-compressed 199646217 / 201681486 / -1.0% 234093899 / 276136749 / -15.2% 0.85 / 0.73 / +16.8%
tpch_q17/duckdb:vortex-file-compressed 397204444 / 392475910 / +1.2% 425791657 / 402010720 / +5.9% 0.93 / 0.98 / -4.4%
tpch_q18/duckdb:vortex-file-compressed 317079317 / 309070836 / +2.6% 409939043 / 380464553 / +7.7% 0.77 / 0.81 / -4.8%
tpch_q19/duckdb:vortex-file-compressed 336041485 / 343830641 / -2.3% 336052813 / 390174628 / -13.9% 1.00 / 0.88 / +13.5%
tpch_q20/duckdb:vortex-file-compressed 488489802 / 390668933 / +25.0% 418841869 / 488255222 / -14.2% 1.17 / 0.80 / +45.8%
tpch_q21/duckdb:vortex-file-compressed 576923364 / 777506430 / -25.8% 655957803 / 685295218 / -4.3% 0.88 / 1.13 / -22.5%
tpch_q22/duckdb:vortex-file-compressed 174566850 / 187456477 / -6.9% 187531469 / 204054429 / -8.1% 0.93 / 0.92 / +1.3%
duckdb / vortex-compact / ns (1.000x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 208151636 / 207990450 / +0.1% 286403612 / 235472184 / +21.6% 0.73 / 0.88 / -17.7%
tpch_q02/duckdb:vortex-compact 392277189 / 382132657 / +2.7% 423986191 / 411234999 / +3.1% 0.93 / 0.93 / -0.4%
tpch_q03/duckdb:vortex-compact 400602089 / 401664322 / -0.3% 613163607 / 473557683 / +29.5% 0.65 / 0.85 / -23.0%
tpch_q04/duckdb:vortex-compact 285223226 / 240969012 / +18.4% 312470950 / 308248720 / +1.4% 0.91 / 0.78 / +16.8%
tpch_q05/duckdb:vortex-compact 373972541 / 401112457 / -6.8% 437890877 / 439570987 / -0.4% 0.85 / 0.91 / -6.4%
tpch_q06/duckdb:vortex-compact 287730536 / 312680432 / -8.0% 333291405 / 318286270 / +4.7% 0.86 / 0.98 / -12.1%
tpch_q07/duckdb:vortex-compact 482132247 / 445339368 / +8.3% 472551494 / 492388414 / -4.0% 1.02 / 0.90 / +12.8%
tpch_q08/duckdb:vortex-compact 590459363 / 545076571 / +8.3% 742451930 / 597275310 / +24.3% 0.80 / 0.91 / -12.9%
tpch_q09/duckdb:vortex-compact 488753620 / 486577916 / +0.4% 670540069 / 431422568 / +55.4% 🔴 0.73 / 1.13 / -35.4%
tpch_q10/duckdb:vortex-compact 420814821 / 491269677 / -14.3% 439712464 / 625808569 / -29.7% 0.96 / 0.79 / +21.9%
tpch_q11/duckdb:vortex-compact 187414528 / 199359478 / -6.0% 196639714 / 198511649 / -0.9% 0.95 / 1.00 / -5.1%
tpch_q12/duckdb:vortex-compact 699643789 / 481349385 / +45.4% 🔴 693194977 / 425691167 / +62.8% 🔴 1.01 / 1.13 / -10.7%
tpch_q13/duckdb:vortex-compact 384587336 / 428515292 / -10.3% 445950144 / 493785196 / -9.7% 0.86 / 0.87 / -0.6%
tpch_q14/duckdb:vortex-compact 240735849 / 239165155 / +0.7% 333804580 / 279038170 / +19.6% 0.72 / 0.86 / -15.9%
tpch_q15/duckdb:vortex-compact 168020905 / 160071446 / +5.0% 231251312 / 205434557 / +12.6% 0.73 / 0.78 / -6.8%
tpch_q16/duckdb:vortex-compact 170958676 / 167219879 / +2.2% 185592412 / 174116501 / +6.6% 0.92 / 0.96 / -4.1%
tpch_q17/duckdb:vortex-compact 395374798 / 400234708 / -1.2% 456568614 / 398623507 / +14.5% 0.87 / 1.00 / -13.8%
tpch_q18/duckdb:vortex-compact 306643998 / 294502213 / +4.1% 301343976 / 338246725 / -10.9% 1.02 / 0.87 / +16.9%
tpch_q19/duckdb:vortex-compact 351476058 / 340097194 / +3.3% 441385761 / 337183837 / +30.9% 🔴 0.80 / 1.01 / -21.1%
tpch_q20/duckdb:vortex-compact 391742821 / 361633445 / +8.3% 501487380 / 399553594 / +25.5% 0.78 / 0.91 / -13.7%
tpch_q21/duckdb:vortex-compact 723109394 / 1038657156 / -30.4% 🟢 801480200 / 1070879636 / -25.2% 0.90 / 0.97 / -7.0%
tpch_q22/duckdb:vortex-compact 209635760 / 232751122 / -9.9% 287305366 / 305105769 / -5.8% 0.73 / 0.76 / -4.4%
duckdb / parquet / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 295389615 / 316411939 / -6.6% 303938731 / 290087474 / +4.8% 0.97 / 1.09 / -10.9%
tpch_q02/duckdb:parquet 609993915 / 631189148 / -3.4% 708064537 / 817122781 / -13.3% 0.86 / 0.77 / +11.5%
tpch_q03/duckdb:parquet 717977181 / 746378080 / -3.8% 726828664 / 750629889 / -3.2% 0.99 / 0.99 / -0.7%
tpch_q04/duckdb:parquet 463280644 / 447939282 / +3.4% 618977236 / 513648631 / +20.5% 0.75 / 0.87 / -14.2%
tpch_q05/duckdb:parquet 930094315 / 860168823 / +8.1% 821426769 / 882509081 / -6.9% 1.13 / 0.97 / +16.2%
tpch_q06/duckdb:parquet 275030841 / 271848978 / +1.2% 501373140 / 252013549 / +98.9% 🔴 0.55 / 1.08 / -49.1%
tpch_q07/duckdb:parquet 759764216 / 775466976 / -2.0% 848176805 / 942813064 / -10.0% 0.90 / 0.82 / +8.9%
tpch_q08/duckdb:parquet 1042305058 / 1036331739 / +0.6% 1119821838 / 1049020935 / +6.7% 0.93 / 0.99 / -5.8%
tpch_q09/duckdb:parquet 942656232 / 1247216189 / -24.4% 1003169521 / 1434740383 / -30.1% 🟢 0.94 / 0.87 / +8.1%
tpch_q10/duckdb:parquet 909125520 / 860343018 / +5.7% 908559412 / 932762354 / -2.6% 1.00 / 0.92 / +8.5%
tpch_q11/duckdb:parquet 426798860 / 424231496 / +0.6% 388276585 / 461177036 / -15.8% 1.10 / 0.92 / +19.5%
tpch_q12/duckdb:parquet 515212016 / 592815625 / -13.1% 539577143 / 743887534 / -27.5% 0.95 / 0.80 / +19.8%
tpch_q13/duckdb:parquet 701949785 / 668360257 / +5.0% 832944151 / 897317502 / -7.2% 0.84 / 0.74 / +13.1%
tpch_q14/duckdb:parquet 603728963 / 450480318 / +34.0% 🔴 644274736 / 467676588 / +37.8% 🔴 0.94 / 0.96 / -2.7%
tpch_q15/duckdb:parquet 388695808 / 378560148 / +2.7% 435096818 / 348198539 / +25.0% 0.89 / 1.09 / -17.8%
tpch_q16/duckdb:parquet 467647072 / 474664356 / -1.5% 469635733 / 577215294 / -18.6% 1.00 / 0.82 / +21.1%
tpch_q17/duckdb:parquet 442188188 / 395291806 / +11.9% 475186946 / 477344768 / -0.5% 0.93 / 0.83 / +12.4%
tpch_q18/duckdb:parquet 601527163 / 595924551 / +0.9% 562916426 / 570575053 / -1.3% 1.07 / 1.04 / +2.3%
tpch_q19/duckdb:parquet 550238004 / 503719804 / +9.2% 537093018 / 465620576 / +15.3% 1.02 / 1.08 / -5.3%
tpch_q20/duckdb:parquet 829216247 / 714083118 / +16.1% 1223596017 / 814068916 / +50.3% 🔴 0.68 / 0.88 / -22.7%
tpch_q21/duckdb:parquet 668787584 / 691974834 / -3.4% 714258901 / 844055308 / -15.4% 0.94 / 0.82 / +14.2%
tpch_q22/duckdb:parquet 404797729 / 389911258 / +3.8% 420192650 / 305449635 / +37.6% 🔴 0.96 / 1.28 / -24.5%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR e1111f9c vs base 9eb20ba0


vortex / vortex-file-compressed / ns (0.978x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 755076188 / 770669345 / -2.0%
compress time/Bimbo 3686549025 / 3728250920 / -1.1%
compress time/CMSprovider 2502129407 / 2657261714 / -5.8%
compress time/Euro2016 265746503 / 274873657 / -3.3%
compress time/Food 277015877 / 283267092 / -2.2%
compress time/HashTags 471904349 / 481686600 / -2.0%
compress time/TPC-H l_comment canonical 621383402 / 632367396 / -1.7%
compress time/TPC-H l_comment chunked 622821429 / 635152795 / -1.9%
compress time/taxi 396441819 / 410537065 / -3.4%
compress time/wide table cols=100 chunks=1 rows=1000 7200640 / 7159149 / +0.6%
compress time/wide table cols=100 chunks=50 rows=1000 7021871 / 7049765 / -0.4%
compress time/wide table cols=1000 chunks=1 rows=1000 69408756 / 70376604 / -1.4%
compress time/wide table cols=1000 chunks=50 rows=1000 70466095 / 69783209 / +1.0%
compress time/wide table cols=10000 chunks=1 rows=1000 757808905 / 770465530 / -1.6%
compress time/wide table cols=10000 chunks=50 rows=1000 765194027 / 758299713 / +0.9%
decompress time/Arade 9098615 / 9192629 / -1.0%
decompress time/Bimbo 37570786 / 39676580 / -5.3%
decompress time/CMSprovider 28685019 / 28999997 / -1.1%
decompress time/Euro2016 6690861 / 7146664 / -6.4%
decompress time/Food 2467666 / 2479442 / -0.5%
decompress time/HashTags 46576952 / 49229424 / -5.4%
decompress time/TPC-H l_comment canonical 20656664 / 22125423 / -6.6%
decompress time/TPC-H l_comment chunked 20520895 / 21981166 / -6.6%
decompress time/taxi 5606175 / 5716910 / -1.9%
decompress time/wide table cols=100 chunks=1 rows=1000 1985778 / 1990587 / -0.2%
decompress time/wide table cols=100 chunks=50 rows=1000 1956485 / 1995100 / -1.9%
decompress time/wide table cols=1000 chunks=1 rows=1000 19280008 / 19303555 / -0.1%
decompress time/wide table cols=1000 chunks=50 rows=1000 18937720 / 19583457 / -3.3%
decompress time/wide table cols=10000 chunks=1 rows=1000 223176724 / 223932040 / -0.3%
decompress time/wide table cols=10000 chunks=50 rows=1000 220933156 / 223435829 / -1.1%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142212028 / 142212028 / +0.0%
vortex-file-compressed size/Bimbo 458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420778804 / 420778804 / +0.0%
vortex-file-compressed size/Euro2016 164045668 / 164045668 / +0.0%
vortex-file-compressed size/Food 38949464 / 38949464 / +0.0%
vortex-file-compressed size/HashTags 190338852 / 190338852 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179845112 / 179845112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179845112 / 179845112 / +0.0%
vortex-file-compressed size/taxi 49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.989x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.335632289 / 0.342342754 / -2.0%
vortex:parquet-zstd ratio compress time/Bimbo 0.312948748 / 0.315278429 / -0.7%
vortex:parquet-zstd ratio compress time/CMSprovider 0.393351438 / 0.415181194 / -5.3%
vortex:parquet-zstd ratio compress time/Euro2016 0.246898039 / 0.25379589 / -2.7%
vortex:parquet-zstd ratio compress time/Food 0.375304032 / 0.38100973 / -1.5%
vortex:parquet-zstd ratio compress time/HashTags 0.257819189 / 0.262733488 / -1.9%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.236926806 / 0.240231253 / -1.4%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.236190855 / 0.241847091 / -2.3%
vortex:parquet-zstd ratio compress time/taxi 0.363687438 / 0.375417151 / -3.1%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.82293668 / 1.81562818 / +0.4%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.78538545 / 1.78028055 / +0.3%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.55524825 / 1.56571153 / -0.7%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.60184688 / 1.5534845 / +3.1%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.64643892 / 1.67568216 / -1.7%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.66721594 / 1.64509022 / +1.3%
vortex:parquet-zstd ratio decompress time/Arade 0.016320504 / 0.0163671309 / -0.3%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0233390043 / 0.0244461652 / -4.5%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.021091628 / 0.0212772044 / -0.9%
vortex:parquet-zstd ratio decompress time/Euro2016 0.020192696 / 0.0214575379 / -5.9%
vortex:parquet-zstd ratio decompress time/Food 0.0144996132 / 0.0144850595 / +0.1%
vortex:parquet-zstd ratio decompress time/HashTags 0.0902154526 / 0.0952671294 / -5.3%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0414995798 / 0.0444322048 / -6.6%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0412179511 / 0.0440772187 / -6.5%
vortex:parquet-zstd ratio decompress time/taxi 0.0257438767 / 0.0261318088 / -1.5%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.98119851 / 0.972000006 / +0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.953436467 / 0.950301938 / +0.3%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.817354463 / 0.815271497 / +0.3%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.840786556 / 0.83166691 / +1.1%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.914198885 / 0.922184102 / -0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.903814541 / 0.899261968 / +0.5%
vortex:parquet-zstd size/Arade 0.551178899 / 0.551178899 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11645609 / 1.11645609 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33393183 / 1.33393183 / -0.0%
vortex:parquet-zstd size/Food 1.09103668 / 1.09103668 / +0.0%
vortex:parquet-zstd size/HashTags 1.42578493 / 1.42578493 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/taxi 0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (0.994x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2249712593 / 2251163011 / -0.1%
parquet_rs-zstd compress time/Bimbo 11780040799 / 11825264827 / -0.4%
parquet_rs-zstd compress time/CMSprovider 6361053156 / 6400245848 / -0.6%
parquet_rs-zstd compress time/Euro2016 1076341083 / 1083050071 / -0.6%
parquet_rs-zstd compress time/Food 738110580 / 743464195 / -0.7%
parquet_rs-zstd compress time/HashTags 1830369383 / 1833365836 / -0.2%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2622680869 / 2632327759 / -0.4%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2636941333 / 2626257742 / +0.4%
parquet_rs-zstd compress time/taxi 1090061899 / 1093549039 / -0.3%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3950022 / 3943070 / +0.2%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3932972 / 3959918 / -0.7%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44628731 / 44948640 / -0.7%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 43990531 / 44920441 / -2.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 460271496 / 459792166 / +0.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 458965157 / 460947190 / -0.4%
parquet_rs-zstd decompress time/Arade 557495957 / 561651827 / -0.7%
parquet_rs-zstd decompress time/Bimbo 1609785298 / 1623018564 / -0.8%
parquet_rs-zstd decompress time/CMSprovider 1360019197 / 1362960869 / -0.2%
parquet_rs-zstd decompress time/Euro2016 331350553 / 333060765 / -0.5%
parquet_rs-zstd decompress time/Food 170188402 / 171172373 / -0.6%
parquet_rs-zstd decompress time/HashTags 516285743 / 516751416 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 497755980 / 497959152 / -0.0%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 497863054 / 498696756 / -0.2%
parquet_rs-zstd decompress time/taxi 217767319 / 218772074 / -0.5%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2023829 / 2047929 / -1.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2052035 / 2099438 / -2.3%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23588307 / 23677456 / -0.4%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 22523814 / 23547236 / -4.3%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 244122726 / 242827912 / +0.5%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 244445233 / 248465783 / -1.6%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.997x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98979708 / 100237859 / -1.3%
arrow-ipc compress time/Bimbo 615213500 / 628151718 / -2.1%
arrow-ipc compress time/CMSprovider 389824953 / 387788251 / +0.5%
arrow-ipc compress time/Euro2016 38393175 / 38625357 / -0.6%
arrow-ipc compress time/Food 33686657 / 34273234 / -1.7%
arrow-ipc compress time/HashTags 78433106 / 79568140 / -1.4%
arrow-ipc compress time/TPC-H l_comment canonical 496728543 / 504033762 / -1.4%
arrow-ipc compress time/TPC-H l_comment chunked 504326143 / 527125142 / -4.3%
arrow-ipc compress time/taxi 74327084 / 75731238 / -1.9%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 204054 / 210969 / -3.3%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 203243 / 209418 / -2.9%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2248286 / 2280341 / -1.4%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2224522 / 2267657 / -1.9%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25388161 / 25586314 / -0.8%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25469622 / 25727909 / -1.0%
arrow-ipc decompress time/Arade 181074209 / 181883837 / -0.4%
arrow-ipc decompress time/Bimbo 414578813 / 405697665 / +2.2%
arrow-ipc decompress time/CMSprovider 580100464 / 473369623 / +22.5% 🔴
arrow-ipc decompress time/Euro2016 74875655 / 75214542 / -0.5%
arrow-ipc decompress time/Food 58061312 / 58436123 / -0.6%
arrow-ipc decompress time/HashTags 143158088 / 143764169 / -0.4%
arrow-ipc decompress time/TPC-H l_comment canonical 533064548 / 545552295 / -2.3%
arrow-ipc decompress time/TPC-H l_comment chunked 532449551 / 530023864 / +0.5%
arrow-ipc decompress time/taxi 48024490 / 48513547 / -1.0%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 316995 / 321474 / -1.4%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 320404 / 320984 / -0.2%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3541165 / 3583862 / -1.2%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3569260 / 3625046 / -1.5%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 37406228 / 36582883 / +2.3%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 37287535 / 36469163 / +2.2%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR e1111f9c vs base 5d5f429a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.7%
Engines: DataFusion No clear signal (-5.2%, environment too noisy confidence) · DuckDB No clear signal (+1.8%, environment too noisy confidence)
Vortex (geomean): hot 0.910x ➖ · cold 0.879x ➖
Parquet (geomean): hot 0.926x ➖ · cold 0.862x ➖
Shifts: Parquet (control) -7.4% · Median polish -6.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.884x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 329668787 / 370526604 / -11.0% 858388751 / 949237918 / -9.6% 0.38 / 0.39 / -1.6%
tpch_q02/datafusion:vortex-compact 544915464 / 542430522 / +0.5% 1014842970 / 1137672344 / -10.8% 0.54 / 0.48 / +12.6%
tpch_q03/datafusion:vortex-compact 554950954 / 606035585 / -8.4% 1366677780 / 2012270682 / -32.1% 🟢 0.41 / 0.30 / +34.8%
tpch_q04/datafusion:vortex-compact 259861954 / 352384025 / -26.3% 670934745 / 714478924 / -6.1% 0.39 / 0.49 / -21.5%
tpch_q05/datafusion:vortex-compact 673868795 / 838130205 / -19.6% 990026923 / 947497657 / +4.5% 0.68 / 0.88 / -23.1%
tpch_q06/datafusion:vortex-compact 420216030 / 336412070 / +24.9% 594266906 / 544991310 / +9.0% 0.71 / 0.62 / +14.6%
tpch_q07/datafusion:vortex-compact 651751552 / 734977378 / -11.3% 849794514 / 1010702580 / -15.9% 0.77 / 0.73 / +5.5%
tpch_q08/datafusion:vortex-compact 907726619 / 1007051367 / -9.9% 1237999970 / 1386003331 / -10.7% 0.73 / 0.73 / +0.9%
tpch_q09/datafusion:vortex-compact 725496000 / 857185302 / -15.4% 1052243741 / 1008894731 / +4.3% 0.69 / 0.85 / -18.8%
tpch_q10/datafusion:vortex-compact 670984325 / 763807832 / -12.2% 948906608 / 1070812697 / -11.4% 0.71 / 0.71 / -0.9%
tpch_q11/datafusion:vortex-compact 362731073 / 340270043 / +6.6% 613844446 / 704257957 / -12.8% 0.59 / 0.48 / +22.3%
tpch_q12/datafusion:vortex-compact 522979693 / 520794405 / +0.4% 849730691 / 907522864 / -6.4% 0.62 / 0.57 / +7.2%
tpch_q13/datafusion:vortex-compact 349891596 / 536261210 / -34.8% 🟢 731209115 / 940296986 / -22.2% 0.48 / 0.57 / -16.1%
tpch_q14/datafusion:vortex-compact 351610521 / 380328836 / -7.6% 462674447 / 435151663 / +6.3% 0.76 / 0.87 / -13.1%
tpch_q15/datafusion:vortex-compact 561482039 / 613131956 / -8.4% 805831716 / 908477397 / -11.3% 0.70 / 0.67 / +3.2%
tpch_q16/datafusion:vortex-compact 265777453 / 342977402 / -22.5% 479069214 / 468303150 / +2.3% 0.55 / 0.73 / -24.3%
tpch_q17/datafusion:vortex-compact 756985132 / 695567341 / +8.8% 956562654 / 940584518 / +1.7% 0.79 / 0.74 / +7.0%
tpch_q18/datafusion:vortex-compact 568390881 / 585387649 / -2.9% 624268063 / 748405171 / -16.6% 0.91 / 0.78 / +16.4%
tpch_q19/datafusion:vortex-compact 504100041 / 568745177 / -11.4% 623470436 / 718771368 / -13.3% 0.81 / 0.79 / +2.2%
tpch_q20/datafusion:vortex-compact 704110818 / 1369157159 / -48.6% 🟢 1027396653 / 1269348080 / -19.1% 0.69 / 1.08 / -36.5%
tpch_q21/datafusion:vortex-compact 788088955 / 1101956984 / -28.5% 1084588981 / 1248981840 / -13.2% 0.73 / 0.88 / -17.6%
tpch_q22/datafusion:vortex-compact 474711401 / 408440860 / +16.2% 729002132 / 704087297 / +3.5% 0.65 / 0.58 / +12.3%
datafusion / parquet / ns (0.932x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 274282727 / 271177964 / +1.1% 728415482 / 813097099 / -10.4% 0.38 / 0.33 / +12.9%
tpch_q02/datafusion:parquet 571801299 / 700437915 / -18.4% 1423163917 / 1186122667 / +20.0% 0.40 / 0.59 / -32.0%
tpch_q03/datafusion:parquet 544603090 / 562883555 / -3.2% 1149379781 / 1060091536 / +8.4% 0.47 / 0.53 / -10.8%
tpch_q04/datafusion:parquet 377182594 / 367940591 / +2.5% 510352011 / 495240547 / +3.1% 0.74 / 0.74 / -0.5%
tpch_q05/datafusion:parquet 654155005 / 765578459 / -14.6% 1019884119 / 1032772999 / -1.2% 0.64 / 0.74 / -13.5%
tpch_q06/datafusion:parquet 206349254 / 208788224 / -1.2% 362613758 / 451754784 / -19.7% 0.57 / 0.46 / +23.1%
tpch_q07/datafusion:parquet 689881211 / 616664255 / +11.9% 896064192 / 843451040 / +6.2% 0.77 / 0.73 / +5.3%
tpch_q08/datafusion:parquet 773845104 / 747141496 / +3.6% 985574872 / 1162512159 / -15.2% 0.79 / 0.64 / +22.2%
tpch_q09/datafusion:parquet 906349915 / 879408712 / +3.1% 1183363692 / 1157116190 / +2.3% 0.77 / 0.76 / +0.8%
tpch_q10/datafusion:parquet 1393116968 / 1393039012 / +0.0% 1924414767 / 1734719391 / +10.9% 0.72 / 0.80 / -9.9%
tpch_q11/datafusion:parquet 383170414 / 527474348 / -27.4% 562516607 / 707696081 / -20.5% 0.68 / 0.75 / -8.6%
tpch_q12/datafusion:parquet 402364863 / 440498559 / -8.7% 546914929 / 727236396 / -24.8% 0.74 / 0.61 / +21.5%
tpch_q13/datafusion:parquet 426575212 / 451911220 / -5.6% 784542912 / 810922262 / -3.3% 0.54 / 0.56 / -2.4%
tpch_q14/datafusion:parquet 529416284 / 446967129 / +18.4% 639017523 / 663924066 / -3.8% 0.83 / 0.67 / +23.1%
tpch_q15/datafusion:parquet 535422705 / 804863711 / -33.5% 🟢 694411860 / 992616636 / -30.0% 🟢 0.77 / 0.81 / -4.9%
tpch_q16/datafusion:parquet 273387434 / 266893387 / +2.4% 584346673 / 560840919 / +4.2% 0.47 / 0.48 / -1.7%
tpch_q17/datafusion:parquet 528595585 / 620811247 / -14.9% 957360019 / 942235795 / +1.6% 0.55 / 0.66 / -16.2%
tpch_q18/datafusion:parquet 916955094 / 1159912159 / -20.9% 1102604000 / 1452089917 / -24.1% 0.83 / 0.80 / +4.1%
tpch_q19/datafusion:parquet 452827022 / 474741848 / -4.6% 648580106 / 650061101 / -0.2% 0.70 / 0.73 / -4.4%
tpch_q20/datafusion:parquet 711974385 / 841071169 / -15.3% 765562982 / 1110167614 / -31.0% 🟢 0.93 / 0.76 / +22.8%
tpch_q21/datafusion:parquet 912349537 / 970182818 / -6.0% 1121285092 / 1276305007 / -12.1% 0.81 / 0.76 / +7.0%
tpch_q22/datafusion:parquet 531426800 / 535315587 / -0.7% 751954135 / 780984383 / -3.7% 0.71 / 0.69 / +3.1%
duckdb / vortex-compact / ns (0.937x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1050180322 / 927495980 / +13.2% 1237348544 / 2380738692 / -48.0% 🟢 0.85 / 0.39 / +117.9%
tpch_q02/duckdb:vortex-compact 499646042 / 484469869 / +3.1% 576709759 / 726253861 / -20.6% 0.87 / 0.67 / +29.9%
tpch_q03/duckdb:vortex-compact 1233739892 / 1148979275 / +7.4% 1262031096 / 1965664798 / -35.8% 🟢 0.98 / 0.58 / +67.2%
tpch_q04/duckdb:vortex-compact 760149595 / 731945891 / +3.9% 1042308545 / 1124537171 / -7.3% 0.73 / 0.65 / +12.0%
tpch_q05/duckdb:vortex-compact 1232721564 / 1212316123 / +1.7% 1332653911 / 1563071969 / -14.7% 0.93 / 0.78 / +19.3%
tpch_q06/duckdb:vortex-compact 1154980920 / 1222077051 / -5.5% 1162220947 / 1234073444 / -5.8% 0.99 / 0.99 / +0.4%
tpch_q07/duckdb:vortex-compact 1611811400 / 1644085296 / -2.0% 1527634882 / 1688225298 / -9.5% 1.06 / 0.97 / +8.3%
tpch_q08/duckdb:vortex-compact 1535331175 / 1781186210 / -13.8% 1668612459 / 1867566810 / -10.7% 0.92 / 0.95 / -3.5%
tpch_q09/duckdb:vortex-compact 1765089230 / 2166721461 / -18.5% 1815319319 / 2029475706 / -10.6% 0.97 / 1.07 / -8.9%
tpch_q10/duckdb:vortex-compact 1624631534 / 1649510430 / -1.5% 2036126671 / 2321799347 / -12.3% 0.80 / 0.71 / +12.3%
tpch_q11/duckdb:vortex-compact 461213968 / 518462097 / -11.0% 621450197 / 705235092 / -11.9% 0.74 / 0.74 / +1.0%
tpch_q12/duckdb:vortex-compact 1995330080 / 2099540419 / -5.0% 2164440714 / 2873887840 / -24.7% 0.92 / 0.73 / +26.2%
tpch_q13/duckdb:vortex-compact 1126078619 / 1417514939 / -20.6% 1559083470 / 1904732907 / -18.1% 0.72 / 0.74 / -2.9%
tpch_q14/duckdb:vortex-compact 841651614 / 970251191 / -13.3% 958780934 / 1037258895 / -7.6% 0.88 / 0.94 / -6.2%
tpch_q15/duckdb:vortex-compact 914944644 / 1038486640 / -11.9% 915450756 / 1057884085 / -13.5% 1.00 / 0.98 / +1.8%
tpch_q16/duckdb:vortex-compact 234658918 / 274119462 / -14.4% 264646934 / 255097323 / +3.7% 0.89 / 1.07 / -17.5%
tpch_q17/duckdb:vortex-compact 1349971603 / 1366565689 / -1.2% 1390672017 / 1561722911 / -11.0% 0.97 / 0.88 / +10.9%
tpch_q18/duckdb:vortex-compact 1173626462 / 1353444965 / -13.3% 1224724022 / 1432939330 / -14.5% 0.96 / 0.94 / +1.5%
tpch_q19/duckdb:vortex-compact 1191573607 / 1254607882 / -5.0% 1277559472 / 1264302259 / +1.0% 0.93 / 0.99 / -6.0%
tpch_q20/duckdb:vortex-compact 1702743086 / 1830052647 / -7.0% 1855304906 / 1898695653 / -2.3% 0.92 / 0.96 / -4.8%
tpch_q21/duckdb:vortex-compact 2447637788 / 2729442395 / -10.3% 2583565623 / 2577692906 / +0.2% 0.95 / 1.06 / -10.5%
tpch_q22/duckdb:vortex-compact 636970074 / 678939434 / -6.2% 695152908 / 1164778082 / -40.3% 🟢 0.92 / 0.58 / +57.2%
duckdb / parquet / ns (0.920x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 389823038 / 398076940 / -2.1% 391233758 / 836608586 / -53.2% 🟢 1.00 / 0.48 / +109.4%
tpch_q02/duckdb:parquet 765296948 / 802718659 / -4.7% 928275180 / 1359181847 / -31.7% 🟢 0.82 / 0.59 / +39.6%
tpch_q03/duckdb:parquet 934001975 / 1042921190 / -10.4% 1301065793 / 1702572176 / -23.6% 0.72 / 0.61 / +17.2%
tpch_q04/duckdb:parquet 590047683 / 612011316 / -3.6% 639430793 / 1278382414 / -50.0% 🟢 0.92 / 0.48 / +92.8%
tpch_q05/duckdb:parquet 1300871141 / 1201418946 / +8.3% 1230461898 / 2016365364 / -39.0% 🟢 1.06 / 0.60 / +77.4%
tpch_q06/duckdb:parquet 338471820 / 626224416 / -46.0% 🟢 347995355 / 540528933 / -35.6% 🟢 0.97 / 1.16 / -16.0%
tpch_q07/duckdb:parquet 995818216 / 1005210969 / -0.9% 1189262699 / 885670721 / +34.3% 🔴 0.84 / 1.13 / -26.2%
tpch_q08/duckdb:parquet 1241066042 / 1478965948 / -16.1% 1496175871 / 1436745238 / +4.1% 0.83 / 1.03 / -19.4%
tpch_q09/duckdb:parquet 1224893148 / 1309316847 / -6.4% 1346654961 / 1334899030 / +0.9% 0.91 / 0.98 / -7.3%
tpch_q10/duckdb:parquet 1909758624 / 2025687153 / -5.7% 2241743191 / 3116933480 / -28.1% 0.85 / 0.65 / +31.1%
tpch_q11/duckdb:parquet 491804502 / 494111646 / -0.5% 506372541 / 578194678 / -12.4% 0.97 / 0.85 / +13.7%
tpch_q12/duckdb:parquet 729627792 / 851781122 / -14.3% 816616803 / 780667777 / +4.6% 0.89 / 1.09 / -18.1%
tpch_q13/duckdb:parquet 810071312 / 789692677 / +2.6% 938555521 / 1135549651 / -17.3% 0.86 / 0.70 / +24.1%
tpch_q14/duckdb:parquet 689000101 / 768264439 / -10.3% 695598453 / 758604496 / -8.3% 0.99 / 1.01 / -2.2%
tpch_q15/duckdb:parquet 576609461 / 506298386 / +13.9% 408849336 / 492155336 / -16.9% 1.41 / 1.03 / +37.1%
tpch_q16/duckdb:parquet 651646656 / 662446905 / -1.6% 670979450 / 686550133 / -2.3% 0.97 / 0.96 / +0.7%
tpch_q17/duckdb:parquet 556438148 / 590247301 / -5.7% 660289788 / 609227572 / +8.4% 0.84 / 0.97 / -13.0%
tpch_q18/duckdb:parquet 719261769 / 848536287 / -15.2% 679676665 / 1078731492 / -37.0% 🟢 1.06 / 0.79 / +34.5%
tpch_q19/duckdb:parquet 798039127 / 838308525 / -4.8% 878778568 / 1232509404 / -28.7% 0.91 / 0.68 / +33.5%
tpch_q20/duckdb:parquet 1000485785 / 1200096751 / -16.6% 1074493923 / 1378138815 / -22.0% 0.93 / 0.87 / +6.9%
tpch_q21/duckdb:parquet 904094468 / 999051790 / -9.5% 834313381 / 965478606 / -13.6% 1.08 / 1.03 / +4.7%
tpch_q22/duckdb:parquet 708411243 / 768695807 / -7.8% 809581806 / 886547081 / -8.7% 0.88 / 0.87 / +0.9%

@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026 — with Claude
@joseph-isaacs joseph-isaacs changed the title Serve local file segments from the OS page cache with preadv2(RWF_NOWAIT) Resolve page-cached segments in place with preadv2(RWF_NOWAIT), skipping IO coalescing Oct 7, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.4%
Engines: random-access No clear signal (+7.4%, environment too noisy confidence)
Vortex (geomean): hot 1.091x ➖
Parquet (geomean): hot 1.015x ➖
Shifts: Parquet (control) +1.5% · Median polish +2.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.091x ➖, 0↑ 3↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 47329838 / 62953151 / -24.8%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 110229184 / 125970201 / -12.5%
random-access/feature-vectors/uniform/vortex-tokio-s3 99487006 / 87214035 / +14.1%
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 298729129 / 306827425 / -2.6%
random-access/nested-lists/correlated/vortex-tokio-s3 63383676 / 43657681 / +45.2% 🔴
random-access/nested-lists/correlated/vortex-tokio-s3-footer 100726266 / 90435124 / +11.4%
random-access/nested-lists/uniform/vortex-tokio-s3 177224286 / 161071230 / +10.0%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 203629257 / 202835112 / +0.4%
random-access/nested-structs/correlated/vortex-tokio-s3 61086904 / 46497477 / +31.4% 🔴
random-access/nested-structs/correlated/vortex-tokio-s3-footer 90992314 / 90537968 / +0.5%
random-access/nested-structs/uniform/vortex-tokio-s3 621250512 / 167494960 / +270.9% 🔴
random-access/nested-structs/uniform/vortex-tokio-s3-footer 210604239 / 210259560 / +0.2%
random-access/taxi/correlated/vortex-tokio-s3 101613990 / 136084390 / -25.3%
random-access/taxi/correlated/vortex-tokio-s3-footer 128851989 / 134115092 / -3.9%
random-access/taxi/uniform/vortex-tokio-s3 184659474 / 173597666 / +6.4%
random-access/taxi/uniform/vortex-tokio-s3-footer 240370479 / 245845547 / -2.2%
random-access/vortex-tokio-s3 48972657 / 48749506 / +0.5%
random-access/vortex-tokio-s3-footer 95431729 / 95604679 / -0.2%
random-access / parquet / ns (1.015x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 174911605026 / 193442594050 / -9.6%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 176631901781 / 174392372102 / +1.3%
random-access/feature-vectors/uniform/parquet-tokio-s3 177272600008 / 169226612512 / +4.8%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 173885702699 / 185968144991 / -6.5%
random-access/nested-lists/correlated/parquet-tokio-s3 1023599302 / 1045016819 / -2.0%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1100173064 / 1102368385 / -0.2%
random-access/nested-lists/uniform/parquet-tokio-s3 1026566323 / 1030337884 / -0.4%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1123649710 / 1104020519 / +1.8%
random-access/nested-structs/correlated/parquet-tokio-s3 499645365 / 453997314 / +10.1%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 647400000 / 552948912 / +17.1%
random-access/nested-structs/uniform/parquet-tokio-s3 491746379 / 453503140 / +8.4%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 614037517 / 547631115 / +12.1%
random-access/parquet-tokio-s3 474632134 / 482276882 / -1.6%
random-access/parquet-tokio-s3-footer 551627948 / 542661676 / +1.7%
random-access/taxi/correlated/parquet-tokio-s3 708162432 / 716541484 / -1.2%
random-access/taxi/correlated/parquet-tokio-s3-footer 767981030 / 801179151 / -4.1%
random-access/taxi/uniform/parquet-tokio-s3 780308688 / 782003211 / -0.2%
random-access/taxi/uniform/parquet-tokio-s3-footer 823863121 / 824316863 / -0.1%
random-access / lance / ns (0.998x ➖, 2↑ 2↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 34518011 / 36641333 / -5.8%
random-access/feature-vectors/correlated/lance-tokio-s3-footer 193206083 / 195242323 / -1.0%
random-access/feature-vectors/uniform/lance-tokio-s3 85832755 / 124424963 / -31.0% 🟢
random-access/feature-vectors/uniform/lance-tokio-s3-footer 244059351 / 248131750 / -1.6%
random-access/lance-tokio-s3 53128152 / 53306692 / -0.3%
random-access/lance-tokio-s3-footer 232558975 / 235668035 / -1.3%
random-access/nested-lists/correlated/lance-tokio-s3 35293942 / 35778843 / -1.4%
random-access/nested-lists/correlated/lance-tokio-s3-footer 237763892 / 204345210 / +16.4%
random-access/nested-lists/uniform/lance-tokio-s3 75805394 / 75577759 / +0.3%
random-access/nested-lists/uniform/lance-tokio-s3-footer 286784043 / 263389860 / +8.9%
random-access/nested-structs/correlated/lance-tokio-s3 52325566 / 44773801 / +16.9%
random-access/nested-structs/correlated/lance-tokio-s3-footer 248798732 / 228393066 / +8.9%
random-access/nested-structs/uniform/lance-tokio-s3 115180688 / 202318731 / -43.1% 🟢
random-access/nested-structs/uniform/lance-tokio-s3-footer 346795523 / 261548156 / +32.6% 🔴
random-access/taxi/correlated/lance-tokio-s3 60176642 / 67178171 / -10.4%
random-access/taxi/correlated/lance-tokio-s3-footer 243560859 / 240036318 / +1.5%
random-access/taxi/uniform/lance-tokio-s3 378353567 / 263128179 / +43.8% 🔴
random-access/taxi/uniform/lance-tokio-s3-footer 505886811 / 516513541 / -2.1%

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR e1111f9c vs base 9eb20ba0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Engines: random-access No clear signal (+3.1%, low confidence)
Vortex (geomean): hot 1.030x ➖
Parquet (geomean): hot 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.083x ➖, 0↑ 3↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 74034 / 70597 / +4.9%
random-access/arrow-tokio-local-disk-footer 170225 / 161156 / +5.6%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2409304 / 1390438 / +73.3% 🔴
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 3720068 / 3425388 / +8.6%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 55934748 / 54598235 / +2.4%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 34264677 / 32545055 / +5.3%
random-access/nested-lists/correlated/arrow-tokio-local-disk 64333 / 56466 / +13.9% 🔴
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 108848 / 103391 / +5.3%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1161958 / 1074938 / +8.1%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1189817 / 1148732 / +3.6%
random-access/nested-structs/correlated/arrow-tokio-local-disk 56959 / 53078 / +7.3%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 100766 / 91556 / +10.1% 🔴
random-access/nested-structs/uniform/arrow-tokio-local-disk 898475 / 867430 / +3.6%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 969733 / 914767 / +6.0%
random-access/taxi/correlated/arrow-tokio-local-disk 124403 / 118817 / +4.7%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 226063 / 215186 / +5.1%
random-access/taxi/uniform/arrow-tokio-local-disk 2856632 / 2861460 / -0.2%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2980542 / 3041945 / -2.0%
random-access / vortex-file-compressed / ns (1.030x ➖, 0↑ 3↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 252472 / 248629 / +1.5%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1272059 / 1282717 / -0.8%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1412176 / 1440011 / -1.9%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2673947 / 2723628 / -1.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk 246283 / 204521 / +20.4% 🔴
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 406569 / 372489 / +9.1%
random-access/nested-lists/uniform/vortex-tokio-local-disk 754946 / 724546 / +4.2%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 949011 / 983857 / -3.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk 279104 / 283897 / -1.7%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 543527 / 528515 / +2.8%
random-access/nested-structs/uniform/vortex-tokio-local-disk 654927 / 691361 / -5.3%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 971846 / 952248 / +2.1%
random-access/taxi/correlated/vortex-tokio-local-disk 740139 / 668397 / +10.7% 🔴
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1582384 / 1441782 / +9.8%
random-access/taxi/uniform/vortex-tokio-local-disk 2636951 / 2663472 / -1.0%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3743358 / 3861714 / -3.1%
random-access/vortex-tokio-local-disk 486362 / 441974 / +10.0% 🔴
random-access/vortex-tokio-local-disk-footer 1150970 / 1088022 / +5.8%
random-access / parquet / ns (0.999x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107291364514 / 106129315753 / +1.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 113355216542 / 107862757809 / +5.1%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 107603411230 / 107684804402 / -0.1%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 107868472023 / 107886428361 / -0.0%
random-access/nested-lists/correlated/parquet-tokio-local-disk 145751853 / 144224183 / +1.1%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 144571262 / 148133484 / -2.4%
random-access/nested-lists/uniform/parquet-tokio-local-disk 146036220 / 147521692 / -1.0%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 146004357 / 144433590 / +1.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44046186 / 44083794 / -0.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 44254520 / 44382591 / -0.3%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44095598 / 44095382 / +0.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 44174725 / 44164735 / +0.0%
random-access/parquet-tokio-local-disk 120047585 / 119000758 / +0.9%
random-access/parquet-tokio-local-disk-footer 118646085 / 121720551 / -2.5%
random-access/taxi/correlated/parquet-tokio-local-disk 180205693 / 182391418 / -1.2%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 178021284 / 182724358 / -2.6%
random-access/taxi/uniform/parquet-tokio-local-disk 187888818 / 192575680 / -2.4%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 193237025 / 190750153 / +1.3%
random-access / lance / ns (1.010x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 301944 / 295706 / +2.1%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1238044 / 1254811 / -1.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1049027 / 1046789 / +0.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2026133 / 2006796 / +1.0%
random-access/lance-tokio-local-disk 521776 / 527803 / -1.1%
random-access/lance-tokio-local-disk-footer 1487582 / 1505435 / -1.2%
random-access/nested-lists/correlated/lance-tokio-local-disk 160129 / 156259 / +2.5%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 748349 / 728860 / +2.7%
random-access/nested-lists/uniform/lance-tokio-local-disk 875035 / 835123 / +4.8%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1448637 / 1420831 / +2.0%
random-access/nested-structs/correlated/lance-tokio-local-disk 271313 / 268829 / +0.9%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 654154 / 642536 / +1.8%
random-access/nested-structs/uniform/lance-tokio-local-disk 2278447 / 2272375 / +0.3%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2810326 / 2624311 / +7.1%
random-access/taxi/correlated/lance-tokio-local-disk 749772 / 769212 / -2.5%
random-access/taxi/correlated/lance-tokio-local-disk-footer 2044254 / 2101002 / -2.7%
random-access/taxi/uniform/lance-tokio-local-disk 8234135 / 8247250 / -0.2%
random-access/taxi/uniform/lance-tokio-local-disk-footer 9098964 / 8962496 / +1.5%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants