Try and benchmark on metal instances by AdamGS · Pull Request #6169 · vortex-data/vortex

AdamGS · 2026-01-27T17:31:54Z

No description provided.

codspeed-hq · 2026-01-27T17:36:59Z

Merging this PR will improve performance by 11.12%

⚡ 1 improved benchmark
✅ 1105 untouched benchmarks
⏩ 1522 skipped benchmarks¹

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
⚡	Simulation	`binary_search_std`	582.8 ns	524.4 ns	+11.12%

_{Comparing adamg/benchmark-on-metal2 (672002c) with develop (b32c6b9)}

1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

github-actions · 2026-01-27T17:41:45Z

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 0.962x ➖
Parquet (geomean): 0.956x ➖
Shifts: Parquet (control) -4.4% · Median polish -3.9%

datafusion / vortex-file-compressed (0.978x ➖, 1↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	5469078	5891685	0.93
fineweb_q01/datafusion:vortex-file-compressed	25168224	27778935	0.91
fineweb_q02/datafusion:vortex-file-compressed 🚨	33634294	28430119	1.18
fineweb_q03/datafusion:vortex-file-compressed	94490603	94611853	1.00
fineweb_q04/datafusion:vortex-file-compressed	259878370	259756400	1.00
fineweb_q05/datafusion:vortex-file-compressed	232403416	235592048	0.99
fineweb_q06/datafusion:vortex-file-compressed	71378872	72090783	0.99
fineweb_q07/datafusion:vortex-file-compressed	69003723	72612815	0.95
fineweb_q08/datafusion:vortex-file-compressed 🚀	24186969	27290065	0.89

datafusion / vortex-compact (0.964x ➖, 1↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀	5318306	5965725	0.89
fineweb_q01/datafusion:vortex-compact	165090251	166967746	0.99
fineweb_q02/datafusion:vortex-compact	165974043	169836985	0.98
fineweb_q03/datafusion:vortex-compact	1454470962	1500053651	0.97
fineweb_q04/datafusion:vortex-compact	1575484464	1639643289	0.96
fineweb_q05/datafusion:vortex-compact	1263592726	1288883410	0.98
fineweb_q06/datafusion:vortex-compact	692891444	723935749	0.96
fineweb_q07/datafusion:vortex-compact	741992742	768975677	0.96
fineweb_q08/datafusion:vortex-compact	21860258	22073326	0.99

datafusion / parquet (0.935x ➖, 2↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀	6596588	7565246	0.87
fineweb_q01/datafusion:parquet	270257474	288867372	0.94
fineweb_q02/datafusion:parquet	271690910	289708999	0.94
fineweb_q03/datafusion:parquet	281922211	286219931	0.98
fineweb_q04/datafusion:parquet	289370612	307478997	0.94
fineweb_q05/datafusion:parquet	285073565	305429435	0.93
fineweb_q06/datafusion:parquet 🚀	273757095	304498141	0.90
fineweb_q07/datafusion:parquet	270757014	285908131	0.95
fineweb_q08/datafusion:parquet	268118187	276997538	0.97

duckdb / vortex-file-compressed (0.955x ➖, 2↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀	3418387	3881613	0.88
fineweb_q01/duckdb:vortex-file-compressed 🚀	24844032	29826877	0.83
fineweb_q02/duckdb:vortex-file-compressed	26597440	28139739	0.95
fineweb_q03/duckdb:vortex-file-compressed 🚨	167728089	137136445	1.22
fineweb_q04/duckdb:vortex-file-compressed	223808371	234150729	0.96
fineweb_q05/duckdb:vortex-file-compressed	216756006	224436933	0.97
fineweb_q06/duckdb:vortex-file-compressed	65909836	68339624	0.96
fineweb_q07/duckdb:vortex-file-compressed	68766375	72406227	0.95
fineweb_q08/duckdb:vortex-file-compressed	25255915	27484170	0.92

duckdb / vortex-compact (0.953x ➖, 1↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	4189758	4412190	0.95
fineweb_q01/duckdb:vortex-compact 🚀	96693776	117468823	0.82
fineweb_q02/duckdb:vortex-compact	114715999	121275666	0.95
fineweb_q03/duckdb:vortex-compact	872035269	901229817	0.97
fineweb_q04/duckdb:vortex-compact	917776739	957947319	0.96
fineweb_q05/duckdb:vortex-compact	821327091	854018585	0.96
fineweb_q06/duckdb:vortex-compact	472221402	485678376	0.97
fineweb_q07/duckdb:vortex-compact	481360237	492444733	0.98
fineweb_q08/duckdb:vortex-compact	25155147	24211201	1.04

duckdb / parquet (0.977x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	38657221	36863384	1.05
fineweb_q01/duckdb:parquet	96253528	97057141	0.99
fineweb_q02/duckdb:parquet	98988661	103654817	0.95
fineweb_q03/duckdb:parquet	309379643	321099238	0.96
fineweb_q04/duckdb:parquet	441280956	451339464	0.98
fineweb_q05/duckdb:parquet	413664892	423538897	0.98
fineweb_q06/duckdb:parquet	201668890	209450604	0.96
fineweb_q07/duckdb:parquet	214950684	221402816	0.97
fineweb_q08/duckdb:parquet	59931705	62831251	0.95

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	-10.9%	-4.4%	-6.8%	+35.9%	➖ noise
0	datafusion:vortex-file-compressed	-7.2%	-4.4%	-2.9%	+64.8%	➖ noise
0	duckdb:vortex-compact	-5.0%	-4.4%	-0.7%	+32.1%	➖ noise
0	duckdb:vortex-file-compressed	-11.9%	-4.4%	-7.9%	+42.5%	➖ noise
1	datafusion:vortex-compact	-1.1%	-3.7%	+2.6%	+10.0%	➖ noise
1	datafusion:vortex-file-compressed	-9.4%	-3.7%	-5.9%	+24.5%	➖ noise
1	duckdb:vortex-compact	-17.7%	-3.7%	-14.5%	+18.0%	➖ noise
1	duckdb:vortex-file-compressed	-16.7%	-3.7%	-13.5%	+38.9%	➖ noise
2	datafusion:vortex-compact	-2.3%	-5.4%	+3.3%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	+18.3%	-5.4%	+25.0%	+16.8%	🚨 regression
2	duckdb:vortex-compact	-5.4%	-5.4%	-0.0%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-5.5%	-5.4%	-0.1%	+11.7%	➖ noise
3	datafusion:vortex-compact	-3.0%	-2.6%	-0.5%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-0.1%	-2.6%	+2.5%	+22.5%	➖ noise
3	duckdb:vortex-compact	-3.2%	-2.6%	-0.7%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	+22.3%	-2.6%	+25.5%	+23.2%	🚨 regression
4	datafusion:vortex-compact	-3.9%	-4.1%	+0.2%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	+0.0%	-4.1%	+4.3%	+10.0%	➖ noise
4	duckdb:vortex-compact	-4.2%	-4.1%	-0.1%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-4.4%	-4.1%	-0.4%	+10.0%	➖ noise
5	datafusion:vortex-compact	-2.0%	-4.5%	+2.7%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-1.4%	-4.5%	+3.3%	+10.0%	➖ noise
5	duckdb:vortex-compact	-3.8%	-4.5%	+0.7%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-3.4%	-4.5%	+1.2%	+10.0%	➖ noise
6	datafusion:vortex-compact	-4.3%	-7.0%	+2.9%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-1.0%	-7.0%	+6.4%	+10.0%	➖ noise
6	duckdb:vortex-compact	-2.8%	-7.0%	+4.5%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-3.6%	-7.0%	+3.7%	+10.6%	➖ noise
7	datafusion:vortex-compact	-3.5%	-4.1%	+0.6%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-5.0%	-4.1%	-0.9%	+10.9%	➖ noise
7	duckdb:vortex-compact	-2.3%	-4.1%	+1.9%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-5.0%	-4.1%	-1.0%	+10.0%	➖ noise
8	datafusion:vortex-compact	-1.0%	-3.9%	+3.1%	+24.0%	➖ noise
8	datafusion:vortex-file-compressed	-11.4%	-3.9%	-7.8%	+26.4%	➖ noise
8	duckdb:vortex-compact	+3.9%	-3.9%	+8.1%	+16.5%	➖ noise
8	duckdb:vortex-file-compressed	-8.1%	-3.9%	-4.4%	+12.8%	➖ noise

github-actions · 2026-01-27T17:43:03Z

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.6%

datafusion / vortex-file-compressed (0.995x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	50609781	47670890	1.06
tpch_q02/datafusion:vortex-file-compressed	32655381	33454389	0.98
tpch_q03/datafusion:vortex-file-compressed	27435577	27526133	1.00
tpch_q04/datafusion:vortex-file-compressed	17758123	18099256	0.98
tpch_q05/datafusion:vortex-file-compressed	52158379	54191736	0.96
tpch_q06/datafusion:vortex-file-compressed	10041671	10116171	0.99
tpch_q07/datafusion:vortex-file-compressed	63087046	62687286	1.01
tpch_q08/datafusion:vortex-file-compressed	43730695	44304901	0.99
tpch_q09/datafusion:vortex-file-compressed	54162073	56138901	0.96
tpch_q10/datafusion:vortex-file-compressed	45124711	44878348	1.01
tpch_q11/datafusion:vortex-file-compressed	17946970	18187470	0.99
tpch_q12/datafusion:vortex-file-compressed	23236414	23903107	0.97
tpch_q13/datafusion:vortex-file-compressed	27059656	27648047	0.98
tpch_q14/datafusion:vortex-file-compressed	16591369	16858132	0.98
tpch_q15/datafusion:vortex-file-compressed	24660302	26494798	0.93
tpch_q16/datafusion:vortex-file-compressed	25059980	24860023	1.01
tpch_q17/datafusion:vortex-file-compressed	68158736	67150829	1.02
tpch_q18/datafusion:vortex-file-compressed	78994379	78273939	1.01
tpch_q19/datafusion:vortex-file-compressed	26883030	26220965	1.03
tpch_q20/datafusion:vortex-file-compressed	33564631	32552380	1.03
tpch_q21/datafusion:vortex-file-compressed	75040096	72520712	1.03
tpch_q22/datafusion:vortex-file-compressed	16242399	16297179	1.00

datafusion / vortex-compact (0.995x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	57470520	56625825	1.01
tpch_q02/datafusion:vortex-compact	35719247	36862711	0.97
tpch_q03/datafusion:vortex-compact	30890827	30398430	1.02
tpch_q04/datafusion:vortex-compact	23169272	23061918	1.00
tpch_q05/datafusion:vortex-compact	55163320	56410563	0.98
tpch_q06/datafusion:vortex-compact	13682470	13655634	1.00
tpch_q07/datafusion:vortex-compact	68671555	69177632	0.99
tpch_q08/datafusion:vortex-compact	49302459	48711804	1.01
tpch_q09/datafusion:vortex-compact	60409463	61439569	0.98
tpch_q10/datafusion:vortex-compact	51933666	52593904	0.99
tpch_q11/datafusion:vortex-compact	19803883	19570297	1.01
tpch_q12/datafusion:vortex-compact	33060447	33244450	0.99
tpch_q13/datafusion:vortex-compact	36247267	36731184	0.99
tpch_q14/datafusion:vortex-compact	20556641	20364685	1.01
tpch_q15/datafusion:vortex-compact	32578196	33297331	0.98
tpch_q16/datafusion:vortex-compact	32760574	30836475	1.06
tpch_q17/datafusion:vortex-compact	66595038	69197928	0.96
tpch_q18/datafusion:vortex-compact	84500913	84557393	1.00
tpch_q19/datafusion:vortex-compact	38138946	39430810	0.97
tpch_q20/datafusion:vortex-compact	37738960	37802252	1.00
tpch_q21/datafusion:vortex-compact	85256812	88422359	0.96
tpch_q22/datafusion:vortex-compact	17285658	17348916	1.00

datafusion / parquet (1.019x ➖, 1↑ 3↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet 🚨	134507843	94524144	1.42
tpch_q02/datafusion:parquet	69147783	69074023	1.00
tpch_q03/datafusion:parquet 🚨	80193484	70587529	1.14
tpch_q04/datafusion:parquet	48241935	48937879	0.99
tpch_q05/datafusion:parquet	101984628	103460740	0.99
tpch_q06/datafusion:parquet 🚨	40958399	34567448	1.18
tpch_q07/datafusion:parquet	110625646	111749454	0.99
tpch_q08/datafusion:parquet	105348858	101203351	1.04
tpch_q09/datafusion:parquet	131684856	133913558	0.98
tpch_q10/datafusion:parquet	118239640	121245346	0.98
tpch_q11/datafusion:parquet	48457156	47918485	1.01
tpch_q12/datafusion:parquet 🚀	82978009	96998330	0.86
tpch_q13/datafusion:parquet	208726203	203757397	1.02
tpch_q14/datafusion:parquet	51902267	51072774	1.02
tpch_q15/datafusion:parquet	65302114	65842206	0.99
tpch_q16/datafusion:parquet	49967263	50634545	0.99
tpch_q17/datafusion:parquet	130517161	126302666	1.03
tpch_q18/datafusion:parquet	166843273	167043140	1.00
tpch_q19/datafusion:parquet	90670533	91962048	0.99
tpch_q20/datafusion:parquet	77167391	78122764	0.99
tpch_q21/datafusion:parquet	148561717	150531800	0.99
tpch_q22/datafusion:parquet	34060849	36361582	0.94

datafusion / arrow (0.989x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow	52481768	56309509	0.93
tpch_q02/datafusion:arrow	21492060	22326823	0.96
tpch_q03/datafusion:arrow	32947872	34141425	0.97
tpch_q04/datafusion:arrow	27033726	27547876	0.98
tpch_q05/datafusion:arrow	77534927	77954455	0.99
tpch_q06/datafusion:arrow	20098068	20536877	0.98
tpch_q07/datafusion:arrow	111176450	111980821	0.99
tpch_q08/datafusion:arrow	45237800	44826816	1.01
tpch_q09/datafusion:arrow	72057355	69784162	1.03
tpch_q10/datafusion:arrow	52189062	51417025	1.02
tpch_q11/datafusion:arrow	11315904	11357306	1.00
tpch_q12/datafusion:arrow	56133457	53285197	1.05
tpch_q13/datafusion:arrow	50529662	49873964	1.01
tpch_q14/datafusion:arrow	23330527	23281622	1.00
tpch_q15/datafusion:arrow	43743934	45397596	0.96
tpch_q16/datafusion:arrow	21204105	21458177	0.99
tpch_q17/datafusion:arrow	69795271	68725991	1.02
tpch_q18/datafusion:arrow	142147293	142281438	1.00
tpch_q19/datafusion:arrow	39823769	43460720	0.92
tpch_q20/datafusion:arrow	37779338	38838129	0.97
tpch_q21/datafusion:arrow	155433260	155497253	1.00
tpch_q22/datafusion:arrow	19439542	19669230	0.99

duckdb / vortex-file-compressed (0.995x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	32540081	32512058	1.00
tpch_q02/duckdb:vortex-file-compressed	27740183	26111925	1.06
tpch_q03/duckdb:vortex-file-compressed	29085259	28615362	1.02
tpch_q04/duckdb:vortex-file-compressed	29158796	29791707	0.98
tpch_q05/duckdb:vortex-file-compressed	33060250	33430261	0.99
tpch_q06/duckdb:vortex-file-compressed	10461292	10778802	0.97
tpch_q07/duckdb:vortex-file-compressed	35987738	37022676	0.97
tpch_q08/duckdb:vortex-file-compressed	39921954	40359186	0.99
tpch_q09/duckdb:vortex-file-compressed	77747658	77292615	1.01
tpch_q10/duckdb:vortex-file-compressed	37056731	35998495	1.03
tpch_q11/duckdb:vortex-file-compressed	16711175	16603562	1.01
tpch_q12/duckdb:vortex-file-compressed	23676685	23325963	1.02
tpch_q13/duckdb:vortex-file-compressed	36995872	37600550	0.98
tpch_q14/duckdb:vortex-file-compressed	21232743	22133823	0.96
tpch_q15/duckdb:vortex-file-compressed	16033383	16055651	1.00
tpch_q16/duckdb:vortex-file-compressed	30388362	29868199	1.02
tpch_q17/duckdb:vortex-file-compressed	26197526	26666067	0.98
tpch_q18/duckdb:vortex-file-compressed	47911632	48415333	0.99
tpch_q19/duckdb:vortex-file-compressed	32044269	33957571	0.94
tpch_q20/duckdb:vortex-file-compressed	34328216	35009863	0.98
tpch_q21/duckdb:vortex-file-compressed	100490292	101349423	0.99
tpch_q22/duckdb:vortex-file-compressed	18190729	18112242	1.00

duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	39493383	40562589	0.97
tpch_q02/duckdb:vortex-compact	37005069	37781032	0.98
tpch_q03/duckdb:vortex-compact	32335068	33233593	0.97
tpch_q04/duckdb:vortex-compact	33835040	34001961	1.00
tpch_q05/duckdb:vortex-compact	37413092	36729298	1.02
tpch_q06/duckdb:vortex-compact	14224967	15365797	0.93
tpch_q07/duckdb:vortex-compact	43532563	43793829	0.99
tpch_q08/duckdb:vortex-compact	45235165	46084493	0.98
tpch_q09/duckdb:vortex-compact	88822435	89986831	0.99
tpch_q10/duckdb:vortex-compact	41123920	41209122	1.00
tpch_q11/duckdb:vortex-compact	20612753	20954743	0.98
tpch_q12/duckdb:vortex-compact	37490582	36523289	1.03
tpch_q13/duckdb:vortex-compact	46272803	45838815	1.01
tpch_q14/duckdb:vortex-compact	29434992	29600495	0.99
tpch_q15/duckdb:vortex-compact	19120340	19272090	0.99
tpch_q16/duckdb:vortex-compact	35932410	36254626	0.99
tpch_q17/duckdb:vortex-compact	31182165	31213769	1.00
tpch_q18/duckdb:vortex-compact	50632296	50572119	1.00
tpch_q19/duckdb:vortex-compact	37449586	39063115	0.96
tpch_q20/duckdb:vortex-compact	45741167	46051073	0.99
tpch_q21/duckdb:vortex-compact	108719436	111682499	0.97
tpch_q22/duckdb:vortex-compact	20729423	20669795	1.00

duckdb / parquet (0.959x ➖, 4↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet 🚀	99767812	118096386	0.84
tpch_q02/duckdb:parquet	39526500	38909334	1.02
tpch_q03/duckdb:parquet	69130372	69139285	1.00
tpch_q04/duckdb:parquet	47506086	46316919	1.03
tpch_q05/duckdb:parquet	67848951	67188349	1.01
tpch_q06/duckdb:parquet	20276805	20176405	1.00
tpch_q07/duckdb:parquet	76198821	69805494	1.09
tpch_q08/duckdb:parquet	79372780	81381149	0.98
tpch_q09/duckdb:parquet	155215092	151103059	1.03
tpch_q10/duckdb:parquet	124670032	127964456	0.97
tpch_q11/duckdb:parquet	21782535	22189323	0.98
tpch_q12/duckdb:parquet	45121710	45625204	0.99
tpch_q13/duckdb:parquet	259692547	261929845	0.99
tpch_q14/duckdb:parquet 🚀	48132109	62295973	0.77
tpch_q15/duckdb:parquet 🚀	24349818	33696765	0.72
tpch_q16/duckdb:parquet	54974841	54822176	1.00
tpch_q17/duckdb:parquet	55133013	60678847	0.91
tpch_q18/duckdb:parquet	117335090	122189543	0.96
tpch_q19/duckdb:parquet 🚀	68016677	83159233	0.82
tpch_q20/duckdb:parquet	65836573	63673709	1.03
tpch_q21/duckdb:parquet	178684003	167254965	1.07
tpch_q22/duckdb:parquet	51448222	52381796	0.98

duckdb / duckdb (0.994x ➖, 0↑ 2↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	16306502	16094296	1.01
tpch_q02/duckdb:duckdb	11768339	11959843	0.98
tpch_q03/duckdb:duckdb	19228918	19780159	0.97
tpch_q04/duckdb:duckdb	18255543	17810449	1.02
tpch_q05/duckdb:duckdb	19651550	20795170	0.95
tpch_q06/duckdb:duckdb	5181901	5379174	0.96
tpch_q07/duckdb:duckdb	22767003	23226308	0.98
tpch_q08/duckdb:duckdb	21150430	21285670	0.99
tpch_q09/duckdb:duckdb	52406565	54488545	0.96
tpch_q10/duckdb:duckdb	40538519	41107028	0.99
tpch_q11/duckdb:duckdb	5710053	5920242	0.96
tpch_q12/duckdb:duckdb	13605940	13682275	0.99
tpch_q13/duckdb:duckdb 🚨	44414113	39330023	1.13
tpch_q14/duckdb:duckdb 🚨	17769894	16086096	1.10
tpch_q15/duckdb:duckdb	11774676	11896354	0.99
tpch_q16/duckdb:duckdb	22468728	24321769	0.92
tpch_q17/duckdb:duckdb	13446350	13580762	0.99
tpch_q18/duckdb:duckdb	37648408	38957960	0.97
tpch_q19/duckdb:duckdb	27444533	27676072	0.99
tpch_q20/duckdb:duckdb	22930971	22723269	1.01
tpch_q21/duckdb:duckdb	56317548	56948538	0.99
tpch_q22/duckdb:duckdb	24593309	24313811	1.01

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-6.8%	+9.6%	-15.0%	+32.5%	➖ noise
1	datafusion:vortex-compact	+1.5%	+9.6%	-7.4%	+30.6%	➖ noise
1	datafusion:vortex-file-compressed	+6.2%	+9.6%	-3.2%	+32.9%	➖ noise
1	duckdb:duckdb	+1.3%	+9.6%	-7.6%	+31.5%	➖ noise
1	duckdb:vortex-compact	-2.6%	+9.6%	-11.2%	+30.3%	➖ noise
1	duckdb:vortex-file-compressed	+0.1%	+9.6%	-8.7%	+30.5%	➖ noise
2	datafusion:arrow	-3.7%	+0.8%	-4.5%	+17.8%	➖ noise
2	datafusion:vortex-compact	-3.1%	+0.8%	-3.9%	+17.8%	➖ noise
2	datafusion:vortex-file-compressed	-2.4%	+0.8%	-3.2%	+17.8%	➖ noise
2	duckdb:duckdb	-1.6%	+0.8%	-2.4%	+17.8%	➖ noise
2	duckdb:vortex-compact	-2.1%	+0.8%	-2.9%	+17.8%	➖ noise
2	duckdb:vortex-file-compressed	+6.2%	+0.8%	+5.3%	+17.8%	➖ noise
3	datafusion:arrow	-3.5%	+6.6%	-9.5%	+17.8%	➖ noise
3	datafusion:vortex-compact	+1.6%	+6.6%	-4.7%	+17.8%	➖ noise
3	datafusion:vortex-file-compressed	-0.3%	+6.6%	-6.5%	+17.8%	➖ noise
3	duckdb:duckdb	-2.8%	+6.6%	-8.8%	+23.8%	➖ noise
3	duckdb:vortex-compact	-2.7%	+6.6%	-8.7%	+17.8%	➖ noise
3	duckdb:vortex-file-compressed	+1.6%	+6.6%	-4.6%	+17.8%	➖ noise
4	datafusion:arrow	-1.9%	+0.6%	-2.4%	+17.8%	➖ noise
4	datafusion:vortex-compact	+0.5%	+0.6%	-0.1%	+17.8%	➖ noise
4	datafusion:vortex-file-compressed	-1.9%	+0.6%	-2.4%	+17.8%	➖ noise
4	duckdb:duckdb	+2.5%	+0.6%	+1.9%	+17.8%	➖ noise
4	duckdb:vortex-compact	-0.5%	+0.6%	-1.0%	+17.8%	➖ noise
4	duckdb:vortex-file-compressed	-2.1%	+0.6%	-2.7%	+17.8%	➖ noise
5	datafusion:arrow	-0.5%	-0.2%	-0.3%	+17.8%	➖ noise
5	datafusion:vortex-compact	-2.2%	-0.2%	-2.0%	+17.8%	➖ noise
5	datafusion:vortex-file-compressed	-3.8%	-0.2%	-3.5%	+17.8%	➖ noise
5	duckdb:duckdb	-5.5%	-0.2%	-5.3%	+17.8%	➖ noise
5	duckdb:vortex-compact	+1.9%	-0.2%	+2.1%	+17.8%	➖ noise
5	duckdb:vortex-file-compressed	-1.1%	-0.2%	-0.9%	+17.8%	➖ noise
6	datafusion:arrow	-2.1%	+9.1%	-10.3%	+21.2%	➖ noise
6	datafusion:vortex-compact	+0.2%	+9.1%	-8.2%	+22.1%	➖ noise
6	datafusion:vortex-file-compressed	-0.7%	+9.1%	-9.0%	+23.5%	➖ noise
6	duckdb:duckdb	-3.7%	+9.1%	-11.7%	+27.8%	➖ noise
6	duckdb:vortex-compact	-7.4%	+9.1%	-15.2%	+23.7%	➖ noise
6	duckdb:vortex-file-compressed	-2.9%	+9.1%	-11.1%	+24.1%	➖ noise
7	datafusion:arrow	-0.7%	+4.0%	-4.5%	+17.8%	➖ noise
7	datafusion:vortex-compact	-0.7%	+4.0%	-4.5%	+17.8%	➖ noise
7	datafusion:vortex-file-compressed	+0.6%	+4.0%	-3.2%	+17.8%	➖ noise
7	duckdb:duckdb	-2.0%	+4.0%	-5.7%	+17.8%	➖ noise
7	duckdb:vortex-compact	-0.6%	+4.0%	-4.4%	+17.8%	➖ noise
7	duckdb:vortex-file-compressed	-2.8%	+4.0%	-6.5%	+17.8%	➖ noise
8	datafusion:arrow	+0.9%	+0.8%	+0.2%	+17.8%	➖ noise
8	datafusion:vortex-compact	+1.2%	+0.8%	+0.4%	+17.8%	➖ noise
8	datafusion:vortex-file-compressed	-1.3%	+0.8%	-2.0%	+17.8%	➖ noise
8	duckdb:duckdb	-0.6%	+0.8%	-1.4%	+17.8%	➖ noise
8	duckdb:vortex-compact	-1.8%	+0.8%	-2.6%	+17.8%	➖ noise
8	duckdb:vortex-file-compressed	-1.1%	+0.8%	-1.8%	+17.8%	➖ noise
9	datafusion:arrow	+3.3%	+0.5%	+2.7%	+17.8%	➖ noise
9	datafusion:vortex-compact	-1.7%	+0.5%	-2.2%	+17.8%	➖ noise
9	datafusion:vortex-file-compressed	-3.5%	+0.5%	-4.0%	+17.8%	➖ noise
9	duckdb:duckdb	-3.8%	+0.5%	-4.3%	+17.8%	➖ noise
9	duckdb:vortex-compact	-1.3%	+0.5%	-1.8%	+17.8%	➖ noise
9	duckdb:vortex-file-compressed	+0.6%	+0.5%	+0.1%	+17.8%	➖ noise
10	datafusion:arrow	+1.5%	-2.5%	+4.1%	+17.8%	➖ noise
10	datafusion:vortex-compact	-1.3%	-2.5%	+1.3%	+17.8%	➖ noise
10	datafusion:vortex-file-compressed	+0.5%	-2.5%	+3.2%	+17.8%	➖ noise
10	duckdb:duckdb	-1.4%	-2.5%	+1.2%	+18.1%	➖ noise
10	duckdb:vortex-compact	-0.2%	-2.5%	+2.4%	+17.8%	➖ noise
10	duckdb:vortex-file-compressed	+2.9%	-2.5%	+5.6%	+17.8%	➖ noise
11	datafusion:arrow	-0.4%	-0.4%	+0.0%	+17.8%	➖ noise
11	datafusion:vortex-compact	+1.2%	-0.4%	+1.6%	+17.8%	➖ noise
11	datafusion:vortex-file-compressed	-1.3%	-0.4%	-1.0%	+17.8%	➖ noise
11	duckdb:duckdb	-3.6%	-0.4%	-3.2%	+17.8%	➖ noise
11	duckdb:vortex-compact	-1.6%	-0.4%	-1.3%	+17.8%	➖ noise
11	duckdb:vortex-file-compressed	+0.6%	-0.4%	+1.0%	+17.8%	➖ noise
12	datafusion:arrow	+5.3%	-8.0%	+14.5%	+19.8%	➖ noise
12	datafusion:vortex-compact	-0.6%	-8.0%	+8.1%	+17.8%	➖ noise
12	datafusion:vortex-file-compressed	-2.8%	-8.0%	+5.7%	+17.8%	➖ noise
12	duckdb:duckdb	-0.6%	-8.0%	+8.1%	+17.8%	➖ noise
12	duckdb:vortex-compact	+2.6%	-8.0%	+11.6%	+17.8%	➖ noise
12	duckdb:vortex-file-compressed	+1.5%	-8.0%	+10.4%	+17.8%	➖ noise
13	datafusion:arrow	+1.3%	+0.8%	+0.5%	+17.8%	➖ noise
13	datafusion:vortex-compact	-1.3%	+0.8%	-2.1%	+17.8%	➖ noise
13	datafusion:vortex-file-compressed	-2.1%	+0.8%	-2.9%	+17.8%	➖ noise
13	duckdb:duckdb	+12.9%	+0.8%	+12.1%	+19.9%	➖ noise
13	duckdb:vortex-compact	+0.9%	+0.8%	+0.2%	+17.8%	➖ noise
13	duckdb:vortex-file-compressed	-1.6%	+0.8%	-2.4%	+17.8%	➖ noise
14	datafusion:arrow	+0.2%	-11.4%	+13.1%	+17.8%	➖ noise
14	datafusion:vortex-compact	+0.9%	-11.4%	+13.9%	+17.8%	➖ noise
14	datafusion:vortex-file-compressed	-1.6%	-11.4%	+11.1%	+19.7%	➖ noise
14	duckdb:duckdb	+10.5%	-11.4%	+24.7%	+22.7%	🚨 regression
14	duckdb:vortex-compact	-0.6%	-11.4%	+12.2%	+17.8%	➖ noise
14	duckdb:vortex-file-compressed	-4.1%	-11.4%	+8.3%	+17.8%	➖ noise
15	datafusion:arrow	-3.6%	-15.3%	+13.8%	+17.8%	➖ noise
15	datafusion:vortex-compact	-2.2%	-15.3%	+15.6%	+17.8%	➖ noise
15	datafusion:vortex-file-compressed	-6.9%	-15.3%	+9.9%	+17.8%	➖ noise
15	duckdb:duckdb	-1.0%	-15.3%	+16.9%	+20.4%	➖ noise
15	duckdb:vortex-compact	-0.8%	-15.3%	+17.2%	+17.8%	➖ noise
15	duckdb:vortex-file-compressed	-0.1%	-15.3%	+18.0%	+17.8%	🚨 regression
16	datafusion:arrow	-1.2%	-0.5%	-0.7%	+17.8%	➖ noise
16	datafusion:vortex-compact	+6.2%	-0.5%	+6.8%	+17.8%	➖ noise
16	datafusion:vortex-file-compressed	+0.8%	-0.5%	+1.3%	+17.8%	➖ noise
16	duckdb:duckdb	-7.6%	-0.5%	-7.1%	+17.8%	➖ noise
16	duckdb:vortex-compact	-0.9%	-0.5%	-0.4%	+17.8%	➖ noise
16	duckdb:vortex-file-compressed	+1.7%	-0.5%	+2.3%	+17.8%	➖ noise
17	datafusion:arrow	+1.6%	-3.1%	+4.8%	+17.8%	➖ noise
17	datafusion:vortex-compact	-3.8%	-3.1%	-0.7%	+17.8%	➖ noise
17	datafusion:vortex-file-compressed	+1.5%	-3.1%	+4.8%	+17.8%	➖ noise
17	duckdb:duckdb	-1.0%	-3.1%	+2.2%	+17.8%	➖ noise
17	duckdb:vortex-compact	-0.1%	-3.1%	+3.1%	+19.6%	➖ noise
17	duckdb:vortex-file-compressed	-1.8%	-3.1%	+1.4%	+18.7%	➖ noise
18	datafusion:arrow	-0.1%	-2.1%	+2.0%	+17.8%	➖ noise
18	datafusion:vortex-compact	-0.1%	-2.1%	+2.0%	+17.8%	➖ noise
18	datafusion:vortex-file-compressed	+0.9%	-2.1%	+3.0%	+17.8%	➖ noise
18	duckdb:duckdb	-3.4%	-2.1%	-1.3%	+17.8%	➖ noise
18	duckdb:vortex-compact	+0.1%	-2.1%	+2.2%	+17.8%	➖ noise
18	duckdb:vortex-file-compressed	-1.0%	-2.1%	+1.0%	+17.8%	➖ noise
19	datafusion:arrow	-8.4%	-10.2%	+2.0%	+17.8%	➖ noise
19	datafusion:vortex-compact	-3.3%	-10.2%	+7.7%	+20.8%	➖ noise
19	datafusion:vortex-file-compressed	+2.5%	-10.2%	+14.2%	+17.8%	➖ noise
19	duckdb:duckdb	-0.8%	-10.2%	+10.4%	+18.8%	➖ noise
19	duckdb:vortex-compact	-4.1%	-10.2%	+6.8%	+17.8%	➖ noise
19	duckdb:vortex-file-compressed	-5.6%	-10.2%	+5.1%	+18.1%	➖ noise
20	datafusion:arrow	-2.7%	+1.1%	-3.7%	+17.8%	➖ noise
20	datafusion:vortex-compact	-0.2%	+1.1%	-1.2%	+17.8%	➖ noise
20	datafusion:vortex-file-compressed	+3.1%	+1.1%	+2.0%	+17.8%	➖ noise
20	duckdb:duckdb	+0.9%	+1.1%	-0.1%	+17.8%	➖ noise
20	duckdb:vortex-compact	-0.7%	+1.1%	-1.7%	+17.8%	➖ noise
20	duckdb:vortex-file-compressed	-1.9%	+1.1%	-3.0%	+22.8%	➖ noise
21	datafusion:arrow	-0.0%	+2.7%	-2.7%	+17.8%	➖ noise
21	datafusion:vortex-compact	-3.6%	+2.7%	-6.1%	+17.8%	➖ noise
21	datafusion:vortex-file-compressed	+3.5%	+2.7%	+0.8%	+17.8%	➖ noise
21	duckdb:duckdb	-1.1%	+2.7%	-3.7%	+17.8%	➖ noise
21	duckdb:vortex-compact	-2.7%	+2.7%	-5.2%	+17.8%	➖ noise
21	duckdb:vortex-file-compressed	-0.8%	+2.7%	-3.4%	+17.8%	➖ noise
22	datafusion:arrow	-1.2%	-4.1%	+3.0%	+17.8%	➖ noise
22	datafusion:vortex-compact	-0.4%	-4.1%	+3.9%	+17.8%	➖ noise
22	datafusion:vortex-file-compressed	-0.3%	-4.1%	+3.9%	+17.8%	➖ noise
22	duckdb:duckdb	+1.1%	-4.1%	+5.5%	+17.8%	➖ noise
22	duckdb:vortex-compact	+0.3%	-4.1%	+4.6%	+17.8%	➖ noise
22	duckdb:vortex-file-compressed	+0.4%	-4.1%	+4.7%	+17.8%	➖ noise

github-actions · 2026-01-27T17:47:20Z

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.9%

datafusion / vortex-file-compressed (1.033x ➖, 0↑ 5↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	215825570	197972560	1.09
tpch_q02/datafusion:vortex-file-compressed	458198557	476201817	0.96
tpch_q03/datafusion:vortex-file-compressed 🚨	463234913	329992705	1.40
tpch_q04/datafusion:vortex-file-compressed	262370901	267559960	0.98
tpch_q05/datafusion:vortex-file-compressed	506548883	646927248	0.78
tpch_q06/datafusion:vortex-file-compressed	312719960	342446118	0.91
tpch_q07/datafusion:vortex-file-compressed	375247815	464769234	0.81
tpch_q08/datafusion:vortex-file-compressed 🚨	858876842	628976072	1.37
tpch_q09/datafusion:vortex-file-compressed 🚨	787832835	471373054	1.67
tpch_q10/datafusion:vortex-file-compressed 🚨	870738209	566977905	1.54
tpch_q11/datafusion:vortex-file-compressed 🚨	822364756	328170846	2.51
tpch_q12/datafusion:vortex-file-compressed	653935050	792589366	0.83
tpch_q13/datafusion:vortex-file-compressed	223012314	237769678	0.94
tpch_q14/datafusion:vortex-file-compressed	223900768	203783819	1.10
tpch_q15/datafusion:vortex-file-compressed	362923107	431133030	0.84
tpch_q16/datafusion:vortex-file-compressed	191395340	207719130	0.92
tpch_q17/datafusion:vortex-file-compressed	412426049	557859856	0.74
tpch_q18/datafusion:vortex-file-compressed	393881843	536212029	0.73
tpch_q19/datafusion:vortex-file-compressed	527306375	613521834	0.86
tpch_q20/datafusion:vortex-file-compressed	510860708	542302848	0.94
tpch_q21/datafusion:vortex-file-compressed	659339437	711365213	0.93
tpch_q22/datafusion:vortex-file-compressed	233689401	223684778	1.04

datafusion / vortex-compact (0.922x ➖, 3↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨	363088171	230429844	1.58
tpch_q02/datafusion:vortex-compact	489457010	498226372	0.98
tpch_q03/datafusion:vortex-compact	368435937	394851461	0.93
tpch_q04/datafusion:vortex-compact	273138735	229928588	1.19
tpch_q05/datafusion:vortex-compact	429632120	416445408	1.03
tpch_q06/datafusion:vortex-compact	331428356	337977645	0.98
tpch_q07/datafusion:vortex-compact	402175340	421589767	0.95
tpch_q08/datafusion:vortex-compact	684615419	564660008	1.21
tpch_q09/datafusion:vortex-compact	468525557	502580870	0.93
tpch_q10/datafusion:vortex-compact	666438843	606429310	1.10
tpch_q11/datafusion:vortex-compact	272799967	335952044	0.81
tpch_q12/datafusion:vortex-compact	603818864	583515141	1.03
tpch_q13/datafusion:vortex-compact 🚀	221106243	409557273	0.54
tpch_q14/datafusion:vortex-compact	316652937	363022586	0.87
tpch_q15/datafusion:vortex-compact	592985664	662573421	0.89
tpch_q16/datafusion:vortex-compact 🚀	165308231	378373172	0.44
tpch_q17/datafusion:vortex-compact	429080101	424663953	1.01
tpch_q18/datafusion:vortex-compact	419251650	348902772	1.20
tpch_q19/datafusion:vortex-compact	662483598	655434901	1.01
tpch_q20/datafusion:vortex-compact	533173796	637910250	0.84
tpch_q21/datafusion:vortex-compact	610233714	728623361	0.84
tpch_q22/datafusion:vortex-compact 🚀	186469698	304714726	0.61

datafusion / parquet (1.005x ➖, 3↑ 6↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	242583788	227166399	1.07
tpch_q02/datafusion:parquet	511915517	512653375	1.00
tpch_q03/datafusion:parquet	451692234	392555653	1.15
tpch_q04/datafusion:parquet	201635475	220947714	0.91
tpch_q05/datafusion:parquet	616360672	529317940	1.16
tpch_q06/datafusion:parquet 🚨	205267029	135389651	1.52
tpch_q07/datafusion:parquet	560094924	715923524	0.78
tpch_q08/datafusion:parquet	635920557	656047549	0.97
tpch_q09/datafusion:parquet	651629659	815054059	0.80
tpch_q10/datafusion:parquet 🚀	517278573	783495522	0.66
tpch_q11/datafusion:parquet	349290234	340209337	1.03
tpch_q12/datafusion:parquet 🚀	243660115	391659161	0.62
tpch_q13/datafusion:parquet	443303890	528603426	0.84
tpch_q14/datafusion:parquet 🚀	181779836	391498202	0.46
tpch_q15/datafusion:parquet	310129381	439617055	0.71
tpch_q16/datafusion:parquet	179192897	236256731	0.76
tpch_q17/datafusion:parquet	349759575	423770312	0.83
tpch_q18/datafusion:parquet 🚨	751139458	456325850	1.65
tpch_q19/datafusion:parquet 🚨	714256202	348477689	2.05
tpch_q20/datafusion:parquet 🚨	597195930	368388031	1.62
tpch_q21/datafusion:parquet 🚨	881234515	582289683	1.51
tpch_q22/datafusion:parquet 🚨	205395568	132140017	1.55

duckdb / vortex-file-compressed (1.042x ➖, 0↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	265574387	239994791	1.11
tpch_q02/duckdb:vortex-file-compressed	925600915	882699417	1.05
tpch_q03/duckdb:vortex-file-compressed	689090643	739089232	0.93
tpch_q04/duckdb:vortex-file-compressed	406314711	408145321	1.00
tpch_q05/duckdb:vortex-file-compressed	942661733	1048538407	0.90
tpch_q06/duckdb:vortex-file-compressed	370422333	398394293	0.93
tpch_q07/duckdb:vortex-file-compressed	877407893	1008774937	0.87
tpch_q08/duckdb:vortex-file-compressed	982158622	937745391	1.05
tpch_q09/duckdb:vortex-file-compressed	1098298964	1031371586	1.06
tpch_q10/duckdb:vortex-file-compressed	823990789	818290041	1.01
tpch_q11/duckdb:vortex-file-compressed	611883484	492651716	1.24
tpch_q12/duckdb:vortex-file-compressed	605907901	579522984	1.05
tpch_q13/duckdb:vortex-file-compressed	496588969	463322238	1.07
tpch_q14/duckdb:vortex-file-compressed	491920208	549017197	0.90
tpch_q15/duckdb:vortex-file-compressed 🚨	461819037	258069697	1.79
tpch_q16/duckdb:vortex-file-compressed	365180244	335814014	1.09
tpch_q17/duckdb:vortex-file-compressed	755126521	646768512	1.17
tpch_q18/duckdb:vortex-file-compressed	671582635	704902139	0.95
tpch_q19/duckdb:vortex-file-compressed	526084649	552701083	0.95
tpch_q20/duckdb:vortex-file-compressed	958698150	899731554	1.07
tpch_q21/duckdb:vortex-file-compressed	1189593573	1107926614	1.07
tpch_q22/duckdb:vortex-file-compressed	406494812	428730073	0.95

duckdb / vortex-compact (0.950x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	386056612	328192582	1.18
tpch_q02/duckdb:vortex-compact	979805206	876417554	1.12
tpch_q03/duckdb:vortex-compact	562101096	517271915	1.09
tpch_q04/duckdb:vortex-compact	334601190	441179892	0.76
tpch_q05/duckdb:vortex-compact	923117432	1160451071	0.80
tpch_q06/duckdb:vortex-compact	517048081	472948349	1.09
tpch_q07/duckdb:vortex-compact	802509524	779485073	1.03
tpch_q08/duckdb:vortex-compact	937138664	867652316	1.08
tpch_q09/duckdb:vortex-compact	874553466	919024824	0.95
tpch_q10/duckdb:vortex-compact	678773298	838741373	0.81
tpch_q11/duckdb:vortex-compact	503342467	454914044	1.11
tpch_q12/duckdb:vortex-compact	415686563	435587527	0.95
tpch_q13/duckdb:vortex-compact	434768982	600586351	0.72
tpch_q14/duckdb:vortex-compact	448397009	507575370	0.88
tpch_q15/duckdb:vortex-compact	307986409	438948339	0.70
tpch_q16/duckdb:vortex-compact	349404524	341269693	1.02
tpch_q17/duckdb:vortex-compact	687894563	652787882	1.05
tpch_q18/duckdb:vortex-compact	496723365	490672247	1.01
tpch_q19/duckdb:vortex-compact	584440712	626282187	0.93
tpch_q20/duckdb:vortex-compact	779295367	889270568	0.88
tpch_q21/duckdb:vortex-compact	1096945124	1256047943	0.87
tpch_q22/duckdb:vortex-compact	367756426	336032268	1.09

duckdb / parquet (0.973x ➖, 1↑ 2↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet 🚨	702830301	524393978	1.34
tpch_q02/duckdb:parquet	1422321628	1390371646	1.02
tpch_q03/duckdb:parquet	1271389643	1311327752	0.97
tpch_q04/duckdb:parquet 🚨	889065668	661258951	1.34
tpch_q05/duckdb:parquet	1486212235	1792323852	0.83
tpch_q06/duckdb:parquet	495356207	424686709	1.17
tpch_q07/duckdb:parquet	1322992440	1579993920	0.84
tpch_q08/duckdb:parquet	1715554917	2187293846	0.78
tpch_q09/duckdb:parquet	1564235678	1511661069	1.03
tpch_q10/duckdb:parquet	1634285197	1430884162	1.14
tpch_q11/duckdb:parquet	929597777	920473143	1.01
tpch_q12/duckdb:parquet	706176831	789425456	0.89
tpch_q13/duckdb:parquet	899990659	918928089	0.98
tpch_q14/duckdb:parquet	861406722	836045589	1.03
tpch_q15/duckdb:parquet	514646972	499827655	1.03
tpch_q16/duckdb:parquet	538777993	667448545	0.81
tpch_q17/duckdb:parquet	883324354	1240321490	0.71
tpch_q18/duckdb:parquet	880043999	892996111	0.99
tpch_q19/duckdb:parquet 🚀	888514477	1332685966	0.67
tpch_q20/duckdb:parquet	1107688481	1283974096	0.86
tpch_q21/duckdb:parquet	1258612193	1185543884	1.06
tpch_q22/duckdb:parquet	638422929	511574819	1.25

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	+57.6%	+19.6%	+31.7%	+115.5%	➖ noise
1	datafusion:vortex-file-compressed	+9.0%	+19.6%	-8.9%	+140.7%	➖ noise
1	duckdb:vortex-compact	+17.6%	+19.6%	-1.7%	+69.5%	➖ noise
1	duckdb:vortex-file-compressed	+10.7%	+19.6%	-7.5%	+95.9%	➖ noise
2	datafusion:vortex-compact	-1.8%	+1.1%	-2.8%	+69.5%	➖ noise
2	datafusion:vortex-file-compressed	-3.8%	+1.1%	-4.8%	+69.5%	➖ noise
2	duckdb:vortex-compact	+11.8%	+1.1%	+10.6%	+69.5%	➖ noise
2	duckdb:vortex-file-compressed	+4.9%	+1.1%	+3.8%	+69.5%	➖ noise
3	datafusion:vortex-compact	-6.7%	+5.6%	-11.7%	+85.5%	➖ noise
3	datafusion:vortex-file-compressed	+40.4%	+5.6%	+32.9%	+84.2%	➖ noise
3	duckdb:vortex-compact	+8.7%	+5.6%	+2.9%	+69.5%	➖ noise
3	duckdb:vortex-file-compressed	-6.8%	+5.6%	-11.7%	+69.5%	➖ noise
4	datafusion:vortex-compact	+18.8%	+10.8%	+7.2%	+69.5%	➖ noise
4	datafusion:vortex-file-compressed	-1.9%	+10.8%	-11.5%	+69.5%	➖ noise
4	duckdb:vortex-compact	-24.2%	+10.8%	-31.5%	+69.5%	➖ noise
4	duckdb:vortex-file-compressed	-0.4%	+10.8%	-10.1%	+69.5%	➖ noise
5	datafusion:vortex-compact	+3.2%	-1.7%	+5.0%	+69.5%	➖ noise
5	datafusion:vortex-file-compressed	-21.7%	-1.7%	-20.3%	+69.5%	➖ noise
5	duckdb:vortex-compact	-20.5%	-1.7%	-19.0%	+69.5%	➖ noise
5	duckdb:vortex-file-compressed	-10.1%	-1.7%	-8.5%	+69.5%	➖ noise
6	datafusion:vortex-compact	-1.9%	+33.0%	-26.3%	+69.5%	➖ noise
6	datafusion:vortex-file-compressed	-8.7%	+33.0%	-31.3%	+69.5%	➖ noise
6	duckdb:vortex-compact	+9.3%	+33.0%	-17.8%	+69.5%	➖ noise
6	duckdb:vortex-file-compressed	-7.0%	+33.0%	-30.1%	+69.5%	➖ noise
7	datafusion:vortex-compact	-4.6%	-19.1%	+17.9%	+69.5%	➖ noise
7	datafusion:vortex-file-compressed	-19.3%	-19.1%	-0.2%	+69.5%	➖ noise
7	duckdb:vortex-compact	+3.0%	-19.1%	+27.2%	+69.5%	➖ noise
7	duckdb:vortex-file-compressed	-13.0%	-19.1%	+7.5%	+69.5%	➖ noise
8	datafusion:vortex-compact	+21.2%	-12.8%	+39.1%	+69.5%	➖ noise
8	datafusion:vortex-file-compressed	+36.6%	-12.8%	+56.6%	+69.5%	➖ noise
8	duckdb:vortex-compact	+8.0%	-12.8%	+23.9%	+69.5%	➖ noise
8	duckdb:vortex-file-compressed	+4.7%	-12.8%	+20.1%	+69.5%	➖ noise
9	datafusion:vortex-compact	-6.8%	-9.0%	+2.5%	+69.5%	➖ noise
9	datafusion:vortex-file-compressed	+67.1%	-9.0%	+83.8%	+69.5%	🚨 regression
9	duckdb:vortex-compact	-4.8%	-9.0%	+4.6%	+69.5%	➖ noise
9	duckdb:vortex-file-compressed	+6.5%	-9.0%	+17.1%	+69.5%	➖ noise
10	datafusion:vortex-compact	+9.9%	-13.2%	+26.6%	+69.5%	➖ noise
10	datafusion:vortex-file-compressed	+53.6%	-13.2%	+76.9%	+69.5%	🚨 regression
10	duckdb:vortex-compact	-19.1%	-13.2%	-6.8%	+69.5%	➖ noise
10	duckdb:vortex-file-compressed	+0.7%	-13.2%	+16.0%	+69.5%	➖ noise
11	datafusion:vortex-compact	-18.8%	+1.8%	-20.3%	+69.5%	➖ noise
11	datafusion:vortex-file-compressed	+150.6%	+1.8%	+146.1%	+69.5%	🚨 regression
11	duckdb:vortex-compact	+10.6%	+1.8%	+8.7%	+69.5%	➖ noise
11	duckdb:vortex-file-compressed	+24.2%	+1.8%	+22.0%	+69.5%	➖ noise
12	datafusion:vortex-compact	+3.5%	-25.4%	+38.7%	+69.5%	➖ noise
12	datafusion:vortex-file-compressed	-17.5%	-25.4%	+10.6%	+69.5%	➖ noise
12	duckdb:vortex-compact	-4.6%	-25.4%	+27.9%	+69.5%	➖ noise
12	duckdb:vortex-file-compressed	+4.6%	-25.4%	+40.2%	+69.5%	➖ noise
13	datafusion:vortex-compact	-46.0%	-9.4%	-40.4%	+101.2%	➖ noise
13	datafusion:vortex-file-compressed	-6.2%	-9.4%	+3.5%	+69.5%	➖ noise
13	duckdb:vortex-compact	-27.6%	-9.4%	-20.1%	+69.5%	➖ noise
13	duckdb:vortex-file-compressed	+7.2%	-9.4%	+18.3%	+69.5%	➖ noise
14	datafusion:vortex-compact	-12.8%	-30.8%	+26.1%	+69.5%	➖ noise
14	datafusion:vortex-file-compressed	+9.9%	-30.8%	+58.9%	+69.5%	➖ noise
14	duckdb:vortex-compact	-11.7%	-30.8%	+27.7%	+69.5%	➖ noise
14	duckdb:vortex-file-compressed	-10.4%	-30.8%	+29.5%	+69.5%	➖ noise
15	datafusion:vortex-compact	-10.5%	-14.8%	+5.0%	+69.5%	➖ noise
15	datafusion:vortex-file-compressed	-15.8%	-14.8%	-1.2%	+69.5%	➖ noise
15	duckdb:vortex-compact	-29.8%	-14.8%	-17.7%	+69.5%	➖ noise
15	duckdb:vortex-file-compressed	+79.0%	-14.8%	+110.0%	+69.5%	🚨 regression
16	datafusion:vortex-compact	-56.3%	-21.8%	-44.2%	+104.9%	➖ noise
16	datafusion:vortex-file-compressed	-7.9%	-21.8%	+17.8%	+69.5%	➖ noise
16	duckdb:vortex-compact	+2.4%	-21.8%	+30.8%	+84.0%	➖ noise
16	duckdb:vortex-file-compressed	+8.7%	-21.8%	+39.0%	+69.5%	➖ noise
17	datafusion:vortex-compact	+1.0%	-23.3%	+31.8%	+69.5%	➖ noise
17	datafusion:vortex-file-compressed	-26.1%	-23.3%	-3.6%	+69.5%	➖ noise
17	duckdb:vortex-compact	+5.4%	-23.3%	+37.4%	+69.5%	➖ noise
17	duckdb:vortex-file-compressed	+16.8%	-23.3%	+52.3%	+69.5%	➖ noise
18	datafusion:vortex-compact	+20.2%	+27.4%	-5.7%	+69.5%	➖ noise
18	datafusion:vortex-file-compressed	-26.5%	+27.4%	-42.3%	+69.5%	✅ faster
18	duckdb:vortex-compact	+1.2%	+27.4%	-20.5%	+69.5%	➖ noise
18	duckdb:vortex-file-compressed	-4.7%	+27.4%	-25.2%	+69.5%	➖ noise
19	datafusion:vortex-compact	+1.1%	+16.9%	-13.5%	+69.5%	➖ noise
19	datafusion:vortex-file-compressed	-14.1%	+16.9%	-26.5%	+69.5%	➖ noise
19	duckdb:vortex-compact	-6.7%	+16.9%	-20.2%	+69.5%	➖ noise
19	duckdb:vortex-file-compressed	-4.8%	+16.9%	-18.6%	+69.5%	➖ noise
20	datafusion:vortex-compact	-16.4%	+18.3%	-29.3%	+69.5%	➖ noise
20	datafusion:vortex-file-compressed	-5.8%	+18.3%	-20.3%	+69.5%	➖ noise
20	duckdb:vortex-compact	-12.4%	+18.3%	-25.9%	+69.5%	➖ noise
20	duckdb:vortex-file-compressed	+6.6%	+18.3%	-9.9%	+69.5%	➖ noise
21	datafusion:vortex-compact	-16.2%	+26.8%	-33.9%	+69.5%	➖ noise
21	datafusion:vortex-file-compressed	-7.3%	+26.8%	-26.9%	+69.5%	➖ noise
21	duckdb:vortex-compact	-12.7%	+26.8%	-31.1%	+69.5%	➖ noise
21	duckdb:vortex-file-compressed	+7.4%	+26.8%	-15.3%	+69.5%	➖ noise
22	datafusion:vortex-compact	-38.8%	+39.3%	-56.1%	+69.5%	✅ faster
22	datafusion:vortex-file-compressed	+4.5%	+39.3%	-25.0%	+69.5%	➖ noise
22	duckdb:vortex-compact	+9.4%	+39.3%	-21.4%	+69.5%	➖ noise
22	duckdb:vortex-file-compressed	-5.2%	+39.3%	-31.9%	+69.5%	➖ noise

github-actions · 2026-01-27T17:49:20Z

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -1.3%

datafusion / vortex-file-compressed (0.967x ➖, 5↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed	1934294	1913646	1.01
clickbench_q01/datafusion:vortex-file-compressed	13484566	13912213	0.97
clickbench_q02/datafusion:vortex-file-compressed	31976649	34681540	0.92
clickbench_q03/datafusion:vortex-file-compressed	36720605	37436133	0.98
clickbench_q04/datafusion:vortex-file-compressed	311542981	316339555	0.98
clickbench_q05/datafusion:vortex-file-compressed	322979577	321177655	1.01
clickbench_q06/datafusion:vortex-file-compressed	1906269	1969198	0.97
clickbench_q07/datafusion:vortex-file-compressed	17885700	17048687	1.05
clickbench_q08/datafusion:vortex-file-compressed	371999731	378959023	0.98
clickbench_q09/datafusion:vortex-file-compressed	552391442	562875732	0.98
clickbench_q10/datafusion:vortex-file-compressed	71452212	73898735	0.97
clickbench_q11/datafusion:vortex-file-compressed	82005074	84135233	0.97
clickbench_q12/datafusion:vortex-file-compressed	284574642	278172188	1.02
clickbench_q13/datafusion:vortex-file-compressed	412033931	416652432	0.99
clickbench_q14/datafusion:vortex-file-compressed	250142892	254484496	0.98
clickbench_q15/datafusion:vortex-file-compressed	354364447	372621499	0.95
clickbench_q16/datafusion:vortex-file-compressed	688874981	704092666	0.98
clickbench_q17/datafusion:vortex-file-compressed	683239714	690279809	0.99
clickbench_q18/datafusion:vortex-file-compressed	1343088084	1474782520	0.91
clickbench_q19/datafusion:vortex-file-compressed	22507463	23693987	0.95
clickbench_q20/datafusion:vortex-file-compressed	353857818	355963351	0.99
clickbench_q21/datafusion:vortex-file-compressed	402783450	411668100	0.98
clickbench_q22/datafusion:vortex-file-compressed	535945185	546986646	0.98
clickbench_q23/datafusion:vortex-file-compressed 🚨	726584438	585395356	1.24
clickbench_q24/datafusion:vortex-file-compressed	48893014	46588897	1.05
clickbench_q25/datafusion:vortex-file-compressed	67757673	69573557	0.97
clickbench_q26/datafusion:vortex-file-compressed	45849299	47263742	0.97
clickbench_q27/datafusion:vortex-file-compressed	793239349	794358794	1.00
clickbench_q28/datafusion:vortex-file-compressed	6430330604	6700907783	0.96
clickbench_q29/datafusion:vortex-file-compressed	243783933	261848681	0.93
clickbench_q30/datafusion:vortex-file-compressed 🚀	221428079	249885074	0.89
clickbench_q31/datafusion:vortex-file-compressed 🚀	261607690	296248468	0.88
clickbench_q32/datafusion:vortex-file-compressed	1263619549	1291230327	0.98
clickbench_q33/datafusion:vortex-file-compressed 🚀	1412966635	1635462976	0.86
clickbench_q34/datafusion:vortex-file-compressed	1404196801	1459888648	0.96
clickbench_q35/datafusion:vortex-file-compressed	506904167	517969735	0.98
clickbench_q36/datafusion:vortex-file-compressed 🚀	76139315	87243718	0.87
clickbench_q37/datafusion:vortex-file-compressed	39713764	40931863	0.97
clickbench_q38/datafusion:vortex-file-compressed	22798805	22980115	0.99
clickbench_q39/datafusion:vortex-file-compressed	145831825	153508439	0.95
clickbench_q40/datafusion:vortex-file-compressed	18628561	20691116	0.90
clickbench_q41/datafusion:vortex-file-compressed 🚀	16657686	19187917	0.87
clickbench_q42/datafusion:vortex-file-compressed	21066607	23259050	0.91

datafusion / parquet (0.981x ➖, 2↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet	1861925	1816888	1.02
clickbench_q01/datafusion:parquet	20454813	21008009	0.97
clickbench_q02/datafusion:parquet	56369994	56768098	0.99
clickbench_q03/datafusion:parquet	43684511	44973391	0.97
clickbench_q04/datafusion:parquet	345243224	350628628	0.98
clickbench_q05/datafusion:parquet	402189136	373805939	1.08
clickbench_q06/datafusion:parquet	1868352	1838095	1.02
clickbench_q07/datafusion:parquet	26721684	28196235	0.95
clickbench_q08/datafusion:parquet	424178905	422431650	1.00
clickbench_q09/datafusion:parquet	655553748	654177444	1.00
clickbench_q10/datafusion:parquet	114304639	112017287	1.02
clickbench_q11/datafusion:parquet	140428556	137562757	1.02
clickbench_q12/datafusion:parquet	374099322	372190437	1.01
clickbench_q13/datafusion:parquet	531118992	524758761	1.01
clickbench_q14/datafusion:parquet	365720933	374829148	0.98
clickbench_q15/datafusion:parquet	396062490	397032081	1.00
clickbench_q16/datafusion:parquet	734362864	746881540	0.98
clickbench_q17/datafusion:parquet	706608072	707088805	1.00
clickbench_q18/datafusion:parquet	1442787529	1479182784	0.98
clickbench_q19/datafusion:parquet	32376447	32516618	1.00
clickbench_q20/datafusion:parquet	604857541	606895779	1.00
clickbench_q21/datafusion:parquet	657367298	679536771	0.97
clickbench_q22/datafusion:parquet	954530645	971065451	0.98
clickbench_q23/datafusion:parquet	3587959611	3664698724	0.98
clickbench_q24/datafusion:parquet	89178574	95737904	0.93
clickbench_q25/datafusion:parquet	140674407	146085730	0.96
clickbench_q26/datafusion:parquet 🚀	85572124	97091324	0.88
clickbench_q27/datafusion:parquet	1038013100	1088217816	0.95
clickbench_q28/datafusion:parquet	6538232096	6672941564	0.98
clickbench_q29/datafusion:parquet	250640777	248006040	1.01
clickbench_q30/datafusion:parquet	355995133	366471887	0.97
clickbench_q31/datafusion:parquet	390539141	390838175	1.00
clickbench_q32/datafusion:parquet	1275678368	1212616991	1.05
clickbench_q33/datafusion:parquet	1530954610	1532617506	1.00
clickbench_q34/datafusion:parquet	1503834354	1514687848	0.99
clickbench_q35/datafusion:parquet	525817142	560353668	0.94
clickbench_q36/datafusion:parquet	141231942	152735077	0.92
clickbench_q37/datafusion:parquet	58532582	63254375	0.93
clickbench_q38/datafusion:parquet	92857822	91425863	1.02
clickbench_q39/datafusion:parquet	265398491	281416816	0.94
clickbench_q40/datafusion:parquet 🚀	33688396	40230875	0.84
clickbench_q41/datafusion:parquet	31061677	30301855	1.03
clickbench_q42/datafusion:parquet	32005518	33172622	0.96

duckdb / vortex-file-compressed (0.972x ➖, 6↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed	6043533	5769470	1.05
clickbench_q01/duckdb:vortex-file-compressed	13631342	13350555	1.02
clickbench_q02/duckdb:vortex-file-compressed	25227005	23757677	1.06
clickbench_q03/duckdb:vortex-file-compressed	30412481	28860102	1.05
clickbench_q04/duckdb:vortex-file-compressed	173249922	171745355	1.01
clickbench_q05/duckdb:vortex-file-compressed	200094806	198214244	1.01
clickbench_q06/duckdb:vortex-file-compressed	19476496	19961861	0.98
clickbench_q07/duckdb:vortex-file-compressed 🚀	15162524	17174968	0.88
clickbench_q08/duckdb:vortex-file-compressed	264842438	263298979	1.01
clickbench_q09/duckdb:vortex-file-compressed	377730806	372802578	1.01
clickbench_q10/duckdb:vortex-file-compressed	74887453	74209814	1.01
clickbench_q11/duckdb:vortex-file-compressed	81242685	81446328	1.00
clickbench_q12/duckdb:vortex-file-compressed	212095203	218241940	0.97
clickbench_q13/duckdb:vortex-file-compressed	432867936	442917872	0.98
clickbench_q14/duckdb:vortex-file-compressed	239577251	243520424	0.98
clickbench_q15/duckdb:vortex-file-compressed	213230023	215989495	0.99
clickbench_q16/duckdb:vortex-file-compressed 🚀	577224299	717690076	0.80
clickbench_q17/duckdb:vortex-file-compressed 🚀	474084516	534832548	0.89
clickbench_q18/duckdb:vortex-file-compressed	1231002004	1250382437	0.98
clickbench_q19/duckdb:vortex-file-compressed	21265160	21947521	0.97
clickbench_q20/duckdb:vortex-file-compressed	399472033	393295018	1.02
clickbench_q21/duckdb:vortex-file-compressed	415508629	404163172	1.03
clickbench_q22/duckdb:vortex-file-compressed	573201910	566068204	1.01
clickbench_q23/duckdb:vortex-file-compressed 🚀	1286290920	2019341552	0.64
clickbench_q24/duckdb:vortex-file-compressed 🚀	38809440	44522793	0.87
clickbench_q25/duckdb:vortex-file-compressed	75159550	78718961	0.95
clickbench_q26/duckdb:vortex-file-compressed	46145614	47871209	0.96
clickbench_q27/duckdb:vortex-file-compressed	533635552	522985924	1.02
clickbench_q28/duckdb:vortex-file-compressed	3006253147	3006943984	1.00
clickbench_q29/duckdb:vortex-file-compressed	27570575	27703097	1.00
clickbench_q30/duckdb:vortex-file-compressed	173111476	175731145	0.99
clickbench_q31/duckdb:vortex-file-compressed	252542461	256210778	0.99
clickbench_q32/duckdb:vortex-file-compressed	1358696689	1310670748	1.04
clickbench_q33/duckdb:vortex-file-compressed 🚨	1674905442	1518086424	1.10
clickbench_q34/duckdb:vortex-file-compressed	1720434255	1661062102	1.04
clickbench_q35/duckdb:vortex-file-compressed	372014291	369479434	1.01
clickbench_q36/duckdb:vortex-file-compressed	32437252	33211426	0.98
clickbench_q37/duckdb:vortex-file-compressed	23303560	24468267	0.95
clickbench_q38/duckdb:vortex-file-compressed	25468071	26082602	0.98
clickbench_q39/duckdb:vortex-file-compressed	45297547	45875459	0.99
clickbench_q40/duckdb:vortex-file-compressed 🚀	21087384	23477699	0.90
clickbench_q41/duckdb:vortex-file-compressed	22412206	23539938	0.95
clickbench_q42/duckdb:vortex-file-compressed	23834142	26418355	0.90

duckdb / parquet (0.998x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	222399648	223793157	0.99
clickbench_q01/duckdb:parquet	50809202	51042373	1.00
clickbench_q02/duckdb:parquet	66663032	65794086	1.01
clickbench_q03/duckdb:parquet	63559138	64212750	0.99
clickbench_q04/duckdb:parquet	204563784	206980036	0.99
clickbench_q05/duckdb:parquet	277913618	282226765	0.98
clickbench_q06/duckdb:parquet	60660995	61212323	0.99
clickbench_q07/duckdb:parquet	52412376	53452431	0.98
clickbench_q08/duckdb:parquet	270025983	273047173	0.99
clickbench_q09/duckdb:parquet	396195594	398832637	0.99
clickbench_q10/duckdb:parquet	96964249	95545895	1.01
clickbench_q11/duckdb:parquet	109528590	106495157	1.03
clickbench_q12/duckdb:parquet	292201484	300727247	0.97
clickbench_q13/duckdb:parquet	513987932	532219198	0.97
clickbench_q14/duckdb:parquet	331068286	330400491	1.00
clickbench_q15/duckdb:parquet	242235313	242627012	1.00
clickbench_q16/duckdb:parquet	610226815	617730710	0.99
clickbench_q17/duckdb:parquet	512077158	521697633	0.98
clickbench_q18/duckdb:parquet	1051480846	1063886573	0.99
clickbench_q19/duckdb:parquet	49969295	50187772	1.00
clickbench_q20/duckdb:parquet	437448219	439735246	0.99
clickbench_q21/duckdb:parquet	557979697	562448492	0.99
clickbench_q22/duckdb:parquet	930257333	936450625	0.99
clickbench_q23/duckdb:parquet	309360247	320777344	0.96
clickbench_q24/duckdb:parquet	77412470	80481232	0.96
clickbench_q25/duckdb:parquet	139707037	141203843	0.99
clickbench_q26/duckdb:parquet	52374668	52214337	1.00
clickbench_q27/duckdb:parquet	644285415	646607167	1.00
clickbench_q28/duckdb:parquet	4885462095	4841527567	1.01
clickbench_q29/duckdb:parquet	60553974	60855801	1.00
clickbench_q30/duckdb:parquet	304743590	303380415	1.00
clickbench_q31/duckdb:parquet	346222929	351781876	0.98
clickbench_q32/duckdb:parquet	1224848035	1135712718	1.08
clickbench_q33/duckdb:parquet	1332904978	1237378004	1.08
clickbench_q34/duckdb:parquet	1335927231	1264484863	1.06
clickbench_q35/duckdb:parquet	352054879	354670609	0.99
clickbench_q36/duckdb:parquet	63331447	64220648	0.99
clickbench_q37/duckdb:parquet	54015176	53565147	1.01
clickbench_q38/duckdb:parquet	57575455	58918223	0.98
clickbench_q39/duckdb:parquet	97752325	100007200	0.98
clickbench_q40/duckdb:parquet	56246674	55374356	1.02
clickbench_q41/duckdb:parquet	59523542	59606500	1.00
clickbench_q42/duckdb:parquet	53805805	51964359	1.04

duckdb / duckdb (0.971x ➖, 2↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
clickbench_q00/duckdb:duckdb	18055444	19113692	0.94
clickbench_q01/duckdb:duckdb	33020976	34644571	0.95
clickbench_q02/duckdb:duckdb	45189824	45960851	0.98
clickbench_q03/duckdb:duckdb	47478652	48069327	0.99
clickbench_q04/duckdb:duckdb	213796310	227807348	0.94
clickbench_q05/duckdb:duckdb	331398793	323202743	1.03
clickbench_q06/duckdb:duckdb	34497814	36509276	0.94
clickbench_q07/duckdb:duckdb	35763128	37333250	0.96
clickbench_q08/duckdb:duckdb	317243257	313640074	1.01
clickbench_q09/duckdb:duckdb	470951852	488478748	0.96
clickbench_q10/duckdb:duckdb	96751778	98946102	0.98
clickbench_q11/duckdb:duckdb	107075171	109233901	0.98
clickbench_q12/duckdb:duckdb	305017284	307602060	0.99
clickbench_q13/duckdb:duckdb	535156012	571413617	0.94
clickbench_q14/duckdb:duckdb	354417257	355626116	1.00
clickbench_q15/duckdb:duckdb	257453646	266539456	0.97
clickbench_q16/duckdb:duckdb	691383958	699252736	0.99
clickbench_q17/duckdb:duckdb	590516723	588596423	1.00
clickbench_q18/duckdb:duckdb	1255937272	1287809136	0.98
clickbench_q19/duckdb:duckdb	34380692	35703313	0.96
clickbench_q20/duckdb:duckdb	980583370	946914955	1.04
clickbench_q21/duckdb:duckdb	1055545518	1030340421	1.02
clickbench_q22/duckdb:duckdb 🚨	1188835468	1076569899	1.10
clickbench_q23/duckdb:duckdb	250355444	256907533	0.97
clickbench_q24/duckdb:duckdb	59925247	62841075	0.95
clickbench_q25/duckdb:duckdb	120099309	126426357	0.95
clickbench_q26/duckdb:duckdb	52937026	55210354	0.96
clickbench_q27/duckdb:duckdb	1052942330	1043795471	1.01
clickbench_q28/duckdb:duckdb	4583545658	4610370423	0.99
clickbench_q29/duckdb:duckdb	48550865	49319980	0.98
clickbench_q30/duckdb:duckdb	290922479	303077523	0.96
clickbench_q31/duckdb:duckdb 🚀	408175215	485357237	0.84
clickbench_q32/duckdb:duckdb 🚀	1387968641	1654366162	0.84
clickbench_q33/duckdb:duckdb	1994350480	2129013469	0.94
clickbench_q34/duckdb:duckdb	1985568125	2130284006	0.93
clickbench_q35/duckdb:duckdb	265307751	264448161	1.00
clickbench_q36/duckdb:duckdb	41825557	42680275	0.98
clickbench_q37/duckdb:duckdb	31108223	32694860	0.95
clickbench_q38/duckdb:duckdb	30645297	31671257	0.97
clickbench_q39/duckdb:duckdb	66184664	67493997	0.98
clickbench_q40/duckdb:duckdb	31230957	32453660	0.96
clickbench_q41/duckdb:duckdb	31456844	31809092	0.99
clickbench_q42/duckdb:duckdb	31361005	32640865	0.96

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-file-compressed	+1.1%	+0.9%	+0.2%	+642.2%	➖ noise
0	duckdb:duckdb	-5.5%	+0.9%	-6.4%	+260.5%	➖ noise
0	duckdb:vortex-file-compressed	+4.8%	+0.9%	+3.8%	+313.6%	➖ noise
1	datafusion:vortex-file-compressed	-3.1%	-1.6%	-1.5%	+45.0%	➖ noise
1	duckdb:duckdb	-4.7%	-1.6%	-3.2%	+59.1%	➖ noise
1	duckdb:vortex-file-compressed	+2.1%	-1.6%	+3.7%	+16.9%	➖ noise
2	datafusion:vortex-file-compressed	-7.8%	+0.3%	-8.1%	+37.6%	➖ noise
2	duckdb:duckdb	-1.7%	+0.3%	-2.0%	+23.2%	➖ noise
2	duckdb:vortex-file-compressed	+6.2%	+0.3%	+5.9%	+13.2%	➖ noise
3	datafusion:vortex-file-compressed	-1.9%	-1.9%	+0.0%	+183.5%	➖ noise
3	duckdb:duckdb	-1.2%	-1.9%	+0.7%	+53.8%	➖ noise
3	duckdb:vortex-file-compressed	+5.4%	-1.9%	+7.5%	+30.8%	➖ noise
4	datafusion:vortex-file-compressed	-1.5%	-1.4%	-0.2%	+10.0%	➖ noise
4	duckdb:duckdb	-6.2%	-1.4%	-4.9%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	+0.9%	-1.4%	+2.3%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	+0.6%	+2.9%	-2.3%	+10.0%	➖ noise
5	duckdb:duckdb	+2.5%	+2.9%	-0.4%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+0.9%	+2.9%	-1.9%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-3.2%	+0.4%	-3.5%	+44.4%	➖ noise
6	duckdb:duckdb	-5.5%	+0.4%	-5.9%	+29.8%	➖ noise
6	duckdb:vortex-file-compressed	-2.4%	+0.4%	-2.8%	+19.7%	➖ noise
7	datafusion:vortex-file-compressed	+4.9%	-3.6%	+8.8%	+10.8%	➖ noise
7	duckdb:duckdb	-4.2%	-3.6%	-0.6%	+15.4%	➖ noise
7	duckdb:vortex-file-compressed	-11.7%	-3.6%	-8.4%	+10.2%	➖ noise
8	datafusion:vortex-file-compressed	-1.8%	-0.3%	-1.5%	+10.0%	➖ noise
8	duckdb:duckdb	+1.1%	-0.3%	+1.5%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	+0.6%	-0.3%	+0.9%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	-1.9%	-0.2%	-1.6%	+10.0%	➖ noise
9	duckdb:duckdb	-3.6%	-0.2%	-3.4%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	+1.3%	-0.2%	+1.6%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-3.3%	+1.8%	-5.0%	+10.0%	➖ noise
10	duckdb:duckdb	-2.2%	+1.8%	-3.9%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	+0.9%	+1.8%	-0.8%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	-2.5%	+2.5%	-4.9%	+10.0%	➖ noise
11	duckdb:duckdb	-2.0%	+2.5%	-4.3%	+10.0%	➖ noise
11	duckdb:vortex-file-compressed	-0.3%	+2.5%	-2.6%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	+2.3%	-1.2%	+3.5%	+10.0%	➖ noise
12	duckdb:duckdb	-0.8%	-1.2%	+0.3%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-2.8%	-1.2%	-1.7%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-1.1%	-1.1%	+0.0%	+10.0%	➖ noise
13	duckdb:duckdb	-6.3%	-1.1%	-5.3%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-2.3%	-1.1%	-1.1%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-1.7%	-1.1%	-0.6%	+10.0%	➖ noise
14	duckdb:duckdb	-0.3%	-1.1%	+0.8%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	-1.6%	-1.1%	-0.5%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-4.9%	-0.2%	-4.7%	+10.0%	➖ noise
15	duckdb:duckdb	-3.4%	-0.2%	-3.2%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-1.3%	-0.2%	-1.1%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-2.2%	-1.4%	-0.7%	+10.0%	➖ noise
16	duckdb:duckdb	-1.1%	-1.4%	+0.3%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	-19.6%	-1.4%	-18.4%	+10.7%	✅ faster
17	datafusion:vortex-file-compressed	-1.0%	-1.0%	-0.1%	+10.0%	➖ noise
17	duckdb:duckdb	+0.3%	-1.0%	+1.3%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-11.4%	-1.0%	-10.5%	+14.6%	➖ noise
18	datafusion:vortex-file-compressed	-8.9%	-1.8%	-7.2%	+10.0%	➖ noise
18	duckdb:duckdb	-2.5%	-1.8%	-0.7%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-1.5%	-1.8%	+0.3%	+13.4%	➖ noise
19	datafusion:vortex-file-compressed	-5.0%	-0.4%	-4.6%	+13.2%	➖ noise
19	duckdb:duckdb	-3.7%	-0.4%	-3.3%	+11.2%	➖ noise
19	duckdb:vortex-file-compressed	-3.1%	-0.4%	-2.7%	+34.2%	➖ noise
20	datafusion:vortex-file-compressed	-0.6%	-0.4%	-0.2%	+186.5%	➖ noise
20	duckdb:duckdb	+3.6%	-0.4%	+4.0%	+23.3%	➖ noise
20	duckdb:vortex-file-compressed	+1.6%	-0.4%	+2.0%	+11.6%	➖ noise
21	datafusion:vortex-file-compressed	-2.2%	-2.0%	-0.1%	+10.0%	➖ noise
21	duckdb:duckdb	+2.4%	-2.0%	+4.6%	+10.0%	➖ noise
21	duckdb:vortex-file-compressed	+2.8%	-2.0%	+4.9%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	-2.0%	-1.2%	-0.8%	+10.0%	➖ noise
22	duckdb:duckdb	+10.4%	-1.2%	+11.8%	+21.1%	➖ noise
22	duckdb:vortex-file-compressed	+1.3%	-1.2%	+2.5%	+18.3%	➖ noise
23	datafusion:vortex-file-compressed	+24.1%	-2.8%	+27.7%	+58.0%	➖ noise
23	duckdb:duckdb	-2.6%	-2.8%	+0.3%	+10.0%	➖ noise
23	duckdb:vortex-file-compressed	-36.3%	-2.8%	-34.4%	+10.3%	✅ faster
24	datafusion:vortex-file-compressed	+4.9%	-5.3%	+10.9%	+13.7%	➖ noise
24	duckdb:duckdb	-4.6%	-5.3%	+0.7%	+10.0%	➖ noise
24	duckdb:vortex-file-compressed	-12.8%	-5.3%	-7.9%	+22.3%	➖ noise
25	datafusion:vortex-file-compressed	-2.6%	-2.4%	-0.2%	+18.6%	➖ noise
25	duckdb:duckdb	-5.0%	-2.4%	-2.7%	+10.0%	➖ noise
25	duckdb:vortex-file-compressed	-4.5%	-2.4%	-2.2%	+10.0%	➖ noise
26	datafusion:vortex-file-compressed	-3.0%	-6.0%	+3.2%	+17.3%	➖ noise
26	duckdb:duckdb	-4.1%	-6.0%	+2.0%	+10.0%	➖ noise
26	duckdb:vortex-file-compressed	-3.6%	-6.0%	+2.5%	+17.7%	➖ noise
27	datafusion:vortex-file-compressed	-0.1%	-2.5%	+2.4%	+10.0%	➖ noise
27	duckdb:duckdb	+0.9%	-2.5%	+3.5%	+11.3%	➖ noise
27	duckdb:vortex-file-compressed	+2.0%	-2.5%	+4.7%	+10.0%	➖ noise
28	datafusion:vortex-file-compressed	-4.0%	-0.6%	-3.5%	+10.0%	➖ noise
28	duckdb:duckdb	-0.6%	-0.6%	-0.0%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	-0.0%	-0.6%	+0.5%	+10.0%	➖ noise
29	datafusion:vortex-file-compressed	-6.9%	+0.3%	-7.2%	+10.0%	➖ noise
29	duckdb:duckdb	-1.6%	+0.3%	-1.8%	+10.0%	➖ noise
29	duckdb:vortex-file-compressed	-0.5%	+0.3%	-0.8%	+12.4%	➖ noise
30	datafusion:vortex-file-compressed	-11.4%	-1.2%	-10.3%	+10.0%	✅ faster
30	duckdb:duckdb	-4.0%	-1.2%	-2.8%	+10.0%	➖ noise
30	duckdb:vortex-file-compressed	-1.5%	-1.2%	-0.3%	+10.0%	➖ noise
31	datafusion:vortex-file-compressed	-11.7%	-0.8%	-11.0%	+10.0%	✅ faster
31	duckdb:duckdb	-15.9%	-0.8%	-15.2%	+10.0%	✅ faster
31	duckdb:vortex-file-compressed	-1.4%	-0.8%	-0.6%	+10.0%	➖ noise
32	datafusion:vortex-file-compressed	-2.1%	+6.5%	-8.1%	+22.2%	➖ noise
32	duckdb:duckdb	-16.1%	+6.5%	-21.2%	+10.0%	✅ faster
32	duckdb:vortex-file-compressed	+3.7%	+6.5%	-2.7%	+10.0%	➖ noise
33	datafusion:vortex-file-compressed	-13.6%	+3.7%	-16.7%	+10.3%	✅ faster
33	duckdb:duckdb	-6.3%	+3.7%	-9.7%	+10.0%	✅ faster
33	duckdb:vortex-file-compressed	+10.3%	+3.7%	+6.4%	+10.0%	➖ noise
34	datafusion:vortex-file-compressed	-3.8%	+2.4%	-6.1%	+10.0%	➖ noise
34	duckdb:duckdb	-6.8%	+2.4%	-9.0%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	+3.6%	+2.4%	+1.1%	+10.0%	➖ noise
35	datafusion:vortex-file-compressed	-2.1%	-3.5%	+1.4%	+10.0%	➖ noise
35	duckdb:duckdb	+0.3%	-3.5%	+4.0%	+10.0%	➖ noise
35	duckdb:vortex-file-compressed	+0.7%	-3.5%	+4.3%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	-12.7%	-4.5%	-8.6%	+11.0%	➖ noise
36	duckdb:duckdb	-2.0%	-4.5%	+2.6%	+11.2%	➖ noise
36	duckdb:vortex-file-compressed	-2.3%	-4.5%	+2.3%	+15.1%	➖ noise
37	datafusion:vortex-file-compressed	-3.0%	-3.4%	+0.4%	+11.4%	➖ noise
37	duckdb:duckdb	-4.9%	-3.4%	-1.5%	+10.0%	➖ noise
37	duckdb:vortex-file-compressed	-4.8%	-3.4%	-1.4%	+11.5%	➖ noise
38	datafusion:vortex-file-compressed	-0.8%	-0.4%	-0.4%	+10.5%	➖ noise
38	duckdb:duckdb	-3.2%	-0.4%	-2.9%	+10.0%	➖ noise
38	duckdb:vortex-file-compressed	-2.4%	-0.4%	-2.0%	+10.0%	➖ noise
39	datafusion:vortex-file-compressed	-5.0%	-4.0%	-1.1%	+10.0%	➖ noise
39	duckdb:duckdb	-1.9%	-4.0%	+2.1%	+16.4%	➖ noise
39	duckdb:vortex-file-compressed	-1.3%	-4.0%	+2.8%	+10.0%	➖ noise
40	datafusion:vortex-file-compressed	-10.0%	-7.8%	-2.4%	+10.0%	➖ noise
40	duckdb:duckdb	-3.8%	-7.8%	+4.3%	+10.0%	➖ noise
40	duckdb:vortex-file-compressed	-10.2%	-7.8%	-2.6%	+12.9%	➖ noise
41	datafusion:vortex-file-compressed	-13.2%	+1.2%	-14.2%	+10.0%	✅ faster
41	duckdb:duckdb	-1.1%	+1.2%	-2.3%	+12.7%	➖ noise
41	duckdb:vortex-file-compressed	-4.8%	+1.2%	-5.9%	+10.0%	➖ noise
42	datafusion:vortex-file-compressed	-9.4%	-0.0%	-9.4%	+10.0%	✅ faster
42	duckdb:duckdb	-3.9%	-0.0%	-3.9%	+10.0%	➖ noise
42	duckdb:vortex-file-compressed	-9.8%	-0.0%	-9.7%	+10.3%	✅ faster

github-actions · 2026-01-27T17:49:48Z

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 0.933x ➖
Parquet (geomean): 0.918x ➖
Shifts: Parquet (control) -8.2% · Median polish -7.8%

duckdb / vortex-file-compressed (0.892x ✅, 4↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚀	10759020	11982040	0.90
statpopgen_q01/duckdb:vortex-file-compressed 🚀	18907454	29728403	0.64
statpopgen_q02/duckdb:vortex-file-compressed	1277634343	1406004510	0.91
statpopgen_q03/duckdb:vortex-file-compressed	2982777632	3221106267	0.93
statpopgen_q04/duckdb:vortex-file-compressed	3010432715	3141404996	0.96
statpopgen_q05/duckdb:vortex-file-compressed	1358816965	1391917948	0.98
statpopgen_q06/duckdb:vortex-file-compressed	2058469065	2163756045	0.95
statpopgen_q07/duckdb:vortex-file-compressed 🚀	198296644	222113512	0.89
statpopgen_q08/duckdb:vortex-file-compressed 🚀	213191262	238518299	0.89
statpopgen_q09/duckdb:vortex-file-compressed	2815125442	3066219490	0.92
statpopgen_q10/duckdb:vortex-file-compressed	4567188945	5013616719	0.91

duckdb / vortex-compact (0.976x ➖, 1↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact	11278752	10814587	1.04
statpopgen_q01/duckdb:vortex-compact	168650799	178367322	0.95
statpopgen_q02/duckdb:vortex-compact	1814259211	1843044979	0.98
statpopgen_q03/duckdb:vortex-compact	3464179947	3485019118	0.99
statpopgen_q04/duckdb:vortex-compact	3464890419	3513761148	0.99
statpopgen_q05/duckdb:vortex-compact	1848362048	1820212264	1.02
statpopgen_q06/duckdb:vortex-compact	2670188986	2684933642	0.99
statpopgen_q07/duckdb:vortex-compact	943986257	947125344	1.00
statpopgen_q08/duckdb:vortex-compact	972424255	985748693	0.99
statpopgen_q09/duckdb:vortex-compact 🚀	3293879425	3674538122	0.90
statpopgen_q10/duckdb:vortex-compact	5359003424	5908728735	0.91

duckdb / parquet (0.918x ➖, 1↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	306379934	333340701	0.92
statpopgen_q01/duckdb:parquet	393191309	420705765	0.93
statpopgen_q02/duckdb:parquet	973090790	1080321694	0.90
statpopgen_q03/duckdb:parquet	1488285146	1611727694	0.92
statpopgen_q04/duckdb:parquet	1518016212	1624765196	0.93
statpopgen_q05/duckdb:parquet	998334331	1108673196	0.90
statpopgen_q06/duckdb:parquet	1482240733	1596284759	0.93
statpopgen_q07/duckdb:parquet	1863900619	2027544980	0.92
statpopgen_q08/duckdb:parquet	1882379703	2033296882	0.93
statpopgen_q09/duckdb:parquet	1373346417	1501644214	0.91
statpopgen_q10/duckdb:parquet 🚀	2662587344	2975953310	0.89

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	duckdb:vortex-compact	+4.3%	-8.1%	+13.5%	+10.0%	🚨 regression
0	duckdb:vortex-file-compressed	-10.2%	-8.1%	-2.3%	+13.9%	➖ noise
1	duckdb:vortex-compact	-5.4%	-6.5%	+1.2%	+28.2%	➖ noise
1	duckdb:vortex-file-compressed	-36.4%	-6.5%	-31.9%	+258.3%	➖ noise
2	duckdb:vortex-compact	-1.6%	-9.9%	+9.3%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-9.1%	-9.9%	+0.9%	+10.0%	➖ noise
3	duckdb:vortex-compact	-0.6%	-7.7%	+7.6%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-7.4%	-7.7%	+0.3%	+10.0%	➖ noise
4	duckdb:vortex-compact	-1.4%	-6.6%	+5.5%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-4.2%	-6.6%	+2.6%	+10.0%	➖ noise
5	duckdb:vortex-compact	+1.5%	-10.0%	+12.8%	+10.0%	🚨 regression
5	duckdb:vortex-file-compressed	-2.4%	-10.0%	+8.4%	+10.0%	➖ noise
6	duckdb:vortex-compact	-0.5%	-7.1%	+7.1%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-4.9%	-7.1%	+2.5%	+10.0%	➖ noise
7	duckdb:vortex-compact	-0.3%	-8.1%	+8.4%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-10.7%	-8.1%	-2.9%	+10.0%	➖ noise
8	duckdb:vortex-compact	-1.4%	-7.4%	+6.6%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-10.6%	-7.4%	-3.5%	+10.0%	➖ noise
9	duckdb:vortex-compact	-10.4%	-8.5%	-2.0%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-8.2%	-8.5%	+0.4%	+10.0%	➖ noise
10	duckdb:vortex-compact	-9.3%	-10.5%	+1.4%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-8.9%	-10.5%	+1.8%	+10.0%	➖ noise

github-actions · 2026-01-27T17:53:40Z

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.9%
Vortex (geomean): 1.101x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +4.4%

datafusion / vortex-file-compressed (1.177x ➖, 0↑ 3↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨	52133306	39102156	1.33
fineweb_q01/datafusion:vortex-file-compressed 🚨	1067899466	537350035	1.99
fineweb_q02/datafusion:vortex-file-compressed 🚨	826344238	525671401	1.57
fineweb_q03/datafusion:vortex-file-compressed	1574856616	1381243336	1.14
fineweb_q04/datafusion:vortex-file-compressed	1387723674	1411720324	0.98
fineweb_q05/datafusion:vortex-file-compressed	1359258352	1386974669	0.98
fineweb_q06/datafusion:vortex-file-compressed	1696161500	1753993192	0.97
fineweb_q07/datafusion:vortex-file-compressed	1411701420	1531211949	0.92
fineweb_q08/datafusion:vortex-file-compressed	581954968	546821464	1.06

datafusion / vortex-compact (1.176x ➖, 0↑ 2↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	50726158	41981033	1.21
fineweb_q01/datafusion:vortex-compact 🚨	847957853	576140502	1.47
fineweb_q02/datafusion:vortex-compact 🚨	1072765322	667386494	1.61
fineweb_q03/datafusion:vortex-compact	1854672326	1846774610	1.00
fineweb_q04/datafusion:vortex-compact	2250393211	2214924943	1.02
fineweb_q05/datafusion:vortex-compact	1714961186	1698244391	1.01
fineweb_q06/datafusion:vortex-compact	1749306598	1447537589	1.21
fineweb_q07/datafusion:vortex-compact	1366645860	1376219225	0.99
fineweb_q08/datafusion:vortex-compact	482951709	395777698	1.22

datafusion / parquet (1.032x ➖, 0↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	1523379835	1699929063	0.90
fineweb_q01/datafusion:parquet	2330991389	1898161119	1.23
fineweb_q02/datafusion:parquet	2113475322	2360489272	0.90
fineweb_q03/datafusion:parquet	2418776131	1905793140	1.27
fineweb_q04/datafusion:parquet 🚨	2443882339	1877854276	1.30
fineweb_q05/datafusion:parquet	1948330057	2021552978	0.96
fineweb_q06/datafusion:parquet	2144900265	2007230393	1.07
fineweb_q07/datafusion:parquet	2073815279	2286752170	0.91
fineweb_q08/datafusion:parquet	1871310991	2145362834	0.87

duckdb / vortex-file-compressed (1.039x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	129809898	113002356	1.15
fineweb_q01/duckdb:vortex-file-compressed	744692765	731902779	1.02
fineweb_q02/duckdb:vortex-file-compressed	507065351	566777980	0.89
fineweb_q03/duckdb:vortex-file-compressed	1643618533	1536617849	1.07
fineweb_q04/duckdb:vortex-file-compressed	1696441626	1569126923	1.08
fineweb_q05/duckdb:vortex-file-compressed	1616060516	1600507119	1.01
fineweb_q06/duckdb:vortex-file-compressed	1811087072	1757420589	1.03
fineweb_q07/duckdb:vortex-file-compressed	1592211049	1578398269	1.01
fineweb_q08/duckdb:vortex-file-compressed	691770262	620824806	1.11

duckdb / vortex-compact (1.021x ➖, 0↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨	119122862	71529911	1.67
fineweb_q01/duckdb:vortex-compact	604205055	756271703	0.80
fineweb_q02/duckdb:vortex-compact	580138689	678375273	0.86
fineweb_q03/duckdb:vortex-compact	1759125839	1694454868	1.04
fineweb_q04/duckdb:vortex-compact	1782220265	1832084432	0.97
fineweb_q05/duckdb:vortex-compact	1604839550	1552009950	1.03
fineweb_q06/duckdb:vortex-compact	1623496229	1505135429	1.08
fineweb_q07/duckdb:vortex-compact	1385723669	1413880697	0.98
fineweb_q08/duckdb:vortex-compact	541244439	563310363	0.96

duckdb / parquet (0.990x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	1203630719	1115038242	1.08
fineweb_q01/duckdb:parquet	1722818293	1722829524	1.00
fineweb_q02/duckdb:parquet	1698400052	1826949463	0.93
fineweb_q03/duckdb:parquet	4445012787	4679697592	0.95
fineweb_q04/duckdb:parquet	2168365744	2341206951	0.93
fineweb_q05/duckdb:parquet	2842396107	3029782407	0.94
fineweb_q06/duckdb:parquet	3761131627	3696694487	1.02
fineweb_q07/duckdb:parquet	4442477429	4115528099	1.08
fineweb_q08/duckdb:parquet	1180387903	1172460500	1.01

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	+20.8%	-1.6%	+22.9%	+97.3%	➖ noise
0	datafusion:vortex-file-compressed	+33.3%	-1.6%	+35.6%	+159.8%	➖ noise
0	duckdb:vortex-compact	+66.5%	-1.6%	+69.3%	+38.3%	🚨 regression
0	duckdb:vortex-file-compressed	+14.9%	-1.6%	+16.8%	+61.5%	➖ noise
1	datafusion:vortex-compact	+47.2%	+10.8%	+32.8%	+72.1%	➖ noise
1	datafusion:vortex-file-compressed	+98.7%	+10.8%	+79.3%	+62.0%	🚨 regression
1	duckdb:vortex-compact	-20.1%	+10.8%	-27.9%	+61.6%	➖ noise
1	duckdb:vortex-file-compressed	+1.7%	+10.8%	-8.2%	+50.3%	➖ noise
2	datafusion:vortex-compact	+60.7%	-8.8%	+76.2%	+30.0%	🚨 regression
2	datafusion:vortex-file-compressed	+57.2%	-8.8%	+72.3%	+66.5%	🚨 regression
2	duckdb:vortex-compact	-14.5%	-8.8%	-6.3%	+31.0%	➖ noise
2	duckdb:vortex-file-compressed	-10.5%	-8.8%	-1.9%	+38.7%	➖ noise
3	datafusion:vortex-compact	+0.4%	+9.8%	-8.5%	+30.0%	➖ noise
3	datafusion:vortex-file-compressed	+14.0%	+9.8%	+3.8%	+30.0%	➖ noise
3	duckdb:vortex-compact	+3.8%	+9.8%	-5.4%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	+7.0%	+9.8%	-2.6%	+34.8%	➖ noise
4	datafusion:vortex-compact	+1.6%	+9.8%	-7.5%	+30.0%	➖ noise
4	datafusion:vortex-file-compressed	-1.7%	+9.8%	-10.5%	+30.0%	➖ noise
4	duckdb:vortex-compact	-2.7%	+9.8%	-11.4%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+8.1%	+9.8%	-1.5%	+30.0%	➖ noise
5	datafusion:vortex-compact	+1.0%	-4.9%	+6.2%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-2.0%	-4.9%	+3.1%	+30.0%	➖ noise
5	duckdb:vortex-compact	+3.4%	-4.9%	+8.7%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	+1.0%	-4.9%	+6.2%	+30.5%	➖ noise
6	datafusion:vortex-compact	+20.8%	+4.3%	+15.9%	+30.0%	➖ noise
6	datafusion:vortex-file-compressed	-3.3%	+4.3%	-7.3%	+30.0%	➖ noise
6	duckdb:vortex-compact	+7.9%	+4.3%	+3.4%	+30.0%	➖ noise
6	duckdb:vortex-file-compressed	+3.1%	+4.3%	-1.2%	+30.0%	➖ noise
7	datafusion:vortex-compact	-0.7%	-1.1%	+0.4%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	-7.8%	-1.1%	-6.8%	+30.0%	➖ noise
7	duckdb:vortex-compact	-2.0%	-1.1%	-0.9%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	+0.9%	-1.1%	+2.0%	+30.0%	➖ noise
8	datafusion:vortex-compact	+22.0%	-6.3%	+30.2%	+30.0%	🚨 regression
8	datafusion:vortex-file-compressed	+6.4%	-6.3%	+13.6%	+30.0%	➖ noise
8	duckdb:vortex-compact	-3.9%	-6.3%	+2.5%	+33.3%	➖ noise
8	duckdb:vortex-file-compressed	+11.4%	-6.3%	+18.9%	+30.0%	➖ noise

github-actions · 2026-01-27T17:53:45Z

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.1%
Vortex (geomean): 1.050x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish +1.2%

datafusion / vortex-file-compressed (1.114x ➖, 3↑ 7↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	825879874	827800243	1.00
tpch_q02/datafusion:vortex-file-compressed 🚀	713388036	1146257737	0.62
tpch_q03/datafusion:vortex-file-compressed 🚀	840843478	1625414726	0.52
tpch_q04/datafusion:vortex-file-compressed	680881457	755103571	0.90
tpch_q05/datafusion:vortex-file-compressed 🚀	1340569373	2010805305	0.67
tpch_q06/datafusion:vortex-file-compressed	762782613	827319683	0.92
tpch_q07/datafusion:vortex-file-compressed	1575397608	1383767792	1.14
tpch_q08/datafusion:vortex-file-compressed 🚨	2136971734	1623644927	1.32
tpch_q09/datafusion:vortex-file-compressed	1836406185	1900829059	0.97
tpch_q10/datafusion:vortex-file-compressed 🚨	1626362665	1222470947	1.33
tpch_q11/datafusion:vortex-file-compressed	712009604	757023683	0.94
tpch_q12/datafusion:vortex-file-compressed	1173781403	1393421252	0.84
tpch_q13/datafusion:vortex-file-compressed	544996256	499825452	1.09
tpch_q14/datafusion:vortex-file-compressed	764234596	642232964	1.19
tpch_q15/datafusion:vortex-file-compressed 🚨	1667322283	1263749213	1.32
tpch_q16/datafusion:vortex-file-compressed 🚨	870345234	348823872	2.50
tpch_q17/datafusion:vortex-file-compressed	1626318221	1302357932	1.25
tpch_q18/datafusion:vortex-file-compressed	1706452814	1409956747	1.21
tpch_q19/datafusion:vortex-file-compressed	871191014	864674966	1.01
tpch_q20/datafusion:vortex-file-compressed 🚨	1415922156	1075058031	1.32
tpch_q21/datafusion:vortex-file-compressed 🚨	3041244622	1715522043	1.77
tpch_q22/datafusion:vortex-file-compressed 🚨	1299500827	493986015	2.63

datafusion / vortex-compact (1.223x ➖, 0↑ 7↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	855680400	720923537	1.19
tpch_q02/datafusion:vortex-compact 🚨	916626247	654267449	1.40
tpch_q03/datafusion:vortex-compact 🚨	992334411	715293877	1.39
tpch_q04/datafusion:vortex-compact 🚨	776006177	515104045	1.51
tpch_q05/datafusion:vortex-compact 🚨	1603554880	1050356987	1.53
tpch_q06/datafusion:vortex-compact	852100708	689704182	1.24
tpch_q07/datafusion:vortex-compact	1563390303	1393274647	1.12
tpch_q08/datafusion:vortex-compact	1299140543	1232882835	1.05
tpch_q09/datafusion:vortex-compact	1608383877	1385711781	1.16
tpch_q10/datafusion:vortex-compact 🚨	1245822367	901489534	1.38
tpch_q11/datafusion:vortex-compact 🚨	714939580	402232134	1.78
tpch_q12/datafusion:vortex-compact	993228410	923144272	1.08
tpch_q13/datafusion:vortex-compact	503487738	463292661	1.09
tpch_q14/datafusion:vortex-compact	660458450	578670463	1.14
tpch_q15/datafusion:vortex-compact	1260874028	1306461596	0.97
tpch_q16/datafusion:vortex-compact	532451772	468257800	1.14
tpch_q17/datafusion:vortex-compact	1565922000	1252443929	1.25
tpch_q18/datafusion:vortex-compact	1539032538	1289009855	1.19
tpch_q19/datafusion:vortex-compact	785688877	821940644	0.96
tpch_q20/datafusion:vortex-compact 🚨	1273489181	896796383	1.42
tpch_q21/datafusion:vortex-compact	1850297784	1671376763	1.11
tpch_q22/datafusion:vortex-compact	664116541	580136135	1.14

datafusion / parquet (0.935x ➖, 4↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	883637618	1083176083	0.82
tpch_q02/datafusion:parquet 🚀	878085846	1767903928	0.50
tpch_q03/datafusion:parquet	1322434734	1551856520	0.85
tpch_q04/datafusion:parquet 🚀	625137207	921053007	0.68
tpch_q05/datafusion:parquet	1454858441	1875576813	0.78
tpch_q06/datafusion:parquet 🚀	681838284	1099414694	0.62
tpch_q07/datafusion:parquet	2185046219	1727167845	1.27
tpch_q08/datafusion:parquet	2684057991	2546175573	1.05
tpch_q09/datafusion:parquet	2742456368	2759302209	0.99
tpch_q10/datafusion:parquet	2600368822	3210273350	0.81
tpch_q11/datafusion:parquet 🚀	781469569	1479726899	0.53
tpch_q12/datafusion:parquet	752935177	670027344	1.12
tpch_q13/datafusion:parquet	850597140	714891295	1.19
tpch_q14/datafusion:parquet	896500076	739415675	1.21
tpch_q15/datafusion:parquet	1356862109	1246665006	1.09
tpch_q16/datafusion:parquet	408613347	430456149	0.95
tpch_q17/datafusion:parquet	1742824022	1381016505	1.26
tpch_q18/datafusion:parquet	2107585884	1643378484	1.28
tpch_q19/datafusion:parquet	1113147474	1107167110	1.01
tpch_q20/datafusion:parquet	1544377943	1346242480	1.15
tpch_q21/datafusion:parquet	2310776149	1816007046	1.27
tpch_q22/datafusion:parquet	1295125439	1449183322	0.89

duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	806783845	748567476	1.08
tpch_q02/duckdb:vortex-file-compressed	1151148259	1271175531	0.91
tpch_q03/duckdb:vortex-file-compressed	1193852954	1030061576	1.16
tpch_q04/duckdb:vortex-file-compressed	832953553	720478606	1.16
tpch_q05/duckdb:vortex-file-compressed	1424232451	1145723782	1.24
tpch_q06/duckdb:vortex-file-compressed	1170423460	984867991	1.19
tpch_q07/duckdb:vortex-file-compressed	1331532355	1385933613	0.96
tpch_q08/duckdb:vortex-file-compressed	1504531460	1581436245	0.95
tpch_q09/duckdb:vortex-file-compressed	1498812078	1690916066	0.89
tpch_q10/duckdb:vortex-file-compressed	1431435365	1220213207	1.17
tpch_q11/duckdb:vortex-file-compressed	692559360	663182758	1.04
tpch_q12/duckdb:vortex-file-compressed	929246973	948203939	0.98
tpch_q13/duckdb:vortex-file-compressed	975997907	1104979857	0.88
tpch_q14/duckdb:vortex-file-compressed	945269312	1098276545	0.86
tpch_q15/duckdb:vortex-file-compressed	602544572	602710835	1.00
tpch_q16/duckdb:vortex-file-compressed	501452242	471983791	1.06
tpch_q17/duckdb:vortex-file-compressed	1079018316	1369563047	0.79
tpch_q18/duckdb:vortex-file-compressed	951796906	1209271606	0.79
tpch_q19/duckdb:vortex-file-compressed	892136579	1044264571	0.85
tpch_q20/duckdb:vortex-file-compressed	1285002396	1447416652	0.89
tpch_q21/duckdb:vortex-file-compressed	2422322482	2258825507	1.07
tpch_q22/duckdb:vortex-file-compressed	761327534	775150510	0.98

duckdb / vortex-compact (0.905x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	631484842	860047087	0.73
tpch_q02/duckdb:vortex-compact	1146283511	1229429571	0.93
tpch_q03/duckdb:vortex-compact	952297988	1230863042	0.77
tpch_q04/duckdb:vortex-compact	608581683	546566788	1.11
tpch_q05/duckdb:vortex-compact	1028475757	1215112215	0.85
tpch_q06/duckdb:vortex-compact	669178186	872216183	0.77
tpch_q07/duckdb:vortex-compact	1007807292	1273436512	0.79
tpch_q08/duckdb:vortex-compact	1395559998	1473462910	0.95
tpch_q09/duckdb:vortex-compact	1473928850	1526879123	0.97
tpch_q10/duckdb:vortex-compact	1160868325	1050374340	1.11
tpch_q11/duckdb:vortex-compact	714710646	740696055	0.96
tpch_q12/duckdb:vortex-compact	617322121	880769227	0.70
tpch_q13/duckdb:vortex-compact	843422934	1046970117	0.81
tpch_q14/duckdb:vortex-compact	839657297	1040469923	0.81
tpch_q15/duckdb:vortex-compact	557999360	623464450	0.89
tpch_q16/duckdb:vortex-compact	437919212	421794748	1.04
tpch_q17/duckdb:vortex-compact	948429357	1053068792	0.90
tpch_q18/duckdb:vortex-compact	884559892	896931046	0.99
tpch_q19/duckdb:vortex-compact	833878561	877383740	0.95
tpch_q20/duckdb:vortex-compact	1354313959	1343888787	1.01
tpch_q21/duckdb:vortex-compact	1721796741	1854915967	0.93
tpch_q22/duckdb:vortex-compact	861431489	765749351	1.12

duckdb / parquet (1.010x ➖, 0↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	1099612305	1268354010	0.87
tpch_q02/duckdb:parquet	1784192094	1778044751	1.00
tpch_q03/duckdb:parquet	1840927325	2498461648	0.74
tpch_q04/duckdb:parquet	1297918152	1506686580	0.86
tpch_q05/duckdb:parquet	2619483828	2303702328	1.14
tpch_q06/duckdb:parquet	836337058	856236702	0.98
tpch_q07/duckdb:parquet	2056014945	2066823077	0.99
tpch_q08/duckdb:parquet	2673246679	2835160952	0.94
tpch_q09/duckdb:parquet	2831027578	2582494671	1.10
tpch_q10/duckdb:parquet	3491960705	3579193339	0.98
tpch_q11/duckdb:parquet	1071368857	1125147387	0.95
tpch_q12/duckdb:parquet	1237742918	1180944559	1.05
tpch_q13/duckdb:parquet	1421053710	1434006204	0.99
tpch_q14/duckdb:parquet	1367784709	1394148518	0.98
tpch_q15/duckdb:parquet	1080500249	1137566177	0.95
tpch_q16/duckdb:parquet	1155021662	910457779	1.27
tpch_q17/duckdb:parquet	1534090534	1330985621	1.15
tpch_q18/duckdb:parquet	1756878391	1614607194	1.09
tpch_q19/duckdb:parquet 🚨	1954343636	1497417056	1.31
tpch_q20/duckdb:parquet	2076256580	1894585042	1.10
tpch_q21/duckdb:parquet	2196932589	2205055142	1.00
tpch_q22/duckdb:parquet	1118119480	1151037059	0.97

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	+18.7%	-15.9%	+41.1%	+67.2%	➖ noise
1	datafusion:vortex-file-compressed	-0.2%	-15.9%	+18.6%	+71.8%	➖ noise
1	duckdb:vortex-compact	-26.6%	-15.9%	-12.7%	+55.5%	➖ noise
1	duckdb:vortex-file-compressed	+7.8%	-15.9%	+28.2%	+55.5%	➖ noise
2	datafusion:vortex-compact	+40.1%	-29.4%	+98.4%	+61.9%	🚨 regression
2	datafusion:vortex-file-compressed	-37.8%	-29.4%	-11.8%	+55.5%	➖ noise
2	duckdb:vortex-compact	-6.8%	-29.4%	+32.1%	+59.1%	➖ noise
2	duckdb:vortex-file-compressed	-9.4%	-29.4%	+28.3%	+55.5%	➖ noise
3	datafusion:vortex-compact	+38.7%	-20.8%	+75.1%	+71.2%	🚨 regression
3	datafusion:vortex-file-compressed	-48.3%	-20.8%	-34.7%	+86.1%	➖ noise
3	duckdb:vortex-compact	-22.6%	-20.8%	-2.4%	+55.5%	➖ noise
3	duckdb:vortex-file-compressed	+15.9%	-20.8%	+46.3%	+66.0%	➖ noise
4	datafusion:vortex-compact	+50.7%	-23.5%	+97.0%	+55.5%	🚨 regression
4	datafusion:vortex-file-compressed	-9.8%	-23.5%	+17.9%	+55.5%	➖ noise
4	duckdb:vortex-compact	+11.3%	-23.5%	+45.6%	+55.5%	➖ noise
4	duckdb:vortex-file-compressed	+15.6%	-23.5%	+51.2%	+55.5%	➖ noise
5	datafusion:vortex-compact	+52.7%	-6.1%	+62.6%	+55.5%	🚨 regression
5	datafusion:vortex-file-compressed	-33.3%	-6.1%	-29.0%	+55.5%	➖ noise
5	duckdb:vortex-compact	-15.4%	-6.1%	-9.9%	+55.5%	➖ noise
5	duckdb:vortex-file-compressed	+24.3%	-6.1%	+32.4%	+55.5%	➖ noise
6	datafusion:vortex-compact	+23.5%	-22.2%	+58.7%	+55.5%	🚨 regression
6	datafusion:vortex-file-compressed	-7.8%	-22.2%	+18.5%	+55.5%	➖ noise
6	duckdb:vortex-compact	-23.3%	-22.2%	-1.4%	+55.5%	➖ noise
6	duckdb:vortex-file-compressed	+18.8%	-22.2%	+52.7%	+55.5%	➖ noise
7	datafusion:vortex-compact	+12.2%	+12.2%	+0.0%	+55.5%	➖ noise
7	datafusion:vortex-file-compressed	+13.8%	+12.2%	+1.5%	+55.5%	➖ noise
7	duckdb:vortex-compact	-20.9%	+12.2%	-29.5%	+55.5%	➖ noise
7	duckdb:vortex-file-compressed	-3.9%	+12.2%	-14.4%	+55.5%	➖ noise
8	datafusion:vortex-compact	+5.4%	-0.3%	+5.7%	+55.5%	➖ noise
8	datafusion:vortex-file-compressed	+31.6%	-0.3%	+32.0%	+55.5%	➖ noise
8	duckdb:vortex-compact	-5.3%	-0.3%	-5.0%	+55.5%	➖ noise
8	duckdb:vortex-file-compressed	-4.9%	-0.3%	-4.6%	+55.5%	➖ noise
9	datafusion:vortex-compact	+16.1%	+4.4%	+11.2%	+55.5%	➖ noise
9	datafusion:vortex-file-compressed	-3.4%	+4.4%	-7.4%	+55.5%	➖ noise
9	duckdb:vortex-compact	-3.5%	+4.4%	-7.5%	+55.5%	➖ noise
9	duckdb:vortex-file-compressed	-11.4%	+4.4%	-15.1%	+55.5%	➖ noise
10	datafusion:vortex-compact	+38.2%	-11.1%	+55.5%	+55.5%	➖ noise
10	datafusion:vortex-file-compressed	+33.0%	-11.1%	+49.7%	+55.5%	➖ noise
10	duckdb:vortex-compact	+10.5%	-11.1%	+24.3%	+55.5%	➖ noise
10	duckdb:vortex-file-compressed	+17.3%	-11.1%	+32.0%	+55.5%	➖ noise
11	datafusion:vortex-compact	+77.7%	-29.1%	+150.6%	+55.5%	🚨 regression
11	datafusion:vortex-file-compressed	-5.9%	-29.1%	+32.6%	+55.5%	➖ noise
11	duckdb:vortex-compact	-3.5%	-29.1%	+36.1%	+55.5%	➖ noise
11	duckdb:vortex-file-compressed	+4.4%	-29.1%	+47.3%	+55.5%	➖ noise
12	datafusion:vortex-compact	+7.6%	+8.5%	-0.9%	+55.5%	➖ noise
12	datafusion:vortex-file-compressed	-15.8%	+8.5%	-22.4%	+55.5%	➖ noise
12	duckdb:vortex-compact	-29.9%	+8.5%	-35.4%	+58.6%	➖ noise
12	duckdb:vortex-file-compressed	-2.0%	+8.5%	-9.7%	+55.5%	➖ noise
13	datafusion:vortex-compact	+8.7%	+8.6%	+0.1%	+70.4%	➖ noise
13	datafusion:vortex-file-compressed	+9.0%	+8.6%	+0.4%	+59.9%	➖ noise
13	duckdb:vortex-compact	-19.4%	+8.6%	-25.8%	+65.8%	➖ noise
13	duckdb:vortex-file-compressed	-11.7%	+8.6%	-18.7%	+83.5%	➖ noise
14	datafusion:vortex-compact	+14.1%	+9.1%	+4.6%	+55.5%	➖ noise
14	datafusion:vortex-file-compressed	+19.0%	+9.1%	+9.1%	+55.5%	➖ noise
14	duckdb:vortex-compact	-19.3%	+9.1%	-26.0%	+55.5%	➖ noise
14	duckdb:vortex-file-compressed	-13.9%	+9.1%	-21.1%	+55.5%	➖ noise
15	datafusion:vortex-compact	-3.5%	+1.7%	-5.1%	+55.5%	➖ noise
15	datafusion:vortex-file-compressed	+31.9%	+1.7%	+29.8%	+55.5%	➖ noise
15	duckdb:vortex-compact	-10.5%	+1.7%	-12.0%	+55.5%	➖ noise
15	duckdb:vortex-file-compressed	-0.0%	+1.7%	-1.7%	+55.5%	➖ noise
16	datafusion:vortex-compact	+13.7%	+9.7%	+3.6%	+55.5%	➖ noise
16	datafusion:vortex-file-compressed	+149.5%	+9.7%	+127.4%	+63.6%	🚨 regression
16	duckdb:vortex-compact	+3.8%	+9.7%	-5.4%	+55.5%	➖ noise
16	duckdb:vortex-file-compressed	+6.2%	+9.7%	-3.2%	+75.2%	➖ noise
17	datafusion:vortex-compact	+25.0%	+20.6%	+3.7%	+55.5%	➖ noise
17	datafusion:vortex-file-compressed	+24.9%	+20.6%	+3.5%	+55.5%	➖ noise
17	duckdb:vortex-compact	-9.9%	+20.6%	-25.3%	+55.5%	➖ noise
17	duckdb:vortex-file-compressed	-21.2%	+20.6%	-34.7%	+55.5%	➖ noise
18	datafusion:vortex-compact	+19.4%	+18.1%	+1.1%	+55.5%	➖ noise
18	datafusion:vortex-file-compressed	+21.0%	+18.1%	+2.5%	+55.5%	➖ noise
18	duckdb:vortex-compact	-1.4%	+18.1%	-16.5%	+55.5%	➖ noise
18	duckdb:vortex-file-compressed	-21.3%	+18.1%	-33.4%	+55.5%	➖ noise
19	datafusion:vortex-compact	-4.4%	+14.6%	-16.6%	+55.5%	➖ noise
19	datafusion:vortex-file-compressed	+0.8%	+14.6%	-12.0%	+55.5%	➖ noise
19	duckdb:vortex-compact	-5.0%	+14.6%	-17.0%	+55.5%	➖ noise
19	duckdb:vortex-file-compressed	-14.6%	+14.6%	-25.4%	+55.9%	➖ noise
20	datafusion:vortex-compact	+42.0%	+12.1%	+26.6%	+55.5%	➖ noise
20	datafusion:vortex-file-compressed	+31.7%	+12.1%	+17.5%	+55.5%	➖ noise
20	duckdb:vortex-compact	+0.8%	+12.1%	-10.1%	+55.5%	➖ noise
20	duckdb:vortex-file-compressed	-11.2%	+12.1%	-20.8%	+55.5%	➖ noise
21	datafusion:vortex-compact	+10.7%	+12.6%	-1.7%	+55.5%	➖ noise
21	datafusion:vortex-file-compressed	+77.3%	+12.6%	+57.4%	+55.5%	🚨 regression
21	duckdb:vortex-compact	-7.2%	+12.6%	-17.6%	+55.5%	➖ noise
21	duckdb:vortex-file-compressed	+7.2%	+12.6%	-4.8%	+55.5%	➖ noise
22	datafusion:vortex-compact	+14.5%	-6.8%	+22.9%	+55.5%	➖ noise
22	datafusion:vortex-file-compressed	+163.1%	-6.8%	+182.3%	+55.5%	🚨 regression
22	duckdb:vortex-compact	+12.5%	-6.8%	+20.7%	+55.5%	➖ noise
22	duckdb:vortex-file-compressed	-1.8%	-6.8%	+5.4%	+55.5%	➖ noise

github-actions · 2026-01-27T17:58:24Z

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.8%
Vortex (geomean): 0.868x ✅
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -9.0%

datafusion / vortex-file-compressed (0.823x ✅, 99↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀	28968324	33626713	0.86
tpcds_q02/datafusion:vortex-file-compressed 🚀	53623822	65021882	0.82
tpcds_q03/datafusion:vortex-file-compressed 🚀	20544873	24478287	0.84
tpcds_q04/datafusion:vortex-file-compressed 🚀	294497135	350798928	0.84
tpcds_q05/datafusion:vortex-file-compressed 🚀	53183791	66213456	0.80
tpcds_q06/datafusion:vortex-file-compressed 🚀	51056783	58591292	0.87
tpcds_q07/datafusion:vortex-file-compressed 🚀	52191882	62938705	0.83
tpcds_q08/datafusion:vortex-file-compressed 🚀	37335355	44359826	0.84
tpcds_q09/datafusion:vortex-file-compressed 🚀	54862971	63598557	0.86
tpcds_q10/datafusion:vortex-file-compressed 🚀	45483392	53551955	0.85
tpcds_q11/datafusion:vortex-file-compressed 🚀	167306197	207286799	0.81
tpcds_q12/datafusion:vortex-file-compressed 🚀	21993038	28774520	0.76
tpcds_q13/datafusion:vortex-file-compressed 🚀	61570617	72395555	0.85
tpcds_q14/datafusion:vortex-file-compressed 🚀	200253191	237467261	0.84
tpcds_q15/datafusion:vortex-file-compressed 🚀	35777856	43053065	0.83
tpcds_q16/datafusion:vortex-file-compressed 🚀	28694190	34976809	0.82
tpcds_q17/datafusion:vortex-file-compressed 🚀	67720920	85254354	0.79
tpcds_q18/datafusion:vortex-file-compressed 🚀	78538272	98226421	0.80
tpcds_q19/datafusion:vortex-file-compressed 🚀	31542917	37744718	0.84
tpcds_q20/datafusion:vortex-file-compressed 🚀	25874090	30665635	0.84
tpcds_q21/datafusion:vortex-file-compressed 🚀	139300094	162352128	0.86
tpcds_q22/datafusion:vortex-file-compressed 🚀	62007910	70494599	0.88
tpcds_q23/datafusion:vortex-file-compressed 🚀	149579010	188709579	0.79
tpcds_q24/datafusion:vortex-file-compressed 🚀	111893503	138128744	0.81
tpcds_q25/datafusion:vortex-file-compressed 🚀	67078900	82178517	0.82
tpcds_q26/datafusion:vortex-file-compressed 🚀	35772848	44284870	0.81
tpcds_q27/datafusion:vortex-file-compressed 🚀	118114198	157907231	0.75
tpcds_q28/datafusion:vortex-file-compressed 🚀	50599047	58208566	0.87
tpcds_q29/datafusion:vortex-file-compressed 🚀	67597597	83960010	0.81
tpcds_q30/datafusion:vortex-file-compressed 🚀	30343203	37205643	0.82
tpcds_q31/datafusion:vortex-file-compressed 🚀	93211486	115007730	0.81
tpcds_q32/datafusion:vortex-file-compressed 🚀	21726313	25321886	0.86
tpcds_q33/datafusion:vortex-file-compressed 🚀	38217751	47256793	0.81
tpcds_q34/datafusion:vortex-file-compressed 🚀	33336252	39096878	0.85
tpcds_q35/datafusion:vortex-file-compressed 🚀	56032520	65019987	0.86
tpcds_q36/datafusion:vortex-file-compressed 🚀	75775094	97037294	0.78
tpcds_q37/datafusion:vortex-file-compressed 🚀	34406733	44691323	0.77
tpcds_q38/datafusion:vortex-file-compressed 🚀	52112676	63146142	0.83
tpcds_q39/datafusion:vortex-file-compressed 🚀	151036137	171517340	0.88
tpcds_q40/datafusion:vortex-file-compressed 🚀	52557425	61994100	0.85
tpcds_q41/datafusion:vortex-file-compressed 🚀	17965714	21697872	0.83
tpcds_q42/datafusion:vortex-file-compressed 🚀	18817840	23134892	0.81
tpcds_q43/datafusion:vortex-file-compressed 🚀	32327180	40655411	0.80
tpcds_q44/datafusion:vortex-file-compressed 🚀	44172815	51563701	0.86
tpcds_q45/datafusion:vortex-file-compressed 🚀	35132130	40745437	0.86
tpcds_q46/datafusion:vortex-file-compressed 🚀	47980361	59642614	0.80
tpcds_q47/datafusion:vortex-file-compressed 🚀	205782929	260761106	0.79
tpcds_q48/datafusion:vortex-file-compressed 🚀	47902128	55947356	0.86
tpcds_q49/datafusion:vortex-file-compressed 🚀	69827422	85415184	0.82
tpcds_q50/datafusion:vortex-file-compressed 🚀	45888583	56121308	0.82
tpcds_q51/datafusion:vortex-file-compressed 🚀	90546893	108261966	0.84
tpcds_q52/datafusion:vortex-file-compressed 🚀	17700786	23105314	0.77
tpcds_q53/datafusion:vortex-file-compressed 🚀	24784507	28833189	0.86
tpcds_q54/datafusion:vortex-file-compressed 🚀	44515752	52072065	0.85
tpcds_q55/datafusion:vortex-file-compressed 🚀	18400879	22212581	0.83
tpcds_q56/datafusion:vortex-file-compressed 🚀	40113623	48142765	0.83
tpcds_q57/datafusion:vortex-file-compressed 🚀	127345452	153968466	0.83
tpcds_q58/datafusion:vortex-file-compressed 🚀	70443056	85980123	0.82
tpcds_q59/datafusion:vortex-file-compressed 🚀	71876767	90905298	0.79
tpcds_q60/datafusion:vortex-file-compressed 🚀	40747956	49222017	0.83
tpcds_q61/datafusion:vortex-file-compressed 🚀	50871769	61516922	0.83
tpcds_q62/datafusion:vortex-file-compressed 🚀	31292209	38171134	0.82
tpcds_q63/datafusion:vortex-file-compressed 🚀	25818570	31282478	0.83
tpcds_q64/datafusion:vortex-file-compressed 🚀	472704968	580842127	0.81
tpcds_q65/datafusion:vortex-file-compressed 🚀	47679538	61301598	0.78
tpcds_q66/datafusion:vortex-file-compressed 🚀	89842137	107866422	0.83
tpcds_q67/datafusion:vortex-file-compressed 🚀	119786946	148767082	0.81
tpcds_q68/datafusion:vortex-file-compressed 🚀	46323511	58192680	0.80
tpcds_q69/datafusion:vortex-file-compressed 🚀	43060294	52135437	0.83
tpcds_q70/datafusion:vortex-file-compressed 🚀	111931467	134113626	0.83
tpcds_q71/datafusion:vortex-file-compressed 🚀	31153196	37297345	0.84
tpcds_q72/datafusion:vortex-file-compressed 🚀	2616979187	3506591778	0.75
tpcds_q73/datafusion:vortex-file-compressed 🚀	33999597	42125135	0.81
tpcds_q74/datafusion:vortex-file-compressed 🚀	113733417	141080085	0.81
tpcds_q75/datafusion:vortex-file-compressed 🚀	118366380	143429027	0.83
tpcds_q76/datafusion:vortex-file-compressed 🚀	36380534	41489060	0.88
tpcds_q77/datafusion:vortex-file-compressed 🚀	51336101	62703707	0.82
tpcds_q78/datafusion:vortex-file-compressed 🚀	124509407	161223343	0.77
tpcds_q79/datafusion:vortex-file-compressed 🚀	37558507	46558932	0.81
tpcds_q80/datafusion:vortex-file-compressed 🚀	113548311	146544278	0.77
tpcds_q81/datafusion:vortex-file-compressed 🚀	36956783	43887720	0.84
tpcds_q82/datafusion:vortex-file-compressed 🚀	35480003	45696633	0.78
tpcds_q83/datafusion:vortex-file-compressed 🚀	49297364	61144111	0.81
tpcds_q84/datafusion:vortex-file-compressed 🚀	15273760	18908410	0.81
tpcds_q85/datafusion:vortex-file-compressed 🚀	103235231	120830055	0.85
tpcds_q86/datafusion:vortex-file-compressed 🚀	19351005	22734421	0.85
tpcds_q87/datafusion:vortex-file-compressed 🚀	53680397	63795083	0.84
tpcds_q88/datafusion:vortex-file-compressed 🚀	77252149	90342162	0.86
tpcds_q89/datafusion:vortex-file-compressed 🚀	36426442	44451202	0.82
tpcds_q90/datafusion:vortex-file-compressed 🚀	18356897	21471797	0.85
tpcds_q91/datafusion:vortex-file-compressed 🚀	26366163	32085143	0.82
tpcds_q92/datafusion:vortex-file-compressed 🚀	19209097	22850131	0.84
tpcds_q93/datafusion:vortex-file-compressed 🚀	34448964	44804687	0.77
tpcds_q94/datafusion:vortex-file-compressed 🚀	25274586	28908567	0.87
tpcds_q95/datafusion:vortex-file-compressed 🚀	60180024	72213125	0.83
tpcds_q96/datafusion:vortex-file-compressed 🚀	16811770	20226629	0.83
tpcds_q97/datafusion:vortex-file-compressed 🚀	31669321	38615623	0.82
tpcds_q98/datafusion:vortex-file-compressed 🚀	31351359	41551622	0.75
tpcds_q99/datafusion:vortex-file-compressed 🚀	48427818	56759427	0.85

datafusion / vortex-compact (0.865x ✅, 72↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀	36747866	41515518	0.89
tpcds_q02/datafusion:vortex-compact 🚀	57707031	71263961	0.81
tpcds_q03/datafusion:vortex-compact 🚀	26487473	30970971	0.86
tpcds_q04/datafusion:vortex-compact 🚀	332624009	414816052	0.80
tpcds_q05/datafusion:vortex-compact	68246678	75518215	0.90
tpcds_q06/datafusion:vortex-compact 🚀	58534344	72659303	0.81
tpcds_q07/datafusion:vortex-compact 🚀	64167960	79447697	0.81
tpcds_q08/datafusion:vortex-compact 🚀	45039361	54030726	0.83
tpcds_q09/datafusion:vortex-compact 🚀	101266716	122834767	0.82
tpcds_q10/datafusion:vortex-compact 🚀	63240886	74479694	0.85
tpcds_q11/datafusion:vortex-compact 🚀	185106735	233758297	0.79
tpcds_q12/datafusion:vortex-compact 🚀	25511638	29919626	0.85
tpcds_q13/datafusion:vortex-compact	130937037	145056140	0.90
tpcds_q14/datafusion:vortex-compact 🚀	252472427	301046369	0.84
tpcds_q15/datafusion:vortex-compact 🚀	39246448	47197632	0.83
tpcds_q16/datafusion:vortex-compact 🚀	39824867	47789185	0.83
tpcds_q17/datafusion:vortex-compact 🚀	92619688	110428360	0.84
tpcds_q18/datafusion:vortex-compact 🚀	94552091	108945313	0.87
tpcds_q19/datafusion:vortex-compact 🚀	44048135	52284995	0.84
tpcds_q20/datafusion:vortex-compact 🚀	30518821	38408488	0.79
tpcds_q21/datafusion:vortex-compact 🚀	142590066	174250601	0.82
tpcds_q22/datafusion:vortex-compact 🚀	65361803	79301791	0.82
tpcds_q23/datafusion:vortex-compact 🚀	186212026	225579759	0.83
tpcds_q24/datafusion:vortex-compact 🚀	140972722	172045994	0.82
tpcds_q25/datafusion:vortex-compact 🚀	95148611	113721967	0.84
tpcds_q26/datafusion:vortex-compact 🚀	47616099	58321729	0.82
tpcds_q27/datafusion:vortex-compact 🚀	157142079	198148578	0.79
tpcds_q28/datafusion:vortex-compact 🚀	100877233	115169515	0.88
tpcds_q29/datafusion:vortex-compact 🚀	94231207	114750441	0.82
tpcds_q30/datafusion:vortex-compact 🚀	37245961	41388172	0.90
tpcds_q31/datafusion:vortex-compact 🚀	125658010	148596597	0.85
tpcds_q32/datafusion:vortex-compact 🚀	26939076	31224577	0.86
tpcds_q33/datafusion:vortex-compact 🚀	52971746	59852169	0.89
tpcds_q34/datafusion:vortex-compact 🚀	49158911	58960356	0.83
tpcds_q35/datafusion:vortex-compact 🚀	68576612	81512538	0.84
tpcds_q36/datafusion:vortex-compact 🚀	101874614	119011196	0.86
tpcds_q37/datafusion:vortex-compact 🚀	48082902	58917105	0.82
tpcds_q38/datafusion:vortex-compact 🚀	65597009	78760141	0.83
tpcds_q39/datafusion:vortex-compact 🚀	147160391	188329037	0.78
tpcds_q40/datafusion:vortex-compact 🚀	56581174	71661109	0.79
tpcds_q41/datafusion:vortex-compact 🚀	20099225	24611902	0.82
tpcds_q42/datafusion:vortex-compact 🚀	25728315	29795381	0.86
tpcds_q43/datafusion:vortex-compact 🚀	40384259	46697027	0.86
tpcds_q44/datafusion:vortex-compact 🚀	74514743	85372013	0.87
tpcds_q45/datafusion:vortex-compact 🚀	37588313	45555658	0.83
tpcds_q46/datafusion:vortex-compact 🚀	70417092	82284452	0.86
tpcds_q47/datafusion:vortex-compact 🚀	230209934	288218030	0.80
tpcds_q48/datafusion:vortex-compact	100846731	108331712	0.93
tpcds_q49/datafusion:vortex-compact 🚀	95865348	113693690	0.84
tpcds_q50/datafusion:vortex-compact 🚀	63560824	75423649	0.84
tpcds_q51/datafusion:vortex-compact 🚀	97357733	116378906	0.84
tpcds_q52/datafusion:vortex-compact 🚀	24741728	29190708	0.85
tpcds_q53/datafusion:vortex-compact 🚀	35384011	42386659	0.83
tpcds_q54/datafusion:vortex-compact 🚀	58176205	67038153	0.87
tpcds_q55/datafusion:vortex-compact 🚀	23851142	29449797	0.81
tpcds_q56/datafusion:vortex-compact 🚀	54334416	63347046	0.86
tpcds_q57/datafusion:vortex-compact 🚀	140251871	167929507	0.84
tpcds_q58/datafusion:vortex-compact 🚀	78466248	94699518	0.83
tpcds_q59/datafusion:vortex-compact 🚀	86403762	107696499	0.80
tpcds_q60/datafusion:vortex-compact 🚀	56135383	64914405	0.86
tpcds_q61/datafusion:vortex-compact 🚀	72607868	86251464	0.84
tpcds_q62/datafusion:vortex-compact 🚀	32947132	39522094	0.83
tpcds_q63/datafusion:vortex-compact 🚀	35044625	42525686	0.82
tpcds_q64/datafusion:vortex-compact 🚀	546532233	644276282	0.85
tpcds_q65/datafusion:vortex-compact 🚀	69701697	80144000	0.87
tpcds_q66/datafusion:vortex-compact 🚀	97723197	113457078	0.86
tpcds_q67/datafusion:vortex-compact 🚀	128819223	152246726	0.85
tpcds_q68/datafusion:vortex-compact 🚀	70820328	80809415	0.88
tpcds_q69/datafusion:vortex-compact 🚀	60047822	68502290	0.88
tpcds_q70/datafusion:vortex-compact 🚀	127817422	144989038	0.88
tpcds_q71/datafusion:vortex-compact 🚀	48296513	54066946	0.89
tpcds_q72/datafusion:vortex-compact 🚀	2615094556	3271764985	0.80
tpcds_q73/datafusion:vortex-compact 🚀	49473149	56220116	0.88
tpcds_q74/datafusion:vortex-compact	132213164	143914931	0.92
tpcds_q75/datafusion:vortex-compact	165224241	176549963	0.94
tpcds_q76/datafusion:vortex-compact	51450504	55781193	0.92
tpcds_q77/datafusion:vortex-compact	67860304	72888606	0.93
tpcds_q78/datafusion:vortex-compact 🚀	146140047	165662451	0.88
tpcds_q79/datafusion:vortex-compact	59906307	63994041	0.94
tpcds_q80/datafusion:vortex-compact	131079539	140583633	0.93
tpcds_q81/datafusion:vortex-compact	42744272	45766226	0.93
tpcds_q82/datafusion:vortex-compact	48250169	51635982	0.93
tpcds_q83/datafusion:vortex-compact	59104590	64986938	0.91
tpcds_q84/datafusion:vortex-compact 🚀	17699849	20499830	0.86
tpcds_q85/datafusion:vortex-compact	123842662	135425320	0.91
tpcds_q86/datafusion:vortex-compact	20292755	21357781	0.95
tpcds_q87/datafusion:vortex-compact	64850761	70464919	0.92
tpcds_q88/datafusion:vortex-compact	139155929	142559756	0.98
tpcds_q89/datafusion:vortex-compact	45651117	48001294	0.95
tpcds_q90/datafusion:vortex-compact	23946732	25592287	0.94
tpcds_q91/datafusion:vortex-compact	42077081	42609372	0.99
tpcds_q92/datafusion:vortex-compact	21047500	22620376	0.93
tpcds_q93/datafusion:vortex-compact	47770503	52172676	0.92
tpcds_q94/datafusion:vortex-compact	31443128	34500913	0.91
tpcds_q95/datafusion:vortex-compact	71860389	76380824	0.94
tpcds_q96/datafusion:vortex-compact	26455653	27354346	0.97
tpcds_q97/datafusion:vortex-compact	40783919	43000627	0.95
tpcds_q98/datafusion:vortex-compact	38054933	39534672	0.96
tpcds_q99/datafusion:vortex-compact	49764954	52424561	0.95

datafusion / parquet (0.913x ➖, 29↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet	37498696	39217385	0.96
tpcds_q02/datafusion:parquet	47445044	49798602	0.95
tpcds_q03/datafusion:parquet	15702420	16601468	0.95
tpcds_q04/datafusion:parquet	327953352	361378000	0.91
tpcds_q05/datafusion:parquet 🚀	51619065	59384356	0.87
tpcds_q06/datafusion:parquet	66581467	66590388	1.00
tpcds_q07/datafusion:parquet	97065599	101865617	0.95
tpcds_q08/datafusion:parquet	33640040	35146496	0.96
tpcds_q09/datafusion:parquet	60513039	61739083	0.98
tpcds_q10/datafusion:parquet	87733934	89552780	0.98
tpcds_q11/datafusion:parquet 🚀	180756110	208539425	0.87
tpcds_q12/datafusion:parquet	24290142	25772164	0.94
tpcds_q13/datafusion:parquet	88160865	94128630	0.94
tpcds_q14/datafusion:parquet 🚀	195804549	222423637	0.88
tpcds_q15/datafusion:parquet 🚀	26004233	30692405	0.85
tpcds_q16/datafusion:parquet 🚀	28694463	32948345	0.87
tpcds_q17/datafusion:parquet	71754803	79226990	0.91
tpcds_q18/datafusion:parquet	133554800	143554323	0.93
tpcds_q19/datafusion:parquet 🚀	27886961	31647374	0.88
tpcds_q20/datafusion:parquet 🚀	21691968	24909395	0.87
tpcds_q21/datafusion:parquet	23502756	24725680	0.95
tpcds_q22/datafusion:parquet 🚀	151478696	178481926	0.85
tpcds_q23/datafusion:parquet 🚀	168129453	190331356	0.88
tpcds_q24/datafusion:parquet	108432780	119298361	0.91
tpcds_q25/datafusion:parquet	73738325	78246061	0.94
tpcds_q26/datafusion:parquet	77129792	84959467	0.91
tpcds_q27/datafusion:parquet 🚀	165337529	186030438	0.89
tpcds_q28/datafusion:parquet	51232345	55262391	0.93
tpcds_q29/datafusion:parquet	75630149	81656940	0.93
tpcds_q30/datafusion:parquet	44880579	47381945	0.95
tpcds_q31/datafusion:parquet	77643048	83006034	0.94
tpcds_q32/datafusion:parquet	23235087	25284078	0.92
tpcds_q33/datafusion:parquet	36304577	38414226	0.95
tpcds_q34/datafusion:parquet	27289550	30004010	0.91
tpcds_q35/datafusion:parquet	87869545	96899104	0.91
tpcds_q36/datafusion:parquet 🚀	63859543	73981336	0.86
tpcds_q37/datafusion:parquet	24048255	26349699	0.91
tpcds_q38/datafusion:parquet	51295599	56400586	0.91
tpcds_q39/datafusion:parquet 🚀	84545222	96363359	0.88
tpcds_q40/datafusion:parquet	27975279	29876930	0.94
tpcds_q41/datafusion:parquet 🚀	16649313	18748363	0.89
tpcds_q42/datafusion:parquet	13854602	15242512	0.91
tpcds_q43/datafusion:parquet	19744891	21063538	0.94
tpcds_q44/datafusion:parquet	42499676	44990075	0.94
tpcds_q45/datafusion:parquet	34582075	36553948	0.95
tpcds_q46/datafusion:parquet	39746327	43027561	0.92
tpcds_q47/datafusion:parquet	138147909	152662954	0.90
tpcds_q48/datafusion:parquet	80793208	86512767	0.93
tpcds_q49/datafusion:parquet	66663411	73123532	0.91
tpcds_q50/datafusion:parquet 🚀	49040712	54600745	0.90
tpcds_q51/datafusion:parquet	91159252	100315731	0.91
tpcds_q52/datafusion:parquet	15345546	16351863	0.94
tpcds_q53/datafusion:parquet	22320629	23209830	0.96
tpcds_q54/datafusion:parquet	42962727	45342096	0.95
tpcds_q55/datafusion:parquet 🚀	13986783	16379219	0.85
tpcds_q56/datafusion:parquet	36090865	39244012	0.92
tpcds_q57/datafusion:parquet 🚀	110806661	124968824	0.89
tpcds_q58/datafusion:parquet	60685863	64067336	0.95
tpcds_q59/datafusion:parquet	59908856	64204172	0.93
tpcds_q60/datafusion:parquet	37085554	38632394	0.96
tpcds_q61/datafusion:parquet	52334800	57323048	0.91
tpcds_q62/datafusion:parquet 🚀	23925657	31118859	0.77
tpcds_q63/datafusion:parquet	22526502	24183826	0.93
tpcds_q64/datafusion:parquet	559831699	611399047	0.92
tpcds_q65/datafusion:parquet	46447936	49442818	0.94
tpcds_q66/datafusion:parquet	79154517	85636767	0.92
tpcds_q67/datafusion:parquet 🚀	157276143	181126103	0.87
tpcds_q68/datafusion:parquet	41087352	43809898	0.94
tpcds_q69/datafusion:parquet	82229251	86175037	0.95
tpcds_q70/datafusion:parquet	97221945	102425304	0.95
tpcds_q71/datafusion:parquet	27237255	29322212	0.93
tpcds_q72/datafusion:parquet 🚀	641826695	769613927	0.83
tpcds_q73/datafusion:parquet	27819937	30403054	0.92
tpcds_q74/datafusion:parquet	107615988	116380101	0.92
tpcds_q75/datafusion:parquet	116649657	129221240	0.90
tpcds_q76/datafusion:parquet	37178813	39243908	0.95
tpcds_q77/datafusion:parquet	50176055	53663975	0.94
tpcds_q78/datafusion:parquet 🚀	125784989	144073382	0.87
tpcds_q79/datafusion:parquet	32237937	33855454	0.95
tpcds_q80/datafusion:parquet 🚀	96642769	109208906	0.88
tpcds_q81/datafusion:parquet	41223904	44362947	0.93
tpcds_q82/datafusion:parquet	24894429	25250140	0.99
tpcds_q83/datafusion:parquet	48467017	53572482	0.90
tpcds_q84/datafusion:parquet	48057072	51567198	0.93
tpcds_q85/datafusion:parquet	175060679	185668710	0.94
tpcds_q86/datafusion:parquet	19106059	18931767	1.01
tpcds_q87/datafusion:parquet	51825401	57065162	0.91
tpcds_q88/datafusion:parquet	71331471	76177473	0.94
tpcds_q89/datafusion:parquet	24519406	26135570	0.94
tpcds_q90/datafusion:parquet	19072764	20593492	0.93
tpcds_q91/datafusion:parquet 🚀	72283210	82673649	0.87
tpcds_q92/datafusion:parquet 🚀	21708601	25110373	0.86
tpcds_q93/datafusion:parquet 🚀	34410245	42797811	0.80
tpcds_q94/datafusion:parquet 🚀	25718607	30380746	0.85
tpcds_q95/datafusion:parquet 🚀	69725079	79489536	0.88
tpcds_q96/datafusion:parquet	14207375	14706118	0.97
tpcds_q97/datafusion:parquet 🚀	33631046	43390482	0.78
tpcds_q98/datafusion:parquet 🚀	25505533	29071377	0.88
tpcds_q99/datafusion:parquet 🚀	29386336	34539527	0.85

duckdb / vortex-file-compressed (0.877x ✅, 71↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed	24890281	26019115	0.96
tpcds_q02/duckdb:vortex-file-compressed	84776242	88895394	0.95
tpcds_q03/duckdb:vortex-file-compressed	22807770	24658861	0.92
tpcds_q04/duckdb:vortex-file-compressed	106849345	118144298	0.90
tpcds_q05/duckdb:vortex-file-compressed 🚀	98564434	114765482	0.86
tpcds_q06/duckdb:vortex-file-compressed 🚀	36750096	42678405	0.86
tpcds_q07/duckdb:vortex-file-compressed 🚀	23414457	26639911	0.88
tpcds_q08/duckdb:vortex-file-compressed 🚀	22766567	25632703	0.89
tpcds_q09/duckdb:vortex-file-compressed 🚀	39533675	44860810	0.88
tpcds_q10/duckdb:vortex-file-compressed	37459331	41402333	0.90
tpcds_q11/duckdb:vortex-file-compressed 🚀	60729479	72421313	0.84
tpcds_q12/duckdb:vortex-file-compressed	14859519	16339451	0.91
tpcds_q13/duckdb:vortex-file-compressed 🚀	33483437	38844443	0.86
tpcds_q14/duckdb:vortex-file-compressed 🚀	197036103	226578036	0.87
tpcds_q15/duckdb:vortex-file-compressed 🚀	39642165	45681026	0.87
tpcds_q16/duckdb:vortex-file-compressed	30116214	32207058	0.94
tpcds_q17/duckdb:vortex-file-compressed 🚀	38379905	44545273	0.86
tpcds_q18/duckdb:vortex-file-compressed 🚀	45945451	51579814	0.89
tpcds_q19/duckdb:vortex-file-compressed 🚀	33526658	38610555	0.87
tpcds_q20/duckdb:vortex-file-compressed	17078726	18263577	0.94
tpcds_q21/duckdb:vortex-file-compressed 🚀	21163978	24334898	0.87
tpcds_q22/duckdb:vortex-file-compressed 🚀	107834382	123024100	0.88
tpcds_q23/duckdb:vortex-file-compressed 🚀	124848246	146442059	0.85
tpcds_q24/duckdb:vortex-file-compressed	57096691	62458127	0.91
tpcds_q25/duckdb:vortex-file-compressed 🚀	37431889	42500656	0.88
tpcds_q26/duckdb:vortex-file-compressed	40166180	43358892	0.93
tpcds_q27/duckdb:vortex-file-compressed 🚀	88296002	103111255	0.86
tpcds_q28/duckdb:vortex-file-compressed 🚀	37557724	43746437	0.86
tpcds_q29/duckdb:vortex-file-compressed 🚀	36279518	44065235	0.82
tpcds_q30/duckdb:vortex-file-compressed 🚀	28558429	33731069	0.85
tpcds_q31/duckdb:vortex-file-compressed 🚀	24079838	30348888	0.79
tpcds_q32/duckdb:vortex-file-compressed 🚀	16768385	19017294	0.88
tpcds_q33/duckdb:vortex-file-compressed 🚀	66818738	81848032	0.82
tpcds_q34/duckdb:vortex-file-compressed 🚀	19622378	23240514	0.84
tpcds_q35/duckdb:vortex-file-compressed 🚀	62668171	75293705	0.83
tpcds_q36/duckdb:vortex-file-compressed 🚀	27358292	30886774	0.89
tpcds_q37/duckdb:vortex-file-compressed 🚀	22492426	25439792	0.88
tpcds_q38/duckdb:vortex-file-compressed	37093134	40155516	0.92
tpcds_q39/duckdb:vortex-file-compressed 🚀	45802636	52095892	0.88
tpcds_q40/duckdb:vortex-file-compressed 🚀	23665450	27695350	0.85
tpcds_q41/duckdb:vortex-file-compressed 🚀	13282093	15125008	0.88
tpcds_q42/duckdb:vortex-file-compressed 🚀	11419986	13523832	0.84
tpcds_q43/duckdb:vortex-file-compressed	20312294	21614067	0.94
tpcds_q44/duckdb:vortex-file-compressed 🚀	23942464	26925857	0.89
tpcds_q45/duckdb:vortex-file-compressed 🚀	26768471	32225393	0.83
tpcds_q46/duckdb:vortex-file-compressed 🚀	48601367	55456488	0.88
tpcds_q47/duckdb:vortex-file-compressed 🚀	48794480	57516919	0.85
tpcds_q48/duckdb:vortex-file-compressed 🚀	30653648	35103095	0.87
tpcds_q49/duckdb:vortex-file-compressed 🚀	29522861	36384262	0.81
tpcds_q50/duckdb:vortex-file-compressed 🚀	36319758	40861753	0.89
tpcds_q51/duckdb:vortex-file-compressed	99135038	109813046	0.90
tpcds_q52/duckdb:vortex-file-compressed 🚀	12104617	14258060	0.85
tpcds_q53/duckdb:vortex-file-compressed	17196868	18754185	0.92
tpcds_q54/duckdb:vortex-file-compressed 🚀	49406022	57673066	0.86
tpcds_q55/duckdb:vortex-file-compressed	12221456	13569301	0.90
tpcds_q56/duckdb:vortex-file-compressed 🚀	66319978	78156582	0.85
tpcds_q57/duckdb:vortex-file-compressed 🚀	44396311	51982646	0.85
tpcds_q58/duckdb:vortex-file-compressed 🚀	33508245	40867436	0.82
tpcds_q59/duckdb:vortex-file-compressed	55434145	59438162	0.93
tpcds_q60/duckdb:vortex-file-compressed 🚀	68794523	81161513	0.85
tpcds_q61/duckdb:vortex-file-compressed	40289056	43965467	0.92
tpcds_q62/duckdb:vortex-file-compressed 🚀	17566702	21058278	0.83
tpcds_q63/duckdb:vortex-file-compressed 🚀	17434916	19734000	0.88
tpcds_q64/duckdb:vortex-file-compressed 🚀	79903726	91699051	0.87
tpcds_q65/duckdb:vortex-file-compressed 🚀	22948921	26053541	0.88
tpcds_q66/duckdb:vortex-file-compressed 🚀	60759319	71192543	0.85
tpcds_q67/duckdb:vortex-file-compressed 🚀	147652205	167662496	0.88
tpcds_q68/duckdb:vortex-file-compressed 🚀	40744629	46704599	0.87
tpcds_q69/duckdb:vortex-file-compressed 🚀	38102890	42790044	0.89
tpcds_q70/duckdb:vortex-file-compressed	25593570	27668732	0.92
tpcds_q71/duckdb:vortex-file-compressed 🚀	20880213	23248665	0.90
tpcds_q72/duckdb:vortex-file-compressed	177931149	188523913	0.94
tpcds_q73/duckdb:vortex-file-compressed 🚀	19716013	22763073	0.87
tpcds_q74/duckdb:vortex-file-compressed 🚀	49281325	56332111	0.87
tpcds_q75/duckdb:vortex-file-compressed 🚀	61559223	69478217	0.89
tpcds_q76/duckdb:vortex-file-compressed	71337919	75310991	0.95
tpcds_q77/duckdb:vortex-file-compressed	70525186	77337208	0.91
tpcds_q78/duckdb:vortex-file-compressed 🚀	74311484	87724175	0.85
tpcds_q79/duckdb:vortex-file-compressed	35456138	39141275	0.91
tpcds_q80/duckdb:vortex-file-compressed 🚀	94655097	110683806	0.86
tpcds_q81/duckdb:vortex-file-compressed 🚀	34298835	40175152	0.85
tpcds_q82/duckdb:vortex-file-compressed 🚀	21757795	26975463	0.81
tpcds_q83/duckdb:vortex-file-compressed 🚀	27282758	31376252	0.87
tpcds_q84/duckdb:vortex-file-compressed	17228979	18886776	0.91
tpcds_q85/duckdb:vortex-file-compressed 🚀	44600244	51759588	0.86
tpcds_q86/duckdb:vortex-file-compressed 🚀	16901134	18905944	0.89
tpcds_q87/duckdb:vortex-file-compressed	41793293	46375075	0.90
tpcds_q88/duckdb:vortex-file-compressed	35579386	39317315	0.90
tpcds_q89/duckdb:vortex-file-compressed 🚀	17803274	20101708	0.89
tpcds_q90/duckdb:vortex-file-compressed 🚀	15378304	17326959	0.89
tpcds_q91/duckdb:vortex-file-compressed 🚀	27883473	31419670	0.89
tpcds_q92/duckdb:vortex-file-compressed 🚀	13929951	16985713	0.82
tpcds_q93/duckdb:vortex-file-compressed 🚀	30620132	34391490	0.89
tpcds_q94/duckdb:vortex-file-compressed 🚀	20988584	26582943	0.79
tpcds_q95/duckdb:vortex-file-compressed	161067065	169501579	0.95
tpcds_q96/duckdb:vortex-file-compressed 🚀	11489796	14024994	0.82
tpcds_q97/duckdb:vortex-file-compressed	38861002	42059490	0.92
tpcds_q98/duckdb:vortex-file-compressed 🚀	17674555	21304375	0.83
tpcds_q99/duckdb:vortex-file-compressed	32725765	34640849	0.94

duckdb / vortex-compact (0.911x ➖, 37↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-compact	33937513	37529833	0.90
tpcds_q02/duckdb:vortex-compact	124610954	130279686	0.96
tpcds_q03/duckdb:vortex-compact	49377021	54008958	0.91
tpcds_q04/duckdb:vortex-compact 🚀	121314478	137940303	0.88
tpcds_q05/duckdb:vortex-compact	155753384	170251418	0.91
tpcds_q06/duckdb:vortex-compact	38014689	41937074	0.91
tpcds_q07/duckdb:vortex-compact	36534333	39435816	0.93
tpcds_q08/duckdb:vortex-compact	29605349	32366112	0.91
tpcds_q09/duckdb:vortex-compact 🚀	110080760	122914389	0.90
tpcds_q10/duckdb:vortex-compact 🚀	45688439	50942771	0.90
tpcds_q11/duckdb:vortex-compact 🚀	75390009	87119148	0.87
tpcds_q12/duckdb:vortex-compact 🚀	19550582	24007560	0.81
tpcds_q13/duckdb:vortex-compact	49351141	52298239	0.94
tpcds_q14/duckdb:vortex-compact	277124025	294393783	0.94
tpcds_q15/duckdb:vortex-compact	46040103	50382080	0.91
tpcds_q16/duckdb:vortex-compact	36633306	40108333	0.91
tpcds_q17/duckdb:vortex-compact 🚀	49093016	54704487	0.90
tpcds_q18/duckdb:vortex-compact	66543056	72971678	0.91
tpcds_q19/duckdb:vortex-compact	38990038	41868326	0.93
tpcds_q20/duckdb:vortex-compact	21508478	23441397	0.92
tpcds_q21/duckdb:vortex-compact 🚀	27860776	31141378	0.89
tpcds_q22/duckdb:vortex-compact	121282991	133360821	0.91
tpcds_q23/duckdb:vortex-compact	164551925	176990859	0.93
tpcds_q24/duckdb:vortex-compact	70539487	76479617	0.92
tpcds_q25/duckdb:vortex-compact	49273320	54106436	0.91
tpcds_q26/duckdb:vortex-compact 🚀	47299638	56225592	0.84
tpcds_q27/duckdb:vortex-compact	132244111	143769140	0.92
tpcds_q28/duckdb:vortex-compact	107861990	113613865	0.95
tpcds_q29/duckdb:vortex-compact	49362765	54749247	0.90
tpcds_q30/duckdb:vortex-compact 🚀	34708496	39167196	0.89
tpcds_q31/duckdb:vortex-compact	29406678	32461971	0.91
tpcds_q32/duckdb:vortex-compact	23366261	25640956	0.91
tpcds_q33/duckdb:vortex-compact	136628087	142848212	0.96
tpcds_q34/duckdb:vortex-compact 🚀	23747399	27017485	0.88
tpcds_q35/duckdb:vortex-compact	68667966	76091092	0.90
tpcds_q36/duckdb:vortex-compact	34940407	37539714	0.93
tpcds_q37/duckdb:vortex-compact 🚀	30859951	34857502	0.89
tpcds_q38/duckdb:vortex-compact 🚀	38591503	43940516	0.88
tpcds_q39/duckdb:vortex-compact	53099891	58011364	0.92
tpcds_q40/duckdb:vortex-compact 🚀	29772766	34609731	0.86
tpcds_q41/duckdb:vortex-compact 🚀	16369599	18979775	0.86
tpcds_q42/duckdb:vortex-compact	14946390	16555276	0.90
tpcds_q43/duckdb:vortex-compact	24530893	25525581	0.96
tpcds_q44/duckdb:vortex-compact	31992822	34369250	0.93
tpcds_q45/duckdb:vortex-compact 🚀	32025082	37865489	0.85
tpcds_q46/duckdb:vortex-compact	56850665	62799946	0.91
tpcds_q47/duckdb:vortex-compact	56411379	60009196	0.94
tpcds_q48/duckdb:vortex-compact	40981426	44304477	0.92
tpcds_q49/duckdb:vortex-compact	48344615	51083755	0.95
tpcds_q50/duckdb:vortex-compact	43116358	46987234	0.92
tpcds_q51/duckdb:vortex-compact	105598816	110795536	0.95
tpcds_q52/duckdb:vortex-compact	16099925	16567848	0.97
tpcds_q53/duckdb:vortex-compact 🚀	21827652	24389508	0.89
tpcds_q54/duckdb:vortex-compact	87849089	93134064	0.94
tpcds_q55/duckdb:vortex-compact 🚀	14617412	16647546	0.88
tpcds_q56/duckdb:vortex-compact	137577798	146484811	0.94
tpcds_q57/duckdb:vortex-compact	47978856	51687639	0.93
tpcds_q58/duckdb:vortex-compact 🚀	43288849	52695285	0.82
tpcds_q59/duckdb:vortex-compact	67386103	71859011	0.94
tpcds_q60/duckdb:vortex-compact	139720116	145232577	0.96
tpcds_q61/duckdb:vortex-compact	49807562	50815930	0.98
tpcds_q62/duckdb:vortex-compact	22346208	23868983	0.94
tpcds_q63/duckdb:vortex-compact 🚀	22415185	25375573	0.88
tpcds_q64/duckdb:vortex-compact 🚀	99223660	111993003	0.89
tpcds_q65/duckdb:vortex-compact 🚀	28027879	31500127	0.89
tpcds_q66/duckdb:vortex-compact	99628058	100744989	0.99
tpcds_q67/duckdb:vortex-compact 🚀	152723282	173074601	0.88
tpcds_q68/duckdb:vortex-compact	52729550	55604600	0.95
tpcds_q69/duckdb:vortex-compact 🚀	45680731	51078364	0.89
tpcds_q70/duckdb:vortex-compact	28067157	30848283	0.91
tpcds_q71/duckdb:vortex-compact	24684978	26544452	0.93
tpcds_q72/duckdb:vortex-compact	197807488	211789136	0.93
tpcds_q73/duckdb:vortex-compact 🚀	23322803	25916132	0.90
tpcds_q74/duckdb:vortex-compact 🚀	54660486	61013753	0.90
tpcds_q75/duckdb:vortex-compact	77479313	78736125	0.98
tpcds_q76/duckdb:vortex-compact 🚀	116046732	137373913	0.84
tpcds_q77/duckdb:vortex-compact	130484023	140758962	0.93
tpcds_q78/duckdb:vortex-compact 🚀	85682056	97027904	0.88
tpcds_q79/duckdb:vortex-compact	54781497	59449958	0.92
tpcds_q80/duckdb:vortex-compact	162931097	167507127	0.97
tpcds_q81/duckdb:vortex-compact	43141260	43295048	1.00
tpcds_q82/duckdb:vortex-compact	32032054	34440877	0.93
tpcds_q83/duckdb:vortex-compact 🚀	44434473	52713573	0.84
tpcds_q84/duckdb:vortex-compact 🚀	20783711	23774273	0.87
tpcds_q85/duckdb:vortex-compact	64684627	66883950	0.97
tpcds_q86/duckdb:vortex-compact 🚀	19523445	22286126	0.88
tpcds_q87/duckdb:vortex-compact	42539893	45897444	0.93
tpcds_q88/duckdb:vortex-compact	38121888	40185793	0.95
tpcds_q89/duckdb:vortex-compact 🚀	23545693	26202634	0.90
tpcds_q90/duckdb:vortex-compact	16094022	16925667	0.95
tpcds_q91/duckdb:vortex-compact 🚀	44027425	50629564	0.87
tpcds_q92/duckdb:vortex-compact 🚀	19682752	23364109	0.84
tpcds_q93/duckdb:vortex-compact 🚀	36157080	41179317	0.88
tpcds_q94/duckdb:vortex-compact 🚀	27114966	32652907	0.83
tpcds_q95/duckdb:vortex-compact	148461072	152730284	0.97
tpcds_q96/duckdb:vortex-compact 🚀	13681988	15305711	0.89
tpcds_q97/duckdb:vortex-compact	41183778	43543137	0.95
tpcds_q98/duckdb:vortex-compact	23496213	25398258	0.93
tpcds_q99/duckdb:vortex-compact 🚀	36547741	41049883	0.89

duckdb / parquet (0.992x ➖, 2↑ 1↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet	43068197	43433681	0.99
tpcds_q02/duckdb:parquet	57827949	59471883	0.97
tpcds_q03/duckdb:parquet	11879276	12063475	0.98
tpcds_q04/duckdb:parquet	125314213	126805229	0.99
tpcds_q05/duckdb:parquet	71155241	77497321	0.92
tpcds_q06/duckdb:parquet	28775977	28954066	0.99
tpcds_q07/duckdb:parquet	23454244	24184028	0.97
tpcds_q08/duckdb:parquet	28773950	29310845	0.98
tpcds_q09/duckdb:parquet	39691093	40034589	0.99
tpcds_q10/duckdb:parquet	35290155	35879710	0.98
tpcds_q11/duckdb:parquet	88106442	92386085	0.95
tpcds_q12/duckdb:parquet	14227811	14886444	0.96
tpcds_q13/duckdb:parquet	34766343	34345284	1.01
tpcds_q14/duckdb:parquet	162337519	164881165	0.98
tpcds_q15/duckdb:parquet	29518513	30123866	0.98
tpcds_q16/duckdb:parquet	21140781	23115730	0.91
tpcds_q17/duckdb:parquet	37832897	37783481	1.00
tpcds_q18/duckdb:parquet	45820923	45533385	1.01
tpcds_q19/duckdb:parquet	29997534	28824802	1.04
tpcds_q20/duckdb:parquet	15292201	15808170	0.97
tpcds_q21/duckdb:parquet	10698650	11652142	0.92
tpcds_q22/duckdb:parquet	67619211	67062897	1.01
tpcds_q23/duckdb:parquet	115061587	111832445	1.03
tpcds_q24/duckdb:parquet	44783749	44942170	1.00
tpcds_q25/duckdb:parquet	32823412	32669592	1.00
tpcds_q26/duckdb:parquet	36486340	37176576	0.98
tpcds_q27/duckdb:parquet	88118513	89173746	0.99
tpcds_q28/duckdb:parquet	37212992	36482562	1.02
tpcds_q29/duckdb:parquet	34454568	35833114	0.96
tpcds_q30/duckdb:parquet	40096187	40874877	0.98
tpcds_q31/duckdb:parquet	23317152	22191417	1.05
tpcds_q32/duckdb:parquet	11288877	11987607	0.94
tpcds_q33/duckdb:parquet	71791541	71852380	1.00
tpcds_q34/duckdb:parquet	20917019	20897396	1.00
tpcds_q35/duckdb:parquet	56755185	58321197	0.97
tpcds_q36/duckdb:parquet	20479320	20742003	0.99
tpcds_q37/duckdb:parquet	13306085	13533235	0.98
tpcds_q38/duckdb:parquet	32151076	34902268	0.92
tpcds_q39/duckdb:parquet	31600006	33462325	0.94
tpcds_q40/duckdb:parquet	18391212	16985065	1.08
tpcds_q41/duckdb:parquet	7388228	7386474	1.00
tpcds_q42/duckdb:parquet	9808634	10286361	0.95
tpcds_q43/duckdb:parquet	15829800	15289122	1.04
tpcds_q44/duckdb:parquet	20757856	21434922	0.97
tpcds_q45/duckdb:parquet	25825160	27245282	0.95
tpcds_q46/duckdb:parquet	45254946	46267793	0.98
tpcds_q47/duckdb:parquet	46229904	46995654	0.98
tpcds_q48/duckdb:parquet	30526772	30730282	0.99
tpcds_q49/duckdb:parquet	23378125	23982013	0.97
tpcds_q50/duckdb:parquet	24505612	24359534	1.01
tpcds_q51/duckdb:parquet	93731058	95400081	0.98
tpcds_q52/duckdb:parquet	11064386	11102021	1.00
tpcds_q53/duckdb:parquet	16178499	16092501	1.01
tpcds_q54/duckdb:parquet	40917735	38454438	1.06
tpcds_q55/duckdb:parquet	10854598	10573503	1.03
tpcds_q56/duckdb:parquet	67526497	70068416	0.96
tpcds_q57/duckdb:parquet	34822439	35066862	0.99
tpcds_q58/duckdb:parquet	21334384	20829212	1.02
tpcds_q59/duckdb:parquet	36803401	36608519	1.01
tpcds_q60/duckdb:parquet	74041751	69159461	1.07
tpcds_q61/duckdb:parquet	30583763	30582332	1.00
tpcds_q62/duckdb:parquet	11561767	11940823	0.97
tpcds_q63/duckdb:parquet	15611295	14944954	1.04
tpcds_q64/duckdb:parquet	73233775	72830792	1.01
tpcds_q65/duckdb:parquet	20501447	21814452	0.94
tpcds_q66/duckdb:parquet	55832605	56238054	0.99
tpcds_q67/duckdb:parquet	137077173	135081127	1.01
tpcds_q68/duckdb:parquet	37603861	37961988	0.99
tpcds_q69/duckdb:parquet	37281307	38350278	0.97
tpcds_q70/duckdb:parquet	19864665	19232778	1.03
tpcds_q71/duckdb:parquet	19947210	18400056	1.08
tpcds_q72/duckdb:parquet	164358453	165178966	1.00
tpcds_q73/duckdb:parquet	17955484	18042938	1.00
tpcds_q74/duckdb:parquet	52234517	49903899	1.05
tpcds_q75/duckdb:parquet	52562053	52583521	1.00
tpcds_q76/duckdb:parquet	68946213	69925601	0.99
tpcds_q77/duckdb:parquet	64991934	63035524	1.03
tpcds_q78/duckdb:parquet	74791472	75685221	0.99
tpcds_q79/duckdb:parquet	27391522	27744143	0.99
tpcds_q80/duckdb:parquet	85151769	83832754	1.02
tpcds_q81/duckdb:parquet	46285413	47503411	0.97
tpcds_q82/duckdb:parquet	15097431	15668672	0.96
tpcds_q83/duckdb:parquet	16925641	16361280	1.03
tpcds_q84/duckdb:parquet	19174756	19707960	0.97
tpcds_q85/duckdb:parquet	39492772	39556549	1.00
tpcds_q86/duckdb:parquet	12540211	11938164	1.05
tpcds_q87/duckdb:parquet	37494412	35357350	1.06
tpcds_q88/duckdb:parquet	28745078	29112895	0.99
tpcds_q89/duckdb:parquet	17331034	17176229	1.01
tpcds_q90/duckdb:parquet	7179994	7811790	0.92
tpcds_q91/duckdb:parquet	23744860	23679824	1.00
tpcds_q92/duckdb:parquet	11250988	11413631	0.99
tpcds_q93/duckdb:parquet	29762910	30694580	0.97
tpcds_q94/duckdb:parquet	16013131	16780944	0.95
tpcds_q95/duckdb:parquet 🚨	146413872	118642399	1.23
tpcds_q96/duckdb:parquet	9351355	9337939	1.00
tpcds_q97/duckdb:parquet	34142177	33996690	1.00
tpcds_q98/duckdb:parquet 🚀	17966717	20121128	0.89
tpcds_q99/duckdb:parquet 🚀	19467042	21685204	0.90

duckdb / duckdb (0.963x ➖, 17↑ 2↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpcds_q01/duckdb:duckdb	20180094	20712456	0.97
tpcds_q02/duckdb:duckdb	18514575	18668420	0.99
tpcds_q03/duckdb:duckdb	9255425	8796545	1.05
tpcds_q04/duckdb:duckdb	162334195	164993751	0.98
tpcds_q05/duckdb:duckdb	18271984	18196168	1.00
tpcds_q06/duckdb:duckdb	21822707	22051600	0.99
tpcds_q07/duckdb:duckdb	38341445	38333049	1.00
tpcds_q08/duckdb:duckdb	119093301	118705069	1.00
tpcds_q09/duckdb:duckdb	19783258	19545211	1.01
tpcds_q10/duckdb:duckdb	23047949	22756596	1.01
tpcds_q11/duckdb:duckdb	141989285	140220729	1.01
tpcds_q12/duckdb:duckdb	10998094	11348493	0.97
tpcds_q13/duckdb:duckdb	23540677	23687808	0.99
tpcds_q14/duckdb:duckdb	92235421	93662151	0.98
tpcds_q15/duckdb:duckdb	23991569	24099192	1.00
tpcds_q16/duckdb:duckdb	16891401	16988289	0.99
tpcds_q17/duckdb:duckdb	21020870	20993039	1.00
tpcds_q18/duckdb:duckdb	43461432	43441894	1.00
tpcds_q19/duckdb:duckdb	16070547	16154616	0.99
tpcds_q20/duckdb:duckdb	11689501	11447523	1.02
tpcds_q21/duckdb:duckdb	6292916	6750350	0.93
tpcds_q22/duckdb:duckdb	59725156	59974294	1.00
tpcds_q23/duckdb:duckdb 🚨	81197023	70818766	1.15
tpcds_q24/duckdb:duckdb 🚀	23096830	25812629	0.89
tpcds_q25/duckdb:duckdb	17434615	17454346	1.00
tpcds_q26/duckdb:duckdb	25253700	23715507	1.06
tpcds_q27/duckdb:duckdb	37793024	39988811	0.95
tpcds_q28/duckdb:duckdb	20883262	21605179	0.97
tpcds_q29/duckdb:duckdb	19685907	19756691	1.00
tpcds_q30/duckdb:duckdb	27440074	30198864	0.91
tpcds_q31/duckdb:duckdb	19926497	19904833	1.00
tpcds_q32/duckdb:duckdb 🚀	6695818	7896629	0.85
tpcds_q33/duckdb:duckdb	12562666	12339100	1.02
tpcds_q34/duckdb:duckdb 🚀	14386285	16179574	0.89
tpcds_q35/duckdb:duckdb	33175064	31011317	1.07
tpcds_q36/duckdb:duckdb	69976845	70930214	0.99
tpcds_q37/duckdb:duckdb	7363771	7881916	0.93
tpcds_q38/duckdb:duckdb	29415839	32324521	0.91
tpcds_q39/duckdb:duckdb	25654254	26026315	0.99
tpcds_q40/duckdb:duckdb	13731519	13664370	1.00
tpcds_q41/duckdb:duckdb	8048432	8085041	1.00
tpcds_q42/duckdb:duckdb	6305498	5775364	1.09
tpcds_q43/duckdb:duckdb	11064756	11048109	1.00
tpcds_q44/duckdb:duckdb	13039800	13308638	0.98
tpcds_q45/duckdb:duckdb	17430476	16957489	1.03
tpcds_q46/duckdb:duckdb	35594392	37156358	0.96
tpcds_q47/duckdb:duckdb	40535480	40921758	0.99
tpcds_q48/duckdb:duckdb	21733903	21692284	1.00
tpcds_q49/duckdb:duckdb	15165159	16136271	0.94
tpcds_q50/duckdb:duckdb	13964992	13870427	1.01
tpcds_q51/duckdb:duckdb	90542262	91972469	0.98
tpcds_q52/duckdb:duckdb	7163247	7078839	1.01
tpcds_q53/duckdb:duckdb	11632114	11442779	1.02
tpcds_q54/duckdb:duckdb	16697735	16365582	1.02
tpcds_q55/duckdb:duckdb	6620240	6592697	1.00
tpcds_q56/duckdb:duckdb	13443912	13341427	1.01
tpcds_q57/duckdb:duckdb	30866252	30923693	1.00
tpcds_q58/duckdb:duckdb 🚨	12722875	11562781	1.10
tpcds_q59/duckdb:duckdb	34733339	34080301	1.02
tpcds_q60/duckdb:duckdb	14612254	14783321	0.99
tpcds_q61/duckdb:duckdb	13759543	14765132	0.93
tpcds_q62/duckdb:duckdb	9050124	8915230	1.02
tpcds_q63/duckdb:duckdb	10919607	10621493	1.03
tpcds_q64/duckdb:duckdb	51901016	52169067	0.99
tpcds_q65/duckdb:duckdb	30366511	32680476	0.93
tpcds_q66/duckdb:duckdb	24419967	24135599	1.01
tpcds_q67/duckdb:duckdb	128157897	129334490	0.99
tpcds_q68/duckdb:duckdb	24391216	25410524	0.96
tpcds_q69/duckdb:duckdb	23725207	23636279	1.00
tpcds_q70/duckdb:duckdb	14343173	13723464	1.05
tpcds_q71/duckdb:duckdb	11587197	12508997	0.93
tpcds_q72/duckdb:duckdb	41705127	42313948	0.99
tpcds_q73/duckdb:duckdb	10215852	10842263	0.94
tpcds_q74/duckdb:duckdb	98939429	98391133	1.01
tpcds_q75/duckdb:duckdb	41105308	42860976	0.96
tpcds_q76/duckdb:duckdb	11488704	12555518	0.92
tpcds_q77/duckdb:duckdb	11927930	12683095	0.94
tpcds_q78/duckdb:duckdb	61359781	67109831	0.91
tpcds_q79/duckdb:duckdb 🚀	17898232	21450037	0.83
tpcds_q80/duckdb:duckdb	28551905	30281331	0.94
tpcds_q81/duckdb:duckdb 🚀	35338563	42515140	0.83
tpcds_q82/duckdb:duckdb 🚀	8201094	9157178	0.90
tpcds_q83/duckdb:duckdb 🚀	8801932	10126351	0.87
tpcds_q84/duckdb:duckdb 🚀	12974577	16488391	0.79
tpcds_q85/duckdb:duckdb 🚀	23145268	25942105	0.89
tpcds_q86/duckdb:duckdb 🚀	10361331	11789346	0.88
tpcds_q87/duckdb:duckdb 🚀	32712355	39203753	0.83
tpcds_q88/duckdb:duckdb	24016956	24977677	0.96
tpcds_q89/duckdb:duckdb 🚀	12565345	14043691	0.89
tpcds_q90/duckdb:duckdb 🚀	5369593	6506507	0.83
tpcds_q91/duckdb:duckdb	12647665	13631376	0.93
tpcds_q92/duckdb:duckdb	8932289	9879778	0.90
tpcds_q93/duckdb:duckdb 🚀	21785415	24735945	0.88
tpcds_q94/duckdb:duckdb	12382540	13691041	0.90
tpcds_q95/duckdb:duckdb	119239232	128969806	0.92
tpcds_q96/duckdb:duckdb 🚀	4372397	5072966	0.86
tpcds_q97/duckdb:duckdb 🚀	29589640	33861009	0.87
tpcds_q98/duckdb:duckdb 🚀	12862135	16369326	0.79
tpcds_q99/duckdb:duckdb	16496001	17056655	0.97

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-11.5%	-2.6%	-9.1%	+10.7%	➖ noise
1	datafusion:vortex-file-compressed	-13.9%	-2.6%	-11.5%	+12.5%	✅ faster
1	duckdb:duckdb	-2.6%	-2.6%	+0.1%	+17.5%	➖ noise
1	duckdb:vortex-compact	-9.6%	-2.6%	-7.1%	+10.0%	➖ noise
1	duckdb:vortex-file-compressed	-4.3%	-2.6%	-1.8%	+31.6%	➖ noise
2	datafusion:vortex-compact	-19.0%	-3.8%	-15.9%	+10.0%	✅ faster
2	datafusion:vortex-file-compressed	-17.5%	-3.8%	-14.3%	+10.0%	✅ faster
2	duckdb:duckdb	-0.8%	-3.8%	+3.0%	+10.0%	➖ noise
2	duckdb:vortex-compact	-4.4%	-3.8%	-0.6%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	-4.6%	-3.8%	-0.9%	+10.0%	➖ noise
3	datafusion:vortex-compact	-14.5%	-3.5%	-11.4%	+13.8%	➖ noise
3	datafusion:vortex-file-compressed	-16.1%	-3.5%	-13.0%	+12.3%	✅ faster
3	duckdb:duckdb	+5.2%	-3.5%	+9.0%	+19.1%	➖ noise
3	duckdb:vortex-compact	-8.6%	-3.5%	-5.3%	+12.8%	➖ noise
3	duckdb:vortex-file-compressed	-7.5%	-3.5%	-4.2%	+19.9%	➖ noise
4	datafusion:vortex-compact	-19.8%	-5.3%	-15.3%	+10.0%	✅ faster
4	datafusion:vortex-file-compressed	-16.0%	-5.3%	-11.4%	+10.0%	✅ faster
4	duckdb:duckdb	-1.6%	-5.3%	+3.9%	+10.0%	➖ noise
4	duckdb:vortex-compact	-12.1%	-5.3%	-7.1%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-9.6%	-5.3%	-4.5%	+10.0%	➖ noise
5	datafusion:vortex-compact	-9.6%	-10.7%	+1.2%	+13.8%	➖ noise
5	datafusion:vortex-file-compressed	-19.7%	-10.7%	-10.1%	+10.0%	✅ faster
5	duckdb:duckdb	+0.4%	-10.7%	+12.4%	+15.2%	➖ noise
5	duckdb:vortex-compact	-8.5%	-10.7%	+2.4%	+12.9%	➖ noise
5	duckdb:vortex-file-compressed	-14.1%	-10.7%	-3.9%	+13.2%	➖ noise
6	datafusion:vortex-compact	-19.4%	-0.3%	-19.2%	+10.0%	✅ faster
6	datafusion:vortex-file-compressed	-12.9%	-0.3%	-12.6%	+11.5%	✅ faster
6	duckdb:duckdb	-1.0%	-0.3%	-0.7%	+14.2%	➖ noise
6	duckdb:vortex-compact	-9.4%	-0.3%	-9.1%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	-13.9%	-0.3%	-13.6%	+10.0%	✅ faster
7	datafusion:vortex-compact	-19.2%	-3.9%	-16.0%	+10.0%	✅ faster
7	datafusion:vortex-file-compressed	-17.1%	-3.9%	-13.7%	+10.8%	✅ faster
7	duckdb:duckdb	+0.0%	-3.9%	+4.0%	+17.8%	➖ noise
7	duckdb:vortex-compact	-7.4%	-3.9%	-3.6%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-12.1%	-3.9%	-8.6%	+10.0%	➖ noise
8	datafusion:vortex-compact	-16.6%	-3.1%	-14.0%	+10.0%	✅ faster
8	datafusion:vortex-file-compressed	-15.8%	-3.1%	-13.2%	+10.0%	✅ faster
8	duckdb:duckdb	+0.3%	-3.1%	+3.5%	+10.0%	➖ noise
8	duckdb:vortex-compact	-8.5%	-3.1%	-5.6%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-11.2%	-3.1%	-8.4%	+14.7%	➖ noise
9	datafusion:vortex-compact	-17.6%	-1.4%	-16.4%	+10.0%	✅ faster
9	datafusion:vortex-file-compressed	-13.7%	-1.4%	-12.5%	+10.0%	✅ faster
9	duckdb:duckdb	+1.2%	-1.4%	+2.7%	+10.0%	➖ noise
9	duckdb:vortex-compact	-10.4%	-1.4%	-9.1%	+10.0%	✅ faster
9	duckdb:vortex-file-compressed	-11.9%	-1.4%	-10.6%	+10.0%	✅ faster
10	datafusion:vortex-compact	-15.1%	-1.8%	-13.5%	+10.0%	✅ faster
10	datafusion:vortex-file-compressed	-15.1%	-1.8%	-13.5%	+10.0%	✅ faster
10	duckdb:duckdb	+1.3%	-1.8%	+3.2%	+10.0%	➖ noise
10	duckdb:vortex-compact	-10.3%	-1.8%	-8.6%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-9.5%	-1.8%	-7.8%	+10.0%	➖ noise
11	datafusion:vortex-compact	-20.8%	-9.1%	-12.9%	+10.0%	✅ faster
11	datafusion:vortex-file-compressed	-19.3%	-9.1%	-11.2%	+10.0%	✅ faster
11	duckdb:duckdb	+1.3%	-9.1%	+11.4%	+10.0%	🚨 regression
11	duckdb:vortex-compact	-13.5%	-9.1%	-4.8%	+11.1%	➖ noise
11	duckdb:vortex-file-compressed	-16.1%	-9.1%	-7.8%	+10.0%	➖ noise
12	datafusion:vortex-compact	-14.7%	-5.1%	-10.2%	+10.6%	✅ faster
12	datafusion:vortex-file-compressed	-23.6%	-5.1%	-19.5%	+10.2%	✅ faster
12	duckdb:duckdb	-3.1%	-5.1%	+2.1%	+10.0%	➖ noise
12	duckdb:vortex-compact	-18.6%	-5.1%	-14.2%	+11.3%	✅ faster
12	duckdb:vortex-file-compressed	-9.1%	-5.1%	-4.2%	+10.0%	➖ noise
13	datafusion:vortex-compact	-9.7%	-2.6%	-7.3%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-15.0%	-2.6%	-12.7%	+10.0%	✅ faster
13	duckdb:duckdb	-0.6%	-2.6%	+2.1%	+10.0%	➖ noise
13	duckdb:vortex-compact	-5.6%	-2.6%	-3.1%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-13.8%	-2.6%	-11.5%	+10.0%	✅ faster
14	datafusion:vortex-compact	-16.1%	-6.9%	-9.9%	+10.0%	✅ faster
14	datafusion:vortex-file-compressed	-15.7%	-6.9%	-9.4%	+10.0%	✅ faster
14	duckdb:duckdb	-1.5%	-6.9%	+5.8%	+10.0%	➖ noise
14	duckdb:vortex-compact	-5.9%	-6.9%	+1.1%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	-13.0%	-6.9%	-6.6%	+10.0%	➖ noise
15	datafusion:vortex-compact	-16.8%	-8.9%	-8.7%	+12.2%	➖ noise
15	datafusion:vortex-file-compressed	-16.9%	-8.9%	-8.8%	+15.0%	➖ noise
15	duckdb:duckdb	-0.4%	-8.9%	+9.3%	+10.3%	➖ noise
15	duckdb:vortex-compact	-8.6%	-8.9%	+0.3%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	-13.2%	-8.9%	-4.8%	+13.0%	➖ noise
16	datafusion:vortex-compact	-16.7%	-10.8%	-6.6%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-18.0%	-10.8%	-8.1%	+10.0%	➖ noise
16	duckdb:duckdb	-0.6%	-10.8%	+11.4%	+12.2%	➖ noise
16	duckdb:vortex-compact	-8.7%	-10.8%	+2.3%	+11.6%	➖ noise
16	duckdb:vortex-file-compressed	-6.5%	-10.8%	+4.8%	+10.0%	➖ noise
17	datafusion:vortex-compact	-16.1%	-4.8%	-11.9%	+10.0%	✅ faster
17	datafusion:vortex-file-compressed	-20.6%	-4.8%	-16.6%	+10.0%	✅ faster
17	duckdb:duckdb	+0.1%	-4.8%	+5.1%	+10.0%	➖ noise
17	duckdb:vortex-compact	-10.3%	-4.8%	-5.8%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-13.8%	-4.8%	-9.5%	+10.0%	✅ faster
18	datafusion:vortex-compact	-13.2%	-3.2%	-10.3%	+10.0%	✅ faster
18	datafusion:vortex-file-compressed	-20.0%	-3.2%	-17.4%	+10.0%	✅ faster
18	duckdb:duckdb	+0.0%	-3.2%	+3.4%	+11.7%	➖ noise
18	duckdb:vortex-compact	-8.8%	-3.2%	-5.8%	+10.3%	➖ noise
18	duckdb:vortex-file-compressed	-10.9%	-3.2%	-7.9%	+10.9%	➖ noise
19	datafusion:vortex-compact	-15.8%	-4.2%	-12.0%	+10.0%	✅ faster
19	datafusion:vortex-file-compressed	-16.4%	-4.2%	-12.7%	+10.0%	✅ faster
19	duckdb:duckdb	-0.5%	-4.2%	+3.9%	+11.2%	➖ noise
19	duckdb:vortex-compact	-6.9%	-4.2%	-2.8%	+10.6%	➖ noise
19	duckdb:vortex-file-compressed	-13.2%	-4.2%	-9.3%	+10.2%	✅ faster
20	datafusion:vortex-compact	-20.5%	-8.2%	-13.4%	+11.3%	✅ faster
20	datafusion:vortex-file-compressed	-15.6%	-8.2%	-8.1%	+10.0%	➖ noise
20	duckdb:duckdb	+2.1%	-8.2%	+11.3%	+11.1%	🚨 regression
20	duckdb:vortex-compact	-8.2%	-8.2%	-0.0%	+14.6%	➖ noise
20	duckdb:vortex-file-compressed	-6.5%	-8.2%	+1.9%	+11.3%	➖ noise
21	datafusion:vortex-compact	-18.2%	-6.6%	-12.4%	+10.2%	✅ faster
21	datafusion:vortex-file-compressed	-14.2%	-6.6%	-8.2%	+10.0%	➖ noise
21	duckdb:duckdb	-6.8%	-6.6%	-0.2%	+22.9%	➖ noise
21	duckdb:vortex-compact	-10.5%	-6.6%	-4.2%	+14.4%	➖ noise
21	duckdb:vortex-file-compressed	-13.0%	-6.6%	-6.9%	+15.2%	➖ noise
22	datafusion:vortex-compact	-17.6%	-7.5%	-10.9%	+10.9%	✅ faster
22	datafusion:vortex-file-compressed	-12.0%	-7.5%	-4.9%	+11.2%	➖ noise
22	duckdb:duckdb	-0.4%	-7.5%	+7.7%	+10.0%	➖ noise
22	duckdb:vortex-compact	-9.1%	-7.5%	-1.7%	+10.0%	➖ noise
22	duckdb:vortex-file-compressed	-12.3%	-7.5%	-5.2%	+10.0%	➖ noise
23	datafusion:vortex-compact	-17.5%	-4.7%	-13.4%	+10.0%	✅ faster
23	datafusion:vortex-file-compressed	-20.7%	-4.7%	-16.9%	+10.0%	✅ faster
23	duckdb:duckdb	+14.7%	-4.7%	+20.3%	+16.6%	🚨 regression
23	duckdb:vortex-compact	-7.0%	-4.7%	-2.5%	+11.4%	➖ noise
23	duckdb:vortex-file-compressed	-14.7%	-4.7%	-10.6%	+10.0%	✅ faster
24	datafusion:vortex-compact	-18.1%	-4.8%	-13.9%	+10.0%	✅ faster
24	datafusion:vortex-file-compressed	-19.0%	-4.8%	-14.9%	+10.0%	✅ faster
24	duckdb:duckdb	-10.5%	-4.8%	-6.0%	+10.5%	➖ noise
24	duckdb:vortex-compact	-7.8%	-4.8%	-3.1%	+10.0%	➖ noise
24	duckdb:vortex-file-compressed	-8.6%	-4.8%	-3.9%	+10.0%	➖ noise
25	datafusion:vortex-compact	-16.3%	-2.7%	-14.0%	+10.0%	✅ faster
25	datafusion:vortex-file-compressed	-18.4%	-2.7%	-16.1%	+10.0%	✅ faster
25	duckdb:duckdb	-0.1%	-2.7%	+2.7%	+10.5%	➖ noise
25	duckdb:vortex-compact	-8.9%	-2.7%	-6.4%	+10.0%	➖ noise
25	duckdb:vortex-file-compressed	-11.9%	-2.7%	-9.5%	+10.0%	✅ faster
26	datafusion:vortex-compact	-18.4%	-5.6%	-13.5%	+10.0%	✅ faster
26	datafusion:vortex-file-compressed	-19.2%	-5.6%	-14.4%	+10.0%	✅ faster
26	duckdb:duckdb	+6.5%	-5.6%	+12.8%	+14.2%	➖ noise
26	duckdb:vortex-compact	-15.9%	-5.6%	-10.9%	+10.0%	✅ faster
26	duckdb:vortex-file-compressed	-7.4%	-5.6%	-1.9%	+16.7%	➖ noise
27	datafusion:vortex-compact	-20.7%	-6.3%	-15.4%	+10.0%	✅ faster
27	datafusion:vortex-file-compressed	-25.2%	-6.3%	-20.2%	+10.0%	✅ faster
27	duckdb:duckdb	-5.5%	-6.3%	+0.8%	+17.7%	➖ noise
27	duckdb:vortex-compact	-8.0%	-6.3%	-1.8%	+10.0%	➖ noise
27	duckdb:vortex-file-compressed	-14.4%	-6.3%	-8.6%	+10.0%	➖ noise
28	datafusion:vortex-compact	-12.4%	-2.8%	-9.9%	+10.0%	✅ faster
28	datafusion:vortex-file-compressed	-13.1%	-2.8%	-10.6%	+10.0%	✅ faster
28	duckdb:duckdb	-3.3%	-2.8%	-0.6%	+10.0%	➖ noise
28	duckdb:vortex-compact	-5.1%	-2.8%	-2.4%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	-14.1%	-2.8%	-11.7%	+10.0%	✅ faster
29	datafusion:vortex-compact	-17.9%	-5.6%	-13.0%	+10.0%	✅ faster
29	datafusion:vortex-file-compressed	-19.5%	-5.6%	-14.7%	+10.0%	✅ faster
29	duckdb:duckdb	-0.4%	-5.6%	+5.6%	+10.0%	➖ noise
29	duckdb:vortex-compact	-9.8%	-5.6%	-4.5%	+10.0%	➖ noise
29	duckdb:vortex-file-compressed	-17.7%	-5.6%	-12.8%	+10.7%	✅ faster
30	datafusion:vortex-compact	-10.0%	-3.6%	-6.6%	+10.0%	➖ noise
30	datafusion:vortex-file-compressed	-18.4%	-3.6%	-15.4%	+10.0%	✅ faster
30	duckdb:duckdb	-9.1%	-3.6%	-5.7%	+10.0%	➖ noise
30	duckdb:vortex-compact	-11.4%	-3.6%	-8.1%	+11.8%	➖ noise
30	duckdb:vortex-file-compressed	-15.3%	-3.6%	-12.2%	+10.0%	✅ faster
31	datafusion:vortex-compact	-15.4%	-0.9%	-14.7%	+10.0%	✅ faster
31	datafusion:vortex-file-compressed	-19.0%	-0.9%	-18.2%	+10.0%	✅ faster
31	duckdb:duckdb	+0.1%	-0.9%	+1.0%	+10.0%	➖ noise
31	duckdb:vortex-compact	-9.4%	-0.9%	-8.6%	+10.0%	➖ noise
31	duckdb:vortex-file-compressed	-20.7%	-0.9%	-20.0%	+10.0%	✅ faster
32	datafusion:vortex-compact	-13.7%	-7.0%	-7.3%	+10.0%	➖ noise
32	datafusion:vortex-file-compressed	-14.2%	-7.0%	-7.8%	+10.6%	➖ noise
32	duckdb:duckdb	-15.2%	-7.0%	-8.9%	+15.9%	➖ noise
32	duckdb:vortex-compact	-8.9%	-7.0%	-2.0%	+12.3%	➖ noise
32	duckdb:vortex-file-compressed	-11.8%	-7.0%	-5.2%	+10.5%	➖ noise
33	datafusion:vortex-compact	-11.5%	-2.8%	-8.9%	+10.0%	➖ noise
33	datafusion:vortex-file-compressed	-19.1%	-2.8%	-16.8%	+11.3%	✅ faster
33	duckdb:duckdb	+1.8%	-2.8%	+4.8%	+10.0%	➖ noise
33	duckdb:vortex-compact	-4.4%	-2.8%	-1.6%	+10.0%	➖ noise
33	duckdb:vortex-file-compressed	-18.4%	-2.8%	-16.0%	+11.4%	✅ faster
34	datafusion:vortex-compact	-16.6%	-4.6%	-12.6%	+10.0%	✅ faster
34	datafusion:vortex-file-compressed	-14.7%	-4.6%	-10.6%	+10.7%	✅ faster
34	duckdb:duckdb	-11.1%	-4.6%	-6.8%	+10.0%	➖ noise
34	duckdb:vortex-compact	-12.1%	-4.6%	-7.9%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	-15.6%	-4.6%	-11.5%	+17.6%	➖ noise
35	datafusion:vortex-compact	-15.9%	-6.1%	-10.4%	+10.0%	✅ faster
35	datafusion:vortex-file-compressed	-13.8%	-6.1%	-8.3%	+10.0%	➖ noise
35	duckdb:duckdb	+7.0%	-6.1%	+13.9%	+15.0%	➖ noise
35	duckdb:vortex-compact	-9.8%	-6.1%	-3.9%	+10.1%	➖ noise
35	duckdb:vortex-file-compressed	-16.8%	-6.1%	-11.4%	+10.0%	✅ faster
36	datafusion:vortex-compact	-14.4%	-7.7%	-7.3%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	-21.9%	-7.7%	-15.4%	+10.0%	✅ faster
36	duckdb:duckdb	-1.3%	-7.7%	+6.9%	+10.0%	➖ noise
36	duckdb:vortex-compact	-6.9%	-7.7%	+0.8%	+15.2%	➖ noise
36	duckdb:vortex-file-compressed	-11.4%	-7.7%	-4.1%	+10.0%	➖ noise
37	datafusion:vortex-compact	-18.4%	-5.3%	-13.8%	+12.3%	✅ faster
37	datafusion:vortex-file-compressed	-23.0%	-5.3%	-18.7%	+10.9%	✅ faster
37	duckdb:duckdb	-6.6%	-5.3%	-1.4%	+13.9%	➖ noise
37	duckdb:vortex-compact	-11.5%	-5.3%	-6.5%	+10.7%	➖ noise
37	duckdb:vortex-file-compressed	-11.6%	-5.3%	-6.7%	+17.9%	➖ noise
38	datafusion:vortex-compact	-16.7%	-8.5%	-9.0%	+10.0%	➖ noise
38	datafusion:vortex-file-compressed	-17.5%	-8.5%	-9.8%	+10.0%	✅ faster
38	duckdb:duckdb	-9.0%	-8.5%	-0.6%	+11.6%	➖ noise
38	duckdb:vortex-compact	-12.2%	-8.5%	-4.0%	+10.7%	➖ noise
38	duckdb:vortex-file-compressed	-7.6%	-8.5%	+0.9%	+10.0%	➖ noise
39	datafusion:vortex-compact	-21.9%	-9.0%	-14.2%	+10.0%	✅ faster
39	datafusion:vortex-file-compressed	-11.9%	-9.0%	-3.3%	+14.4%	➖ noise
39	duckdb:duckdb	-1.4%	-9.0%	+8.3%	+18.1%	➖ noise
39	duckdb:vortex-compact	-8.5%	-9.0%	+0.6%	+15.5%	➖ noise
39	duckdb:vortex-file-compressed	-12.1%	-9.0%	-3.4%	+20.5%	➖ noise
40	datafusion:vortex-compact	-21.0%	+0.7%	-21.6%	+10.0%	✅ faster
40	datafusion:vortex-file-compressed	-15.2%	+0.7%	-15.8%	+10.0%	✅ faster
40	duckdb:duckdb	+0.5%	+0.7%	-0.2%	+10.6%	➖ noise
40	duckdb:vortex-compact	-14.0%	+0.7%	-14.6%	+11.2%	✅ faster
40	duckdb:vortex-file-compressed	-14.6%	+0.7%	-15.1%	+10.9%	✅ faster
41	datafusion:vortex-compact	-18.3%	-5.8%	-13.4%	+10.0%	✅ faster
41	datafusion:vortex-file-compressed	-17.2%	-5.8%	-12.1%	+10.0%	✅ faster
41	duckdb:duckdb	-0.5%	-5.8%	+5.6%	+10.3%	➖ noise
41	duckdb:vortex-compact	-13.8%	-5.8%	-8.5%	+11.2%	➖ noise
41	duckdb:vortex-file-compressed	-12.2%	-5.8%	-6.8%	+10.0%	➖ noise
42	datafusion:vortex-compact	-13.6%	-6.9%	-7.2%	+10.0%	➖ noise
42	datafusion:vortex-file-compressed	-18.7%	-6.9%	-12.6%	+10.1%	✅ faster
42	duckdb:duckdb	+9.2%	-6.9%	+17.3%	+16.8%	🚨 regression
42	duckdb:vortex-compact	-9.7%	-6.9%	-3.0%	+17.1%	➖ noise
42	duckdb:vortex-file-compressed	-15.6%	-6.9%	-9.3%	+18.3%	➖ noise
43	datafusion:vortex-compact	-13.5%	-1.5%	-12.2%	+10.0%	✅ faster
43	datafusion:vortex-file-compressed	-20.5%	-1.5%	-19.3%	+10.6%	✅ faster
43	duckdb:duckdb	+0.2%	-1.5%	+1.7%	+10.0%	➖ noise
43	duckdb:vortex-compact	-3.9%	-1.5%	-2.4%	+10.0%	➖ noise
43	duckdb:vortex-file-compressed	-6.0%	-1.5%	-4.6%	+11.0%	➖ noise
44	datafusion:vortex-compact	-12.7%	-4.4%	-8.7%	+10.0%	➖ noise
44	datafusion:vortex-file-compressed	-14.3%	-4.4%	-10.4%	+10.0%	✅ faster
44	duckdb:duckdb	-2.0%	-4.4%	+2.4%	+12.1%	➖ noise
44	duckdb:vortex-compact	-6.9%	-4.4%	-2.7%	+10.5%	➖ noise
44	duckdb:vortex-file-compressed	-11.1%	-4.4%	-7.0%	+10.0%	➖ noise
45	datafusion:vortex-compact	-17.5%	-5.3%	-12.9%	+10.0%	✅ faster
45	datafusion:vortex-file-compressed	-13.8%	-5.3%	-8.9%	+10.0%	➖ noise
45	duckdb:duckdb	+2.8%	-5.3%	+8.5%	+12.8%	➖ noise
45	duckdb:vortex-compact	-15.4%	-5.3%	-10.7%	+12.0%	➖ noise
45	duckdb:vortex-file-compressed	-16.9%	-5.3%	-12.3%	+10.7%	✅ faster
46	datafusion:vortex-compact	-14.4%	-4.9%	-10.0%	+10.0%	✅ faster
46	datafusion:vortex-file-compressed	-19.6%	-4.9%	-15.4%	+10.0%	✅ faster
46	duckdb:duckdb	-4.2%	-4.9%	+0.8%	+10.5%	➖ noise
46	duckdb:vortex-compact	-9.5%	-4.9%	-4.8%	+10.0%	➖ noise
46	duckdb:vortex-file-compressed	-12.4%	-4.9%	-7.8%	+10.0%	➖ noise
47	datafusion:vortex-compact	-20.1%	-5.7%	-15.3%	+10.0%	✅ faster
47	datafusion:vortex-file-compressed	-21.1%	-5.7%	-16.4%	+10.0%	✅ faster
47	duckdb:duckdb	-0.9%	-5.7%	+5.0%	+10.0%	➖ noise
47	duckdb:vortex-compact	-6.0%	-5.7%	-0.4%	+11.6%	➖ noise
47	duckdb:vortex-file-compressed	-15.2%	-5.7%	-10.1%	+10.6%	✅ faster
48	datafusion:vortex-compact	-6.9%	-3.7%	-3.4%	+10.0%	➖ noise
48	datafusion:vortex-file-compressed	-14.4%	-3.7%	-11.1%	+10.0%	✅ faster
48	duckdb:duckdb	+0.2%	-3.7%	+4.0%	+10.0%	➖ noise
48	duckdb:vortex-compact	-7.5%	-3.7%	-4.0%	+10.0%	➖ noise
48	duckdb:vortex-file-compressed	-12.7%	-3.7%	-9.3%	+11.0%	➖ noise
49	datafusion:vortex-compact	-15.7%	-5.7%	-10.6%	+10.0%	✅ faster
49	datafusion:vortex-file-compressed	-18.2%	-5.7%	-13.3%	+13.3%	✅ faster
49	duckdb:duckdb	-6.0%	-5.7%	-0.3%	+18.1%	➖ noise
49	duckdb:vortex-compact	-5.4%	-5.7%	+0.4%	+10.8%	➖ noise
49	duckdb:vortex-file-compressed	-18.9%	-5.7%	-13.9%	+12.6%	✅ faster
50	datafusion:vortex-compact	-15.7%	-4.9%	-11.3%	+10.0%	✅ faster
50	datafusion:vortex-file-compressed	-18.2%	-4.9%	-14.0%	+13.8%	✅ faster
50	duckdb:duckdb	+0.7%	-4.9%	+5.9%	+10.3%	➖ noise
50	duckdb:vortex-compact	-8.2%	-4.9%	-3.5%	+10.0%	➖ noise
50	duckdb:vortex-file-compressed	-11.1%	-4.9%	-6.5%	+10.0%	➖ noise
51	datafusion:vortex-compact	-16.3%	-5.5%	-11.5%	+11.3%	✅ faster
51	datafusion:vortex-file-compressed	-16.4%	-5.5%	-11.5%	+10.4%	✅ faster
51	duckdb:duckdb	-1.6%	-5.5%	+4.2%	+18.1%	➖ noise
51	duckdb:vortex-compact	-4.7%	-5.5%	+0.9%	+16.8%	➖ noise
51	duckdb:vortex-file-compressed	-9.7%	-5.5%	-4.5%	+18.6%	➖ noise
52	datafusion:vortex-compact	-15.2%	-3.3%	-12.4%	+12.1%	✅ faster
52	datafusion:vortex-file-compressed	-23.4%	-3.3%	-20.8%	+15.0%	✅ faster
52	duckdb:duckdb	+1.2%	-3.3%	+4.6%	+14.6%	➖ noise
52	duckdb:vortex-compact	-2.8%	-3.3%	+0.5%	+18.2%	➖ noise
52	duckdb:vortex-file-compressed	-15.1%	-3.3%	-12.2%	+18.7%	➖ noise
53	datafusion:vortex-compact	-16.5%	-1.7%	-15.1%	+10.0%	✅ faster
53	datafusion:vortex-file-compressed	-14.0%	-1.7%	-12.6%	+12.0%	✅ faster
53	duckdb:duckdb	+1.7%	-1.7%	+3.4%	+11.4%	➖ noise
53	duckdb:vortex-compact	-10.5%	-1.7%	-9.0%	+10.0%	➖ noise
53	duckdb:vortex-file-compressed	-8.3%	-1.7%	-6.7%	+10.0%	➖ noise
54	datafusion:vortex-compact	-13.2%	+0.4%	-13.6%	+10.0%	✅ faster
54	datafusion:vortex-file-compressed	-14.5%	+0.4%	-14.9%	+10.0%	✅ faster
54	duckdb:duckdb	+2.0%	+0.4%	+1.6%	+10.0%	➖ noise
54	duckdb:vortex-compact	-5.7%	+0.4%	-6.1%	+10.0%	➖ noise
54	duckdb:vortex-file-compressed	-14.3%	+0.4%	-14.7%	+10.0%	✅ faster
55	datafusion:vortex-compact	-19.0%	-6.4%	-13.5%	+12.3%	✅ faster
55	datafusion:vortex-file-compressed	-17.2%	-6.4%	-11.5%	+13.0%	✅ faster
55	duckdb:duckdb	+0.4%	-6.4%	+7.3%	+17.3%	➖ noise
55	duckdb:vortex-compact	-12.2%	-6.4%	-6.2%	+16.0%	➖ noise
55	duckdb:vortex-file-compressed	-9.9%	-6.4%	-3.8%	+18.0%	➖ noise
56	datafusion:vortex-compact	-14.2%	-5.9%	-8.9%	+10.0%	➖ noise
56	datafusion:vortex-file-compressed	-16.7%	-5.9%	-11.5%	+10.1%	✅ faster
56	duckdb:duckdb	+0.8%	-5.9%	+7.0%	+12.1%	➖ noise
56	duckdb:vortex-compact	-6.1%	-5.9%	-0.2%	+10.0%	➖ noise
56	duckdb:vortex-file-compressed	-15.1%	-5.9%	-9.9%	+11.5%	➖ noise
57	datafusion:vortex-compact	-16.5%	-6.2%	-11.0%	+10.0%	✅ faster
57	datafusion:vortex-file-compressed	-17.3%	-6.2%	-11.9%	+10.0%	✅ faster
57	duckdb:duckdb	-0.2%	-6.2%	+6.4%	+10.9%	➖ noise
57	duckdb:vortex-compact	-7.2%	-6.2%	-1.1%	+19.1%	➖ noise
57	duckdb:vortex-file-compressed	-14.6%	-6.2%	-9.0%	+15.2%	➖ noise
58	datafusion:vortex-compact	-17.1%	-1.5%	-15.9%	+10.0%	✅ faster
58	datafusion:vortex-file-compressed	-18.1%	-1.5%	-16.8%	+10.1%	✅ faster
58	duckdb:duckdb	+10.0%	-1.5%	+11.7%	+12.0%	➖ noise
58	duckdb:vortex-compact	-17.9%	-1.5%	-16.6%	+27.0%	➖ noise
58	duckdb:vortex-file-compressed	-18.0%	-1.5%	-16.8%	+16.3%	✅ faster
59	datafusion:vortex-compact	-19.8%	-3.1%	-17.2%	+10.0%	✅ faster
59	datafusion:vortex-file-compressed	-20.9%	-3.1%	-18.4%	+10.0%	✅ faster
59	duckdb:duckdb	+1.9%	-3.1%	+5.2%	+10.0%	➖ noise
59	duckdb:vortex-compact	-6.2%	-3.1%	-3.2%	+10.0%	➖ noise
59	duckdb:vortex-file-compressed	-6.7%	-3.1%	-3.7%	+10.0%	➖ noise
60	datafusion:vortex-compact	-13.5%	+1.4%	-14.7%	+10.0%	✅ faster
60	datafusion:vortex-file-compressed	-17.2%	+1.4%	-18.3%	+10.0%	✅ faster
60	duckdb:duckdb	-1.2%	+1.4%	-2.5%	+14.8%	➖ noise
60	duckdb:vortex-compact	-3.8%	+1.4%	-5.1%	+10.0%	➖ noise
60	duckdb:vortex-file-compressed	-15.2%	+1.4%	-16.4%	+10.4%	✅ faster
61	datafusion:vortex-compact	-15.8%	-4.4%	-11.9%	+10.0%	✅ faster
61	datafusion:vortex-file-compressed	-17.3%	-4.4%	-13.5%	+10.0%	✅ faster
61	duckdb:duckdb	-6.8%	-4.4%	-2.5%	+32.2%	➖ noise
61	duckdb:vortex-compact	-2.0%	-4.4%	+2.6%	+10.0%	➖ noise
61	duckdb:vortex-file-compressed	-8.4%	-4.4%	-4.1%	+12.1%	➖ noise
62	datafusion:vortex-compact	-16.6%	-13.7%	-3.4%	+14.9%	➖ noise
62	datafusion:vortex-file-compressed	-18.0%	-13.7%	-5.0%	+14.0%	➖ noise
62	duckdb:duckdb	+1.5%	-13.7%	+17.7%	+15.9%	🚨 regression
62	duckdb:vortex-compact	-6.4%	-13.7%	+8.5%	+23.6%	➖ noise
62	duckdb:vortex-file-compressed	-16.6%	-13.7%	-3.3%	+23.4%	➖ noise
63	datafusion:vortex-compact	-17.6%	-1.4%	-16.5%	+10.0%	✅ faster
63	datafusion:vortex-file-compressed	-17.5%	-1.4%	-16.3%	+10.0%	✅ faster
63	duckdb:duckdb	+2.8%	-1.4%	+4.2%	+10.0%	➖ noise
63	duckdb:vortex-compact	-11.7%	-1.4%	-10.4%	+10.5%	✅ faster
63	duckdb:vortex-file-compressed	-11.7%	-1.4%	-10.4%	+10.0%	✅ faster
64	datafusion:vortex-compact	-15.2%	-4.0%	-11.6%	+10.0%	✅ faster
64	datafusion:vortex-file-compressed	-18.6%	-4.0%	-15.2%	+10.0%	✅ faster
64	duckdb:duckdb	-0.5%	-4.0%	+3.7%	+10.0%	➖ noise
64	duckdb:vortex-compact	-11.4%	-4.0%	-7.7%	+10.0%	➖ noise
64	duckdb:vortex-file-compressed	-12.9%	-4.0%	-9.2%	+10.0%	✅ faster
65	datafusion:vortex-compact	-13.0%	-6.0%	-7.4%	+10.0%	➖ noise
65	datafusion:vortex-file-compressed	-22.2%	-6.0%	-17.2%	+10.0%	✅ faster
65	duckdb:duckdb	-7.1%	-6.0%	-1.1%	+13.2%	➖ noise
65	duckdb:vortex-compact	-11.0%	-6.0%	-5.3%	+10.0%	➖ noise
65	duckdb:vortex-file-compressed	-11.9%	-6.0%	-6.3%	+10.0%	➖ noise
66	datafusion:vortex-compact	-13.9%	-4.2%	-10.1%	+12.3%	➖ noise
66	datafusion:vortex-file-compressed	-16.7%	-4.2%	-13.1%	+10.7%	✅ faster
66	duckdb:duckdb	+1.2%	-4.2%	+5.6%	+13.6%	➖ noise
66	duckdb:vortex-compact	-1.1%	-4.2%	+3.2%	+14.9%	➖ noise
66	duckdb:vortex-file-compressed	-14.7%	-4.2%	-10.9%	+16.5%	➖ noise
67	datafusion:vortex-compact	-15.4%	-6.1%	-9.9%	+10.0%	✅ faster
67	datafusion:vortex-file-compressed	-19.5%	-6.1%	-14.2%	+10.0%	✅ faster
67	duckdb:duckdb	-0.9%	-6.1%	+5.6%	+10.0%	➖ noise
67	duckdb:vortex-compact	-11.8%	-6.1%	-6.0%	+10.0%	➖ noise
67	duckdb:vortex-file-compressed	-11.9%	-6.1%	-6.2%	+10.0%	➖ noise
68	datafusion:vortex-compact	-12.4%	-3.6%	-9.1%	+10.0%	➖ noise
68	datafusion:vortex-file-compressed	-20.4%	-3.6%	-17.4%	+10.0%	✅ faster
68	duckdb:duckdb	-4.0%	-3.6%	-0.4%	+10.0%	➖ noise
68	duckdb:vortex-compact	-5.2%	-3.6%	-1.6%	+10.0%	➖ noise
68	duckdb:vortex-file-compressed	-12.8%	-3.6%	-9.5%	+12.7%	➖ noise
69	datafusion:vortex-compact	-12.3%	-3.7%	-9.0%	+10.0%	➖ noise
69	datafusion:vortex-file-compressed	-17.4%	-3.7%	-14.2%	+10.0%	✅ faster
69	duckdb:duckdb	+0.4%	-3.7%	+4.2%	+10.0%	➖ noise
69	duckdb:vortex-compact	-10.6%	-3.7%	-7.1%	+10.0%	➖ noise
69	duckdb:vortex-file-compressed	-11.0%	-3.7%	-7.5%	+10.0%	➖ noise
70	datafusion:vortex-compact	-11.8%	-1.0%	-11.0%	+10.0%	✅ faster
70	datafusion:vortex-file-compressed	-16.5%	-1.0%	-15.7%	+10.0%	✅ faster
70	duckdb:duckdb	+4.5%	-1.0%	+5.6%	+26.9%	➖ noise
70	duckdb:vortex-compact	-9.0%	-1.0%	-8.1%	+10.0%	➖ noise
70	duckdb:vortex-file-compressed	-7.5%	-1.0%	-6.6%	+10.1%	➖ noise
71	datafusion:vortex-compact	-10.7%	+0.3%	-11.0%	+10.9%	✅ faster
71	datafusion:vortex-file-compressed	-16.5%	+0.3%	-16.8%	+12.5%	✅ faster
71	duckdb:duckdb	-7.4%	+0.3%	-7.7%	+11.0%	➖ noise
71	duckdb:vortex-compact	-7.0%	+0.3%	-7.3%	+13.1%	➖ noise
71	duckdb:vortex-file-compressed	-10.2%	+0.3%	-10.5%	+15.3%	➖ noise
72	datafusion:vortex-compact	-20.1%	-8.9%	-12.3%	+10.0%	✅ faster
72	datafusion:vortex-file-compressed	-25.4%	-8.9%	-18.1%	+10.0%	✅ faster
72	duckdb:duckdb	-1.4%	-8.9%	+8.2%	+10.0%	➖ noise
72	duckdb:vortex-compact	-6.6%	-8.9%	+2.5%	+10.0%	➖ noise
72	duckdb:vortex-file-compressed	-5.6%	-8.9%	+3.6%	+10.0%	➖ noise
73	datafusion:vortex-compact	-12.0%	-4.6%	-7.8%	+21.6%	➖ noise
73	datafusion:vortex-file-compressed	-19.3%	-4.6%	-15.4%	+20.4%	➖ noise
73	duckdb:duckdb	-5.8%	-4.6%	-1.3%	+10.4%	➖ noise
73	duckdb:vortex-compact	-10.0%	-4.6%	-5.7%	+10.0%	➖ noise
73	duckdb:vortex-file-compressed	-13.4%	-4.6%	-9.2%	+10.0%	✅ faster
74	datafusion:vortex-compact	-8.1%	-1.6%	-6.6%	+10.0%	➖ noise
74	datafusion:vortex-file-compressed	-19.4%	-1.6%	-18.1%	+10.0%	✅ faster
74	duckdb:duckdb	+0.6%	-1.6%	+2.2%	+10.0%	➖ noise
74	duckdb:vortex-compact	-10.4%	-1.6%	-8.9%	+12.3%	➖ noise
74	duckdb:vortex-file-compressed	-12.5%	-1.6%	-11.1%	+13.7%	➖ noise
75	datafusion:vortex-compact	-6.4%	-5.0%	-1.5%	+10.0%	➖ noise
75	datafusion:vortex-file-compressed	-17.5%	-5.0%	-13.1%	+10.0%	✅ faster
75	duckdb:duckdb	-4.1%	-5.0%	+1.0%	+10.0%	➖ noise
75	duckdb:vortex-compact	-1.6%	-5.0%	+3.6%	+12.7%	➖ noise
75	duckdb:vortex-file-compressed	-11.4%	-5.0%	-6.7%	+10.0%	➖ noise
76	datafusion:vortex-compact	-7.8%	-3.4%	-4.6%	+10.0%	➖ noise
76	datafusion:vortex-file-compressed	-12.3%	-3.4%	-9.3%	+11.1%	➖ noise
76	duckdb:duckdb	-8.5%	-3.4%	-5.3%	+22.6%	➖ noise
76	duckdb:vortex-compact	-15.5%	-3.4%	-12.6%	+15.9%	➖ noise
76	duckdb:vortex-file-compressed	-5.3%	-3.4%	-2.0%	+17.4%	➖ noise
77	datafusion:vortex-compact	-6.9%	-1.8%	-5.2%	+10.0%	➖ noise
77	datafusion:vortex-file-compressed	-18.1%	-1.8%	-16.6%	+10.0%	✅ faster
77	duckdb:duckdb	-6.0%	-1.8%	-4.2%	+17.7%	➖ noise
77	duckdb:vortex-compact	-7.3%	-1.8%	-5.6%	+13.0%	➖ noise
77	duckdb:vortex-file-compressed	-8.8%	-1.8%	-7.1%	+12.3%	➖ noise
78	datafusion:vortex-compact	-11.8%	-7.1%	-5.0%	+10.0%	➖ noise
78	datafusion:vortex-file-compressed	-22.8%	-7.1%	-16.9%	+10.0%	✅ faster
78	duckdb:duckdb	-8.6%	-7.1%	-1.6%	+11.9%	➖ noise
78	duckdb:vortex-compact	-11.7%	-7.1%	-4.9%	+10.0%	➖ noise
78	duckdb:vortex-file-compressed	-15.3%	-7.1%	-8.8%	+10.0%	➖ noise
79	datafusion:vortex-compact	-6.4%	-3.0%	-3.5%	+10.0%	➖ noise
79	datafusion:vortex-file-compressed	-19.3%	-3.0%	-16.8%	+10.0%	✅ faster
79	duckdb:duckdb	-16.6%	-3.0%	-13.9%	+10.6%	✅ faster
79	duckdb:vortex-compact	-7.9%	-3.0%	-5.0%	+14.6%	➖ noise
79	duckdb:vortex-file-compressed	-9.4%	-3.0%	-6.6%	+19.2%	➖ noise
80	datafusion:vortex-compact	-6.8%	-5.2%	-1.7%	+10.0%	➖ noise
80	datafusion:vortex-file-compressed	-22.5%	-5.2%	-18.3%	+10.0%	✅ faster
80	duckdb:duckdb	-5.7%	-5.2%	-0.5%	+17.2%	➖ noise
80	duckdb:vortex-compact	-2.7%	-5.2%	+2.6%	+10.0%	➖ noise
80	duckdb:vortex-file-compressed	-14.5%	-5.2%	-9.8%	+10.0%	✅ faster
81	datafusion:vortex-compact	-6.6%	-4.8%	-1.8%	+10.3%	➖ noise
81	datafusion:vortex-file-compressed	-15.8%	-4.8%	-11.5%	+12.9%	✅ faster
81	duckdb:duckdb	-16.9%	-4.8%	-12.6%	+10.1%	✅ faster
81	duckdb:vortex-compact	-0.4%	-4.8%	+4.7%	+11.7%	➖ noise
81	duckdb:vortex-file-compressed	-14.6%	-4.8%	-10.3%	+13.6%	➖ noise
82	datafusion:vortex-compact	-6.6%	-2.5%	-4.1%	+10.0%	➖ noise
82	datafusion:vortex-file-compressed	-22.4%	-2.5%	-20.3%	+10.0%	✅ faster
82	duckdb:duckdb	-10.4%	-2.5%	-8.1%	+15.2%	➖ noise
82	duckdb:vortex-compact	-7.0%	-2.5%	-4.6%	+10.0%	➖ noise
82	duckdb:vortex-file-compressed	-19.3%	-2.5%	-17.2%	+13.2%	✅ faster
83	datafusion:vortex-compact	-9.1%	-3.3%	-6.0%	+10.1%	➖ noise
83	datafusion:vortex-file-compressed	-19.4%	-3.3%	-16.7%	+10.0%	✅ faster
83	duckdb:duckdb	-13.1%	-3.3%	-10.2%	+13.0%	➖ noise
83	duckdb:vortex-compact	-15.7%	-3.3%	-12.9%	+13.7%	✅ faster
83	duckdb:vortex-file-compressed	-13.0%	-3.3%	-10.1%	+12.3%	➖ noise
84	datafusion:vortex-compact	-13.7%	-4.8%	-9.3%	+11.0%	➖ noise
84	datafusion:vortex-file-compressed	-19.2%	-4.8%	-15.2%	+10.0%	✅ faster
84	duckdb:duckdb	-21.3%	-4.8%	-17.4%	+10.0%	✅ faster
84	duckdb:vortex-compact	-12.6%	-4.8%	-8.2%	+10.0%	➖ noise
84	duckdb:vortex-file-compressed	-8.8%	-4.8%	-4.2%	+10.0%	➖ noise
85	datafusion:vortex-compact	-8.6%	-3.0%	-5.7%	+10.0%	➖ noise
85	datafusion:vortex-file-compressed	-14.6%	-3.0%	-11.9%	+10.0%	✅ faster
85	duckdb:duckdb	-10.8%	-3.0%	-8.0%	+10.0%	➖ noise
85	duckdb:vortex-compact	-3.3%	-3.0%	-0.3%	+10.0%	➖ noise
85	duckdb:vortex-file-compressed	-13.8%	-3.0%	-11.2%	+10.0%	✅ faster
86	datafusion:vortex-compact	-5.0%	+3.0%	-7.7%	+12.9%	➖ noise
86	datafusion:vortex-file-compressed	-14.9%	+3.0%	-17.3%	+10.0%	✅ faster
86	duckdb:duckdb	-12.1%	+3.0%	-14.6%	+12.1%	✅ faster
86	duckdb:vortex-compact	-12.4%	+3.0%	-14.9%	+19.1%	➖ noise
86	duckdb:vortex-file-compressed	-10.6%	+3.0%	-13.2%	+13.7%	✅ faster
87	datafusion:vortex-compact	-8.0%	-1.9%	-6.2%	+10.0%	➖ noise
87	datafusion:vortex-file-compressed	-15.9%	-1.9%	-14.3%	+10.0%	✅ faster
87	duckdb:duckdb	-16.6%	-1.9%	-15.0%	+13.0%	✅ faster
87	duckdb:vortex-compact	-7.3%	-1.9%	-5.6%	+10.0%	➖ noise
87	duckdb:vortex-file-compressed	-9.9%	-1.9%	-8.2%	+16.3%	➖ noise
88	datafusion:vortex-compact	-2.4%	-3.8%	+1.5%	+10.0%	➖ noise
88	datafusion:vortex-file-compressed	-14.5%	-3.8%	-11.1%	+10.0%	✅ faster
88	duckdb:duckdb	-3.8%	-3.8%	-0.0%	+10.0%	➖ noise
88	duckdb:vortex-compact	-5.1%	-3.8%	-1.3%	+10.0%	➖ noise
88	duckdb:vortex-file-compressed	-9.5%	-3.8%	-5.9%	+10.0%	➖ noise
89	datafusion:vortex-compact	-4.9%	-2.7%	-2.3%	+14.6%	➖ noise
89	datafusion:vortex-file-compressed	-18.1%	-2.7%	-15.8%	+11.7%	✅ faster
89	duckdb:duckdb	-10.5%	-2.7%	-8.0%	+12.5%	➖ noise
89	duckdb:vortex-compact	-10.1%	-2.7%	-7.6%	+11.0%	➖ noise
89	duckdb:vortex-file-compressed	-11.4%	-2.7%	-9.0%	+10.7%	➖ noise
90	datafusion:vortex-compact	-6.4%	-7.7%	+1.4%	+10.0%	➖ noise
90	datafusion:vortex-file-compressed	-14.5%	-7.7%	-7.3%	+10.0%	➖ noise
90	duckdb:duckdb	-17.5%	-7.7%	-10.6%	+10.0%	✅ faster
90	duckdb:vortex-compact	-4.9%	-7.7%	+3.1%	+10.3%	➖ noise
90	duckdb:vortex-file-compressed	-11.2%	-7.7%	-3.8%	+10.0%	➖ noise
91	datafusion:vortex-compact	-1.2%	-6.4%	+5.5%	+11.8%	➖ noise
91	datafusion:vortex-file-compressed	-17.8%	-6.4%	-12.2%	+10.2%	✅ faster
91	duckdb:duckdb	-7.2%	-6.4%	-0.9%	+10.0%	➖ noise
91	duckdb:vortex-compact	-13.0%	-6.4%	-7.1%	+11.1%	➖ noise
91	duckdb:vortex-file-compressed	-11.3%	-6.4%	-5.2%	+11.4%	➖ noise
92	datafusion:vortex-compact	-7.0%	-7.7%	+0.8%	+10.0%	➖ noise
92	datafusion:vortex-file-compressed	-15.9%	-7.7%	-8.9%	+10.0%	➖ noise
92	duckdb:duckdb	-9.6%	-7.7%	-2.1%	+11.8%	➖ noise
92	duckdb:vortex-compact	-15.8%	-7.7%	-8.7%	+11.5%	➖ noise
92	duckdb:vortex-file-compressed	-18.0%	-7.7%	-11.2%	+13.1%	➖ noise
93	datafusion:vortex-compact	-8.4%	-11.7%	+3.7%	+10.0%	➖ noise
93	datafusion:vortex-file-compressed	-23.1%	-11.7%	-12.9%	+10.0%	✅ faster
93	duckdb:duckdb	-11.9%	-11.7%	-0.3%	+10.0%	➖ noise
93	duckdb:vortex-compact	-12.2%	-11.7%	-0.6%	+10.0%	➖ noise
93	duckdb:vortex-file-compressed	-11.0%	-11.7%	+0.8%	+11.4%	➖ noise
94	datafusion:vortex-compact	-8.9%	-10.1%	+1.4%	+10.0%	➖ noise
94	datafusion:vortex-file-compressed	-12.6%	-10.1%	-2.7%	+10.0%	➖ noise
94	duckdb:duckdb	-9.6%	-10.1%	+0.6%	+11.7%	➖ noise
94	duckdb:vortex-compact	-17.0%	-10.1%	-7.6%	+11.0%	➖ noise
94	duckdb:vortex-file-compressed	-21.0%	-10.1%	-12.2%	+10.0%	✅ faster
95	datafusion:vortex-compact	-5.9%	+4.0%	-9.6%	+11.7%	➖ noise
95	datafusion:vortex-file-compressed	-16.7%	+4.0%	-19.9%	+10.9%	✅ faster
95	duckdb:duckdb	-7.5%	+4.0%	-11.1%	+18.2%	➖ noise
95	duckdb:vortex-compact	-2.8%	+4.0%	-6.6%	+18.8%	➖ noise
95	duckdb:vortex-file-compressed	-5.0%	+4.0%	-8.7%	+15.1%	➖ noise
96	datafusion:vortex-compact	-3.3%	-1.6%	-1.7%	+10.0%	➖ noise
96	datafusion:vortex-file-compressed	-16.9%	-1.6%	-15.5%	+11.9%	✅ faster
96	duckdb:duckdb	-13.8%	-1.6%	-12.4%	+14.5%	➖ noise
96	duckdb:vortex-compact	-10.6%	-1.6%	-9.1%	+12.4%	➖ noise
96	duckdb:vortex-file-compressed	-18.1%	-1.6%	-16.7%	+13.4%	✅ faster
97	datafusion:vortex-compact	-5.2%	-11.8%	+7.5%	+10.0%	➖ noise
97	datafusion:vortex-file-compressed	-18.0%	-11.8%	-7.0%	+10.3%	➖ noise
97	duckdb:duckdb	-12.6%	-11.8%	-1.0%	+16.4%	➖ noise
97	duckdb:vortex-compact	-5.4%	-11.8%	+7.2%	+14.3%	➖ noise
97	duckdb:vortex-file-compressed	-7.6%	-11.8%	+4.7%	+10.7%	➖ noise
98	datafusion:vortex-compact	-3.7%	-11.5%	+8.8%	+10.5%	➖ noise
98	datafusion:vortex-file-compressed	-24.5%	-11.5%	-14.8%	+10.4%	✅ faster
98	duckdb:duckdb	-21.4%	-11.5%	-11.2%	+20.6%	➖ noise
98	duckdb:vortex-compact	-7.5%	-11.5%	+4.5%	+13.2%	➖ noise
98	duckdb:vortex-file-compressed	-17.0%	-11.5%	-6.3%	+15.8%	➖ noise
99	datafusion:vortex-compact	-5.1%	-12.6%	+8.6%	+17.5%	➖ noise
99	datafusion:vortex-file-compressed	-14.7%	-12.6%	-2.4%	+17.1%	➖ noise
99	duckdb:duckdb	-3.3%	-12.6%	+10.7%	+24.1%	➖ noise
99	duckdb:vortex-compact	-11.0%	-12.6%	+1.9%	+26.2%	➖ noise
99	duckdb:vortex-file-compressed	-5.5%	-12.6%	+8.1%	+38.3%	➖ noise

github-actions · 2026-01-27T18:05:16Z

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.896x ✅
Shifts: Parquet (control) -10.4% · Median polish -10.6%

datafusion / vortex-file-compressed (0.979x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	398310182	410413501	0.97
tpch_q02/datafusion:vortex-file-compressed	115105053	117955750	0.98
tpch_q03/datafusion:vortex-file-compressed	205870407	208645102	0.99
tpch_q04/datafusion:vortex-file-compressed	101991068	102371251	1.00
tpch_q05/datafusion:vortex-file-compressed	379899391	393164499	0.97
tpch_q06/datafusion:vortex-file-compressed	40386152	42196135	0.96
tpch_q07/datafusion:vortex-file-compressed	559315663	575133860	0.97
tpch_q08/datafusion:vortex-file-compressed	380240800	386576042	0.98
tpch_q09/datafusion:vortex-file-compressed	660273378	680495328	0.97
tpch_q10/datafusion:vortex-file-compressed	234323172	238679795	0.98
tpch_q11/datafusion:vortex-file-compressed	88045795	87440530	1.01
tpch_q12/datafusion:vortex-file-compressed	110928701	113248748	0.98
tpch_q13/datafusion:vortex-file-compressed	220536978	223355083	0.99
tpch_q14/datafusion:vortex-file-compressed	59128765	63102738	0.94
tpch_q15/datafusion:vortex-file-compressed	110042426	111593073	0.99
tpch_q16/datafusion:vortex-file-compressed	78270585	79174877	0.99
tpch_q17/datafusion:vortex-file-compressed	649855438	653894952	0.99
tpch_q18/datafusion:vortex-file-compressed	874585054	903687378	0.97
tpch_q19/datafusion:vortex-file-compressed	115512678	115168486	1.00
tpch_q20/datafusion:vortex-file-compressed	174665823	173990083	1.00
tpch_q21/datafusion:vortex-file-compressed	659260226	673716322	0.98
tpch_q22/datafusion:vortex-file-compressed	60525076	63436150	0.95

datafusion / vortex-compact (0.897x ✅, 12↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	428135324	436144215	0.98
tpch_q02/datafusion:vortex-compact	123041346	121343678	1.01
tpch_q03/datafusion:vortex-compact	218311196	218267671	1.00
tpch_q04/datafusion:vortex-compact	120180348	122094426	0.98
tpch_q05/datafusion:vortex-compact	393418168	396136963	0.99
tpch_q06/datafusion:vortex-compact	63539311	63917797	0.99
tpch_q07/datafusion:vortex-compact	586287569	589996384	0.99
tpch_q08/datafusion:vortex-compact	385193607	399522382	0.96
tpch_q09/datafusion:vortex-compact	682199836	695827027	0.98
tpch_q10/datafusion:vortex-compact	278026315	307521351	0.90
tpch_q11/datafusion:vortex-compact 🚀	92019454	111771363	0.82
tpch_q12/datafusion:vortex-compact 🚀	172804588	202002272	0.86
tpch_q13/datafusion:vortex-compact 🚀	274248905	317662750	0.86
tpch_q14/datafusion:vortex-compact 🚀	74491291	89558112	0.83
tpch_q15/datafusion:vortex-compact 🚀	165459548	199697293	0.83
tpch_q16/datafusion:vortex-compact 🚀	82767646	99405391	0.83
tpch_q17/datafusion:vortex-compact 🚀	655482012	840116642	0.78
tpch_q18/datafusion:vortex-compact 🚀	893198459	1124435400	0.79
tpch_q19/datafusion:vortex-compact 🚀	210716454	237897086	0.89
tpch_q20/datafusion:vortex-compact 🚀	198240406	244982240	0.81
tpch_q21/datafusion:vortex-compact 🚀	703090497	876455848	0.80
tpch_q22/datafusion:vortex-compact 🚀	71770199	80613774	0.89

datafusion / parquet (0.861x ✅, 17↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	441753795	490087341	0.90
tpch_q02/datafusion:parquet 🚀	186151328	216448504	0.86
tpch_q03/datafusion:parquet 🚀	303078296	360436692	0.84
tpch_q04/datafusion:parquet 🚀	132128423	157638321	0.84
tpch_q05/datafusion:parquet 🚀	446949281	555676404	0.80
tpch_q06/datafusion:parquet 🚀	125126013	143615923	0.87
tpch_q07/datafusion:parquet 🚀	628368993	794789206	0.79
tpch_q08/datafusion:parquet 🚀	489898307	602759223	0.81
tpch_q09/datafusion:parquet 🚀	764140430	948058713	0.81
tpch_q10/datafusion:parquet 🚀	499464218	595228631	0.84
tpch_q11/datafusion:parquet 🚀	130741157	152040275	0.86
tpch_q12/datafusion:parquet 🚀	200774570	246006026	0.82
tpch_q13/datafusion:parquet 🚀	341829658	381900868	0.90
tpch_q14/datafusion:parquet 🚀	156541887	180467996	0.87
tpch_q15/datafusion:parquet 🚀	240186641	316894585	0.76
tpch_q16/datafusion:parquet 🚀	133681274	153541901	0.87
tpch_q17/datafusion:parquet 🚀	685121560	848295266	0.81
tpch_q18/datafusion:parquet 🚀	884686504	1124148899	0.79
tpch_q19/datafusion:parquet	269319748	265538026	1.01
tpch_q20/datafusion:parquet	309344096	312582478	0.99
tpch_q21/datafusion:parquet	740639909	759166618	0.98
tpch_q22/datafusion:parquet	221794385	220489905	1.01

datafusion / arrow (0.802x ✅, 21↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	602856152	749853001	0.80
tpch_q02/datafusion:arrow 🚀	166061165	194728684	0.85
tpch_q03/datafusion:arrow 🚀	478726098	604429218	0.79
tpch_q04/datafusion:arrow 🚀	365277260	483803590	0.76
tpch_q05/datafusion:arrow 🚀	922992195	1223640834	0.75
tpch_q06/datafusion:arrow 🚀	280202824	363911192	0.77
tpch_q07/datafusion:arrow 🚀	1134035599	1572110820	0.72
tpch_q08/datafusion:arrow 🚀	1145825995	1528490008	0.75
tpch_q09/datafusion:arrow 🚀	1349393189	1725343970	0.78
tpch_q10/datafusion:arrow 🚀	601888785	790666729	0.76
tpch_q11/datafusion:arrow 🚀	151308398	175838155	0.86
tpch_q12/datafusion:arrow 🚀	667263527	825266628	0.81
tpch_q13/datafusion:arrow 🚀	525526212	603028064	0.87
tpch_q14/datafusion:arrow 🚀	305103101	430125379	0.71
tpch_q15/datafusion:arrow 🚀	672522062	962480258	0.70
tpch_q16/datafusion:arrow 🚀	108328383	127534454	0.85
tpch_q17/datafusion:arrow 🚀	1329351347	1663588375	0.80
tpch_q18/datafusion:arrow 🚀	1870476688	2155662020	0.87
tpch_q19/datafusion:arrow 🚀	517280364	597265140	0.87
tpch_q20/datafusion:arrow 🚀	498116755	590483657	0.84
tpch_q21/datafusion:arrow	2856910407	2990244786	0.96
tpch_q22/datafusion:arrow 🚀	144729493	173611779	0.83

duckdb / vortex-file-compressed (0.932x ➖, 2↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	174224557	183678329	0.95
tpch_q02/duckdb:vortex-file-compressed	51846341	55777512	0.93
tpch_q03/duckdb:vortex-file-compressed	125675088	136378079	0.92
tpch_q04/duckdb:vortex-file-compressed	148266560	162599664	0.91
tpch_q05/duckdb:vortex-file-compressed	130287127	138625782	0.94
tpch_q06/duckdb:vortex-file-compressed	48391661	51634010	0.94
tpch_q07/duckdb:vortex-file-compressed	147389080	158360104	0.93
tpch_q08/duckdb:vortex-file-compressed	173573141	184728078	0.94
tpch_q09/duckdb:vortex-file-compressed	337370598	353733487	0.95
tpch_q10/duckdb:vortex-file-compressed	152947921	166969523	0.92
tpch_q11/duckdb:vortex-file-compressed	36016254	38988831	0.92
tpch_q12/duckdb:vortex-file-compressed	92914823	99097172	0.94
tpch_q13/duckdb:vortex-file-compressed	245977961	262947423	0.94
tpch_q14/duckdb:vortex-file-compressed 🚀	67430850	79020997	0.85
tpch_q15/duckdb:vortex-file-compressed	97430377	107215423	0.91
tpch_q16/duckdb:vortex-file-compressed	79587711	86402420	0.92
tpch_q17/duckdb:vortex-file-compressed 🚀	100020293	112462874	0.89
tpch_q18/duckdb:vortex-file-compressed	277429237	286233055	0.97
tpch_q19/duckdb:vortex-file-compressed	91021791	94125490	0.97
tpch_q20/duckdb:vortex-file-compressed	163733563	175290999	0.93
tpch_q21/duckdb:vortex-file-compressed	555517946	583385094	0.95
tpch_q22/duckdb:vortex-file-compressed	79549167	79663493	1.00

duckdb / vortex-compact (0.939x ➖, 0↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	231260011	231586365	1.00
tpch_q02/duckdb:vortex-compact	59681292	60346459	0.99
tpch_q03/duckdb:vortex-compact	140269517	145944816	0.96
tpch_q04/duckdb:vortex-compact	180223533	188042426	0.96
tpch_q05/duckdb:vortex-compact	150291852	161072578	0.93
tpch_q06/duckdb:vortex-compact	85148284	90214575	0.94
tpch_q07/duckdb:vortex-compact	206695043	222417757	0.93
tpch_q08/duckdb:vortex-compact	191964386	210598208	0.91
tpch_q09/duckdb:vortex-compact	368057229	386697301	0.95
tpch_q10/duckdb:vortex-compact	186794947	204586901	0.91
tpch_q11/duckdb:vortex-compact	41920276	46442815	0.90
tpch_q12/duckdb:vortex-compact	209026789	217284362	0.96
tpch_q13/duckdb:vortex-compact	292487443	315330772	0.93
tpch_q14/duckdb:vortex-compact	101216755	111526898	0.91
tpch_q15/duckdb:vortex-compact	119797543	126816721	0.94
tpch_q16/duckdb:vortex-compact	85318598	88656301	0.96
tpch_q17/duckdb:vortex-compact	114513444	125472490	0.91
tpch_q18/duckdb:vortex-compact	292161805	312851648	0.93
tpch_q19/duckdb:vortex-compact	113683936	122542850	0.93
tpch_q20/duckdb:vortex-compact	206282849	219385477	0.94
tpch_q21/duckdb:vortex-compact	629234513	675069384	0.93
tpch_q22/duckdb:vortex-compact	89814573	96360425	0.93

duckdb / parquet (0.932x ➖, 2↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	251867700	276277456	0.91
tpch_q02/duckdb:parquet	99544393	108822175	0.91
tpch_q03/duckdb:parquet	207760346	226836526	0.92
tpch_q04/duckdb:parquet	135852410	144808150	0.94
tpch_q05/duckdb:parquet	215929156	236922620	0.91
tpch_q06/duckdb:parquet	66615479	73057787	0.91
tpch_q07/duckdb:parquet	185392351	197010723	0.94
tpch_q08/duckdb:parquet	255823540	279351291	0.92
tpch_q09/duckdb:parquet 🚀	439169073	516001924	0.85
tpch_q10/duckdb:parquet	603916824	645554247	0.94
tpch_q11/duckdb:parquet 🚀	37893569	43410237	0.87
tpch_q12/duckdb:parquet	126285181	133526717	0.95
tpch_q13/duckdb:parquet	443113041	477340249	0.93
tpch_q14/duckdb:parquet	178016136	186555927	0.95
tpch_q15/duckdb:parquet	99110080	100972914	0.98
tpch_q16/duckdb:parquet	162251153	167085395	0.97
tpch_q17/duckdb:parquet	179349089	186089914	0.96
tpch_q18/duckdb:parquet	349226224	386646565	0.90
tpch_q19/duckdb:parquet	286281518	292886537	0.98
tpch_q20/duckdb:parquet	231072419	236731415	0.98
tpch_q21/duckdb:parquet	567552240	615109941	0.92
tpch_q22/duckdb:parquet	289593347	297214451	0.97

duckdb / duckdb (0.872x ✅, 18↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	117379592	122187684	0.96
tpch_q02/duckdb:duckdb	48896842	48165735	1.02
tpch_q03/duckdb:duckdb	97611167	107243525	0.91
tpch_q04/duckdb:duckdb 🚀	128526621	149347783	0.86
tpch_q05/duckdb:duckdb 🚀	107821835	124490300	0.87
tpch_q06/duckdb:duckdb	38148151	40075841	0.95
tpch_q07/duckdb:duckdb 🚀	86214793	96573574	0.89
tpch_q08/duckdb:duckdb 🚀	110510922	127955996	0.86
tpch_q09/duckdb:duckdb 🚀	277678520	327249047	0.85
tpch_q10/duckdb:duckdb 🚀	201898167	241511552	0.84
tpch_q11/duckdb:duckdb 🚀	15215068	19340482	0.79
tpch_q12/duckdb:duckdb 🚀	84184886	96917741	0.87
tpch_q13/duckdb:duckdb 🚀	252330487	301108250	0.84
tpch_q14/duckdb:duckdb 🚀	70171050	82154912	0.85
tpch_q15/duckdb:duckdb 🚀	78848720	89634124	0.88
tpch_q16/duckdb:duckdb 🚀	72814129	89084765	0.82
tpch_q17/duckdb:duckdb 🚀	84512603	94953551	0.89
tpch_q18/duckdb:duckdb 🚀	213900137	254973861	0.84
tpch_q19/duckdb:duckdb 🚀	115832359	133234802	0.87
tpch_q20/duckdb:duckdb 🚀	110220533	125047140	0.88
tpch_q21/duckdb:duckdb 🚀	301512380	369304519	0.82
tpch_q22/duckdb:duckdb 🚀	68415201	78377844	0.87

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-19.6%	-9.4%	-11.3%	+13.8%	➖ noise
1	datafusion:vortex-compact	-1.8%	-9.4%	+8.3%	+13.8%	➖ noise
1	datafusion:vortex-file-compressed	-2.9%	-9.4%	+7.1%	+14.6%	➖ noise
1	duckdb:duckdb	-3.9%	-9.4%	+6.0%	+13.8%	➖ noise
1	duckdb:vortex-compact	-0.1%	-9.4%	+10.2%	+13.8%	➖ noise
1	duckdb:vortex-file-compressed	-5.1%	-9.4%	+4.6%	+13.8%	➖ noise
2	datafusion:arrow	-14.7%	-11.3%	-3.9%	+13.8%	➖ noise
2	datafusion:vortex-compact	+1.4%	-11.3%	+14.3%	+13.8%	🚨 regression
2	datafusion:vortex-file-compressed	-2.4%	-11.3%	+10.0%	+13.8%	➖ noise
2	duckdb:duckdb	+1.5%	-11.3%	+14.5%	+13.8%	🚨 regression
2	duckdb:vortex-compact	-1.1%	-11.3%	+11.5%	+13.8%	➖ noise
2	duckdb:vortex-file-compressed	-7.0%	-11.3%	+4.8%	+13.8%	➖ noise
3	datafusion:arrow	-20.8%	-12.2%	-9.7%	+13.8%	➖ noise
3	datafusion:vortex-compact	+0.0%	-12.2%	+14.0%	+13.8%	🚨 regression
3	datafusion:vortex-file-compressed	-1.3%	-12.2%	+12.4%	+13.8%	➖ noise
3	duckdb:duckdb	-9.0%	-12.2%	+3.7%	+13.8%	➖ noise
3	duckdb:vortex-compact	-3.9%	-12.2%	+9.5%	+13.8%	➖ noise
3	duckdb:vortex-file-compressed	-7.8%	-12.2%	+5.0%	+13.8%	➖ noise
4	datafusion:arrow	-24.5%	-11.3%	-14.9%	+13.8%	✅ faster
4	datafusion:vortex-compact	-1.6%	-11.3%	+11.0%	+13.8%	➖ noise
4	datafusion:vortex-file-compressed	-0.4%	-11.3%	+12.4%	+13.8%	➖ noise
4	duckdb:duckdb	-13.9%	-11.3%	-3.0%	+13.8%	➖ noise
4	duckdb:vortex-compact	-4.2%	-11.3%	+8.1%	+13.8%	➖ noise
4	duckdb:vortex-file-compressed	-8.8%	-11.3%	+2.8%	+13.8%	➖ noise
5	datafusion:arrow	-24.6%	-14.4%	-11.9%	+13.8%	➖ noise
5	datafusion:vortex-compact	-0.7%	-14.4%	+16.0%	+13.8%	🚨 regression
5	datafusion:vortex-file-compressed	-3.4%	-14.4%	+12.9%	+13.8%	➖ noise
5	duckdb:duckdb	-13.4%	-14.4%	+1.2%	+13.8%	➖ noise
5	duckdb:vortex-compact	-6.7%	-14.4%	+9.0%	+13.8%	➖ noise
5	duckdb:vortex-file-compressed	-6.0%	-14.4%	+9.8%	+13.8%	➖ noise
6	datafusion:arrow	-23.0%	-10.9%	-13.6%	+13.8%	✅ faster
6	datafusion:vortex-compact	-0.6%	-10.9%	+11.5%	+13.8%	➖ noise
6	datafusion:vortex-file-compressed	-4.3%	-10.9%	+7.4%	+13.8%	➖ noise
6	duckdb:duckdb	-4.8%	-10.9%	+6.8%	+14.0%	➖ noise
6	duckdb:vortex-compact	-5.6%	-10.9%	+5.9%	+13.8%	➖ noise
6	duckdb:vortex-file-compressed	-6.3%	-10.9%	+5.1%	+13.8%	➖ noise
7	datafusion:arrow	-27.9%	-13.7%	-16.4%	+13.8%	✅ faster
7	datafusion:vortex-compact	-0.6%	-13.7%	+15.2%	+13.8%	🚨 regression
7	datafusion:vortex-file-compressed	-2.8%	-13.7%	+12.7%	+13.8%	➖ noise
7	duckdb:duckdb	-10.7%	-13.7%	+3.5%	+13.8%	➖ noise
7	duckdb:vortex-compact	-7.1%	-13.7%	+7.7%	+13.8%	➖ noise
7	duckdb:vortex-file-compressed	-6.9%	-13.7%	+7.9%	+13.8%	➖ noise
8	datafusion:arrow	-25.0%	-13.7%	-13.1%	+13.8%	✅ faster
8	datafusion:vortex-compact	-3.6%	-13.7%	+11.8%	+13.8%	➖ noise
8	datafusion:vortex-file-compressed	-1.6%	-13.7%	+14.0%	+13.8%	🚨 regression
8	duckdb:duckdb	-13.6%	-13.7%	+0.1%	+13.8%	➖ noise
8	duckdb:vortex-compact	-8.8%	-13.7%	+5.7%	+13.8%	➖ noise
8	duckdb:vortex-file-compressed	-6.0%	-13.7%	+8.9%	+13.8%	➖ noise
9	datafusion:arrow	-21.8%	-17.2%	-5.6%	+13.8%	➖ noise
9	datafusion:vortex-compact	-2.0%	-17.2%	+18.4%	+13.8%	🚨 regression
9	datafusion:vortex-file-compressed	-3.0%	-17.2%	+17.1%	+13.8%	🚨 regression
9	duckdb:duckdb	-15.1%	-17.2%	+2.4%	+13.8%	➖ noise
9	duckdb:vortex-compact	-4.8%	-17.2%	+14.9%	+13.8%	🚨 regression
9	duckdb:vortex-file-compressed	-4.6%	-17.2%	+15.2%	+13.8%	🚨 regression
10	datafusion:arrow	-23.9%	-11.4%	-14.1%	+13.8%	✅ faster
10	datafusion:vortex-compact	-9.6%	-11.4%	+2.0%	+13.8%	➖ noise
10	datafusion:vortex-file-compressed	-1.8%	-11.4%	+10.8%	+13.8%	➖ noise
10	duckdb:duckdb	-16.4%	-11.4%	-5.6%	+13.8%	➖ noise
10	duckdb:vortex-compact	-8.7%	-11.4%	+3.1%	+13.8%	➖ noise
10	duckdb:vortex-file-compressed	-8.4%	-11.4%	+3.4%	+13.8%	➖ noise
11	datafusion:arrow	-14.0%	-13.4%	-0.7%	+13.8%	➖ noise
11	datafusion:vortex-compact	-17.7%	-13.4%	-5.0%	+13.8%	➖ noise
11	datafusion:vortex-file-compressed	+0.7%	-13.4%	+16.2%	+13.8%	🚨 regression
11	duckdb:duckdb	-21.3%	-13.4%	-9.2%	+18.3%	➖ noise
11	duckdb:vortex-compact	-9.7%	-13.4%	+4.2%	+13.8%	➖ noise
11	duckdb:vortex-file-compressed	-7.6%	-13.4%	+6.6%	+17.8%	➖ noise
12	datafusion:arrow	-19.1%	-12.1%	-8.0%	+55.9%	➖ noise
12	datafusion:vortex-compact	-14.5%	-12.1%	-2.6%	+13.8%	➖ noise
12	datafusion:vortex-file-compressed	-2.0%	-12.1%	+11.5%	+13.8%	➖ noise
12	duckdb:duckdb	-13.1%	-12.1%	-1.1%	+13.8%	➖ noise
12	duckdb:vortex-compact	-3.8%	-12.1%	+9.5%	+13.8%	➖ noise
12	duckdb:vortex-file-compressed	-6.2%	-12.1%	+6.7%	+13.8%	➖ noise
13	datafusion:arrow	-12.9%	-8.8%	-4.4%	+13.8%	➖ noise
13	datafusion:vortex-compact	-13.7%	-8.8%	-5.3%	+13.8%	➖ noise
13	datafusion:vortex-file-compressed	-1.3%	-8.8%	+8.3%	+13.8%	➖ noise
13	duckdb:duckdb	-16.2%	-8.8%	-8.1%	+13.8%	➖ noise
13	duckdb:vortex-compact	-7.2%	-8.8%	+1.8%	+13.8%	➖ noise
13	duckdb:vortex-file-compressed	-6.5%	-8.8%	+2.6%	+13.8%	➖ noise
14	datafusion:arrow	-29.1%	-9.0%	-22.0%	+13.8%	✅ faster
14	datafusion:vortex-compact	-16.8%	-9.0%	-8.6%	+13.8%	➖ noise
14	datafusion:vortex-file-compressed	-6.3%	-9.0%	+3.0%	+13.8%	➖ noise
14	duckdb:duckdb	-14.6%	-9.0%	-6.1%	+13.8%	➖ noise
14	duckdb:vortex-compact	-9.2%	-9.0%	-0.2%	+13.8%	➖ noise
14	duckdb:vortex-file-compressed	-14.7%	-9.0%	-6.2%	+13.8%	➖ noise
15	datafusion:arrow	-30.1%	-13.7%	-19.0%	+13.8%	✅ faster
15	datafusion:vortex-compact	-17.1%	-13.7%	-3.9%	+13.8%	➖ noise
15	datafusion:vortex-file-compressed	-1.4%	-13.7%	+14.3%	+13.8%	🚨 regression
15	duckdb:duckdb	-12.0%	-13.7%	+2.0%	+13.8%	➖ noise
15	duckdb:vortex-compact	-5.5%	-13.7%	+9.5%	+13.8%	➖ noise
15	duckdb:vortex-file-compressed	-9.1%	-13.7%	+5.4%	+13.8%	➖ noise
16	datafusion:arrow	-15.1%	-8.1%	-7.6%	+13.8%	➖ noise
16	datafusion:vortex-compact	-16.7%	-8.1%	-9.4%	+13.8%	➖ noise
16	datafusion:vortex-file-compressed	-1.1%	-8.1%	+7.5%	+13.8%	➖ noise
16	duckdb:duckdb	-18.3%	-8.1%	-11.1%	+13.8%	➖ noise
16	duckdb:vortex-compact	-3.8%	-8.1%	+4.7%	+13.8%	➖ noise
16	duckdb:vortex-file-compressed	-7.9%	-8.1%	+0.2%	+13.8%	➖ noise
17	datafusion:arrow	-20.1%	-11.8%	-9.4%	+13.8%	➖ noise
17	datafusion:vortex-compact	-22.0%	-11.8%	-11.6%	+13.8%	➖ noise
17	datafusion:vortex-file-compressed	-0.6%	-11.8%	+12.6%	+13.8%	➖ noise
17	duckdb:duckdb	-11.0%	-11.8%	+0.9%	+13.8%	➖ noise
17	duckdb:vortex-compact	-8.7%	-11.8%	+3.4%	+13.8%	➖ noise
17	duckdb:vortex-file-compressed	-11.1%	-11.8%	+0.8%	+13.8%	➖ noise
18	datafusion:arrow	-13.2%	-15.7%	+2.9%	+13.8%	➖ noise
18	datafusion:vortex-compact	-20.6%	-15.7%	-5.8%	+13.8%	➖ noise
18	datafusion:vortex-file-compressed	-3.2%	-15.7%	+14.8%	+13.8%	🚨 regression
18	duckdb:duckdb	-16.1%	-15.7%	-0.5%	+13.8%	➖ noise
18	duckdb:vortex-compact	-6.6%	-15.7%	+10.8%	+13.8%	➖ noise
18	duckdb:vortex-file-compressed	-3.1%	-15.7%	+15.0%	+13.8%	🚨 regression
19	datafusion:arrow	-13.4%	-0.4%	-13.0%	+13.8%	✅ faster
19	datafusion:vortex-compact	-11.4%	-0.4%	-11.0%	+16.5%	➖ noise
19	datafusion:vortex-file-compressed	+0.3%	-0.4%	+0.7%	+13.8%	➖ noise
19	duckdb:duckdb	-13.1%	-0.4%	-12.7%	+13.8%	✅ faster
19	duckdb:vortex-compact	-7.2%	-0.4%	-6.8%	+13.8%	➖ noise
19	duckdb:vortex-file-compressed	-3.3%	-0.4%	-2.9%	+13.8%	➖ noise
20	datafusion:arrow	-15.6%	-1.7%	-14.2%	+13.8%	✅ faster
20	datafusion:vortex-compact	-19.1%	-1.7%	-17.7%	+13.8%	✅ faster
20	datafusion:vortex-file-compressed	+0.4%	-1.7%	+2.1%	+13.8%	➖ noise
20	duckdb:duckdb	-11.9%	-1.7%	-10.3%	+13.8%	➖ noise
20	duckdb:vortex-compact	-6.0%	-1.7%	-4.3%	+13.8%	➖ noise
20	duckdb:vortex-file-compressed	-6.6%	-1.7%	-5.0%	+13.8%	➖ noise
21	datafusion:arrow	-4.5%	-5.1%	+0.7%	+13.8%	➖ noise
21	datafusion:vortex-compact	-19.8%	-5.1%	-15.4%	+13.8%	✅ faster
21	datafusion:vortex-file-compressed	-2.1%	-5.1%	+3.1%	+13.8%	➖ noise
21	duckdb:duckdb	-18.4%	-5.1%	-13.9%	+13.8%	✅ faster
21	duckdb:vortex-compact	-6.8%	-5.1%	-1.8%	+13.8%	➖ noise
21	duckdb:vortex-file-compressed	-4.8%	-5.1%	+0.4%	+13.8%	➖ noise
22	datafusion:arrow	-16.6%	-1.0%	-15.8%	+13.8%	✅ faster
22	datafusion:vortex-compact	-11.0%	-1.0%	-10.1%	+13.8%	➖ noise
22	datafusion:vortex-file-compressed	-4.6%	-1.0%	-3.6%	+13.8%	➖ noise
22	duckdb:duckdb	-12.7%	-1.0%	-11.8%	+13.8%	➖ noise
22	duckdb:vortex-compact	-6.8%	-1.0%	-5.9%	+13.8%	➖ noise
22	duckdb:vortex-file-compressed	-0.1%	-1.0%	+0.9%	+13.8%	➖ noise

cloudflare-workers-and-pages · 2026-02-02T18:36:13Z

Deploying vortex-bench with Cloudflare Pages

Latest commit:	`44fe13b`
Status:	✅ Deploy successful!
Preview URL:	https://c223cf31.vortex-93b.pages.dev
Branch Preview URL:	https://adamg-benchmark-on-metal2.vortex-93b.pages.dev

View logs

github-actions · 2026-02-26T14:50:30Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`672002c`		1	Explore Profiling Data

Previous Runs (4)

Status	Commit	Attempt	Link
🟢 Done	`b718bf8`	1	Explore Profiling Data
🟢 Done	`d786f26`	1	Explore Profiling Data
🟢 Done	`60dc013`	2	Explore Profiling Data
🟢 Done	`60dc013`	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-02-26T14:51:30Z

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.885x ✅

datafusion / vortex-file-compressed (0.885x ✅, 7↑ 0↓)

name	PR `672002c` (ns)	base `b32c6b9` (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed	131826792	139561735	0.94
polarsignals_q01/datafusion:vortex-file-compressed 🚀	370341647	420491329	0.88
polarsignals_q02/datafusion:vortex-file-compressed 🚀	22085244	26440721	0.84
polarsignals_q03/datafusion:vortex-file-compressed 🚀	381580872	426623975	0.89
polarsignals_q04/datafusion:vortex-file-compressed 🚀	10467737	12659655	0.83
polarsignals_q05/datafusion:vortex-file-compressed 🚀	15424953	17805365	0.87
polarsignals_q06/datafusion:vortex-file-compressed 🚀	18453247	20830505	0.89
polarsignals_q07/datafusion:vortex-file-compressed	13699948	15136889	0.91
polarsignals_q08/datafusion:vortex-file-compressed 🚀	464411167	529192199	0.88
polarsignals_q09/datafusion:vortex-file-compressed	10935772	11660448	0.94

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

github-actions · 2026-03-26T16:49:24Z

Benchmarks: TPC-H SF=100 on NVME with DataFusion

Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

datafusion / vortex-file-compressed (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	4019640951	nan
tpch_q02/datafusion:vortex-file-compressed	950056879	nan
tpch_q03/datafusion:vortex-file-compressed	2101699191	nan
tpch_q04/datafusion:vortex-file-compressed	1217324247	nan
tpch_q05/datafusion:vortex-file-compressed	4207563922	nan
tpch_q06/datafusion:vortex-file-compressed	355500860	nan
tpch_q07/datafusion:vortex-file-compressed	7039441804	nan
tpch_q08/datafusion:vortex-file-compressed	4537077730	nan
tpch_q09/datafusion:vortex-file-compressed	8572759566	nan
tpch_q10/datafusion:vortex-file-compressed	2701814143	nan
tpch_q11/datafusion:vortex-file-compressed	958294551	nan
tpch_q12/datafusion:vortex-file-compressed	1083517562	nan
tpch_q13/datafusion:vortex-file-compressed	2929222051	nan
tpch_q14/datafusion:vortex-file-compressed	567819105	nan
tpch_q15/datafusion:vortex-file-compressed	1138993436	nan
tpch_q16/datafusion:vortex-file-compressed	590411126	nan
tpch_q17/datafusion:vortex-file-compressed	9499560407	nan
tpch_q18/datafusion:vortex-file-compressed	12313701876	nan
tpch_q19/datafusion:vortex-file-compressed	1539407268	nan
tpch_q20/datafusion:vortex-file-compressed	1661402177	nan
tpch_q21/datafusion:vortex-file-compressed	8871369529	nan
tpch_q22/datafusion:vortex-file-compressed	571072421	nan

datafusion / vortex-compact (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	4241063532	nan
tpch_q02/datafusion:vortex-compact	984400750	nan
tpch_q03/datafusion:vortex-compact	2240069478	nan
tpch_q04/datafusion:vortex-compact	1228382613	nan
tpch_q05/datafusion:vortex-compact	4157479416	nan
tpch_q06/datafusion:vortex-compact	572021270	nan
tpch_q07/datafusion:vortex-compact	6687187625	nan
tpch_q08/datafusion:vortex-compact	3750017727	nan
tpch_q09/datafusion:vortex-compact	7559949515	nan
tpch_q10/datafusion:vortex-compact	2836306561	nan
tpch_q11/datafusion:vortex-compact	951491444	nan
tpch_q12/datafusion:vortex-compact	1560518206	nan
tpch_q13/datafusion:vortex-compact	3184829127	nan
tpch_q14/datafusion:vortex-compact	817990642	nan
tpch_q15/datafusion:vortex-compact	1315535096	nan
tpch_q16/datafusion:vortex-compact	549259430	nan
tpch_q17/datafusion:vortex-compact	7800132988	nan
tpch_q18/datafusion:vortex-compact	12051871379	nan
tpch_q19/datafusion:vortex-compact	2536219426	nan
tpch_q20/datafusion:vortex-compact	1955874509	nan
tpch_q21/datafusion:vortex-compact	9219533324	nan
tpch_q22/datafusion:vortex-compact	622027970	nan

datafusion / parquet (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/datafusion:parquet	3762836829	nan
tpch_q02/datafusion:parquet	1267355765	nan
tpch_q03/datafusion:parquet	2690207174	nan
tpch_q04/datafusion:parquet	1439863238	nan
tpch_q05/datafusion:parquet	4399411462	nan
tpch_q06/datafusion:parquet	1028120666	nan
tpch_q07/datafusion:parquet	7895754267	nan
tpch_q08/datafusion:parquet	4160200802	nan
tpch_q09/datafusion:parquet	8143289550	nan
tpch_q10/datafusion:parquet	3629343647	nan
tpch_q11/datafusion:parquet	1109379040	nan
tpch_q12/datafusion:parquet	1850895073	nan
tpch_q13/datafusion:parquet	3445811345	nan
tpch_q14/datafusion:parquet	1178124792	nan
tpch_q15/datafusion:parquet	2438772262	nan
tpch_q16/datafusion:parquet	800722918	nan
tpch_q17/datafusion:parquet	8447618695	nan
tpch_q18/datafusion:parquet	11818227611	nan
tpch_q19/datafusion:parquet	1995550895	nan
tpch_q20/datafusion:parquet	2609138963	nan
tpch_q21/datafusion:parquet	10443018575	nan
tpch_q22/datafusion:parquet	709625669	nan

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

github-actions · 2026-03-26T17:25:03Z

Benchmarks: TPC-H SF=100 on NVME with DuckDB

Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

duckdb / vortex-file-compressed (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	1487081109	nan
tpch_q02/duckdb:vortex-file-compressed	311066229	nan
tpch_q03/duckdb:vortex-file-compressed	1285166026	nan
tpch_q04/duckdb:vortex-file-compressed	1404443460	nan
tpch_q05/duckdb:vortex-file-compressed	1136573512	nan
tpch_q06/duckdb:vortex-file-compressed	462887029	nan
tpch_q07/duckdb:vortex-file-compressed	1449327484	nan
tpch_q08/duckdb:vortex-file-compressed	1413871999	nan
tpch_q09/duckdb:vortex-file-compressed	3868252465	nan
tpch_q10/duckdb:vortex-file-compressed	1267787481	nan
tpch_q11/duckdb:vortex-file-compressed	214212097	nan
tpch_q12/duckdb:vortex-file-compressed	841487467	nan
tpch_q13/duckdb:vortex-file-compressed	2500246392	nan
tpch_q14/duckdb:vortex-file-compressed	674892835	nan
tpch_q15/duckdb:vortex-file-compressed	905444786	nan
tpch_q16/duckdb:vortex-file-compressed	484959992	nan
tpch_q17/duckdb:vortex-file-compressed	1148401338	nan
tpch_q18/duckdb:vortex-file-compressed	3091883307	nan
tpch_q19/duckdb:vortex-file-compressed	694322301	nan
tpch_q20/duckdb:vortex-file-compressed	1565525738	nan
tpch_q21/duckdb:vortex-file-compressed	4764659896	nan
tpch_q22/duckdb:vortex-file-compressed	530452935	nan

duckdb / vortex-compact (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	1952058688	nan
tpch_q02/duckdb:vortex-compact	340850302	nan
tpch_q03/duckdb:vortex-compact	1303120574	nan
tpch_q04/duckdb:vortex-compact	1577038963	nan
tpch_q05/duckdb:vortex-compact	1184818433	nan
tpch_q06/duckdb:vortex-compact	825489845	nan
tpch_q07/duckdb:vortex-compact	1817839840	nan
tpch_q08/duckdb:vortex-compact	1521880785	nan
tpch_q09/duckdb:vortex-compact	4075130518	nan
tpch_q10/duckdb:vortex-compact	1461975891	nan
tpch_q11/duckdb:vortex-compact	273439240	nan
tpch_q12/duckdb:vortex-compact	1951564350	nan
tpch_q13/duckdb:vortex-compact	2854924691	nan
tpch_q14/duckdb:vortex-compact	1253666591	nan
tpch_q15/duckdb:vortex-compact	1084933264	nan
tpch_q16/duckdb:vortex-compact	507814281	nan
tpch_q17/duckdb:vortex-compact	1511998901	nan
tpch_q18/duckdb:vortex-compact	2733915998	nan
tpch_q19/duckdb:vortex-compact	1023277065	nan
tpch_q20/duckdb:vortex-compact	1979504814	nan
tpch_q21/duckdb:vortex-compact	5365337580	nan
tpch_q22/duckdb:vortex-compact	601869518	nan

duckdb / parquet (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/duckdb:parquet	2062260171	nan
tpch_q02/duckdb:parquet	605511609	nan
tpch_q03/duckdb:parquet	1523539380	nan
tpch_q04/duckdb:parquet	998911488	nan
tpch_q05/duckdb:parquet	1646000856	nan
tpch_q06/duckdb:parquet	590851323	nan
tpch_q07/duckdb:parquet	1596000014	nan
tpch_q08/duckdb:parquet	1960268105	nan
tpch_q09/duckdb:parquet	4572699270	nan
tpch_q10/duckdb:parquet	2032019130	nan
tpch_q11/duckdb:parquet	291063759	nan
tpch_q12/duckdb:parquet	914813760	nan
tpch_q13/duckdb:parquet	2984360744	nan
tpch_q14/duckdb:parquet	1137872137	nan
tpch_q15/duckdb:parquet	1164011297	nan
tpch_q16/duckdb:parquet	659591215	nan
tpch_q17/duckdb:parquet	1554691093	nan
tpch_q18/duckdb:parquet	3062393870	nan
tpch_q19/duckdb:parquet	1757237325	nan
tpch_q20/duckdb:parquet	1647138140	nan
tpch_q21/duckdb:parquet	4924782650	nan
tpch_q22/duckdb:parquet	767025549	nan

duckdb / duckdb (no group data, 0↑ 0↓)

name	PR `672002c` (unit)	ratio (PR/base)
tpch_q01/duckdb:duckdb	1267827147	nan
tpch_q02/duckdb:duckdb	268462181	nan
tpch_q03/duckdb:duckdb	1088194469	nan
tpch_q04/duckdb:duckdb	878260060	nan
tpch_q05/duckdb:duckdb	1116730689	nan
tpch_q06/duckdb:duckdb	508446415	nan
tpch_q07/duckdb:duckdb	1241033849	nan
tpch_q08/duckdb:duckdb	1144593425	nan
tpch_q09/duckdb:duckdb	3319800708	nan
tpch_q10/duckdb:duckdb	1537636083	nan
tpch_q11/duckdb:duckdb	116944233	nan
tpch_q12/duckdb:duckdb	878818656	nan
tpch_q13/duckdb:duckdb	2405489101	nan
tpch_q14/duckdb:duckdb	889628470	nan
tpch_q15/duckdb:duckdb	915784467	nan
tpch_q16/duckdb:duckdb	444326012	nan
tpch_q17/duckdb:duckdb	1017534784	nan
tpch_q18/duckdb:duckdb	2117187588	nan
tpch_q19/duckdb:duckdb	1306521012	nan
tpch_q20/duckdb:duckdb	1332555478	nan
tpch_q21/duckdb:duckdb	2534306805	nan
tpch_q22/duckdb:duckdb	465805537	nan

github-actions · 2026-04-16T02:16:14Z

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

AdamGS · 2026-04-16T15:56:50Z

Now basically #7456

AdamGS added changelog/skip Do not list PR in the changelog action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Jan 27, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jan 27, 2026

AdamGS force-pushed the adamg/benchmark-on-metal2 branch from 3147706 to 07600dc Compare January 27, 2026 17:36

AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jan 27, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jan 27, 2026

AdamGS force-pushed the adamg/benchmark-on-metal2 branch from 07600dc to f96f8f2 Compare January 29, 2026 09:07

AdamGS mentioned this pull request Jan 30, 2026

TPC-DS query 76 becomes much slower as target_partitions goes up apache/datafusion#20078

Open

AdamGS force-pushed the adamg/benchmark-on-metal2 branch from 44fe13b to e28096f Compare February 2, 2026 18:37

AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 2, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 2, 2026

AdamGS force-pushed the adamg/benchmark-on-metal2 branch from e28096f to 60dc013 Compare February 26, 2026 14:30

AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 26, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 26, 2026

AdamGS added 2 commits March 26, 2026 16:38

do the thing

6674ddc

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

YOLO

218aded

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

AdamGS force-pushed the adamg/benchmark-on-metal2 branch from 60dc013 to 218aded Compare March 26, 2026 16:39

Split DataFusion and DuckDB sf100 runs

d786f26

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026

fix

b718bf8

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026

no need for in-memory arrow here

672002c

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026

github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026

github-actions bot added the stale This PR is stale and will be auto-closed soon label Apr 16, 2026

AdamGS closed this Apr 16, 2026

Conversation

AdamGS commented Jan 27, 2026

Uh oh!

codspeed-hq bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will improve performance by 11.12%

Performance Changes

Footnotes

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on S3

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME

Uh oh!

cloudflare-workers-and-pages bot commented Feb 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Deploying vortex-bench with Cloudflare Pages

Uh oh!

github-actions bot commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions bot commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling

Uh oh!

github-actions bot commented Mar 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=100 on NVME with DataFusion

Uh oh!

github-actions bot commented Mar 26, 2026

Benchmarks: TPC-H SF=100 on NVME with DuckDB

Uh oh!

github-actions bot commented Apr 16, 2026

Uh oh!

AdamGS commented Apr 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

codspeed-hq bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

cloudflare-workers-and-pages bot commented Feb 2, 2026 •

edited

Loading

github-actions bot commented Feb 26, 2026 •

edited

Loading

github-actions bot commented Feb 26, 2026 •

edited

Loading

github-actions bot commented Mar 26, 2026 •

edited

Loading