1 datafusion:vortex-compact +8.0% +6.7% +1.2% +11.1% ➖ noise 1 datafusion:vortex-file-compressed +0.2% +6.7% -6.1% +11.6% ➖ noise 1 duckdb:duckdb -2.3% +6.7% -8.5% +10.6% ➖ noise 1 duckdb:vortex-compact +2.2% +6.7% -4.3% +14.6% ➖ noise 1 duckdb:vortex-file-compressed +7.3% +6.7% +0.5% +12.4% ➖ noise 2 datafusion:vortex-compact +0.7% +2.1% -1.3% +10.0% ➖ noise 2 datafusion:vortex-file-compressed +2.6% +2.1% +0.5% +10.0% ➖ noise 2 duckdb:duckdb +0.2% +2.1% -1.8% +10.9% ➖ noise 2 duckdb:vortex-compact +2.3% +2.1% +0.2% +10.0% ➖ noise 2 duckdb:vortex-file-compressed -2.6% +2.1% -4.6% +11.2% ➖ noise 3 datafusion:vortex-compact +4.4% +0.2% +4.2% +10.6% ➖ noise 3 datafusion:vortex-file-compressed +4.2% +0.2% +3.9% +10.5% ➖ noise 3 duckdb:duckdb -2.8% +0.2% -3.0% +15.3% ➖ noise 3 duckdb:vortex-compact +1.1% +0.2% +0.8% +12.3% ➖ noise 3 duckdb:vortex-file-compressed +3.2% +0.2% +2.9% +10.1% ➖ noise 4 datafusion:vortex-compact +3.9% +0.1% +3.8% +10.0% ➖ noise 4 datafusion:vortex-file-compressed +1.8% +0.1% +1.7% +10.0% ➖ noise 4 duckdb:duckdb -0.3% +0.1% -0.4% +10.0% ➖ noise 4 duckdb:vortex-compact +0.4% +0.1% +0.2% +10.0% ➖ noise 4 duckdb:vortex-file-compressed -2.3% +0.1% -2.4% +10.0% ➖ noise 5 datafusion:vortex-compact +0.6% +4.4% -3.7% +12.2% ➖ noise 5 datafusion:vortex-file-compressed -0.4% +4.4% -4.6% +10.3% ➖ noise 5 duckdb:duckdb -4.6% +4.4% -8.6% +20.4% ➖ noise 5 duckdb:vortex-compact +3.7% +4.4% -0.7% +14.3% ➖ noise 5 duckdb:vortex-file-compressed +6.1% +4.4% +1.6% +10.7% ➖ noise 6 datafusion:vortex-compact -0.2% +1.1% -1.3% +10.0% ➖ noise 6 datafusion:vortex-file-compressed +0.5% +1.1% -0.6% +10.0% ➖ noise 6 duckdb:duckdb +10.7% +1.1% +9.5% +13.8% ➖ noise 6 duckdb:vortex-compact +1.9% +1.1% +0.8% +10.0% ➖ noise 6 duckdb:vortex-file-compressed -1.4% +1.1% -2.5% +19.4% ➖ noise 7 datafusion:vortex-compact +3.4% +1.1% +2.3% +11.1% ➖ noise 7 datafusion:vortex-file-compressed +5.2% +1.1% +4.0% +10.0% ➖ noise 7 duckdb:duckdb -1.5% +1.1% -2.6% +18.3% ➖ noise 7 duckdb:vortex-compact +0.6% +1.1% -0.5% +10.0% ➖ noise 7 duckdb:vortex-file-compressed -1.7% +1.1% -2.8% +10.0% ➖ noise 8 datafusion:vortex-compact -1.0% +3.3% -4.1% +10.0% ➖ noise 8 datafusion:vortex-file-compressed +3.3% +3.3% +0.0% +11.2% ➖ noise 8 duckdb:duckdb +2.6% +3.3% -0.7% +10.0% ➖ noise 8 duckdb:vortex-compact +2.4% +3.3% -0.9% +10.0% ➖ noise 8 duckdb:vortex-file-compressed -1.8% +3.3% -4.9% +10.4% ➖ noise 9 datafusion:vortex-compact -1.5% +3.2% -4.6% +10.0% ➖ noise 9 datafusion:vortex-file-compressed +2.8% +3.2% -0.5% +10.0% ➖ noise 9 duckdb:duckdb +2.9% +3.2% -0.3% +10.0% ➖ noise 9 duckdb:vortex-compact +2.9% +3.2% -0.3% +10.0% ➖ noise 9 duckdb:vortex-file-compressed +1.7% +3.2% -1.5% +10.0% ➖ noise 10 datafusion:vortex-compact -0.1% +6.0% -5.8% +10.0% ➖ noise 10 datafusion:vortex-file-compressed -0.6% +6.0% -6.2% +10.0% ➖ noise 10 duckdb:duckdb +4.7% +6.0% -1.2% +14.2% ➖ noise 10 duckdb:vortex-compact -0.4% +6.0% -6.0% +10.0% ➖ noise 10 duckdb:vortex-file-compressed +4.9% +6.0% -1.0% +10.0% ➖ noise 11 datafusion:vortex-compact +1.4% +3.5% -2.0% +10.0% ➖ noise 11 datafusion:vortex-file-compressed +3.0% +3.5% -0.5% +10.0% ➖ noise 11 duckdb:duckdb +0.7% +3.5% -2.7% +10.0% ➖ noise 11 duckdb:vortex-compact -1.1% +3.5% -4.4% +10.0% ➖ noise 11 duckdb:vortex-file-compressed -1.8% +3.5% -5.1% +10.0% ➖ noise 12 datafusion:vortex-compact +2.3% +0.9% +1.4% +10.0% ➖ noise 12 datafusion:vortex-file-compressed +1.7% +0.9% +0.8% +13.3% ➖ noise 12 duckdb:duckdb +0.8% +0.9% -0.2% +11.9% ➖ noise 12 duckdb:vortex-compact -6.0% +0.9% -6.9% +17.8% ➖ noise 12 duckdb:vortex-file-compressed -3.9% +0.9% -4.8% +11.3% ➖ noise 13 datafusion:vortex-compact +4.4% +1.9% +2.4% +10.0% ➖ noise 13 datafusion:vortex-file-compressed +4.4% +1.9% +2.5% +10.0% ➖ noise 13 duckdb:duckdb -2.4% +1.9% -4.2% +10.0% ➖ noise 13 duckdb:vortex-compact +1.6% +1.9% -0.3% +10.0% ➖ noise 13 duckdb:vortex-file-compressed +5.4% +1.9% +3.5% +10.4% ➖ noise 14 datafusion:vortex-compact +2.1% -2.8% +5.0% +10.0% ➖ noise 14 datafusion:vortex-file-compressed +3.1% -2.8% +6.0% +10.0% ➖ noise 14 duckdb:duckdb +0.3% -2.8% +3.2% +10.0% ➖ noise 14 duckdb:vortex-compact +2.8% -2.8% +5.8% +10.0% ➖ noise 14 duckdb:vortex-file-compressed +4.8% -2.8% +7.8% +12.1% ➖ noise 15 datafusion:vortex-compact -1.3% -1.8% +0.5% +10.4% ➖ noise 15 datafusion:vortex-file-compressed +5.1% -1.8% +7.0% +10.0% ➖ noise 15 duckdb:duckdb +1.9% -1.8% +3.8% +12.9% ➖ noise 15 duckdb:vortex-compact +1.7% -1.8% +3.6% +10.0% ➖ noise 15 duckdb:vortex-file-compressed -0.9% -1.8% +1.0% +10.0% ➖ noise 16 datafusion:vortex-compact +2.8% -0.8% +3.6% +10.0% ➖ noise 16 datafusion:vortex-file-compressed +1.5% -0.8% +2.3% +10.0% ➖ noise 16 duckdb:duckdb +10.7% -0.8% +11.5% +14.9% ➖ noise 16 duckdb:vortex-compact +5.4% -0.8% +6.2% +11.1% ➖ noise 16 duckdb:vortex-file-compressed -4.1% -0.8% -3.3% +10.0% ➖ noise 17 datafusion:vortex-compact +1.0% -1.1% +2.1% +10.0% ➖ noise 17 datafusion:vortex-file-compressed +0.9% -1.1% +2.0% +10.0% ➖ noise 17 duckdb:duckdb +2.9% -1.1% +4.0% +11.4% ➖ noise 17 duckdb:vortex-compact +4.3% -1.1% +5.4% +10.0% ➖ noise 17 duckdb:vortex-file-compressed +0.1% -1.1% +1.2% +10.3% ➖ noise 18 datafusion:vortex-compact -1.6% +2.5% -4.0% +10.0% ➖ noise 18 datafusion:vortex-file-compressed -0.0% +2.5% -2.5% +10.0% ➖ noise 18 duckdb:duckdb -3.2% +2.5% -5.6% +10.0% ➖ noise 18 duckdb:vortex-compact -0.1% +2.5% -2.5% +10.0% ➖ noise 18 duckdb:vortex-file-compressed -0.3% +2.5% -2.7% +10.0% ➖ noise 19 datafusion:vortex-compact +2.6% +1.9% +0.7% +10.0% ➖ noise 19 datafusion:vortex-file-compressed -2.1% +1.9% -3.9% +10.0% ➖ noise 19 duckdb:duckdb -1.9% +1.9% -3.8% +11.8% ➖ noise 19 duckdb:vortex-compact +5.5% +1.9% +3.5% +10.0% ➖ noise 19 duckdb:vortex-file-compressed +4.8% +1.9% +2.8% +13.0% ➖ noise 20 datafusion:vortex-compact +0.5% +2.7% -2.1% +10.0% ➖ noise 20 datafusion:vortex-file-compressed -1.2% +2.7% -3.8% +10.0% ➖ noise 20 duckdb:duckdb +2.5% +2.7% -0.1% +10.5% ➖ noise 20 duckdb:vortex-compact +6.4% +2.7% +3.7% +16.1% ➖ noise 20 duckdb:vortex-file-compressed -3.4% +2.7% -5.9% +11.1% ➖ noise 21 datafusion:vortex-compact +6.3% -3.4% +10.0% +10.0% 🚨 regression 21 datafusion:vortex-file-compressed +7.2% -3.4% +10.9% +10.0% 🚨 regression 21 duckdb:duckdb -7.8% -3.4% -4.6% +10.0% ➖ noise 21 duckdb:vortex-compact -8.9% -3.4% -5.7% +13.4% ➖ noise 21 duckdb:vortex-file-compressed +5.0% -3.4% +8.7% +13.2% ➖ noise 22 datafusion:vortex-compact -0.1% +1.0% -1.1% +14.5% ➖ noise 22 datafusion:vortex-file-compressed +5.5% +1.0% +4.5% +15.2% ➖ noise 22 duckdb:duckdb +0.6% +1.0% -0.4% +14.0% ➖ noise 22 duckdb:vortex-compact +1.9% +1.0% +1.0% +13.3% ➖ noise 22 duckdb:vortex-file-compressed +7.5% +1.0% +6.4% +14.2% ➖ noise 23 datafusion:vortex-compact +2.0% +4.8% -2.6% +10.0% ➖ noise 23 datafusion:vortex-file-compressed +0.8% +4.8% -3.8% +10.0% ➖ noise 23 duckdb:duckdb +6.8% +4.8% +1.9% +17.9% ➖ noise 23 duckdb:vortex-compact -4.0% +4.8% -8.3% +12.6% ➖ noise 23 duckdb:vortex-file-compressed -4.9% +4.8% -9.2% +10.0% ✅ faster 24 datafusion:vortex-compact +0.5% +1.7% -1.2% +10.0% ➖ noise 24 datafusion:vortex-file-compressed +1.0% +1.7% -0.7% +10.0% ➖ noise 24 duckdb:duckdb +2.2% +1.7% +0.5% +10.0% ➖ noise 24 duckdb:vortex-compact +1.5% +1.7% -0.2% +10.0% ➖ noise 24 duckdb:vortex-file-compressed +2.6% +1.7% +0.9% +12.6% ➖ noise 25 datafusion:vortex-compact +4.5% -1.6% +6.2% +10.0% ➖ noise 25 datafusion:vortex-file-compressed +1.5% -1.6% +3.1% +10.0% ➖ noise 25 duckdb:duckdb +1.1% -1.6% +2.7% +15.2% ➖ noise 25 duckdb:vortex-compact +4.9% -1.6% +6.6% +10.0% ➖ noise 25 duckdb:vortex-file-compressed +0.4% -1.6% +2.0% +10.0% ➖ noise 26 datafusion:vortex-compact -0.0% +3.1% -3.0% +10.7% ➖ noise 26 datafusion:vortex-file-compressed +3.9% +3.1% +0.8% +10.0% ➖ noise 26 duckdb:duckdb +6.7% +3.1% +3.5% +15.5% ➖ noise 26 duckdb:vortex-compact +6.1% +3.1% +2.9% +15.2% ➖ noise 26 duckdb:vortex-file-compressed -1.0% +3.1% -4.0% +10.0% ➖ noise 27 datafusion:vortex-compact -1.4% +1.1% -2.4% +10.0% ➖ noise 27 datafusion:vortex-file-compressed +3.6% +1.1% +2.5% +10.0% ➖ noise 27 duckdb:duckdb -0.5% +1.1% -1.6% +18.5% ➖ noise 27 duckdb:vortex-compact +1.9% +1.1% +0.8% +10.0% ➖ noise 27 duckdb:vortex-file-compressed +0.7% +1.1% -0.4% +10.0% ➖ noise 28 datafusion:vortex-compact +3.4% +2.7% +0.6% +10.0% ➖ noise 28 datafusion:vortex-file-compressed +2.5% +2.7% -0.2% +10.0% ➖ noise 28 duckdb:duckdb -0.8% +2.7% -3.5% +10.0% ➖ noise 28 duckdb:vortex-compact +1.8% +2.7% -1.0% +10.0% ➖ noise 28 duckdb:vortex-file-compressed -2.0% +2.7% -4.6% +10.0% ➖ noise 29 datafusion:vortex-compact +1.2% +2.9% -1.6% +10.0% ➖ noise 29 datafusion:vortex-file-compressed +4.1% +2.9% +1.2% +10.0% ➖ noise 29 duckdb:duckdb -2.6% +2.9% -5.3% +11.5% ➖ noise 29 duckdb:vortex-compact -2.2% +2.9% -4.9% +12.9% ➖ noise 29 duckdb:vortex-file-compressed -1.8% +2.9% -4.5% +11.9% ➖ noise 30 datafusion:vortex-compact +3.9% +3.9% -0.0% +13.0% ➖ noise 30 datafusion:vortex-file-compressed +3.4% +3.9% -0.5% +10.0% ➖ noise 30 duckdb:duckdb +1.7% +3.9% -2.1% +10.0% ➖ noise 30 duckdb:vortex-compact +4.6% +3.9% +0.7% +11.1% ➖ noise 30 duckdb:vortex-file-compressed -4.0% +3.9% -7.6% +13.0% ➖ noise 31 datafusion:vortex-compact +3.5% +1.7% +1.8% +10.0% ➖ noise 31 datafusion:vortex-file-compressed +3.9% +1.7% +2.1% +10.0% ➖ noise 31 duckdb:duckdb +1.2% +1.7% -0.5% +11.3% ➖ noise 31 duckdb:vortex-compact +6.7% +1.7% +4.9% +11.1% ➖ noise 31 duckdb:vortex-file-compressed +1.9% +1.7% +0.2% +10.9% ➖ noise 32 datafusion:vortex-compact +5.4% +0.3% +5.1% +10.0% ➖ noise 32 datafusion:vortex-file-compressed -1.6% +0.3% -1.9% +10.0% ➖ noise 32 duckdb:duckdb +0.4% +0.3% +0.1% +11.7% ➖ noise 32 duckdb:vortex-compact +0.5% +0.3% +0.2% +10.8% ➖ noise 32 duckdb:vortex-file-compressed -2.8% +0.3% -3.1% +10.5% ➖ noise 33 datafusion:vortex-compact -3.2% +1.9% -5.1% +10.0% ➖ noise 33 datafusion:vortex-file-compressed -1.4% +1.9% -3.3% +10.2% ➖ noise 33 duckdb:duckdb +8.2% +1.9% +6.1% +11.3% ➖ noise 33 duckdb:vortex-compact +0.0% +1.9% -1.9% +10.0% ➖ noise 33 duckdb:vortex-file-compressed +1.8% +1.9% -0.1% +16.2% ➖ noise 34 datafusion:vortex-compact +3.1% +0.7% +2.4% +10.0% ➖ noise 34 datafusion:vortex-file-compressed +0.4% +0.7% -0.3% +10.0% ➖ noise 34 duckdb:duckdb +1.4% +0.7% +0.7% +10.0% ➖ noise 34 duckdb:vortex-compact +3.1% +0.7% +2.4% +10.0% ➖ noise 34 duckdb:vortex-file-compressed +1.2% +0.7% +0.5% +11.2% ➖ noise 35 datafusion:vortex-compact -0.8% +2.5% -3.2% +10.0% ➖ noise 35 datafusion:vortex-file-compressed -1.9% +2.5% -4.3% +10.0% ➖ noise 35 duckdb:duckdb -7.5% +2.5% -9.7% +17.3% ➖ noise 35 duckdb:vortex-compact +3.2% +2.5% +0.7% +10.0% ➖ noise 35 duckdb:vortex-file-compressed +3.0% +2.5% +0.5% +10.3% ➖ noise 36 datafusion:vortex-compact -3.2% +0.8% -3.9% +10.0% ➖ noise 36 datafusion:vortex-file-compressed +3.1% +0.8% +2.3% +10.0% ➖ noise 36 duckdb:duckdb -1.0% +0.8% -1.8% +11.8% ➖ noise 36 duckdb:vortex-compact +2.0% +0.8% +1.2% +10.0% ➖ noise 36 duckdb:vortex-file-compressed +3.4% +0.8% +2.6% +10.0% ➖ noise 37 datafusion:vortex-compact -1.8% +1.9% -3.6% +10.0% ➖ noise 37 datafusion:vortex-file-compressed +1.5% +1.9% -0.3% +10.8% ➖ noise 37 duckdb:duckdb +7.0% +1.9% +5.1% +20.1% ➖ noise 37 duckdb:vortex-compact +4.7% +1.9% +2.8% +10.9% ➖ noise 37 duckdb:vortex-file-compressed -0.0% +1.9% -1.9% +14.4% ➖ noise 38 datafusion:vortex-compact +1.3% +3.8% -2.4% +10.0% ➖ noise 38 datafusion:vortex-file-compressed +3.8% +3.8% +0.0% +10.0% ➖ noise 38 duckdb:duckdb -0.0% +3.8% -3.7% +24.6% ➖ noise 38 duckdb:vortex-compact +2.0% +3.8% -1.7% +13.3% ➖ noise 38 duckdb:vortex-file-compressed +3.6% +3.8% -0.1% +12.4% ➖ noise 39 datafusion:vortex-compact -2.9% +2.8% -5.6% +11.4% ➖ noise 39 datafusion:vortex-file-compressed -7.8% +2.8% -10.3% +15.8% ➖ noise 39 duckdb:duckdb -13.4% +2.8% -15.7% +30.7% ➖ noise 39 duckdb:vortex-compact +1.2% +2.8% -1.5% +10.7% ➖ noise 39 duckdb:vortex-file-compressed -2.1% +2.8% -4.7% +19.8% ➖ noise 40 datafusion:vortex-compact +2.4% +7.7% -4.9% +10.0% ➖ noise 40 datafusion:vortex-file-compressed +1.0% +7.7% -6.2% +10.0% ➖ noise 40 duckdb:duckdb +7.0% +7.7% -0.6% +12.7% ➖ noise 40 duckdb:vortex-compact +3.2% +7.7% -4.2% +10.0% ➖ noise 40 duckdb:vortex-file-compressed -3.6% +7.7% -10.5% +10.0% ✅ faster 41 datafusion:vortex-compact -1.5% +3.9% -5.3% +11.4% ➖ noise 41 datafusion:vortex-file-compressed +7.2% +3.9% +3.2% +10.0% ➖ noise 41 duckdb:duckdb +1.1% +3.9% -2.8% +10.0% ➖ noise 41 duckdb:vortex-compact +0.6% +3.9% -3.2% +10.0% ➖ noise 41 duckdb:vortex-file-compressed -0.7% +3.9% -4.4% +10.0% ➖ noise 42 datafusion:vortex-compact +1.7% +2.9% -1.1% +11.9% ➖ noise 42 datafusion:vortex-file-compressed +2.5% +2.9% -0.3% +12.2% ➖ noise 42 duckdb:duckdb +2.0% +2.9% -0.8% +17.5% ➖ noise 42 duckdb:vortex-compact +1.5% +2.9% -1.4% +16.2% ➖ noise 42 duckdb:vortex-file-compressed -3.0% +2.9% -5.7% +16.1% ➖ noise 43 datafusion:vortex-compact +2.5% +7.2% -4.4% +10.0% ➖ noise 43 datafusion:vortex-file-compressed +1.2% +7.2% -5.6% +10.0% ➖ noise 43 duckdb:duckdb +1.4% +7.2% -5.4% +10.0% ➖ noise 43 duckdb:vortex-compact -1.3% +7.2% -8.0% +13.7% ➖ noise 43 duckdb:vortex-file-compressed -0.1% +7.2% -6.8% +10.0% ➖ noise 44 datafusion:vortex-compact +0.8% +3.0% -2.1% +10.0% ➖ noise 44 datafusion:vortex-file-compressed +3.7% +3.0% +0.7% +10.0% ➖ noise 44 duckdb:duckdb -4.3% +3.0% -7.1% +12.4% ➖ noise 44 duckdb:vortex-compact +3.0% +3.0% +0.0% +10.0% ➖ noise 44 duckdb:vortex-file-compressed +5.2% +3.0% +2.2% +11.7% ➖ noise 45 datafusion:vortex-compact -0.8% +1.5% -2.3% +10.0% ➖ noise 45 datafusion:vortex-file-compressed +0.3% +1.5% -1.2% +10.0% ➖ noise 45 duckdb:duckdb +12.5% +1.5% +10.8% +10.0% 🚨 regression 45 duckdb:vortex-compact +14.8% +1.5% +13.1% +13.8% ➖ noise 45 duckdb:vortex-file-compressed -6.0% +1.5% -7.4% +11.9% ➖ noise 46 datafusion:vortex-compact -1.3% -0.9% -0.4% +10.0% ➖ noise 46 datafusion:vortex-file-compressed +9.1% -0.9% +10.0% +10.0% 🚨 regression 46 duckdb:duckdb +7.7% -0.9% +8.7% +10.0% ➖ noise 46 duckdb:vortex-compact +3.5% -0.9% +4.4% +10.0% ➖ noise 46 duckdb:vortex-file-compressed +2.3% -0.9% +3.2% +10.0% ➖ noise 47 datafusion:vortex-compact +3.5% +2.1% +1.4% +10.0% ➖ noise 47 datafusion:vortex-file-compressed +5.8% +2.1% +3.6% +10.0% ➖ noise 47 duckdb:duckdb +1.6% +2.1% -0.4% +10.0% ➖ noise 47 duckdb:vortex-compact +0.9% +2.1% -1.2% +10.0% ➖ noise 47 duckdb:vortex-file-compressed +5.3% +2.1% +3.2% +10.0% ➖ noise 48 datafusion:vortex-compact +0.8% +0.6% +0.2% +10.0% ➖ noise 48 datafusion:vortex-file-compressed -1.0% +0.6% -1.6% +10.0% ➖ noise 48 duckdb:duckdb +2.0% +0.6% +1.4% +12.8% ➖ noise 48 duckdb:vortex-compact -0.0% +0.6% -0.6% +10.0% ➖ noise 48 duckdb:vortex-file-compressed +6.8% +0.6% +6.1% +13.6% ➖ noise 49 datafusion:vortex-compact +1.2% +2.8% -1.6% +10.0% ➖ noise 49 datafusion:vortex-file-compressed -2.2% +2.8% -4.9% +10.0% ➖ noise 49 duckdb:duckdb +3.9% +2.8% +1.0% +13.9% ➖ noise 49 duckdb:vortex-compact +2.8% +2.8% -0.0% +10.3% ➖ noise 49 duckdb:vortex-file-compressed -1.7% +2.8% -4.4% +10.6% ➖ noise 50 datafusion:vortex-compact -0.4% +1.0% -1.4% +10.0% ➖ noise 50 datafusion:vortex-file-compressed +5.3% +1.0% +4.3% +10.0% ➖ noise 50 duckdb:duckdb +2.7% +1.0% +1.8% +10.0% ➖ noise 50 duckdb:vortex-compact +2.0% +1.0% +1.1% +10.0% ➖ noise 50 duckdb:vortex-file-compressed +0.2% +1.0% -0.7% +10.0% ➖ noise 51 datafusion:vortex-compact +1.4% -0.8% +2.2% +10.9% ➖ noise 51 datafusion:vortex-file-compressed +2.1% -0.8% +2.9% +10.0% ➖ noise 51 duckdb:duckdb +0.5% -0.8% +1.2% +22.6% ➖ noise 51 duckdb:vortex-compact +2.5% -0.8% +3.3% +10.0% ➖ noise 51 duckdb:vortex-file-compressed +0.8% -0.8% +1.6% +18.5% ➖ noise 52 datafusion:vortex-compact +2.4% +1.6% +0.8% +19.7% ➖ noise 52 datafusion:vortex-file-compressed +2.4% +1.6% +0.8% +14.2% ➖ noise 52 duckdb:duckdb +1.2% +1.6% -0.4% +21.3% ➖ noise 52 duckdb:vortex-compact -6.6% +1.6% -8.1% +18.5% ➖ noise 52 duckdb:vortex-file-compressed -6.9% +1.6% -8.4% +19.7% ➖ noise 53 datafusion:vortex-compact +3.1% +2.9% +0.2% +10.9% ➖ noise 53 datafusion:vortex-file-compressed +0.0% +2.9% -2.8% +12.6% ➖ noise 53 duckdb:duckdb -0.6% +2.9% -3.4% +14.2% ➖ noise 53 duckdb:vortex-compact -0.2% +2.9% -3.0% +11.8% ➖ noise 53 duckdb:vortex-file-compressed +6.1% +2.9% +3.1% +15.1% ➖ noise 54 datafusion:vortex-compact -2.5% +2.7% -5.0% +10.0% ➖ noise 54 datafusion:vortex-file-compressed -1.4% +2.7% -3.9% +10.0% ➖ noise 54 duckdb:duckdb -4.0% +2.7% -6.5% +14.5% ➖ noise 54 duckdb:vortex-compact +3.3% +2.7% +0.6% +10.0% ➖ noise 54 duckdb:vortex-file-compressed +3.4% +2.7% +0.7% +10.4% ➖ noise 55 datafusion:vortex-compact +2.0% +1.2% +0.8% +11.3% ➖ noise 55 datafusion:vortex-file-compressed -0.6% +1.2% -1.8% +10.7% ➖ noise 55 duckdb:duckdb +0.5% +1.2% -0.7% +16.0% ➖ noise 55 duckdb:vortex-compact -1.1% +1.2% -2.3% +11.9% ➖ noise 55 duckdb:vortex-file-compressed -4.2% +1.2% -5.4% +18.1% ➖ noise 56 datafusion:vortex-compact -0.4% +1.0% -1.3% +10.0% ➖ noise 56 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise 56 duckdb:duckdb +1.9% +1.0% +1.0% +12.5% ➖ noise 56 duckdb:vortex-compact +4.7% +1.0% +3.7% +10.4% ➖ noise 56 duckdb:vortex-file-compressed -1.7% +1.0% -2.6% +10.3% ➖ noise 57 datafusion:vortex-compact +2.4% +2.7% -0.2% +10.0% ➖ noise 57 datafusion:vortex-file-compressed +1.2% +2.7% -1.4% +10.0% ➖ noise 57 duckdb:duckdb -0.1% +2.7% -2.8% +10.0% ➖ noise 57 duckdb:vortex-compact -1.1% +2.7% -3.7% +20.7% ➖ noise 57 duckdb:vortex-file-compressed +2.2% +2.7% -0.5% +16.5% ➖ noise 58 datafusion:vortex-compact +2.2% -0.6% +2.9% +10.0% ➖ noise 58 datafusion:vortex-file-compressed +4.4% -0.6% +5.1% +10.0% ➖ noise 58 duckdb:duckdb +0.5% -0.6% +1.1% +14.7% ➖ noise 58 duckdb:vortex-compact +0.1% -0.6% +0.7% +15.9% ➖ noise 58 duckdb:vortex-file-compressed +1.5% -0.6% +2.2% +21.7% ➖ noise 59 datafusion:vortex-compact -0.0% +1.4% -1.5% +10.0% ➖ noise 59 datafusion:vortex-file-compressed +5.7% +1.4% +4.2% +10.0% ➖ noise 59 duckdb:duckdb -1.1% +1.4% -2.5% +10.0% ➖ noise 59 duckdb:vortex-compact -0.8% +1.4% -2.2% +10.0% ➖ noise 59 duckdb:vortex-file-compressed -0.5% +1.4% -1.9% +10.0% ➖ noise 60 datafusion:vortex-compact -2.8% +1.7% -4.5% +10.0% ➖ noise 60 datafusion:vortex-file-compressed +0.6% +1.7% -1.1% +10.0% ➖ noise 60 duckdb:duckdb +2.0% +1.7% +0.2% +13.5% ➖ noise 60 duckdb:vortex-compact -2.1% +1.7% -3.8% +10.0% ➖ noise 60 duckdb:vortex-file-compressed +0.1% +1.7% -1.6% +13.9% ➖ noise 61 datafusion:vortex-compact -3.0% +0.7% -3.7% +10.0% ➖ noise 61 datafusion:vortex-file-compressed +1.4% +0.7% +0.7% +10.0% ➖ noise 61 duckdb:duckdb -0.4% +0.7% -1.1% +10.0% ➖ noise 61 duckdb:vortex-compact -3.3% +0.7% -4.0% +11.8% ➖ noise 61 duckdb:vortex-file-compressed -0.8% +0.7% -1.5% +10.0% ➖ noise 62 datafusion:vortex-compact +3.4% +1.8% +1.5% +12.7% ➖ noise 62 datafusion:vortex-file-compressed +1.9% +1.8% +0.1% +11.8% ➖ noise 62 duckdb:duckdb -1.3% +1.8% -3.1% +15.8% ➖ noise 62 duckdb:vortex-compact +2.6% +1.8% +0.7% +28.2% ➖ noise 62 duckdb:vortex-file-compressed -3.2% +1.8% -5.0% +25.6% ➖ noise 63 datafusion:vortex-compact +4.7% +2.6% +2.0% +10.0% ➖ noise 63 datafusion:vortex-file-compressed +4.3% +2.6% +1.6% +10.0% ➖ noise 63 duckdb:duckdb -1.8% +2.6% -4.3% +10.9% ➖ noise 63 duckdb:vortex-compact +1.7% +2.6% -0.9% +10.0% ➖ noise 63 duckdb:vortex-file-compressed +1.0% +2.6% -1.6% +11.6% ➖ noise 64 datafusion:vortex-compact +0.2% +1.0% -0.8% +10.0% ➖ noise 64 datafusion:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise 64 duckdb:duckdb +4.3% +1.0% +3.3% +10.0% ➖ noise 64 duckdb:vortex-compact +3.5% +1.0% +2.5% +10.0% ➖ noise 64 duckdb:vortex-file-compressed +5.5% +1.0% +4.5% +10.0% ➖ noise 65 datafusion:vortex-compact +4.0% +5.3% -1.2% +10.0% ➖ noise 65 datafusion:vortex-file-compressed +3.5% +5.3% -1.7% +10.3% ➖ noise 65 duckdb:duckdb -0.4% +5.3% -5.4% +12.3% ➖ noise 65 duckdb:vortex-compact +0.9% +5.3% -4.1% +10.0% ➖ noise 65 duckdb:vortex-file-compressed -4.2% +5.3% -9.0% +10.0% ➖ noise 66 datafusion:vortex-compact +1.2% -1.1% +2.3% +12.5% ➖ noise 66 datafusion:vortex-file-compressed +2.3% -1.1% +3.5% +10.9% ➖ noise 66 duckdb:duckdb +0.6% -1.1% +1.7% +12.7% ➖ noise 66 duckdb:vortex-compact +7.5% -1.1% +8.7% +10.6% ➖ noise 66 duckdb:vortex-file-compressed +17.9% -1.1% +19.2% +15.9% 🚨 regression 67 datafusion:vortex-compact -0.1% -0.6% +0.6% +10.0% ➖ noise 67 datafusion:vortex-file-compressed +4.5% -0.6% +5.2% +10.0% ➖ noise 67 duckdb:duckdb +2.4% -0.6% +3.0% +10.0% ➖ noise 67 duckdb:vortex-compact -2.5% -0.6% -1.8% +10.0% ➖ noise 67 duckdb:vortex-file-compressed +3.1% -0.6% +3.8% +10.0% ➖ noise 68 datafusion:vortex-compact +0.5% +3.4% -2.8% +10.0% ➖ noise 68 datafusion:vortex-file-compressed +6.5% +3.4% +2.9% +10.0% ➖ noise 68 duckdb:duckdb +6.4% +3.4% +2.9% +10.0% ➖ noise 68 duckdb:vortex-compact +2.1% +3.4% -1.3% +10.0% ➖ noise 68 duckdb:vortex-file-compressed +0.1% +3.4% -3.3% +10.0% ➖ noise 69 datafusion:vortex-compact -0.1% -1.7% +1.6% +10.0% ➖ noise 69 datafusion:vortex-file-compressed +4.0% -1.7% +5.8% +10.0% ➖ noise 69 duckdb:duckdb +4.5% -1.7% +6.4% +10.0% ➖ noise 69 duckdb:vortex-compact -1.0% -1.7% +0.7% +10.0% ➖ noise 69 duckdb:vortex-file-compressed +1.7% -1.7% +3.5% +10.0% ➖ noise 70 datafusion:vortex-compact -3.1% +1.3% -4.3% +10.0% ➖ noise 70 datafusion:vortex-file-compressed +3.6% +1.3% +2.3% +10.0% ➖ noise 70 duckdb:duckdb -8.3% +1.3% -9.5% +14.1% ➖ noise 70 duckdb:vortex-compact -1.5% +1.3% -2.8% +10.7% ➖ noise 70 duckdb:vortex-file-compressed +0.2% +1.3% -1.1% +10.0% ➖ noise 71 datafusion:vortex-compact -2.2% +0.9% -3.1% +10.0% ➖ noise 71 datafusion:vortex-file-compressed +3.2% +0.9% +2.3% +10.0% ➖ noise 71 duckdb:duckdb +1.6% +0.9% +0.7% +11.3% ➖ noise 71 duckdb:vortex-compact -2.0% +0.9% -2.9% +12.2% ➖ noise 71 duckdb:vortex-file-compressed -2.5% +0.9% -3.3% +14.2% ➖ noise 72 datafusion:vortex-compact +1.0% +0.2% +0.8% +10.0% ➖ noise 72 datafusion:vortex-file-compressed +0.9% +0.2% +0.7% +10.0% ➖ noise 72 duckdb:duckdb +2.7% +0.2% +2.5% +10.8% ➖ noise 72 duckdb:vortex-compact -0.3% +0.2% -0.5% +10.0% ➖ noise 72 duckdb:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise 73 datafusion:vortex-compact -0.8% -0.6% -0.2% +16.3% ➖ noise 73 datafusion:vortex-file-compressed -10.5% -0.6% -10.0% +17.3% ➖ noise 73 duckdb:duckdb +1.6% -0.6% +2.2% +10.5% ➖ noise 73 duckdb:vortex-compact +5.7% -0.6% +6.3% +10.0% ➖ noise 73 duckdb:vortex-file-compressed -1.6% -0.6% -1.0% +10.0% ➖ noise 74 datafusion:vortex-compact +2.5% +1.6% +0.9% +10.0% ➖ noise 74 datafusion:vortex-file-compressed +4.2% +1.6% +2.6% +10.0% ➖ noise 74 duckdb:duckdb -1.8% +1.6% -3.3% +10.0% ➖ noise 74 duckdb:vortex-compact +0.9% +1.6% -0.7% +10.0% ➖ noise 74 duckdb:vortex-file-compressed +2.8% +1.6% +1.2% +10.0% ➖ noise 75 datafusion:vortex-compact +0.3% +1.3% -1.0% +10.0% ➖ noise 75 datafusion:vortex-file-compressed +4.5% +1.3% +3.1% +10.0% ➖ noise 75 duckdb:duckdb -1.3% +1.3% -2.6% +10.8% ➖ noise 75 duckdb:vortex-compact +3.2% +1.3% +1.9% +10.0% ➖ noise 75 duckdb:vortex-file-compressed -6.6% +1.3% -7.8% +10.0% ➖ noise 76 datafusion:vortex-compact +4.9% +5.6% -0.6% +10.0% ➖ noise 76 datafusion:vortex-file-compressed +6.0% +5.6% +0.4% +10.0% ➖ noise 76 duckdb:duckdb +3.1% +5.6% -2.4% +11.6% ➖ noise 76 duckdb:vortex-compact +8.2% +5.6% +2.5% +10.0% ➖ noise 76 duckdb:vortex-file-compressed +2.4% +5.6% -3.1% +23.6% ➖ noise 77 datafusion:vortex-compact +4.4% +2.4% +1.9% +10.0% ➖ noise 77 datafusion:vortex-file-compressed -1.1% +2.4% -3.5% +10.0% ➖ noise 77 duckdb:duckdb +1.5% +2.4% -0.9% +13.0% ➖ noise 77 duckdb:vortex-compact +6.3% +2.4% +3.7% +10.0% ➖ noise 77 duckdb:vortex-file-compressed +5.8% +2.4% +3.3% +10.5% ➖ noise 78 datafusion:vortex-compact +1.6% +3.6% -1.9% +10.0% ➖ noise 78 datafusion:vortex-file-compressed +0.2% +3.6% -3.3% +10.0% ➖ noise 78 duckdb:duckdb +3.3% +3.6% -0.3% +12.8% ➖ noise 78 duckdb:vortex-compact +0.6% +3.6% -2.9% +11.6% ➖ noise 78 duckdb:vortex-file-compressed -4.3% +3.6% -7.6% +12.9% ➖ noise 79 datafusion:vortex-compact -0.5% +4.4% -4.6% +10.0% ➖ noise 79 datafusion:vortex-file-compressed +3.3% +4.4% -1.1% +11.2% ➖ noise 79 duckdb:duckdb -0.5% +4.4% -4.7% +11.5% ➖ noise 79 duckdb:vortex-compact +14.4% +4.4% +9.6% +10.0% ➖ noise 79 duckdb:vortex-file-compressed -0.1% +4.4% -4.3% +15.6% ➖ noise 80 datafusion:vortex-compact +0.9% +1.9% -1.0% +10.0% ➖ noise 80 datafusion:vortex-file-compressed +2.7% +1.9% +0.8% +10.0% ➖ noise 80 duckdb:duckdb +5.9% +1.9% +3.9% +17.7% ➖ noise 80 duckdb:vortex-compact +3.9% +1.9% +2.0% +10.0% ➖ noise 80 duckdb:vortex-file-compressed +4.8% +1.9% +2.8% +10.0% ➖ noise 81 datafusion:vortex-compact +6.0% -0.6% +6.6% +10.0% ➖ noise 81 datafusion:vortex-file-compressed +4.4% -0.6% +5.0% +13.9% ➖ noise 81 duckdb:duckdb -2.4% -0.6% -1.8% +10.0% ➖ noise 81 duckdb:vortex-compact -2.2% -0.6% -1.7% +10.0% ➖ noise 81 duckdb:vortex-file-compressed -1.4% -0.6% -0.9% +10.0% ➖ noise 82 datafusion:vortex-compact -0.3% +2.4% -2.7% +10.0% ➖ noise 82 datafusion:vortex-file-compressed -5.5% +2.4% -7.7% +10.0% ➖ noise 82 duckdb:duckdb +2.0% +2.4% -0.4% +12.5% ➖ noise 82 duckdb:vortex-compact -0.3% +2.4% -2.7% +10.6% ➖ noise 82 duckdb:vortex-file-compressed +0.3% +2.4% -2.1% +10.0% ➖ noise 83 datafusion:vortex-compact +4.6% +1.9% +2.6% +10.0% ➖ noise 83 datafusion:vortex-file-compressed -0.2% +1.9% -2.1% +10.0% ➖ noise 83 duckdb:duckdb +1.0% +1.9% -0.9% +10.1% ➖ noise 83 duckdb:vortex-compact +5.0% +1.9% +3.0% +10.0% ➖ noise 83 duckdb:vortex-file-compressed +8.4% +1.9% +6.4% +10.0% ➖ noise 84 datafusion:vortex-compact +1.9% +0.8% +1.1% +12.7% ➖ noise 84 datafusion:vortex-file-compressed +7.7% +0.8% +6.8% +10.4% ➖ noise 84 duckdb:duckdb +10.7% +0.8% +9.8% +22.7% ➖ noise 84 duckdb:vortex-compact +8.4% +0.8% +7.5% +10.2% ➖ noise 84 duckdb:vortex-file-compressed +0.4% +0.8% -0.4% +10.0% ➖ noise 85 datafusion:vortex-compact +5.3% +2.9% +2.4% +10.0% ➖ noise 85 datafusion:vortex-file-compressed +2.7% +2.9% -0.2% +10.0% ➖ noise 85 duckdb:duckdb -7.9% +2.9% -10.4% +15.1% ➖ noise 85 duckdb:vortex-compact +8.9% +2.9% +5.8% +10.0% ➖ noise 85 duckdb:vortex-file-compressed -0.5% +2.9% -3.3% +10.0% ➖ noise 86 datafusion:vortex-compact +10.4% +5.6% +4.5% +11.9% ➖ noise 86 datafusion:vortex-file-compressed +7.5% +5.6% +1.8% +16.1% ➖ noise 86 duckdb:duckdb +0.4% +5.6% -5.0% +14.8% ➖ noise 86 duckdb:vortex-compact -0.4% +5.6% -5.7% +20.2% ➖ noise 86 duckdb:vortex-file-compressed -2.1% +5.6% -7.3% +19.8% ➖ noise 87 datafusion:vortex-compact +4.4% +1.3% +3.1% +10.0% ➖ noise 87 datafusion:vortex-file-compressed -4.6% +1.3% -5.8% +10.0% ➖ noise 87 duckdb:duckdb -4.8% +1.3% -6.1% +10.0% ➖ noise 87 duckdb:vortex-compact +3.1% +1.3% +1.7% +10.0% ➖ noise 87 duckdb:vortex-file-compressed -10.9% +1.3% -12.0% +13.7% ✅ faster 88 datafusion:vortex-compact -1.5% +0.7% -2.2% +10.0% ➖ noise 88 datafusion:vortex-file-compressed +0.5% +0.7% -0.3% +10.0% ➖ noise 88 duckdb:duckdb +0.1% +0.7% -0.6% +10.0% ➖ noise 88 duckdb:vortex-compact +0.6% +0.7% -0.1% +10.0% ➖ noise 88 duckdb:vortex-file-compressed +4.3% +0.7% +3.6% +10.2% ➖ noise 89 datafusion:vortex-compact -2.1% +2.6% -4.7% +10.0% ➖ noise 89 datafusion:vortex-file-compressed +1.4% +2.6% -1.2% +10.0% ➖ noise 89 duckdb:duckdb +1.3% +2.6% -1.3% +12.9% ➖ noise 89 duckdb:vortex-compact +4.1% +2.6% +1.4% +10.0% ➖ noise 89 duckdb:vortex-file-compressed +2.3% +2.6% -0.3% +11.7% ➖ noise 90 datafusion:vortex-compact +3.9% +5.9% -1.9% +10.0% ➖ noise 90 datafusion:vortex-file-compressed -2.1% +5.9% -7.5% +10.0% ➖ noise 90 duckdb:duckdb -2.8% +5.9% -8.2% +10.0% ➖ noise 90 duckdb:vortex-compact +6.3% +5.9% +0.4% +10.0% ➖ noise 90 duckdb:vortex-file-compressed +1.2% +5.9% -4.4% +10.0% ➖ noise 91 datafusion:vortex-compact +3.5% -2.2% +5.9% +10.0% ➖ noise 91 datafusion:vortex-file-compressed +0.8% -2.2% +3.0% +10.0% ➖ noise 91 duckdb:duckdb +4.2% -2.2% +6.5% +11.0% ➖ noise 91 duckdb:vortex-compact +8.7% -2.2% +11.1% +10.0% 🚨 regression 91 duckdb:vortex-file-compressed -0.3% -2.2% +1.9% +10.0% ➖ noise 92 datafusion:vortex-compact +3.8% +1.7% +2.0% +10.0% ➖ noise 92 datafusion:vortex-file-compressed +5.8% +1.7% +4.0% +10.0% ➖ noise 92 duckdb:duckdb +4.4% +1.7% +2.6% +13.8% ➖ noise 92 duckdb:vortex-compact -2.3% +1.7% -4.0% +18.5% ➖ noise 92 duckdb:vortex-file-compressed +4.2% +1.7% +2.5% +10.0% ➖ noise 93 datafusion:vortex-compact +5.2% -1.9% +7.3% +10.0% ➖ noise 93 datafusion:vortex-file-compressed +4.0% -1.9% +6.0% +10.0% ➖ noise 93 duckdb:duckdb +5.9% -1.9% +7.9% +12.7% ➖ noise 93 duckdb:vortex-compact +2.7% -1.9% +4.7% +11.3% ➖ noise 93 duckdb:vortex-file-compressed +3.7% -1.9% +5.7% +14.8% ➖ noise 94 datafusion:vortex-compact +6.9% +2.7% +4.1% +10.0% ➖ noise 94 datafusion:vortex-file-compressed +9.0% +2.7% +6.1% +11.1% ➖ noise 94 duckdb:duckdb +4.0% +2.7% +1.3% +10.7% ➖ noise 94 duckdb:vortex-compact +0.5% +2.7% -2.1% +11.6% ➖ noise 94 duckdb:vortex-file-compressed +3.3% +2.7% +0.6% +10.2% ➖ noise 95 datafusion:vortex-compact +2.5% -2.9% +5.6% +10.0% ➖ noise 95 datafusion:vortex-file-compressed +1.4% -2.9% +4.5% +10.0% ➖ noise 95 duckdb:duckdb +1.9% -2.9% +4.9% +18.1% ➖ noise 95 duckdb:vortex-compact -8.5% -2.9% -5.7% +11.6% ➖ noise 95 duckdb:vortex-file-compressed -1.8% -2.9% +1.1% +16.6% ➖ noise 96 datafusion:vortex-compact +1.9% +1.7% +0.2% +10.0% ➖ noise 96 datafusion:vortex-file-compressed +7.2% +1.7% +5.4% +10.0% ➖ noise 96 duckdb:duckdb +1.1% +1.7% -0.6% +14.9% ➖ noise 96 duckdb:vortex-compact +2.7% +1.7% +1.0% +10.9% ➖ noise 96 duckdb:vortex-file-compressed -2.3% +1.7% -4.0% +11.9% ➖ noise 97 datafusion:vortex-compact +1.1% +2.4% -1.3% +10.0% ➖ noise 97 datafusion:vortex-file-compressed +1.2% +2.4% -1.1% +10.0% ➖ noise 97 duckdb:duckdb +1.4% +2.4% -0.9% +10.0% ➖ noise 97 duckdb:vortex-compact +0.9% +2.4% -1.4% +13.4% ➖ noise 97 duckdb:vortex-file-compressed -1.8% +2.4% -4.1% +10.9% ➖ noise 98 datafusion:vortex-compact +7.1% -1.0% +8.2% +11.4% ➖ noise 98 datafusion:vortex-file-compressed -0.2% -1.0% +0.9% +10.0% ➖ noise 98 duckdb:duckdb +2.4% -1.0% +3.4% +12.7% ➖ noise 98 duckdb:vortex-compact +1.2% -1.0% +2.2% +10.0% ➖ noise 98 duckdb:vortex-file-compressed +0.8% -1.0% +1.8% +10.6% ➖ noise 99 datafusion:vortex-compact +7.8% -2.3% +10.4% +18.9% ➖ noise 99 datafusion:vortex-file-compressed +1.8% -2.3% +4.3% +16.6% ➖ noise 99 duckdb:duckdb -2.9% -2.3% -0.6% +34.9% ➖ noise 99 duckdb:vortex-compact +13.1% -2.3% +15.8% +30.2% ➖ noise 99 duckdb:vortex-file-compressed +0.7% -2.3% +3.1% +17.1% ➖ noise