Improve SLT test harness#8567
Conversation
Merging this PR will not alter performance
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | chunked_varbinview_into_canonical[(1000, 10)] |
168.8 µs | 205.6 µs | -17.87% |
| ❌ | Simulation | slice_empty_vortex |
310 ns | 368.3 ns | -15.84% |
| ⚡ | Simulation | chunked_varbinview_opt_canonical_into[(1000, 10)] |
205.9 µs | 169.4 µs | +21.54% |
| ⚡ | Simulation | bitwise_not_vortex_buffer_mut[128] |
244.4 ns | 215.3 ns | +13.55% |
| ⚡ | Simulation | bitwise_not_vortex_buffer_mut[1024] |
304.7 ns | 275.6 ns | +10.58% |
| ⚡ | Simulation | eq_i64_constant |
318.6 µs | 288.7 µs | +10.35% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing adamg/improve-slt (0cc13dd) with develop (b0fb9f1)
Footnotes
-
4 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Summary
This PR improves the SLT test harness in the following way
sqllogictestcrate re-exports to get support for nextest and better filtering!--completeflag that can just fill-in results$__TEST_DIR__with${WORK_DIR}that is a test-only scratch dir that gets cleaned up at the end of the test.