fix(benchmarks): unblock codspeed runs on pytest 9#1647
Merged
CodSpeed HQ / CodSpeed Performance Analysis
completed
May 4, 2026 in 0s
Acknowledged Regression: -34.64%
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 2 improved benchmarks
❌ 49 (👁 49) regressed benchmarks
✅ 33 untouched benchmarks
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| 👁 | WallTime | test_count[250] |
3 ms | 3.6 ms | -16.6% |
| 👁 | WallTime | test_avg[500] |
2.5 ms | 3.4 ms | -25.65% |
| 👁 | WallTime | test_max[250] |
2.4 ms | 3.4 ms | -27.16% |
| 👁 | WallTime | test_making_and_inserting_models_in_bulk[10] |
9.5 ms | 10.6 ms | -10.62% |
| 👁 | WallTime | test_get_or_none[250] |
2.6 ms | 3.5 ms | -25.38% |
| 👁 | WallTime | test_get_or_create_when_create[10] |
102.4 ms | 119.7 ms | -14.44% |
| 👁 | WallTime | test_get_or_create_when_create[40] |
413.6 ms | 484.2 ms | -14.57% |
| 👁 | WallTime | test_saving_models_individually[20] |
149.3 ms | 167.6 ms | -10.91% |
| 👁 | WallTime | test_values[250] |
5.5 ms | 6.4 ms | -14.2% |
| 👁 | WallTime | test_min[500] |
2.5 ms | 3.4 ms | -25.16% |
| 👁 | WallTime | test_first[500] |
2.5 ms | 3.3 ms | -25.67% |
| 👁 | WallTime | test_get_or_none[1000] |
2.7 ms | 3.5 ms | -24.14% |
| 👁 | WallTime | test_deleting_all[250] |
1.4 ms | 2.2 ms | -34.64% |
| 👁 | WallTime | test_avg[250] |
2.4 ms | 3.5 ms | -30.88% |
| 👁 | WallTime | test_get_or_create_when_create[20] |
209.4 ms | 240.7 ms | -13.01% |
| 👁 | WallTime | test_get_one[500] |
2.7 ms | 3.5 ms | -24.54% |
| 👁 | WallTime | test_get_or_none[500] |
2.7 ms | 3.5 ms | -24.56% |
| 👁 | WallTime | test_values_list[250] |
5.6 ms | 6.5 ms | -13.53% |
| 👁 | WallTime | test_get_or_create_when_get[1000] |
2.7 ms | 3.5 ms | -24.48% |
| 👁 | WallTime | test_get_one[250] |
2.7 ms | 3.5 ms | -24.18% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Comparing fix/benchmarks-pytest9 (695f4ea) with master (53d2462)
Loading