Skip to content

Latest commit

 

History

History
208 lines (181 loc) · 38.2 KB

bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95-vs-base.md

File metadata and controls

208 lines (181 loc) · 38.2 KB

Results vs. base

  • fork: python
  • ref: d63af9540f6163104699
  • machine: linux-x86_64
  • commit hash: d63af95
  • commit date: 2025-02-20
  • overall geometric mean: 1.109x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.10x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
docutils 3.62 sec 3.96 sec: 1.09x slower
html5lib 88.2 ms 100 ms: 1.14x slower
sphinx 1.38 sec 1.61 sec: 1.17x slower
Geometric mean (ref) 1.10x slower

Benchmark hidden because not significant (1): 2to3

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
async_tree_io_tg 906 ms 730 ms: 1.24x faster
async_tree_memoization_tg 475 ms 441 ms: 1.08x faster
async_tree_cpu_io_mixed_tg 684 ms 638 ms: 1.07x faster
async_tree_none_tg 370 ms 346 ms: 1.07x faster
async_tree_io 860 ms 819 ms: 1.05x faster
async_tree_none 375 ms 390 ms: 1.04x slower
async_tree_memoization 478 ms 504 ms: 1.05x slower
async_generators 510 ms 578 ms: 1.13x slower
Geometric mean (ref) 1.02x faster

Benchmark hidden because not significant (3): async_tree_cpu_io_mixed, coroutines, asyncio_websockets

Benchmarks with tag 'math':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
float 106 ms 114 ms: 1.07x slower
nbody 119 ms 176 ms: 1.48x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
regex_dna 289 ms 304 ms: 1.05x slower
regex_compile 178 ms 195 ms: 1.10x slower
Geometric mean (ref) 1.04x slower

Benchmark hidden because not significant (2): regex_effbot, regex_v8

Benchmarks with tag 'serialize':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
pickle_pure_python 468 us 497 us: 1.06x slower
json_dumps 15.7 ms 17.4 ms: 1.11x slower
xml_etree_parse 195 ms 218 ms: 1.12x slower
xml_etree_generate 117 ms 137 ms: 1.17x slower
xml_etree_process 75.9 ms 89.0 ms: 1.17x slower
tomli_loads 2.46 sec 2.92 sec: 1.19x slower
json_loads 40.0 us 48.1 us: 1.20x slower
unpickle_pure_python 278 us 347 us: 1.25x slower
Geometric mean (ref) 1.14x slower

Benchmark hidden because not significant (1): xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
python_startup 26.6 ms 32.8 ms: 1.23x slower
python_startup_no_site 15.5 ms 20.4 ms: 1.31x slower
Geometric mean (ref) 1.27x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
django_template 45.7 ms 53.6 ms: 1.17x slower
genshi_xml 67.3 ms 80.1 ms: 1.19x slower
mako 15.8 ms 23.1 ms: 1.46x slower
genshi_text 27.9 ms 41.2 ms: 1.47x slower
Geometric mean (ref) 1.32x slower

All benchmarks:

Benchmark results/bm-20250220-3.14.0a5+-d63af95/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json results/bm-20250220-3.14.0a5+-d63af95-NOGIL/bm-20250220-linux-x86_64-python-d63af9540f6163104699-3.14.0a5+-d63af95.json
gc_traversal 7.62 ms 3.62 ms: 2.11x faster
create_gc_cycles 3.35 ms 2.44 ms: 1.37x faster
async_tree_io_tg 906 ms 730 ms: 1.24x faster
async_tree_memoization_tg 475 ms 441 ms: 1.08x faster
async_tree_cpu_io_mixed_tg 684 ms 638 ms: 1.07x faster
bench_mp_pool 93.5 ms 87.4 ms: 1.07x faster
async_tree_none_tg 370 ms 346 ms: 1.07x faster
pycparser 1.61 sec 1.52 sec: 1.06x faster
async_tree_io 860 ms 819 ms: 1.05x faster
logging_silent 144 ns 138 ns: 1.04x faster
async_tree_none 375 ms 390 ms: 1.04x slower
json 7.53 ms 7.89 ms: 1.05x slower
pathlib 28.4 ms 29.8 ms: 1.05x slower
regex_dna 289 ms 304 ms: 1.05x slower
async_tree_memoization 478 ms 504 ms: 1.05x slower
sqlglot_optimize 73.9 ms 78.3 ms: 1.06x slower
pickle_pure_python 468 us 497 us: 1.06x slower
sqlite_synth 3.57 us 3.80 us: 1.07x slower
float 106 ms 114 ms: 1.07x slower
k_core 4.10 sec 4.40 sec: 1.07x slower
docutils 3.62 sec 3.96 sec: 1.09x slower
generators 41.2 ms 45.2 ms: 1.10x slower
regex_compile 178 ms 195 ms: 1.10x slower
json_dumps 15.7 ms 17.4 ms: 1.11x slower
xml_etree_parse 195 ms 218 ms: 1.12x slower
pyflate 650 ms 731 ms: 1.12x slower
pylint 401 ms 452 ms: 1.13x slower
coverage 121 ms 137 ms: 1.13x slower
sympy_expand 601 ms 678 ms: 1.13x slower
logging_simple 8.41 us 9.53 us: 1.13x slower
async_generators 510 ms 578 ms: 1.13x slower
html5lib 88.2 ms 100 ms: 1.14x slower
spectral_norm 129 ms 147 ms: 1.14x slower
comprehensions 21.8 us 25.0 us: 1.15x slower
logging_format 9.24 us 10.6 us: 1.15x slower
go 156 ms 180 ms: 1.15x slower
pprint_safe_repr 948 ms 1.10 sec: 1.16x slower
thrift 1.05 ms 1.22 ms: 1.16x slower
sphinx 1.38 sec 1.61 sec: 1.17x slower
telco 10.0 ms 11.7 ms: 1.17x slower
connected_components 817 ms 953 ms: 1.17x slower
scimark_sor 152 ms 178 ms: 1.17x slower
xml_etree_generate 117 ms 137 ms: 1.17x slower
xml_etree_process 75.9 ms 89.0 ms: 1.17x slower
django_template 45.7 ms 53.6 ms: 1.17x slower
deepcopy 339 us 399 us: 1.18x slower
pprint_pformat 1.92 sec 2.26 sec: 1.18x slower
tomli_loads 2.46 sec 2.92 sec: 1.19x slower
nqueens 111 ms 131 ms: 1.19x slower
sympy_sum 205 ms 244 ms: 1.19x slower
genshi_xml 67.3 ms 80.1 ms: 1.19x slower
dulwich_log 94.7 ms 113 ms: 1.19x slower
scimark_fft 443 ms 529 ms: 1.19x slower
sqlglot_parse 1.83 ms 2.18 ms: 1.19x slower
sympy_integrate 28.7 ms 34.4 ms: 1.20x slower
sqlalchemy_declarative 177 ms 212 ms: 1.20x slower
deepcopy_reduce 3.57 us 4.29 us: 1.20x slower
json_loads 40.0 us 48.1 us: 1.20x slower
shortest_path 877 ms 1.06 sec: 1.20x slower
sqlalchemy_imperative 22.9 ms 27.7 ms: 1.21x slower
crypto_pyaes 93.7 ms 113 ms: 1.21x slower
subparsers 29.1 ms 35.3 ms: 1.21x slower
mdp 3.54 sec 4.29 sec: 1.21x slower
sqlglot_transpile 2.28 ms 2.76 ms: 1.21x slower
chaos 77.5 ms 94.2 ms: 1.22x slower
deepcopy_memo 40.7 us 49.6 us: 1.22x slower
deltablue 4.18 ms 5.11 ms: 1.22x slower
richards 53.4 ms 65.3 ms: 1.22x slower
richards_super 68.1 ms 83.6 ms: 1.23x slower
raytrace 343 ms 422 ms: 1.23x slower
bpe_tokeniser 5.77 sec 7.09 sec: 1.23x slower
python_startup 26.6 ms 32.8 ms: 1.23x slower
many_optionals 1.28 ms 1.58 ms: 1.24x slower
scimark_lu 146 ms 181 ms: 1.24x slower
unpickle_pure_python 278 us 347 us: 1.25x slower
hexiom 8.52 ms 10.6 ms: 1.25x slower
scimark_monte_carlo 90.3 ms 113 ms: 1.25x slower
sqlglot_normalize 136 ms 171 ms: 1.26x slower
meteor_contest 140 ms 179 ms: 1.28x slower
sympy_str 356 ms 456 ms: 1.28x slower
python_startup_no_site 15.5 ms 20.4 ms: 1.31x slower
typing_runtime_protocols 204 us 269 us: 1.32x slower
scimark_sparse_mat_mult 5.88 ms 7.75 ms: 1.32x slower
fannkuch 502 ms 664 ms: 1.32x slower
bench_thread_pool 3.24 ms 4.39 ms: 1.35x slower
mako 15.8 ms 23.1 ms: 1.46x slower
genshi_text 27.9 ms 41.2 ms: 1.47x slower
nbody 119 ms 176 ms: 1.48x slower
Geometric mean (ref) 1.13x slower

Benchmark hidden because not significant (8): pidigits, xml_etree_iterparse, async_tree_cpu_io_mixed, regex_effbot, 2to3, regex_v8, coroutines, asyncio_websockets

  • Geometric mean (including insignificant results): 1.109x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.12x
  • 95% likely to have a slowdown of 1.11x
  • 99% likely to have a slowdown of 1.10x

Memory

  • memory change: 1.19x