Skip to content

Latest commit

 

History

History
203 lines (177 loc) · 37.2 KB

bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2-vs-base.md

File metadata and controls

203 lines (177 loc) · 37.2 KB

Results vs. base

  • fork: python
  • ref: cd6abe27a2582786da7b
  • machine: linux-x86_64
  • commit hash: cd6abe2
  • commit date: 2025-02-24
  • overall geometric mean: 1.113x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.11x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
2to3 422 ms 509 ms: 1.21x slower
docutils 3.56 sec 3.95 sec: 1.11x slower
html5lib 81.4 ms 96.2 ms: 1.18x slower
sphinx 1.38 sec 1.61 sec: 1.17x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
async_tree_io_tg 875 ms 748 ms: 1.17x faster
async_tree_none_tg 353 ms 336 ms: 1.05x faster
async_tree_io 844 ms 812 ms: 1.04x faster
async_tree_cpu_io_mixed 663 ms 697 ms: 1.05x slower
async_tree_memoization 481 ms 520 ms: 1.08x slower
async_generators 511 ms 570 ms: 1.12x slower
Geometric mean (ref) 1.00x slower

Benchmark hidden because not significant (5): async_tree_memoization_tg, async_tree_cpu_io_mixed_tg, asyncio_websockets, coroutines, async_tree_none

Benchmarks with tag 'math':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
pidigits 233 ms 239 ms: 1.02x slower
nbody 121 ms 181 ms: 1.49x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (1): float

Benchmarks with tag 'regex':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
regex_v8 35.8 ms 32.5 ms: 1.10x faster
regex_dna 272 ms 305 ms: 1.12x slower
regex_compile 159 ms 207 ms: 1.30x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (1): regex_effbot

Benchmarks with tag 'serialize':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
json_dumps 15.7 ms 16.7 ms: 1.06x slower
xml_etree_parse 190 ms 202 ms: 1.06x slower
pickle_pure_python 408 us 479 us: 1.17x slower
xml_etree_generate 113 ms 133 ms: 1.18x slower
json_loads 38.8 us 45.9 us: 1.18x slower
xml_etree_process 78.2 ms 95.9 ms: 1.23x slower
tomli_loads 2.44 sec 3.00 sec: 1.23x slower
unpickle_pure_python 270 us 338 us: 1.25x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (1): xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
python_startup 24.9 ms 31.8 ms: 1.28x slower
python_startup_no_site 15.1 ms 19.8 ms: 1.31x slower
Geometric mean (ref) 1.29x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
django_template 46.6 ms 51.9 ms: 1.11x slower
genshi_xml 63.5 ms 79.8 ms: 1.26x slower
genshi_text 27.5 ms 38.1 ms: 1.39x slower
mako 15.6 ms 22.3 ms: 1.43x slower
Geometric mean (ref) 1.29x slower

All benchmarks:

Benchmark results/bm-20250224-3.14.0a5+-cd6abe2/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json results/bm-20250224-3.14.0a5+-cd6abe2-NOGIL/bm-20250224-linux-x86_64-python-cd6abe27a2582786da7b-3.14.0a5+-cd6abe2.json
gc_traversal 9.44 ms 3.46 ms: 2.73x faster
create_gc_cycles 3.78 ms 2.35 ms: 1.61x faster
bench_mp_pool 94.4 ms 77.1 ms: 1.22x faster
async_tree_io_tg 875 ms 748 ms: 1.17x faster
regex_v8 35.8 ms 32.5 ms: 1.10x faster
async_tree_none_tg 353 ms 336 ms: 1.05x faster
async_tree_io 844 ms 812 ms: 1.04x faster
pidigits 233 ms 239 ms: 1.02x slower
k_core 4.19 sec 4.37 sec: 1.04x slower
async_tree_cpu_io_mixed 663 ms 697 ms: 1.05x slower
json_dumps 15.7 ms 16.7 ms: 1.06x slower
xml_etree_parse 190 ms 202 ms: 1.06x slower
generators 40.4 ms 43.3 ms: 1.07x slower
json 7.13 ms 7.71 ms: 1.08x slower
async_tree_memoization 481 ms 520 ms: 1.08x slower
mdp 3.68 sec 4.02 sec: 1.09x slower
sqlite_synth 3.42 us 3.77 us: 1.10x slower
deepcopy_reduce 3.59 us 3.97 us: 1.11x slower
sqlglot_normalize 140 ms 156 ms: 1.11x slower
docutils 3.56 sec 3.95 sec: 1.11x slower
logging_silent 130 ns 145 ns: 1.11x slower
django_template 46.6 ms 51.9 ms: 1.11x slower
async_generators 511 ms 570 ms: 1.12x slower
regex_dna 272 ms 305 ms: 1.12x slower
pylint 385 ms 431 ms: 1.12x slower
dulwich_log 98.6 ms 111 ms: 1.12x slower
shortest_path 922 ms 1.04 sec: 1.12x slower
pprint_safe_repr 953 ms 1.08 sec: 1.13x slower
pyflate 616 ms 698 ms: 1.13x slower
chaos 77.4 ms 87.9 ms: 1.14x slower
sympy_integrate 26.9 ms 30.7 ms: 1.14x slower
go 153 ms 174 ms: 1.14x slower
coverage 119 ms 137 ms: 1.15x slower
pprint_pformat 1.93 sec 2.23 sec: 1.15x slower
meteor_contest 143 ms 166 ms: 1.16x slower
subparsers 30.7 ms 35.7 ms: 1.16x slower
scimark_sor 155 ms 181 ms: 1.17x slower
spectral_norm 131 ms 153 ms: 1.17x slower
sphinx 1.38 sec 1.61 sec: 1.17x slower
pickle_pure_python 408 us 479 us: 1.17x slower
deepcopy 332 us 390 us: 1.17x slower
telco 10.5 ms 12.3 ms: 1.17x slower
connected_components 816 ms 959 ms: 1.18x slower
xml_etree_generate 113 ms 133 ms: 1.18x slower
html5lib 81.4 ms 96.2 ms: 1.18x slower
thrift 1.01 ms 1.19 ms: 1.18x slower
json_loads 38.8 us 45.9 us: 1.18x slower
fannkuch 524 ms 621 ms: 1.19x slower
many_optionals 1.24 ms 1.48 ms: 1.19x slower
crypto_pyaes 97.5 ms 116 ms: 1.19x slower
deltablue 4.19 ms 4.99 ms: 1.19x slower
richards 59.0 ms 70.3 ms: 1.19x slower
bpe_tokeniser 5.78 sec 6.92 sec: 1.20x slower
sympy_expand 575 ms 689 ms: 1.20x slower
logging_simple 8.21 us 9.85 us: 1.20x slower
scimark_fft 436 ms 524 ms: 1.20x slower
sqlalchemy_imperative 23.8 ms 28.6 ms: 1.20x slower
logging_format 9.11 us 11.0 us: 1.20x slower
sqlalchemy_declarative 171 ms 206 ms: 1.20x slower
deepcopy_memo 40.8 us 49.3 us: 1.21x slower
2to3 422 ms 509 ms: 1.21x slower
raytrace 345 ms 418 ms: 1.21x slower
comprehensions 21.1 us 25.9 us: 1.23x slower
xml_etree_process 78.2 ms 95.9 ms: 1.23x slower
sympy_sum 198 ms 243 ms: 1.23x slower
tomli_loads 2.44 sec 3.00 sec: 1.23x slower
sympy_str 338 ms 422 ms: 1.25x slower
unpickle_pure_python 270 us 338 us: 1.25x slower
genshi_xml 63.5 ms 79.8 ms: 1.26x slower
scimark_monte_carlo 87.2 ms 110 ms: 1.26x slower
scimark_lu 151 ms 191 ms: 1.26x slower
python_startup 24.9 ms 31.8 ms: 1.28x slower
typing_runtime_protocols 204 us 261 us: 1.28x slower
sqlglot_transpile 2.07 ms 2.65 ms: 1.28x slower
sqlglot_optimize 67.9 ms 88.0 ms: 1.30x slower
richards_super 63.3 ms 82.3 ms: 1.30x slower
regex_compile 159 ms 207 ms: 1.30x slower
sqlglot_parse 1.71 ms 2.24 ms: 1.31x slower
python_startup_no_site 15.1 ms 19.8 ms: 1.31x slower
nqueens 99.0 ms 136 ms: 1.37x slower
genshi_text 27.5 ms 38.1 ms: 1.39x slower
hexiom 7.71 ms 10.8 ms: 1.40x slower
mako 15.6 ms 22.3 ms: 1.43x slower
scimark_sparse_mat_mult 5.80 ms 8.44 ms: 1.45x slower
nbody 121 ms 181 ms: 1.49x slower
Geometric mean (ref) 1.13x slower

Benchmark hidden because not significant (11): regex_effbot, async_tree_memoization_tg, pycparser, async_tree_cpu_io_mixed_tg, bench_thread_pool, pathlib, float, asyncio_websockets, coroutines, async_tree_none, xml_etree_iterparse

  • Geometric mean (including insignificant results): 1.113x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.12x
  • 95% likely to have a slowdown of 1.12x
  • 99% likely to have a slowdown of 1.11x

Memory

  • memory change: 1.19x