Skip to content

Latest commit

 

History

History
216 lines (190 loc) · 40.8 KB

bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8-vs-base.md

File metadata and controls

216 lines (190 loc) · 40.8 KB

Results vs. base

  • fork: python
  • ref: 5ec4bf86b7f4455432ae
  • machine: linux-x86_64
  • commit hash: 5ec4bf8
  • commit date: 2025-02-22
  • overall geometric mean: 1.102x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.09x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
2to3 442 ms 522 ms: 1.18x slower
docutils 3.53 sec 3.79 sec: 1.07x slower
html5lib 77.2 ms 89.8 ms: 1.16x slower
sphinx 1.36 sec 1.52 sec: 1.12x slower
Geometric mean (ref) 1.13x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
async_tree_io_tg 892 ms 725 ms: 1.23x faster
async_tree_io 884 ms 784 ms: 1.13x faster
async_tree_none_tg 348 ms 321 ms: 1.08x faster
async_tree_cpu_io_mixed_tg 667 ms 632 ms: 1.06x faster
async_tree_cpu_io_mixed 662 ms 684 ms: 1.03x slower
async_tree_none 368 ms 387 ms: 1.05x slower
async_tree_memoization 461 ms 493 ms: 1.07x slower
asyncio_tcp 881 ms 953 ms: 1.08x slower
async_generators 498 ms 562 ms: 1.13x slower
asyncio_tcp_ssl 2.70 sec 3.20 sec: 1.19x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (3): asyncio_websockets, async_tree_memoization_tg, coroutines

Benchmarks with tag 'math':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
float 98.2 ms 103 ms: 1.05x slower
nbody 113 ms 184 ms: 1.62x slower
Geometric mean (ref) 1.20x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
regex_dna 285 ms 268 ms: 1.06x faster
regex_compile 166 ms 195 ms: 1.18x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (2): regex_v8, regex_effbot

Benchmarks with tag 'serialize':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
xml_etree_iterparse 153 ms 132 ms: 1.16x faster
pickle_list 7.19 us 6.66 us: 1.08x faster
unpickle_list 7.17 us 6.90 us: 1.04x faster
xml_etree_parse 187 ms 197 ms: 1.05x slower
pickle_dict 41.3 us 44.3 us: 1.07x slower
xml_etree_generate 119 ms 128 ms: 1.07x slower
xml_etree_process 82.6 ms 90.4 ms: 1.09x slower
unpickle 18.4 us 20.6 us: 1.12x slower
json_loads 37.2 us 42.6 us: 1.15x slower
pickle_pure_python 423 us 486 us: 1.15x slower
tomli_loads 2.48 sec 2.94 sec: 1.19x slower
json_dumps 13.8 ms 16.8 ms: 1.22x slower
unpickle_pure_python 278 us 348 us: 1.25x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (1): pickle

Benchmarks with tag 'startup':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
python_startup 25.8 ms 29.0 ms: 1.13x slower
python_startup_no_site 14.9 ms 18.2 ms: 1.22x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
django_template 42.9 ms 50.2 ms: 1.17x slower
genshi_text 29.5 ms 36.1 ms: 1.22x slower
genshi_xml 65.1 ms 83.4 ms: 1.28x slower
mako 14.9 ms 23.2 ms: 1.56x slower
Geometric mean (ref) 1.30x slower

All benchmarks:

Benchmark results/bm-20250222-3.14.0a5+-5ec4bf8/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json results/bm-20250222-3.14.0a5+-5ec4bf8-NOGIL/bm-20250222-linux-x86_64-python-5ec4bf86b7f4455432ae-3.14.0a5+-5ec4bf8.json
gc_traversal 7.67 ms 2.88 ms: 2.66x faster
create_gc_cycles 3.37 ms 2.19 ms: 1.54x faster
async_tree_io_tg 892 ms 725 ms: 1.23x faster
xml_etree_iterparse 153 ms 132 ms: 1.16x faster
async_tree_io 884 ms 784 ms: 1.13x faster
bench_mp_pool 87.1 ms 77.7 ms: 1.12x faster
async_tree_none_tg 348 ms 321 ms: 1.08x faster
pickle_list 7.19 us 6.66 us: 1.08x faster
regex_dna 285 ms 268 ms: 1.06x faster
async_tree_cpu_io_mixed_tg 667 ms 632 ms: 1.06x faster
unpickle_list 7.17 us 6.90 us: 1.04x faster
async_tree_cpu_io_mixed 662 ms 684 ms: 1.03x slower
k_core 4.03 sec 4.19 sec: 1.04x slower
float 98.2 ms 103 ms: 1.05x slower
async_tree_none 368 ms 387 ms: 1.05x slower
xml_etree_parse 187 ms 197 ms: 1.05x slower
deepcopy_reduce 3.79 us 4.03 us: 1.06x slower
async_tree_memoization 461 ms 493 ms: 1.07x slower
pickle_dict 41.3 us 44.3 us: 1.07x slower
docutils 3.53 sec 3.79 sec: 1.07x slower
xml_etree_generate 119 ms 128 ms: 1.07x slower
asyncio_tcp 881 ms 953 ms: 1.08x slower
sqlglot_normalize 141 ms 153 ms: 1.09x slower
xml_etree_process 82.6 ms 90.4 ms: 1.09x slower
generators 40.9 ms 44.7 ms: 1.09x slower
unpack_sequence 68.8 ns 76.6 ns: 1.11x slower
telco 10.1 ms 11.3 ms: 1.12x slower
sphinx 1.36 sec 1.52 sec: 1.12x slower
unpickle 18.4 us 20.6 us: 1.12x slower
pyflate 642 ms 718 ms: 1.12x slower
mdp 3.46 sec 3.88 sec: 1.12x slower
python_startup 25.8 ms 29.0 ms: 1.13x slower
shortest_path 859 ms 968 ms: 1.13x slower
async_generators 498 ms 562 ms: 1.13x slower
pylint 378 ms 428 ms: 1.13x slower
crypto_pyaes 100 ms 114 ms: 1.14x slower
connected_components 777 ms 884 ms: 1.14x slower
nqueens 113 ms 129 ms: 1.14x slower
spectral_norm 129 ms 147 ms: 1.14x slower
go 159 ms 182 ms: 1.14x slower
thrift 992 us 1.13 ms: 1.14x slower
json_loads 37.2 us 42.6 us: 1.15x slower
pickle_pure_python 423 us 486 us: 1.15x slower
sqlglot_transpile 2.13 ms 2.45 ms: 1.15x slower
pprint_safe_repr 921 ms 1.06 sec: 1.15x slower
scimark_sor 152 ms 176 ms: 1.15x slower
deepcopy 326 us 378 us: 1.16x slower
sympy_expand 576 ms 667 ms: 1.16x slower
richards_super 66.9 ms 77.6 ms: 1.16x slower
html5lib 77.2 ms 89.8 ms: 1.16x slower
richards 59.3 ms 69.0 ms: 1.16x slower
pprint_pformat 1.85 sec 2.16 sec: 1.17x slower
sqlglot_optimize 72.3 ms 84.3 ms: 1.17x slower
django_template 42.9 ms 50.2 ms: 1.17x slower
bpe_tokeniser 5.67 sec 6.64 sec: 1.17x slower
sympy_integrate 26.4 ms 30.9 ms: 1.17x slower
many_optionals 1.28 ms 1.50 ms: 1.17x slower
meteor_contest 144 ms 169 ms: 1.17x slower
scimark_lu 149 ms 175 ms: 1.18x slower
regex_compile 166 ms 195 ms: 1.18x slower
2to3 442 ms 522 ms: 1.18x slower
deltablue 4.29 ms 5.07 ms: 1.18x slower
tomli_loads 2.48 sec 2.94 sec: 1.19x slower
asyncio_tcp_ssl 2.70 sec 3.20 sec: 1.19x slower
sympy_sum 190 ms 230 ms: 1.21x slower
comprehensions 21.0 us 25.4 us: 1.21x slower
logging_simple 7.40 us 9.02 us: 1.22x slower
subparsers 29.3 ms 35.7 ms: 1.22x slower
json_dumps 13.8 ms 16.8 ms: 1.22x slower
logging_format 8.62 us 10.5 us: 1.22x slower
python_startup_no_site 14.9 ms 18.2 ms: 1.22x slower
genshi_text 29.5 ms 36.1 ms: 1.22x slower
coverage 115 ms 141 ms: 1.23x slower
sympy_str 355 ms 435 ms: 1.23x slower
hexiom 8.12 ms 10.1 ms: 1.24x slower
scimark_fft 434 ms 539 ms: 1.24x slower
scimark_sparse_mat_mult 6.17 ms 7.68 ms: 1.25x slower
unpickle_pure_python 278 us 348 us: 1.25x slower
raytrace 330 ms 413 ms: 1.25x slower
chaos 75.8 ms 95.0 ms: 1.25x slower
genshi_xml 65.1 ms 83.4 ms: 1.28x slower
sqlalchemy_declarative 172 ms 221 ms: 1.28x slower
sqlalchemy_imperative 21.6 ms 27.7 ms: 1.28x slower
fannkuch 507 ms 653 ms: 1.29x slower
deepcopy_memo 38.2 us 49.4 us: 1.29x slower
sqlglot_parse 1.73 ms 2.25 ms: 1.31x slower
scimark_monte_carlo 83.7 ms 110 ms: 1.31x slower
typing_runtime_protocols 193 us 260 us: 1.35x slower
mako 14.9 ms 23.2 ms: 1.56x slower
nbody 113 ms 184 ms: 1.62x slower
Geometric mean (ref) 1.11x slower

Benchmark hidden because not significant (14): dulwich_log, regex_v8, sqlite_synth, pycparser, asyncio_websockets, pickle, pidigits, logging_silent, json, async_tree_memoization_tg, regex_effbot, pathlib, coroutines, bench_thread_pool

  • Geometric mean (including insignificant results): 1.102x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.11x
  • 95% likely to have a slowdown of 1.11x
  • 99% likely to have a slowdown of 1.09x

Memory

  • memory change: 1.19x