bolt-beches-all-opts

❯ uvx pyperf compare_to bolt-baseline.json bolt-all-opts.json -G
Benchmarks with tag 'apps':
===========================

Faster (2):
- 2to3: 230 ms +- 1 ms -> 223 ms +- 1 ms: 1.03x faster
- docutils: 2.22 sec +- 0.01 sec -> 2.19 sec +- 0.02 sec: 1.01x faster

Benchmark hidden because not significant (1): html5lib

Geometric mean: 1.01x faster

Benchmarks with tag 'math':
===========================

Faster (3):
- nbody: 88.3 ms +- 0.6 ms -> 80.1 ms +- 0.8 ms: 1.10x faster
- float: 66.4 ms +- 1.1 ms -> 62.5 ms +- 0.6 ms: 1.06x faster
- pidigits: 160 ms +- 1 ms -> 158 ms +- 1 ms: 1.01x faster

Geometric mean: 1.06x faster

Benchmarks with tag 'regex':
============================

Slower (1):
- regex_dna: 147 ms +- 3 ms -> 153 ms +- 1 ms: 1.04x slower

Faster (3):
- regex_compile: 118 ms +- 1 ms -> 110 ms +- 1 ms: 1.08x faster
- regex_effbot: 2.47 ms +- 0.03 ms -> 2.33 ms +- 0.04 ms: 1.06x faster
- regex_v8: 22.1 ms +- 0.2 ms -> 21.4 ms +- 0.1 ms: 1.03x faster

Geometric mean: 1.03x faster

Benchmarks with tag 'serialize':
================================

Slower (3):
- json_loads: 22.9 us +- 0.2 us -> 23.1 us +- 0.2 us: 1.01x slower
- xml_etree_iterparse: 78.7 ms +- 0.6 ms -> 79.0 ms +- 0.9 ms: 1.00x slower
- xml_etree_parse: 114 ms +- 1 ms -> 114 ms +- 1 ms: 1.00x slower

Faster (9):
- unpickle_pure_python: 210 us +- 1 us -> 195 us +- 1 us: 1.08x faster
- unpickle_list: 4.36 us +- 0.07 us -> 4.14 us +- 0.10 us: 1.05x faster
- pickle_pure_python: 298 us +- 3 us -> 283 us +- 3 us: 1.05x faster
- json_dumps: 10.1 ms +- 0.2 ms -> 9.60 ms +- 0.10 ms: 1.05x faster
- xml_etree_process: 54.6 ms +- 0.4 ms -> 52.3 ms +- 0.4 ms: 1.04x faster
- tomli_loads: 1.93 sec +- 0.02 sec -> 1.85 sec +- 0.02 sec: 1.04x faster
- xml_etree_generate: 78.3 ms +- 0.5 ms -> 75.7 ms +- 0.6 ms: 1.04x faster
- pickle: 11.1 us +- 0.4 us -> 10.9 us +- 0.1 us: 1.01x faster
- pickle_list: 3.84 us +- 0.07 us -> 3.82 us +- 0.06 us: 1.00x faster

Benchmark hidden because not significant (2): pickle_dict, unpickle

Geometric mean: 1.02x faster

Benchmarks with tag 'startup':
==============================

Slower (2):
- python_startup_no_site: 6.52 ms +- 0.03 ms -> 8.53 ms +- 0.04 ms: 1.31x slower
- python_startup: 9.30 ms +- 0.03 ms -> 11.2 ms +- 0.0 ms: 1.21x slower

Geometric mean: 1.26x slower

Benchmarks with tag 'template':
===============================

Faster (3):
- genshi_text: 19.6 ms +- 0.2 ms -> 18.5 ms +- 0.2 ms: 1.06x faster
- genshi_xml: 46.1 ms +- 0.6 ms -> 44.1 ms +- 0.4 ms: 1.05x faster
- mako: 10.2 ms +- 0.1 ms -> 9.92 ms +- 0.07 ms: 1.03x faster

Geometric mean: 1.04x faster

All benchmarks:
===============

Slower (10):
- sqlglot_normalize: 102 ms +- 1 ms -> 275 ms +- 3 ms: 2.70x slower
- python_startup_no_site: 6.52 ms +- 0.03 ms -> 8.53 ms +- 0.04 ms: 1.31x slower
- python_startup: 9.30 ms +- 0.03 ms -> 11.2 ms +- 0.0 ms: 1.21x slower
- bench_mp_pool: 26.1 ms +- 0.4 ms -> 28.3 ms +- 0.6 ms: 1.08x slower
- create_gc_cycles: 954 us +- 5 us -> 1.00 ms +- 0.01 ms: 1.05x slower
- regex_dna: 147 ms +- 3 ms -> 153 ms +- 1 ms: 1.04x slower
- gc_traversal: 2.78 ms +- 0.06 ms -> 2.84 ms +- 0.03 ms: 1.02x slower
- json_loads: 22.9 us +- 0.2 us -> 23.1 us +- 0.2 us: 1.01x slower
- xml_etree_iterparse: 78.7 ms +- 0.6 ms -> 79.0 ms +- 0.9 ms: 1.00x slower
- xml_etree_parse: 114 ms +- 1 ms -> 114 ms +- 1 ms: 1.00x slower

Faster (58):
- unpack_sequence: 37.4 ns +- 1.9 ns -> 33.1 ns +- 0.5 ns: 1.13x faster
- deltablue: 2.91 ms +- 0.03 ms -> 2.63 ms +- 0.02 ms: 1.11x faster
- nbody: 88.3 ms +- 0.6 ms -> 80.1 ms +- 0.8 ms: 1.10x faster
- logging_silent: 107 ns +- 1 ns -> 97.3 ns +- 1.8 ns: 1.10x faster
- hexiom: 5.63 ms +- 0.06 ms -> 5.13 ms +- 0.05 ms: 1.10x faster
- async_generators: 376 ms +- 4 ms -> 345 ms +- 3 ms: 1.09x faster
- go: 110 ms +- 1 ms -> 101 ms +- 1 ms: 1.09x faster
- chaos: 58.0 ms +- 0.8 ms -> 53.5 ms +- 0.6 ms: 1.08x faster
- regex_compile: 118 ms +- 1 ms -> 110 ms +- 1 ms: 1.08x faster
- unpickle_pure_python: 210 us +- 1 us -> 195 us +- 1 us: 1.08x faster
- pyflate: 380 ms +- 3 ms -> 354 ms +- 4 ms: 1.07x faster
- genshi_text: 19.6 ms +- 0.2 ms -> 18.5 ms +- 0.2 ms: 1.06x faster
- float: 66.4 ms +- 1.1 ms -> 62.5 ms +- 0.6 ms: 1.06x faster
- comprehensions: 15.3 us +- 0.1 us -> 14.4 us +- 0.3 us: 1.06x faster
- deepcopy: 250 us +- 2 us -> 236 us +- 2 us: 1.06x faster
- regex_effbot: 2.47 ms +- 0.03 ms -> 2.33 ms +- 0.04 ms: 1.06x faster
- scimark_fft: 313 ms +- 3 ms -> 297 ms +- 9 ms: 1.06x faster
- scimark_monte_carlo: 59.3 ms +- 0.4 ms -> 56.3 ms +- 0.9 ms: 1.05x faster
- unpickle_list: 4.36 us +- 0.07 us -> 4.14 us +- 0.10 us: 1.05x faster
- pickle_pure_python: 298 us +- 3 us -> 283 us +- 3 us: 1.05x faster
- richards: 43.6 ms +- 0.4 ms -> 41.5 ms +- 0.6 ms: 1.05x faster
- deepcopy_reduce: 2.60 us +- 0.03 us -> 2.48 us +- 0.03 us: 1.05x faster
- telco: 6.60 ms +- 0.10 ms -> 6.30 ms +- 0.11 ms: 1.05x faster
- json_dumps: 10.1 ms +- 0.2 ms -> 9.60 ms +- 0.10 ms: 1.05x faster
- logging_simple: 5.25 us +- 0.07 us -> 5.02 us +- 0.06 us: 1.05x faster
- nqueens: 74.4 ms +- 0.7 ms -> 71.1 ms +- 0.8 ms: 1.05x faster
- genshi_xml: 46.1 ms +- 0.6 ms -> 44.1 ms +- 0.4 ms: 1.05x faster
- meteor_contest: 89.6 ms +- 0.4 ms -> 85.8 ms +- 0.4 ms: 1.04x faster
- spectral_norm: 93.0 ms +- 0.8 ms -> 89.1 ms +- 0.7 ms: 1.04x faster
- xml_etree_process: 54.6 ms +- 0.4 ms -> 52.3 ms +- 0.4 ms: 1.04x faster
- mdp: 2.33 sec +- 0.02 sec -> 2.23 sec +- 0.03 sec: 1.04x faster
- dulwich_log: 60.0 ms +- 0.3 ms -> 57.6 ms +- 0.4 ms: 1.04x faster
- pprint_pformat: 1.38 sec +- 0.01 sec -> 1.33 sec +- 0.01 sec: 1.04x faster
- scimark_lu: 112 ms +- 1 ms -> 107 ms +- 1 ms: 1.04x faster
- coroutines: 20.4 ms +- 0.3 ms -> 19.6 ms +- 0.4 ms: 1.04x faster
- scimark_sparse_mat_mult: 4.21 ms +- 0.11 ms -> 4.05 ms +- 0.12 ms: 1.04x faster
- tomli_loads: 1.93 sec +- 0.02 sec -> 1.85 sec +- 0.02 sec: 1.04x faster
- scimark_sor: 114 ms +- 1 ms -> 110 ms +- 1 ms: 1.04x faster
- xml_etree_generate: 78.3 ms +- 0.5 ms -> 75.7 ms +- 0.6 ms: 1.04x faster
- pprint_safe_repr: 667 ms +- 6 ms -> 646 ms +- 7 ms: 1.03x faster
- 2to3: 230 ms +- 1 ms -> 223 ms +- 1 ms: 1.03x faster
- regex_v8: 22.1 ms +- 0.2 ms -> 21.4 ms +- 0.1 ms: 1.03x faster
- richards_super: 49.7 ms +- 0.4 ms -> 48.3 ms +- 0.5 ms: 1.03x faster
- mako: 10.2 ms +- 0.1 ms -> 9.92 ms +- 0.07 ms: 1.03x faster
- deepcopy_memo: 29.6 us +- 0.2 us -> 28.8 us +- 0.3 us: 1.03x faster
- bench_thread_pool: 936 us +- 39 us -> 913 us +- 38 us: 1.02x faster
- generators: 25.3 ms +- 0.2 ms -> 24.7 ms +- 0.2 ms: 1.02x faster
- raytrace: 256 ms +- 3 ms -> 250 ms +- 2 ms: 1.02x faster
- asyncio_websockets: 508 ms +- 24 ms -> 496 ms +- 2 ms: 1.02x faster
- logging_format: 5.82 us +- 0.13 us -> 5.69 us +- 0.11 us: 1.02x faster
- pidigits: 160 ms +- 1 ms -> 158 ms +- 1 ms: 1.01x faster
- docutils: 2.22 sec +- 0.01 sec -> 2.19 sec +- 0.02 sec: 1.01x faster
- pickle: 11.1 us +- 0.4 us -> 10.9 us +- 0.1 us: 1.01x faster
- typing_runtime_protocols: 153 us +- 3 us -> 151 us +- 6 us: 1.01x faster
- pathlib: 19.2 ms +- 0.1 ms -> 19.0 ms +- 0.1 ms: 1.01x faster
- pickle_list: 3.84 us +- 0.07 us -> 3.82 us +- 0.06 us: 1.00x faster
- asyncio_tcp: 429 ms +- 4 ms -> 428 ms +- 3 ms: 1.00x faster
- asyncio_tcp_ssl: 1.48 sec +- 0.01 sec -> 1.47 sec +- 0.01 sec: 1.00x faster

Benchmark hidden because not significant (5): crypto_pyaes, fannkuch, html5lib, pickle_dict, unpickle

Geometric mean: 1.01x faster