Skip to content

Instantly share code, notes, and snippets.

@zanieb
Last active January 11, 2025 00:02
Show Gist options
  • Save zanieb/eee897b77597f93d0d3e0c2081dbc712 to your computer and use it in GitHub Desktop.
Save zanieb/eee897b77597f93d0d3e0c2081dbc712 to your computer and use it in GitHub Desktop.

On a Hetzner bare metal machine with AMD Ryzen 5 3600, 64 GB DDR4 RAM, 2 x 512 GB NVMe SSD

❯ uvx pyperf compare_to bolt-baseline.json bolt-hugify.json bolt-cdsplit.json bolt-split-all-cold.json
Benchmarks with tag 'apps':
===========================

2to3
====

Mean +- std dev: [bolt-baseline] 266 ms +- 1 ms -> [bolt-hugify] 258 ms +- 1 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 266 ms +- 1 ms -> [bolt-cdsplit] 263 ms +- 1 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 266 ms +- 1 ms -> [bolt-split-all-cold] 260 ms +- 1 ms: 1.02x faster

docutils
========

Mean +- std dev: [bolt-baseline] 2.38 sec +- 0.01 sec -> [bolt-hugify] 2.30 sec +- 0.02 sec: 1.03x faster
Mean +- std dev: [bolt-baseline] 2.38 sec +- 0.01 sec -> [bolt-cdsplit] 2.34 sec +- 0.02 sec: 1.02x faster
Mean +- std dev: [bolt-baseline] 2.38 sec +- 0.01 sec -> [bolt-split-all-cold] 2.31 sec +- 0.02 sec: 1.03x faster

html5lib
========

Mean +- std dev: [bolt-baseline] 65.3 ms +- 0.6 ms -> [bolt-hugify] 63.4 ms +- 0.7 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 65.3 ms +- 0.6 ms -> [bolt-cdsplit] 64.6 ms +- 0.5 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 65.3 ms +- 0.6 ms -> [bolt-split-all-cold] 64.0 ms +- 0.5 ms: 1.02x faster


Geometric mean
==============

bolt-hugify: 1.03x faster
bolt-cdsplit: 1.01x faster
bolt-split-all-cold: 1.02x faster

Benchmarks with tag 'math':
===========================

float
=====

Mean +- std dev: [bolt-baseline] 77.6 ms +- 1.1 ms -> [bolt-hugify] 75.4 ms +- 1.2 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 77.6 ms +- 1.1 ms -> [bolt-cdsplit] 77.9 ms +- 1.0 ms: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 77.6 ms +- 1.1 ms -> [bolt-split-all-cold] 77.5 ms +- 0.8 ms: 1.00x faster
Not significant!

nbody
=====

Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-hugify] 109 ms +- 1 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-cdsplit] 109 ms +- 1 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-split-all-cold] 117 ms +- 1 ms: 1.02x slower

pidigits
========

Mean +- std dev: [bolt-baseline] 182 ms +- 1 ms -> [bolt-hugify] 182 ms +- 1 ms: 1.00x faster
Mean +- std dev: [bolt-baseline] 182 ms +- 1 ms -> [bolt-cdsplit] 180 ms +- 1 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 182 ms +- 1 ms -> [bolt-split-all-cold] 182 ms +- 1 ms: 1.00x faster


Geometric mean
==============

bolt-hugify: 1.03x faster
bolt-cdsplit: 1.02x faster
bolt-split-all-cold: 1.00x slower

Benchmarks with tag 'regex':
============================

regex_compile
=============

Mean +- std dev: [bolt-baseline] 149 ms +- 1 ms -> [bolt-hugify] 141 ms +- 1 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 149 ms +- 1 ms -> [bolt-cdsplit] 147 ms +- 1 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 149 ms +- 1 ms -> [bolt-split-all-cold] 144 ms +- 1 ms: 1.03x faster

regex_dna
=========

Mean +- std dev: [bolt-baseline] 158 ms +- 2 ms -> [bolt-hugify] 154 ms +- 2 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 158 ms +- 2 ms -> [bolt-cdsplit] 164 ms +- 2 ms: 1.03x slower
Mean +- std dev: [bolt-baseline] 158 ms +- 2 ms -> [bolt-split-all-cold] 154 ms +- 2 ms: 1.03x faster

regex_effbot
============

Mean +- std dev: [bolt-baseline] 2.65 ms +- 0.06 ms -> [bolt-hugify] 2.65 ms +- 0.06 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 2.65 ms +- 0.06 ms -> [bolt-cdsplit] 2.76 ms +- 0.06 ms: 1.04x slower
Mean +- std dev: [bolt-baseline] 2.65 ms +- 0.06 ms -> [bolt-split-all-cold] 2.70 ms +- 0.05 ms: 1.02x slower

regex_v8
========

Mean +- std dev: [bolt-baseline] 22.9 ms +- 0.3 ms -> [bolt-hugify] 22.1 ms +- 0.2 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 22.9 ms +- 0.3 ms -> [bolt-cdsplit] 22.9 ms +- 0.4 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 22.9 ms +- 0.3 ms -> [bolt-split-all-cold] 22.9 ms +- 0.3 ms: 1.00x faster
Not significant!


Geometric mean
==============

bolt-hugify: 1.03x faster
bolt-cdsplit: 1.01x slower
bolt-split-all-cold: 1.01x faster

Benchmarks with tag 'serialize':
================================

json_dumps
==========

Mean +- std dev: [bolt-baseline] 11.7 ms +- 0.1 ms -> [bolt-hugify] 11.1 ms +- 0.2 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 11.7 ms +- 0.1 ms -> [bolt-cdsplit] 11.7 ms +- 0.2 ms: 1.00x slower
Mean +- std dev: [bolt-baseline] 11.7 ms +- 0.1 ms -> [bolt-split-all-cold] 11.4 ms +- 0.1 ms: 1.03x faster

json_loads
==========

Mean +- std dev: [bolt-baseline] 22.2 us +- 0.2 us -> [bolt-hugify] 21.6 us +- 0.3 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 22.2 us +- 0.2 us -> [bolt-cdsplit] 22.9 us +- 0.2 us: 1.03x slower
Mean +- std dev: [bolt-baseline] 22.2 us +- 0.2 us -> [bolt-split-all-cold] 23.2 us +- 0.3 us: 1.05x slower

pickle
======

Mean +- std dev: [bolt-baseline] 11.0 us +- 0.1 us -> [bolt-hugify] 10.7 us +- 0.2 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 11.0 us +- 0.1 us -> [bolt-cdsplit] 11.0 us +- 0.1 us: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 11.0 us +- 0.1 us -> [bolt-split-all-cold] 10.7 us +- 0.1 us: 1.03x faster

pickle_dict
===========

Mean +- std dev: [bolt-baseline] 24.1 us +- 0.5 us -> [bolt-hugify] 24.0 us +- 0.2 us: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 24.1 us +- 0.5 us -> [bolt-cdsplit] 23.5 us +- 1.2 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 24.1 us +- 0.5 us -> [bolt-split-all-cold] 22.9 us +- 0.4 us: 1.05x faster

pickle_list
===========

Mean +- std dev: [bolt-baseline] 3.88 us +- 0.11 us -> [bolt-hugify] 3.87 us +- 0.09 us: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 3.88 us +- 0.11 us -> [bolt-cdsplit] 3.84 us +- 0.05 us: 1.01x faster
Mean +- std dev: [bolt-baseline] 3.88 us +- 0.11 us -> [bolt-split-all-cold] 3.84 us +- 0.05 us: 1.01x faster

pickle_pure_python
==================

Mean +- std dev: [bolt-baseline] 366 us +- 2 us -> [bolt-hugify] 348 us +- 4 us: 1.05x faster
Mean +- std dev: [bolt-baseline] 366 us +- 2 us -> [bolt-cdsplit] 356 us +- 3 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 366 us +- 2 us -> [bolt-split-all-cold] 361 us +- 2 us: 1.01x faster

tomli_loads
===========

Mean +- std dev: [bolt-baseline] 2.81 sec +- 0.03 sec -> [bolt-hugify] 2.58 sec +- 0.02 sec: 1.09x faster
Mean +- std dev: [bolt-baseline] 2.81 sec +- 0.03 sec -> [bolt-cdsplit] 2.69 sec +- 0.02 sec: 1.04x faster
Mean +- std dev: [bolt-baseline] 2.81 sec +- 0.03 sec -> [bolt-split-all-cold] 2.70 sec +- 0.02 sec: 1.04x faster

unpickle
========

Mean +- std dev: [bolt-baseline] 12.7 us +- 0.1 us -> [bolt-hugify] 12.8 us +- 0.1 us: 1.00x slower
Mean +- std dev: [bolt-baseline] 12.7 us +- 0.1 us -> [bolt-cdsplit] 13.2 us +- 0.1 us: 1.04x slower
Mean +- std dev: [bolt-baseline] 12.7 us +- 0.1 us -> [bolt-split-all-cold] 13.0 us +- 0.1 us: 1.02x slower

unpickle_list
=============

Mean +- std dev: [bolt-baseline] 4.09 us +- 0.11 us -> [bolt-hugify] 4.01 us +- 0.07 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 4.09 us +- 0.11 us -> [bolt-cdsplit] 4.00 us +- 0.04 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 4.09 us +- 0.11 us -> [bolt-split-all-cold] 4.54 us +- 0.04 us: 1.11x slower

unpickle_pure_python
====================

Mean +- std dev: [bolt-baseline] 251 us +- 2 us -> [bolt-hugify] 240 us +- 3 us: 1.05x faster
Mean +- std dev: [bolt-baseline] 251 us +- 2 us -> [bolt-cdsplit] 244 us +- 2 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 251 us +- 2 us -> [bolt-split-all-cold] 248 us +- 2 us: 1.01x faster

xml_etree_parse
===============

Mean +- std dev: [bolt-baseline] 150 ms +- 3 ms -> [bolt-hugify] 148 ms +- 2 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 150 ms +- 3 ms -> [bolt-cdsplit] 142 ms +- 2 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 150 ms +- 3 ms -> [bolt-split-all-cold] 139 ms +- 2 ms: 1.08x faster

xml_etree_iterparse
===================

Mean +- std dev: [bolt-baseline] 97.2 ms +- 1.1 ms -> [bolt-hugify] 95.7 ms +- 1.2 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 97.2 ms +- 1.1 ms -> [bolt-cdsplit] 96.8 ms +- 0.9 ms: 1.00x faster
Mean +- std dev: [bolt-baseline] 97.2 ms +- 1.1 ms -> [bolt-split-all-cold] 94.1 ms +- 0.5 ms: 1.03x faster

xml_etree_generate
==================

Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-hugify] 85.2 ms +- 0.7 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-cdsplit] 89.9 ms +- 0.8 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-split-all-cold] 89.2 ms +- 0.6 ms: 1.01x slower

xml_etree_process
=================

Mean +- std dev: [bolt-baseline] 63.3 ms +- 0.5 ms -> [bolt-hugify] 60.0 ms +- 0.6 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 63.3 ms +- 0.5 ms -> [bolt-cdsplit] 63.7 ms +- 0.4 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 63.3 ms +- 0.5 ms -> [bolt-split-all-cold] 63.1 ms +- 0.5 ms: 1.00x faster


Geometric mean
==============

bolt-hugify: 1.03x faster
bolt-cdsplit: 1.01x faster
bolt-split-all-cold: 1.01x faster

Benchmarks with tag 'startup':
==============================

python_startup
==============

Mean +- std dev: [bolt-baseline] 9.40 ms +- 0.03 ms -> [bolt-hugify] 11.4 ms +- 0.0 ms: 1.22x slower
Mean +- std dev: [bolt-baseline] 9.40 ms +- 0.03 ms -> [bolt-cdsplit] 9.42 ms +- 0.02 ms: 1.00x slower
Mean +- std dev: [bolt-baseline] 9.40 ms +- 0.03 ms -> [bolt-split-all-cold] 9.41 ms +- 0.02 ms: 1.00x slower

python_startup_no_site
======================

Mean +- std dev: [bolt-baseline] 6.63 ms +- 0.02 ms -> [bolt-hugify] 8.66 ms +- 0.04 ms: 1.31x slower
Mean +- std dev: [bolt-baseline] 6.63 ms +- 0.02 ms -> [bolt-cdsplit] 6.64 ms +- 0.03 ms: 1.00x slower
Mean +- std dev: [bolt-baseline] 6.63 ms +- 0.02 ms -> [bolt-split-all-cold] 6.63 ms +- 0.02 ms: 1.00x slower
Not significant!


Geometric mean
==============

bolt-hugify: 1.26x slower
bolt-cdsplit: 1.00x slower
bolt-split-all-cold: 1.00x slower

Benchmarks with tag 'template':
===============================

genshi_text
===========

Mean +- std dev: [bolt-baseline] 25.6 ms +- 0.3 ms -> [bolt-hugify] 24.4 ms +- 0.2 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 25.6 ms +- 0.3 ms -> [bolt-cdsplit] 24.9 ms +- 0.2 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 25.6 ms +- 0.3 ms -> [bolt-split-all-cold] 25.1 ms +- 0.3 ms: 1.02x faster

genshi_xml
==========

Mean +- std dev: [bolt-baseline] 61.7 ms +- 0.4 ms -> [bolt-hugify] 57.0 ms +- 0.4 ms: 1.08x faster
Mean +- std dev: [bolt-baseline] 61.7 ms +- 0.4 ms -> [bolt-cdsplit] 62.5 ms +- 0.5 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 61.7 ms +- 0.4 ms -> [bolt-split-all-cold] 60.8 ms +- 0.4 ms: 1.01x faster

mako
====

Mean +- std dev: [bolt-baseline] 12.9 ms +- 0.2 ms -> [bolt-hugify] 12.4 ms +- 0.3 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 12.9 ms +- 0.2 ms -> [bolt-cdsplit] 12.8 ms +- 0.1 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 12.9 ms +- 0.2 ms -> [bolt-split-all-cold] 12.4 ms +- 0.2 ms: 1.04x faster


Geometric mean
==============

bolt-hugify: 1.06x faster
bolt-cdsplit: 1.01x faster
bolt-split-all-cold: 1.03x faster

All benchmarks:
===============

2to3
====

Mean +- std dev: [bolt-baseline] 266 ms +- 1 ms -> [bolt-hugify] 258 ms +- 1 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 266 ms +- 1 ms -> [bolt-cdsplit] 263 ms +- 1 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 266 ms +- 1 ms -> [bolt-split-all-cold] 260 ms +- 1 ms: 1.02x faster

async_generators
================

Mean +- std dev: [bolt-baseline] 437 ms +- 4 ms -> [bolt-hugify] 408 ms +- 4 ms: 1.07x faster
Mean +- std dev: [bolt-baseline] 437 ms +- 4 ms -> [bolt-cdsplit] 430 ms +- 5 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 437 ms +- 4 ms -> [bolt-split-all-cold] 434 ms +- 5 ms: 1.01x faster

asyncio_tcp
===========

Mean +- std dev: [bolt-baseline] 352 ms +- 4 ms -> [bolt-hugify] 352 ms +- 4 ms: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 352 ms +- 4 ms -> [bolt-cdsplit] 351 ms +- 3 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 352 ms +- 4 ms -> [bolt-split-all-cold] 371 ms +- 3 ms: 1.06x slower

asyncio_tcp_ssl
===============

Mean +- std dev: [bolt-baseline] 1.38 sec +- 0.01 sec -> [bolt-hugify] 1.37 sec +- 0.01 sec: 1.01x faster
Mean +- std dev: [bolt-baseline] 1.38 sec +- 0.01 sec -> [bolt-cdsplit] 1.39 sec +- 0.01 sec: 1.01x slower
Mean +- std dev: [bolt-baseline] 1.38 sec +- 0.01 sec -> [bolt-split-all-cold] 1.38 sec +- 0.01 sec: 1.00x slower
Not significant!

chaos
=====

Mean +- std dev: [bolt-baseline] 72.2 ms +- 0.6 ms -> [bolt-hugify] 69.6 ms +- 0.7 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 72.2 ms +- 0.6 ms -> [bolt-cdsplit] 73.3 ms +- 0.5 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 72.2 ms +- 0.6 ms -> [bolt-split-all-cold] 71.2 ms +- 0.5 ms: 1.02x faster

comprehensions
==============

Mean +- std dev: [bolt-baseline] 19.6 us +- 0.2 us -> [bolt-hugify] 18.1 us +- 0.1 us: 1.08x faster
Mean +- std dev: [bolt-baseline] 19.6 us +- 0.2 us -> [bolt-cdsplit] 19.3 us +- 0.2 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 19.6 us +- 0.2 us -> [bolt-split-all-cold] 18.8 us +- 0.2 us: 1.04x faster

bench_mp_pool
=============

Mean +- std dev: [bolt-baseline] 919 ms +- 613 ms -> [bolt-hugify] 116 ms +- 75 ms: 7.95x faster
Mean +- std dev: [bolt-baseline] 919 ms +- 613 ms -> [bolt-cdsplit] 616 ms +- 413 ms: 1.49x faster
Mean +- std dev: [bolt-baseline] 919 ms +- 613 ms -> [bolt-split-all-cold] 339 ms +- 221 ms: 2.71x faster

bench_thread_pool
=================

Mean +- std dev: [bolt-baseline] 974 us +- 39 us -> [bolt-hugify] 947 us +- 38 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 974 us +- 39 us -> [bolt-cdsplit] 980 us +- 36 us: 1.01x slower
Not significant!
Mean +- std dev: [bolt-baseline] 974 us +- 39 us -> [bolt-split-all-cold] 974 us +- 40 us: 1.00x slower
Not significant!

coroutines
==========

Mean +- std dev: [bolt-baseline] 26.9 ms +- 0.2 ms -> [bolt-hugify] 23.0 ms +- 0.2 ms: 1.17x faster
Mean +- std dev: [bolt-baseline] 26.9 ms +- 0.2 ms -> [bolt-cdsplit] 24.0 ms +- 0.2 ms: 1.12x faster
Mean +- std dev: [bolt-baseline] 26.9 ms +- 0.2 ms -> [bolt-split-all-cold] 23.7 ms +- 0.2 ms: 1.13x faster

crypto_pyaes
============

Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-hugify] 76.2 ms +- 0.6 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-cdsplit] 78.3 ms +- 0.7 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-split-all-cold] 76.4 ms +- 0.6 ms: 1.03x faster

deepcopy
========

Mean +- std dev: [bolt-baseline] 301 us +- 2 us -> [bolt-hugify] 277 us +- 3 us: 1.09x faster
Mean +- std dev: [bolt-baseline] 301 us +- 2 us -> [bolt-cdsplit] 295 us +- 3 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 301 us +- 2 us -> [bolt-split-all-cold] 290 us +- 3 us: 1.04x faster

deepcopy_reduce
===============

Mean +- std dev: [bolt-baseline] 3.09 us +- 0.04 us -> [bolt-hugify] 2.88 us +- 0.02 us: 1.07x faster
Mean +- std dev: [bolt-baseline] 3.09 us +- 0.04 us -> [bolt-cdsplit] 3.08 us +- 0.07 us: 1.01x faster
Not significant!
Mean +- std dev: [bolt-baseline] 3.09 us +- 0.04 us -> [bolt-split-all-cold] 3.01 us +- 0.05 us: 1.03x faster

deepcopy_memo
=============

Mean +- std dev: [bolt-baseline] 35.0 us +- 0.5 us -> [bolt-hugify] 32.8 us +- 0.8 us: 1.07x faster
Mean +- std dev: [bolt-baseline] 35.0 us +- 0.5 us -> [bolt-cdsplit] 34.2 us +- 0.4 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 35.0 us +- 0.5 us -> [bolt-split-all-cold] 34.9 us +- 0.4 us: 1.00x faster
Not significant!

deltablue
=========

Mean +- std dev: [bolt-baseline] 4.03 ms +- 0.03 ms -> [bolt-hugify] 3.86 ms +- 0.04 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 4.03 ms +- 0.03 ms -> [bolt-cdsplit] 3.96 ms +- 0.03 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 4.03 ms +- 0.03 ms -> [bolt-split-all-cold] 3.85 ms +- 0.04 ms: 1.05x faster

docutils
========

Mean +- std dev: [bolt-baseline] 2.38 sec +- 0.01 sec -> [bolt-hugify] 2.30 sec +- 0.02 sec: 1.03x faster
Mean +- std dev: [bolt-baseline] 2.38 sec +- 0.01 sec -> [bolt-cdsplit] 2.34 sec +- 0.02 sec: 1.02x faster
Mean +- std dev: [bolt-baseline] 2.38 sec +- 0.01 sec -> [bolt-split-all-cold] 2.31 sec +- 0.02 sec: 1.03x faster

dulwich_log
===========

Mean +- std dev: [bolt-baseline] 66.5 ms +- 0.3 ms -> [bolt-hugify] 64.4 ms +- 0.3 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 66.5 ms +- 0.3 ms -> [bolt-cdsplit] 66.6 ms +- 0.3 ms: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 66.5 ms +- 0.3 ms -> [bolt-split-all-cold] 65.5 ms +- 0.2 ms: 1.02x faster

fannkuch
========

Mean +- std dev: [bolt-baseline] 485 ms +- 6 ms -> [bolt-hugify] 427 ms +- 5 ms: 1.13x faster
Mean +- std dev: [bolt-baseline] 485 ms +- 6 ms -> [bolt-cdsplit] 444 ms +- 3 ms: 1.09x faster
Mean +- std dev: [bolt-baseline] 485 ms +- 6 ms -> [bolt-split-all-cold] 430 ms +- 3 ms: 1.13x faster

float
=====

Mean +- std dev: [bolt-baseline] 77.6 ms +- 1.1 ms -> [bolt-hugify] 75.4 ms +- 1.2 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 77.6 ms +- 1.1 ms -> [bolt-cdsplit] 77.9 ms +- 1.0 ms: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 77.6 ms +- 1.1 ms -> [bolt-split-all-cold] 77.5 ms +- 0.8 ms: 1.00x faster
Not significant!

create_gc_cycles
================

Mean +- std dev: [bolt-baseline] 969 us +- 6 us -> [bolt-hugify] 971 us +- 6 us: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 969 us +- 6 us -> [bolt-cdsplit] 974 us +- 10 us: 1.00x slower
Mean +- std dev: [bolt-baseline] 969 us +- 6 us -> [bolt-split-all-cold] 1.03 ms +- 0.01 ms: 1.06x slower

gc_traversal
============

Mean +- std dev: [bolt-baseline] 3.32 ms +- 0.05 ms -> [bolt-hugify] 3.79 ms +- 0.12 ms: 1.14x slower
Mean +- std dev: [bolt-baseline] 3.32 ms +- 0.05 ms -> [bolt-cdsplit] 3.78 ms +- 0.17 ms: 1.14x slower
Mean +- std dev: [bolt-baseline] 3.32 ms +- 0.05 ms -> [bolt-split-all-cold] 3.99 ms +- 0.17 ms: 1.20x slower

generators
==========

Mean +- std dev: [bolt-baseline] 32.9 ms +- 0.4 ms -> [bolt-hugify] 31.2 ms +- 0.3 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 32.9 ms +- 0.4 ms -> [bolt-cdsplit] 32.0 ms +- 0.3 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 32.9 ms +- 0.4 ms -> [bolt-split-all-cold] 32.1 ms +- 0.4 ms: 1.03x faster

genshi_text
===========

Mean +- std dev: [bolt-baseline] 25.6 ms +- 0.3 ms -> [bolt-hugify] 24.4 ms +- 0.2 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 25.6 ms +- 0.3 ms -> [bolt-cdsplit] 24.9 ms +- 0.2 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 25.6 ms +- 0.3 ms -> [bolt-split-all-cold] 25.1 ms +- 0.3 ms: 1.02x faster

genshi_xml
==========

Mean +- std dev: [bolt-baseline] 61.7 ms +- 0.4 ms -> [bolt-hugify] 57.0 ms +- 0.4 ms: 1.08x faster
Mean +- std dev: [bolt-baseline] 61.7 ms +- 0.4 ms -> [bolt-cdsplit] 62.5 ms +- 0.5 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 61.7 ms +- 0.4 ms -> [bolt-split-all-cold] 60.8 ms +- 0.4 ms: 1.01x faster

go
==

Mean +- std dev: [bolt-baseline] 146 ms +- 1 ms -> [bolt-hugify] 136 ms +- 1 ms: 1.07x faster
Mean +- std dev: [bolt-baseline] 146 ms +- 1 ms -> [bolt-cdsplit] 141 ms +- 1 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 146 ms +- 1 ms -> [bolt-split-all-cold] 141 ms +- 1 ms: 1.04x faster

hexiom
======

Mean +- std dev: [bolt-baseline] 7.65 ms +- 0.12 ms -> [bolt-hugify] 7.06 ms +- 0.10 ms: 1.08x faster
Mean +- std dev: [bolt-baseline] 7.65 ms +- 0.12 ms -> [bolt-cdsplit] 7.31 ms +- 0.03 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 7.65 ms +- 0.12 ms -> [bolt-split-all-cold] 7.27 ms +- 0.10 ms: 1.05x faster

html5lib
========

Mean +- std dev: [bolt-baseline] 65.3 ms +- 0.6 ms -> [bolt-hugify] 63.4 ms +- 0.7 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 65.3 ms +- 0.6 ms -> [bolt-cdsplit] 64.6 ms +- 0.5 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 65.3 ms +- 0.6 ms -> [bolt-split-all-cold] 64.0 ms +- 0.5 ms: 1.02x faster

json_dumps
==========

Mean +- std dev: [bolt-baseline] 11.7 ms +- 0.1 ms -> [bolt-hugify] 11.1 ms +- 0.2 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 11.7 ms +- 0.1 ms -> [bolt-cdsplit] 11.7 ms +- 0.2 ms: 1.00x slower
Mean +- std dev: [bolt-baseline] 11.7 ms +- 0.1 ms -> [bolt-split-all-cold] 11.4 ms +- 0.1 ms: 1.03x faster

json_loads
==========

Mean +- std dev: [bolt-baseline] 22.2 us +- 0.2 us -> [bolt-hugify] 21.6 us +- 0.3 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 22.2 us +- 0.2 us -> [bolt-cdsplit] 22.9 us +- 0.2 us: 1.03x slower
Mean +- std dev: [bolt-baseline] 22.2 us +- 0.2 us -> [bolt-split-all-cold] 23.2 us +- 0.3 us: 1.05x slower

logging_format
==============

Mean +- std dev: [bolt-baseline] 8.38 us +- 0.12 us -> [bolt-hugify] 8.21 us +- 0.08 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 8.38 us +- 0.12 us -> [bolt-cdsplit] 8.47 us +- 0.17 us: 1.01x slower
Mean +- std dev: [bolt-baseline] 8.38 us +- 0.12 us -> [bolt-split-all-cold] 8.30 us +- 0.10 us: 1.01x faster

logging_silent
==============

Mean +- std dev: [bolt-baseline] 120 ns +- 2 ns -> [bolt-hugify] 120 ns +- 3 ns: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 120 ns +- 2 ns -> [bolt-cdsplit] 111 ns +- 2 ns: 1.09x faster
Mean +- std dev: [bolt-baseline] 120 ns +- 2 ns -> [bolt-split-all-cold] 114 ns +- 2 ns: 1.06x faster

logging_simple
==============

Mean +- std dev: [bolt-baseline] 7.56 us +- 0.12 us -> [bolt-hugify] 7.50 us +- 0.11 us: 1.01x faster
Mean +- std dev: [bolt-baseline] 7.56 us +- 0.12 us -> [bolt-cdsplit] 7.56 us +- 0.11 us: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 7.56 us +- 0.12 us -> [bolt-split-all-cold] 7.67 us +- 0.14 us: 1.01x slower

mako
====

Mean +- std dev: [bolt-baseline] 12.9 ms +- 0.2 ms -> [bolt-hugify] 12.4 ms +- 0.3 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 12.9 ms +- 0.2 ms -> [bolt-cdsplit] 12.8 ms +- 0.1 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 12.9 ms +- 0.2 ms -> [bolt-split-all-cold] 12.4 ms +- 0.2 ms: 1.04x faster

meteor_contest
==============

Mean +- std dev: [bolt-baseline] 105 ms +- 1 ms -> [bolt-hugify] 100 ms +- 1 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 105 ms +- 1 ms -> [bolt-cdsplit] 105 ms +- 1 ms: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 105 ms +- 1 ms -> [bolt-split-all-cold] 102 ms +- 0 ms: 1.02x faster

nbody
=====

Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-hugify] 109 ms +- 1 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-cdsplit] 109 ms +- 1 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-split-all-cold] 117 ms +- 1 ms: 1.02x slower

nqueens
=======

Mean +- std dev: [bolt-baseline] 92.6 ms +- 1.1 ms -> [bolt-hugify] 86.1 ms +- 0.9 ms: 1.08x faster
Mean +- std dev: [bolt-baseline] 92.6 ms +- 1.1 ms -> [bolt-cdsplit] 91.7 ms +- 0.6 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 92.6 ms +- 1.1 ms -> [bolt-split-all-cold] 88.9 ms +- 0.6 ms: 1.04x faster

pathlib
=======

Mean +- std dev: [bolt-baseline] 19.9 ms +- 0.1 ms -> [bolt-hugify] 19.3 ms +- 0.1 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 19.9 ms +- 0.1 ms -> [bolt-cdsplit] 19.9 ms +- 0.1 ms: 1.00x faster
Mean +- std dev: [bolt-baseline] 19.9 ms +- 0.1 ms -> [bolt-split-all-cold] 19.8 ms +- 0.1 ms: 1.01x faster

pickle
======

Mean +- std dev: [bolt-baseline] 11.0 us +- 0.1 us -> [bolt-hugify] 10.7 us +- 0.2 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 11.0 us +- 0.1 us -> [bolt-cdsplit] 11.0 us +- 0.1 us: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 11.0 us +- 0.1 us -> [bolt-split-all-cold] 10.7 us +- 0.1 us: 1.03x faster

pickle_dict
===========

Mean +- std dev: [bolt-baseline] 24.1 us +- 0.5 us -> [bolt-hugify] 24.0 us +- 0.2 us: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 24.1 us +- 0.5 us -> [bolt-cdsplit] 23.5 us +- 1.2 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 24.1 us +- 0.5 us -> [bolt-split-all-cold] 22.9 us +- 0.4 us: 1.05x faster

pickle_list
===========

Mean +- std dev: [bolt-baseline] 3.88 us +- 0.11 us -> [bolt-hugify] 3.87 us +- 0.09 us: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 3.88 us +- 0.11 us -> [bolt-cdsplit] 3.84 us +- 0.05 us: 1.01x faster
Mean +- std dev: [bolt-baseline] 3.88 us +- 0.11 us -> [bolt-split-all-cold] 3.84 us +- 0.05 us: 1.01x faster

pickle_pure_python
==================

Mean +- std dev: [bolt-baseline] 366 us +- 2 us -> [bolt-hugify] 348 us +- 4 us: 1.05x faster
Mean +- std dev: [bolt-baseline] 366 us +- 2 us -> [bolt-cdsplit] 356 us +- 3 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 366 us +- 2 us -> [bolt-split-all-cold] 361 us +- 2 us: 1.01x faster

pidigits
========

Mean +- std dev: [bolt-baseline] 182 ms +- 1 ms -> [bolt-hugify] 182 ms +- 1 ms: 1.00x faster
Mean +- std dev: [bolt-baseline] 182 ms +- 1 ms -> [bolt-cdsplit] 180 ms +- 1 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 182 ms +- 1 ms -> [bolt-split-all-cold] 182 ms +- 1 ms: 1.00x faster

pprint_safe_repr
================

Mean +- std dev: [bolt-baseline] 860 ms +- 9 ms -> [bolt-hugify] 808 ms +- 13 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 860 ms +- 9 ms -> [bolt-cdsplit] 861 ms +- 8 ms: 1.00x slower
Not significant!
Mean +- std dev: [bolt-baseline] 860 ms +- 9 ms -> [bolt-split-all-cold] 853 ms +- 5 ms: 1.01x faster

pprint_pformat
==============

Mean +- std dev: [bolt-baseline] 1.80 sec +- 0.02 sec -> [bolt-hugify] 1.70 sec +- 0.02 sec: 1.06x faster
Mean +- std dev: [bolt-baseline] 1.80 sec +- 0.02 sec -> [bolt-cdsplit] 1.80 sec +- 0.02 sec: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 1.80 sec +- 0.02 sec -> [bolt-split-all-cold] 1.78 sec +- 0.01 sec: 1.01x faster

pyflate
=======

Mean +- std dev: [bolt-baseline] 488 ms +- 4 ms -> [bolt-hugify] 447 ms +- 3 ms: 1.09x faster
Mean +- std dev: [bolt-baseline] 488 ms +- 4 ms -> [bolt-cdsplit] 465 ms +- 3 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 488 ms +- 4 ms -> [bolt-split-all-cold] 467 ms +- 2 ms: 1.04x faster

python_startup
==============

Mean +- std dev: [bolt-baseline] 9.40 ms +- 0.03 ms -> [bolt-hugify] 11.4 ms +- 0.0 ms: 1.22x slower
Mean +- std dev: [bolt-baseline] 9.40 ms +- 0.03 ms -> [bolt-cdsplit] 9.42 ms +- 0.02 ms: 1.00x slower
Mean +- std dev: [bolt-baseline] 9.40 ms +- 0.03 ms -> [bolt-split-all-cold] 9.41 ms +- 0.02 ms: 1.00x slower

python_startup_no_site
======================

Mean +- std dev: [bolt-baseline] 6.63 ms +- 0.02 ms -> [bolt-hugify] 8.66 ms +- 0.04 ms: 1.31x slower
Mean +- std dev: [bolt-baseline] 6.63 ms +- 0.02 ms -> [bolt-cdsplit] 6.64 ms +- 0.03 ms: 1.00x slower
Mean +- std dev: [bolt-baseline] 6.63 ms +- 0.02 ms -> [bolt-split-all-cold] 6.63 ms +- 0.02 ms: 1.00x slower
Not significant!

raytrace
========

Mean +- std dev: [bolt-baseline] 304 ms +- 3 ms -> [bolt-hugify] 299 ms +- 4 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 304 ms +- 3 ms -> [bolt-cdsplit] 306 ms +- 4 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 304 ms +- 3 ms -> [bolt-split-all-cold] 304 ms +- 2 ms: 1.00x slower
Not significant!

regex_compile
=============

Mean +- std dev: [bolt-baseline] 149 ms +- 1 ms -> [bolt-hugify] 141 ms +- 1 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 149 ms +- 1 ms -> [bolt-cdsplit] 147 ms +- 1 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 149 ms +- 1 ms -> [bolt-split-all-cold] 144 ms +- 1 ms: 1.03x faster

regex_dna
=========

Mean +- std dev: [bolt-baseline] 158 ms +- 2 ms -> [bolt-hugify] 154 ms +- 2 ms: 1.03x faster
Mean +- std dev: [bolt-baseline] 158 ms +- 2 ms -> [bolt-cdsplit] 164 ms +- 2 ms: 1.03x slower
Mean +- std dev: [bolt-baseline] 158 ms +- 2 ms -> [bolt-split-all-cold] 154 ms +- 2 ms: 1.03x faster

regex_effbot
============

Mean +- std dev: [bolt-baseline] 2.65 ms +- 0.06 ms -> [bolt-hugify] 2.65 ms +- 0.06 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 2.65 ms +- 0.06 ms -> [bolt-cdsplit] 2.76 ms +- 0.06 ms: 1.04x slower
Mean +- std dev: [bolt-baseline] 2.65 ms +- 0.06 ms -> [bolt-split-all-cold] 2.70 ms +- 0.05 ms: 1.02x slower

regex_v8
========

Mean +- std dev: [bolt-baseline] 22.9 ms +- 0.3 ms -> [bolt-hugify] 22.1 ms +- 0.2 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 22.9 ms +- 0.3 ms -> [bolt-cdsplit] 22.9 ms +- 0.4 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 22.9 ms +- 0.3 ms -> [bolt-split-all-cold] 22.9 ms +- 0.3 ms: 1.00x faster
Not significant!

richards
========

Mean +- std dev: [bolt-baseline] 58.1 ms +- 0.7 ms -> [bolt-hugify] 55.1 ms +- 0.5 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 58.1 ms +- 0.7 ms -> [bolt-cdsplit] 55.3 ms +- 0.7 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 58.1 ms +- 0.7 ms -> [bolt-split-all-cold] 55.3 ms +- 0.6 ms: 1.05x faster

richards_super
==============

Mean +- std dev: [bolt-baseline] 66.1 ms +- 0.8 ms -> [bolt-hugify] 62.0 ms +- 0.5 ms: 1.07x faster
Mean +- std dev: [bolt-baseline] 66.1 ms +- 0.8 ms -> [bolt-cdsplit] 63.0 ms +- 0.6 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 66.1 ms +- 0.8 ms -> [bolt-split-all-cold] 61.5 ms +- 0.6 ms: 1.07x faster

scimark_fft
===========

Mean +- std dev: [bolt-baseline] 404 ms +- 5 ms -> [bolt-hugify] 373 ms +- 4 ms: 1.08x faster
Mean +- std dev: [bolt-baseline] 404 ms +- 5 ms -> [bolt-cdsplit] 396 ms +- 7 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 404 ms +- 5 ms -> [bolt-split-all-cold] 400 ms +- 3 ms: 1.01x faster

scimark_lu
==========

Mean +- std dev: [bolt-baseline] 127 ms +- 3 ms -> [bolt-hugify] 119 ms +- 2 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 127 ms +- 3 ms -> [bolt-cdsplit] 124 ms +- 1 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 127 ms +- 3 ms -> [bolt-split-all-cold] 123 ms +- 1 ms: 1.03x faster

scimark_monte_carlo
===================

Mean +- std dev: [bolt-baseline] 74.6 ms +- 0.8 ms -> [bolt-hugify] 69.8 ms +- 0.9 ms: 1.07x faster
Mean +- std dev: [bolt-baseline] 74.6 ms +- 0.8 ms -> [bolt-cdsplit] 71.7 ms +- 1.0 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 74.6 ms +- 0.8 ms -> [bolt-split-all-cold] 71.6 ms +- 0.7 ms: 1.04x faster

scimark_sor
===========

Mean +- std dev: [bolt-baseline] 157 ms +- 1 ms -> [bolt-hugify] 147 ms +- 1 ms: 1.07x faster
Mean +- std dev: [bolt-baseline] 157 ms +- 1 ms -> [bolt-cdsplit] 155 ms +- 2 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 157 ms +- 1 ms -> [bolt-split-all-cold] 153 ms +- 2 ms: 1.02x faster

scimark_sparse_mat_mult
=======================

Mean +- std dev: [bolt-baseline] 5.63 ms +- 0.07 ms -> [bolt-hugify] 5.21 ms +- 0.19 ms: 1.08x faster
Mean +- std dev: [bolt-baseline] 5.63 ms +- 0.07 ms -> [bolt-cdsplit] 5.50 ms +- 0.07 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 5.63 ms +- 0.07 ms -> [bolt-split-all-cold] 5.37 ms +- 0.08 ms: 1.05x faster

spectral_norm
=============

Mean +- std dev: [bolt-baseline] 120 ms +- 2 ms -> [bolt-hugify] 105 ms +- 1 ms: 1.14x faster
Mean +- std dev: [bolt-baseline] 120 ms +- 2 ms -> [bolt-cdsplit] 115 ms +- 1 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 120 ms +- 2 ms -> [bolt-split-all-cold] 116 ms +- 1 ms: 1.04x faster

sqlglot_normalize
=================

Mean +- std dev: [bolt-baseline] 119 ms +- 1 ms -> [bolt-hugify] 113 ms +- 1 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 119 ms +- 1 ms -> [bolt-cdsplit] 118 ms +- 1 ms: 1.00x faster
Mean +- std dev: [bolt-baseline] 119 ms +- 1 ms -> [bolt-split-all-cold] 116 ms +- 1 ms: 1.02x faster

telco
=====

Mean +- std dev: [bolt-baseline] 7.65 ms +- 0.13 ms -> [bolt-hugify] 7.13 ms +- 0.08 ms: 1.07x faster
Mean +- std dev: [bolt-baseline] 7.65 ms +- 0.13 ms -> [bolt-cdsplit] 7.64 ms +- 0.18 ms: 1.00x faster
Not significant!
Mean +- std dev: [bolt-baseline] 7.65 ms +- 0.13 ms -> [bolt-split-all-cold] 7.38 ms +- 0.06 ms: 1.04x faster

tomli_loads
===========

Mean +- std dev: [bolt-baseline] 2.81 sec +- 0.03 sec -> [bolt-hugify] 2.58 sec +- 0.02 sec: 1.09x faster
Mean +- std dev: [bolt-baseline] 2.81 sec +- 0.03 sec -> [bolt-cdsplit] 2.69 sec +- 0.02 sec: 1.04x faster
Mean +- std dev: [bolt-baseline] 2.81 sec +- 0.03 sec -> [bolt-split-all-cold] 2.70 sec +- 0.02 sec: 1.04x faster

typing_runtime_protocols
========================

Mean +- std dev: [bolt-baseline] 177 us +- 3 us -> [bolt-hugify] 164 us +- 3 us: 1.08x faster
Mean +- std dev: [bolt-baseline] 177 us +- 3 us -> [bolt-cdsplit] 179 us +- 4 us: 1.01x slower
Mean +- std dev: [bolt-baseline] 177 us +- 3 us -> [bolt-split-all-cold] 176 us +- 3 us: 1.00x faster
Not significant!

unpack_sequence
===============

Mean +- std dev: [bolt-baseline] 44.5 ns +- 1.0 ns -> [bolt-hugify] 40.8 ns +- 0.4 ns: 1.09x faster
Mean +- std dev: [bolt-baseline] 44.5 ns +- 1.0 ns -> [bolt-cdsplit] 42.2 ns +- 0.3 ns: 1.05x faster
Mean +- std dev: [bolt-baseline] 44.5 ns +- 1.0 ns -> [bolt-split-all-cold] 48.0 ns +- 1.6 ns: 1.08x slower

unpickle
========

Mean +- std dev: [bolt-baseline] 12.7 us +- 0.1 us -> [bolt-hugify] 12.8 us +- 0.1 us: 1.00x slower
Mean +- std dev: [bolt-baseline] 12.7 us +- 0.1 us -> [bolt-cdsplit] 13.2 us +- 0.1 us: 1.04x slower
Mean +- std dev: [bolt-baseline] 12.7 us +- 0.1 us -> [bolt-split-all-cold] 13.0 us +- 0.1 us: 1.02x slower

unpickle_list
=============

Mean +- std dev: [bolt-baseline] 4.09 us +- 0.11 us -> [bolt-hugify] 4.01 us +- 0.07 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 4.09 us +- 0.11 us -> [bolt-cdsplit] 4.00 us +- 0.04 us: 1.02x faster
Mean +- std dev: [bolt-baseline] 4.09 us +- 0.11 us -> [bolt-split-all-cold] 4.54 us +- 0.04 us: 1.11x slower

unpickle_pure_python
====================

Mean +- std dev: [bolt-baseline] 251 us +- 2 us -> [bolt-hugify] 240 us +- 3 us: 1.05x faster
Mean +- std dev: [bolt-baseline] 251 us +- 2 us -> [bolt-cdsplit] 244 us +- 2 us: 1.03x faster
Mean +- std dev: [bolt-baseline] 251 us +- 2 us -> [bolt-split-all-cold] 248 us +- 2 us: 1.01x faster

xml_etree_parse
===============

Mean +- std dev: [bolt-baseline] 150 ms +- 3 ms -> [bolt-hugify] 148 ms +- 2 ms: 1.01x faster
Mean +- std dev: [bolt-baseline] 150 ms +- 3 ms -> [bolt-cdsplit] 142 ms +- 2 ms: 1.06x faster
Mean +- std dev: [bolt-baseline] 150 ms +- 3 ms -> [bolt-split-all-cold] 139 ms +- 2 ms: 1.08x faster

xml_etree_iterparse
===================

Mean +- std dev: [bolt-baseline] 97.2 ms +- 1.1 ms -> [bolt-hugify] 95.7 ms +- 1.2 ms: 1.02x faster
Mean +- std dev: [bolt-baseline] 97.2 ms +- 1.1 ms -> [bolt-cdsplit] 96.8 ms +- 0.9 ms: 1.00x faster
Mean +- std dev: [bolt-baseline] 97.2 ms +- 1.1 ms -> [bolt-split-all-cold] 94.1 ms +- 0.5 ms: 1.03x faster

xml_etree_generate
==================

Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-hugify] 85.2 ms +- 0.7 ms: 1.04x faster
Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-cdsplit] 89.9 ms +- 0.8 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-split-all-cold] 89.2 ms +- 0.6 ms: 1.01x slower

xml_etree_process
=================

Mean +- std dev: [bolt-baseline] 63.3 ms +- 0.5 ms -> [bolt-hugify] 60.0 ms +- 0.6 ms: 1.05x faster
Mean +- std dev: [bolt-baseline] 63.3 ms +- 0.5 ms -> [bolt-cdsplit] 63.7 ms +- 0.4 ms: 1.01x slower
Mean +- std dev: [bolt-baseline] 63.3 ms +- 0.5 ms -> [bolt-split-all-cold] 63.1 ms +- 0.5 ms: 1.00x faster

Benchmark hidden because not significant (2): asyncio_websockets, mdp

Geometric mean
==============

bolt-hugify: 1.07x faster
bolt-cdsplit: 1.02x faster
bolt-split-all-cold: 1.03x faster
❯ pyperf system show
Show the system configuration

System state
============

CPU: use 12 logical CPUs: 0-11
Perf event: Maximum sample rate: 1 per second
ASLR: Full randomization
Linux scheduler: No CPU is isolated
CPU Frequency: 0-11=min=max=3600 MHz
IRQ affinity: irqbalance service: inactive
IRQ affinity: Default IRQ affinity: CPU 0-11
IRQ affinity: IRQ affinity: IRQ 0-15,25-29,31-32,43-44,46-48,113,115-122,124,127-128=CPU 0-11; IRQ 49,81=CPU 0; IRQ 50,82=CPU 1; IRQ 51,83=CPU 2; IRQ 52,84=CPU 3; IRQ 53,85=CPU 4; IRQ 54,86=CPU 5; IRQ 55,87=CPU 6; IRQ 56,88=CPU 7; IRQ 57,89=CPU 8; IRQ 58,90=CPU 9; IRQ 59,91=CPU 10; IRQ 60,92=CPU 11; IRQ 61-80,93-112=CPU None
CPU scaling governor: 0-11=performance

Advices
=======

Linux scheduler: Use isolcpus=<cpu list> kernel parameter to isolate CPUs
Linux scheduler: Use rcu_nocbs=<cpu list> kernel parameter (with isolcpus) to not schedule RCU on isolated CPUs

Warnings
========

Turbo Boost (MSR): Failed to read MSR 0x1a0 from /dev/cpu/0/msr: [Errno 13] Permission denied: '/dev/cpu/0/msr'
ERROR: At least one operation failed with permission error, retry as root

OK! System ready for benchmarking
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment