Created
January 16, 2025 21:54
-
-
Save zanieb/8614bcb40b0db24dd678f2983146fb43 to your computer and use it in GitHub Desktop.
BOLT benchmark results from https://github.com/zanieb/cpython-bench/commit/dcb7d5569ba88578e75cbf2d959d4e9e1a417fc1 with the rigorous flag
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ❯ uvx pyperf compare_to bolt-baseline.json bolt-hugify.json bolt-cdsplit.json bolt-split-all-cold.json | |
| Benchmarks with tag 'apps': | |
| =========================== | |
| 2to3 | |
| ==== | |
| Mean +- std dev: [bolt-baseline] 231 ms +- 1 ms -> [bolt-hugify] 230 ms +- 2 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 231 ms +- 1 ms -> [bolt-cdsplit] 232 ms +- 1 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 231 ms +- 1 ms -> [bolt-split-all-cold] 231 ms +- 1 ms: 1.00x faster | |
| docutils | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 2.21 sec +- 0.02 sec -> [bolt-hugify] 2.21 sec +- 0.02 sec: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 2.21 sec +- 0.02 sec -> [bolt-cdsplit] 2.22 sec +- 0.02 sec: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 2.21 sec +- 0.02 sec -> [bolt-split-all-cold] 2.22 sec +- 0.02 sec: 1.00x slower | |
| html5lib | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 60.4 ms +- 0.5 ms -> [bolt-hugify] 59.9 ms +- 0.6 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 60.4 ms +- 0.5 ms -> [bolt-cdsplit] 62.6 ms +- 0.5 ms: 1.04x slower | |
| Mean +- std dev: [bolt-baseline] 60.4 ms +- 0.5 ms -> [bolt-split-all-cold] 60.9 ms +- 0.7 ms: 1.01x slower | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.00x faster | |
| bolt-cdsplit: 1.01x slower | |
| bolt-split-all-cold: 1.00x slower | |
| Benchmarks with tag 'math': | |
| =========================== | |
| float | |
| ===== | |
| Mean +- std dev: [bolt-baseline] 66.5 ms +- 1.2 ms -> [bolt-hugify] 66.0 ms +- 0.8 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 66.5 ms +- 1.2 ms -> [bolt-cdsplit] 67.1 ms +- 0.7 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 66.5 ms +- 1.2 ms -> [bolt-split-all-cold] 66.6 ms +- 0.7 ms: 1.00x slower | |
| Not significant! | |
| nbody | |
| ===== | |
| Mean +- std dev: [bolt-baseline] 88.2 ms +- 0.6 ms -> [bolt-hugify] 88.2 ms +- 0.8 ms: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 88.2 ms +- 0.6 ms -> [bolt-cdsplit] 87.5 ms +- 0.8 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 88.2 ms +- 0.6 ms -> [bolt-split-all-cold] 86.9 ms +- 1.7 ms: 1.01x faster | |
| pidigits | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 160 ms +- 2 ms -> [bolt-hugify] 158 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 160 ms +- 2 ms -> [bolt-cdsplit] 158 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 160 ms +- 2 ms -> [bolt-split-all-cold] 160 ms +- 1 ms: 1.00x faster | |
| Not significant! | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.01x faster | |
| bolt-cdsplit: 1.00x faster | |
| bolt-split-all-cold: 1.01x faster | |
| Benchmarks with tag 'regex': | |
| ============================ | |
| regex_compile | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 118 ms +- 1 ms -> [bolt-hugify] 117 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 118 ms +- 1 ms -> [bolt-cdsplit] 119 ms +- 1 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 118 ms +- 1 ms -> [bolt-split-all-cold] 118 ms +- 1 ms: 1.00x slower | |
| regex_dna | |
| ========= | |
| Mean +- std dev: [bolt-baseline] 148 ms +- 2 ms -> [bolt-hugify] 149 ms +- 4 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 148 ms +- 2 ms -> [bolt-cdsplit] 149 ms +- 3 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 148 ms +- 2 ms -> [bolt-split-all-cold] 152 ms +- 2 ms: 1.02x slower | |
| regex_effbot | |
| ============ | |
| Mean +- std dev: [bolt-baseline] 2.45 ms +- 0.05 ms -> [bolt-hugify] 2.35 ms +- 0.07 ms: 1.04x faster | |
| Mean +- std dev: [bolt-baseline] 2.45 ms +- 0.05 ms -> [bolt-cdsplit] 2.33 ms +- 0.06 ms: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 2.45 ms +- 0.05 ms -> [bolt-split-all-cold] 2.35 ms +- 0.04 ms: 1.04x faster | |
| regex_v8 | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 21.5 ms +- 0.2 ms -> [bolt-hugify] 20.9 ms +- 0.3 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 21.5 ms +- 0.2 ms -> [bolt-cdsplit] 20.2 ms +- 0.2 ms: 1.07x faster | |
| Mean +- std dev: [bolt-baseline] 21.5 ms +- 0.2 ms -> [bolt-split-all-cold] 20.7 ms +- 0.2 ms: 1.04x faster | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.02x faster | |
| bolt-cdsplit: 1.02x faster | |
| bolt-split-all-cold: 1.01x faster | |
| Benchmarks with tag 'serialize': | |
| ================================ | |
| json_dumps | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.2 ms -> [bolt-hugify] 9.75 ms +- 0.18 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.2 ms -> [bolt-cdsplit] 10.3 ms +- 0.3 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.2 ms -> [bolt-split-all-cold] 10.0 ms +- 0.1 ms: 1.01x faster | |
| json_loads | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 23.2 us +- 0.2 us -> [bolt-hugify] 22.1 us +- 0.3 us: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 23.2 us +- 0.2 us -> [bolt-cdsplit] 22.1 us +- 0.2 us: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 23.2 us +- 0.2 us -> [bolt-split-all-cold] 21.7 us +- 0.3 us: 1.07x faster | |
| pickle | |
| ====== | |
| Mean +- std dev: [bolt-baseline] 11.2 us +- 0.4 us -> [bolt-hugify] 10.7 us +- 0.1 us: 1.04x faster | |
| Mean +- std dev: [bolt-baseline] 11.2 us +- 0.4 us -> [bolt-cdsplit] 11.0 us +- 0.1 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 11.2 us +- 0.4 us -> [bolt-split-all-cold] 10.9 us +- 0.1 us: 1.03x faster | |
| pickle_dict | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 23.9 us +- 0.8 us -> [bolt-hugify] 23.8 us +- 0.5 us: 1.01x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 23.9 us +- 0.8 us -> [bolt-cdsplit] 24.1 us +- 0.6 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 23.9 us +- 0.8 us -> [bolt-split-all-cold] 24.3 us +- 0.9 us: 1.02x slower | |
| pickle_list | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 3.92 us +- 0.10 us -> [bolt-hugify] 3.88 us +- 0.20 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 3.92 us +- 0.10 us -> [bolt-cdsplit] 3.93 us +- 0.05 us: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 3.92 us +- 0.10 us -> [bolt-split-all-cold] 3.87 us +- 0.13 us: 1.01x faster | |
| pickle_pure_python | |
| ================== | |
| Mean +- std dev: [bolt-baseline] 296 us +- 3 us -> [bolt-hugify] 298 us +- 3 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 296 us +- 3 us -> [bolt-cdsplit] 295 us +- 3 us: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 296 us +- 3 us -> [bolt-split-all-cold] 296 us +- 2 us: 1.00x slower | |
| tomli_loads | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 1.93 sec +- 0.02 sec -> [bolt-hugify] 1.89 sec +- 0.02 sec: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 1.93 sec +- 0.02 sec -> [bolt-cdsplit] 1.94 sec +- 0.02 sec: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 1.93 sec +- 0.02 sec -> [bolt-split-all-cold] 1.95 sec +- 0.03 sec: 1.01x slower | |
| unpickle | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 12.1 us +- 0.1 us -> [bolt-hugify] 11.9 us +- 0.2 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 12.1 us +- 0.1 us -> [bolt-cdsplit] 11.9 us +- 0.2 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 12.1 us +- 0.1 us -> [bolt-split-all-cold] 11.8 us +- 0.1 us: 1.03x faster | |
| unpickle_list | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 4.34 us +- 0.07 us -> [bolt-hugify] 4.30 us +- 0.13 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 4.34 us +- 0.07 us -> [bolt-cdsplit] 4.38 us +- 0.07 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 4.34 us +- 0.07 us -> [bolt-split-all-cold] 4.52 us +- 0.11 us: 1.04x slower | |
| unpickle_pure_python | |
| ==================== | |
| Mean +- std dev: [bolt-baseline] 211 us +- 2 us -> [bolt-hugify] 211 us +- 2 us: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 211 us +- 2 us -> [bolt-cdsplit] 210 us +- 2 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 211 us +- 2 us -> [bolt-split-all-cold] 210 us +- 2 us: 1.00x faster | |
| xml_etree_parse | |
| =============== | |
| Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-hugify] 115 ms +- 1 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-cdsplit] 114 ms +- 1 ms: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-split-all-cold] 116 ms +- 1 ms: 1.02x slower | |
| xml_etree_iterparse | |
| =================== | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-hugify] 79.9 ms +- 0.6 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-cdsplit] 79.4 ms +- 0.5 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-split-all-cold] 80.4 ms +- 0.5 ms: 1.02x slower | |
| xml_etree_generate | |
| ================== | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.7 ms -> [bolt-hugify] 77.8 ms +- 0.8 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.7 ms -> [bolt-cdsplit] 78.5 ms +- 0.6 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.7 ms -> [bolt-split-all-cold] 79.3 ms +- 0.6 ms: 1.01x slower | |
| xml_etree_process | |
| ================= | |
| Mean +- std dev: [bolt-baseline] 54.8 ms +- 0.6 ms -> [bolt-hugify] 54.2 ms +- 0.7 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 54.8 ms +- 0.6 ms -> [bolt-cdsplit] 55.2 ms +- 0.5 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 54.8 ms +- 0.6 ms -> [bolt-split-all-cold] 55.2 ms +- 0.5 ms: 1.01x slower | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.01x faster | |
| bolt-cdsplit: 1.00x faster | |
| bolt-split-all-cold: 1.00x faster | |
| Benchmarks with tag 'startup': | |
| ============================== | |
| python_startup | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 9.28 ms +- 0.03 ms -> [bolt-hugify] 11.3 ms +- 0.0 ms: 1.22x slower | |
| Mean +- std dev: [bolt-baseline] 9.28 ms +- 0.03 ms -> [bolt-cdsplit] 9.27 ms +- 0.04 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 9.28 ms +- 0.03 ms -> [bolt-split-all-cold] 9.29 ms +- 0.03 ms: 1.00x slower | |
| python_startup_no_site | |
| ====================== | |
| Mean +- std dev: [bolt-baseline] 6.52 ms +- 0.03 ms -> [bolt-hugify] 8.53 ms +- 0.05 ms: 1.31x slower | |
| Mean +- std dev: [bolt-baseline] 6.52 ms +- 0.03 ms -> [bolt-cdsplit] 6.50 ms +- 0.04 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 6.52 ms +- 0.03 ms -> [bolt-split-all-cold] 6.51 ms +- 0.03 ms: 1.00x faster | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.26x slower | |
| bolt-cdsplit: 1.00x faster | |
| bolt-split-all-cold: 1.00x faster | |
| Benchmarks with tag 'template': | |
| =============================== | |
| genshi_text | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 19.6 ms +- 0.3 ms -> [bolt-hugify] 19.8 ms +- 0.4 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 19.6 ms +- 0.3 ms -> [bolt-cdsplit] 20.0 ms +- 0.2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 19.6 ms +- 0.3 ms -> [bolt-split-all-cold] 20.0 ms +- 0.2 ms: 1.02x slower | |
| genshi_xml | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 46.5 ms +- 0.6 ms -> [bolt-hugify] 46.4 ms +- 0.5 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 46.5 ms +- 0.6 ms -> [bolt-cdsplit] 47.7 ms +- 0.5 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 46.5 ms +- 0.6 ms -> [bolt-split-all-cold] 46.3 ms +- 0.5 ms: 1.01x faster | |
| mako | |
| ==== | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.1 ms -> [bolt-hugify] 10.4 ms +- 0.2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.1 ms -> [bolt-cdsplit] 10.6 ms +- 0.1 ms: 1.04x slower | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.1 ms -> [bolt-split-all-cold] 11.0 ms +- 0.1 ms: 1.08x slower | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.01x slower | |
| bolt-cdsplit: 1.03x slower | |
| bolt-split-all-cold: 1.03x slower | |
| All benchmarks: | |
| =============== | |
| 2to3 | |
| ==== | |
| Mean +- std dev: [bolt-baseline] 231 ms +- 1 ms -> [bolt-hugify] 230 ms +- 2 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 231 ms +- 1 ms -> [bolt-cdsplit] 232 ms +- 1 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 231 ms +- 1 ms -> [bolt-split-all-cold] 231 ms +- 1 ms: 1.00x faster | |
| async_generators | |
| ================ | |
| Mean +- std dev: [bolt-baseline] 379 ms +- 4 ms -> [bolt-hugify] 379 ms +- 5 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 379 ms +- 4 ms -> [bolt-cdsplit] 388 ms +- 4 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 379 ms +- 4 ms -> [bolt-split-all-cold] 383 ms +- 4 ms: 1.01x slower | |
| asyncio_tcp | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 430 ms +- 4 ms -> [bolt-hugify] 433 ms +- 4 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 430 ms +- 4 ms -> [bolt-cdsplit] 437 ms +- 5 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 430 ms +- 4 ms -> [bolt-split-all-cold] 429 ms +- 5 ms: 1.00x faster | |
| Not significant! | |
| asyncio_tcp_ssl | |
| =============== | |
| Mean +- std dev: [bolt-baseline] 1.48 sec +- 0.01 sec -> [bolt-hugify] 1.47 sec +- 0.01 sec: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 1.48 sec +- 0.01 sec -> [bolt-cdsplit] 1.48 sec +- 0.01 sec: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 1.48 sec +- 0.01 sec -> [bolt-split-all-cold] 1.48 sec +- 0.01 sec: 1.00x faster | |
| chaos | |
| ===== | |
| Mean +- std dev: [bolt-baseline] 56.6 ms +- 0.9 ms -> [bolt-hugify] 56.8 ms +- 0.7 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 56.6 ms +- 0.9 ms -> [bolt-cdsplit] 59.3 ms +- 0.7 ms: 1.05x slower | |
| Mean +- std dev: [bolt-baseline] 56.6 ms +- 0.9 ms -> [bolt-split-all-cold] 57.4 ms +- 0.5 ms: 1.01x slower | |
| comprehensions | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 15.4 us +- 0.2 us -> [bolt-hugify] 15.7 us +- 0.2 us: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 15.4 us +- 0.2 us -> [bolt-cdsplit] 15.8 us +- 0.1 us: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 15.4 us +- 0.2 us -> [bolt-split-all-cold] 15.6 us +- 0.1 us: 1.02x slower | |
| bench_mp_pool | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 29.5 ms +- 1.7 ms -> [bolt-hugify] 29.4 ms +- 0.9 ms: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 29.5 ms +- 1.7 ms -> [bolt-cdsplit] 29.9 ms +- 1.3 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 29.5 ms +- 1.7 ms -> [bolt-split-all-cold] 31.4 ms +- 7.7 ms: 1.06x slower | |
| bench_thread_pool | |
| ================= | |
| Mean +- std dev: [bolt-baseline] 949 us +- 39 us -> [bolt-hugify] 939 us +- 39 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 949 us +- 39 us -> [bolt-cdsplit] 930 us +- 36 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 949 us +- 39 us -> [bolt-split-all-cold] 927 us +- 36 us: 1.02x faster | |
| coroutines | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 20.6 ms +- 0.4 ms -> [bolt-hugify] 20.9 ms +- 0.2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 20.6 ms +- 0.4 ms -> [bolt-cdsplit] 21.0 ms +- 0.2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 20.6 ms +- 0.4 ms -> [bolt-split-all-cold] 19.5 ms +- 0.3 ms: 1.06x faster | |
| crypto_pyaes | |
| ============ | |
| Mean +- std dev: [bolt-baseline] 64.2 ms +- 0.8 ms -> [bolt-hugify] 63.5 ms +- 0.4 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 64.2 ms +- 0.8 ms -> [bolt-cdsplit] 63.7 ms +- 0.5 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 64.2 ms +- 0.8 ms -> [bolt-split-all-cold] 63.5 ms +- 0.5 ms: 1.01x faster | |
| deepcopy | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 250 us +- 3 us -> [bolt-hugify] 244 us +- 3 us: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 250 us +- 3 us -> [bolt-cdsplit] 248 us +- 3 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 250 us +- 3 us -> [bolt-split-all-cold] 247 us +- 2 us: 1.01x faster | |
| deepcopy_reduce | |
| =============== | |
| Mean +- std dev: [bolt-baseline] 2.59 us +- 0.03 us -> [bolt-hugify] 2.51 us +- 0.04 us: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 2.59 us +- 0.03 us -> [bolt-cdsplit] 2.55 us +- 0.04 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 2.59 us +- 0.03 us -> [bolt-split-all-cold] 2.54 us +- 0.03 us: 1.02x faster | |
| deepcopy_memo | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 29.6 us +- 0.3 us -> [bolt-hugify] 28.9 us +- 0.5 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 29.6 us +- 0.3 us -> [bolt-cdsplit] 29.0 us +- 0.4 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 29.6 us +- 0.3 us -> [bolt-split-all-cold] 28.8 us +- 0.4 us: 1.03x faster | |
| deltablue | |
| ========= | |
| Mean +- std dev: [bolt-baseline] 2.92 ms +- 0.04 ms -> [bolt-hugify] 2.95 ms +- 0.03 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 2.92 ms +- 0.04 ms -> [bolt-cdsplit] 3.18 ms +- 0.05 ms: 1.09x slower | |
| Mean +- std dev: [bolt-baseline] 2.92 ms +- 0.04 ms -> [bolt-split-all-cold] 2.98 ms +- 0.03 ms: 1.02x slower | |
| docutils | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 2.21 sec +- 0.02 sec -> [bolt-hugify] 2.21 sec +- 0.02 sec: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 2.21 sec +- 0.02 sec -> [bolt-cdsplit] 2.22 sec +- 0.02 sec: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 2.21 sec +- 0.02 sec -> [bolt-split-all-cold] 2.22 sec +- 0.02 sec: 1.00x slower | |
| dulwich_log | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 59.6 ms +- 0.3 ms -> [bolt-hugify] 59.2 ms +- 0.4 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 59.6 ms +- 0.3 ms -> [bolt-cdsplit] 59.6 ms +- 0.4 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 59.6 ms +- 0.3 ms -> [bolt-split-all-cold] 59.5 ms +- 0.3 ms: 1.00x faster | |
| Not significant! | |
| fannkuch | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 371 ms +- 3 ms -> [bolt-hugify] 368 ms +- 4 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 371 ms +- 3 ms -> [bolt-cdsplit] 377 ms +- 3 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 371 ms +- 3 ms -> [bolt-split-all-cold] 369 ms +- 4 ms: 1.01x faster | |
| float | |
| ===== | |
| Mean +- std dev: [bolt-baseline] 66.5 ms +- 1.2 ms -> [bolt-hugify] 66.0 ms +- 0.8 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 66.5 ms +- 1.2 ms -> [bolt-cdsplit] 67.1 ms +- 0.7 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 66.5 ms +- 1.2 ms -> [bolt-split-all-cold] 66.6 ms +- 0.7 ms: 1.00x slower | |
| Not significant! | |
| create_gc_cycles | |
| ================ | |
| Mean +- std dev: [bolt-baseline] 1.01 ms +- 0.01 ms -> [bolt-hugify] 1.01 ms +- 0.01 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 1.01 ms +- 0.01 ms -> [bolt-cdsplit] 1000 us +- 7 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 1.01 ms +- 0.01 ms -> [bolt-split-all-cold] 1.01 ms +- 0.01 ms: 1.01x faster | |
| gc_traversal | |
| ============ | |
| Mean +- std dev: [bolt-baseline] 2.90 ms +- 0.11 ms -> [bolt-hugify] 2.85 ms +- 0.05 ms: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 2.90 ms +- 0.11 ms -> [bolt-cdsplit] 2.87 ms +- 0.06 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 2.90 ms +- 0.11 ms -> [bolt-split-all-cold] 2.86 ms +- 0.06 ms: 1.01x faster | |
| generators | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 25.7 ms +- 0.2 ms -> [bolt-hugify] 26.3 ms +- 0.3 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 25.7 ms +- 0.2 ms -> [bolt-cdsplit] 26.7 ms +- 0.2 ms: 1.04x slower | |
| Mean +- std dev: [bolt-baseline] 25.7 ms +- 0.2 ms -> [bolt-split-all-cold] 26.1 ms +- 0.3 ms: 1.02x slower | |
| genshi_text | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 19.6 ms +- 0.3 ms -> [bolt-hugify] 19.8 ms +- 0.4 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 19.6 ms +- 0.3 ms -> [bolt-cdsplit] 20.0 ms +- 0.2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 19.6 ms +- 0.3 ms -> [bolt-split-all-cold] 20.0 ms +- 0.2 ms: 1.02x slower | |
| genshi_xml | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 46.5 ms +- 0.6 ms -> [bolt-hugify] 46.4 ms +- 0.5 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 46.5 ms +- 0.6 ms -> [bolt-cdsplit] 47.7 ms +- 0.5 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 46.5 ms +- 0.6 ms -> [bolt-split-all-cold] 46.3 ms +- 0.5 ms: 1.01x faster | |
| go | |
| == | |
| Mean +- std dev: [bolt-baseline] 110 ms +- 1 ms -> [bolt-hugify] 110 ms +- 1 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 110 ms +- 1 ms -> [bolt-cdsplit] 114 ms +- 1 ms: 1.03x slower | |
| Mean +- std dev: [bolt-baseline] 110 ms +- 1 ms -> [bolt-split-all-cold] 111 ms +- 1 ms: 1.01x slower | |
| hexiom | |
| ====== | |
| Mean +- std dev: [bolt-baseline] 5.60 ms +- 0.05 ms -> [bolt-hugify] 5.59 ms +- 0.05 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 5.60 ms +- 0.05 ms -> [bolt-cdsplit] 5.68 ms +- 0.04 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 5.60 ms +- 0.05 ms -> [bolt-split-all-cold] 5.48 ms +- 0.03 ms: 1.02x faster | |
| html5lib | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 60.4 ms +- 0.5 ms -> [bolt-hugify] 59.9 ms +- 0.6 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 60.4 ms +- 0.5 ms -> [bolt-cdsplit] 62.6 ms +- 0.5 ms: 1.04x slower | |
| Mean +- std dev: [bolt-baseline] 60.4 ms +- 0.5 ms -> [bolt-split-all-cold] 60.9 ms +- 0.7 ms: 1.01x slower | |
| json_dumps | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.2 ms -> [bolt-hugify] 9.75 ms +- 0.18 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.2 ms -> [bolt-cdsplit] 10.3 ms +- 0.3 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.2 ms -> [bolt-split-all-cold] 10.0 ms +- 0.1 ms: 1.01x faster | |
| json_loads | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 23.2 us +- 0.2 us -> [bolt-hugify] 22.1 us +- 0.3 us: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 23.2 us +- 0.2 us -> [bolt-cdsplit] 22.1 us +- 0.2 us: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 23.2 us +- 0.2 us -> [bolt-split-all-cold] 21.7 us +- 0.3 us: 1.07x faster | |
| logging_format | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 5.77 us +- 0.14 us -> [bolt-hugify] 5.74 us +- 0.16 us: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 5.77 us +- 0.14 us -> [bolt-cdsplit] 5.96 us +- 0.17 us: 1.03x slower | |
| Mean +- std dev: [bolt-baseline] 5.77 us +- 0.14 us -> [bolt-split-all-cold] 5.75 us +- 0.12 us: 1.00x faster | |
| Not significant! | |
| logging_silent | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 107 ns +- 1 ns -> [bolt-hugify] 100 ns +- 2 ns: 1.07x faster | |
| Mean +- std dev: [bolt-baseline] 107 ns +- 1 ns -> [bolt-cdsplit] 102 ns +- 1 ns: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 107 ns +- 1 ns -> [bolt-split-all-cold] 101 ns +- 2 ns: 1.06x faster | |
| logging_simple | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 5.23 us +- 0.07 us -> [bolt-hugify] 5.29 us +- 0.10 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 5.23 us +- 0.07 us -> [bolt-cdsplit] 5.40 us +- 0.11 us: 1.03x slower | |
| Mean +- std dev: [bolt-baseline] 5.23 us +- 0.07 us -> [bolt-split-all-cold] 5.25 us +- 0.06 us: 1.00x slower | |
| mako | |
| ==== | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.1 ms -> [bolt-hugify] 10.4 ms +- 0.2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.1 ms -> [bolt-cdsplit] 10.6 ms +- 0.1 ms: 1.04x slower | |
| Mean +- std dev: [bolt-baseline] 10.1 ms +- 0.1 ms -> [bolt-split-all-cold] 11.0 ms +- 0.1 ms: 1.08x slower | |
| mdp | |
| === | |
| Mean +- std dev: [bolt-baseline] 2.32 sec +- 0.02 sec -> [bolt-hugify] 2.30 sec +- 0.02 sec: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 2.32 sec +- 0.02 sec -> [bolt-cdsplit] 2.33 sec +- 0.01 sec: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 2.32 sec +- 0.02 sec -> [bolt-split-all-cold] 2.31 sec +- 0.01 sec: 1.00x faster | |
| meteor_contest | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-hugify] 88.0 ms +- 0.5 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-cdsplit] 90.0 ms +- 0.4 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 88.7 ms +- 0.5 ms -> [bolt-split-all-cold] 88.5 ms +- 0.5 ms: 1.00x faster | |
| nbody | |
| ===== | |
| Mean +- std dev: [bolt-baseline] 88.2 ms +- 0.6 ms -> [bolt-hugify] 88.2 ms +- 0.8 ms: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 88.2 ms +- 0.6 ms -> [bolt-cdsplit] 87.5 ms +- 0.8 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 88.2 ms +- 0.6 ms -> [bolt-split-all-cold] 86.9 ms +- 1.7 ms: 1.01x faster | |
| nqueens | |
| ======= | |
| Mean +- std dev: [bolt-baseline] 74.7 ms +- 0.9 ms -> [bolt-hugify] 72.6 ms +- 0.6 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 74.7 ms +- 0.9 ms -> [bolt-cdsplit] 74.4 ms +- 0.5 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 74.7 ms +- 0.9 ms -> [bolt-split-all-cold] 73.4 ms +- 0.7 ms: 1.02x faster | |
| pathlib | |
| ======= | |
| Mean +- std dev: [bolt-baseline] 19.1 ms +- 0.1 ms -> [bolt-hugify] 18.8 ms +- 0.1 ms: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 19.1 ms +- 0.1 ms -> [bolt-cdsplit] 18.9 ms +- 0.1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 19.1 ms +- 0.1 ms -> [bolt-split-all-cold] 18.8 ms +- 0.1 ms: 1.02x faster | |
| pickle | |
| ====== | |
| Mean +- std dev: [bolt-baseline] 11.2 us +- 0.4 us -> [bolt-hugify] 10.7 us +- 0.1 us: 1.04x faster | |
| Mean +- std dev: [bolt-baseline] 11.2 us +- 0.4 us -> [bolt-cdsplit] 11.0 us +- 0.1 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 11.2 us +- 0.4 us -> [bolt-split-all-cold] 10.9 us +- 0.1 us: 1.03x faster | |
| pickle_dict | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 23.9 us +- 0.8 us -> [bolt-hugify] 23.8 us +- 0.5 us: 1.01x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 23.9 us +- 0.8 us -> [bolt-cdsplit] 24.1 us +- 0.6 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 23.9 us +- 0.8 us -> [bolt-split-all-cold] 24.3 us +- 0.9 us: 1.02x slower | |
| pickle_list | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 3.92 us +- 0.10 us -> [bolt-hugify] 3.88 us +- 0.20 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 3.92 us +- 0.10 us -> [bolt-cdsplit] 3.93 us +- 0.05 us: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 3.92 us +- 0.10 us -> [bolt-split-all-cold] 3.87 us +- 0.13 us: 1.01x faster | |
| pickle_pure_python | |
| ================== | |
| Mean +- std dev: [bolt-baseline] 296 us +- 3 us -> [bolt-hugify] 298 us +- 3 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 296 us +- 3 us -> [bolt-cdsplit] 295 us +- 3 us: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 296 us +- 3 us -> [bolt-split-all-cold] 296 us +- 2 us: 1.00x slower | |
| pidigits | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 160 ms +- 2 ms -> [bolt-hugify] 158 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 160 ms +- 2 ms -> [bolt-cdsplit] 158 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 160 ms +- 2 ms -> [bolt-split-all-cold] 160 ms +- 1 ms: 1.00x faster | |
| Not significant! | |
| pprint_safe_repr | |
| ================ | |
| Mean +- std dev: [bolt-baseline] 670 ms +- 6 ms -> [bolt-hugify] 657 ms +- 6 ms: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 670 ms +- 6 ms -> [bolt-cdsplit] 677 ms +- 6 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 670 ms +- 6 ms -> [bolt-split-all-cold] 661 ms +- 6 ms: 1.01x faster | |
| pprint_pformat | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 1.38 sec +- 0.01 sec -> [bolt-hugify] 1.36 sec +- 0.02 sec: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 1.38 sec +- 0.01 sec -> [bolt-cdsplit] 1.39 sec +- 0.01 sec: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 1.38 sec +- 0.01 sec -> [bolt-split-all-cold] 1.37 sec +- 0.01 sec: 1.01x faster | |
| pyflate | |
| ======= | |
| Mean +- std dev: [bolt-baseline] 382 ms +- 3 ms -> [bolt-hugify] 384 ms +- 3 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 382 ms +- 3 ms -> [bolt-cdsplit] 414 ms +- 3 ms: 1.09x slower | |
| Mean +- std dev: [bolt-baseline] 382 ms +- 3 ms -> [bolt-split-all-cold] 407 ms +- 3 ms: 1.06x slower | |
| python_startup | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 9.28 ms +- 0.03 ms -> [bolt-hugify] 11.3 ms +- 0.0 ms: 1.22x slower | |
| Mean +- std dev: [bolt-baseline] 9.28 ms +- 0.03 ms -> [bolt-cdsplit] 9.27 ms +- 0.04 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 9.28 ms +- 0.03 ms -> [bolt-split-all-cold] 9.29 ms +- 0.03 ms: 1.00x slower | |
| python_startup_no_site | |
| ====================== | |
| Mean +- std dev: [bolt-baseline] 6.52 ms +- 0.03 ms -> [bolt-hugify] 8.53 ms +- 0.05 ms: 1.31x slower | |
| Mean +- std dev: [bolt-baseline] 6.52 ms +- 0.03 ms -> [bolt-cdsplit] 6.50 ms +- 0.04 ms: 1.00x faster | |
| Mean +- std dev: [bolt-baseline] 6.52 ms +- 0.03 ms -> [bolt-split-all-cold] 6.51 ms +- 0.03 ms: 1.00x faster | |
| raytrace | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 256 ms +- 2 ms -> [bolt-hugify] 257 ms +- 2 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 256 ms +- 2 ms -> [bolt-cdsplit] 257 ms +- 4 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 256 ms +- 2 ms -> [bolt-split-all-cold] 262 ms +- 2 ms: 1.02x slower | |
| regex_compile | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 118 ms +- 1 ms -> [bolt-hugify] 117 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 118 ms +- 1 ms -> [bolt-cdsplit] 119 ms +- 1 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 118 ms +- 1 ms -> [bolt-split-all-cold] 118 ms +- 1 ms: 1.00x slower | |
| regex_dna | |
| ========= | |
| Mean +- std dev: [bolt-baseline] 148 ms +- 2 ms -> [bolt-hugify] 149 ms +- 4 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 148 ms +- 2 ms -> [bolt-cdsplit] 149 ms +- 3 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 148 ms +- 2 ms -> [bolt-split-all-cold] 152 ms +- 2 ms: 1.02x slower | |
| regex_effbot | |
| ============ | |
| Mean +- std dev: [bolt-baseline] 2.45 ms +- 0.05 ms -> [bolt-hugify] 2.35 ms +- 0.07 ms: 1.04x faster | |
| Mean +- std dev: [bolt-baseline] 2.45 ms +- 0.05 ms -> [bolt-cdsplit] 2.33 ms +- 0.06 ms: 1.05x faster | |
| Mean +- std dev: [bolt-baseline] 2.45 ms +- 0.05 ms -> [bolt-split-all-cold] 2.35 ms +- 0.04 ms: 1.04x faster | |
| regex_v8 | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 21.5 ms +- 0.2 ms -> [bolt-hugify] 20.9 ms +- 0.3 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 21.5 ms +- 0.2 ms -> [bolt-cdsplit] 20.2 ms +- 0.2 ms: 1.07x faster | |
| Mean +- std dev: [bolt-baseline] 21.5 ms +- 0.2 ms -> [bolt-split-all-cold] 20.7 ms +- 0.2 ms: 1.04x faster | |
| richards | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 43.6 ms +- 0.4 ms -> [bolt-hugify] 44.9 ms +- 0.4 ms: 1.03x slower | |
| Mean +- std dev: [bolt-baseline] 43.6 ms +- 0.4 ms -> [bolt-cdsplit] 44.4 ms +- 0.3 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 43.6 ms +- 0.4 ms -> [bolt-split-all-cold] 43.9 ms +- 0.5 ms: 1.01x slower | |
| richards_super | |
| ============== | |
| Mean +- std dev: [bolt-baseline] 49.5 ms +- 0.5 ms -> [bolt-hugify] 51.3 ms +- 0.6 ms: 1.04x slower | |
| Mean +- std dev: [bolt-baseline] 49.5 ms +- 0.5 ms -> [bolt-cdsplit] 50.5 ms +- 0.5 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 49.5 ms +- 0.5 ms -> [bolt-split-all-cold] 50.5 ms +- 0.5 ms: 1.02x slower | |
| scimark_fft | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 314 ms +- 4 ms -> [bolt-hugify] 304 ms +- 6 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 314 ms +- 4 ms -> [bolt-cdsplit] 329 ms +- 4 ms: 1.05x slower | |
| Mean +- std dev: [bolt-baseline] 314 ms +- 4 ms -> [bolt-split-all-cold] 318 ms +- 4 ms: 1.01x slower | |
| scimark_lu | |
| ========== | |
| Mean +- std dev: [bolt-baseline] 112 ms +- 1 ms -> [bolt-hugify] 110 ms +- 1 ms: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 112 ms +- 1 ms -> [bolt-cdsplit] 105 ms +- 2 ms: 1.07x faster | |
| Mean +- std dev: [bolt-baseline] 112 ms +- 1 ms -> [bolt-split-all-cold] 114 ms +- 2 ms: 1.02x slower | |
| scimark_monte_carlo | |
| =================== | |
| Mean +- std dev: [bolt-baseline] 59.3 ms +- 0.6 ms -> [bolt-hugify] 57.4 ms +- 0.5 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 59.3 ms +- 0.6 ms -> [bolt-cdsplit] 59.5 ms +- 0.6 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 59.3 ms +- 0.6 ms -> [bolt-split-all-cold] 59.5 ms +- 0.5 ms: 1.00x slower | |
| scimark_sor | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 113 ms +- 1 ms -> [bolt-hugify] 115 ms +- 2 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 113 ms +- 1 ms -> [bolt-cdsplit] 116 ms +- 1 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 113 ms +- 1 ms -> [bolt-split-all-cold] 117 ms +- 1 ms: 1.03x slower | |
| scimark_sparse_mat_mult | |
| ======================= | |
| Mean +- std dev: [bolt-baseline] 4.24 ms +- 0.15 ms -> [bolt-hugify] 4.01 ms +- 0.17 ms: 1.06x faster | |
| Mean +- std dev: [bolt-baseline] 4.24 ms +- 0.15 ms -> [bolt-cdsplit] 4.30 ms +- 0.06 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 4.24 ms +- 0.15 ms -> [bolt-split-all-cold] 4.34 ms +- 0.08 ms: 1.02x slower | |
| spectral_norm | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 93.2 ms +- 0.6 ms -> [bolt-hugify] 98.8 ms +- 1.2 ms: 1.06x slower | |
| Mean +- std dev: [bolt-baseline] 93.2 ms +- 0.6 ms -> [bolt-cdsplit] 95.1 ms +- 1.0 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 93.2 ms +- 0.6 ms -> [bolt-split-all-cold] 88.5 ms +- 1.4 ms: 1.05x faster | |
| sqlglot_normalize | |
| ================= | |
| Mean +- std dev: [bolt-baseline] 102 ms +- 1 ms -> [bolt-hugify] 280 ms +- 4 ms: 2.74x slower | |
| Mean +- std dev: [bolt-baseline] 102 ms +- 1 ms -> [bolt-cdsplit] 101 ms +- 1 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 102 ms +- 1 ms -> [bolt-split-all-cold] 284 ms +- 4 ms: 2.78x slower | |
| telco | |
| ===== | |
| Mean +- std dev: [bolt-baseline] 6.61 ms +- 0.09 ms -> [bolt-hugify] 6.40 ms +- 0.09 ms: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 6.61 ms +- 0.09 ms -> [bolt-cdsplit] 6.64 ms +- 0.09 ms: 1.00x slower | |
| Mean +- std dev: [bolt-baseline] 6.61 ms +- 0.09 ms -> [bolt-split-all-cold] 6.87 ms +- 0.10 ms: 1.04x slower | |
| tomli_loads | |
| =========== | |
| Mean +- std dev: [bolt-baseline] 1.93 sec +- 0.02 sec -> [bolt-hugify] 1.89 sec +- 0.02 sec: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 1.93 sec +- 0.02 sec -> [bolt-cdsplit] 1.94 sec +- 0.02 sec: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 1.93 sec +- 0.02 sec -> [bolt-split-all-cold] 1.95 sec +- 0.03 sec: 1.01x slower | |
| typing_runtime_protocols | |
| ======================== | |
| Mean +- std dev: [bolt-baseline] 153 us +- 3 us -> [bolt-hugify] 148 us +- 3 us: 1.03x faster | |
| Mean +- std dev: [bolt-baseline] 153 us +- 3 us -> [bolt-cdsplit] 153 us +- 3 us: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 153 us +- 3 us -> [bolt-split-all-cold] 153 us +- 3 us: 1.00x slower | |
| Not significant! | |
| unpack_sequence | |
| =============== | |
| Mean +- std dev: [bolt-baseline] 36.8 ns +- 2.3 ns -> [bolt-hugify] 36.2 ns +- 0.9 ns: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 36.8 ns +- 2.3 ns -> [bolt-cdsplit] 36.7 ns +- 0.6 ns: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 36.8 ns +- 2.3 ns -> [bolt-split-all-cold] 39.4 ns +- 2.6 ns: 1.07x slower | |
| unpickle | |
| ======== | |
| Mean +- std dev: [bolt-baseline] 12.1 us +- 0.1 us -> [bolt-hugify] 11.9 us +- 0.2 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 12.1 us +- 0.1 us -> [bolt-cdsplit] 11.9 us +- 0.2 us: 1.02x faster | |
| Mean +- std dev: [bolt-baseline] 12.1 us +- 0.1 us -> [bolt-split-all-cold] 11.8 us +- 0.1 us: 1.03x faster | |
| unpickle_list | |
| ============= | |
| Mean +- std dev: [bolt-baseline] 4.34 us +- 0.07 us -> [bolt-hugify] 4.30 us +- 0.13 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 4.34 us +- 0.07 us -> [bolt-cdsplit] 4.38 us +- 0.07 us: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 4.34 us +- 0.07 us -> [bolt-split-all-cold] 4.52 us +- 0.11 us: 1.04x slower | |
| unpickle_pure_python | |
| ==================== | |
| Mean +- std dev: [bolt-baseline] 211 us +- 2 us -> [bolt-hugify] 211 us +- 2 us: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 211 us +- 2 us -> [bolt-cdsplit] 210 us +- 2 us: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 211 us +- 2 us -> [bolt-split-all-cold] 210 us +- 2 us: 1.00x faster | |
| xml_etree_parse | |
| =============== | |
| Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-hugify] 115 ms +- 1 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-cdsplit] 114 ms +- 1 ms: 1.00x faster | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 114 ms +- 1 ms -> [bolt-split-all-cold] 116 ms +- 1 ms: 1.02x slower | |
| xml_etree_iterparse | |
| =================== | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-hugify] 79.9 ms +- 0.6 ms: 1.02x slower | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-cdsplit] 79.4 ms +- 0.5 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.6 ms -> [bolt-split-all-cold] 80.4 ms +- 0.5 ms: 1.02x slower | |
| xml_etree_generate | |
| ================== | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.7 ms -> [bolt-hugify] 77.8 ms +- 0.8 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.7 ms -> [bolt-cdsplit] 78.5 ms +- 0.6 ms: 1.00x slower | |
| Not significant! | |
| Mean +- std dev: [bolt-baseline] 78.5 ms +- 0.7 ms -> [bolt-split-all-cold] 79.3 ms +- 0.6 ms: 1.01x slower | |
| xml_etree_process | |
| ================= | |
| Mean +- std dev: [bolt-baseline] 54.8 ms +- 0.6 ms -> [bolt-hugify] 54.2 ms +- 0.7 ms: 1.01x faster | |
| Mean +- std dev: [bolt-baseline] 54.8 ms +- 0.6 ms -> [bolt-cdsplit] 55.2 ms +- 0.5 ms: 1.01x slower | |
| Mean +- std dev: [bolt-baseline] 54.8 ms +- 0.6 ms -> [bolt-split-all-cold] 55.2 ms +- 0.5 ms: 1.01x slower | |
| Benchmark hidden because not significant (1): asyncio_websockets | |
| Geometric mean | |
| ============== | |
| bolt-hugify: 1.01x slower | |
| bolt-cdsplit: 1.01x slower | |
| bolt-split-all-cold: 1.02x slower |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment