CPython results, 2017¶
This page lists benchmarks which became faster in CPython.
Optimizations¶
2016-12-14: speedup method calls¶
Optimization: Speedup method calls 1.2x, commit f2392133.
Benchmark |
2016-12-01 (27580c1fb5e8) |
2017-01-01 (67e1aa0b58be) |
|---|---|---|
call_method |
14.1 ms |
11.2 ms: 1.26x faster (-21%) |
call_method_slots |
13.9 ms |
11.1 ms: 1.25x faster (-20%) |
call_method_unknown |
16.0 ms |
14.3 ms: 1.12x faster (-11%) |
2016-04-22: pymalloc allocator¶
Optimization: PyMem_Malloc() now uses the fast pymalloc allocator, commit f5c4b990.
Changes of at least 5%:
Benchmark |
2016-04-21 (5439fc4901db) |
2016-04-22 (f5c4b99034fa) |
|---|---|---|
unpickle_list |
10.4 us |
7.64 us: 1.36x faster (-27%) |
json_dumps |
28.0 ms |
25.2 ms: 1.11x faster (-10%) |
unpickle_pure_python |
741 us |
678 us: 1.09x faster (-9%) |
unpickle |
33.9 us |
31.3 us: 1.08x faster (-8%) |
meteor_contest |
197 ms |
183 ms: 1.08x faster (-7%) |
mako |
36.9 ms |
34.3 ms: 1.07x faster (-7%) |
pathlib |
41.0 ms |
38.4 ms: 1.07x faster (-6%) |
call_method_slots |
14.8 ms |
13.9 ms: 1.07x faster (-6%) |
telco |
19.5 ms |
18.3 ms: 1.07x faster (-6%) |
scimark_lu |
413 ms |
388 ms: 1.07x faster (-6%) |
nqueens |
221 ms |
207 ms: 1.07x faster (-6%) |
fannkuch |
937 ms |
882 ms: 1.06x faster (-6%) |
regex_compile |
319 ms |
301 ms: 1.06x faster (-6%) |
raytrace |
1.16 sec |
1.09 sec: 1.06x faster (-5%) |
pickle_pure_python |
1.11 ms |
1.05 ms: 1.05x faster (-5%) |
genshi_text |
70.1 ms |
66.6 ms: 1.05x faster (-5%) |
2015-12-07: Optimize ElementTree.iterparse(), xml_etree_iterparse¶
Optimization: Issue #25638: Optimized ElementTree.iterparse(); it is now 2x faster, commit 9ec5e25f2.
Benchmark |
2015-12-01 (df144092a340) |
2016-01-01 (71db90356390) |
|---|---|---|
xml_etree_iterparse |
423 ms |
206 ms: 2.05x faster (-51%) |
2015-09-19: PGO uses test suite, pidigits¶
Optimization: Issue #24915: Add Clang support to PGO builds and use the test suite for profile data, commit 7188a3ef.
Changes of at least 5%:
Benchmark |
2015-09-18 (4b363e270108) |
2015-09-18_22-13 (7188a3efe07b) |
|---|---|---|
pickle |
33.7 us |
26.4 us: 1.28x faster (-22%) |
pidigits |
332 ms |
286 ms: 1.16x faster (-14%) |
pickle_list |
9.90 us |
8.84 us: 1.12x faster (-11%) |
unpickle |
37.2 us |
33.3 us: 1.12x faster (-11%) |
unpickle_list |
11.1 us |
9.95 us: 1.11x faster (-10%) |
regex_dna |
330 ms |
297 ms: 1.11x faster (-10%) |
regex_effbot |
6.43 ms |
5.80 ms: 1.11x faster (-10%) |
pickle_dict |
69.3 us |
64.1 us: 1.08x faster (-8%) |
mako |
39.1 ms |
36.2 ms: 1.08x faster (-7%) |
call_simple |
12.2 ms |
11.6 ms: 1.05x faster (-5%) |
genshi_xml |
175 ms |
166 ms: 1.05x faster (-5%) |
Changes of at least 5%, sadly two benchmarks also became slower:
Benchmark |
2015-09-18_14-32-master-4b363e270108 |
2015-09-18_22-13-master-7188a3efe07b |
|---|---|---|
unpickle_pure_python |
776 us |
821 us: 1.06x slower (+6%) |
regex_v8 |
49.5 ms |
52.6 ms: 1.06x slower (+6%) |
2015-05-30: C implementation of collections.OrderedDict, html5lib¶
Optimization: Issue #16991: Add a C implementation of collections.OrderedDict, commit 96c6af9b.
Benchmark |
2015-05-02 (3b4d30a27bd6) |
2015-06-01 (41874c570cf3) |
|---|---|---|
html5lib |
285 ms |
233 ms: 1.23x faster (-19%) |
2015-05-23: C implementation of functools.lru_cache(), sympy¶
Optimization: Issue #14373: Added C implementation of functools.lru_cache(), commit 1c858c35.
Changes of at least 5%:
Benchmark |
2015-05-23_19-15-master-c70908558d8e |
2015-05-23_19-42-master-1c858c352b8c |
|---|---|---|
sympy_expand |
1.45 sec |
1.14 sec: 1.27x faster (-21%) |
sympy_sum |
308 ms |
247 ms: 1.25x faster (-20%) |
sympy_str |
621 ms |
500 ms: 1.24x faster (-19%) |
sympy_integrate |
54.2 ms |
45.7 ms: 1.19x faster (-16%) |
scimark_lu |
497 ms |
471 ms: 1.06x faster (-5%) |
pickle_dict is seen as 1.06x slower, but since pickle doesn’t use
functools.lru_cache(), the change is ignored in the table.
Slowdown¶
2016-09-11: regex_compile¶
Slowdown: convert re flags to (much friendlier) IntFlag constants (issue #28082), commit f93395bc.
Benchmark |
2016-04-01 (6b6abd4cf10e) |
2016-07-01 (355048970b2a) |
2016-10-01 (78a111c7d867) |
|---|---|---|---|
regex_compile |
339 ms |
309 ms: 1.10x faster (-9%) |
383 ms: 1.13x slower (+13%) |
Timeline¶
April, 2016 -> May, 2016¶
2016-04-01 .. 2016-05-01:
Benchmark |
2016-04-01 (dcfebb32e277) |
2016-05-01 (f1e2671fdf88) |
|---|---|---|
nqueens |
255 ms |
207 ms: 1.23x faster (-19%) |
raytrace |
1.31 sec |
1.09 sec: 1.19x faster (-16%) |
float |
290 ms |
243 ms: 1.19x faster (-16%) |
chaos |
273 ms |
235 ms: 1.16x faster (-14%) |
hexiom |
21.0 ms |
18.6 ms: 1.13x faster (-11%) |
deltablue |
16.4 ms |
14.6 ms: 1.12x faster (-11%) |
go |
557 ms |
502 ms: 1.11x faster (-10%) |
nbody |
254 ms |
232 ms: 1.10x faster (-9%) |
call_method¶
Timeline 2016-04-01 .. 2017-01-01:
Benchmark |
2016-04-01 (6b6abd4cf10e) |
2016-07-01 (355048970b2a) |
2016-10-01 (78a111c7d867) |
2017-01-01 (67e1aa0b58be) |
|---|---|---|---|---|
call_method |
15.8 ms |
14.9 ms: 1.06x faster (-6%) |
14.1 ms: 1.13x faster (-11%) |
11.2 ms: 1.42x faster (-29%) |
call_method_slots |
15.7 ms |
15.2 ms: 1.03x faster (-3%) |
14.0 ms: 1.13x faster (-11%) |
11.1 ms: 1.42x faster (-29%) |
call_method_unknown |
17.7 ms |
15.9 ms: 1.11x faster (-10%) |
15.6 ms: 1.13x faster (-11%) |
14.3 ms: 1.23x faster (-19%) |
crypto_pyaes¶
Benchmark |
2016-04-01 (master) |
2016-05-01 (master) |
|---|---|---|
crypto_pyaes |
226 ms |
205 ms: 1.10x faster (-9%) |
2016-03-01 .. 2016-06-01:
Benchmark |
2016-03-01 (13d09afff127) |
2016-06-01 (d80ab7d94578) |
|---|---|---|
crypto_pyaes |
231 ms |
199 ms: 1.16x faster (-14%) |
json_loads¶
Progress on 21 months, 2015-01-01 .. 2016-10-01:
Benchmark |
2015-01-01 (52074ac866eb) |
2016-10-01 (78a111c7d867) |
|---|---|---|
json_loads |
64.0 us |
56.6 us: 1.13x faster (-11%) |
logging_silent¶
Benchmark |
2016-01-01 (899b72cee21c) |
2016-07-01 (355048970b2a) |
|---|---|---|
logging_silent |
718 ns |
606 ns: 1.18x faster (-16%) |
pickle¶
pickle, 2016-08-02 .. 2016-09-08:
Benchmark |
2016-08-02 (133138a284be) |
2016-09-08 (10427f44852b) |
|---|---|---|
pickle |
25.5 us |
21.4 us: 1.19x faster (-16%) |
pickle dict/list:
Benchmark |
2016-04-01 (6b6abd4cf10e) |
2016-10-01 (78a111c7d867) |
|---|---|---|
pickle_dict |
64.5 us |
57.7 us: 1.12x faster (-11%) |
pickle_list |
9.06 us |
7.79 us: 1.16x faster (-14%) |
unpickle:
Benchmark |
2015-07-01 (d7982beca93c) |
2015-10-01 (30b7138fe12b) |
|---|---|---|
unpickle |
36.9 us |
32.8 us: 1.13x faster (-11%) |
python_startup¶
2015-04-01 .. 2015-10-01:
Benchmark |
2015-04-01 (4fd929b43121) |
2015-10-01 (30b7138fe12b) |
|---|---|---|
python_startup |
16.4 ms |
17.2 ms: 1.05x slower (+5%) |
python_startup_no_site |
8.65 ms |
8.90 ms: 1.03x slower (+3%) |
2016-04-01 .. 2017-01-01:
Benchmark |
2016-04-01 (6b6abd4cf10e) |
2017-01-01 (67e1aa0b58be) |
|---|---|---|
python_startup |
17.3 ms |
14.5 ms: 1.20x faster (-16%) |
python_startup_no_site |
8.89 ms |
8.39 ms: 1.06x faster (-6%) |
regex_compile¶
Benchmark |
2016-04-01 (6b6abd4cf10e) |
2016-07-01 (355048970b2a) |
2016-10-01 (78a111c7d867) |
|---|---|---|---|
regex_compile |
339 ms |
309 ms: 1.10x faster (-9%) |
383 ms: 1.13x slower (+13%) |
telco¶
Benchmark |
2016-01-01 (899b72cee21c) |
2016-04-01 (6b6abd4cf10e) |
2016-07-01 (355048970b2a) |
2016-10-01 (78a111c7d867) |
2017-03-31 (cdcac039fb44) |
|---|---|---|---|---|---|
telco |
19.6 ms |
19.2 ms: 1.02x faster (-2%) |
18.3 ms: 1.08x faster (-7%) |
15.1 ms: 1.30x faster (-23%) |
13.9 ms: 1.41x faster (-29%) |
scimark¶
2016-10-01 .. 2017-03-31:
Benchmark |
2016-10-01 (78a111c7d867) |
2017-01-01 (67e1aa0b58be) |
2017-03-31 (cdcac039fb44) |
|---|---|---|---|
scimark_lu |
423 ms |
378 ms: 1.12x faster (-11%) |
318 ms: 1.33x faster (-25%) |
scimark_sor |
426 ms |
403 ms: 1.06x faster (-5%) |
375 ms: 1.14x faster (-12%) |
sqlalchemy_declarative¶
Benchmark |
2014-10-01 (5a789f7eaf81) |
2015-10-01 (30b7138fe12b) |
|---|---|---|
sqlalchemy_declarative |
345 ms |
301 ms: 1.15x faster (-13%) |
sympy¶
2016-04-01 .. 2016-10-01:
Benchmark |
2016-04-01 (6b6abd4cf10e) |
2016-07-01 (355048970b2a) |
2016-10-01 (78a111c7d867) |
|---|---|---|---|
sympy_expand |
1.10 sec |
1.01 sec: 1.09x faster (-8%) |
942 ms: 1.17x faster (-14%) |
sympy_integrate |
46.6 ms |
42.9 ms: 1.09x faster (-8%) |
41.2 ms: 1.13x faster (-11%) |
sympy_sum |
247 ms |
233 ms: 1.06x faster (-6%) |
199 ms: 1.24x faster (-19%) |
sympy_str |
483 ms |
454 ms: 1.07x faster (-6%) |
427 ms: 1.13x faster (-12%) |
xml_etree_generate¶
Benchmark |
2015-04-01 (4fd929b43121) |
2015-07-01 (d7982beca93c) |
2015-10-01 (30b7138fe12b) |
2016-01-01 (899b72cee21c) |
2016-07-01 (355048970b2a) |
|---|---|---|---|---|---|
xml_etree_generate |
282 ms |
267 ms: 1.06x faster (-5%) |
256 ms: 1.10x faster (-9%) |
237 ms: 1.19x faster (-16%) |
212 ms: 1.33x faster (-25%) |