diff options
| author | Ulf Magnusson <ulfalizer@gmail.com> | 2017-09-29 03:49:35 +0200 |
|---|---|---|
| committer | Ulf Magnusson <ulfalizer@gmail.com> | 2017-09-29 06:15:01 +0200 |
| commit | 5fea36ffd71d8f908133d091860ef4b139cc7e81 (patch) | |
| tree | 3b78d0c6a8724ed741fbeec535b803f33bd07a6b /tests/Kbase_dir | |
| parent | 3d27a14dbcb057eb99491babe1238bde6cfe66e6 (diff) | |
Reorganize whitespace stripping in _tokenize()
By consistently stripping trailing whitespace instead of stripping
initial whitespace in the string/operator case, we do less redundant
work and handle the '\n's at the end of lines better. Shaves a few % off
the _tokenize() runtime in cProfile and line_profiler.
Diffstat (limited to 'tests/Kbase_dir')
0 files changed, 0 insertions, 0 deletions