diff options
| author | Ulf Magnusson <ulfalizer@gmail.com> | 2017-09-26 17:33:43 +0200 |
|---|---|---|
| committer | Ulf Magnusson <ulfalizer@gmail.com> | 2017-09-26 21:56:28 +0200 |
| commit | d18ca7216457e46cdc592b022aa534eec473b9c4 (patch) | |
| tree | 81ac25b9ef0f613562c0c83d0f6a7ba708406a0b /setup.py | |
| parent | c8807f0afa354fb16886b7517f0cc0bf18d39713 (diff) | |
Micro-optimize _tokenize()
- A small modification to _initial_token_re_match makes it reject
comments too, saving some manual code (and probably lots of string
copying).
- Reorganize things to handle 'previous' in a nicer way.
- Use tuples instead instead of lists in the no-tokens and _T_HELP
cases. Could preallocate and return an empty _Feed too, but it seems
like overkilling it.
Profiling done with cProfile and line_profiler.
Diffstat (limited to 'setup.py')
0 files changed, 0 insertions, 0 deletions