diff options
| author | Ulf Magnusson <ulfalizer@gmail.com> | 2018-07-02 04:23:50 +0200 |
|---|---|---|
| committer | Ulf Magnusson <ulfalizer@gmail.com> | 2018-07-02 04:36:17 +0200 |
| commit | 86a3c2da10491f7cec96a9c2720a5cd92b8aad67 (patch) | |
| tree | 1848909f81772f554292b96b6f06ce1877542e22 /tests/Krange | |
| parent | db90cb85094a2cab19a524ad30b603e26cbb76fe (diff) | |
Refactor tokenization a bit
Have _tokenize() take the string to tokenize and return a list of
tokens, and handle all the token list management outside.
Simplifies the internal logic a bit. Likely faster too.
Diffstat (limited to 'tests/Krange')
0 files changed, 0 insertions, 0 deletions