Commit Graph

4 Commits

Author SHA1 Message Date
Daniel Wolf 55cf80e40b Refactoring: Made imports more specific 2017-09-12 19:29:10 +02:00
Daniel Wolf 5f451feb00 Made entire application Unicode-aware
All 8-bit strings are UTF-8-encoded now.
2017-08-15 20:47:05 +02:00
Daniel Wolf c9b17e1937 Improved tokenization by taking dictionary into account 2016-06-25 21:52:04 +02:00
Daniel Wolf 4d95b4c2c5 Implemented text tokenization using Flite 2016-06-02 18:24:27 +02:00