Skip to content
GitLab

added python-ucto, python binding to a tokenizer

Closed Administrator requested to merge github/fork/proycon/python-ucto into master

Created by: proycon

Ucto is an advanced regular-expression based tokeniser and sentence splitter, with configurations for various languages, support for FoLiA XML. Ucto itself is written in C++, this is the Python binding to ucto.