304 Open source projects that are alternatives of or similar to skt

A toolkit for pre-processing large source code corpora

Syllable segmentation tool for Myanmar language (Burmese) by Ye.

Paper: A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging

Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.