118 Open source projects that are alternatives of or similar to suika

Self-contained Japanese Morphological Analyzer written in pure Go

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

Juman++ (a Morphological Analyzer Toolkit)

POS Tagger, lemmatizer and stemmer for french language in javascript

The greynir.is natural language processing website for Icelandic

Collection of developer toolkits

Greeb is a simple Unicode-aware regexp-based tokenizer.

React component for tagging inputs.

aim to use JapaneseTokenizer as easy as possible

🌭 Mustard is a Swift library for tokenizing strings when splitting by whitespace doesn't cut it.

Open Korean Text Processor - An Open-source Korean Text Processor

PHP calculator library for mathematical terms (expressions) passed as strings

Replaced by foonathan/lexy

NLP framework: sentence detector, tokeniser, pos-tagger and dependency parser

Vietnamese tokenizer (Maximum Matching and CRF)

Fuzzing Parsers with Tokens

Parser Building Toolkit for JavaScript

SNL(Small Nested Language) Compiler. Maven jUnit Tokenizer Lexer Syntax Parser. 编译原理 词法分析 语法分析

Yet Another (natural language) Parser

한국어 자연어처리를 위한 파이썬 라이브러리입니다. 단어 추출/ 토크나이저 / 품사판별/ 전처리의 기능을 제공합니다.

Kadot, the unsupervised natural language processing library.

Tiny JavaScript tokenizer.

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

A tokenizer and sentence splitter for German and English web and social media texts.

🌿 NodeJS PHP Parser - extract AST or tokens (PHP5 and PHP7)

Lex machinary for go.

Ruby Object Inspection for IRB

R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based on the UDPipe Natural Language Processing Toolkit

Thot toolkit for statistical machine translation

Neural morphological disambiguation for Turkish. Implemented in DyNet

A collection of basic python modules for spoken natural language processing

Fast and customizable text tokenization library with BPE and SentencePiece support

A small .NET math library.

A tokenizer for Icelandic text

Naive Bayes text classification implementation as an OmniCat classifier strategy. (#ruby #naivebayes)

A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.

Laravel token management

A collection of NLP tools for Sinhalese (සිංහල).

💠The Lel programming language

Text tokenization and sentence segmentation (segtok v2)

Solves basic Russian NLP tasks, API for lower level Natasha projects

(Latest semester at https://github.com/kmader/Quantitative-Big-Imaging-2019) The material for the Quantitative Big Imaging course at ETHZ for the Spring Semester 2018

Source code tokenizer

PHP standards checker.

A multilingual command line sentence tokenizer in Golang

A small library for converting tokenized PHP source code into XML (and potentially other formats)

Bitextor generates translation memories from multilingual websites.

专注于可解释的NLP技术 An NLP Toolset With A Focus on Explainable Inference

😻 Markdown with easy tokenization, a fast highlighter, and a lean HTML sanitizer

Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.

C++ Lexer Toolkit Library (LexerTk) https://www.partow.net/programming/lexertk/index.html

The fast scanner generator for Java™ with full Unicode support

Simple yet helpful library for writing Django urls by an easy, short and intuitive way.

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

Query Translator is a search query translator with AST representation

Python port of Moses tokenizer, truecaser and normalizer

Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.

Python morphological analyzer for Turkish language. Partial port of ZemberekNLP.

The aim of this repository is to show a baseline model for text classification by implementing a LSTM-based model coded in PyTorch. In order to provide a better understanding of the model, it will be used a Tweets dataset provided by Kaggle.

Essential NLP & ML, short & fast pure Python code