144 Open source projects that are alternatives of or similar to WeTextProcessing

🔬 Очистка датасетов от мусора (нормализация, препроцессинг)

My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.

Expands texts as you type, naturally

Text Mining in Python

Unix Text Processing Command Reference

Preprocessing Library for Natural Language Processing

Python library for creating PEG parsers

Text vectorization tool to outperform TFIDF for classification tasks

⚡ From finding text to search and replace, from sorting to beautifying text and more 🎨

A simple Python module for parsing human names into their individual components

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

A NodeJS implementation of the Rapid Automatic Keyword Extraction algorithm.

Stanford NLP group's shared Python tools.

Text Expression Runner – Readable and easy to use text expressions

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

PipeIt is a text transformation, conversion, cleansing and extraction tool.

A Golang library for processing Asciidoc files.

A large scale feature extraction tool for text-based machine learning

A low level regular expression library that uses deterministic finite automata.

Hatena Notation (はてな記法) Parser written in Go

短文本聚类预处理模块 Short text cluster

Open Korean Text Processor - An Open-source Korean Text Processor

Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku and Zenkaku

Text Classification Algorithms: A Survey

Simple SQL-like syntax on top of Perl text processing.

Textpipe: clean and extract metadata from text

Vision Framework IOS WWDC 2017

A web app to create and browse text visualizations for automated customer listening.

A flexible Java text processor. BB, BBCode, BB-code, HTML, Textile, Markdown, parser, translator, converter.

Intuitive find & replace CLI (sed alternative)

Cleaning-up Persian Texts!

Text Mining and Topic Modeling Toolkit for Python with parallel processing power

Repo for Applied Text Mining in Python (coursera) by University of Michigan

THE String Processing Package for R (with ICU)

🚀 Search & replace URLs in WordPress SQL files.

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

Mycroft's multilingual text parsing and formatting library

Tool which allow you to detect and translate text.

An idiomatic and fast QP-trie implementation in pure Rust.

A neural network intent parser

Ipython Notebooks for solving problems like classification, segmentation, generation using latest Deep learning algorithms on different publicly available text and image data-sets.

Multilingual implementation of RAKE algorithm for Rust

🔤 Lightweight R package for manipulating [string] characters

CogComp's light-weight Python NLP annotators

Natural language detection library for Go

Python library for Natural Language Preprocessing (NLPre)

Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

UNIC: Unicode and Internationalization Crates for Rust

A fast implementation of Aho-Corasick in Rust.

Binary Processing Language

🗣️ Tool to generate adversarial text examples and test machine learning models against them

Util collection for Japanese text processing. Hiraganize, Katakanize, and Romanize.

A Python package that do stemming, tokenization, sentence breaking, segmentation, normalization, POS tagging for Arabic language.

Multi-lingual Text Processing

Weaving analytical stories from text data

Twitter Text Libraries for Python

pyarabic

Extract indicators of compromise from text, including "escaped" ones.