Punkt SegmenterRuby port of the NLTK Punkt sentence segmentation algorithm
Stars: ✭ 88 (+486.67%)
Atr4sToolkit with state-of-the-art Automatic Terms Recognition methods in Scala
Stars: ✭ 23 (+53.33%)
Cn2an📦 快速转化「中文数字」和「阿拉伯数字」~ (最新特性:分数,日期、温度等转化)
Stars: ✭ 249 (+1560%)
Turkish DeasciifierTurkish deasciifier in Python based on Deniz Yüret's turkish-mode for Emacs
Stars: ✭ 108 (+620%)
EkphrasisEkphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
Stars: ✭ 433 (+2786.67%)
limaThe Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.
Stars: ✭ 75 (+400%)
Tika PythonTika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
Stars: ✭ 997 (+6546.67%)
GrammarEngineГрамматический Словарь Русского Языка (+ английский, японский, etc)
Stars: ✭ 68 (+353.33%)
PythainlpThai Natural Language Processing in Python.
Stars: ✭ 582 (+3780%)
UrduhackAn NLP library for the Urdu language. It comes with a lot of battery included features to help you process Urdu data in the easiest way possible.
Stars: ✭ 200 (+1233.33%)
Lingopackage lingo provides the data structures and algorithms required for natural language processing
Stars: ✭ 113 (+653.33%)
Giveme5w1hExtraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?
Stars: ✭ 316 (+2006.67%)
rsmorphyMorphological analyzer / inflection engine for Russian and Ukrainian languages rewritten in Rust
Stars: ✭ 27 (+80%)
OpenPromptAn Open-Source Framework for Prompt-Learning.
Stars: ✭ 1,769 (+11693.33%)
Farm🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
Stars: ✭ 1,140 (+7500%)
py-lingualyticsA text analytics library with support for codemixed data
Stars: ✭ 36 (+140%)
extra-modelCode to run the ExtRA algorithm for unsupervised topic/aspect extraction on English texts.
Stars: ✭ 43 (+186.67%)
KuromojiKuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
Stars: ✭ 745 (+4866.67%)
Fnlp中文自然语言处理工具包 Toolkit for Chinese natural language processing
Stars: ✭ 2,468 (+16353.33%)
SudachiA Japanese Tokenizer for Business
Stars: ✭ 496 (+3206.67%)
empythyAutomated NLP sentiment predictions- batteries included, or use your own data
Stars: ✭ 17 (+13.33%)
Lingua👄 The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
Stars: ✭ 341 (+2173.33%)
Nlp profilerA simple NLP library allows profiling datasets with one or more text columns. When given a dataset and a column name containing text data, NLP Profiler will return either high-level insights or low-level/granular statistical information about the text in that column.
Stars: ✭ 181 (+1106.67%)
Camel toolsA suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.
Stars: ✭ 124 (+726.67%)
Quick NlpPytorch NLP library based on FastAI
Stars: ✭ 279 (+1760%)
bllip-parserBLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.
Stars: ✭ 217 (+1346.67%)
DanlpDaNLP is a repository for Natural Language Processing resources for the Danish Language.
Stars: ✭ 111 (+640%)
Transformers🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Stars: ✭ 55,742 (+371513.33%)
ppdbInterface for reading the Paraphrase Database (PPDB)
Stars: ✭ 22 (+46.67%)
ToiroA comparison tool of Japanese tokenizers
Stars: ✭ 95 (+533.33%)
Nuts自然语言处理常见任务(主要包括文本分类,序列标注,自动问答等)解决方案试验田
Stars: ✭ 21 (+40%)
SimstringA Python implementation of the SimString, a simple and efficient algorithm for approximate string matching.
Stars: ✭ 79 (+426.67%)
schrutepyThe Entire Transcript from the Office in Tidy Format
Stars: ✭ 22 (+46.67%)
Node OpennlpApache OpenNLP wrapper for Nodejs
Stars: ✭ 55 (+266.67%)
TextFeatureSelectionPython library for feature selection for text features. It has filter method, genetic algorithm and TextFeatureSelectionEnsemble for improving text classification models. Helps improve your machine learning models
Stars: ✭ 42 (+180%)
spaczzFuzzy matching and more functionality for spaCy.
Stars: ✭ 215 (+1333.33%)
NatasPython 3 library for processing historical English
Stars: ✭ 28 (+86.67%)
Giveme5WExtraction of the five journalistic W-questions (5W) from news articles
Stars: ✭ 16 (+6.67%)
UndertheseaUnderthesea - Vietnamese NLP Toolkit
Stars: ✭ 823 (+5386.67%)
Multi Task Nlpmulti_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.
Stars: ✭ 221 (+1373.33%)
JanomeJapanese morphological analysis engine written in pure Python
Stars: ✭ 630 (+4100%)
mlconjug3A Python library to conjugate verbs in French, English, Spanish, Italian, Portuguese and Romanian (more soon) using Machine Learning techniques.
Stars: ✭ 47 (+213.33%)
KagomeSelf-contained Japanese Morphological Analyzer written in pure Go
Stars: ✭ 554 (+3593.33%)
SudachipyPython version of Sudachi, a Japanese tokenizer.
Stars: ✭ 207 (+1280%)
Spacy💫 Industrial-strength Natural Language Processing (NLP) in Python
Stars: ✭ 21,978 (+146420%)
simple NERsimple rule based named entity recognition
Stars: ✭ 29 (+93.33%)
PynlplPyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
Stars: ✭ 426 (+2740%)
Contextualized Topic ModelsA python package to run contextualized topic modeling. CTMs combine BERT with topic models to get coherent topics. Also supports multilingual tasks. Cross-lingual Zero-shot model published at EACL 2021.
Stars: ✭ 318 (+2020%)
wefeWEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!
Stars: ✭ 164 (+993.33%)
FastnlpfastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
Stars: ✭ 2,441 (+16173.33%)
classyclassy is a simple-to-use library for building high-performance Machine Learning models in NLP.
Stars: ✭ 61 (+306.67%)
NLP ToolkitLibrary of state-of-the-art models (PyTorch) for NLP tasks
Stars: ✭ 92 (+513.33%)
minieAn open information extraction system that provides compact extractions
Stars: ✭ 83 (+453.33%)
Awesome Pytorch ListA comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
Stars: ✭ 12,475 (+83066.67%)