869 Open source projects that are alternatives of or similar to Toiro

A Japanese tokenizer based on recurrent neural networks

Thai Natural Language Processing in Python.

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

💫 Industrial-strength Natural Language Processing (NLP) in Python

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

Underthesea - Vietnamese NLP Toolkit

Juman++ (a Morphological Analyzer Toolkit)

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

NLP: Convert Japanese Kana-kanji sentences into Kana-Roman in simple algorithm.

A simple NLP library allows profiling datasets with one or more text columns. When given a dataset and a column name containing text data, NLP Profiler will return either high-level insights or low-level/granular statistical information about the text in that column.

chatbot_ner: Named Entity Recognition for chatbots.

👄 The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

Self-contained Japanese Morphological Analyzer written in pure Go

Unsupervised text tokenizer for Neural Network-based text generation.

Unsupervised text tokenizer focused on computational efficiency

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

package lingo provides the data structures and algorithms required for natural language processing

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

Cantonese Linguistics and NLP in Python

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information

A Vietnamese natural language processing toolkit (NAACL 2018)

Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search

Code for PyCon JP 2019 talk "Python による日本語自然言語処理 〜系列ラベリングによる実世界テキスト分析〜"

[ECCV 2020] ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

Oxford Deep NLP 2017 course - Open practical

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Abydos NLP/IR library for Python

A Greek edition of BERT pre-trained language model

meProp: Sparsified Back Propagation for Accelerated Deep Learning (ICML 2017)

Continuation of the qolibri EPWING dictionary/book reader

Japanese translation of the W3C/WHATWG specification(s).

This is where I put all my work in Natural Language Processing

Source code for an ACL2016 paper of Chinese word segmentation

SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks

Let your talking do the code

Geotext extracts country and city mentions from text

Pytorch implementation of "Graph Convolutional Networks for Text Classification"

🤹‍♀️ Query spaCy's linguistic annotations using GraphQL

A simple markup language to write novel with types.

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP

A Python implementation of the SimString, a simple and efficient algorithm for approximate string matching.

Neural machine translation and sequence learning using TensorFlow

a web GUI for create japanese epub manga

Implementation of the multi feed-forward network architecture by Parikh et al. (2016) for Natural Language Inference.

Japanese text8 corpus for word embedding.

State-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc.

挙動や仕様が曖昧なユーザインタフェースチートシート

Oxford Deep NLP 2017 course - Practical 3: Text Classification with RNNs

🏄 依存关系分析，NLP，自然语言处理

😡😇 Stanford Sentiment Treebank loader in Python

🏖TagEditor - Annotation tool for spaCy

A PureScript, browser-based implementation of LDA topic modeling.

Mining individual characters in multiparty dialogue

Pre-Trained Chinese XLNet（中文XLNet预训练模型）

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

Ruby port of the NLTK Punkt sentence segmentation algorithm

A collection of 500+ survey papers on Natural Language Processing (NLP) and Machine Learning (ML)

This repository contains PyTorch implementation for the baseline models from the paper Utterance-level Dialogue Understanding: An Empirical Study