81 Open source projects that are alternatives of or similar to pytorch_Joint-Word-Segmentation-and-POS-Tagging

A Vietnamese natural language processing toolkit (NAACL 2018)

Juman++ (a Morphological Analyzer Toolkit)

Thai Word Segmentation and Part-of-Speech Tagging with Deep Learning

A Japanese tokenizer based on recurrent neural networks

Rakuten MA (Python version)

MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型

Pytorch-NLU，一个中文文本分类、序列标注工具包，支持中文长文本、短文本的多类、多标签分类任务，支持中文命名实体识别、词性标注、分词等序列标注任务。 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of speech ta…

Python port of SymSpell

Vietnamese Word Tokenize

BERT for Multitask Learning

High performance unsupervised text tokenization for Ruby

Unsupervised text tokenizer for Neural Network-based text generation.

R package for fitting joint models to time-to-event data and multivariate longitudinal data

Sanskrit compound segmentation using seq2seq model

CKIP CoreNLP Toolkits

Java port of SymSpell: 1 million times faster through Symmetric Delete spelling correction algorithm

Converts from Chinese characters to pinyin, between simplified and traditional, and does word segmentation.

基于Tensorflow的中文分词模型

paribhasha.herokuapp.com/

Fast SymSpell written in c++ and exposes to python via pybind11

Developer friendly Natural Language Processing ✨

Chinese Word Segmention Base on the Deep Learning and LSTM Neural Network

Cantonese Linguistics and NLP in Python

Syllable segmentation tool for Myanmar language (Burmese) by Ye.

Natural Language Toolkit for bahasa Malaysia, https://malaya.readthedocs.io/

R package for Byte Pair Encoding / Unigram modelling based on Sentencepiece

Kiwi(지능형 한국어 형태소 분석기)

Python version of Sudachi, a Japanese tokenizer.

Thai Natural Language Processing in Python.

Syntaxnet Parsey McParseface wrapper for POS tagging and dependency parsing

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

Repository for the Georgetown University Multilayer Corpus (GUM)

PyTorch implementation of ACL paper https://arxiv.org/abs/1906.02656

R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based on the UDPipe Natural Language Processing Toolkit

Hashformers is a framework for hashtag segmentation with transformers.

A collection of NLP tools for Sinhalese (සිංහල).

Source code for an ACL2016 paper of Chinese word segmentation

data resource untuk NLP bahasa indonesia

Sequence Labeling in Tensorflow

A toolkit for Vietnamese word segmentation

An unsupervised Chinese word segmentation tool.

Comparable documents miner: Arabic-English morphological analysis, text processing, n-gram features extraction, POS tagging, dictionary translation, documents alignment, corpus information, text classification, tf-idf computation, text similarity computation, html documents cleaning

A lexicon for Sudachi

百度NLP：分词，词性标注，命名实体识别，词重要性

A toolkit for pre-processing large source code corpora

Word Segmentation with Dynamic Programming

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF implement in pyotrch

SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

English Part-of-Speech Tagger Library; a Ruby port of Lingua::EN::Tagger

Official repository of FISR (AAAI 2020).

Vietnamese NLP Toolkit for Node

A comparison tool of Japanese tokenizers

Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)

[LREC 2022] An off-the-shelf pre-trained Tweet NLP Toolkit (NER, tokenization, lemmatization, POS tagging, dependency parsing) + Tweebank-NER dataset

基于隐式马尔可夫模型和正向最大化匹配的中文分词系统

Image Denoising Codes using STROLLR learning, the Matlab implementation of the paper in ICASSP2017

Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.

NLP Cheat Sheet, Python, spacy, LexNPL, NLTK, tokenization, stemming, sentence detection, named entity recognition

Spelling correction and string segmentation written in Go

Unsupervised text tokenizer focused on computational efficiency