756 Open source projects that are alternatives of or similar to Sentencepiece

Paper: A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging

Machine learning models to automatically summarise scientific papers

A curated list of awesome self-supervised methods

This repository contains landmark research papers in Natural Language Processing that came out in this century.

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.

Various Algorithms for Short Text Mining

Code for the ACL 2018 paper "Neural Document Summarization by Jointly Learning to Score and Select Sentences"

Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.

Stanford NLP group's shared Python tools.

Resources and tools for Indian language Natural Language Processing

Data augmentation for NLP

Translating English sentences to Marathi using Neural Machine Translation

LexPredict ContraxSuite

Repository for the paper "Automated Hate Speech Detection and the Problem of Offensive Language", ICWSM 2017

Sanskrit compound segmentation using seq2seq model

1st Place Solution for CrowdFlower Product Search Results Relevance Competition on Kaggle.

Statistics and accepted paper list of NLP conferences with arXiv link

Code for Sluice networks: Learning what to share between loosely related tasks

CKIP CoreNLP Toolkits

A Multi-Aspect Multi-Sentiment Dataset for aspect-based sentiment analysis.

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.

Free and open source A.I. system based on Python, TensorFlow and Prolog.

R package for Byte Pair Encoding / Unigram modelling based on Sentencepiece

An overview of the AI-as-a-service landscape

Huggingface Transformers + Adapters = ❤️

Unsupervised Data Augmentation (UDA)

Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning (authors' MXNet implementation for the TACL19 paper)

Deep Learning model to analyze a large corpus of clear text passwords.

RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.

NLP, before and after spaCy

A TensorFlow Implementation of Machine Translation In Neural Machine Translation in Linear Time

Character-based word embeddings model based on RNN for handling real world texts

Implementation of Dynamic memory networks by Kumar et al. http://arxiv.org/abs/1506.07285

RASA chatbot use case boilerplate

Thai Word Segmentation and Part-of-Speech Tagging with Deep Learning

PyTorch implementation of latent space reinforcement learning for E2E dialog published at NAACL 2019. It is released by Tiancheng Zhao (Tony) from Dialog Research Center, LTI, CMU

Minimalist NMT for educational purposes

An unsupervised Chinese word segmentation tool.

Machine Learning University: Accelerated Natural Language Processing Class

ADAM - A Question Answering System. Inspired from IBM Watson

A baseline implementation for FNC-1

深度学习面试宝典（含数学、机器学习、深度学习、计算机视觉、自然语言处理和SLAM等方向）

Machine reading comprehension on clinical case reports

Paper reading list in natural language processing, including dialogue systems and text generation related topics.

Calculating ROUGE score between two files (line-by-line)

Natural language processing pipeline for book-length documents

A two-level morphological analyzer for Turkish.

🏇 聊天机器人，自然语言理解，语义理解

Một cuốn sách tương tác về học sâu có mã nguồn, toán và thảo luận. Đề cập đến nhiều framework phổ biến (TensorFlow, Pytorch & MXNet) và được sử dụng tại 175 trường Đại học.

Named Entity Recognition

ROADMAP(Mind Map) and KEYWORD for students those who have interest in learning NLP

Interpretable data visualizations for understanding how texts differ at the word level

🏥 Medical Text Mining and Information Extraction with spaCy

Graph Convolution Network for NLP

Knowledge-Aware Graph Networks for Commonsense Reasoning (EMNLP-IJCNLP 19)

Python port of SymSpell

Open Source Neural Machine Translation in PyTorch