756 Open source projects that are alternatives of or similar to Sentencepiece

A list of NLP(Natural Language Processing) tutorials

Cantonese Linguistics and NLP in Python

Open neural machine translation models and web services

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://nlproc.info

Unsupervised text tokenizer focused on computational efficiency

A comparison tool of Japanese tokenizers

《机器翻译：基础与模型》肖桐 朱靖波 著 - Machine Translation: Foundations and Models

A Vietnamese natural language processing toolkit (NAACL 2018)

Neural machine translation and sequence learning using TensorFlow

Thai Natural Language Processing in Python.

I try my best to keep updated cutting-edge knowledge in Machine Learning/Deep Learning and Natural Language Processing. These are my notes on some good papers

Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.

Sequence to sequence learning using TensorFlow.

Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources

⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.

An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more

3rd Place Solution for HomeDepot Product Search Results Relevance Competition on Kaggle.

Style and Grammar Checker for 25+ Languages

Simple XLNet implementation with Pytorch Wrapper

中文 NLP 任务预处理工具包，准确、高效、零使用门槛

Go to https://github.com/pytorch/tutorials - this repo is deprecated and no longer maintained

📖 Notes and summaries of some Machine Learning / Computer Vision / NLP papers.

Complete solutions for Stanford CS224n, winter, 2019

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

The codes of paper "Long Text Generation via Adversarial Training with Leaked Information" on AAAI 2018. Text generation using GAN and Hierarchical Reinforcement Learning.

A collection of notebooks for Natural Language Processing from NLP Town

❔ Visual Question Answering in Torch

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

Companion code for the book "Mastering Social Media Mining with Python"

A simplified PyTorch implementation of "SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient." (Yu, Lantao, et al.)

🎨 ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.

基于自然语言理解与机器学习的聊天机器人，支持多用户并发及自定义多轮对话

Quiz & Assignment of Coursera

Neural Machine Translation with Keras

Official Repository for 'Practical Natural Language Processing' by O'Reilly Media

📜 An up-to-date & curated list of awesome semi-supervised learning papers, methods & resources.

💫 Industrial-strength Natural Language Processing (NLP) in Python

A curated collection of iOS, ML, AR resources sprinkled with some UI additions

Open Korean Text Processor - An Open-source Korean Text Processor

Sequence-to-Sequence learning using PyTorch

Code For Medium Article: "How To Create Natural Language Semantic Search for Arbitrary Objects With Deep Learning"

Open source annotation tool for machine learning practitioners.

Various Algorithms for Short Text Mining

Repository for the paper "Automated Hate Speech Detection and the Problem of Offensive Language", ICWSM 2017

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.

RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.

🔡 Token level embeddings from BERT model on mxnet and gluonnlp

Minimalist NMT for educational purposes

Paper reading list in natural language processing, including dialogue systems and text generation related topics.

Open Machine Learning course at MIPT

📡 Organized Resources for Deep Learning in Natural Language Processing

Python port of SymSpell

This repositary is a combination of different resources lying scattered all over the internet. The reason for making such an repositary is to combine all the valuable resources in a sequential manner, so that it helps every beginners who are in a search of free and structured learning resource for Data Science. For Constant Updates Follow me in …

Examples and libraries for "Natural Language Processing in Action" book

JavaScript Web SDK for Dialogflow

Named Entity Recognition using multilayered bidirectional LSTM

My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014_cdssm_final.pdf.

An open source Ruby framework for text and voice chatbots. 🤖

An open platform for artificial intelligence, chat bots, virtual agents, social media automation, and live chat automation.

A curated awesome list of AI Startups in India & Machine Learning Interview Guide. Feel free to contribute!