1057 Open source projects that are alternatives of or similar to Tokenizer

Bidirectional LSTM-CRF and ELMo for Named-Entity Recognition, Part-of-Speech Tagging and so on.

Papers and Book to look at when starting NLP 📚

A collection of Natural language processing pre-trained models.

A comprehensive reading list for Emotion Recognition in Conversations

Preprocessing Library for Natural Language Processing

XLNet Extension in TensorFlow

Code examples in pyTorch and Tensorflow for CS230

Python wraper for MetaMap

A Python library for doing bibliometric and network analysis in science and health policy research

PyTorch implementation of latent space reinforcement learning for E2E dialog published at NAACL 2019. It is released by Tiancheng Zhao (Tony) from Dialog Research Center, LTI, CMU

My personal notes and surveys on DL, CV and NLP papers.

RAT-el is an open source penetration test tool that allows you to take control of a windows machine. It works on the client-server model, the server sends commands and the client executes the commands and sends the result back to the server. The client is completely undetectable by anti-virus software.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Persian (Farsi) Stop Words List

NLTK Source

NLPCC 2016 微博分词评测项目

Русскоязычный чатбот

搜索所有中文NLP数据集，附常用英文NLP数据集

List of Machine Learning, AI, NLP solutions for iOS. The most recent version of this article can be found on my blog.

Code for paper "Discourse-Aware Neural Extractive Text Summarization" (ACL20)

Fine-tuned pre-trained GPT2 for custom topic specific text generation. Such system can be used for Text Augmentation.

NLP, before and after spaCy

A fast, efficient universal vector embedding utility package.

Source code tokenizer

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://nlproc.info

R, Python and Mathematica Codes in Machine Learning, Deep Learning, Artificial Intelligence, NLP and Geolocation

Python implementation of TextRank for phrase extraction and summarization of text documents

A pythonic wrapper for Stanford CoreNLP.

Notebooks for the Seattle PyData 2017 talk on Scattertext

Collection of developer toolkits

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

Visualize different Unicode encodings in the terminal

[ACL 2020] Tensorflow implementation for "Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks"

Monospaced fonts patched with Chinese characters and extra glyphs from Nerd Fonts

Datasets, tools, and benchmarks for representation learning of code.

>>> This may become obsolete, read and comment >>>

Fully extendable eslint plugin for JSON i18n translation files.

😻 Markdown with easy tokenization, a fast highlighter, and a lean HTML sanitizer

My personal toolkit for PyTorch development.

Dynamic Coattention Network Plus (DCN+) TensorFlow implementation. Question answering using Deep NLP.

Spoken Language Understanding(SLU)/Slot Filling in Keras

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 300 universities from 55 countries including Stanford, MIT, Harvard, and Cambridge.

Make Highly Customized Boxes for your CLI

Automatic Entity Recognition and Typing for Domain-Specific Corpora (KDD'15)

📖 List of some awesome university courses for Machine Learning! Feel free to contribute!

Character-based word embeddings model based on RNN for handling real world texts

Parser Building Toolkit for JavaScript

A very simple framework for state-of-the-art Natural Language Processing (NLP)

Plot in the terminal using braille dots.

读过的CV方向的一些论文，图像生成文字、弱监督分割等

This repository contains code examples for the Stanford's course: TensorFlow for Deep Learning Research.

English-French Machine Language Translation in Tensorflow

使用 RASA NLU 来构建中文自然语言理解系统（NLU）| Use RASA NLU to build a Chinese Natural Language Understanding System (NLU)

Machine Learning University: Accelerated Natural Language Processing Class

Pretty cheat sheets, or ``reference cards'', obtainable from Org files.

Monospace Unicode character width in Ruby

NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

General Assembly's 2015 Data Science course in Washington, DC

Open Source REST API for named entity extraction, named entity linking, named entity disambiguation, recommendation & reconciliation of entities like persons, organizations and places for (semi)automatic semantic tagging & analysis of documents by linked data knowledge graph like SKOS thesaurus, RDF ontology, database(s) or list(s) of names