1136 Open source projects that are alternatives of or similar to Tokenizers

Simple downloader for pre-trained word vectors

Useful resources for Mongolian NLP

TEXTOIR is a flexible toolkit for open intent detection and discovery. (ACL 2021)

Natural-language event parser for Javascript

text generation based on transformer

COLING'2020: CoLAKE: Contextualized Language and Knowledge Embedding

⏰ AI conference deadline countdowns

Chatbot with bert chinese model, base on rasa framework（中文聊天机器人，结合bert意图分析，基于rasa框架）

Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources

Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.

AutoGluon: AutoML for Text, Image, and Tabular Data

本NER项目包含多个中文数据集，模型采用BiLSTM+CRF、BERT+Softmax、BERT+Cascade、BERT+WOL等，最后用TFServing进行模型部署，线上推理和线下推理。

Alpine Linux Setup Scripts

Naver movie review sentiment classification with KoBERT

A curated list of beginner resources in Natural Language Processing

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Deploy transformers serverless on AWS Lambda

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

A Personal Arch Installation Guide In Case of Amnesia

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Chinese Natural Language Correction via Language Model

A CS degree with a focus on full-stack ML engineering, 2020

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

Transformer based Bangla Speech Recognition

Code for the ICLR 2021 paper "A Distributional Approach to Controlled Text Generation"

Graph Convolution over Pruned Dependency Trees Improves Relation Extraction (authors' PyTorch implementation)

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

Code accompanying EMNLP 2018 paper Language Modeling with Sparse Product of Sememe Experts

Official implementation of the paper “GECToR – Grammatical Error Correction: Tag, Not Rewrite” // Published on BEA15 Workshop (co-located with ACL 2020) https://www.aclweb.org/anthology/2020.bea-1.16.pdf

机器翻译子任务-翻译质量评价-在BERT模型后面加上Bi-LSTM进行fine-tuning

A simple implementation of paper "HCTI at SemEval-2017 Task 1: Use convolutional neural network to evaluate semantic textual similarity."

BioWordVec & BioSentVec: pre-trained embeddings for biomedical words and sentences

🤖💬 Rivebot Community Edition Platform (CEP) is an open source end-to-end software development platform with built-in chatbot management, customer ordering, customer care, and more. Self-host Rivebot CEP on your own servers, in a container, or on a cloud provider.

A question answering dataset for machine comprehension of spoken content

NLP in Python with Deep Learning

Recent Deep Learning papers in NLU and RL

Python script to download public Tweets from a given Twitter account into a format suitable for AI text generation

this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large

Mengzi Pretrained Models

Using machine learning on your anki collection to enhance the scheduling via semantic clustering and semantic similarity

Language Technology Platform

Implementation, trained models and result data for the paper "Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles"

中文 NLP 任务预处理工具包，准确、高效、零使用门槛

Evaluating Machines by their Real-World Language Use

bert sentiment analysis tensorflow serving with RESTful API

Data Augmentation for Neural Machine Translation

A paper list of research conducted based on wikiHow

A curated list of awesome projects and dev/design resources for supporting Arabic computational needs.

Code for the paper "Are Sixteen Heads Really Better than One?"

Presenting Collection of Pretrained Models. Links to pretrained models in NLP and voice.

A neural network architecture for NLP tasks, using cython for fast performance. Currently, it can perform POS tagging, SRL and dependency parsing.

Go to https://github.com/pytorch/tutorials - this repo is deprecated and no longer maintained

A curated awesome list of AI Startups in India & Machine Learning Interview Guide. Feel free to contribute!

Collection of useful data science topics along with code and articles

🏥 Medical Text Mining and Information Extraction with spaCy

Mining Discourse Markers for Unsupervised Sentence Representation Learning

Source code for transferable dialogue state generator (TRADE, Wu et al., 2019). https://arxiv.org/abs/1905.08743

First Prize in HackJaipur Hackathon 2020 for Best ElasticSearch-based Product! Website: http://coronaxiv2.surge.sh/#/

The code for our paper "NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task —— Next Sentence Prediction"

A curated list of recent models of text generation and application