756 Open source projects that are alternatives of or similar to Sentencepiece

Attention-based multimodal fusion for sentiment analysis

AI算法岗求职攻略（涵盖准备攻略、刷题指南、内推和AI公司清单等资料）

State of the Art Natural Language Processing

Official Repository for 'Practical Natural Language Processing' by O'Reilly Media

A privacy preserving NLP framework

A dataset of millions of news articles scraped from a curated list of data sources.

Vietnamese NLP Toolkit for Node

Distantly Supervised Relation Extraction

Collection of stats, modeling, and data science tools in Python and R.

Hashformers is a framework for hashtag segmentation with transformers.

Data and software for building the ACL Anthology.

📜 An up-to-date & curated list of awesome semi-supervised learning papers, methods & resources.

⚡️A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python

This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation" published in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), November 16 - November 20, 2020.

🐍 Turkish Language Stemmer for Python

NLP in Python with Deep Learning

A news recommendation system tailored for user communities

A simple yet strong implementation of neural machine translation in pytorch

Library to scrape and clean web pages to create massive datasets.

💫 Industrial-strength Natural Language Processing (NLP) in Python

Browse Covid-19 & SARS-CoV-2 Scientific Papers with Transformers 🦠 📖

Visualization for simple attention and Google's multi-head attention.

A Curated List of Dataset and Usable Library Resources for NLP in Bahasa Indonesia

A curated list of recent models of text generation and application

High performance unsupervised text tokenization for Ruby

Mishkal is an arabic text vocalization software

A curated collection of iOS, ML, AR resources sprinkled with some UI additions

Topic Modelling for Humans

Fast SymSpell written in c++ and exposes to python via pybind11

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

Facilitating the design, comparison and sharing of deep text matching models.

PyTorch code for Learning Cooperative Visual Dialog Agents using Deep Reinforcement Learning

How Does Selective Mechanism Improve Self-attention Networks?

Front-end speech processing aims at extracting proper features from short- term segments of a speech utterance, known as frames. It is a pre-requisite step toward any pattern recognition problem employing speech or audio (e.g., music). Here, we are interesting in voice disorder classification. That is, to develop two-class classifiers, which can discriminate between utterances of a subject suffering from say vocal fold paralysis and utterances of a healthy subject.The mathematical modeling of the speech production system in humans suggests that an all-pole system function is justified [1-3]. As a consequence, linear prediction coefficients (LPCs) constitute a first choice for modeling the magnitute of the short-term spectrum of speech. LPC-derived cepstral coefficients are guaranteed to discriminate between the system (e.g., vocal tract) contribution and that of the excitation. Taking into account the characteristics of the human ear, the mel-frequency cepstral coefficients (MFCCs) emerged as descriptive features of the speech spectral envelope. Similarly to MFCCs, the perceptual linear prediction coefficients (PLPs) could also be derived. The aforementioned sort of speaking tradi- tional features will be tested against agnostic-features extracted by convolu- tive neural networks (CNNs) (e.g., auto-encoders) [4]. The pattern recognition step will be based on Gaussian Mixture Model based classifiers,K-nearest neighbor classifiers, Bayes classifiers, as well as Deep Neural Networks. The Massachussets Eye and Ear Infirmary Dataset (MEEI-Dataset) [5] will be exploited. At the application level, a library for feature extraction and classification in Python will be developed. Credible publicly available resources will be 1used toward achieving our goal, such as KALDI. Comparisons will be made against [6-8].

Open Korean Text Processor - An Open-source Korean Text Processor

How to build RNNs and LSTMs from scratch with NumPy.

An implementation of attention-based neural machine translation using Pytorch

基于深度学习的自然语言处理库

👑 spaCy building blocks and visualizers for Streamlit apps

This repo contains my coursework, assignments, and Slides for Natural Language Processing Specialization by deeplearning.ai on Coursera

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

Examine two sentences and determine whether they have the same meaning.

Sequence-to-Sequence learning using PyTorch

A Library to parse natural language in pure Clojure and ClojureScript

Pytorch-NLU，一个中文文本分类、序列标注工具包，支持中文长文本、短文本的多类、多标签分类任务，支持中文命名实体识别、词性标注、分词等序列标注任务。 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of speech ta…

Chinese Biomedical Language Understanding Evaluation benchmark (ChineseBLUE)

Neural question generation using transformers

💙 Emoji handling and meta data for spaCy with custom extension attributes

A toolkit for pre-processing large source code corpora

A natural language date parser in Swift (ported from chrono.js)

Code For Medium Article: "How To Create Natural Language Semantic Search for Arbitrary Objects With Deep Learning"

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Một cuốn sách tương tác về học sâu có mã nguồn, toán và thảo luận. Đề cập đến nhiều framework phổ biến (TensorFlow, Pytorch & MXNet) và được sử dụng tại 175 trường Đại học.

Named Entity Recognition

ROADMAP(Mind Map) and KEYWORD for students those who have interest in learning NLP

Interpretable data visualizations for understanding how texts differ at the word level

🏥 Medical Text Mining and Information Extraction with spaCy

Graph Convolution Network for NLP

Knowledge-Aware Graph Networks for Commonsense Reasoning (EMNLP-IJCNLP 19)

Open Source Neural Machine Translation in PyTorch