hscspring / All4nlp
Licence: mit
All For NLP, especially Chinese.
Stars: ✭ 141
Projects that are alternatives of or similar to All4nlp
Tensorwatch
Debugging, monitoring and visualization for Python Machine Learning and Data Science
Stars: ✭ 3,191 (+2163.12%)
Mutual labels: ai, jupyter-notebook, deeplearning, machinelearning
Text summurization abstractive methods
Multiple implementations for abstractive text summurization , using google colab
Stars: ✭ 359 (+154.61%)
Mutual labels: ai, jupyter-notebook, deeplearning, machinelearning
Learnopencv
Learn OpenCV : C++ and Python Examples
Stars: ✭ 15,385 (+10811.35%)
Mutual labels: ai, jupyter-notebook, deeplearning
Netron
Visualizer for neural network, deep learning, and machine learning models
Stars: ✭ 17,193 (+12093.62%)
Mutual labels: ai, deeplearning, machinelearning
Deep Learning In Production
Develop production ready deep learning code, deploy it and scale it
Stars: ✭ 216 (+53.19%)
Mutual labels: ai, jupyter-notebook, deeplearning
Clearml Server
ClearML - Auto-Magical Suite of tools to streamline your ML workflow. Experiment Manager, ML-Ops and Data-Management
Stars: ✭ 186 (+31.91%)
Mutual labels: ai, deeplearning, machinelearning
Clearml
ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
Stars: ✭ 2,868 (+1934.04%)
Mutual labels: ai, deeplearning, machinelearning
Ai Series
📚 [.md & .ipynb] Series of Artificial Intelligence & Deep Learning, including Mathematics Fundamentals, Python Practices, NLP Application, etc. 💫 人工智能与深度学习实战，数理统计篇 | 机器学习篇 | 深度学习篇 | 自然语言处理篇 | 工具实践 Scikit & Tensoflow & PyTorch 篇 | 行业应用 & 课程笔记
Stars: ✭ 702 (+397.87%)
Mutual labels: jupyter-notebook, deeplearning, machinelearning
Deeplearningmugenknock
でぃーぷらーにんぐを無限にやってディープラーニングでDeepLearningするための実装CheatSheet
Stars: ✭ 684 (+385.11%)
Mutual labels: jupyter-notebook, deeplearning, machinelearning
Deeplearning
深度学习入门教程, 优秀文章, Deep Learning Tutorial
Stars: ✭ 6,783 (+4710.64%)
Mutual labels: jupyter-notebook, deeplearning, machinelearning
Fixy
Amacımız Türkçe NLP literatüründeki birçok farklı sorunu bir arada çözebilen, eşsiz yaklaşımlar öne süren ve literatürdeki çalışmaların eksiklerini gideren open source bir yazım destekleyicisi/denetleyicisi oluşturmak. Kullanıcıların yazdıkları metinlerdeki yazım yanlışlarını derin öğrenme yaklaşımıyla çözüp aynı zamanda metinlerde anlamsal analizi de gerçekleştirerek bu bağlamda ortaya çıkan yanlışları da fark edip düzeltebilmek.
Stars: ✭ 165 (+17.02%)
Mutual labels: ai, jupyter-notebook, deeplearning
Algorithmmap
建立你的算法地图：如何高效学习算法；算法工程师：从小白到专家
Stars: ✭ 47 (-66.67%)
Mutual labels: jupyter-notebook, deeplearning, machinelearning
Best ai paper 2020
A curated list of the latest breakthroughs in AI by release date with a clear video explanation, link to a more in-depth article, and code
Stars: ✭ 2,140 (+1417.73%)
Mutual labels: ai, deeplearning, machinelearning
Atari Model Zoo
A binary release of trained deep reinforcement learning models trained in the Atari machine learning benchmark, and a software release that enables easy visualization and analysis of models, and comparison across training algorithms.
Stars: ✭ 198 (+40.43%)
Mutual labels: ai, jupyter-notebook, machinelearning
Deep Learning With Tensorflow Book
深度学习入门开源书，基于TensorFlow 2.0案例实战。Open source Deep Learning book, based on TensorFlow 2.0 framework.
Stars: ✭ 12,105 (+8485.11%)
Mutual labels: jupyter-notebook, deeplearning, machinelearning
Monk v1
Monk is a low code Deep Learning tool and a unified wrapper for Computer Vision.
Stars: ✭ 480 (+240.43%)
Mutual labels: jupyter-notebook, deeplearning, machinelearning
Basic reinforcement learning
An introductory series to Reinforcement Learning (RL) with comprehensive step-by-step tutorials.
Stars: ✭ 826 (+485.82%)
Mutual labels: ai, jupyter-notebook, deeplearning
Objectron
Objectron is a dataset of short, object-centric video clips. In addition, the videos also contain AR session metadata including camera poses, sparse point-clouds and planes. In each video, the camera moves around and above the object and captures it from different views. Each object is annotated with a 3D bounding box. The 3D bounding box describes the object’s position, orientation, and dimensions. The dataset contains about 15K annotated video clips and 4M annotated images in the following categories: bikes, books, bottles, cameras, cereal boxes, chairs, cups, laptops, and shoes
Stars: ✭ 1,352 (+858.87%)
Mutual labels: ai, jupyter-notebook
Ngsim env
Learning human driver models from NGSIM data with imitation learning.
Stars: ✭ 96 (-31.91%)
Mutual labels: jupyter-notebook, deeplearning
All4NLP
Framework & Toolkit
-
facebookresearch/pytext: A natural language modeling framework based on PyTorch
- deeplearning NLP with PyTorch
- Text classifiers, Sequence taggers, Joint intent-slot model and Contextual intent-slot models
- C++ server example
-
zalandoresearch/flair: A very simple framework for state-of-the-art Natural Language Processing (NLP)
- NER, POS, sense disambiguation and classification
- on top of PyTorch
-
pytorch/fairseq: Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
- Seq2Seq modeling
- on top of PyTorch
-
BrikerMan/Kashgari: Kashgari is a Production-ready NLP Transfer learning framework for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
- Text labeling, classification, Pre-trained
- on top of Tensorflow
-
asyml/texar: Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow
- NLP Toolkit
- on top of Tensorflow
-
stanfordnlp/stanza: Official Stanford NLP Python Library for Many Human Languages
- on top of Pytorch
- speed, prodcution system use
-
nltk/nltk: NLTK Source
- education and research tool
- learning and exploring NLP concepts
-
sloria/TextBlob: Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
- on top of NLTK
- fast-prtotyping
- applications don't require highly performance
-
spaCy · Industrial-strength Natural Language Processing in Python
- fast
- streamlined
- production-ready
- chartbeat-labs/textacy: NLP, before and after spaCy
Tokenizer
- OpenNMT/Tokenizer: Fast and customizable text tokenization library with BPE and SentencePiece support
- google/sentencepiece: Unsupervised text tokenizer for Neural Network-based text generation.
- huggingface/tokenizers: 💥Fast State-of-the-Art Tokenizers optimized for Research and Production
Seq2Seq
- OpenNMT - Open-Source Neural Machine Translation
- google-research/text-to-text-transfer-transformer: Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
- tensorflow/tensor2tensor: Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
Text First
- pytorch/text: Data loaders and abstractions for text and NLP
- tensorflow/text: Making text a first-class citizen in TensorFlow.
- textpipe/textpipe: Textpipe: clean and extract metadata from text
Task & Model
Language Model
-
2020 Chinese-BertCLUEbenchmark/CLUEPretrainedModels -
2019 GPT2+ChineseMorizeyao/GPT2-Chinese: Chinese version of GPT2 training code, using BERT tokenizer. -
2019 Bert-wwmymcui/Chinese-BERT-wwm: Pre-Training with Whole Word Masking for Chinese BERT（中文 BERT-wwm 系列模型） -
2019 Toolkithuggingface/pytorch-transformers: 👾 A library of state-of-the-art pretrained models for Natural Language Processing (NLP) -
2019 MASKgoogle-research/bert: TensorFlow code and pre-trained models for BERT -
2019 Permutationzihangdai/xlnet: XLNet: Generalized Autoregressive Pretraining for Language Understanding -
2019 MultiTaskPaddlePaddle/ERNIE: An Implementation of ERNIE For Language Understanding -
2019 Attentionkimiyoung/transformer-xl -
2019 LMopenai/gpt-2: Code for the paper "Language Models are Unsupervised Multitask Learners" -
2018 TwoLMsELMo: Deep contextualized word representations -
2018 Co-occurrencestanfordnlp/GloVe: GloVe model for distributed word representation -
2019facebookresearch/fastText: Library for fast text representation and classification. -
2019 Word2vecEmbedding/Chinese-Word-Vectors: 100+ Chinese Word Vectors 上百种预训练中文词向量 -
2018Word2vec Chinese-Word-Vectors -
2018 LSTM递归神经网络 | TensorFlow -
2013Google Code Archive - Long-term storage for Google Code Project Hosting.
Text Generation
-
2020 ToolkitRUCAIBox/TextBox: TextBox is an open-source library for building text generation system. -
2020 Awesometokenmill/awesome-nlg: A curated list of resources dedicated to Natural Language Generation (NLG) -
2018 BenchMarkgeek-ai/Texygen: A text generation benchmarking platform -
2018 RNNdocs/text_generation.ipynb at master · tensorflow/docs -
2019 Tookit on top of TFasyml/texar: Toolkit for Text Generation and Beyond
Classification
-
Collectionbrightmart/text_classification: all kinds of text classification models and more with deep learning
NLU & IE
-
2019 FrameworkRasaHQ/rasa_nlu: 💬 Open source library for natural language understanding and machine learning-based dialogue management. - All things around intent classification, entity extraction and action predictions - DIY NLP and chatbot framwork. -
2018 Chicrownpku/Rasa_NLU_Chi: Turn Chinese natural language into structured data 中文自然语言理解 -
2019 Toolkitsnipsco/snips-nlu: Snips Python library to extract meaning from text
QA
-
2020 ToolkitRUCAIBox/CRSLab: CRSLab is an open-source toolkit for building Conversational Recommender System (CRS). -
20185hirish/adam_qas: ADAM - A Question Answering System. Inspired from IBM Watson
Similarity
-
2019 SentenceUKPLab/sentence-transformers: Sentence Embeddings with BERT & XLNet -
2019 Sentencehanxiao/bert-as-service: Mapping a variable-length sentence to a fixed-length vector using BERT model -
2018 Sentenceexplosion/sense2vec: 🦆 Use NLP to go beyond vanilla word2vec -
2019 Sentencegensim: models.doc2vec – Doc2vec paragraph embeddings -
2014 Sentenceklb3713/sentence2vec: Tools for mapping a sentence with arbitrary length to vector space -
2019 Doc+Sentence+Wordgensim: Topic modelling for humans -
2019 MinHashekzhu/datasketch: MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++ -
2019 LevenshteinDistanceztane/python-Levenshtein: The Levenshtein Python C extension module contains functions for fast computation of Levenshtein distance and string similarity -
2018 Graphcaesar0301/graphsim: Graph similarity algorithms based on NetworkX.
Pinyin
-
2019 Pinyinmozillazg/python-pinyin: 汉字转拼音 (pypinyin)
Visualization
-
2020 Explainjalammar/ecco: Visualize and explore NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2). -
2019 WordJasonKessler/scattertext: Beautiful visualizations of how language differs among document types. -
2019 Bert GPTjessevig/bertviz: Tool for visualizing attention in the Transformer model (BERT and OpenAI GPT-2) -
2019 MLCmarcotcr/lime: Lime: Explaining the predictions of any machine learning classifier -
2019 Graph Visualization Frameworkantvis/G6: ♾ A Graph Visualization Framework in JavaScript -
2017 Neo4j D3eisman/neo4jd3: Neo4j graph visualization using D3.js -
2019 Neo4j browserneo4j-contrib/neovis.js: Neo4j + vis.js = neovis.js. Graph visualizations in the browser with data from Neo4j. -
2019 Neo4j 3Djexp/neo4j-3d-force-graph: Experiments with Neo4j & 3d-force-graph https://github.com/vasturiano/3d-force-graph -
2019 Interactive Graphvizzmagjac/graphviz-visual-editor: A web application for interactive visual editing of Graphviz graphs described in the DOT language. -
2019 graphviz Pythonmapio/GraphvizAnim: A tool to create animated graph visualizations, based on graphviz.
Readability
-
2019 Kinds of indexesshivam5992/textstat: python package to calculate readability statistics of a text object - paragraphs, sentences, articles. -
2019 in Spacymholtzscher/spacy_readability: spaCy pipeline component for adding text readability meta data to Doc objects.
Translation
-
2019 XLMfacebookresearch/XLM: PyTorch original implementation of Cross-lingual Language Model Pretraining. -
2018 Microsoft Based on PhraseMicrosoft/NPMT: Towards Neural Phrase-based Machine Translation -
2019 Google Based on Seq2Seq and Attentiontensorflow/nmt: TensorFlow Neural Machine Translation Tutorial -
2019 Google Based on Pure Attentionmodels/official/transformer at master · tensorflow/models -
2019 Facebook Based on CNNpytorch/fairseq: Facebook AI Research Sequence-to-Sequence Toolkit written in Python. -
2019 Facebook Based on Unsupervisedfacebookresearch/UnsupervisedMT: Phrase-Based & Neural Unsupervised Machine Translation -
2019 DeepL Basedon CNN (Not Open Source)DeepL Translator DeepL 基于 CNN 的翻译工具 -
2019 OpenNMTOpenNMT/OpenNMT: Open Source Neural Machine Translation
Style Transfer
Tricks
Dataset
- datasets
- 中文任务基准测评
- 中文预训练语料
- cluebenchmarks.com/dataSet_search.html
- 离线百度百科下载（2012 图文版）
- 百度百科 2012 图文版
- 最全中华古诗词数据库
- Kinds of Resources
- 中文历时语料库
- 中文自然语言处理数据集。
Learn Here
- google/trax: Trax — your path to advanced deep learning
- tensorflow/models
- Transformers
- OpenNMT/OpenNMT-py
- OpenNMT/OpenNMT-tf
- microsoft/nlp-recipes: Natural Language Processing Best Practices & Examples
Leading Track
- Google Research
- Facebook Research
- microsoft/unilm: UniLM - Unified Language Model Pre-training / Pre-training for NLP and Beyond
Research
Experts
- Michael Collins, Michael Collins - Google Scholar Citations ☆
- Jason Eisner - Home Page (JHU), Jason Eisner - Google Scholar Citations ☆
- David Yarowsky, David Yarowsky - Google Scholar Citations
- Dan Jurafsky - Home Page, Dan Jurafsky - Google Scholar Citations ☆
- Christopher Manning, Stanford NLP, Christopher D Manning - Google Scholar Citations ☆
- Dan Klein's Home Page, The Berkeley NLP Group ☆
- Dan Roth - Main Page, Dan Roth - Google Scholar Citations ☆
- ChengXiang Zhai - Home Page, ChengXiang Zhai - Google Scholar Citations
- Eugene Charniak's Home Page, Eugene Charniak - Google Scholar Citations
- Joakim Nivre's Home Page, Joakim Nivre - Google Scholar Citations ☆
- Philipp Koehn, Philipp Koehn - Google Scholar Citations
- James H. Martin, James H. Martin - Google Scholar Citations
- Julia Hirschberg, Julia Hirschberg - Google Scholar Citations
- Fernando Pereira – Google AI, Fernando Pereira - Google Scholar Citations ☆
- ryan mcdonald, Ryan McDonald - Google Scholar Citations
- Slav Petrov - Слав Петров, Slav Petrov - Google Scholar Citations ☆
- Kenneth Church HomePage, Kenneth Ward Church - Google Scholar Citations
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].