197 Open source projects that are alternatives of or similar to mlp-gpt-jax

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🏭 PDF text extraction pipeline: self-hosted, local-first, Docker-based

结合python一起学习自然语言处理 (nlp): 语言模型、HMM、PCFG、Word2vec、完形填空式阅读理解任务、朴素贝叶斯分类器、TFIDF、PCA、SVD

XLNet for generating language.

Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019

Implementation of a digit recognition using my Neural Network with the MNIST data set.

Optimus: the first large-scale pre-trained VAE language model

Character-aware Neural Language Model implemented by PyTorch

Official code of our work, Unified Pre-training for Program Understanding and Generation [NAACL 2021].

Language Modeling

A curated list of pretrained sentence and word embedding models

Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.

KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.

Computational Fluid Dynamics in JAX

a sklearn wrapper for Google's BERT model

RNN(LSTM, GRU) in Theano with mini-batch training; character-level language models in Theano

An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.

GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training

[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach

A toolkit for neural language modeling using Tensorflow including basic models like RNNs and LSTMs as well as more advanced models.

An opensource speech-to-text software written in tensorflow

JAX implementations of core Deep RL algorithms

Deep-Learning Model Exploration and Development for NLP

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

The Noise Contrastive Estimation for softmax output written in Pytorch

24-hour Automatic Speech Recognition

Lingvo

Unofficial JAX implementations of deep learning research papers

A collaborative collection of open-source safe GPT-3 prompts that work well

JAX code for the paper "Control-Oriented Model-Based Reinforcement Learning with Implicit Differentiation"

🎧 Automatic Speech Recognition: DeepSpeech & Seq2Seq (TensorFlow)

📃Language Model based sentences scoring library

bert as language model, fork from https://github.com/google-research/bert

Language Modeling and Text Classification in Malayalam Language using ULMFiT

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

Experiments for automated personality detection using Language Models and psycholinguistic features on various famous personality datasets including the Essays dataset (Big-Five)

Revisiting Pre-trained Models for Chinese Natural Language Processing (Findings of EMNLP)

A multilayer perceptron in JavaScript

BERT-based Multilingual Model for Indian Languages

Pytorch implementation of a basic language model using Attention in LSTM network

Library to scrape and clean web pages to create massive datasets.

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Implementation of XLNet that can load pretrained checkpoints

Context Aware Language Models

Transformer language model (GPT-2) with sentencepiece tokenizer

Graphsignal Python agent

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

LSTM and QRNN Language Model Toolkit for PyTorch

Kaldi-based Korean ASR (한국어 음성인식) open-source project

Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling

Companion code in JAX for the paper Parallel Iterated Extended and Sigma-Point Kalman Smoothers.

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Dasher text entry in HTML, CSS, JavaScript, and SVG

SWIG Wrapper for the SRILM toolkit

Revisiting Rainbow

ADAM implements a collection of algorithms for calculating rigid-body dynamics in Jax, CasADi, PyTorch, and Numpy.