286 Open source projects that are alternatives of or similar to CodeT5

Official code of our work, Unified Pre-training for Program Understanding and Generation [NAACL 2021].

The implementation of DeBERTa

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Presenting Collection of Pretrained Models. Links to pretrained models in NLP and voice.

A minimal TF2 re-implementation of the OpenAI GPT training

Curated list of all NLP Resources

Jupyter notebooks for Chainer hands-on

An attempt at the implementation of GLOM, Geoffrey Hinton's paper for emergent part-whole hierarchies from data

Code Generation as a Dual Task of Code Summarization.

LSTM Language Model with Subword Units Input Representations

What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment [CVPR 2019]

A collection of tasks to probe the effectiveness of protein sequence representations in modeling aspects of protein design

ICML'2022: Black-Box Tuning for Language-Model-as-a-Service

Official adversarial mixup resynthesis repository

Proto-RL: Reinforcement Learning with Prototypical Representations

This repository contains the code implementation used in the paper Temporally Coherent Embeddings for Self-Supervised Video Representation Learning (TCE).

An open source implementation of CLIP.

This repo is the home of Romanian Transformers.

Next Word Prediction using n-gram Probabilistic Model with various Smoothing Techniques

machine learning

Official repository for the ShapeFormer Project

Official code for "Mean Shift for Self-Supervised Learning"

Must-read papers and resources related to causal inference and machine (deep) learning

Chinese Natural Language Correction via Language Model

This project presents a simple framework to retrieve images similar to a query image.

Pytorch implementation of a basic language model using Attention in LSTM network

A Repository for maintaining various human skeleton preprocessing steps in numpy and tensorflow along with tensorflow model to learn pose embeddings.

The reference implementation of FEATHER from the CIKM '20 paper "Characteristic Functions on Graphs: Birds of a Feather, from Statistical Descriptors to Parametric Models".

Tutorials for Machine Learning on Graphs

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

Automatic feature engineering using deep learning and Bayesian inference using TensorFlow.

Parametric UMAP embeddings for representation and semisupervised learning. From the paper "Parametric UMAP: learning embeddings with deep neural networks for representation and semi-supervised learning" (Sainburg, McInnes, Gentner, 2020).

Unsupervised Representation Learning for Singing Voice Separation

Awesome Graph Self-Supervised Learning

ExCon: Explanation-driven Supervised Contrastive Learning

A library for evaluating representations.

Useful resources for Mongolian NLP

An implementation of "Community Preserving Network Embedding" (AAAI 2017)

A GPT-J API to use with python3 to generate text, blogs, code, and more

Representation learning-based graph alignment based on implicit matrix factorization and structural embeddings

COLING'2020: CoLAKE: Contextualized Language and Knowledge Embedding

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

Implementation of Information Dropout

[ACL‘20] Highway Transformer: A Gated Transformer.

API for the GPT-J language model 🦜. Including a FastAPI backend and a streamlit frontend

A GPT, made only of MLPs, in Jax

Pytorch implementation of "A Simple Framework for Contrastive Learning of Visual Representations"

Dasher text entry in HTML, CSS, JavaScript, and SVG

Code for the ICLR 2021 paper "A Distributional Approach to Controlled Text Generation"

Build a Movie Reviews Sentiment Classifier with Google's BERT Language Model

SWIG Wrapper for the SRILM toolkit

Personalized Query Completion

📃Language Model based sentences scoring library

Implementation of experiments in paper "Learning from Rules Generalizing Labeled Exemplars" to appear in ICLR2020 (https://openreview.net/forum?id=SkeuexBtDr)

Meta-embeddings are a probabilistic generalization of embeddings in machine learning.

Poincaré Embedding

Code for paper "Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagery", Ren et al., CVPR'18