196 Open source projects that are alternatives of or similar to lightning-transformers

PyTorch Lightning + Hydra. A very user-friendly template for rapid and reproducible ML experimentation with best practices. ⚡🔥⚡

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

neural network based speaker embedder

Modular and extensible speech recognition library leveraging pytorch-lightning and hydra.

My repo for training neural nets using pytorch-lightning and hydra

classy is a simple-to-use library for building high-performance Machine Learning models in NLP.

A Framework for Textual Entailment based Zero Shot text classification

A Python multilingual toolkit for Sentiment Analysis and Social NLP tasks

Use custom tokenizers in spacy-transformers

Implement Question Generator with SOTA pre-trained Language Models (RoBERTa, BERT, GPT, BART, T5, etc.)

Hydra Hot Potato Player (game)

An easy/swift-to-adapt PyTorch-Lighting template. 套壳模板，简单易用，稍改原来Pytorch代码，即可适配Lightning。You can translate your previous Pytorch code much easier using this template, and keep your freedom to edit all the functions as well. Big-project-friendly as well.

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transformers.

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

Code snippets and solutions for the Introduction to Deep Learning and Neural Networks Course hosted in educative.io

DOES NOT WORK WITH VERSIONS > 0.10.0 - A simple library to help you build node-based identity providers that work with Hydra.

Implementation of DeepMind's Deep Generative Model of Radar (DGMR) https://arxiv.org/abs/2104.00954

Easy text classification for everyone : Bert based models via Huggingface transformers (KR / EN)

A collection of Danish Transformers

Weakly Supervised End-to-End Learning (NeurIPS 2021)

Code for Editing Factual Knowledge in Language Models

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.

Using Transformers from HuggingFace in R

🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱

Brain extraction in presence of abnormalities, using single and multiple MRI modalities

PyTorch implementation of a collections of scalable Video Transformer Benchmarks.

🤗 A list of wonderful open-source projects & applications integrated with Hugging Face libraries.

RDF vocabulary and specification

X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification

This repository contains demos I made with the Transformers library by HuggingFace.

Hyku: A multi-tenant Hyrax application built on the latest and greatest Samvera community components. Brought to you by the Hydra-in-a-Box project partners and IMLS; maintained by the Hyku Interest Group.

Making BERT stretchy. Semantic Elasticsearch with Sentence Transformers

Presentations at the Tokyo Nixos Meetup

DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS) data.

This repository contains code for the O'Reilly Live Online Training for BERT

The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.

An NLP system for generating reading comprehension questions

A collection of functions for Hydra

Extensive tutorials for the Advanced NLP Workshop in Open Data Science Conference Europe 2020. We will leverage machine learning, deep learning and deep transfer learning to learn and solve popular tasks using NLP including NER, Classification, Recommendation \ Information Retrieval, Summarization, Classification, Language Translation, Q&A and T…

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2022/Spring 2022

Hydra-enabled GPU path tracer that supports MaterialX and MDL.

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022

CLIP (Contrastive Language–Image Pre-training) for Italian

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

A service aware router for Hydra Services. Implements an API Gateway and can route web socket messages.

Clean minimal implementation of Free-Form Image Inpainting with Gated Convolutions in pytorch lightning. Inspired from pytorch implementation by @avalonstrel.

Transformer/Transformer-XL/R-Transformer examples and explanations

Abstractive and Extractive Text summarization using Transformers.

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

PyTorch Implementation of SOTA SSL methods

Unofficial JAX implementations of deep learning research papers

Transformer based translation quality estimation

This repository focuses on training semantic segmentation models to predict the presence of floodwater for disaster prevention. Models were trained using SageMaker and Colab.

CINO: Pre-trained Language Models for Chinese Minority (少数民族语言预训练模型)

Unofficial PyTorch Implementation for HifiFace (https://arxiv.org/abs/2106.09965)

A deep learning model to age faces in the wild, currently runs at 60+ fps on GPUs

Bottleneck Transformers for Visual Recognition

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch