361 Open source projects that are alternatives of or similar to Bigbird

Personalizing Dialogue Agents via Meta-Learning

LONG-TERM SERIES FORECASTING WITH QUERYSELECTOR – EFFICIENT MODEL OF SPARSEATTENTION

Transformers without Tears: Improving the Normalization of Self-Attention

Dense video captioning in PyTorch

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

a simple and complete pytorch implementation of neural machine translation system

A curated list of awesome resources combining Transformers with Neural Architecture Search

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf

Laravel5 JSONAPI and Dingo together to build APIs fast

[MICCAI2022] This is an official PyTorch implementation for A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation

CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)

PyTorch solution of named entity recognition task Using Google AI's pre-trained BERT model.

Summary of Transformer applications for computer vision tasks.

Repository for Project Insight: NLP as a Service

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

"SOLQ: Segmenting Objects by Learning Queries", SOLQ is an end-to-end instance segmentation framework with Transformer.

PostHTML is a tool to transform HTML/XML with JS plugins

Production First and Production Ready End-to-End Speech Recognition Toolkit

2018-JDDC大赛第4名的解决方案

A python library that makes AMR parsing, generation and visualization simple.

transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"

Implementation of the convolutional module from the Conformer paper, for use in Transformers

NLP Core Library and Model Zoo based on PaddlePaddle 2.0

Unofficial implementation of MaX-DeepLab for Instance Segmentation

[ECCV'2020] STTN: Learning Joint Spatial-Temporal Transformations for Video Inpainting

Import SVG files in your React Native project the same way that you would in a Web application.

Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

pytorch implementation of Attention is all you need

Natural Language Processing Tutorial for Deep Learning Researchers

A collaborative collection of open-source safe GPT-3 prompts that work well

PyTorch v1.2에서 생긴 Transformer API 를 이용한 간단한 Chitchat 챗봇

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition.

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

Sentiment analysis neural network trained by fine-tuning BERT, ALBERT, or DistilBERT on the Stanford Sentiment Treebank.

Tutel MoE: An Optimized Mixture-of-Experts Implementation

Understanding the Difficulty of Training Transformers

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

Julia Implementation of Transformer models

HAL+JSON & HAL+XML API transformer outputting valid (PSR-7) API Responses.

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

A collection of view pager transformers

Running BERT without Padding

End-to-end Temporal Action Detection with Transformer. [Under review for a journal publication]

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Embedding模型代码和学习笔记总结

Transformer implementation in PyTorch.

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the paper "Analyzing Source and Target Contributions to NMT Predictions".

An Implementation of 'Attention is all you need' with Chinese Corpus

Build and train state-of-the-art natural language processing models using BERT

Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

Transformer-XL for Jazz music composition. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Music through Quantitative Measures", ISMIR 2020

A scene text recognition toolbox based on PyTorch

텐서플로2와 머신러닝으로 시작하는 자연어처리 (로지스틱회귀부터 BERT와 GPT3까지) 실습자료