361 Open source projects that are alternatives of or similar to Bigbird

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

[Preprint] "TransGAN: Two Transformers Can Make One Strong GAN", Yifan Jiang, Shiyu Chang, Zhangyang Wang

使用基于Transformer的预训练模型在ACE2005数据集上进行事件抽取任务

Official and maintained implementation of the paper Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [BIBM 2020].

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Typescript Transform Macros

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BERT.

CV backbones including GhostNet, TinyNet and TNT, developed by Huawei Noah's Ark Lab.

Trax — Deep Learning with Clear Code and Speed

Transformers without Tears: Improving the Normalization of Self-Attention

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

Production First and Production Ready End-to-End Speech Recognition Toolkit

Implementation of the convolutional module from the Conformer paper, for use in Transformers

Import SVG files in your React Native project the same way that you would in a Web application.

Natural Language Processing Tutorial for Deep Learning Researchers

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

A collection of view pager transformers

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Unofficial PyTorch implementation of 2D Attentional Irregular Scene Text Recognizer

LightSeq: A High Performance Inference Library for Sequence Processing and Generation

A pytorch based end2end speech recognition system.

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

集成了Tensorflow 2版本的端到端语音识别模型，并且RTF(实时率)在0.1左右/Mandarin State-of-the-art Automatic Speech Recognition in Tensorflow 2

A wrapper around tensor2tensor to flexibly train, interact, and generate data for neural chatbots.

Kaggle新赛(baseline)-基于BERT的fine-tuning方案+基于tensor2tensor的Transformer Encoder方案

Code for the paper "Jukebox: A Generative Model for Music"

Datasets I have created for scientific summarization, and a trained BertSum model

Minimalist NMT for educational purposes

PyTorch Implementation of OpenAI GPT-2

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

End-to-end ASR/LM implementation with PyTorch

Viewpager动画,包括渐变,旋转,缩放,3D,立方体等多种酷炫效果动画,实现原理是自定义ViewpagerTransformer,当然你也可以自定义多种动画

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers

GraphQL implementation with power of Laravel

BERT for Multitask Learning

NLP research：基于tensorflow的nlp深度学习项目，支持文本分类/句子匹配/序列标注/文本生成 四大任务

Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).

Abstractive summarisation using Bert as encoder and Transformer Decoder

[AKBC 19] Improving Relation Extraction by Pre-trained Language Representations

PageTransformer for flutter

TypeScript transformer for improving the debugging experience of styled-components

Code for the paper "KISS: Keeping it Simple for Scene Text Recognition"

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

Transformer implementation in PyTorch.

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the paper "Analyzing Source and Target Contributions to NMT Predictions".

An Implementation of 'Attention is all you need' with Chinese Corpus

Build and train state-of-the-art natural language processing models using BERT

Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

Transformer-XL for Jazz music composition. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Music through Quantitative Measures", ISMIR 2020