361 Open source projects that are alternatives of or similar to Bigbird

😎 A list of awesome TypeScript transformers, plugins, handbooks, etc

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

reference tensorflow code for named entity tagging

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Electra pre-trained model using Vietnamese corpus

Transformation functions generator for Protocol Buffers.

Large-scale pretraining for dialogue

BertQA - Attention on Steroids

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

This package extends the core file generators that are included with Laravel 5 or later.

Original implementation of the paper "SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discovery" by Shion Honda et al.

GPT-2 French demo | Démo française de GPT-2

Multi-turn dialogue baselines written in PyTorch

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

JSON API Transformer Bundle for Symfony 2 and Symfony 3

[ACL 19] Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction

A Jest transformer using esbuild

Presento - Transformer & Presenter Package for PHP

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Indonesian Language Models and its Usage

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

An Implementation of Transformer (Attention Is All You Need) in DyNet

A tool that can transform CommonJS to ESM

微信、bilibili大图、长图、gif、视频、自定义view的转场效果，The transition effect of wechat, bilibili large image, long image, GIF, video and custom view

EQTransformer, a python package for earthquake signal detection and phase picking using AI.

transformer for ASR-systerm (via tensorflow2.0)

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

使用基于Transformer的预训练模型在ACE2005数据集上进行事件抽取任务

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

Typescript Transform Macros

CV backbones including GhostNet, TinyNet and TNT, developed by Huawei Noah's Ark Lab.

Transformers without Tears: Improving the Normalization of Self-Attention

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

Implementation of the convolutional module from the Conformer paper, for use in Transformers

Natural Language Processing Tutorial for Deep Learning Researchers

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Unofficial PyTorch implementation of 2D Attentional Irregular Scene Text Recognizer

A pytorch based end2end speech recognition system.

集成了Tensorflow 2版本的端到端语音识别模型，并且RTF(实时率)在0.1左右/Mandarin State-of-the-art Automatic Speech Recognition in Tensorflow 2

Kaggle新赛(baseline)-基于BERT的fine-tuning方案+基于tensor2tensor的Transformer Encoder方案

Datasets I have created for scientific summarization, and a trained BertSum model

PyTorch Implementation of OpenAI GPT-2

[CVPR 2021, Oral] PREDATOR: Registration of 3D Point Clouds with Low Overlap.

Viewpager动画,包括渐变,旋转,缩放,3D,立方体等多种酷炫效果动画,实现原理是自定义ViewpagerTransformer,当然你也可以自定义多种动画

Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers

GraphQL implementation with power of Laravel

NLP research：基于tensorflow的nlp深度学习项目，支持文本分类/句子匹配/序列标注/文本生成 四大任务

[AKBC 19] Improving Relation Extraction by Pre-trained Language Representations

Code for the paper "KISS: Keeping it Simple for Scene Text Recognition"

FormBuilder + class-transformer + class-validator = dynamic form group builder for Angular10+

Transformer implementation in PyTorch.

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the paper "Analyzing Source and Target Contributions to NMT Predictions".

An Implementation of 'Attention is all you need' with Chinese Corpus

Build and train state-of-the-art natural language processing models using BERT

Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)