352 Open source projects that are alternatives of or similar to uniformer-pytorch

Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

Various implementations and projects on CNN, RNN, LSTM, GAN, etc

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Reformer, the efficient Transformer, in Pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Library - Vanilla, ViT, DeiT, BERT, GPT

Chainer implementation of Deepmind's Visual Attention Model paper

KoBERT on 🤗 Huggingface Transformers 🤗 (with Bug Fixed)

TianChi AIEarth Contest Solution

Action recognition with C3D network implemented in tensorflow

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

A Comparison of LSTMs and Attention Mechanisms for Forecasting Financial Time Series

Attention-based bidirectional LSTM for Classification Task (ICASSP)

MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition

Must-read papers on Natural Language Processing (NLP)

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Using Transformers from HuggingFace in R

Transformer/Transformer-XL/R-Transformer examples and explanations

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

🧑‍🏫 50! Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

[ACM MM 2017 & IEEE TMM 2020] This is the Theano code for the paper "Video Description with Spatial Temporal Attention"

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

(TPAMI 2022) Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer

Transformer based translation quality estimation

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

organic chemistry reaction prediction using NMT with Attention

Neural Models for Key Phrase Detection and Question Generation

Video Recognition using Mixed Convolutional Tube (MiCT) on PyTorch with a ResNet backbone

Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。

My experimentation around action recognition in videos. Contains Keras implementation for C3D network based on original paper "Learning Spatiotemporal Features with 3D Convolutional Networks", Tran et al. and it includes video processing pipelines coded using mPyPl package. Model is being benchmarked on popular UCF101 dataset and achieves result…

A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction

Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

[ICLR2022] official implementation of UniFormer

[ICCV 2019 Oral] TA3N: https://github.com/cmhungsteve/TA3N (Most updated repo)

A Neural Network based Chatbot

CLIP (Contrastive Language–Image Pre-training) for Italian

Super easy library for BERT based NLP models

Asymmetric Multi-Task Attention Network for Prostate Bed Segmentation in CT Images

State of the Art Natural Language Processing

Attention Unet model with post process for retina optic disc segmention

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Sentiment Analysis with Deep Learning models. Implemented with Tensorflow and Keras.

Official PyTorch implementation of our IGARSS'22 paper: A Transformer-Based Siamese Network for Change Detection

This is our implementation of NARRE:Neural Attentional Regression with Review-level Explanations

Neural Relation Understanding: neural cardinality estimators for tabular data

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".

Code for the paper "STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecasting" (Neurocomputing, Elsevier)

KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델

Zero-Shot Text-to-Image Generation VQGAN+CLIP Dockerized

Hashformers is a framework for hashtag segmentation with transformers.

[AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"