41 Open source projects that are alternatives of or similar to Multi-Modal-Transformer

A collection of SOTA Image Classification Models in PyTorch

PyTorch code of my ICDAR 2021 paper Vision Transformer for Fast and Efficient Scene Text Recognition (ViTSTR)

Official Pytorch Implementation for "Splicing ViT Features for Semantic Appearance Transfer" presenting "Splice" (CVPR 2022)

[NeurIPS 2021] Global Filter Networks for Image Classification

Code for Video Deepfake Detection model from "Combining EfficientNet and Vision Transformers for Video Deepfake Detection" available on Arxiv and was submitted to ICIAP 2021.

MPViT:Multi-Path Vision Transformer for Dense Prediction in CVPR 2022

PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，BEiT，MAE等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法

KoCLIP: Korean port of OpenAI CLIP, in Flax

pix2tex: Using a ViT to convert images of equations into LaTeX code.

a collection of visualization function

Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | PyTorch | CNNs | Causality | Reasoning | LSTMs | Transformers | Multi-Head Self Attention | Published in IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)

InterpretDL: Interpretation of Deep Learning Models，基于『飞桨』的模型可解释性算法库。

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

[CVPR2020] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

You Only Look at One Sequence (NeurIPS 2021)

TransMorph: Transformer for Unsupervised Medical Image Registration (PyTorch)

Vision Transformer for 3D medical image registration (Pytorch).

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

Tensorflow implementation of ICLR2019 paper "Exemplar Guided Unsupervised Image-to-Image Translation with Semantic Consistency"

This repository contains demos I made with the Transformers library by HuggingFace.

(TPAMI2022) Salient Object Detection via Integrity Learning.

Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer

SOTA Semantic Segmentation Models in PyTorch

Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation

Multi-modal Thermal Object Detector

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper

[CVPR2022] Official Implementation of ReferFormer

A PyTorch implementation of "MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer".

Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).

Demonstrates the use of interactive render template directives through multi modal screen design.

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

The Tensorflow, Keras implementation of Swin-Transformer and Swin-UNET

Implementation of Conv-based and Vit-based networks designed for CIFAR.

[MICCAI2022] This is an official PyTorch implementation for A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Open Source Routing Engine for OpenStreetMap

CV backbones including GhostNet, TinyNet and TNT, developed by Huawei Noah's Ark Lab.

SwinIR: Image Restoration Using Swin Transformer (official repository)