All Categories → No Category → efficient-transformers

Top 4 efficient-transformers open source projects

[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

✭ 50

python shell pruning model-compression sparse-training vision-transformers efficient-transformers dynamic-sparsity token-slimming

Restormer

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

✭ 586

python matlab pytorch transformer high-resolution image-restoration image-deblurring motion-deblurring low-level-vision defocus-deblurring image-deraining efficient-transformers cvpr2022

SReT

Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"

✭ 51

python vit transformer-architecture efficient-neural-networks vision-transformer efficient-transformers

transformer-ls

Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).

✭ 201

python shell Dockerfile transformer vision-transformer long-sequence efficient-transformers

1-4 of 4 efficient-transformers projects