All Projects → rishikksh20 → FNet-pytorch

rishikksh20 / FNet-pytorch

Licence: MIT license
Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to FNet-pytorch

backprop
Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.
Stars: ✭ 229 (+12.25%)
Mutual labels:  text-classification, image-classification, language-model
Nlp Experiments In Pytorch
PyTorch repository for text categorization and NER experiments in Turkish and English.
Stars: ✭ 35 (-82.84%)
Mutual labels:  text-classification, text, transformer
Vaaku2Vec
Language Modeling and Text Classification in Malayalam Language using ULMFiT
Stars: ✭ 68 (-66.67%)
Mutual labels:  text-classification, language-model
TokenLabeling
Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"
Stars: ✭ 385 (+88.73%)
Mutual labels:  transformer, vision
Highway-Transformer
[ACL‘20] Highway Transformer: A Gated Transformer.
Stars: ✭ 26 (-87.25%)
Mutual labels:  transformer, language-model
Paddlenlp
NLP Core Library and Model Zoo based on PaddlePaddle 2.0
Stars: ✭ 212 (+3.92%)
Mutual labels:  text-classification, transformer
Catalyst
Accelerated deep learning R&D
Stars: ✭ 2,804 (+1274.51%)
Mutual labels:  text-classification, image-classification
cape
Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
Stars: ✭ 29 (-85.78%)
Mutual labels:  text, transformer
Kevinpro-NLP-demo
All NLP you Need Here. 个人实现了一些好玩的NLP demo,目前包含13个NLP应用的pytorch实现
Stars: ✭ 117 (-42.65%)
Mutual labels:  text-classification, transformer
deep-learning
Deep Learning Bootcamp
Stars: ✭ 60 (-70.59%)
Mutual labels:  text-classification, image-classification
Deep-NLP-Resources
Curated list of all NLP Resources
Stars: ✭ 65 (-68.14%)
Mutual labels:  text-classification, language-model
Lotclass
[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach
Stars: ✭ 160 (-21.57%)
Mutual labels:  text-classification, language-model
Onnxt5
Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Stars: ✭ 143 (-29.9%)
Mutual labels:  text-classification, transformer
nested-transformer
Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf
Stars: ✭ 174 (-14.71%)
Mutual labels:  transformer, vision
Nlp Pretrained Model
A collection of Natural language processing pre-trained models.
Stars: ✭ 122 (-40.2%)
Mutual labels:  text-classification, text
ML4K-AI-Extension
Use machine learning in AppInventor, with easy training using text, images, or numbers through the Machine Learning for Kids website.
Stars: ✭ 18 (-91.18%)
Mutual labels:  text-classification, image-classification
Bert language understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Stars: ✭ 933 (+357.35%)
Mutual labels:  text-classification, language-model
Keras Textclassification
中文长文本分类、短句子分类、多标签分类、两句子相似度(Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short),字词句向量嵌入层(embeddings)和网络层(graph)构建基类,FastText,TextCNN,CharCNN,TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN
Stars: ✭ 914 (+348.04%)
Mutual labels:  text-classification, transformer
text-classification-baseline
Pipeline for fast building text classification TF-IDF + LogReg baselines.
Stars: ✭ 55 (-73.04%)
Mutual labels:  text-classification, text
COVID-19-Tweet-Classification-using-Roberta-and-Bert-Simple-Transformers
Rank 1 / 216
Stars: ✭ 24 (-88.24%)
Mutual labels:  text-classification, transformer

FNet: Mixing Tokens with Fourier Transforms

Pytorch implementation of Fnet : Mixing Tokens with Fourier Transforms.

Citation:

@misc{leethorp2021fnet,
      title={FNet: Mixing Tokens with Fourier Transforms}, 
      author={James Lee-Thorp and Joshua Ainslie and Ilya Eckstein and Santiago Ontanon},
      year={2021},
      eprint={2105.03824},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].