7147 Open source projects that are alternatives of or similar to Pytorch Original Transformer

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

Predict materials properties using only the composition information!

2018-JDDC大赛第4名的解决方案

a collection of visualization function

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

BertQA - Attention on Steroids

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Action recognition using soft attention based deep recurrent neural networks

End-to-end ASR/LM implementation with PyTorch

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

Natural Language Processing Tutorial for Deep Learning Researchers

list of efficient attention modules

Neural Machine Translation with Keras

中文聊天机器人，基于10万组对白训练而成，采用注意力机制，对一般问题都会生成一个有意义的答复。已上传模型，可直接运行，跑不起来直播吃键盘。

A PyTorch Implementation of "Attention Is All You Need"

Debugging, monitoring and visualization for Python Machine Learning and Data Science

Using LSTM or Transformer to solve Image Captioning in Pytorch

Neutron: A pytorch based implementation of Transformer and its variants.

Summary of Transformer applications for computer vision tasks.

This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

Sentiment Analysis: Deep Bi-LSTM+attention model

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention

Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

a simple and complete pytorch implementation of neural machine translation system

Implementation of Linformer for Pytorch

Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

一些不同的Attention机制代码

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

📃 **Unofficial** PyTorch Implementation of DA-RNN (arXiv:1704.02971)

[NeurIPS 2020] Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.

💫 Jupyter notebooks for spaCy examples and tutorials

C# kernel for Jupyter

Notebooks and libraries for spatial/geo Python explorations

Implementation of Transformer model (originally from Attention is All You Need) applied to Time Series.

Transformer implemented in Keras

💻Speech and Natural Language Processing (SLP & NLP) Lab Assignments for ECE NTUA

Analysis and datasets about football (soccer)

The Go kernel for Jupyter notebooks and nteract.

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

Time series Timeseries Deep Learning Pytorch fastai - State-of-the-art Deep Learning with Time Series and Sequences in Pytorch / fastai

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"

Transformer of "Attention Is All You Need" (Vaswani et al. 2017) by Chainer.

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Edit your Jupyter notebooks in Vim/Neovim

Jupyter notebook integration with Spyder

Pointer-generator reinforced seq2seq summarization in PyTorch