The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We develop a method for analyzing emerging functional modularity in neural networks based on differentiable weight masks and use it to point out important issues in current-day neural networks.

✭ 25

python machine-learning deep-learning paper transformers pytorch rnn modularity generalization weight-sharing

COVID-19-Tweet-Classification-using-Roberta-and-Bert-Simple-Transformers

Rank 1 / 216

✭ 24

Jupyter Notebook sentiment-analysis text-classification transformers transformer classification tweet bert sentiment-classification textclassification roberta covid-19 covid19

gnn-lspe

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

✭ 165

python Jupyter Notebook shell graphs transformers attention representation-learning molecules message-passing lspe geometric-deep-learning graph-neural-networks graph-representation-learning gnn graph-deep-learning positional-encoding graph-transformer transformer-networks gnn-lspe

PyTorch-Model-Compare

Compare neural networks by their feature similarity

✭ 119

python deep-learning transformers pytorch pip feature-extraction neural-networks imagenet cka torch-cka

DocSum

A tool to automatically summarize documents abstractively using the BART or PreSumm Machine Learning Model.

✭ 58

python Jupyter Notebook nlp pdf machine-learning xml transformers bart text-summarization summarization xml-parser automatic-summarization abstractive-text-summarization abstractive-summarization

xpandas

Universal 1d/2d data containers with Transformers functionality for data analysis.

✭ 25

python sklearn transformers pandas

WellcomeML

Repository for Machine Learning utils at the Wellcome Trust

✭ 31

python nlp deep-learning transformers hacktoberfest scibert

bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

✭ 56

python nlp transformers lstm theseus pruning quantization bert distillation pytorch-lightning fastbert deebert

lightning-transformers

Flexible components pairing 🤗 Transformers with Pytorch Lightning

✭ 551

python Makefile transformers pytorch hydra pytorch-lightning

long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

✭ 103

python deep-learning transformers artificial-intelligence attention-mechanism

label-studio-transformers

Label data using HuggingFace's transformers and automatically get a prediction service

✭ 117

python nlp natural-language-processing transformers bert natural-language-understanding text-labeling data-labeling pytorch-transformers label-studio

deepconsensus

DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS) data.

✭ 124

python Jupyter Notebook shell Dockerfile bioinformatics deep-learning transformers long-read-sequencing

Text-Summarization

Abstractive and Extractive Text summarization using Transformers.

✭ 38

Jupyter Notebook api flask aws prototype transformers pytorch led bart text-summarization pegasus extractive-summarization bert abstractive-summarization roberta fastapi gpt2 t5 xlnet streamlit longformer

anonymisation

Anonymization of legal cases (Fr) based on Flair embeddings

✭ 85

python Makefile legal transformers entities spacy ner flair bert anonymization legal-cases pseudo-anonymization dataset-augmentation camembert

Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

✭ 2,828

Jupyter Notebook transformers pytorch bert gpt-2 layoutlm vision-transformer

wechsel

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

✭ 39

python nlp natural-language-processing transformers transfer-learning language-model bert

transformers-interpret

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

✭ 861

Jupyter Notebook python nlp machine-learning natural-language-processing computer-vision deep-learning neural-network transformers interpretability explainable-ai captum model-explainability transformers-model

elastic transformers

Making BERT stretchy. Semantic Elasticsearch with Sentence Transformers

✭ 153

Jupyter Notebook python search nlp elasticsearch transformers artificial-intelligence semantic-search nlp-machine-learning sentence-transformers

pysentimiento

A Python multilingual toolkit for Sentiment Analysis and Social NLP tasks

✭ 274

Jupyter Notebook python shell nlp sentiment-analysis transformers

transformer generalization

The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.

✭ 58

python shell machine-learning deep-learning paper transformers pytorch generalization systematic-generalization

text-classification-transformers

Easy text classification for everyone : Bert based models via Huggingface transformers (KR / EN)

✭ 32

python shell deep-learning text-classification transformers pytorch korean bert-model kobert huggingface-transformers huggingface-models

backprop

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

✭ 229

python nlp natural-language-processing text-classification transformers question-answering image-classification transfer-learning language-model bert fine-tuning multilingual-models

RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

✭ 473

python deep-learning retrieval transformers artificial-intelligence attention-mechanism

Chinese-Minority-PLM

CINO: Pre-trained Language Models for Chinese Minority (少数民族语言预训练模型)

✭ 133

python nlp transformers pytorch chinese-nlp xlm-roberta xlmr cino

BottleneckTransformers

Bottleneck Transformers for Visual Recognition

✭ 231

python transformers imagenet image-classification image-recognition cifar10 bottleneck-transformers

code-transformer

Implementation of the paper "Language-agnostic representation learning of source code from structure and context".

✭ 130

python java C#Jupyter Notebook shell machine-learning deep-learning transformers ml4code iclr2021

awesome-huggingface

🤗 A list of wonderful open-source projects & applications integrated with Hugging Face libraries.

✭ 436

nlp machine-learning awesome transformers awesome-list huggingface

transformers-lightning

A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transformers.

✭ 45

python Makefile models transformers dataset

X-Transformer

X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification

✭ 127

C++python shell Makefile text-classification transformers pytorch extreme-multi-label-classification

Ask2Transformers

A Framework for Textual Entailment based Zero Shot text classification

✭ 102

python nlp natural-language-processing deep-learning text-classification transformers pytorch topic-modeling zero-shot relation-extraction topic-classification nlp-tool mnli nlp-tools

Introduction-to-Deep-Learning-and-Neural-Networks-Course

Code snippets and solutions for the Introduction to Deep Learning and Neural Networks Course hosted in educative.io

✭ 33

Jupyter Notebook python data-science machine-learning deep-neural-networks ai deep-learning transformers pytorch recurrent-neural-networks generative-adversarial-network convolutional-neural-networks autoencoders graph-neural-networks

ginza-transformers

Use custom tokenizers in spacy-transformers

✭ 15

python nlp natural-language-processing transformers spacy ginza spacy-transformers tokenizers sudachitra

oreilly-bert-nlp

This repository contains code for the O'Reilly Live Online Training for BERT

✭ 19

Jupyter Notebook nlp machine-learning natural-language-processing deep-learning transformers transfer-learning bert

question generator

An NLP system for generating reading comprehension questions

✭ 188

python nlp natural-language-processing transformers natural-language-generation nlg bert question-generation t5

nlp workshop odsc europe20

Extensive tutorials for the Advanced NLP Workshop in Open Data Science Conference Europe 2020. We will leverage machine learning, deep learning and deep transfer learning to learn and solve popular tasks using NLP including NER, Classification, Recommendation \ Information Retrieval, Summarization, Classification, Language Translation, Q&A and T…

✭ 127

Jupyter Notebook machine-learning natural-language-processing deep-learning tensorflow scikit-learn jupyter-notebook transformers pytorch spacy nltk gensim transfer-learning

danish transformers

A collection of Danish Transformers

✭ 30

nlp transformers pytorch huggingface

Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

✭ 484

Jupyter Notebook python javascript shell c CSS visualization transformers transformer vqa clip interpretability explainable-ai explainability detr lxmert visualbert

uniformer-pytorch

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022

✭ 90

python deep-learning transformers artificial-intelligence attention-mechanism video-classification 3d-convolutional-network

KnowledgeEditor

Code for Editing Factual Knowledge in Language Models

✭ 86

python shell nlp natural-language-processing transformers pytorch

clip-italian

CLIP (Contrastive Language–Image Pre-training) for Italian

✭ 113

Jupyter Notebook python shell transformers dataset clip contrastive-loss huggingface transformers-models

Basic-UI-for-GPT-J-6B-with-low-vram

A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.

✭ 90

Jupyter Notebook transformers gpt gpt-neo

text

Using Transformers from HuggingFace in R

✭ 66

r python nlp machine-learning deep-learning transformers

Transformer-in-PyTorch

Transformer/Transformer-XL/R-Transformer examples and explanations

✭ 21

python transformers self-attention multi-head-self-attention transformer-variants

jax-models

Unofficial JAX implementations of deep learning research papers

✭ 108

python machine-learning computer-vision deep-learning transformers artificial-intelligence convolutional-neural-networks flax jax research-paper-implementation

TransQuest

Transformer based translation quality estimation

✭ 85

python deep-learning transformers quality-estimation

STAM-pytorch

Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification

✭ 109

python deep-learning transformers artificial-intelligence attention-mechanism video-classification

naru

Neural Relation Understanding: neural cardinality estimators for tabular data

✭ 76

python shell transformers generative-model learned-database query-optimization unsupervised-learning cardinality-estimation density-estimation autoregressive-neural-networks self-supervised-learning deep-generative-model learned-database-components

KB-ALBERT

KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델

✭ 215

python nlp transformers pytorch language-model albert korean-nlp financial-nlp

LIT

[AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"

✭ 79

python Cuda C++shell transformers image-recognition mlps

thermostat

Collection of NLP model explanations and accompanying analysis tools

✭ 126

Jsonnet python Jupyter Notebook natural-language-processing transformers datasets heatmaps interpretability explainability saliency-maps feature-attribution captum explainable-nlp

SnowflakeNet

(TPAMI 2022) Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer

✭ 74

python Cuda C++c deep-learning transformers pytorch 3dvision point-cloud-completion iccv2021 tpami2022

gpl

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

✭ 216

python shell nlp information-retrieval transformers bert domain-adaptation vector-search

Transformer-Implementations

Library - Vanilla, ViT, DeiT, BERT, GPT

✭ 34

Jupyter Notebook python transformers pytorch vision-transformers transformer-implementations

61-120 of 124 transformers projects

‹

›