276 Open source projects that are alternatives of or similar to Awesome Knowledge Distillation

Data Efficient Model Compression

Official Pytorch implementation of ReXNet (Rank eXpansion Network) with pretrained models

PaddleSlim is an open-source library for deep model compression and architecture search.

knowledge distillation papers

Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BERT.

Amazon Forest Computer Vision: Satellite Image tagging code using PyTorch / Keras with lots of PyTorch tricks

Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Deepdrive is a simulator that allows anyone with a PC to push the state-of-the-art in self-driving

TensorFlow and PyTorch implementation of "Meta-Transfer Learning for Few-Shot Learning" (CVPR2019)

Learning to Cluster. A deep clustering strategy.

Keras implementation of BERT with pre-trained weights

Transfer Learning Library

Deep-learning seismic facies on state-of-the-art CNN architectures

Awesome Multitask Learning Resources

Repository of code for the tutorial on Transfer Learning in NLP held at NAACL 2019 in Minneapolis, MN, USA

BERT-NER (nert-bert) with google bert https://github.com/google-research.

Automatic feature extraction and node role assignment for transfer learning on graphs (ReFeX & RolX)

Tensorflow implementation of "Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network"

Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosophy of Parameter Server and Ring-AllReduce collective communication.

Learn how to use PyTorch to solve some common NLP problems with deep learning.

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

和（he for objective-c） —— “信息熵减机系统”

EasyTransfer is designed to make the development of transfer learning in NLP applications easier.

NLP Paper

A library for transfer learning by reusing parts of TensorFlow models.

Skin cancer classification using Inceptionv3

[CVPR2020] GhostNet: More Features from Cheap Operations

High Quality Monocular Depth Estimation via Transfer Learning

Official Keras & PyTorch Implementation and Pre-trained Models for Models Genesis - MICCAI 2019

Official Pytorch implementation of CutMix regularizer

Train a state-of-the-art yolov3 object detector from scratch!

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

Abstractive summarisation using Bert as encoder and Transformer Decoder

Gradients as Features for Deep Representation Learning

Pytorch Tutorial, Pytorch with Google Colab, Pytorch Implementations: CNN, RNN, DCGAN, Transfer Learning, Chatbot, Pytorch Sample Codes

Transfer-Learning-Library

Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration (CVPR 2019 Oral)

Compressing Representations for Self-Supervised Learning

Deep Learning Computer Vision Algorithms for Real-World Use

TensorFlow 101: Introduction to Deep Learning for Python Within TensorFlow

Chest Xray image analysis using Deep learning !

This project is the official implementation of our accepted ICLR 2021 paper BiPointNet: Binary Neural Network for Point Clouds.

Papers for deep neural network compression and acceleration

Federated Learning Library: https://fedml.ai

AutoGluon: AutoML for Text, Image, and Tabular Data

Channel Pruning for Accelerating Very Deep Neural Networks (ICCV'17)

NLP library designed for reproducible experimentation management

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Transfer learning for time series classification

Deepfakes Video classification via CNN, LSTM, C3D and triplets

Tutorial for video classification/ action recognition using 3D CNN/ CNN+RNN on UCF101

A curated list of neural network pruning resources.

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training deep neural networks using a trained teacher model.

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Pytorch implementation of various Knowledge Distillation (KD) methods.