Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

✭ 666

python javascript typescript HTML Jupyter Notebook SCSS sparsity deep-learning pruning quantization knowledge-distillation auto-tuning low-precision quantization-aware-training post-training-quantization

SAN

[ECCV 2020] Scale Adaptive Network: Learning to Learn Parameterized Classification Networks for Scalable Input Images

✭ 41

python pytorch classification imagenet resnet knowledge-distillation scale-invariance meta-learning mobilenetv2 efficient-neural-networks eccv2020

Localization Distillation for Dense Object Detection (CVPR 2022)

✭ 271

python deep-learning detection pytorch object-detection knowledge-distillation ld

MLIC-KD-WSD

Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detection (ACM MM 2018)

✭ 58

C++python Cuda Jupyter Notebook CMake matlab computer-vision deep-learning multi-label-classification knowledge-distillation weakly-supervised-detection

Distill-BERT-Textgen

Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".

✭ 121

python shell Dockerfile natural-language-processing machine-translation knowledge-distillation bert-model

LabelRelaxation-CVPR21

Official PyTorch Implementation of Embedding Transfer with Label Relaxation for Improved Metric Learning, CVPR 2021

✭ 37

python shell pytorch image-retrieval knowledge-distillation deep-metric-learning cvpr2021 embedding-trasnfer

awesome-efficient-gnn

Code and resources on scalable and efficient Graph Neural Networks

✭ 498

python shell knowledge-distillation graph-convolutional-networks graph-neural-networks graph-representation-learning scalable-deep-learning gnn efficient-neural-networks contrastive-learning efficient-deep-learning

BAKE

Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification

✭ 79

python shell classification imagenet knowledge-distillation

Object-Detection-Knowledge-Distillation

An Object Detection Knowledge Distillation framework powered by pytorch, now having SSD and yolov5.

✭ 189

python deep-learning pytorch ssd object-detection knowledge-distillation yolov5

distill-and-select

Authors official PyTorch implementation of the "DnS: Distill-and-Select for Efficient and Accurate Video Indexing and Retrieval" [IJCV 2022]

✭ 43

python knowledge-distillation video-search duplicate-videos video-similarity-search video-retrieval ndvr fivr video-similarity-learning near-duplicate-video-retrieval

head-network-distillation

[IEEE Access] "Head Network Distillation: Splitting Distilled Deep Neural Networks for Resource-constrained Edge Computing Systems" and [ACM MobiCom HotEdgeVideo 2019] "Distilled Split Deep Neural Networks for Edge-assisted Real-time Systems"

✭ 27

Jupyter Notebook python pytorch imagenet image-classification knowledge-distillation split-computing

kdtf

Knowledge Distillation using Tensorflow

✭ 139

python deep-learning tensorflow knowledge-distillation

1-29 of 29 knowledge-distillation projects