AimetAIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
Stars: ✭ 453 (-18.23%)
DistillerNeural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
Stars: ✭ 3,760 (+578.7%)
GraffitistGraph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow
Stars: ✭ 135 (-75.63%)
Micronetmicronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
Stars: ✭ 1,232 (+122.38%)
Model OptimizationA toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
Stars: ✭ 992 (+79.06%)
ATMC[NeurIPS'2019] Shupeng Gui, Haotao Wang, Haichuan Yang, Chen Yu, Zhangyang Wang, Ji Liu, “Model Compression with Adversarial Robustness: A Unified Optimization Framework”
Stars: ✭ 41 (-92.6%)
neural-compressorIntel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.
Stars: ✭ 666 (+20.22%)
Ctranslate2Fast inference engine for OpenNMT models
Stars: ✭ 140 (-74.73%)
ModelsModel Zoo for Intel® Architecture: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors
Stars: ✭ 248 (-55.23%)
sparsezooNeural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
Stars: ✭ 264 (-52.35%)
TerngradTernary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
Stars: ✭ 168 (-69.68%)
Bmw Yolov4 Inference Api CpuThis is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.
Stars: ✭ 180 (-67.51%)
Tf2An Open Source Deep Learning Inference Engine Based on FPGA
Stars: ✭ 113 (-79.6%)
Awesome Edge Machine LearningA curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.
Stars: ✭ 139 (-74.91%)
Kd libA Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
Stars: ✭ 173 (-68.77%)
bert-squeeze🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
Stars: ✭ 56 (-89.89%)
Ntaggerreference pytorch code for named entity tagging
Stars: ✭ 58 (-89.53%)
NncfPyTorch*-based Neural Network Compression Framework for enhanced OpenVINO™ inference
Stars: ✭ 218 (-60.65%)
Tf Keras SurgeonPruning and other network surgery for trained TF.Keras models.
Stars: ✭ 25 (-95.49%)
Awesome System For Machine LearningA curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.
Stars: ✭ 1,185 (+113.9%)
Adversarial Robustness ToolboxAdversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams
Stars: ✭ 2,638 (+376.17%)
Hey JetsonDeep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.
Stars: ✭ 161 (-70.94%)
optimum🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools
Stars: ✭ 567 (+2.35%)
sparsifyEasy-to-use UI for automatically sparsifying neural networks and creating sparsification recipes for better inference performance and a smaller footprint
Stars: ✭ 138 (-75.09%)
fastT5⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Stars: ✭ 421 (-24.01%)
PaddleslimPaddleSlim is an open-source library for deep model compression and architecture search.
Stars: ✭ 677 (+22.2%)
Awesome Ml Model CompressionAwesome machine learning model compression research papers, tools, and learning material.
Stars: ✭ 166 (-70.04%)
ChaidnnHLS based Deep Neural Network Accelerator Library for Xilinx Ultrascale+ MPSoCs
Stars: ✭ 258 (-53.43%)
Detection 2016 NipswsHierarchical Object Detection with Deep Reinforcement Learning
Stars: ✭ 401 (-27.62%)
CompressionData compression in TensorFlow
Stars: ✭ 458 (-17.33%)
CubertFast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
Stars: ✭ 395 (-28.7%)
TrainyourownyoloTrain a state-of-the-art yolov3 object detector from scratch!
Stars: ✭ 399 (-27.98%)
Convnet DrawerPython script for illustrating Convolutional Neural Networks (CNN) using Keras-like model definitions
Stars: ✭ 516 (-6.86%)
Io TsRuntime type system for IO decoding/encoding
Stars: ✭ 5,086 (+818.05%)
Neuronlp2Deep neural models for core NLP tasks (Pytorch version)
Stars: ✭ 397 (-28.34%)
Jetson InferenceHello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Stars: ✭ 5,191 (+837%)
DeeprobustA pytorch adversarial library for attack and defense methods on images and graphs
Stars: ✭ 388 (-29.96%)
Refinenet RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation
Stars: ✭ 543 (-1.99%)
Cnn Facial LandmarkTraining code for facial landmark detection based on deep convolutional neural network.
Stars: ✭ 516 (-6.86%)
TasoThe Tensor Algebra SuperOptimizer for Deep Learning
Stars: ✭ 391 (-29.42%)
PngquantLossy PNG compressor — pngquant command based on libimagequant library
Stars: ✭ 4,086 (+637.55%)
GfocalGeneralized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection, NeurIPS2020
Stars: ✭ 376 (-32.13%)
AndroidtensorflowmnistexampleAndroid TensorFlow MachineLearning MNIST Example (Building Model with TensorFlow for Android)
Stars: ✭ 449 (-18.95%)
Flow ForecastDeep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).
Stars: ✭ 368 (-33.57%)
Tracking With DarkflowReal-time people Multitracker using YOLO v2 and deep_sort with tensorflow
Stars: ✭ 515 (-7.04%)
CausaldiscoverytoolboxPackage for causal inference in graphs and in the pairwise settings. Tools for graph structure recovery and dependencies are included.
Stars: ✭ 447 (-19.31%)
RmdlRMDL: Random Multimodel Deep Learning for Classification
Stars: ✭ 375 (-32.31%)
U NetU-Net: Convolutional Networks for Biomedical Image Segmentation
Stars: ✭ 374 (-32.49%)
Mobilenetv2.pytorch72.8% MobileNetV2 1.0 model on ImageNet and a spectrum of pre-trained MobileNetV2 models
Stars: ✭ 369 (-33.39%)