1166 Open source projects that are alternatives of or similar to optimum

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

Create a concurrent video analysis pipeline featuring multistream face and human pose detection, vehicle attribute detection, and the ability to encode multiple videos to local storage in a single stream.

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Efficient ML Filter Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2, and Real-CUGAN)

Easy-to-use UI for automatically sparsifying neural networks and creating sparsification recipes for better inference performance and a smaller footprint

An Open Source Deep Learning Inference Engine Based on FPGA

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

Example notebooks for working with SageMaker Studio Lab. Sign up for an account at the link below!

This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use their own XGBoost scripts in SageMaker.

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints

Poplar Advanced Runtime for the IPU

Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment

Multi Model Server is a tool for serving neural net models for inference

MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.

volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.

A repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training quantization (Weight Quantization, Integer Quantization, Full Integer Quantization, Float16 Quantization), Quantization-aware training. TensorFlow Lite. OpenVINO. CoreML. TensorFlow.js. TF-TRT. MediaPipe. ONNX. [.tflite,.h5,.pb,saved_model,tfjs,tftrt,mlmodel,.xml/.bin, .onnx]

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.

Detect various irregularities of a product as it moves along a conveyor belt.

This repository provides you with a easy to use labeling tool for State-of-the-art Deep Learning training purposes.

Build an application that alerts you when someone enters a restricted area. Learn how to use models for multiclass object detection.

Monitor mechanical bolts as they move down a conveyor belt. When a bolt of an irregular size is detected, this solution emits an alert.

Predict performance issues with manufacturing equipment motors. Perform local or cloud analytics of the issues found, and then display the data on a user interface to determine when failures might arise.

The purpose of this project is to apply mediapipe to more AI chips.

[This project has moved to ChainerCV] Chainer Implementation of Fully Convolutional Instance-aware Semantic Segmentation

Detect various irregularities of a product as it moves along a conveyor belt.

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

Python scripts form performing stereo depth estimation using the HITNET model in ONNX.

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

DAWNBench: An End-to-End Deep Learning Benchmark and Competition

Embedded and mobile deep learning research resources

Exposes a serialized machine learning model through a HTTP API.

Yet another yolov5, with its runtime stack for libtorch, onnx, tvm and specialized accelerators. You like torchvision's retinanet? You like yolov5? You love yolort!

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

Graphsignal Python agent

YASK--Yet Another Stencil Kit: a domain-specific language and framework to create high-performance stencil code for implementing finite-difference methods and similar applications.

Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Deep learning based gaze estimation demo with a fun feature :-)

How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO

PyTorch Project Specification.

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

Observe workers as they pass in front of a camera to determine if they have adequate safety protection.

Spark ML Lib serving library

TensorFlow Quantization Example, for TensorFlow Lite

A Julia/JuMP Package for Maximizing Algebraic Connectivity of Undirected Weighted Graphs

Simple and Distributed Machine Learning

LBFGS-Lite: A header-only L-BFGS unconstrained optimizer.

Chef Transformer 🍲 .

🔬 dd's x86 CPU Identification tool

NMA deep learning course

This is a repository for a semantic segmentation inference API using the OpenVINO toolkit

Chef cookbook to create MySQL configuraiton files better suited for your system.