634 Open source projects that are alternatives of or similar to InferenceHelper

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

🍅🍅🍅YOLOv5-Lite: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 930+kb (int8) and 1.7M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

This is a repository for a semantic segmentation inference API using the OpenVINO toolkit

DAWNBench: An End-to-End Deep Learning Benchmark and Competition

Jetson Nano image with deep learning frameworks

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

PyTorch Project Specification.

MobileNetV2-YoloV3-Nano: 0.5BFlops 3MB HUAWEI P40: 6ms/img, YoloFace-500k:0.1Bflops 420KB🔥🔥🔥

This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.

⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥

⚡ Open-source software for deep learning-based digital pathology

Deep Learning API and Server in C++14 support for Caffe, Caffe2, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

A uniform interface to run deep learning models from multiple frameworks

The benchmark of ncnn that is a high-performance neural network inference framework optimized for the mobile platform

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

An easy to use PyTorch to TensorRT converter

🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOX, YOLOP, MODNet, YOLOR, NanoDet, YOLOX, SCRFD, YOLOX . MNN, NCNN, TNN, ONNXRuntime, CPU/GPU.

The purpose of this project is to apply mediapipe to more AI chips.

This is a repository for an object detection inference API using the Tensorflow framework.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Use PyTorch model in C++ project

This is a repository for a No-Code object detection inference API using the OpenVINO. It's supported on both Windows and Linux Operating systems.

Tensorflow implementation for Active Shift Layer(ASL)

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

Create a concurrent video analysis pipeline featuring multistream face and human pose detection, vehicle attribute detection, and the ability to encode multiple videos to local storage in a single stream.

Spark ML Lib serving library

Motion Planning Networks

Kaggle solutions

Pyinfer is a model agnostic tool for ML developers and researchers to benchmark the inference statistics for machine learning models or functions.

Task-based gene regulatory network inference using single-cell or bulk gene expression data conditioned on a prior network.

Harmony framework for connecting scRNA-seq data from discrete time points

Write fully type inferred Vuex modules

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

[ICIP 2019] : This is the official github repository for the paper "What's There in The Dark" accepted in IEEE International Conference in Image Processing 2019 (ICIP19) , Taipei, Taiwan.

3D scene graph generator implemented in Pytorch.

Optical character recognition Using Deep Learning

yet another custom data science template via cookiecutter

YOLO for object detection tasks

Sample projects for TensorRT in C++

Website for "A survey of learning to hash for Computer Vision" https://learning2hash.github.io

ffcnn is a cnn neural network inference framework, written in 600 lines C language.

低代码序列数据处理框架，最短两行即可完成训练任务！

Combining Weighted Multi-resolution STFT Loss and Distance Fusion to Optimize Speech Enhancement Generative Adversarial Networks

tensorrt int8 量化yolov5 onnx模型

My AI security testing projects

CAIN, Channel Attention Is All You Need for Video Frame Interpolation implemented with ncnn library

The code of Switchable Normalization for object detection based on Detectron.pytorch.

Research internship - Image segmentation by superpixels based on PyTorch

Forecasting Solar Power: Analysis of using a LSTM Neural Network

KNIME Deep Learning Integration

A c++ implementation of yolov5 and deepsort

Head and Person detection using yolov5. Detection from crowd.

Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.

Jupyter notebook series for machine learning and deep learning.

A scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.

Deep Learning for Visual-Inertial Odometry

Online Hand Writing Recognition using BLSTM

Live Training by Packt, with Jeffrey Yau.