MediapipeCross-platform, customizable ML solutions for live and streaming media.
Stars: ✭ 15,338 (+40263.16%)
Jetson InferenceHello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Stars: ✭ 5,191 (+13560.53%)
YOLOXYOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
Stars: ✭ 6,570 (+17189.47%)
ai-servingServing AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
Stars: ✭ 122 (+221.05%)
godsendA simple and eloquent workflow for streaming messages to micro-services.
Stars: ✭ 15 (-60.53%)
tensorrt-examplesTensorRT Examples (TensorRT, Jetson Nano, Python, C++)
Stars: ✭ 31 (-18.42%)
MivisionxMIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.
Stars: ✭ 100 (+163.16%)
Torch2trtAn easy to use PyTorch to TensorRT converter
Stars: ✭ 2,974 (+7726.32%)
Volksdepvolksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
Stars: ✭ 195 (+413.16%)
FAST-Pathology⚡ Open-source software for deep learning-based digital pathology
Stars: ✭ 54 (+42.11%)
laavAsynchronous Audio / Video Library for H264 / MJPEG / OPUS / AAC / MP2 encoding, transcoding, recording and streaming from live sources
Stars: ✭ 50 (+31.58%)
mtomoMultiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.
Stars: ✭ 24 (-36.84%)
SaberWindow-Based Hybrid CPU/GPU Stream Processing Engine
Stars: ✭ 35 (-7.89%)
Pytorch Yolov4PyTorch ,ONNX and TensorRT implementation of YOLOv4
Stars: ✭ 3,690 (+9610.53%)
TengineTengine is a lite, high performance, modular inference engine for embedded device
Stars: ✭ 4,012 (+10457.89%)
CaerHigh-performance Vision library in Python. Scale your research, not boilerplate.
Stars: ✭ 452 (+1089.47%)
TnnTNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …
Stars: ✭ 3,257 (+8471.05%)
Multi Model ServerMulti Model Server is a tool for serving neural net models for inference
Stars: ✭ 770 (+1926.32%)
Ncnnncnn is a high-performance neural network inference framework optimized for the mobile platform
Stars: ✭ 13,376 (+35100%)
Yolov5 Rt StackYet another yolov5, with its runtime stack for libtorch, onnx, tvm and specialized accelerators. You like torchvision's retinanet? You like yolov5? You love yolort!
Stars: ✭ 107 (+181.58%)
Tuna🐟 A streaming ETL for fish
Stars: ✭ 11 (-71.05%)
HstreamThe streaming database built for IoT data storage and real-time processing in the 5G Era
Stars: ✭ 166 (+336.84%)
Ml Model CiMLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
Stars: ✭ 122 (+221.05%)
Onnxt5Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Stars: ✭ 143 (+276.32%)
fastT5⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Stars: ✭ 421 (+1007.89%)
InsightFace-RESTInsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
Stars: ✭ 308 (+710.53%)
watsorObject detection for video surveillance
Stars: ✭ 203 (+434.21%)
vs-mlrtEfficient ML Filter Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2, and Real-CUGAN)
Stars: ✭ 34 (-10.53%)
optimum🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools
Stars: ✭ 567 (+1392.11%)
onnx2tensorRttensorRt-inference darknet2onnx pytorch2onnx mxnet2onnx python version
Stars: ✭ 14 (-63.16%)
AI-LABThis repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥
Stars: ✭ 44 (+15.79%)
yolov4 trt rosYOLOv4 object detector using TensorRT engine
Stars: ✭ 89 (+134.21%)
deepvacPyTorch Project Specification.
Stars: ✭ 507 (+1234.21%)
Torch-TensorRTPyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT
Stars: ✭ 1,216 (+3100%)
modelboxA high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用。
Stars: ✭ 48 (+26.32%)
InferenceHelperC++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow
Stars: ✭ 142 (+273.68%)
serving-runtimeExposes a serialized machine learning model through a HTTP API.
Stars: ✭ 15 (-60.53%)
onnxruntime-rsRust wrapper for Microsoft's ONNX Runtime (version 1.8)
Stars: ✭ 149 (+292.11%)
LibonnxA lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
Stars: ✭ 217 (+471.05%)
Deepstream ProjectThis is a highly separated deployment project based on Deepstream , including the full range of Yolo and continuously expanding deployment projects such as Ocr.
Stars: ✭ 120 (+215.79%)
isaac ros dnn inferenceHardware-accelerated DNN model inference ROS2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU
Stars: ✭ 67 (+76.32%)
CarLens-iOSCarLens - Recognize and Collect Cars
Stars: ✭ 124 (+226.32%)
android-chat-tutorialSample apps for the Stream Chat Android SDK's official tutorial
Stars: ✭ 44 (+15.79%)
makinageStream Processing Made Easy
Stars: ✭ 31 (-18.42%)
ros-yolo-sortYOLO v3, v4, v5, v6, v7 + SORT tracking + ROS platform. Supporting: YOLO with Darknet, OpenCV(DNN), OpenVINO, TensorRT(tkDNN). SORT supports python(original) and C++. (Not Deep SORT)
Stars: ✭ 162 (+326.32%)
r2inferenceRidgeRun Inference Framework
Stars: ✭ 22 (-42.11%)
mxfactoriala payment application intended for deployment by the united states treasury
Stars: ✭ 36 (-5.26%)
Perfect-KafkaAn Express Swift Client of Apache Kafka 0.8, the Stream Processing Platform
Stars: ✭ 20 (-47.37%)
SFMediaStreamHTML5 media streamer library for playing music, video, playlist, or even live streaming microphone & camera with node server
Stars: ✭ 97 (+155.26%)
leadSink your streams.
Stars: ✭ 14 (-63.16%)