ForwardA library for high performance deep learning inference on NVIDIA GPUs.
Stars: ✭ 136 (+518.18%)
Frozen Graph TensorflowSave, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x
Stars: ✭ 212 (+863.64%)
Ml privacy meterMachine Learning Privacy Meter: A tool to quantify the privacy risks of machine learning models with respect to inference attacks, notably membership inference attacks
Stars: ✭ 167 (+659.09%)
Yolov5 Rt StackYet another yolov5, with its runtime stack for libtorch, onnx, tvm and specialized accelerators. You like torchvision's retinanet? You like yolov5? You love yolort!
Stars: ✭ 107 (+386.36%)
AdlikAdlik: Toolkit for Accelerating Deep Learning Inference
Stars: ✭ 237 (+977.27%)
MediapipeCross-platform, customizable ML solutions for live and streaming media.
Stars: ✭ 15,338 (+69618.18%)
go-ml-benchmarks⏱ Benchmarks of machine learning inference for Go
Stars: ✭ 27 (+22.73%)
Ml Model CiMLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
Stars: ✭ 122 (+454.55%)
OpenvinoOpenVINO™ Toolkit repository
Stars: ✭ 2,858 (+12890.91%)
ModelsModel Zoo for Intel® Architecture: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors
Stars: ✭ 248 (+1027.27%)
Gpmp2Gaussian Process Motion Planner 2
Stars: ✭ 161 (+631.82%)
EmlearnMachine Learning inference engine for Microcontrollers and Embedded devices
Stars: ✭ 154 (+600%)
Bmw Labeltool LiteThis repository provides you with a easy to use labeling tool for State-of-the-art Deep Learning training purposes.
Stars: ✭ 145 (+559.09%)
monai-deployMONAI Deploy aims to become the de-facto standard for developing, packaging, testing, deploying and running medical AI applications in clinical production.
Stars: ✭ 56 (+154.55%)
Compute EngineHighly optimized inference engine for Binarized Neural Networks
Stars: ✭ 138 (+527.27%)
ElfiELFI - Engine for Likelihood-Free Inference
Stars: ✭ 208 (+845.45%)
NnpackAcceleration package for neural networks on multi-core CPUs
Stars: ✭ 1,538 (+6890.91%)
object-flaw-detector-cppDetect various irregularities of a product as it moves along a conveyor belt.
Stars: ✭ 19 (-13.64%)
DeltaDELTA is a deep learning based natural language and speech processing platform.
Stars: ✭ 1,479 (+6622.73%)
Pytorch CppPyTorch C++ inference with LibTorch
Stars: ✭ 194 (+781.82%)
Object Detection ApiYolov3 Object Detection implemented as APIs, using TensorFlow and Flask
Stars: ✭ 177 (+704.55%)
MivisionxMIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.
Stars: ✭ 100 (+354.55%)
Dawn Bench EntriesDAWNBench: An End-to-End Deep Learning Benchmark and Competition
Stars: ✭ 254 (+1054.55%)
fastT5⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Stars: ✭ 421 (+1813.64%)
ServerThe Triton Inference Server provides an optimized cloud and edge inferencing solution.
Stars: ✭ 2,994 (+13509.09%)
GraknTypeDB: a strongly-typed database
Stars: ✭ 2,947 (+13295.45%)
Hey JetsonDeep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.
Stars: ✭ 161 (+631.82%)
sagemaker-xgboost-containerThis is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use their own XGBoost scripts in SageMaker.
Stars: ✭ 93 (+322.73%)
Bert Ner TfNamed Entity Recognition with BERT using TensorFlow 2.0
Stars: ✭ 155 (+604.55%)
Bmw Yolov4 Inference Api GpuThis is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.
Stars: ✭ 237 (+977.27%)
approxposteriorA Python package for approximate Bayesian inference and optimization using Gaussian processes
Stars: ✭ 36 (+63.64%)
Ncnnncnn is a high-performance neural network inference framework optimized for the mobile platform
Stars: ✭ 13,376 (+60700%)
LibonnxA lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
Stars: ✭ 217 (+886.36%)
Onnxt5Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Stars: ✭ 143 (+550%)
r2inferenceRidgeRun Inference Framework
Stars: ✭ 22 (+0%)
Json AutotypeAutomatic Haskell type inference from JSON input
Stars: ✭ 139 (+531.82%)
Dl inference通用深度学习推理服务,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
Stars: ✭ 209 (+850%)
Embedded Ai.benchbenchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
Stars: ✭ 131 (+495.45%)
dbnRGaussian dynamic Bayesian networks structure learning and inference based on the bnlearn package
Stars: ✭ 33 (+50%)
Volksdepvolksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
Stars: ✭ 195 (+786.36%)
Tf2An Open Source Deep Learning Inference Engine Based on FPGA
Stars: ✭ 113 (+413.64%)
studio-lab-examplesExample notebooks for working with SageMaker Studio Lab. Sign up for an account at the link below!
Stars: ✭ 319 (+1350%)
CnstreamCNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/SolutionSDK/CNStream
Stars: ✭ 104 (+372.73%)
SparktorchTrain and run Pytorch models on Apache Spark.
Stars: ✭ 195 (+786.36%)
LightnerInference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)
Stars: ✭ 102 (+363.64%)
graphsignalGraphsignal Python agent
Stars: ✭ 158 (+618.18%)
Torch2trtAn easy to use PyTorch to TensorRT converter
Stars: ✭ 2,974 (+13418.18%)
chainer-fcis[This project has moved to ChainerCV] Chainer Implementation of Fully Convolutional Instance-aware Semantic Segmentation
Stars: ✭ 45 (+104.55%)
hypothesisA Python toolkit for (simulation-based) inference and the mechanization of science.
Stars: ✭ 47 (+113.64%)
Bmw Yolov4 Inference Api CpuThis is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.
Stars: ✭ 180 (+718.18%)