Embedded Ai.benchbenchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
Stars: ✭ 131 (-27.62%)
Volksdepvolksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
Stars: ✭ 195 (+7.73%)
Hey JetsonDeep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.
Stars: ✭ 161 (-11.05%)
LightnerInference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)
Stars: ✭ 102 (-43.65%)
LibonnxA lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
Stars: ✭ 217 (+19.89%)
Onnxt5Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Stars: ✭ 143 (-20.99%)
graphsignalGraphsignal Python agent
Stars: ✭ 158 (-12.71%)
Tf2An Open Source Deep Learning Inference Engine Based on FPGA
Stars: ✭ 113 (-37.57%)
Torch2trtAn easy to use PyTorch to TensorRT converter
Stars: ✭ 2,974 (+1543.09%)
ServerThe Triton Inference Server provides an optimized cloud and edge inferencing solution.
Stars: ✭ 2,994 (+1554.14%)
Owl RlA simple implementation of the OWL2 RL Profile on top of RDFLib: it expands the graph with all possible triples that OWL RL defines. It can be used together with RDFLib to expand an RDFLib Graph object, or as a stand alone service with its own serialization.
Stars: ✭ 95 (-47.51%)
Bmw Yolov4 Inference Api GpuThis is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.
Stars: ✭ 237 (+30.94%)
Bert Ner TfNamed Entity Recognition with BERT using TensorFlow 2.0
Stars: ✭ 155 (-14.36%)
dbnRGaussian dynamic Bayesian networks structure learning and inference based on the bnlearn package
Stars: ✭ 33 (-81.77%)
Ncnnncnn is a high-performance neural network inference framework optimized for the mobile platform
Stars: ✭ 13,376 (+7290.06%)
Dl inference通用深度学习推理服务,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
Stars: ✭ 209 (+15.47%)
Json AutotypeAutomatic Haskell type inference from JSON input
Stars: ✭ 139 (-23.2%)
fastT5⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Stars: ✭ 421 (+132.6%)
SparktorchTrain and run Pytorch models on Apache Spark.
Stars: ✭ 195 (+7.73%)
CnstreamCNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/SolutionSDK/CNStream
Stars: ✭ 104 (-42.54%)
Dawn Bench EntriesDAWNBench: An End-to-End Deep Learning Benchmark and Competition
Stars: ✭ 254 (+40.33%)
MivisionxMIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.
Stars: ✭ 100 (-44.75%)
Object Detection ApiYolov3 Object Detection implemented as APIs, using TensorFlow and Flask
Stars: ✭ 177 (-2.21%)
Ml privacy meterMachine Learning Privacy Meter: A tool to quantify the privacy risks of machine learning models with respect to inference attacks, notably membership inference attacks
Stars: ✭ 167 (-7.73%)
NostrilNostril: Nonsense String Evaluator
Stars: ✭ 86 (-52.49%)
AdlikAdlik: Toolkit for Accelerating Deep Learning Inference
Stars: ✭ 237 (+30.94%)
Gpmp2Gaussian Process Motion Planner 2
Stars: ✭ 161 (-11.05%)
go-ml-benchmarks⏱ Benchmarks of machine learning inference for Go
Stars: ✭ 27 (-85.08%)
EmlearnMachine Learning inference engine for Microcontrollers and Embedded devices
Stars: ✭ 154 (-14.92%)
hypothesisA Python toolkit for (simulation-based) inference and the mechanization of science.
Stars: ✭ 47 (-74.03%)
MediapipeCross-platform, customizable ML solutions for live and streaming media.
Stars: ✭ 15,338 (+8374.03%)
Frozen Graph TensorflowSave, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x
Stars: ✭ 212 (+17.13%)
Bmw Labeltool LiteThis repository provides you with a easy to use labeling tool for State-of-the-art Deep Learning training purposes.
Stars: ✭ 145 (-19.89%)
object-flaw-detector-cppDetect various irregularities of a product as it moves along a conveyor belt.
Stars: ✭ 19 (-89.5%)
ForwardA library for high performance deep learning inference on NVIDIA GPUs.
Stars: ✭ 136 (-24.86%)
ElfiELFI - Engine for Likelihood-Free Inference
Stars: ✭ 208 (+14.92%)
Compute EngineHighly optimized inference engine for Binarized Neural Networks
Stars: ✭ 138 (-23.76%)
monai-deployMONAI Deploy aims to become the de-facto standard for developing, packaging, testing, deploying and running medical AI applications in clinical production.
Stars: ✭ 56 (-69.06%)
Ml Model CiMLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
Stars: ✭ 122 (-32.6%)
NnpackAcceleration package for neural networks on multi-core CPUs
Stars: ✭ 1,538 (+749.72%)
Yolov5 Rt StackYet another yolov5, with its runtime stack for libtorch, onnx, tvm and specialized accelerators. You like torchvision's retinanet? You like yolov5? You love yolort!
Stars: ✭ 107 (-40.88%)
Pytorch CppPyTorch C++ inference with LibTorch
Stars: ✭ 194 (+7.18%)
DeltaDELTA is a deep learning based natural language and speech processing platform.
Stars: ✭ 1,479 (+717.13%)
Bmw Yolov4 Inference Api CpuThis is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.
Stars: ✭ 180 (-0.55%)
KglabGraph-Based Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, RDFlib, pySHACL, RAPIDS, NetworkX, iGraph, PyVis, pslpython, pyarrow, etc.
Stars: ✭ 98 (-45.86%)
ModelsModel Zoo for Intel® Architecture: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors
Stars: ✭ 248 (+37.02%)
OpenvinoOpenVINO™ Toolkit repository
Stars: ✭ 2,858 (+1479.01%)
sagemaker-xgboost-containerThis is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use their own XGBoost scripts in SageMaker.
Stars: ✭ 93 (-48.62%)
studio-lab-examplesExample notebooks for working with SageMaker Studio Lab. Sign up for an account at the link below!
Stars: ✭ 319 (+76.24%)
approxposteriorA Python package for approximate Bayesian inference and optimization using Gaussian processes
Stars: ✭ 36 (-80.11%)
GraknTypeDB: a strongly-typed database
Stars: ✭ 2,947 (+1528.18%)