161 Open source projects that are alternatives of or similar to Frozen Graph Tensorflow

Graph-Based Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, RDFlib, pySHACL, RAPIDS, NetworkX, iGraph, PyVis, pslpython, pyarrow, etc.

Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.

This repository provides you with a easy to use labeling tool for State-of-the-art Deep Learning training purposes.

DELTA is a deep learning based natural language and speech processing platform.

Sample code for the NIPS paper "Scalable Variational Inference for Dynamical Systems"

Machine Learning inference engine for Microcontrollers and Embedded devices

LoMRF is an open-source implementation of Markov Logic Networks

OpenVINO™ Toolkit repository

Serve your Rubix ML models in production with scalable stand-alone model inference servers.

Highly optimized inference engine for Binarized Neural Networks

Yet another yolov5, with its runtime stack for libtorch, onnx, tvm and specialized accelerators. You like torchvision's retinanet? You like yolov5? You love yolort!

Multi Model Server is a tool for serving neural net models for inference

This is a repository for an object detection inference API using the Tensorflow framework.

Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

This is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.

Nostril: Nonsense String Evaluator

Cross-platform, customizable ML solutions for live and streaming media.

The benchmark of ncnn that is a high-performance neural network inference framework optimized for the mobile platform

Train and run Pytorch models on Apache Spark.

go binding for mxnet c_predict_api to do inference with pre-trained model

A library for high performance deep learning inference on NVIDIA GPUs.

🎨 A complete Pattern Matching library for TypeScript, with smart type inference.

Machine Learning Privacy Meter: A tool to quantify the privacy risks of machine learning models with respect to inference attacks, notably membership inference attacks

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

An Open Source Deep Learning Inference Engine Based on FPGA

The challenge projects for Inferencing machine learning models on iOS

Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.

CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/SolutionSDK/CNStream

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

Inference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)

Named Entity Recognition with BERT using TensorFlow 2.0

MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.

Serving PyTorch 1.0 Models as a Web Server in C++

A simple implementation of the OWL2 RL Profile on top of RDFLib: it expands the graph with all possible triples that OWL RL defines. It can be used together with RDFLib to expand an RDFLib Graph object, or as a stand alone service with its own serialization.

TensorFlow template application for deep learning

A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.

Yolov3 Object Detection implemented as APIs, using TensorFlow and Flask

Deploy a ML inference service on a budget in less than 10 lines of code.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Openllet is an OWL 2 reasoner in Java, build on top of Pellet.

ELFI - Engine for Likelihood-Free Inference

An implementation of MTCNN Face detector using OpenCV's DNN module

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Ordinal regression in Python

Running BERT without Padding

This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.

Automatic Haskell type inference from JSON input

A uniform interface to run deep learning models from multiple frameworks

PyTorch C++ inference with LibTorch

Pytorch-Named-Entity-Recognition-with-BERT

benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.

High-efficiency floating-point neural network inference operators for mobile, server, and Web

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

通用深度学习推理服务，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。

volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.

An easy to use PyTorch to TensorRT converter

Gaussian Process Motion Planner 2

Acceleration package for neural networks on multi-core CPUs