161 Open source projects that are alternatives of or similar to Cnstream

A REST API for Caffe using Docker and Go

Small, dependency-free, fast Python package to infer binary file types checking the magic numbers signature

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.

🎨 A complete Pattern Matching library for TypeScript, with smart type inference.

Run TensorFlow models in C++ without installation and without Bazel

The benchmark of ncnn that is a high-performance neural network inference framework optimized for the mobile platform

HLS based Deep Neural Network Accelerator Library for Xilinx Ultrascale+ MPSoCs

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

LightSeq: A High Performance Inference Library for Sequence Processing and Generation

Detect various irregularities of a product as it moves along a conveyor belt.

Serve your Rubix ML models in production with scalable stand-alone model inference servers.

A scalable inference server for models optimized with OpenVINO™

LoMRF is an open-source implementation of Markov Logic Networks

Train a state-of-the-art yolov3 object detector from scratch!

Sample code for the NIPS paper "Scalable Variational Inference for Dynamical Systems"

AI 尬舞机

Graph-Based Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, RDFlib, pySHACL, RAPIDS, NetworkX, iGraph, PyVis, pslpython, pyarrow, etc.

convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.

Multi Model Server is a tool for serving neural net models for inference

TypeQL: the query language of TypeDB - a strongly-typed database

Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.

Tensorflow C++ examples for Visual Studio. Features Pose Estimation and various techniques to utilize the Tensorflow C++ interface

Lua Language Server coded by Lua

Shape and dimension inference (Keras-like) for PyTorch layers and neural networks

A scalable, high-performance serving system for federated learning models

Ordinal regression in Python

Runtime type system for IO decoding/encoding

A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.

Package for causal inference in graphs and in the pairwise settings. Tools for graph structure recovery and dependencies are included.

This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.

TensorFlow examples in C, C++, Go and Python without bazel but with cmake and FindTensorFlow.cmake

MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

A uniform interface to run deep learning models from multiple frameworks

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection, NeurIPS2020

Deploy a ML inference service on a budget in less than 10 lines of code.

Snips NLU rust implementation

Pytorch-Named-Entity-Recognition-with-BERT

Blind WAF identification tool

Inference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)

This is a repository for an object detection inference API using the Tensorflow framework.

High-efficiency floating-point neural network inference operators for mobile, server, and Web

OpenNARS for Research 3.0+

Openllet is an OWL 2 reasoner in Java, build on top of Pellet.

Documentation, models and code relating to the 3rd edition of the textbook Stochastic Modelling for Systems Biology

The challenge projects for Inferencing machine learning models on iOS

An ICE-based predicate synthesizer for Horn clauses.

A simple implementation of the OWL2 RL Profile on top of RDFLib: it expands the graph with all possible triples that OWL RL defines. It can be used together with RDFLib to expand an RDFLib Graph object, or as a stand alone service with its own serialization.

Deep learning based gaze estimation demo with a fun feature :-)

TensorFlow models accelerated with NVIDIA TensorRT

Python package for the creation, manipulation, and learning of Causal DAGs

An implementation of MTCNN Face detector using OpenCV's DNN module

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

DELTA is a deep learning based natural language and speech processing platform.

Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

Nostril: Nonsense String Evaluator

go binding for mxnet c_predict_api to do inference with pre-trained model

Embedded and mobile deep learning research resources