1189 Open source projects that are alternatives of or similar to Model_server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Azure IoT Edge

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here:

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

Because all problems are solvable with containers and blockchains

Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.

DELTA is a deep learning based natural language and speech processing platform.

Model Zoo for Intel® Architecture: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors

Resource scheduling and cluster management for AI

Build an application that alerts you when someone enters a restricted area. Learn how to use models for multiclass object detection.

Predict performance issues with manufacturing equipment motors. Perform local or cloud analytics of the issues found, and then display the data on a user interface to determine when failures might arise.

Detect various irregularities of a product as it moves along a conveyor belt.

Multi Model Server is a tool for serving neural net models for inference

AoE (AI on Edge，终端智能，边缘计算) 是一个终端侧AI集成运行时环境 (IRE)，帮助开发者提升效率。

Observe workers as they pass in front of a camera to determine if they have adequate safety protection.

Exposes a serialized machine learning model through a HTTP API.

Official code repo for the O'Reilly Book - Practical Deep Learning for Cloud, Mobile & Edge

通用深度学习推理服务，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。

Artificial Intelligence with a Vision

MicroPython for K210 RISC-V, let's play with edge AI easier

Develop production ready deep learning code, deploy it and scale it

This repository contains all codes and materials of the current session. It contains the required code on Natural Language Processing, Artificial intelligence.

Spark ML Lib serving library

Create a concurrent video analysis pipeline featuring multistream face and human pose detection, vehicle attribute detection, and the ability to encode multiple videos to local storage in a single stream.

Detect various irregularities of a product as it moves along a conveyor belt.

Self-hosted IPTV/NVR/CCTV/Video service (Community version)

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

TensorFlow template application for deep learning

A CNCF Project to Bootstrap & Maintain Trust on the Edge / Cloud and IoT

The new architecture of co-computation for data processing and machine learning.

bootstrap Kubernetes with k3s over SSH < 1 min 🚀

Monitor mechanical bolts as they move down a conveyor belt. When a bolt of an irregular size is detected, this solution emits an alert.

OpenNARS for Research 3.0+

The open big data serving engine. https://vespa.ai

Apache Ignite

A REST API for Caffe using Docker and Go

Terratag is a CLI tool that enables users of Terraform to automatically create and maintain tags across their entire set of AWS, Azure, and GCP resources

JHipster is a development platform to quickly generate, develop, & deploy modern web applications & microservice architectures.

Kubernetes cloud-controller-manager for DigitalOcean (beta)

Artificial intelligence for screeps

Building Large-Scale AI Applications for Distributed Big Data

更好的小程序项目架构

Grakn Knowledge Graph Library (ML R&D)

UP - DOWN - LEFT - RIGHT movement tracking.

A python written personal assistant

roro is a free, open-source robotic process automation software written in C# and Blazor WebAssembly

A toolset for network packet capture in Cloud/Kubernetes and Virtualized environment.

Free RPA tool by AI Singapore

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection, NeurIPS2020

An Open Source Control Panel for your Cloud! Deploy and manage LEMP apps in one click!

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

spring-cloud-microservice-examples

🎆 A visualization of the CapsNet layers to better understand how it works

🍔 A Node.js Serverless Framework for front-end/full-stack developers. Build the application for next decade. Works on AWS, Alibaba Cloud, Tencent Cloud and traditional VM/Container. Super easy integrate with React and Vue. 🌈

Natural language detection library for Rust. Try demo online: https://www.greyblake.com/whatlang/

Google's Infrastructure for Everyone Else

List of resources & possible pathway for the Math of Machine Learning and AI.

What to Read to Learn More About DevOps

Implementations of the algorithms described in Differentiable plasticity: training plastic networks with gradient descent, a research paper from Uber AI Labs.