RayAn open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Seldon CoreAn MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
Keras Servingbring keras-models to production with tensorflow-serving and nodejs + docker 🍕
Bodywork CoreDeploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀
Ml Model CiMLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
DeltaDELTA is a deep learning based natural language and speech processing platform.
FastdeployDeploy DL/ ML inference pipelines with minimal extra code.
FoxcrossAsyncIO serving for data science models
ServingA flexible, high-performance serving system for machine learning models
Model serverA scalable inference server for models optimized with OpenVINO™
ServingA flexible, high-performance carrier for machine learning models(『飞桨』服务化部署框架)
VespaThe open big data serving engine. https://vespa.ai
Deep Learning In ProductionIn this repository, I will share some useful notes and references about deploying deep learning-based models in production.
serving-runtimeExposes a serialized machine learning model through a HTTP API.
evaExploratory Video Analytics System
dingoA Hybrid Serving & Analytical Processing Database.
tensorflow-serving-armTensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores
fasttext-servingServe your fastText models for text classification and word vectors