All Categories → No Category → model-serving

Top 11 model-serving open source projects

Deep Learning In Production

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

✭ 3,104

react deep-learning pytorch tutorial keras rest-api flask deep-neural-networks angularjs mxnet tensorflow-models production serving caffe2 tesnorflow model-serving serving-pytorch-models convert-pytorch-models

A scalable, high-performance serving system for federated learning models

✭ 107

java Vue go SCSS javascript shell monitor inference model-serving model-versioning federated-learning

serving-tensorflow-models

Serving TensorFlow models with TensorFlow Serving 📙

✭ 41

Jupyter Notebook machine-learning tensorflow image-classification tensorflow-serving model-deployment model-serving mlops serve-tensorflow-models

Serverless Inferencing on Kubernetes

✭ 1,621

python go shell kubernetes machine-learning tensorflow sklearn pytorch artificial-intelligence xgboost k8s service-mesh istio model-serving kubeflow knative model-interpretability kubeflow-pipelines kserve

Surround is a framework for building AI driven microservices in Python, https://surround.readthedocs.io/en/latest/

✭ 19

python data-science machine-learning pipeline-framework model-serving

fasttext-serving

fastText model serving service

✭ 54

rust python Dockerfile nlp fasttext model-serving model-server

BentoML Example Projects 🎨

✭ 120

python Jupyter Notebook shell data-science machine-learning gallery aws-lambda serverless machine-learning-library model-management azure-machine-learning model-deployment model-serving machine-learning-workflow gcp-cloud-functions aws-sagemaker bentoml

A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.

✭ 210

python visualization machine-learning deep-learning tensorflow image-processing pytorch image-classification image-dataset object-detection hacktoberfest bounding-boxes model-interpretation model-deployment model-serving model-visualization gradcam mlops fastapi

serving-pytorch-models

Serving PyTorch models with TorchServe 🔥

✭ 91

Jupyter Notebook machine-learning pytorch image-classification model-deployment model-serving pytorch-cnn mlops torchserve serve-pytorch

fdp-modelserver

An umbrella project for multiple implementations of model serving

✭ 47

scala java kafka akka-http tensorflow spark-streaming akka-streams pmml flink kafka-streams spark-ml model-serving

1-11 of 11 model-serving projects