117 Open source projects that are alternatives of or similar to Boostcamp-AI-Tech-Product-Serving

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Deployment template for a continuous training pipeline.

This repository provides AI/ML service(MachineLearning model serving) modernization solution using Amazon SageMaker, AWS CDK, and AWS Serverless services.

Serve your fastText models for text classification and word vectors

Spark ML Lib serving library

DELTA is a deep learning based natural language and speech processing platform.

HI-ML toolbox for deep learning for medical imaging and Azure integration

Feature Store for Machine Learning

Generic and easy-to-use serving service for machine learning models

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

A Python framework for creating reproducible, maintainable and modular data science code.

Exploratory Video Analytics System

Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀

A Hybrid Serving & Analytical Processing Database.

Monitor the stability of a Pandas or Spark dataframe ⚙︎

ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management

Meme serving with NLP

Learn how to responsibly deliver value with ML.

Kraken CI is a continuous integration and testing system.

🚀 Build and manage real-life data science projects with ease!

A scalable inference server for models optimized with OpenVINO™

MLOps Platform

Dataset format for AI. Build, manage, & visualize datasets for deep learning. Stream data real-time to PyTorch/TensorFlow & version-control it. https://activeloop.ai

The open big data serving engine. https://vespa.ai

End-to-end pipeline with TFX to train and deploy a BERT model for sentiment analysis.

Template repository to build PyTorch projects from source on any version of PyTorch/CUDA/cuDNN.

Knativeのコンポーネントを理解しながらFaaSプラットフォームをDIYするワークショップです

bring keras-models to production with tensorflow-serving and nodejs + docker 🍕

Reasonable API for serving TensorFlow models using Scala

Slack bot for monitoring your Metaflow flows!

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores

Projects developed by Domino's R&D team

Model Serving Made Easy

Deploy DL/ ML inference pipelines with minimal extra code.

Machine Learning Pipelines for Kubeflow

🎲 A curated list of MLOps projects, tools and resources

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

AsyncIO serving for data science models

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Public reusable components for Polyaxon

A curated list of references for MLOps

A flexible, high-performance serving system for machine learning models

Always know what to expect from your data.

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

Machine Learning Platform for Kubernetes (MLOps tools for experimentation and automation)

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

A Python framework for creating reproducible, maintainable and modular data science code.

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

Beneath is a serverless real-time data platform ⚡️

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

An end-to-end example of MLOps on Google Cloud using TensorFlow, TFX, and Vertex AI

Feast Java Components

Kubeflow pipelines built on top of Tensorflow TFX library

Subscribe to this GitHub repo to access the latest tech talks, tech demos, learning materials & modules, and developer community updates!

GitHub Action that allows you to register models to your Azure Machine Learning Workspace.

TensorFlow template application for deep learning

Exposes a serialized machine learning model through a HTTP API.

Kubernetes-friendly ML model management, deployment, and serving.