38 Open source projects that are alternatives of or similar to tfModelServing4s

⚡ Functional Scala HTTP server, client, and toolkit.

Spark ML Lib serving library

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

Code template for workshop "Building eDSLs in functional TypeScript"

Workshop On Tagless Final Interpreters

A Hybrid Serving & Analytical Processing Database.

TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores

Serve your fastText models for text classification and word vectors

Scala library to describe sharded and event sourced entities using tagless-final algebras

[Machine Learning Engineer Basic Guide] 부스트캠프 AI Tech - Product Serving 자료

Example telegram bot implementation using fs2 and http4s client (no akka)

Small CLI app for filtering out music on Spotify.

Deployment template for a continuous training pipeline.

Compact binary for integrating Nelson with your CI

Helpers for cats & cats-effect

An example of how to create services using tagless final

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

MLOps Platform

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

TensorFlow template application for deep learning

bring keras-models to production with tensorflow-serving and nodejs + docker 🍕

Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

DELTA is a deep learning based natural language and speech processing platform.

Deploy DL/ ML inference pipelines with minimal extra code.

Meme serving with NLP

AsyncIO serving for data science models

Generic and easy-to-use serving service for machine learning models

A flexible, high-performance serving system for machine learning models

A scalable inference server for models optimized with OpenVINO™

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

The open big data serving engine. https://vespa.ai

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Feast Java Components

Exposes a serialized machine learning model through a HTTP API.

This repository provides AI/ML service(MachineLearning model serving) modernization solution using Amazon SageMaker, AWS CDK, and AWS Serverless services.

Knativeのコンポーネントを理解しながらFaaSプラットフォームをDIYするワークショップです

Exploratory Video Analytics System