191 Open source projects that are alternatives of or similar to spark-ml-serving

A scalable inference server for models optimized with OpenVINO™

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

Exposes a serialized machine learning model through a HTTP API.

DELTA is a deep learning based natural language and speech processing platform.

TensorFlow template application for deep learning

RidgeRun Inference Framework

🔮 Use TensorFlow models in Go to evaluate Images (and more soon!)

MONAI Deploy aims to become the de-facto standard for developing, packaging, testing, deploying and running medical AI applications in clinical production.

A Python toolkit for (simulation-based) inference and the mechanization of science.

Сompresssing First Order Motion Model for Image Animation to enable its real-time inference on mobile devices

Companion code for the Unity Style Transfer blog post, showcasing realtime style transfer using Barracuda.

A Python package for approximate Bayesian inference and optimization using Gaussian processes

MLSS 2016 material.

📚 🔬 PIA - Protein Inference Algorithms

JSON schema validator

This tutorial series provides step-by-step instructions for how to perform human pose estimation in Unity with the Barracuda inference library.

Example notebooks for working with SageMaker Studio Lab. Sign up for an account at the link below!

This repository contains the dataset and the PyTorch implementations of the models from the paper Recognizing Emotion Cause in Conversations.

Inference Model Manager for Kubernetes

Rules for Kiwi.com travelling salesman competition

Gaussian dynamic Bayesian networks structure learning and inference based on the bnlearn package

Calculate average score and rating based on Wilson Score Equation

Graphsignal Python agent

DAWNBench: An End-to-End Deep Learning Benchmark and Competition

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

A free, open-source inference and learning library for Sum-Product Networks (SPN)

TypeDB: a strongly-typed database

TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores

A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用。

[This project has moved to ChainerCV] Chainer Implementation of Fully Convolutional Instance-aware Semantic Segmentation

TypeDB: a strongly-typed database

A prototype that demonstrates a method for scoring how well Windows systems have implemented some of the top 10 Information Assurance mitigation strategies. #nsacyber

Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints

This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use their own XGBoost scripts in SageMaker.

Serve your fastText models for text classification and word vectors

Latent Dirichlet Allocation

[Machine Learning Engineer Basic Guide] 부스트캠프 AI Tech - Product Serving 자료

Julia package for automatic Bayesian inference on a factor graph with reactive message passing

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Monitor mechanical bolts as they move down a conveyor belt. When a bolt of an irregular size is detected, this solution emits an alert.

Deployment template for a continuous training pipeline.

Create a concurrent video analysis pipeline featuring multistream face and human pose detection, vehicle attribute detection, and the ability to encode multiple videos to local storage in a single stream.

⏱ Benchmarks of machine learning inference for Go

🚥 S&P of Blockchains

Detect various irregularities of a product as it moves along a conveyor belt.

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

The challenge projects for Inferencing machine learning models on iOS

Build an application that alerts you when someone enters a restricted area. Learn how to use models for multiclass object detection.

Model Zoo for Intel® Architecture: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors

Observe workers as they pass in front of a camera to determine if they have adequate safety protection.

Adlik: Toolkit for Accelerating Deep Learning Inference

The purpose of this project is to apply mediapipe to more AI chips.

This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.

Explore the Capabilities of the TensorRT Platform

A Hybrid Serving & Analytical Processing Database.

IGoR is a C++ software designed to infer V(D)J recombination related processes from sequencing data. Find full documentation at:

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x

Collection of data sets of molecules for a validation of properties inference