All Projects β†’ krystianity β†’ Keras Serving

krystianity / Keras Serving

Licence: apache-2.0
bring keras-models to production with tensorflow-serving and nodejs + docker πŸ•

Programming Languages

python
139335 projects - #7 most used programming language
cpp
1120 projects

Projects that are alternatives of or similar to Keras Serving

Ovpm
OpenVPN Management Server - Effortless and free OpenVPN server administration
Stars: ✭ 256 (+70.67%)
Mutual labels:  grpc, network
Deep Learning In Production
In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
Stars: ✭ 3,104 (+1969.33%)
Mutual labels:  serving, production
Core
Eru, a simple, stateless, flexible, production-ready orchestrator designed to easily integrate into existing workflows. Can run any virtualization things in long or short time.
Stars: ✭ 147 (-2%)
Mutual labels:  grpc, network
Flyte
Accelerate your ML and Data workflows to production. Flyte is a production grade orchestration system for your Data and ML workloads. It has been battle tested at Lyft, Spotify, freenome and others and truly open-source.
Stars: ✭ 1,242 (+728%)
Mutual labels:  grpc, production
Grpc Cmake Example
gRPC C++ example with CMake
Stars: ✭ 142 (-5.33%)
Mutual labels:  grpc
Grpc Haskell
gRPC library binding for Haskell.
Stars: ✭ 141 (-6%)
Mutual labels:  grpc
Lc kicad lib
kicad production symbol and footprint library auto convert from JLC's integrate Altium Designer library
Stars: ✭ 140 (-6.67%)
Mutual labels:  production
Asgard
Asgarde Framework
Stars: ✭ 138 (-8%)
Mutual labels:  grpc
Zeebe
Distributed Workflow Engine for Microservices Orchestration
Stars: ✭ 2,165 (+1343.33%)
Mutual labels:  grpc
Simplewall
Simple tool to configure Windows Filtering Platform (WFP) which can configure network activity on your computer.
Stars: ✭ 2,505 (+1570%)
Mutual labels:  network
Bodywork Core
Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps πŸš€
Stars: ✭ 145 (-3.33%)
Mutual labels:  serving
Ansible Role Nfs
Ansible Role - NFS
Stars: ✭ 141 (-6%)
Mutual labels:  network
Boost Asio Study
Examples and toturials for C++ Boost Asio library.
Stars: ✭ 144 (-4%)
Mutual labels:  network
Grpc Lb
Example for grpc-lb with etcd
Stars: ✭ 140 (-6.67%)
Mutual labels:  grpc
K8s Testsuite
Test suite for Kubernetes
Stars: ✭ 149 (-0.67%)
Mutual labels:  network
Td4a
Template designer for automation
Stars: ✭ 139 (-7.33%)
Mutual labels:  network
Go Micro Boilerplate
The boilerplate of the GoLang application with a clear microservices architecture.
Stars: ✭ 147 (-2%)
Mutual labels:  grpc
Pyfunceble
The tool to check the availability or syntax of domain, IP or URL.
Stars: ✭ 143 (-4.67%)
Mutual labels:  network
Gf Cli
GoFrame Command Line Interface, which is your helpmate for building GoFrame application with convenience.
Stars: ✭ 143 (-4.67%)
Mutual labels:  grpc
Networkgraph
基于D3.jsηš„Neo4jη½‘η»œε›Ύε―θ§†εŒ–(Visualization of Neo4j Network Graph Based on D3.js
Stars: ✭ 145 (-3.33%)
Mutual labels:  network

keras-serving

keras->tensorflow+grpc+docker=>nodejs 🐳πŸ”₯

  • example of bringing a keras model to production using tensorflow serving
  • using custom XOR model with tensor.proto dimensions example
  • building & training of the model works with python2.7 on the workstation
  • exported model is served via grpc in a C++ server using a Docker-Container
  • a nodejs server wraps the grpc api for a simple http POST endpoint
  • also ships an advanced multi-model face (emotion, gender) detection example /face-recog
  • and and advanced google bigquery (as dataaset) example /bigquery

Overview

Workflow (Unix - testen on Ubuntu 16.04 64bit)

You will need

python
pip
docker (docker-compose)

1. Install Requirements

./prepare.sh
# installs python dependencies via pip
# builds the docker image for tensorflow_serving (takes a while ~ 30 minutes)
# image size ~ 3.5 GB

checkout build troubleshoot if you are having trouble

2. Build, Train and Serialise Keras Model

python train.py
# results will be in (/result)

3. Load and export Model as Tensorflow Graph

python export.py
# results will be in (/export)

4. Build & Run Containers via docker-compose

./start-servers.sh
# ./stop-servers.sh

5. Test API via curl

curl -X POST \
  http://localhost:8080/predict-xor \
  -H 'cache-control: no-cache' \
  -H 'content-type: application/json' \
  -d '{"inputs": [0,1]}'
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].