All Projects → artefactory → one-click-mlflow

artefactory / one-click-mlflow

Licence: LGPL-3.0 License
A tool to deploy a mostly serverless MLflow tracking server on a GCP project with one command

Programming Languages

HCL
1544 projects
shell
77523 projects
Makefile
30231 projects
Open Policy Agent
39 projects
Dockerfile
14818 projects

Projects that are alternatives of or similar to one-click-mlflow

deep autoviml
Build tensorflow keras model pipelines in a single line of code. Now with mlflow tracking. Created by Ram Seshadri. Collaborators welcome. Permission granted upon request.
Stars: ✭ 98 (+113.04%)
Mutual labels:  gcp, mlflow
resoto
Resoto - Find leaky resources, manage quota limits, detect drift, and clean up!
Stars: ✭ 562 (+1121.74%)
Mutual labels:  gcp
alpine-firestore-backup
Image that performs Firestore backups based on Alpine Google Cloud SDK image.
Stars: ✭ 23 (-50%)
Mutual labels:  gcp
restme
Template to bootstrap a fully functional, multi-region, REST service on GCP with a developer release pipeline.
Stars: ✭ 19 (-58.7%)
Mutual labels:  gcp
terraform-dcos
DC/OS Terraform Installation and Upgrading Scripts
Stars: ✭ 64 (+39.13%)
Mutual labels:  gcp
mlops-with-vertex-ai
An end-to-end example of MLOps on Google Cloud using TensorFlow, TFX, and Vertex AI
Stars: ✭ 155 (+236.96%)
Mutual labels:  gcp
cloud-desktops
Cloud-based Virtual Desktops on Google Cloud Platform
Stars: ✭ 14 (-69.57%)
Mutual labels:  gcp
gcp-class-1
Google Cloud class 1
Stars: ✭ 14 (-69.57%)
Mutual labels:  gcp
secrets-init
minimalistic init system for containers with AWS/GCP secrets support
Stars: ✭ 114 (+147.83%)
Mutual labels:  gcp
PDF-Bot
A bot for PDF for doing Many Things....
Stars: ✭ 38 (-17.39%)
Mutual labels:  gcp
opal
Policy and data administration, distribution, and real-time updates on top of Open Policy Agent
Stars: ✭ 459 (+897.83%)
Mutual labels:  gcp
gke-managed-certificates-demo
GKE ingress with GCP managed certificates
Stars: ✭ 21 (-54.35%)
Mutual labels:  gcp
gke-enterprise-mt
This repository hosts the terraform module that helps setup a GKE cluster and environment based on the Enterprise Multi-Tenancy Best Practices Guide.
Stars: ✭ 20 (-56.52%)
Mutual labels:  gcp
shamash
Autoscaling for Google Cloud Dataproc
Stars: ✭ 31 (-32.61%)
Mutual labels:  gcp
Microservices-Nodejs-React
Applying Microservices Architecture using nodejs, MongoDB, redis, and handling async communication using nats. Deploying all these in a kubernetes cluster hosted on gcp.
Stars: ✭ 18 (-60.87%)
Mutual labels:  gcp
Bank-Note-Authentication
💸 Authenticate Bank Notes on the basis of Genuity and Forged using Sklearn and deployed on Heroku and FastAPI Server 💳 💲
Stars: ✭ 17 (-63.04%)
Mutual labels:  gcp
pywedge
Makes Interactive Chart Widget, Cleans raw data, Runs baseline models, Interactive hyperparameter tuning & tracking
Stars: ✭ 49 (+6.52%)
Mutual labels:  mlflow
steampipe-plugin-gcp
Use SQL to instantly query GCP resources across regions, projects and organizations. Open source CLI. No DB required.
Stars: ✭ 12 (-73.91%)
Mutual labels:  gcp
dataflow-fsi-example
Using Google Cloud, this project is an example of how to detect anomalies in financial, technical indicators by modeling their expected distribution and thus inform when the Relative Strength Indicator (RSI) is unreliable.
Stars: ✭ 26 (-43.48%)
Mutual labels:  gcp
gcp-iap-auth
A simple server implementation and package in Go for helping you secure your web apps running on GCP behind a Cloud IAP (Identity-Aware Proxy)
Stars: ✭ 75 (+63.04%)
Mutual labels:  gcp

1. one-click-mlflow

A tool to deploy a mostly serverless MLflow on a GCP project with one command

1.1. How to use

1.1.1. Pre-requisites

  • A GCP project on which you are owner
  • Terraform, make, and jq installed
  • Initialized gcloud SDK with your owner account

1.1.2. Deploying

Clone the repo

Run make one-click-mlflow and let the wizard guide you.

If you want to see the innards, you can run it in debug mode: DEBUG=true make one-click-mlflow

1.1.3. What it does

  • Enables the necessary services
  • Builds and deploys the MLFlow docker image
  • Creates a private IP CloudSQL (MySQL) database for the tracking server
  • Creates an AppEngine Flex on the default service for the web UI, secured by IAP
  • Manages all the network magic
  • Creates the mlflow-log-pusher service account

Architecture

1.1.4. Other available make commands

  • make deploy: builds and pushes the application image and (re)deploys the infrastructure
  • make docker: builds and pushes the application image
  • make apply: (re)deploys the infrastructure
  • make destroy: destroys the infrastructure. Will not delete the OAuth consent screen, and the app engine application.

1.1.5. Pushing your first parameters, logs, artifacts

Once the deployment successful, you can start pushing to your MLFlow instance.

cd examples
python3 -m venv venv 
source venv/bin/activate
pip install -r requirements.txt
python track_experiment.py

You can than adapt examples/track_experiment.py and examples/mlflow_config.py to suit your application's needs.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].