All Projects → GoogleCloudPlatform → Cloud Ops Sandbox

GoogleCloudPlatform / Cloud Ops Sandbox

Licence: apache-2.0
Cloud Operations Sandbox is an open source tool that helps practitioners to learn Service Reliability Engineering practices from Google and apply them on their cloud services using Cloud Operations suite of tools.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Cloud Ops Sandbox

Devops Readme.md
What to Read to Learn More About DevOps
Stars: ✭ 398 (+108.38%)
Mutual labels:  cloud, cloud-native, devops, sre
Howtheyaws
A curated collection of publicly available resources on how technology and tech-savvy organizations around the world use Amazon Web Services (AWS)
Stars: ✭ 389 (+103.66%)
Mutual labels:  cloud, cloud-native, devops, sre
Trusted Overlord
Aggregate AWS Trusted Advisor alarms, AWS Health notifications and AWS Support cases from several AWS accounts
Stars: ✭ 73 (-61.78%)
Mutual labels:  cloud, devops, operations
K3sup
bootstrap Kubernetes with k3s over SSH < 1 min 🚀
Stars: ✭ 4,012 (+2000.52%)
Mutual labels:  cloud, cloud-native, devops
My Links
Knowledge seeks no man
Stars: ✭ 311 (+62.83%)
Mutual labels:  cloud, devops, sre
Rundeck
Enable Self-Service Operations: Give specific users access to your existing tools, services, and scripts
Stars: ✭ 4,426 (+2217.28%)
Mutual labels:  devops, sre, operations
Marmot
Marmot workflow execution engine
Stars: ✭ 174 (-8.9%)
Mutual labels:  google-cloud, devops, sre
Runbook
A framework for gradual system automation
Stars: ✭ 531 (+178.01%)
Mutual labels:  devops, sre, operations
Cloudprober
An active monitoring software to detect failures before your customers do.
Stars: ✭ 1,269 (+564.4%)
Mutual labels:  cloud, devops, sre
Lastbackend
System for containerized apps management. From build to scaling.
Stars: ✭ 1,536 (+704.19%)
Mutual labels:  cloud, devops
Apisix Docker
the docker for Apache APISIX
Stars: ✭ 119 (-37.7%)
Mutual labels:  cloud-native, devops
Sre Book In Audio
Google Site Reliability Engineering book converted in audio
Stars: ✭ 130 (-31.94%)
Mutual labels:  devops, sre
Hashi Up
bootstrap HashiCorp Consul, Nomad, or Vault over SSH < 1 minute
Stars: ✭ 113 (-40.84%)
Mutual labels:  cloud, devops
Site Reliability Engineer Guide
Stars: ✭ 112 (-41.36%)
Mutual labels:  cloud, sre
Training
Container, Monitoring & Logging, Cloud & DevOps Tutorials and Labs
Stars: ✭ 121 (-36.65%)
Mutual labels:  cloud, devops
Gocloud
☁️ Go API for open cloud
Stars: ✭ 112 (-41.36%)
Mutual labels:  cloud, google-cloud
Juju
Universal Operator Lifecycle Manager (OLM) for Kubernetes operators, and operators for traditional Linux and Windows apps, with declarative integration between operators for automated microservice integration.
Stars: ✭ 1,942 (+916.75%)
Mutual labels:  devops, operations
Vald
Vald. A Highly Scalable Distributed Vector Search Engine
Stars: ✭ 158 (-17.28%)
Mutual labels:  cloud, cloud-native
Micro
Micro is a distributed cloud operating system
Stars: ✭ 10,778 (+5542.93%)
Mutual labels:  cloud, cloud-native
Terrahub
Terraform Automation and Orchestration Tool (Open Source)
Stars: ✭ 148 (-22.51%)
Mutual labels:  cloud, devops

Cloud Operations Sandbox (Alpha)

Continuous Integration

Cloud Operations Sandbox is an open-source tool that helps practitioners to learn Service Reliability Engineering practices from Google and apply them on their cloud services using Ops Management (formerly Stackdriver). It is based on Hipster Shop, a cloud-native microservices application.

Sandbox offers:

  • Demo Service - an application built using microservices architecture on modern, cloud-native stack.
  • One-click deployment - a script handles the work of deploying the service to Google Cloud Platform.
  • Load Generator - a component that produces synthetic traffic on a demo service.
  • (Soon) SRE Runbook - pre-built routine procedures for operating the deployed sample service that follow best SRE practices using Ops Management.

Why Sandbox

Google Cloud Ops Management is a suite of tools that helps you gain full observability of your code and applications. You might want to take Ops Management to a "test drive" in order to answer the question, "will it work for my application needs"? The most effective way to learn is by testing the tool in "real-life" conditions, but without risking a production system. With Sandbox, we provide a tool that automatically provisions a new demo cluster, which receives traffic, simulating real users. Practicioners can experiment with various Ops Management tools to solve problems and accomplish standard SRE tasks in a sandboxed environment.

Getting Started

Using Sandbox

Prerequisites

Set Up

Click the Cloud Shell button for automated one-click installation of a new Sandbox cluster in a new Google Cloud Project.

Open in Cloud Shell

Note: If installation stops due to billing account errors, set up the billing account and type: sandboxctl create.

Next Steps

Clean Up

When you are done using Cloud Operations Sandbox, you can tear down the environment by deleting the GCP project that was set up for you. This can be accomplished in any of the following ways:

  • Use the sandboxctl script:
sandboxctl destroy
  • If you no longer have the Cloud Operations Sandbox files downloaded, delete your project manually using gcloud
gcloud projects delete $YOUR_PROJECT_ID

Service Overview

This project contains a multi-tier microservices application. It is a web-based e-commerce app called “Hipster Shop”, where users can browse items, add them to the cart, and purchase them.

Screenshots

Home Page Checkout Screen
Screenshot of store homepage Screenshot of checkout screen

Service Architecture

Hipster Shop is composed of many microservices, written in different languages, that talk to each other over gRPC and REST API.

We are not endorsing the architecture of Hipster Shop as the best way to build such a shop! The architecture is optimized for learning purposes and includes modern stack: Kubernetes, GKE, Istio, Ops Management, App Engine, gRPC, OpenTelemetry, and similar cloud-native technologies.

Architecture of microservices

Find the gRPC protocol buffer descriptions in the ./pb directory.

Service Language Description
frontend Go Exposes an HTTP server to serve the website. Does not require signup/login, and generates session IDs for all users automatically.
cartservice C# Manages the items in the user's shipping cart by using Redis.
productcatalogservice Go Provides the list of products from a JSON file and the ability to search and retrieve products.
currencyservice Node.js Converts one currency to another, using real values fetched from the European Central Bank. It's the highest QPS service.
paymentservice Node.js Charges the given credit card info (hypothetically😇) with the given amount and returns a transaction ID.
shippingservice Go Gives shipping-cost estimates based on the shopping cart. Ships items to the given address (hypothetically😇).
emailservice Python Sends users an order-confirmation email (hypothetically😇).
checkoutservice Go Retrieves a user's cart, prepares the order, and orchestrates payment, shipping, and email notification.
recommendationservice Python Recommends other products based on what's in the user's cart.
adservice Java Provides text ads based on given context words.
loadgenerator Python/Locust Continuously sends requests that imitate realistic shopping flows to the frontend.
ratingservice Python3 Manages ratings of the shop's products. Runs on App Engine.

Technologies

  • Kubernetes/GKE: The app is designed to run on Google Kubernetes Engine.
  • gRPC: Microservices use a high volume of gRPC calls to communicate to each other.
  • OpenTelemetry Tracing: Most services are instrumented using OpenTelemetry tracers and interceptors which handle trace context propagation through gRPC and HTTP.
  • Ops Management APM and SRE: Many services are instrumented with Profiling, Tracing, Debugging, Monitoring, Logging and Error Reporting.
  • Skaffold: A tool used for doing repeatable deployments. You can deploy to Kubernetes with a single command using Skaffold.
  • Synthetic Load Generation: The application demo comes with dedicated load generation service that creates realistic usage patterns on Hipster Shop website using Locust load generator.
  • Google App Engine: PaaS for running Web applications and services.
  • Google Cloud SQL: Fully managed relational database service for MySQL, PostgreSQL and SQL Server.

For Developers

If you are a developer and want to contribute to the Sandbox, you can refer to CONTIBUTING.md.


This is not an official Google project.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].