Apache Druid terraform

This is a Terraform module for installing Druid on your Kubernetes cluster. This modules uses normal Kubernetes definitions files instead of the Helm Chart. Despite the Helm chart would make this module way more smaller, we think that for faster testing and deployment, it would have been simpler using multiple yaml files rather then templating.

Currently the this module works only with S3. We ❤️ contributions! Open a PR to support multiple cloud providers.

Build the docker image

To build the Druid docker image, follow the steps below:

1. cd docker
2. docker build -t your-repo/druid:latest .
3. docker push your-repo/druid:latest

Remeber to use your own repository

Deploy the module

Once the image is built and pushed to the registry, you can install the module in your cluster.

It will take few minutes before it gets everything up and running. Once it's ready, you should be able to port-forward towards the Druid UI. To do so, run kubectl port-forward --namespace druid svc/router-cs 8888:8888, open your browser at http://localhost:8888/unified-console.html# and you should see the UI running. If you see 500 Errors within the boxes of the services, it means that it's not ready yet. Wait a little longer and then refresh. If it stays that way, you need to check where the error is.

If you are able to see all the services in the Druid UI it means that your cluster is ready to be used.

Affinity and AntiAffinity

In this module, we followed what the production documentation explains. The location/colocation of the services are done by associating the nodes according to the master, data and query services.

Postsgres resource

If you want to deploy Postgres without using different values for Database name, user and password, mind that you need to keep the same namespace as the druid resources. Those values are defined in a configmap and you cannot share configmaps across namespaces.

Requirements

Providers

Inputs

list(object({
    effect             = string
    key                = string
    operator           = string
    toleration_seconds = string
    value              = string
  }))

list(object({
    effect             = string
    key                = string
    operator           = string
    toleration_seconds = string
    value              = string
  }))

list(object({
    effect             = string
    key                = string
    operator           = string
    toleration_seconds = string
    value              = string
  }))

list(object({
    effect             = string
    key                = string
    operator           = string
    toleration_seconds = string
    value              = string
  }))

list(object({
    effect             = string
    key                = string
    operator           = string
    toleration_seconds = string
    value              = string
  }))

list(object({
    effect             = string
    key                = string
    operator           = string
    toleration_seconds = string
    value              = string
  }))

Outputs

No output.