Naisible

Naisable is a collection of ansible playbooks used to build, test and tear down NAIS kubernetes cluster.

Prerequisites

• Ansible binaries
• An inventory file
• SSH access to the hosts using keys
• A user with passwordless sudo privileges on the hosts

Building and testing an environment

ansible-playbook -i inventory-file setup-playbook.yaml && \
ansible-playbook -i inventory-file test-playbook.yaml

Removing NAIS from hosts

ansible-playbook -i inventory-file teardown-playbook.yaml

Playbook details

Setup Playbook

1. All nodes
   1. Install Webproxy certificate and update truststore
   2. Add Kubernetes RPM repository
   3. Add Docker RPM repository
2. Master Node
   1. Fetch existing cluster certificates, if they exist
3. Ansible master node
   1. Create cluster certificates, if not fetched from NAIS master
4. All etcd Nodes
   1. Configure cluster
   2. Configure etcd backup
5. First etcd Node
   1. Add flannel configuration to etcd
6. Master Node
   1. Copy cluster certificates
7. All nodes
   1. Install and enable Flannel
   2. Install and enable Docker
   3. Install and enable kube-proxy
   4. Configure iptables
8. Master Node
   1. Install and enable Kubelet
   2. Install and enable kubernets controle plane
      1. kube-apiserver
      2. kube-scheduler
      3. kube-controller-manager
9. Worker Nodes
   1. Copy cluster certificates
   2. Install and enable Kubelet
   3. Enable monitoring
10. All nodes
    1. Setup kubeconfig for API server access
    2. Taint nodes
    3. Label nodes
11. Master Node
    1. Install and enable Kubelet
    2. Install and enable addons:
       1. core-dns
    3. Enable monitoring

Teardown Playbook

Test Playbook

NAIS inventory file

Template for creating a NAIS cluster inventory file.

Each inventory file consist of a hosts section, where the master and worker nodes are defined, and a variables section, where both versions and cluster specific information.

Hosts

[masters]
<K8S-master-hostname>

[workers]
<K8S-worker-hostname-1>
<K8S-worker-hostname-n>

[etcd]
<etcd-node-hostname-1>
<etcd-node-hostname-n>

[ceph_nodes]
<ceph-node-hostname-1>
<ceph-node-hostname-n>

[ceph_daemon_nodes]
<ceph-daemon-node-hostname-1>
<ceph-daemon-node-hostname-n>

Variables

Version specific variables. Configured in group_vars/all

Cluster specific variables

Host group specific variables