Fluent Bit Aliyun

Fluent Bit output plugin which sends logs to Aliyun Simple Log Service(SLS). You can do realtime analysis and archiving using other Aliyun products. Check Aliyun documents for detailed usage.

Installing

Currently we only provide Docker image for Linux machines at Docker Hub. If you're not using Docker, you can compile the plugin from source.

Docker

Docker supports fluentd as a log driver. You can launch fluent-bit-aliyun in a container and ask Docker to send logs to it.

$ docker run -d --network host -e ALIYUN_ACCESS_KEY=YOUR_ACCESS_KEY -e ALIYUN_ACCESS_KEY_SECRET=YOUR_ACCESS_KEY_SECRET -e ALIYUN_SLS_PROJECT=YOUR_PROJECT -e ALIYUN_SLS_LOGSTORE=YOUR_LOGSTORE -e ALIYUN_SLS_ENDPOINT=cn-hangzhou.log.aliyuncs.com kubeup/fluent-bit-aliyun:v0.1.0 /fluent-bit/bin/fluent-bit -c /fluent-bit/etc/fluent-bit-forwarder.conf -e /fluent-bit/out_sls.so
$ docker run --log-driver=fluentd -d nginx

You can also set fluentd as your default log driver by adding --log-driver=fluentd to Docker daemon.

Kubernetes

We use DaemonSet to deploy fluent-bit-aliyun on all nodes which will collect Docker logs from all pods on each machine. The kubernetes filter will add tags from pod metadata.

First we create a Secret containing all the configurations.

$ kubectl create secret generic fluent-bit-config --namespace=kube-system --from-literal=ALIYUN_ACCESS_KEY=YOUR_ACCESS_KEY --from-literal=ALIYUN_ACCESS_KEY_SECRET=YOUR_ACCESS_KEY_SECRET --from-literal=ALIYUN_SLS_PROJECT=YOUR_PROJECT --from-literal=ALIYUN_SLS_LOGSTORE=YOUR_LOGSTORE --from-literal=ALIYUN_SLS_ENDPOINT=cn-hangzhou.log.aliyuncs.com

Then we deploy the DaemonSet.

$ kubectl create -f https://raw.githubusercontent.com/kubeup/fluent-bit-aliyun/master/fluent-bit-daemonset.yaml

We could check the status.

$ kubectl get pods --namespace=kube-system

Configurations

You can config the plugin using environment variables. We support these configs:

• ALIYUN_ACCESS_KEY
• ALIYUN_ACCESS_KEY_SECRET
• ALIYUN_SLS_PROJECT
• ALIYUN_SLS_LOGSTORE
• ALIYUN_SLS_ENDPOINT

You should consider creating a dedicated account in RAM just for logging for better security protection.