All Projects → cosmo0920 → Fluent Bit Go Loki

cosmo0920 / Fluent Bit Go Loki

Licence: apache-2.0
[Deprecated] The predessor of fluent-bit output plugin for Loki. https://github.com/grafana/loki

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Projects that are alternatives of or similar to Fluent Bit Go Loki

Pathivu
An efficient log ingestion and log aggregation system https://pathivu.io/
Stars: ✭ 146 (+284.21%)
Mutual labels:  cloud-native, fluentd
kafka-consumer-lag-monitoring
Client tool that exports the consumer lag of Kafka consumer groups to Prometheus or your terminal
Stars: ✭ 45 (+18.42%)
Mutual labels:  grafana, cloud-native
Jmeter Elasticsearch Backend Listener
JMeter plugin that lets you send sample results to an ElasticSearch engine to enable live monitoring of load tests.
Stars: ✭ 72 (+89.47%)
Mutual labels:  plugin, grafana
Fluent Plugin Splunk Hec
This is the Fluentd output plugin for sending events to Splunk via HEC.
Stars: ✭ 56 (+47.37%)
Mutual labels:  plugin, fluentd
macropower-analytics-panel
It's like Google Analytics, but for Grafana dashboards!
Stars: ✭ 16 (-57.89%)
Mutual labels:  grafana, fluentd
dns-collector
Aggregator, analyzer, transporter and logging for your DNS logs
Stars: ✭ 58 (+52.63%)
Mutual labels:  grafana, fluentd
logging-operator
A golang based operator to create and manage EFK (Elasticsearch, Fluentd, and Kibana) stack on Kubernetes
Stars: ✭ 42 (+10.53%)
Mutual labels:  fluentd, cloud-native
Grafana Diagram
A Grafana plugin to visualize metrics in a diagram using flow charts, gantt charts, sequence diagrams, or class diagrams
Stars: ✭ 310 (+715.79%)
Mutual labels:  plugin, grafana
Oci Grafana Metrics
Grafana datasource plugin for OCI metrics
Stars: ✭ 34 (-10.53%)
Mutual labels:  plugin, grafana
prometheus-labs
Example Docker Cluster for "Full Stack Monitoring and Notification with Prometheus and Grafana"
Stars: ✭ 38 (+0%)
Mutual labels:  grafana, fluentd
cloud-computer
☁️ The Cloud Native Computer
Stars: ✭ 5 (-86.84%)
Mutual labels:  grafana, cloud-native
Zenko
Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.
Stars: ✭ 353 (+828.95%)
Mutual labels:  cloud-native, grafana
Ovh Warp10 Datasource
Grafana datasource for Warp10 platform
Stars: ✭ 33 (-13.16%)
Mutual labels:  grafana
Ununiga
[은는이가] 한글 조사(助詞) 대응 I18n engine extension
Stars: ✭ 34 (-10.53%)
Mutual labels:  plugin
Oc Toolbox Plugin
🧰 Toolbox plugin for October CMS
Stars: ✭ 33 (-13.16%)
Mutual labels:  plugin
Minimumaudioplugin
Minimum implementation of a native audio plugin for Unity
Stars: ✭ 33 (-13.16%)
Mutual labels:  plugin
Rabbitmq Delayed Message Exchange
Delayed Messaging for RabbitMQ
Stars: ✭ 982 (+2484.21%)
Mutual labels:  plugin
Appleseed Max
appleseed plugin for Autodesk® 3ds Max®
Stars: ✭ 34 (-10.53%)
Mutual labels:  plugin
Iota Prom Exporter
Iota Exporter for Prometheus Metrics
Stars: ✭ 33 (-13.16%)
Mutual labels:  grafana
Datasette Vega
Datasette plugin for visualizing data using Vega
Stars: ✭ 33 (-13.16%)
Mutual labels:  plugin

fluent-bit loki output plugin

NOTICE! fluent-bit-go-loki is now merged in loki repository.

Build Status Build status

Windows binaries are available in release pages.

DockerHub base images is available in DockerHub.

This plugin works with fluent-bit's go plugin interface. You can use fluent-bit loki to ship logs into grafana datasource with loki.

The configuration typically looks like:

fluent-bit → loki → grafana ← other grafana sources

Usage

$ fluent-bit -e /path/to/built/out_loki.so -c fluent-bit.conf

Or,

$ docker build . -t fluent-bit/loki-plugin

and then, specify Url parameter as environment variable:

$ docker run -it -e="LOKI_URL=http://[YOURHOST]:[YOURPORT]/loki/api/v1/push" fluent-bit/loki-plugin

Using docker image from docker hub.

$ docker pull cosmo0920/fluent-bit-go-loki:latest

Other released images are available in DockerHub's fluent-bit-go-loki image tags.

Prerequisites

  • Go 1.11+
  • gcc (for cgo)
  • make (for Makefile)

Building

$ make

Configuration Options

Key Description Default
Url Url of loki server API endpoint http://localhost:3100/loki/api/v1/push
BatchWait Time to wait before send a log batch to Loki, full or not. (unit: sec) 1 second
BatchSize Log batch size to send a log batch to Loki (unit: Bytes) 10 KiB (10*1024 Bytes)
Labels labels for API requests job="fluent-bit" (describe below)
LogLevel Specify log level info
RemoveKeys Comma separated list of needless record keys to remove. none
LabelKeys Comma separated list of keys to use as stream labels. none

Example:

add this section to fluent-bit.conf

[Output]
    Name loki
    Match *
    Url http://localhost:3100/loki/api/v1/push
    BatchWait 10 # (10msec)
    BatchSize 30 # (30KiB)
    Labels {test="fluent-bit-go",lang="Golang"}
    RemoveKeys key1,key2

Useful links

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].