All Projects → pwillie → Prometheus Es Adapter

pwillie / Prometheus Es Adapter

Licence: apache-2.0
Prometheus remote storage adapter for Elasticsearch

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Projects that are alternatives of or similar to Prometheus Es Adapter

Haproxy Configs
80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.
Stars: ✭ 106 (+85.96%)
Mutual labels:  elasticsearch, prometheus
K8s Tew
Kubernetes - The Easier Way
Stars: ✭ 269 (+371.93%)
Mutual labels:  elasticsearch, prometheus
Alertmanager2es
Receives HTTP webhook notifications from AlertManager and inserts them into an Elasticsearch index for searching and analysis
Stars: ✭ 173 (+203.51%)
Mutual labels:  elasticsearch, prometheus
Elasticsearch exporter
Elasticsearch stats exporter for Prometheus
Stars: ✭ 1,189 (+1985.96%)
Mutual labels:  elasticsearch, prometheus
Elasticsearch Prometheus Exporter
Prometheus exporter plugin for Elasticsearch
Stars: ✭ 409 (+617.54%)
Mutual labels:  elasticsearch, prometheus
Homer App
HOMER 7.x Front-End and API Server
Stars: ✭ 88 (+54.39%)
Mutual labels:  elasticsearch, prometheus
K8s
Important production-grade Kubernetes Ops Services
Stars: ✭ 253 (+343.86%)
Mutual labels:  elasticsearch, prometheus
Prometheus Es Exporter
Prometheus Elasticsearch Exporter
Stars: ✭ 184 (+222.81%)
Mutual labels:  elasticsearch, prometheus
Awesome Monitoring
INFRASTRUCTURE、OPERATION SYSTEM and APPLICATION monitoring tools for Operations.
Stars: ✭ 356 (+524.56%)
Mutual labels:  elasticsearch, prometheus
Helm Monitor
Monitor K8S Helm release, rollback on metrics behavior (Prometheus, Elasticsearch, Sentry)
Stars: ✭ 332 (+482.46%)
Mutual labels:  elasticsearch, prometheus
Graylog Plugin Metrics Reporter
Graylog Metrics Reporter Plugins
Stars: ✭ 71 (+24.56%)
Mutual labels:  elasticsearch, prometheus
Books Recommendation
程序员进阶书籍(视频),持续更新(Programmer Books)
Stars: ✭ 558 (+878.95%)
Mutual labels:  elasticsearch, prometheus
Kubernetes Learning
《从Docker到Kubernetes进阶课程》在线文档
Stars: ✭ 1,128 (+1878.95%)
Mutual labels:  elasticsearch, prometheus
Grafana
The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
Stars: ✭ 45,930 (+80478.95%)
Mutual labels:  elasticsearch, prometheus
Hastic Server
Hastic data management server for analyzing patterns and anomalies from Grafana
Stars: ✭ 292 (+412.28%)
Mutual labels:  elasticsearch, prometheus
Docker monitoring logging alerting
Docker host and container monitoring, logging and alerting out of the box using cAdvisor, Prometheus, Grafana for monitoring, Elasticsearch, Kibana and Logstash for logging and elastalert and Alertmanager for alerting.
Stars: ✭ 479 (+740.35%)
Mutual labels:  elasticsearch, prometheus
Homer7 Docker
HOMER 7 Docker Images
Stars: ✭ 47 (-17.54%)
Mutual labels:  elasticsearch, prometheus
Elasticsearch Synonyms
Curated synonym files and Helpers for Elasticsearch Synonym Token Filter
Stars: ✭ 51 (-10.53%)
Mutual labels:  elasticsearch
Aspnetcorenlog
ASP.NET Core NLog MS SQL Server PostgreSQL MySQL Elasticsearch
Stars: ✭ 54 (-5.26%)
Mutual labels:  elasticsearch
Phpfpm exporter
Prometheus exporter for PHP-FPM.
Stars: ✭ 51 (-10.53%)
Mutual labels:  prometheus

prometheus-es-adapter

Please note: This project is no longer under active development.

Overview

A read and write adapter for prometheus persistent storage.

Exposed Endpoints

Port Path Description
8000 /read Prometheus remote read endpoint
8000 /write Prometheus remote write endpoint
9000 /metrics Surface Prometheus metrics
9000 /live Http probe endpoint to reflect service liveness
9000 /ready Http probe endpoint reflecting the connection to and state of the Elasticsearch cluster

Config

Env Variables Default Description
ES_URL http://localhost:9200 Elasticsearch URL
ES_USER Elasticsearch User
ES_PASSWORD Elasticsearch User Password
ES_WORKERS 1 Number of batch workers
ES_BATCH_MAX_AGE 10 Max period in seconds between bulk Elasticsearch insert operations
ES_BATCH_MAX_DOCS 1000 Max items for bulk Elasticsearch insert operation
ES_BATCH_MAX_SIZE 4096 Max size in bytes for bulk Elasticsearch insert operation
ES_ALIAS prom-metrics Elasticsearch alias pointing to active write index
ES_INDEX_DAILY false Create daily indexes and disable index rollover
ES_INDEX_SHARDS 5 Number of Elasticsearch shards to create per index
ES_INDEX_REPLICAS 1 Number of Elasticsearch replicas to create per index
ES_INDEX_MAX_AGE 7d Max age of Elasticsearch index before rollover
ES_INDEX_MAX_DOCS 1000000 Max number of docs in Elasticsearch index before rollover
ES_INDEX_MAX_SIZE Max size of index before rollover eg 5gb
ES_SEARCH_MAX_DOCS 1000 Max number of docs returned for Elasticsearch search operation
ES_SNIFF false Enable Elasticsearch sniffing
STATS true Expose Prometheus metrics endpoint
DEBUG false Display extra debug logs

Notes

Although prometheus-es-adapter will create and rollover Elasticsearch indicies it is expected that a tool such as Elasticsearch Curator will be used to maintain quiescent indicies eg deleting, shrinking and merging old indexes.

Requirements

  • 6.x Elastisearch cluster

Getting started

Automated builds of Docker image are available at https://hub.docker.com/r/pwillie/prometheus-es-adapter/.

Contributing

Local development requires Go to be installed. On OS X with Homebrew you can just run brew install go.

Running it then should be as simple as:

$ make build
$ ./bin/prometheus-es-adapter

Testing

make test

e2e

To run end to end tests using docker-compose, from the "test" directory:

docker-compose up -d
docker-compose ps
docker-compose up -d --build prometheus-es-adapter
docker-compose logs -f prometheus-es-adapter
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].