All Projects → opensearch-project → data-prepper

opensearch-project / data-prepper

Licence: Apache-2.0 license
Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.

Programming Languages

java
68154 projects - #9 most used programming language
shell
77523 projects
typescript
32286 projects
ANTLR
299 projects
javascript
184084 projects - #8 most used programming language
Dockerfile
14818 projects

Projects that are alternatives of or similar to data-prepper

Logbook
An extensible Java library for HTTP request and response logging
Stars: ✭ 822 (+705.88%)
Mutual labels:  logs, observability
zinc
ZincSearch. A lightweight alternative to elasticsearch that requires minimal resources, written in Go.
Stars: ✭ 9,936 (+9641.18%)
Mutual labels:  logs, opensearch
Applicationinsights Home
Application Insights main repository for documentation of overall SDK offerings for all platforms.
Stars: ✭ 221 (+116.67%)
Mutual labels:  logs, observability
Opstrace
Secure observability, deployed in your own network. An open source alternative to SaaS solutions like Datadog, SignalFx, ...
Stars: ✭ 743 (+628.43%)
Mutual labels:  logs, observability
vector
A high-performance observability data pipeline.
Stars: ✭ 12,138 (+11800%)
Mutual labels:  logs, observability
Vector
A reliable, high-performance tool for building observability data pipelines.
Stars: ✭ 8,736 (+8464.71%)
Mutual labels:  logs, observability
Mtail
extract internal monitoring data from application logs for collection in a timeseries database
Stars: ✭ 3,028 (+2868.63%)
Mutual labels:  logs, observability
mongoproxy
Lightweight proxy to collect MongoDb client metrics
Stars: ✭ 26 (-74.51%)
Mutual labels:  observability
DebugWindow
一个在真机上测试时方便查看输出日志的小工具。(A debug tool which helps you view the console logs on the device when you test you APP.)
Stars: ✭ 36 (-64.71%)
Mutual labels:  logs
orb
Orb is a dynamic network observability platform
Stars: ✭ 437 (+328.43%)
Mutual labels:  observability
LogDNA-Android-Client
Android client for LogDNA
Stars: ✭ 22 (-78.43%)
Mutual labels:  logs
SWELF
Simple Windows Event Log Forwarder (SWELF). Its easy to use/simply works Log Forwarder and EVTX Parser. Almost in full release here at https://github.com/ceramicskate0/SWELF/releases/latest.
Stars: ✭ 23 (-77.45%)
Mutual labels:  logs
aws-otel-java-instrumentation
AWS Distro for OpenTelemetry Java Instrumentation Library
Stars: ✭ 41 (-59.8%)
Mutual labels:  observability
libreant
{,e}Book archive, focused on small grassroot archives, distributed search, support to different kind of objects
Stars: ✭ 18 (-82.35%)
Mutual labels:  opensearch
quickstart-thanos
A docker-compose stack for Thanos monitoring
Stars: ✭ 73 (-28.43%)
Mutual labels:  observability
logops
Really simple and performant logger for node projects compatible with any kind of deployments as your server operations/environment defined
Stars: ✭ 20 (-80.39%)
Mutual labels:  logs
terraform-aws-lb-s3-bucket
Terraform module to provision an S3 bucket with built in IAM policy to allow AWS Load Balancers to ship access logs
Stars: ✭ 29 (-71.57%)
Mutual labels:  logs
grblogtools
Extract and visualize information from Gurobi log files
Stars: ✭ 57 (-44.12%)
Mutual labels:  logs
memcache.php
Visibility for your memcache servers.
Stars: ✭ 54 (-47.06%)
Mutual labels:  observability
parca
Continuous profiling for analysis of CPU and memory usage, down to the line number and throughout time. Saving infrastructure cost, improving performance, and increasing reliability.
Stars: ✭ 2,834 (+2678.43%)
Mutual labels:  observability

Data Prepper

codecov

Data Prepper

We envision Data Prepper as an open source data collector for observability data (trace, logs, metrics) that can filter, enrich, transform, normalize, and aggregate data for downstream analysis and visualization. It will support stateful processing across multiple instances of data pipelines for observability use cases such as distributed tracing and multi-line log events (e.g. stack traces, aggregations, and log-to-metric transformations). Currently Data Prepper supports processing of distributed trace data and log ingestion with plans to support metric data in the future.

Please read the Overview to understand what Data Prepper is and how it works.

Getting Started

Our Getting Started guide is the best starting point for anybody who wants to run Data Prepper.

Please read the Trace Analytics guide or Log Analytics to get started with using Data Prepper for trace or log analytics use cases.

Project Resources

Contribute

We invite developers from the larger OpenSearch community to contribute and help improve test coverage and give us feedback on where improvements can be made in design, code and documentation. You can look at contribution guide for more information on how to contribute.

If you are looking to contribute code, or just to build from source, please see our Developer Guide.

Code of Conduct

This project has adopted an Open Source Code of Conduct.

Security Issue Notifications

If you discover a potential security issue in this project, please refer to the security policy.

License

This library is licensed under the Apache 2.0 License

Copyright

Copyright OpenSearch Contributors. See NOTICE for details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].