All Projects → timberio → Vector

timberio / Vector

Licence: mpl-2.0
A reliable, high-performance tool for building observability data pipelines.

Programming Languages

rust
11053 projects
CUE
23 projects
HTML
75241 projects
typescript
32286 projects
HCL
1544 projects
shell
77523 projects

Projects that are alternatives of or similar to Vector

vector
A high-performance observability data pipeline.
Stars: ✭ 12,138 (+38.94%)
Mutual labels:  events, pipeline, vector, logs, stream-processing, forwarder, observability
Mtail
extract internal monitoring data from application logs for collection in a timeseries database
Stars: ✭ 3,028 (-65.34%)
Mutual labels:  metrics, observability, logs
gateway
A proxy to buffer and forward metrics, events, and traces.
Stars: ✭ 94 (-98.92%)
Mutual labels:  metrics, forwarder, observability
Opstrace
Secure observability, deployed in your own network. An open source alternative to SaaS solutions like Datadog, SignalFx, ...
Stars: ✭ 743 (-91.49%)
Mutual labels:  metrics, observability, logs
Awesome Cybersecurity Datasets
A curated list of amazingly awesome Cybersecurity datasets
Stars: ✭ 380 (-95.65%)
Mutual labels:  events, logs
Go Syslog
Blazing fast syslog parser
Stars: ✭ 370 (-95.76%)
Mutual labels:  parser, logs
Riemann
A network event stream processing system, in Clojure.
Stars: ✭ 4,099 (-53.08%)
Mutual labels:  events, metrics
Swagger Stats
API Observability. Trace API calls and Monitor API performance, health and usage statistics in Node.js Microservices.
Stars: ✭ 559 (-93.6%)
Mutual labels:  metrics, observability
Benthos
Fancy stream processing made operationally mundane
Stars: ✭ 3,705 (-57.59%)
Mutual labels:  stream-processing, logs
Stream Json
The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.
Stars: ✭ 462 (-94.71%)
Mutual labels:  parser, stream-processing
Grafterm
Metrics dashboards on terminal (a grafana inspired terminal version)
Stars: ✭ 613 (-92.98%)
Mutual labels:  metrics, observability
Length.js
📏 JavaScript library for length units conversion.
Stars: ✭ 292 (-96.66%)
Mutual labels:  parser, metrics
Skywalking
APM, Application Performance Monitoring System
Stars: ✭ 18,341 (+109.95%)
Mutual labels:  metrics, observability
Kubernetes Event Exporter
Export Kubernetes events to multiple destinations with routing and filtering
Stars: ✭ 395 (-95.48%)
Mutual labels:  events, observability
Kibana
Your window into the Elastic Stack
Stars: ✭ 16,820 (+92.54%)
Mutual labels:  metrics, observability
Docker monitoring logging alerting
Docker host and container monitoring, logging and alerting out of the box using cAdvisor, Prometheus, Grafana for monitoring, Elasticsearch, Kibana and Logstash for logging and elastalert and Alertmanager for alerting.
Stars: ✭ 479 (-94.52%)
Mutual labels:  metrics, logs
Telemetry
Dynamic dispatching library for metrics and instrumentations.
Stars: ✭ 647 (-92.59%)
Mutual labels:  events, metrics
Sensu Go
Simple. Scalable. Multi-cloud monitoring.
Stars: ✭ 625 (-92.85%)
Mutual labels:  metrics, observability
Sls Dev Tools
Dev Tools for the Serverless World - Issues, PRs and ⭐️welcome!
Stars: ✭ 662 (-92.42%)
Mutual labels:  metrics, observability
Kube State Metrics
Add-on agent to generate and expose cluster-level metrics.
Stars: ✭ 3,433 (-60.7%)
Mutual labels:  metrics, observability

Quickstart  •   Docs  •   Guides  •   Integrations  •   Chat  •   Download

Vector

What is Vector?

Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data. Collect, transform, and route all your logs, metrics, and traces to any vendors you want today and any other vendors you may want tomorrow. Vector enables dramatic cost reduction, novel data enrichment, and data security where you need it, not where it is most convenient for your vendors. Additionally, it is open source and up to 10x faster than every alternative in the space.

To get started, follow our quickstart guide or install Vector.

Principles

  • Reliable - Built in Rust, Vector's primary design goal is reliability.
  • End-to-end - Deploys as an agent or aggregator. Vector is a complete platform.
  • Unified - Logs, metrics, and traces (coming soon). One tool for all of your data.

Use cases

  • Reduce total observability costs.
  • Transition vendors without disrupting workflows.
  • Enhance data quality and improve insights.
  • Consolidate agents and eliminate agent fatigue.
  • Improve overall observability performance and reliability.

Community

  • Vector is relied on by startups and enterprises like Atlassian, T-Mobile, Comcast, Zendesk, Discord, Fastly, CVS, Trivago, Tuple, Douban, Visa, Mambu, Blockfi, Claranet, Instacart, Forcepoint, and many more.
  • Vector is downloaded over 100,000 times per day.
  • Vector's largest user processes over 30TB daily.
  • Vector has over 100 contributors and growing.

Documentation

About

Setup

Reference

Administration

Resources

Comparisons

Performance

The following performance tests demonstrate baseline performance between common protocols with the exception of the Regex Parsing test.

Test Vector Filebeat FluentBit FluentD Logstash SplunkUF SplunkHF
TCP to Blackhole 86mib/s n/a 64.4mib/s 27.7mib/s 40.6mib/s n/a n/a
File to TCP 76.7mib/s 7.8mib/s 35mib/s 26.1mib/s 3.1mib/s 40.1mib/s 39mib/s
Regex Parsing 13.2mib/s n/a 20.5mib/s 2.6mib/s 4.6mib/s n/a 7.8mib/s
TCP to HTTP 26.7mib/s n/a 19.6mib/s <1mib/s 2.7mib/s n/a n/a
TCP to TCP 69.9mib/s 5mib/s 67.1mib/s 3.9mib/s 10mib/s 70.4mib/s 7.6mib/s

To learn more about our performance tests, please see the Vector test harness.

Correctness

The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:

Test Vector Filebeat FluentBit FluentD Logstash Splunk UF Splunk HF
Disk Buffer Persistence
File Rotate (create)
File Rotate (copytruncate)
File Truncation
Process (SIGHUP)
JSON (wrapped)

To learn more about our correctness tests, please see the Vector test harness.

Features

Vector is an end-to-end, unified, open data platform.

Vector Beats Fluentbit Fluentd Logstash Splunk UF Splunk HF
End-to-end
Agent
Aggregator
Unified
Logs
Metrics
Traces 🚧
Open
Open-source
Vendor-neutral
Reliability
Memory-safe
Delivery guarantees
Multi-core

= Not interoperable, metrics are represented as structured logs


Developed with ❤️ by Datadog - Security Policy - Privacy Policy

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].