All Projects → hit9 → Statsd Proxy

hit9 / Statsd Proxy

Fast consistent hashing proxy for etsy/statsd.

Programming Languages

c
50402 projects - #5 most used programming language

Statsd-Proxy

Proxy for etsy/statsd.

Why

etsy/statsd comes with a proxy in nodejs, and we are running it on a single server, proxing a statsd cluster via an udp port. But we found that this nodejs proxy is losing packets, up to 30~40% sometimes!

Cpus are idle but packets are being lost. In our case, one api call makes one statsd request, maybe the single udp socket is too busy.

We tried to use SO_REUSEPORT on the original nodejs proxy, this enables us to bind multiple udp sockets on a single port, but nodejs(or libuv) has disabled this option, and golang just dosen't have a method setsockopt().

Therefore, we made it in C.

Features

  • Zero dependencies.
  • Very very fast.
  • Multiple threading.
  • Reuseport support.
  • Packet aggregation.

Limitations

  • Only available on linux 3.9+ (option SO_REUSEPORT)
  • Only support udp server and udp backends.

Requirements

Linux 3.9+.

Build

$ ./autogen.sh
$ ./configure
$ make

Usage

Usage:
  ./statsd-proxy -f ./path/to/config.cfg
Options:
  -h, --help        Show this message
  -v, --version     Show version
  -d, --debug       Enable debug logging
Copyright (c) https://github.com/hit9/statsd-proxy

License

MIT (c) Chao Wang [email protected] 2015.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].