All Projects → etcd-io → Etcd

etcd-io / Etcd

Licence: apache-2.0
Distributed reliable key-value store for the most critical data of a distributed system

Programming Languages

go
31211 projects - #10 most used programming language
shell
77523 projects
Jsonnet
166 projects
Makefile
30231 projects
python
139335 projects - #7 most used programming language
Dockerfile
14818 projects

Projects that are alternatives of or similar to Etcd

Zookeeper
Apache ZooKeeper
Stars: ✭ 10,061 (-73.69%)
Mutual labels:  database, distributed-systems, key-value, consensus, distributed-database
Rqlite
The lightweight, distributed relational database built on SQLite
Stars: ✭ 9,147 (-76.08%)
Mutual labels:  database, consensus, distributed-database, raft, distributed-systems
Etcd Cloud Operator
Deploying and managing production-grade etcd clusters on cloud providers: failure recovery, disaster recovery, backups and resizing.
Stars: ✭ 149 (-99.61%)
Mutual labels:  database, etcd, distributed-database, distributed-systems
Js
Gryadka is a minimalistic master-master replicated consistent key-value storage based on the CASPaxos protocol
Stars: ✭ 304 (-99.2%)
Mutual labels:  key-value, consensus, distributed-database, distributed-systems
Elasticell
Elastic Key-Value Storage With Strong Consistency and Reliability
Stars: ✭ 453 (-98.82%)
Mutual labels:  key-value, distributed-database, raft, distributed-systems
Copycat
A novel implementation of the Raft consensus algorithm
Stars: ✭ 551 (-98.56%)
Mutual labels:  database, consensus, raft, distributed-systems
Raft
Raft Consensus Algorithm
Stars: ✭ 370 (-99.03%)
Mutual labels:  consensus, distributed-database, raft, distributed-systems
Hraftd
A reference use of Hashicorp's Raft implementation
Stars: ✭ 732 (-98.09%)
Mutual labels:  key-value, consensus, raft, distributed-systems
Verdi Raft
An implementation of the Raft distributed consensus protocol, verified in Coq using the Verdi framework
Stars: ✭ 143 (-99.63%)
Mutual labels:  key-value, consensus, raft, distributed-systems
Dbtester
Distributed database benchmark tester
Stars: ✭ 214 (-99.44%)
Mutual labels:  database, etcd, distributed-database, distributed-systems
Trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Stars: ✭ 4,581 (-88.02%)
Mutual labels:  database, distributed-database, distributed-systems
Permazen
Language-Natural Persistence Layer for Java
Stars: ✭ 265 (-99.31%)
Mutual labels:  database, key-value, raft
Gokv
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
Stars: ✭ 314 (-99.18%)
Mutual labels:  database, etcd, key-value
Paxosstore
PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend. Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.
Stars: ✭ 1,278 (-96.66%)
Mutual labels:  database, consensus, distributed-database
Dragonboat
Dragonboat is a high performance multi-group Raft consensus library in pure Go.
Stars: ✭ 3,983 (-89.58%)
Mutual labels:  consensus, raft, distributed-systems
raft-rocks
A simple database based on raft and rocksdb
Stars: ✭ 38 (-99.9%)
Mutual labels:  key-value, raft, consensus
coolbeans
Coolbeans is a distributed work queue that implements the beanstalkd protocol.
Stars: ✭ 56 (-99.85%)
Mutual labels:  distributed-systems, raft, consensus
Nuraft
C++ implementation of Raft core logic as a replication library
Stars: ✭ 428 (-98.88%)
Mutual labels:  consensus, raft, distributed-systems
Tikv
Distributed transactional key-value database, originally created to complement TiDB
Stars: ✭ 10,403 (-72.79%)
Mutual labels:  key-value, consensus, raft
Blog
my blog, using markdown
Stars: ✭ 25 (-99.93%)
Mutual labels:  etcd, raft, distributed-systems

etcd

Go Report Card Coverage Tests asset-transparency codeql-analysis self-hosted-linux-arm64-graviton2-tests Docs Godoc Releases LICENSE

Note: The main branch may be in an unstable or even broken state during development. For stable versions, see releases.

etcd Logo

etcd is a distributed reliable key-value store for the most critical data of a distributed system, with a focus on being:

  • Simple: well-defined, user-facing API (gRPC)
  • Secure: automatic TLS with optional client cert authentication
  • Fast: benchmarked 10,000 writes/sec
  • Reliable: properly distributed using Raft

etcd is written in Go and uses the Raft consensus algorithm to manage a highly-available replicated log.

etcd is used in production by many companies, and the development team stands behind it in critical deployment scenarios, where etcd is frequently teamed with applications such as Kubernetes, locksmith, vulcand, Doorman, and many others. Reliability is further ensured by rigorous testing.

See etcdctl for a simple command line client.

Community meetings

etcd contributors and maintainers have monthly (every four weeks) meetings at 11:00 AM (USA Pacific) on Thursday.

An initial agenda will be posted to the shared Google docs a day before each meeting, and everyone is welcome to suggest additional topics or other agendas.

Time:

Join Hangouts Meet: meet.google.com/umg-nrxn-qvs

Join by phone: +1 405-792-0633‬ PIN: ‪299 906‬#

Maintainers

MAINTAINERS strive to shape an inclusive open source project culture where users are heard and contributors feel respected and empowered. MAINTAINERS maintain productive relationships across different companies and disciplines. Read more about MAINTAINERS role and responsibilities.

Getting started

Getting etcd

The easiest way to get etcd is to use one of the pre-built release binaries which are available for OSX, Linux, Windows, and Docker on the release page.

For more installation guides, please check out play.etcd.io and operating etcd.

For those wanting to try the very latest version, build the latest version of etcd from the main branch. This first needs Go installed (version 1.16+ is required). All development occurs on main, including new features and bug fixes. Bug fixes are first targeted at main and subsequently ported to release branches, as described in the branch management guide.

Running etcd

First start a single-member cluster of etcd.

If etcd is installed using the pre-built release binaries, run it from the installation location as below:

/tmp/etcd-download-test/etcd

The etcd command can be simply run as such if it is moved to the system path as below:

mv /tmp/etcd-download-test/etcd /usr/local/bin/
etcd

If etcd is built from the main branch, run it as below:

./bin/etcd

This will bring up etcd listening on port 2379 for client communication and on port 2380 for server-to-server communication.

Next, let's set a single key, and then retrieve it:

etcdctl put mykey "this is awesome"
etcdctl get mykey

etcd is now running and serving client requests. For more, please check out:

etcd TCP ports

The official etcd ports are 2379 for client requests, and 2380 for peer communication.

Running a local etcd cluster

First install goreman, which manages Procfile-based applications.

Our Procfile script will set up a local example cluster. Start it with:

goreman start

This will bring up 3 etcd members infra1, infra2 and infra3 and optionally etcd grpc-proxy, which runs locally and composes a cluster.

Every cluster member and proxy accepts key value reads and key value writes.

Follow the steps in Procfile.learner to add a learner node to the cluster. Start the learner node with:

goreman -f ./Procfile.learner start

Install etcd client v3

go get go.etcd.io/etcd/client/v3

Next steps

Now it's time to dig into the full etcd API and other guides.

Contact

Contributing

See CONTRIBUTING for details on submitting patches and the contribution workflow.

Reporting bugs

See reporting bugs for details about reporting any issues.

Reporting a security vulnerability

See security disclosure and release process for details on how to report a security vulnerability and how the etcd team manages it.

Issue and PR management

See issue triage guidelines for details on how issues are managed.

See PR management for guidelines on how pull requests are managed.

etcd Emeritus Maintainers

These emeritus maintainers dedicated a part of their career to etcd and reviewed code, triaged bugs, and pushed the project forward over a substantial period of time. Their contribution is greatly appreciated.

  • Fanmin Shi
  • Anthony Romano

License

etcd is under the Apache 2.0 license. See the LICENSE file for details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].