GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → Tencent → Paxosstore

Tencent / Paxosstore

Licence: other
PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend. Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.

Labels

databaseconsensusdistributed-database

Projects that are alternatives of or similar to Paxosstore

Zookeeper
Apache ZooKeeper
Stars: ✭ 10,061 (+687.25%)
Mutual labels:  database, consensus, distributed-database
Etcd
Distributed reliable key-value store for the most critical data of a distributed system
Stars: ✭ 38,238 (+2892.02%)
Mutual labels:  database, consensus, distributed-database
Rqlite
The lightweight, distributed relational database built on SQLite
Stars: ✭ 9,147 (+615.73%)
Mutual labels:  database, consensus, distributed-database
Js
Gryadka is a minimalistic master-master replicated consistent key-value storage based on the CASPaxos protocol
Stars: ✭ 304 (-76.21%)
Mutual labels:  consensus, distributed-database
Trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Stars: ✭ 4,581 (+258.45%)
Mutual labels:  database, distributed-database
Crate
CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.
Stars: ✭ 3,254 (+154.62%)
Mutual labels:  database, distributed-database
Herddb
A JVM-embeddable Distributed Database
Stars: ✭ 192 (-84.98%)
Mutual labels:  database, distributed-database
Citus
Distributed PostgreSQL as an extension
Stars: ✭ 5,580 (+336.62%)
Mutual labels:  database, distributed-database
Raft
Raft Consensus Algorithm
Stars: ✭ 370 (-71.05%)
Mutual labels:  consensus, distributed-database
Corfudb
A cluster consistency platform
Stars: ✭ 539 (-57.82%)
Mutual labels:  database, distributed-database
Ghostdb
GhostDB is a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.
Stars: ✭ 690 (-46.01%)
Mutual labels:  database, distributed-database
apollo
An experimental distributed ledger platform based on a sea of DAG Nodes
Stars: ✭ 33 (-97.42%)
Mutual labels:  consensus, distributed-database
Dbtester
Distributed database benchmark tester
Stars: ✭ 214 (-83.26%)
Mutual labels:  database, distributed-database
Aviondb
A decentralised database with MongoDB-like developer interface (Fully Compatible with OrbitDB)
Stars: ✭ 301 (-76.45%)
Mutual labels:  database, distributed-database
Shardingsphere
Build criterion and ecosystem above multi-model databases
Stars: ✭ 14,989 (+1072.85%)
Mutual labels:  database, distributed-database
Cockroach
CockroachDB - the open source, cloud-native distributed SQL database.
Stars: ✭ 22,700 (+1676.21%)
Mutual labels:  database, distributed-database
Yugabyte Db
The high-performance distributed SQL database for global, internet-scale apps.
Stars: ✭ 5,890 (+360.88%)
Mutual labels:  database, distributed-database
Tidb
TiDB is an open source distributed HTAP database compatible with the MySQL protocol
Stars: ✭ 29,871 (+2237.32%)
Mutual labels:  database, distributed-database
Etcd Cloud Operator
Deploying and managing production-grade etcd clusters on cloud providers: failure recovery, disaster recovery, backups and resizing.
Stars: ✭ 149 (-88.34%)
Mutual labels:  database, distributed-database
Scalardb
Universal transaction manager
Stars: ✭ 178 (-86.07%)
Mutual labels:  database, distributed-database
View All Similar Projects ➔

PaxosStore

Build Status

PaxosStore is a distributed-database initially inspired by Google MegaStore. It's the second generation of storage system developed to support current WeChat sevice and applications. PaxosStore has been deployed in WeChat production for more than four years, providing storage services for the core businesses of WeChat backend including user account management, user relationship management (i.e., contacts), instant messaging, social networking (i.e., Moments), and online payment (i.e., WeChat Pay).

Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.

Prior to PaxosStore, we have been using a QuorumKV storage system to support various WeChat services with strongly consistent read/write since 2011. As the number of storage servers rises to tens of thousand, the operational mantenance and development of a NWR-based system in such a large scale become painful. That's why we come up with PaxosStore: a new generation of distributed database, built on top of the leaseless Paxos consensus layer, providing

  • Two paxos consensue libraries (the key algorithms described in our paper published at the VLDB 2017 are now open source):

    • Certain for the general PaxosLog + DB design;
    • PaxosKV optimized for key-value storage (PaxosLog-as-value);

    In addition, the following items are planned for open source by October 2017.

  • A high performance key-value system

  • A system that supports rich data structures such as queues, list, set and collections

  • A high performance storage engine backed by LSM-tree

  • A New SQL-like Table system

The PaxosStore Architecture

image

Please refer to the following publications for the technical details of PaxosStore.

Build

License

PaxosStore is under the BSD 3-Clause License. See the LICENSE.txt file for details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].