GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → moiot → Gravity

moiot / Gravity

Licence: apache-2.0
A Data Replication Center

Programming Languages

go
31211 projects - #10 most used programming language
gravity
16 projects

Labels

mysqlstoragereplication

Projects that are alternatives of or similar to Gravity

Synch
Sync data from the other DB to ClickHouse(cluster)
Stars: ✭ 200 (-68.5%)
Mutual labels:  mysql, replication
Glusterfs
Gluster Filesystem : Build your distributed storage in minutes
Stars: ✭ 3,437 (+441.26%)
Mutual labels:  storage, replication
Php Mysql Replication
Pure PHP Implementation of MySQL replication protocol. This allow you to receive event like insert, update, delete with their data and raw SQL queries.
Stars: ✭ 213 (-66.46%)
Mutual labels:  mysql, replication
Drc
MySQL active-active replication solution.
Stars: ✭ 92 (-85.51%)
Mutual labels:  mysql, replication
Symmetric Ds
SymmetricDS is a database and file synchronization solution that is platform-independent, web-enabled, and database agnostic. SymmetricDS was built to make data replication across two to tens of thousands of databases and file systems fast, easy and resilient. We specialize in near real time, bi-directional data replication across large node networks over the WAN or LAN.
Stars: ✭ 450 (-29.13%)
Mutual labels:  mysql, replication
Lapidus
Stream your PostgreSQL, MySQL or MongoDB databases anywhere, fast.
Stars: ✭ 145 (-77.17%)
Mutual labels:  mysql, replication
Pg chameleon
MySQL to PostgreSQL replica system
Stars: ✭ 274 (-56.85%)
Mutual labels:  mysql, replication
Mars
Asynchronous Block-Level Storage Replication
Stars: ✭ 168 (-73.54%)
Mutual labels:  storage, replication
Orchestrator
MySQL replication topology management and HA
Stars: ✭ 4,342 (+583.78%)
Mutual labels:  mysql, replication
Dtle
Distributed Data Transfer Service for MySQL
Stars: ✭ 343 (-45.98%)
Mutual labels:  mysql, replication
Mysql redis replication
MySQL replication to Redis cache server via Ruby, Gearman, triggers, and MySQL UDF (Ubuntu version)
Stars: ✭ 10 (-98.43%)
Mutual labels:  mysql, replication
Freno
freno: cooperative, highly available throttler service
Stars: ✭ 462 (-27.24%)
Mutual labels:  mysql, replication
Reiner
萊納 - A MySQL wrapper which might be better than the ORMs and written in Golang
Stars: ✭ 19 (-97.01%)
Mutual labels:  mysql, replication
Mysql Sandbox
Quick and painless install of one or more MySQL servers in the same host.
Stars: ✭ 176 (-72.28%)
Mutual labels:  mysql, replication
Kingbus
A distributed MySQL binlog storage system built on Raft
Stars: ✭ 798 (+25.67%)
Mutual labels:  mysql, storage
awesome-storage
A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (-48.98%)
Mutual labels:  replication, storage
Sos
Simple Object Storage (I wish I could call it Steve's Simple Storage, or S3 ;)
Stars: ✭ 129 (-79.69%)
Mutual labels:  storage, replication
Gopli
DB replication tool to synchronize data with multi environments written in Golang.
Stars: ✭ 327 (-48.5%)
Mutual labels:  mysql, replication
Replication Manager
Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server
Stars: ✭ 461 (-27.4%)
Mutual labels:  mysql, replication
Dbdeployer
DBdeployer is a tool that deploys MySQL database servers easily.
Stars: ✭ 467 (-26.46%)
Mutual labels:  mysql, replication
View All Similar Projects ➔

Gravity 简体中文

Build Status

2.0 Product

Gravity is used to replicate data between various inputs and outputs (databases, message queues).

It is designed to be a customizable data replication tool that:

  • Supports multiple sources and destinations

  • Supports Kubernetes-based replication cluster

Use Cases

  • Data Bus: Use Change Data Capture (MySQL binlog, MongoDB Oplog) and batch table scan to publish data to message queue like Kafka.
  • Unidirectional data replication: Replicates data from one MySQL cluster to another MySQL cluster.
  • Bidirectional data replication: Replicates data between two MySQL clusters bidirectionally.
  • Synchronization of shards to the merged table: Synchronizes MySQL sharded tables to the merged table. You can specify the corresponding relationship between the source table and the target table.
  • Online data mutation: Data can be changed during the replication. For example, rename the column, encrypt/decrypt data columns.

Features

Input support

Input Status
MySQL Binlog ✅
MySQL Scan ✅
Mongo Oplog ✅
Mongo Scan ✅
TiDB Binlog Doing
PostgreSQL WAL Doing

output support

Output Status
MySQL/TiDB ✅
Kafka ✅
Elasticsearch Beta

Data mutation support

Gravity supports the following data mutations:

  • Ignore specific data
  • Renaming columns
  • Deleting columns

Documentation

Special thanks to @dantin, @LiangShang, and @liwink for the early support to this project, and thanks @CaitinChen for the initial translation of the documentation.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].