All Projects → zendesk → Maxwell

zendesk / Maxwell

Licence: other
Maxwell's daemon, a mysql-to-json kafka producer

Programming Languages

java
68154 projects - #9 most used programming language
ANTLR
299 projects
shell
77523 projects
ruby
36898 projects - #4 most used programming language
javascript
184084 projects - #8 most used programming language
Dockerfile
14818 projects
Makefile
30231 projects

This is Maxwell's daemon, an application that reads MySQL binlogs and writes row updates as JSON to Kafka, Kinesis, or other streaming platforms. Maxwell has low operational overhead, requiring nothing but mysql and a place to write to. Its common use cases include ETL, cache building/expiring, metrics collection, search indexing and inter-service communication. Maxwell gives you some of the benefits of event sourcing without having to re-architect your entire platform.

Download:
https://github.com/zendesk/maxwell/releases/download/v1.35.4/maxwell-1.35.4.tar.gz
Source:
https://github.com/zendesk/maxwell

  mysql> insert into `test`.`maxwell` set id = 1, daemon = 'Stanislaw Lem';
  maxwell: {
    "database": "test",
    "table": "maxwell",
    "type": "insert",
    "ts": 1449786310,
    "xid": 940752,
    "commit": true,
    "data": { "id":1, "daemon": "Stanislaw Lem" }
  }
  mysql> update test.maxwell set daemon = 'firebus!  firebus!' where id = 1;
  maxwell: {
    "database": "test",
    "table": "maxwell",
    "type": "update",
    "ts": 1449786341,
    "xid": 940786,
    "commit": true,
    "data": {"id":1, "daemon": "Firebus!  Firebus!"},
    "old":  {"daemon": "Stanislaw Lem"}
  }
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].