All Projects → nodefluent → mqtt-to-kafka-bridge

nodefluent / mqtt-to-kafka-bridge

Licence: MIT License
Move your messages from MQTT to Apache Kafka in real-time 🚀

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to mqtt-to-kafka-bridge

Homekit2mqtt
HomeKit to MQTT bridge 🏡📱
Stars: ✭ 286 (+1261.9%)
Mutual labels:  mqtt, bridge
Hmq
High performance mqtt broker
Stars: ✭ 722 (+3338.1%)
Mutual labels:  mqtt, bridge
Openmqttgateway
MQTT gateway for ESP8266, ESP32, Sonoff RF Bridge or Arduino with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility, SMS & LORA.
Stars: ✭ 2,413 (+11390.48%)
Mutual labels:  mqtt, bridge
beneath
Beneath is a serverless real-time data platform ⚡️
Stars: ✭ 65 (+209.52%)
Mutual labels:  etl
pioreactor
Hardware and software for accessible, extensible, and scalable bioreactors. Built on Raspberry Pi.
Stars: ✭ 28 (+33.33%)
Mutual labels:  mqtt
asyncio-mqtt
Idomatic asyncio wrapper around paho-mqtt
Stars: ✭ 137 (+552.38%)
Mutual labels:  mqtt
emqx-rule-engine
EMQ X Rule Engine
Stars: ✭ 63 (+200%)
Mutual labels:  mqtt
NodeListServer
Node List Server is a multi-purpose server list system. NodeJS powered and supports Docker.
Stars: ✭ 65 (+209.52%)
Mutual labels:  mirror
ProtonClient
An unofficial desktop client for ProtonMail done with electron nativefier
Stars: ✭ 50 (+138.1%)
Mutual labels:  bridge
Process-Simulator-2-OpenSource
Open source code of Process Simulator 2
Stars: ✭ 20 (-4.76%)
Mutual labels:  mqtt
ESPecial
ESP32 automation with web interface and telegram bot
Stars: ✭ 77 (+266.67%)
Mutual labels:  mqtt
cpp-can-isotp
C++ implementation of CAN ISO 15765-2 also known as CAN ISO transport protocol. CPP CAN isotp.
Stars: ✭ 14 (-33.33%)
Mutual labels:  etl
dbd
dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
Stars: ✭ 30 (+42.86%)
Mutual labels:  etl
mqttbeat
Elasticsearch beat to save messages received with the MQTT protocol.
Stars: ✭ 18 (-14.29%)
Mutual labels:  mqtt
AirflowDataPipeline
Example of an ETL Pipeline using Airflow
Stars: ✭ 24 (+14.29%)
Mutual labels:  etl
metermon
Dockerized rtlamr wrapper that outputs formatted JSON messages over mqtt
Stars: ✭ 19 (-9.52%)
Mutual labels:  mqtt
meshquitto
A simple Arduino project, which aims to provide a gateway between a mesh network of ESP8266's and a remote MQTT broker.
Stars: ✭ 37 (+76.19%)
Mutual labels:  mqtt
AndrOBD-Plugin
AndrOBD plugin development project
Stars: ✭ 38 (+80.95%)
Mutual labels:  mqtt
goaop-laravel-bridge
Integration bridge for Go! AOP framework and Laravel
Stars: ✭ 91 (+333.33%)
Mutual labels:  bridge
as3MQTT
📢 Pure Action Script 3 that implements the MQTT (Message Queue Telemetry Transport) protocol, a lightweight protocol for publish/subscribe messaging.
Stars: ✭ 21 (+0%)
Mutual labels:  mqtt

mqtt-to-kafka-bridge - consume, (etl/mirror), produce

npm version Docker Repository on Quay

Intro

mqtt-to-kafka-bridge allows you to quickly setup a fast (about messages 2 million/sec) and lightweight (about 100 MB RAM) bridge that subscribes to your MQTT Broker and produces messages to your Apache Kafka cluster. You can configure routing (move messags from MQTT topics to certain Kafka topics) or filtering, as well as ETL functions on MQTT consume, as well as on Kafka produce. You just pass everything in a simple JSON/JS config object.

How to use?

Just check out the example here it also gives you description on the configuration options. You can find the sample configuration here.

Info

The bridge spins up an http server, which can be used to check its health status http://localhost:3967/healthcheck as well as statistics http://localhost:3967/stats.

Maintainer

Build with ❤️ 🍕 and by nodefluent

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].