All Projects → theotow → Nodejs Kafka Example

theotow / Nodejs Kafka Example

Event sourcing with kafka and nodejs

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Nodejs Kafka Example

Commonx
基础框架
Stars: ✭ 57 (-20.83%)
Mutual labels:  kafka
Springwolf Core
Automated documentation for async APIs built with Spring Boot
Stars: ✭ 63 (-12.5%)
Mutual labels:  kafka
Event Sourcing Castanha
An Event Sourcing service template with DDD, TDD and SOLID. It has High Cohesion and Loose Coupling, it's a good start for your next Microservice application.
Stars: ✭ 68 (-5.56%)
Mutual labels:  kafka
Kattlo Cli
Kattlo CLI Project
Stars: ✭ 58 (-19.44%)
Mutual labels:  kafka
Awesome Kafka
Stars: ✭ 61 (-15.28%)
Mutual labels:  kafka
Ansible Kafka
Ansible Kafka role
Stars: ✭ 64 (-11.11%)
Mutual labels:  kafka
Zaneperfor
前端性能监控系统,消息队列,高可用,集群等相关架构
Stars: ✭ 1,085 (+1406.94%)
Mutual labels:  kafka
Kafka Elasticsearch Injector
Golang app to read records from a set of kafka topics and write them to an elasticsearch cluster
Stars: ✭ 70 (-2.78%)
Mutual labels:  kafka
Camel Kafka Connector
Camel Kafka Connector allows you to use all Camel components as Kafka Connect connectors
Stars: ✭ 63 (-12.5%)
Mutual labels:  kafka
Go Consumergroup
golang kafka consumer group
Stars: ✭ 67 (-6.94%)
Mutual labels:  kafka
Karamel
Kafka Browser that supports standalone Kafka and Strimzi operator
Stars: ✭ 61 (-15.28%)
Mutual labels:  kafka
Ansible Playbook
Ansible playbook to deploy distributed technologies
Stars: ✭ 61 (-15.28%)
Mutual labels:  kafka
Kryptoflow
Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving
Stars: ✭ 66 (-8.33%)
Mutual labels:  kafka
Spring Cloud Stream Demo
Simple Event Driven Microservices with Spring Cloud Stream
Stars: ✭ 58 (-19.44%)
Mutual labels:  kafka
Hydra
A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.
Stars: ✭ 68 (-5.56%)
Mutual labels:  kafka
Model Serving Tutorial
Code and presentation for Strata Model Serving tutorial
Stars: ✭ 57 (-20.83%)
Mutual labels:  kafka
Ksql Fork With Deep Learning Function
Deep Learning UDF for KSQL, the Streaming SQL Engine for Apache Kafka with Elasticsearch Sink Example
Stars: ✭ 64 (-11.11%)
Mutual labels:  kafka
Drain3
Drain log template miner in Python3
Stars: ✭ 71 (-1.39%)
Mutual labels:  kafka
Burrowui
This is a NodeJS/Angular 2 frontend UI for Kafka cluster monitoring with Burrow
Stars: ✭ 69 (-4.17%)
Mutual labels:  kafka
Thingsboard
Open-source IoT Platform - Device management, data collection, processing and visualization.
Stars: ✭ 10,526 (+14519.44%)
Mutual labels:  kafka

Nodejs Kafka

Setup

Make sure you have following on your local machine installed

docker - 18.03.1 docker-compose - 1.21.1 node - 9.9.0 npm - 5.6.0

Install Project

npm install
docker-compose up

Create Kafka Topics

docker run --rm -it --net=host landoop/fast-data-dev kafka-topics --zookeeper 127.0.0.1:2181 --topic requests --replication-factor 1 --partitions 100 --create
docker run --rm -it --net=host landoop/fast-data-dev kafka-topics --zookeeper 127.0.0.1:2181 --topic finalevents --replication-factor 1 --partitions 100 --create

Kafka UI

Visit http://127.0.0.1:3030 to inspect your kafka broker, topics, partitions etc.

Usage

Terminal1: Start Consumer (you can start multiple in different terminals to spread the load)

node consumer.js

Terminal2: Start API

node api.js

Terminal3: Start CLI

node cli.js

Start interacting with the CLI and observe what the API / Consumer does

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].