darenr / Python Kafka Elasticsearch
Simple learning project pushing CSV data into Kafka then indexing the data in ElasticSearch
Stars: ✭ 11
Programming Languages
python
139335 projects - #7 most used programming language
Labels
Projects that are alternatives of or similar to Python Kafka Elasticsearch
Hangout
用java实现一下Logstash的几个常用input/filter/output, 希望能有效率上面的大提升. 现在我们迁移到golang了 https://github.com/childe/gohangout
Stars: ✭ 469 (+4163.64%)
Mutual labels: kafka, elasticsearch
Books Recommendation
程序员进阶书籍（视频），持续更新（Programmer Books）
Stars: ✭ 558 (+4972.73%)
Mutual labels: kafka, elasticsearch
Gohangout
golang版本的hangout, 希望能省些内存. 使用了自己写的Kafka lib .. 虚. 不过我们在生产环境已经使用近1年, kafka 版本从0.9.0.1到2.0都在使用, 目前情况稳定. 吞吐量在每天2000亿条以上.
Stars: ✭ 507 (+4509.09%)
Mutual labels: kafka, elasticsearch
Gnomock
Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻
Stars: ✭ 398 (+3518.18%)
Mutual labels: kafka, elasticsearch
Demo Scene
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Stars: ✭ 806 (+7227.27%)
Mutual labels: kafka, elasticsearch
Gpmall
【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch
Stars: ✭ 4,241 (+38454.55%)
Mutual labels: kafka, elasticsearch
Kafka Connect Elasticsearch
Kafka Connect Elasticsearch connector
Stars: ✭ 550 (+4900%)
Mutual labels: kafka, elasticsearch
Gimel
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (+1863.64%)
Mutual labels: kafka, elasticsearch
Goodskill
🐂基于springcloud +dubbo构建的模拟秒杀项目，模块化设计，集成了分库分表、elasticsearch🔍、gateway、mybatis-plus、spring-session等常用开源组件
Stars: ✭ 786 (+7045.45%)
Mutual labels: kafka, elasticsearch
Kafka Connect Ui
Web tool for Kafka Connect |
Stars: ✭ 388 (+3427.27%)
Mutual labels: kafka, elasticsearch
Kafka Connect Elasticsearch Source
Kafka Connect Elasticsearch Source
Stars: ✭ 22 (+100%)
Mutual labels: kafka, elasticsearch
Springboot Learning
基于Gradle构建，使用SpringBoot在各个场景的应用，包括集成消息中间件、前后端分离、数据库、缓存、分布式锁、分布式事务等
Stars: ✭ 340 (+2990.91%)
Mutual labels: kafka, elasticsearch
Cookbook
🎉🎉🎉JAVA高级架构师技术栈==任何技能通过 “刻意练习” 都可以达到融会贯通的境界，就像烹饪一样，这里有一份JAVA开发技术手册，只需要增加自己练习的次数。🏃🏃🏃
Stars: ✭ 428 (+3790.91%)
Mutual labels: kafka, elasticsearch
Syncclient
syncClient，数据实时同步中间件（同步mysql到kafka、redis、elasticsearch、httpmq）！
Stars: ✭ 227 (+1963.64%)
Mutual labels: kafka, elasticsearch
Javakeeper
✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能
Stars: ✭ 502 (+4463.64%)
Mutual labels: kafka, elasticsearch
Firecamp
Serverless Platform for the stateful services
Stars: ✭ 194 (+1663.64%)
Mutual labels: kafka, elasticsearch
Amazonriver
amazonriver 是一个将postgresql的实时数据同步到es或kafka的服务
Stars: ✭ 198 (+1700%)
Mutual labels: kafka, elasticsearch
Stream Reactor
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Stars: ✭ 753 (+6745.45%)
Mutual labels: kafka, elasticsearch
python-kafka-elasticsearch
Simple learning project pushing CSV data into Kafka then indexing the data in ElasticSearch.
The indexes are created with a very rudimentary type discovery that uses simple regex patterns.
The Sacramento crime January 2006 dataset contains 7,584 crime records, as made available by the Sacramento Police Department.
You need the following components installed:
- ElasticSearch, 1.8+
- Kafka, 2.10+
- Kibana, 4.1.1+
- Python 2.7+
To install necessary python libraries:
- sudo pip install -r requirements.txt
To startup Kafka:
- untar the distribution & cd kafka_2.10-0.8.2.1
- start zookeeper: bin/zookeeper-server-start.sh config/zookeeper.properties
- start kafka: bin/kafka-server-start.sh config/server.properties
- create a topic: bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
See the Kafka QuickStart Guide
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].