Kafka Storm StarterCode examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (+119.28%)
Agile data code 2Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (+24.4%)
Azure Event Hubs SparkEnabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (-57.83%)
OryxOryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Stars: ✭ 1,785 (+437.65%)
Storm Dynamic SpoutA framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Stars: ✭ 40 (-87.95%)
Awesome PulsarA curated list of Pulsar tools, integrations and resources.
Stars: ✭ 57 (-82.83%)
Data AcceleratorData Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (-25.6%)
DebeziumChange data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Stars: ✭ 5,937 (+1688.25%)
CppkafkaModern C++ Apache Kafka client library (wrapper for librdkafka)
Stars: ✭ 413 (+24.4%)
LibrdkafkaThe Apache Kafka C/C++ library
Stars: ✭ 5,617 (+1591.87%)
Kafka WorkshopMaterials (slides and code) for Kafka and Kafka Streams Workshop
Stars: ✭ 44 (-86.75%)
Kafka Sprout🚀 Web GUI for Kafka Cluster Management
Stars: ✭ 388 (+16.87%)
KowlApache Kafka Web UI for exploring messages, consumers, configurations and more with a focus on a good UI & UX.
Stars: ✭ 1,036 (+212.05%)
PykafkaApache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
Stars: ✭ 1,079 (+225%)
ZatZeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark
Stars: ✭ 303 (-8.73%)
SlimmessagebusLightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Stars: ✭ 120 (-63.86%)
WaterdropWaterDrop is a standalone Karafka component library for generating Kafka messages
Stars: ✭ 136 (-59.04%)
Azkarra Streams🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
Stars: ✭ 146 (-56.02%)
Kattlo CliKattlo CLI Project
Stars: ✭ 58 (-82.53%)
KopKafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Stars: ✭ 159 (-52.11%)
Coolplayspark酷玩 Spark: Spark 源代码解析、Spark 类库等
Stars: ✭ 3,318 (+899.4%)
Phalcon VmVagrant configuration for PHP7, Phalcon 3.x and Zephir development.
Stars: ✭ 43 (-87.05%)
KqKafka-based Job Queue for Python
Stars: ✭ 530 (+59.64%)
Jenkins InfraJenkins main control repo for R10k and our Puppet Enterprise managed infrastructure
Stars: ✭ 76 (-77.11%)
Primary VagrantAn Apache based Vagrant configuration for helping you get the most out of WordPress Development
Stars: ✭ 192 (-42.17%)
KtKafka command line tool that likes JSON
Stars: ✭ 799 (+140.66%)
puppet-magnumrubygems.org/gems/puppet-magnum
Stars: ✭ 31 (-90.66%)
Learningsparkv2This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Stars: ✭ 307 (-7.53%)
MeetupKafka 한국 사용자 모임에서 운영하는 meetup repository
Stars: ✭ 106 (-68.07%)
KukulcanA REPL for Apache Kafka
Stars: ✭ 103 (-68.98%)
KarafkaFramework for Apache Kafka based Ruby and Rails applications development.
Stars: ✭ 1,223 (+268.37%)
KafkactlCommand Line Tool for managing Apache Kafka
Stars: ✭ 177 (-46.69%)
Every Single Day I TldrA daily digest of the articles or videos I've found interesting, that I want to share with you.
Stars: ✭ 249 (-25%)
Ghtorrent VagrantA Vagrant box with Puppet provisioning for running GHTorrent locally
Stars: ✭ 6 (-98.19%)
Vagrant GolangA very easy to use golang environment for use with vagrant.
Stars: ✭ 104 (-68.67%)
Chassis📦 Chassis is a virtual server for your WordPress site, built using Vagrant.
Stars: ✭ 602 (+81.33%)
fink-brokerAstronomy Broker based on Apache Spark
Stars: ✭ 18 (-94.58%)
vagrant-r10kUNSUPPORTED - SEEKING MAINTAINER - Vagrant middleware plugin to retrieve puppet modules using r10k.
Stars: ✭ 36 (-89.16%)
Kafka UiOpen-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (-30.72%)
fastdata-clusterFast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)
Stars: ✭ 20 (-93.98%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-96.08%)
vagrant-puppetmasterA simple vagrant setup exposing all permutations of puppetmaster roles
Stars: ✭ 19 (-94.28%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-66.57%)
devopsSetup & installers for databases, runtimes, queues etc. using Anaconda, Ansible, Vagrant, Docker, AWS, Puppet, automation etc.
Stars: ✭ 28 (-91.57%)
Spark Jupyter AwsA guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Stars: ✭ 259 (-21.99%)