Agile data code 2Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (+624.56%)
WirbelsturmWirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.
Stars: ✭ 332 (+482.46%)
SlimmessagebusLightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Stars: ✭ 120 (+110.53%)
Kafka Storm StarterCode examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (+1177.19%)
Go NotifyAn email automation solution, written in Golang.
Stars: ✭ 143 (+150.88%)
amq-examplesThis repository contains a set of examples to be used with Red Hat AMQ messaging suite components.
Stars: ✭ 25 (-56.14%)
websitePrometheus monitoring mixins
Stars: ✭ 91 (+59.65%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (+94.74%)
Pulsar SparkWhen Apache Pulsar meets Apache Spark
Stars: ✭ 55 (-3.51%)
SparkrdmaRDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+277.19%)
Spark WorkshopApache Spark™ and Scala Workshops
Stars: ✭ 224 (+292.98%)
Azure Event Hubs☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs
Stars: ✭ 233 (+308.77%)
Spark NkpNatural Korean Processor for Apache Spark
Stars: ✭ 50 (-12.28%)
aws-sns-samplesAmazon SNS (Simple Notification Service) - Code Samples
Stars: ✭ 24 (-57.89%)
KopKafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Stars: ✭ 159 (+178.95%)
Coolplayspark酷玩 Spark: Spark 源代码解析、Spark 类库等
Stars: ✭ 3,318 (+5721.05%)
Pihole ExporterA Prometheus exporter for PI-Hole's Raspberry PI ad blocker
Stars: ✭ 352 (+517.54%)
SparkmeasureThis is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.
Stars: ✭ 368 (+545.61%)
SparkleHaskell on Apache Spark.
Stars: ✭ 419 (+635.09%)
MmlsparkSimple and Distributed Machine Learning
Stars: ✭ 2,899 (+4985.96%)
Spark TdaSparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.
Stars: ✭ 45 (-21.05%)
Whylogs JavaProfile and monitor your ML data pipeline end-to-end
Stars: ✭ 164 (+187.72%)
Data AcceleratorData Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (+333.33%)
OryxOryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Stars: ✭ 1,785 (+3031.58%)
Spark With PythonFundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (+163.16%)
streamsx.kafkaRepository for integration with Apache Kafka
Stars: ✭ 13 (-77.19%)
fink-brokerAstronomy Broker based on Apache Spark
Stars: ✭ 18 (-68.42%)
Goodreads etl pipelineAn end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Stars: ✭ 793 (+1291.23%)
Kafka UiOpen-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (+303.51%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-77.19%)
firehoseFirehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
Stars: ✭ 213 (+273.68%)
Azure Event Hubs SparkEnabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (+145.61%)
Learningsparkv2This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Stars: ✭ 307 (+438.6%)
PrometheusA docker-compose stack for Prometheus monitoring
Stars: ✭ 3,383 (+5835.09%)
Spark NotebookInteractive and Reactive Data Science using Scala and Spark.
Stars: ✭ 3,081 (+5305.26%)
MobiusC# and F# language binding and extensions to Apache Spark
Stars: ✭ 929 (+1529.82%)
Unifi PollerApplication: Collect ALL UniFi Controller, Site, Device & Client Data - Export to InfluxDB or Prometheus
Stars: ✭ 1,050 (+1742.11%)
Version CheckerKubernetes utility for exposing image versions in use, compared to latest available upstream, as metrics.
Stars: ✭ 371 (+550.88%)
Spark Jupyter AwsA guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Stars: ✭ 259 (+354.39%)
SparklyrR interface for Apache Spark
Stars: ✭ 775 (+1259.65%)
Spark FlamegraphEasy CPU Profiling for Apache Spark applications
Stars: ✭ 30 (-47.37%)
Live log analyzer sparkSpark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.
Stars: ✭ 14 (-75.44%)
MistA distributed, tag-based pub-sub service for modern web applications and container-driven cloud.
Stars: ✭ 634 (+1012.28%)
Spark.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Stars: ✭ 1,721 (+2919.3%)
Backbone.radioMessaging patterns for Backbone applications.
Stars: ✭ 496 (+770.18%)
UnifiedmetricsFully-featured metrics collection agent for Minecraft servers. Supports Prometheus and InfluxDB. Dashboard included out-of-box.
Stars: ✭ 29 (-49.12%)