485 Open source projects that are alternatives of or similar to Spark Flamegraph

Interactive and Reactive Data Science using Scala and Spark.

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

A curated list of Pulsar tools, integrations and resources.

R interface for Apache Spark

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Apache Spark in your IDE with gradle

C# and F# language binding and extensions to Apache Spark

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Apache Spark Connector for Azure Cosmos DB

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

Apache Spark on AWS Lambda

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Profile and monitor your ML data pipeline end-to-end

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Spark examples

When Apache Pulsar meets Apache Spark

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Fundamentals of Spark with Python (using PySpark), code examples

The Internals of Spark SQL

Simple and Distributed Machine Learning

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

酷玩 Spark: Spark 源代码解析、Spark 类库等

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Custom state store providers for Apache Spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

The Internals of Apache Spark

Apache Spark™ and Scala Workshops

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Natural Korean Processor for Apache Spark

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Spark structured streaming examples with using of version 3.0.0

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

A framework for writing Spark 2.x applications in a pretty way

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

The Internals of Spark Structured Streaming

Haskell on Apache Spark.

A heterogeneous Apache Spark framework.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Plot live-stats as graph from ApacheSpark application using Lightning-viz

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

A connector for Spark that allows reading and writing to/from Redis cluster

A Flexible and Powerful Parameter Server for large-scale machine learning

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

MapReduce, Spark, Java, and Scala for Data Algorithms Book

A Time Series Library for Apache Spark

Efficient variant-call data storage and retrieval library using the TileDB storage library.

CTR prediction model based on spark(LR, GBDT, DNN)

Spark (http://sparkjava.com/) support for Swagger (https://swagger.io/)

hadoop各组件使用，持续更新

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Expressive types for Spark.

Scalable genomic data analysis.

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch