879 Open source projects that are alternatives of or similar to Mastering Spark Sql Book

The Internals of Spark Structured Streaming

The Internals of Apache Spark

A framework for writing Spark 2.x applications in a pretty way

Learn and understand Docker technologies, with real DevOps practice!

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Natural Korean Processor for Apache Spark

A curated list of Pulsar tools, integrations and resources.

Apache Spark™ and Scala Workshops

Easy CPU Profiling for Apache Spark applications

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Apache Spark on AWS Lambda

Spark structured streaming examples with using of version 3.0.0

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

酷玩 Spark: Spark 源代码解析、Spark 类库等

C# and F# language binding and extensions to Apache Spark

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Spark examples

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Simple and Distributed Machine Learning

R interface for Apache Spark

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

When Apache Pulsar meets Apache Spark

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Profile and monitor your ML data pipeline end-to-end

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Interactive and Reactive Data Science using Scala and Spark.

Apache Spark in your IDE with gradle

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Haskell on Apache Spark.

Custom state store providers for Apache Spark

Fundamentals of Spark with Python (using PySpark), code examples

Apache Spark Connector for Azure Cosmos DB

《CSS 揭秘》这本书的大本营

Source code for the Testing Rails book

MLOps Platform

《反爬虫JS破解与混淆还原手册》 by @No-Attack @LoseNine。 一本教你JS破解以及混淆与还原的教程。欢迎star，持续更新。

The reference for writing fantastic Rails applications

Mastering Monero Book

Notes on Apache Spark (pyspark)

📓The Road to learn React: Your journey to master plain yet pragmatic React.js

📖 【译】Kali Linux 秘籍

From apprentice to master (CC BY-NC-ND)

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

▁▂▄▆▇█▇▆▄▂▁

📖 从问题切入，串连 Go 语言相关的所有知识，融会贯通。 https://golang.design/go-questions

小说精品屋是一个多平台（web、安卓app、微信小程序）、功能完善的屏幕自适应小说漫画连载系统，包含精品小说专区、轻小说专区和漫画专区。包括小说/漫画分类、小说/漫画搜索、小说/漫画排行、完本小说/漫画、小说/漫画评分、小说/漫画在线阅读、小说/漫画书架、小说/漫画阅读记录、小说下载、小说弹幕、小说/漫画自动采集/更新/纠错、小说内容自动分享到微博、邮件自动推广、链接自动推送到百度搜索引擎等功能。

This project hosts the source code for the examples of the Camel in Action 1st ed book written by Claus Ibsen and Jonathan Anstey.

Ruby wrapper for Apache Spark

Spark, Spark Streaming and Spark SQL unit testing strategies