Java开发者或者大数据开发者面试知识点整理

Some class materials for a data processing course using PySpark

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

A simple spark standalone cluster for your testing environment purposses

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

High Performance HTTP Sidecar Load Balancer

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

一个大数据架构师应该掌握的技能

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Python clone of Spark, a MapReduce alike framework in Python

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Source code for James Lee's Aparch Spark with Java course

Code Library for My Blog

Data Lineage Tracking And Visualization Solution