Top 26 spark-sql open source projects

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Spark structured streaming examples with using of version 3.0.0

MCW Big data analytics and visualization

尚硅谷大数据Spark-2019版最新 Spark 学习

Developing Spark External Data Sources using the V2 API

Spark SQL 实现 ItemCF，UserCF，Swing，推荐系统，推荐算法，协同过滤

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

Apache Spark Course Material

The Internals of Spark SQL

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例如master、shuffle源码分析，总结及翻译。

A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0

Collection of Databricks and Jupyter Notebooks

Spark VCF data source implementation for Dataframes

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

An encrypted data analytics platform

Albis: High-Performance File Format for Big Data Systems

SQL Parsers for BigData, built with antlr4.

A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.

bring sf to spark in production

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

bigdatatutorial