456 Open source projects that are alternatives of or similar to spark-extension

Apache Spark Sentry Integration

Just a boilerplate for PySpark and Flask

Python clone of Spark, a MapReduce alike framework in Python

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

TPC-H queries in Apache Spark SQL using native DataFrames API

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

An extensive non-reactive Typescript framework that eases the development experience in Spark AR

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

ACID Data Source for Apache Spark based on Hive ACID

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Code examples for my blog posts

HL7 Apache Spark Datasource

Distributed least squares approximation (dlsa) implemented with Apache Spark

Código para workshops Spark com ambiente de desenvolvimento em docker

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

Koalas: pandas API on Apache Spark

A parallel implementation of word2vec based on Spark

A daily digest of the articles or videos I've found interesting, that I want to share with you.

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Framework of vectorized and distributed data analytics

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

Book recommender system using collaborative filtering based on Spark

Autoscaling for Google Cloud Dataproc

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

Machine Learning Course @ Santa Clara University

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

The Internals of Spark SQL

A compiler for automatically re-targeting sequential Java code to Apache Spark.

Type System for Data Analysis in Python

Spark Shuffle Optimization with RDMA+AEP

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

Generate beautiful documentation for your data pipelines in markdown format

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Applying Data Science and Machine Learning to Solve Real World Business Problems

This repo contains commands that data engineers use in day to day work.

▁▂▄▆▇█▇▆▄▂▁

Apache Spark™ and Scala Workshops

Online search advertisement platform & Realtime Campaign Monitoring [Maybe Deprecated]

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

Ruby wrapper for Apache Spark

A Spark library for Amazon SageMaker.

No description or website provided.

A Spark plugin for reading Excel files via Apache POI

基于Spark2.2新闻网大数据实时系统项目

Code Library for My Blog

A lightweight data processing framework for Apache Spark

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

MLOps Platform

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Spark, Spark Streaming and Spark SQL unit testing strategies

k-Nearest Neighbors algorithm on Spark

Apache Spark in your IDE with gradle

Apache Spark for data engineers

Java开发者或者大数据开发者面试知识点整理

Data validation library for PySpark 3.0.0

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

Collection of different demo applications using Apache Spark