419 Open source projects that are alternatives of or similar to spark-data-sources

TPC-H queries in Apache Spark SQL using native DataFrames API

bigdatatutorial

Apache Spark in your IDE with gradle

REST job server for Apache Spark

Model complex data transformation pipelines easily

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

Identifies and collects data on cc-licensed content across web crawl data and public apis.

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Framework of vectorized and distributed data analytics

Python clone of Spark, a MapReduce alike framework in Python

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

基于Spark2.2新闻网大数据实时系统项目

▁▂▄▆▇█▇▆▄▂▁

An extensive non-reactive Typescript framework that eases the development experience in Spark AR

Ruby wrapper for Apache Spark

A complete (distributed) BigData stack, running in containers

A Spark plugin for reading Excel files via Apache POI

Code examples for my blog posts

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

🎼 Docker compose files for various kafka stacks

Spark, Spark Streaming and Spark SQL unit testing strategies

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

Java开发者或者大数据开发者面试知识点整理

Minikube for big data with Scala and Spark

Apache Spark (PySpark) Practice on Real Data

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

A scalable nearest neighbor search library in Apache Spark

Apache Spark docker container image (Standalone mode)

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

A better compressed bitset in Java

HL7 Apache Spark Datasource

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

The Internals of Spark SQL

Write your Spark data to Kafka seamlessly

人生苦短 我用Python

Firely's open source FHIR server

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

Spark Structured Streaming / Kafka / Cassandra / Elastic

🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例如master、shuffle源码分析，总结及翻译。

GeoTrellis for PySpark

Visualize column-level data lineage in Spark SQL

Spark、Flink等离线任务的调度以及实时任务的监控

Collection of Databricks and Jupyter Notebooks

Big Data Ecosystem Docker

Collection of different demo applications using Apache Spark

Simple and beautiful card component with an elegant spark line, for VueJS.

spark on kubernetes

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

An encrypted data analytics platform

ArcGIS Experience Builder samples

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.