1035 Open source projects that are alternatives of or similar to Sparkrdma

A curated list of Pulsar tools, integrations and resources.

Countly Product Analytics SDK for Cordova, Icenium and Phonegap

Research on distributed system

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

The official home of the Presto distributed SQL query engine for big data

可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.

Open-source distribute workflow schedule tools, also support streaming task.

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

OLAP and ETL of Big Data

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

🚢 Docker image for Apache Spark

A simple Spark-powered ETL framework that just works 🍺

low-level helpers for Apache Spark libraries and tests

Documentation placeholder and utilities for all the other containers.

Cookbook to install Hadoop 2.0+ using Chef

Apache Spark Website

ROOT I/O in pure Python and NumPy.

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Enabling queries on compressed data.

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

🏐 Apache Parquet for modern .NET

Spark structured streaming examples with using of version 3.0.0

Create clusters of VMs on the cloud and configure them with Ansible.

Interactive and Reactive Data Science using Scala and Spark.

ROOT I/O in pure Python and NumPy.

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

A simplified, lightweight ETL Framework based on Apache Spark

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

The Internals of Spark Structured Streaming

Simple and Distributed Machine Learning

Iceberg is a table format for large, slow-moving tabular data

A framework for writing Spark 2.x applications in a pretty way

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

Server for the ListenBrainz project

Haskell on Apache Spark.

type-class based data cleansing library for Apache Spark SQL

Custom state store providers for Apache Spark

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Geo Spatial Data Analytics on Spark

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

Apache Drill is a distributed MPP query layer for self describing data

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Source code for James Lee's Aparch Spark with Java course

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Two-day workshop that covers how to use R to interact databases and Spark

Distributed Big Data Orchestration Service

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

extremely distributed machine learning

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

MapReduce, Spark, Java, and Scala for Data Algorithms Book

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.