1595 Open source projects that are alternatives of or similar to Pulsar Spark

面向 OLTP、OLAP、批处理、流处理场景的大一统 SQL 引擎

Custom state store providers for Apache Spark

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

深圳地铁大数据客流分析系统🚇🚄🌟

The Internals of Apache Spark

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Apache Spark Connector for Azure Cosmos DB

Spark、Flink等离线任务的调度以及实时任务的监控

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Profile and monitor your ML data pipeline end-to-end

Python clone of Spark, a MapReduce alike framework in Python

The Internals of Spark SQL

🎓 Jupyter notebooks from UFC data science course

Fundamentals of Spark with Python (using PySpark), code examples

A curated list of awesome big data frameworks, ressources and other awesomeness.

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

A simple Spark-powered ETL framework that just works 🍺

Pandas and Spark DataFrame comparison for humans

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Content for architecting a data science platform for products using Luigi, Spark & Flask.

C# and F# language binding and extensions to Apache Spark

The Proxima platform.

Repository for integration with Apache Kafka

Apache Flink connectors for Pravega.

Experiments with Apache Flink.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Apache Spark in your IDE with gradle

Koalas: pandas API on Apache Spark

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Dataset format for AI. Build, manage, & visualize datasets for deep learning. Stream data real-time to PyTorch/TensorFlow & version-control it. https://activeloop.ai

Distributed Stream and Batch Processing

The Internals of Spark Structured Streaming

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Example project implementing best practices for PySpark ETL jobs and applications.

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

R interface for Apache Spark

Applying Data Science and Machine Learning to Solve Real World Business Problems

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Efficient variant-call data storage and retrieval library using the TileDB storage library.

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

Python Helper library for Jupyter Notebooks

A collection of computer vision pre-trained models.

A Python library that helps data scientists to infer causation rather than observing correlation.

Visualise your data from Scala using Plotly

Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications.