2658 Open source projects that are alternatives of or similar to Spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

C# and F# language binding and extensions to Apache Spark

Simple and Distributed Machine Learning

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Real Time Analytics and Data Pipelines based on Spark Streaming

💿 Storage abstractions with implementations for .NET/.NET Standard

Custom state store providers for Apache Spark

Simple and Distributed Machine Learning

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

一个大数据架构师应该掌握的技能

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

酷玩 Spark: Spark 源代码解析、Spark 类库等

Streaming System 相关的论文读物

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

bigdatatutorial

Haskell on Apache Spark.

Fundamentals of Spark with Python (using PySpark), code examples

Apache Spark Course Material

Spark structured streaming examples with using of version 3.0.0

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

A curated list of Pulsar tools, integrations and resources.

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Code examples on Apache Spark using python

Tutorial for ASP.NET Boilerplate Core + Angular

When Apache Pulsar meets Apache Spark

This repository contains resources for the Exam AZ-203: Developing Solutions for Microsoft Azure. You can find direct links to resources and and practice resources to test yourself ☁️🎓📚

This sample shows how to create a private AKS cluster in a virtual network along with a jumpbox virtual machine.

Countly Product Analytics SDK for Cordova, Icenium and Phonegap

Golang library for reading and writing Microsoft Excel™ (XLSX) files.

Big Data for Data Engineers Coursera Specialization from Yandex

"Sentiment analysis" on a live Twitter feed with Apache Spark and Apache Bahir

scala、spark使用过程中，各种测试用例以及相关资料整理

Distributed "massively parallel" SQL query engine

SQL-based streaming analytics platform at scale

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

TeamCity plugin for .NET Core projects

Azure Architecture Center

Azure-related repository

Unleash your resw files with this Visual Studio extension: auto generation of strongly typed static properties, support of pluralization, strongly typed string formatting, etc...

Piranha CMS is the friendly editor-focused CMS for .NET Core that can be used both as an integrated CMS or as a headless API.

Building blocks for gaming on Azure

☁💾 Manage your Azure Storage blobs, tables, queues and file shares from this simple and intuitive web application.

A framework for writing Spark 2.x applications in a pretty way

Azure Event Hubs for Apache Kafka Ecosystems

A powerful C# library for Razer Chroma's SDK

Natural Korean Processor for Apache Spark

type-class based data cleansing library for Apache Spark SQL

JsonApiFramework is a fast, extensible, and portable .NET framework for the reading and writing of JSON API documents. Currently working on ApiFramework 1.0 which is a new framework that supports the many enhancements documented in the 2.0 milestone of this project while being media type agnostic but will support media types like {json:api} and GraphQL for serialization/deserialization purposes.

Background job system for .NET applications

Simple blogging application written in Microsoft Server Side Blazor

大数据入门指南 ⭐

Best Practices on Recommendation Systems

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Source code for James Lee's Aparch Spark with Java course