127 Open source projects that are alternatives of or similar to Spark Atlas Connector

C# and F# language binding and extensions to Apache Spark

Haskell on Apache Spark.

PySpark + Scikit-learn = Sparkit-learn

Easy CPU Profiling for Apache Spark applications

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Custom state store providers for Apache Spark

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

The Internals of Apache Spark

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Interactive and Reactive Data Science using Scala and Spark.

Apache (Py)Spark type annotations (stub files).

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Apache Spark on AWS Lambda

R interface for Apache Spark

A curated list of Pulsar tools, integrations and resources.

Streaming System 相关的论文读物

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

A list about Apache Kafka

Natural Korean Processor for Apache Spark

A boilerplate for writing PySpark Jobs

Project for James' Apache Spark with Scala course

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

Example Maven configuration for a Spark, Scala project

Distributed Bayesian Entity Resolution in Apache Spark

Easy to use library to bring Tensorflow on Apache Spark

Apache Spark docker image

Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Apache Zeppelin notebooks for Recommendation Engines using Keras and Machine Learning on Apache Spark

A framework for writing Spark 2.x applications in a pretty way

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Simple windows desktop application for viewing & querying Apache Parquet files

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Open source platform for the machine learning lifecycle

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Use the TPC-DS benchmark to test Spark SQL performance

A command-line tool for launching Apache Spark clusters.

When Apache Pulsar meets Apache Spark

REST web service for the true real-time scoring (<1 ms) of Scikit-Learn, R and Apache Spark models

Fundamentals of Spark with Python (using PySpark), code examples

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

A curated list of awesome Apache Spark packages and resources.

The Internals of Spark Structured Streaming

Griffon Data Science Virtual Machine

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

(Deprecated) Scikit-learn integration package for Apache Spark

酷玩 Spark: Spark 源代码解析、Spark 类库等

A visual ETL development and debugging tool for big data

Serverless proxy for Spark cluster

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

📚 Various cheatsheets in PDF

A recommender system for discovering GitHub repos, built with Apache Spark

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Spark examples