435 Open source projects that are alternatives of or similar to Example Spark

Models and Pipelines for the Spark NLP library

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Google Authenticator support for Laravel Spark

An open-source toolkit for large-scale genomic analysis

Webex Bot SDK for Node.js (deprecated in favor of https://github.com/webex/webex-bot-node-framework)

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Write your Spark data to Kafka seamlessly

Spark job for dependency links

An encrypted data analytics platform

Visualize data using relative ordering

HandySpark - bringing pandas-like capabilities to Spark dataframes

A simple Spark-powered ETL framework that just works 🍺

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Big Data Ecosystem Docker

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

ApacheCN 开源组织：公告、介绍、成员、活动、交流方式

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

type-class based data cleansing library for Apache Spark SQL

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

LearningApacheSpark

Optimize and improve the Label propagation algorithm

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

Research on distributed system

Firely's open source FHIR server

A luigi powered analytics / warehouse stack

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

四川大学拓思爱诺用户session行为数据离线分析项目

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

Apache Spark (PySpark) Practice on Real Data

Word2Vec models with Twitter data using Spark. Blog:

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

🌐 Interactive Workshop on GeoAnalysis using PySpark

Julia binding for Apache Spark

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

State of the Art Natural Language Processing

Boiler plate framework to use Spark and ZIO together.

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

StreamLine - Streaming Analytics

Code and presentation for Strata Model Serving tutorial

Apache Spark examples exclusively in Java

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Relation Extraction using Deep learning(CNN)

This is a based on playframwork for submit spark app

spark ml 算法原理剖析以及具体的源码实现分析

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

spark summit 2017 SanFrancisco

🔧 Use dplyr to analyze Big Data 🐘

Apache Spark on AWS Lambda