Top 625 spark open source projects

No description or website provided.

Stores Snowplow enriched events in Redshift

Spark Design System

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

FBLYZE is a Facebook scraping system and analysis system.

Operator for managing the Spark clusters on Kubernetes and OpenShift.

基于大数据的图书推荐系统

Design/Implement stream/batch architecture on NYC taxi data | #DE

基于spark的外卖大数据平台分析系统

A lightweight data processing framework for Apache Spark

DEPRECATED Particle iOS Cloud SDK. Use -->

Spark in Action, 2nd edition - chapter 1 - Introduction

Ginger - Opinionated RESTful Routing powered by Spark

Taller SparkR para las Jornadas de Usuarios de R

Apache Spark Course Material

A simple hello world using Apache Spark

Spring Boot Starter for Apache Spark

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....

The Internals of Spark SQL

Python - Java/Scala API for the Hopsworks feature store

A collection of online books for data science, computer science and coding!

Collection of cyber security and "AI" relevant topics

Nested array transformation helper extensions for Apache Spark

Personal Data Engineering Projects

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Self-contained examples using Apache Spark with the functional features of Java 8

Publishing Big Geospatial data as Linked Open Geospatial Data

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.

Movie review dataset Word2Vec & sentiment classification Zeppelin notebook

Репозиторий учебных материалов для ДПО от ВШЭ (https://cs.hse.ru/dpo/) и курсов по Apache Spark

Spark with Scala example projects

A library for managing, validating, summarizing, and visualizing data.

Contains source files used in the Spark with Python course

Spark 2.0 Scala Machine Learning examples

scalable knowledge graph construction from unstructured text

Apache Spark for data engineers

A schema-aware Scala library for data transformation

RDF2X converts big RDF datasets to the relational database model, CSV, JSON and ElasticSearch.

pytest plugin to run the tests with support of pyspark

Basic framework utilities to quickly start writing production ready Apache Spark applications

Spark ML Lib serving library

Simple and Distributed Machine Learning

Simple SBT plugin to configure Spark applications

A framework designed around Kotlin providing Restful HTTP Client, JDBC DSL, Loading Cache, Configurations, Validations, and more

Spark Streaming ETL jobs for Mozilla Telemetry

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

🌏 Clip geographic data into MVT files based on Apache Spark

Walkthrough notebooks for Deep Learning, Machine Learning, Reinforcement Learning, Spark, Statistics, Algorithms, Scala, Python

A compiler for Pig Latin to Spark and Flink.

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Spark Scala docker container sample for AWS testing - EKS & S3

A quotation-based Scala DSL for scalable data analysis.

An Extensible Data Skipping Framework

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

A Spark datasource for the HadoopOffice library

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

Materials for "Machine Learning on Big Data" course

A collection of examples of continuous analytics.

A parallel implementation of factorization machines based on Spark

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi