399 Open source projects that are alternatives of or similar to Sparkctr

Python clone of Spark, a MapReduce alike framework in Python

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Optimize and improve the Label propagation algorithm

Research on distributed system

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

A luigi powered analytics / warehouse stack

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

四川大学拓思爱诺用户session行为数据离线分析项目

Scalable genomic data analysis.

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Word2Vec models with Twitter data using Spark. Blog:

▁▂▄▆▇█▇▆▄▂▁

🌐 Interactive Workshop on GeoAnalysis using PySpark

Generic Data Ingestion & Dispersal Library for Hadoop

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

Ruby wrapper for Apache Spark

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

A simple spark standalone cluster for your testing environment purposses

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

A Spark plugin for reading Excel files via Apache POI

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Real Time Analytics and Data Pipelines based on Spark Streaming

Code and presentation for Strata Model Serving tutorial

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Apache Spark examples exclusively in Java

Distributed scikit-learn meta-estimators in PySpark

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Spark, Spark Streaming and Spark SQL unit testing strategies

This is a based on playframwork for submit spark app

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Natural Korean Processor for Apache Spark

Java开发者或者大数据开发者面试知识点整理

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Enabling queries on compressed data.

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Apache Spark (PySpark) Practice on Real Data

Spark examples

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

Apache Spark Connector for Azure Kusto

A scalable nearest neighbor search library in Apache Spark

Spark structured streaming examples with using of version 3.0.0

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

A big data platform for analyzing web access logs

一个大数据架构师应该掌握的技能

A better compressed bitset in Java

hadoop各组件使用，持续更新

Expressive types for Spark.

电商用户行为分析大数据平台

Alluxio, data orchestration for analytics and machine learning in the cloud

Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

A parallel implementation of word2vec based on Spark

📊 Cube — Open-Source Analytics API for Building Data Apps