1035 Open source projects that are alternatives of or similar to Sparkrdma

Easily make RESTful web services for time series reporting with Big Data analytics engines like Druid and SQL Databases.

Hazelcast IMDG C++ Client

🐳 Tool to automate data quality checks on data pipelines

Apache Flink shaded artifacts repository

Distributed, Versioned, Image-oriented Dataservice

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Distributed t-SNE via Apache Spark

Word2Vec models with Twitter data using Spark. Blog:

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

🌐 Interactive Workshop on GeoAnalysis using PySpark

Facebook's Hive UDFs

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Convert and analyze large data sets at light speed, on Mac and iOS.

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

An extremely fast Non-crypto-safe AES Based Hash algorithm for Big Data

Boiler plate framework to use Spark and ZIO together.

something to help you spark

🎓 Jupyter notebooks from UFC data science course

State of the Art Natural Language Processing

Upserts, Deletes And Incremental Processing on Big Data.

pyspark🍒🥭 is delicious，just eat it!😋😋

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

VerticaPy is a Python library that exposes sci-kit like functionality to conduct data science projects on data stored in Vertica, thus taking advantage Vertica’s speed and built-in analytics and machine learning capabilities.

Apache Spark and Apache Kafka integration example

An implementation of locality sensitive hashing with Hadoop

Mirror of Apache Lens

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

The Signal Metadata Format Specification

YMCache is a lightweight object caching solution for iOS and Mac OS X that is designed for highly parallel access scenarios.

Code examples on Apache Spark using python

Spark Streaming监控平台，支持任务部署与告警、自启动

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

An open source book to learn data science, data analysis and machine learning, suitable for all ages!

Keyvi - a key value index that powers Cliqz search engine. It is an in-memory FST-based data structure highly optimized for size and lookup performance.

Kinesis Connector for Structured Streaming

Code and presentation for Strata Model Serving tutorial

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

Elassandra = Elasticsearch + Apache Cassandra

Apache Spark examples exclusively in Java

PySpark + Scikit-learn = Sparkit-learn

Apache Kibble - a tool to collect, aggregate and visualize data about any software project

PredictionIO, a machine learning server for developers and ML engineers.

A recommender system for discovering GitHub repos, built with Apache Spark

A native Node.js producer and consumer library for Amazon Kinesis Data Streams

scala、spark使用过程中，各种测试用例以及相关资料整理

This is a based on playframwork for submit spark app

📊 Cube — Open-Source Analytics API for Building Data Apps

Course Website on Macroeconomic Analysis with Machine Learning and Big Data

Mirror of Apache OODT

Process Common Crawl data with Python and Spark

CMAK is a tool for managing Apache Kafka clusters

A curated list of awesome Apache Spark packages and resources.

Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications.

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

PredictionIO Ruby SDK

Apache Avro is a data serialization system.

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)