795 Open source projects that are alternatives of or similar to big_data

Materials for "Machine Learning on Big Data" course

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster. See https://github.com/Cascading/cascading for the release repository.

Data Lineage Tracking And Visualization Solution

C# and F# language binding and extensions to Apache Spark

MapReduce, Spark, Java, and Scala for Data Algorithms Book

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Ppts, códigos y videos de las meetups, data science days, videollamadas y workshops. Data Science Research es una organización sin fines de lucro que busca difundir, descentralizar y difundir los conocimientos en Ciencia de Datos e Inteligencia Artificial en el Perú, dando oportunidades a nuevos talentos mediante MeetUps, Workshops y Semilleros …

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

An end-to-end machine learning and data mining framework on Hadoop

A serverless cluster computing system for the Go programming language

Big Data Toolkit for the JVM

Apache Calcite

Samples to the Oracle Big Data Lite VM

Tidy up Spark and Hadoop tutorials.

Drools processor for Apache NiFi

Simple and Distributed Machine Learning

Apache Tez

ROOT I/O in pure Python and NumPy.

Apache Ignite

OLAP and ETL of Big Data

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

Kafka Connect HDFS connector

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

编程路上加油站！------【持续更新中...欢迎star,欢迎常回来看看......】【内容：编程/学习/阅读资源，开源项目,面试题,网站,书,博客,教程等等】

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

Griffon Data Science Virtual Machine

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

SQL Parsers for BigData, built with antlr4.

The official home of the Presto distributed SQL query engine for big data

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

Information Inference Service of the OpenAIRE system

Simple and Distributed Machine Learning

Collection of Databricks and Jupyter Notebooks

🐳 big data study

Big Data Processing Framework - Unified Data API or SQL on Any Storage

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

Full featured TypeScript Twitter archive reader and browser

🍉基于Hadoop和HBase的大规模海量数据去重

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

Some class materials for a data processing course using PySpark

ROOT I/O in pure Python and NumPy.

Data pipeline project

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Pyspark in Google Colab: A simple machine learning (Linear Regression) model