651 Open source projects that are alternatives of or similar to Big Whale

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

A Spark cluster setup running on Docker containers

Next generation tool for decentralized exchange and transformation of semi-structured data

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Java开发者或者大数据开发者面试知识点整理

🚢 Docker image for Apache Spark

Cookbook to install Hadoop 2.0+ using Chef

A Scala feature transformation library for data science and machine learning

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Big Data Ecosystem Docker

Code Library for My Blog

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

Elastic data processing with Apache Pulsar and Apache Flink

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

Mirror of Apache Hadoop HDFS

Geospatial Raster support for Spark DataFrames

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

A repository to keep track of all the code that I end up writing for my blog posts.

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

The official home of the Presto distributed SQL query engine for big data

Live-coding the cluster!

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Boiler plate framework to use Spark and ZIO together.

pyspark🍒🥭 is delicious，just eat it!😋😋

Big Data Toolkit for the JVM

Apache Spark and Apache Kafka integration example

StreamLine - Streaming Analytics

Spark Streaming监控平台，支持任务部署与告警、自启动

Kinesis Connector for Structured Streaming

Elassandra = Elasticsearch + Apache Cassandra

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Docker packaging for Apache Flink

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Simple and beautiful card component with an elegant spark line, for VueJS.

A Clojure dataframe library that runs on Spark

Distributed t-SNE via Apache Spark

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Apache Drill is a distributed MPP query layer for self describing data

AI on Hadoop

📊 Cube — Open-Source Analytics API for Building Data Apps

spark ml 算法原理剖析以及具体的源码实现分析

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Asakusa Framework

Spark RDD with Lucene's query and entity linkage capabilities

Apache Spark on AWS Lambda

Support TensorFlow on YARN

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

Mirror of Apache Hadoop common

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Node.js bindings for Apache Spark DataFrame APIs

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

HBase客户端数据管理软件

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Data science and Big Data with Python