840 Open source projects that are alternatives of or similar to bigkube

Big Data Ecosystem Docker

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Alluxio, data orchestration for analytics and machine learning in the cloud

Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

📊 Cube — Open-Source Analytics API for Building Data Apps

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

大数据入门指南 ⭐

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Real Time Analytics and Data Pipelines based on Spark Streaming

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Fundamentals of Spark with Python (using PySpark), code examples

A pandas-like deferred expression system, with first-class SQL support

A Data Engineering & Machine Learning Knowledge Hub

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Bucketing and partitioning system for Parquet

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Big Data for Data Engineers Coursera Specialization from Yandex

Udacity Data Engineering Nano Degree (DEND)

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

A complete (distributed) BigData stack, running in containers

零基础学习spark，大数据学习

Data validation and organization of metadata for data frames and database tables

Identifies and collects data on cc-licensed content across web crawl data and public apis.

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

🎼 Docker compose files for various kafka stacks

Demonstration of Eclipse Vert.x, Kotlin, RxJava2 and Kubernetes

.NET 5.0 Web API İle E-Ticaret Sitesi Yapımı MVC,Win Form,Angular ve Mobil

Astronomer Core Docker Images

Model complex data transformation pipelines easily

Conex integrates Docker with testing package so you can easily run your integration tests with containers.

Bitnami Docker Image for Apache Airflow Scheduler

Apache Spark docker container image (Standalone mode)

A pytest powered framework for multi-host integration and system testing

Apache Spark Sentry Integration

人生苦短 我用Python

blog entries

Inventory Management System by asp.net and MSSQL

HL7 Apache Spark Datasource

ACID Data Source for Apache Spark based on Hive ACID

W3C WebDriver JavaScript Client

Type System for Data Analysis in Python

Visualize column-level data lineage in Spark SQL

A parallel implementation of word2vec based on Spark

A library that provides useful extensions to Apache Spark and PySpark.

Collection of different demo applications using Apache Spark

A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract data from S3, apply a series of transformations and load into S3 and Redshift.

CarRental Project

Quick nodejs (Express) + docker + mongodb + JEST(testing) setup.

spark on kubernetes

Autoscaling for Google Cloud Dataproc

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

Example of a single node Presto with Azure Data Lake Store (ADLS) and Azure Storage Blob (WASB) access via Hive metastore