917 Open source projects that are alternatives of or similar to beekeeper

Hive federation service. Enables disparate tables to be concurrently accessed across multiple Hive deployments.

A client for connecting and running DDLs on hive metastore.

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

大数据入门指南 ⭐

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

A series of DAGs/Workflows to help maintain the operation of Airflow

ACID Data Source for Apache Spark based on Hive ACID

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

Apache Hive

Read and write Neuroglancer datasets programmatically.

Apache Drill is a distributed MPP query layer for self describing data

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

A SQL-like language for performing ETL transformations.

Big Data Toolkit for the JVM

Tool to apply retention logic to docker images in a Docker Registry

Scalable, redundant, and distributed object store for Apache Hadoop

The official home of the Presto distributed SQL query engine for big data

Cleans up docker registry by removing untagged manifests from the registry

Apiary provides modules which can be combined to create a federated cloud data lake

Example end to end data engineering project.

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

This terraform module is used to create sftp on AWS for S3.

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

HiveQL Parser. Parse HiveQL code and print AST in JSON format if success, else print well formed syntax error message.

A boilerplate project for Azure Big Data PaaS services

Go Wrapper for using localstack

Android plugins for Java, making core Android APIs easy to use

A simple commenting system for your blog.

🔥 Latest computer science e-books。提供最新技术类电子书下载， “我无非就是想卷死各位，或者被各位卷死！”

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters

Easy automated configuration and deployment of Minecraft servers on AWS spot instances, featuring automatic backups and restoration using S3.

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3

Celeborn provides an elastic and high-performance service for shuffle and spilled data.

Terraform Modules by Peak

This project aim is to provide free software to fetch data from plcs (Siemens S7-300/400/1200/1500) and store it. Used stack is completly opensource. I used InfluDB as data storage, so application principle is following Big Data paradigm.

A curated list of awesome Hive resources.

AppSync for Relay

Relational data pipelines for the science lab

A SQLite driver for S3 and Amazon Athena 😳

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Unofficial MinIO Dart Client SDK that provides simple APIs to access any Amazon S3 compatible object storage server.

A Terraform module that creates a tagged S3 bucket and an IAM user/key with access to the bucket

A supercharged S3 reverse proxy

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

Mirror of Apache Airavata PHP Gateway

a set of scripts to pull meta data and data profiling metrics from relational database systems

A lightweight file upload input for Django and Amazon S3

Apache Spark Data Source for ROOT File Format

A practical guide for Sociocracy 3.0.

A distributed in-memory key-value storage for billions of small objects.

React Native app for image uploads to S3 and storing their records in Amazon DynamoDB using AWS Amplify and AppSync SDK

A command line utility for organizing files and directories according to regex patterns.