386 Open source projects that are alternatives of or similar to BigDataTools

Hadoop utility to compact small files

基于Hadoop的分布式云存储系统 🌴

编程路上加油站！------【持续更新中...欢迎star,欢迎常回来看看......】【内容：编程/学习/阅读资源，开源项目,面试题,网站,书,博客,教程等等】

Easy parsing of Apache HTTPD and NGINX access logs with Java, Hadoop, Hive, Pig, Flink, Beam, Storm, Drill, ...

Apiary provides modules which can be combined to create a federated cloud data lake

Smart Automation Tool for building modern Data Lakes and Data Pipelines

An Open Source unit test framework for Hive queries based on JUnit 4 and 5

Learning Flink : Flink CEP,Flink Core,Flink SQL

Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format

Hive Ruby API Client

Make record oriented data to columnar format.

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

A robust web archive analytics toolkit

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

个人笔记集中营，快糙猛的形式记录技术性Notes .. 📚☕️⌨️🎧

adding "simple" to HBase

一道面试题的思考 - 6000万数据包和300万数据包在50M内存使用环境中求交集

This is a learning note | Java基础，JVM，源码，大数据，面经

🐧基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

Flutter Application to keep track of Subscriptions

Ppts, códigos y videos de las meetups, data science days, videollamadas y workshops. Data Science Research es una organización sin fines de lucro que busca difundir, descentralizar y difundir los conocimientos en Ciencia de Datos e Inteligencia Artificial en el Perú, dando oportunidades a nuevos talentos mediante MeetUps, Workshops y Semilleros …

Liquibase extension to add Impala Database support

A distributed file system written in Rust.

HBase as a JSON Document Database

基于hadoop+hbase+springboot实现分布式网盘系统

Scalable data processing pipelines in JavaScript

java学习和项目中一些典型的应用场景样例代码

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

A curated list of awesome Hive resources.

Full featured TypeScript Twitter archive reader and browser

Management and automation platform for Stateful Distributed Systems

DevOps pipeline for Real Time Social/Web Mining

Hayabusa: Simple and Fast Full-Text Search Engine for Massive System Log Data

MySQL Replicator. Replicates MySQL tables to Kafka and HBase, keeping the data changes history in HBase.

Native Julia I/O package to work with CERN ROOT files

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Analyzes network traffic of HBase RegionServers

Service for automatically managing and cleaning up unreferenced data

Use Scala API to read/write data from different databases,HBase,MySQL,etc.

A client for connecting and running DDLs on hive metastore.

西电云计算课程大作业Web端代码示例

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

大型分布式系统实时监控平台

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters

大数据生态圈学习

NoSQL Data Engineering

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

BEE MOnitoring System: create an infrastructure for monitoring beehives

No description or website provided.

Kafka Connect FileSystem Connector

Fense is a database proxy written in Java, which can connect DB of different engines at the same time. The key features are: authority management, query cache, audit security, current limiting fuse, onesql and so on

Apache Phoenix / Hbase Spring Boot Microservices

hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.

Examples for gauravbytes.com

An open-source, cloud-ready web application for simplified deployment of big data workflows.

Flink: Stateful Computations over Data Streams