388 Open source projects that are alternatives of or similar to hive-metastore-client

Service for automatically managing and cleaning up unreferenced data

Hive federation service. Enables disparate tables to be concurrently accessed across multiple Hive deployments.

Beneath is a serverless real-time data platform ⚡️

Python library for building Pangeo Forge recipes.

Blog post on ETL pipelines with Airflow

Fancy stream processing made operationally mundane

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

An Elasticsearch client tailored to data science workflows.

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

A tool for building feature stores.

Enterprise-grade, production-hardened, serverless data lake on AWS

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

python ETL framework

A python package to create a database on the platform using our moj data warehousing framework

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

A schema-aware Scala library for data transformation

A luigi powered analytics / warehouse stack

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Big Data Toolkit for the JVM

A simple Spark-powered ETL framework that just works 🍺

网站点击流离线日志分析

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Apiary provides modules which can be combined to create a federated cloud data lake

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Example of an ETL Pipeline using Airflow

Example project implementing best practices for PySpark ETL jobs and applications.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

ELT Code for your Data Warehouse

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

A SQL-like language for performing ETL transformations.

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Lightweight and blazing fast key-value database written in pure Dart.

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

A PHP library for connecting to Hive or Impala over Thrift

www.vixtract.ru

Unified SQL Analytics Engine Based on SparkSQL

Ecency Mobile - reimagined social blogging, contribute and get rewarded (for Android and iOS)

Python interface to Hive and Presto. 🐝

大数据分析可视化实践

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Ecency desktop formerly known as Esteem Surfer - reimagined desktop social wallet, contribute and get rewarded (for Windows, Mac, Linux)

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

Thain is a distributed flow schedule platform.

Big Data Ecosystem Docker

springboot和dubbo、netty的集成，redis mongodb的nosql模板， kafka rocketmq rabbit的MQ模板， solr solrcloud elasticsearch查询引擎

大数据入门指南 ⭐

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

An app to keep track of different cryptocurrencies, written in dart + flutter

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

The official home of the Presto distributed SQL query engine for big data

基于wifi抓取信息的大数据查询分析系统