GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → quintoandar → hive-metastore-client

quintoandar / hive-metastore-client

Licence: Apache-2.0 license
A client for connecting and running DDLs on hive metastore.

Programming Languages

Thrift
134 projects
python
139335 projects - #7 most used programming language
Makefile
30231 projects

Labels

packagehiveetldata-engineeringhive-metastore-clientmetastorehive-metastoreddls

Projects that are alternatives of or similar to hive-metastore-client

waggle-dance
Hive federation service. Enables disparate tables to be concurrently accessed across multiple Hive deployments.
Stars: ✭ 194 (+424.32%)
Mutual labels:  hive, metastore, hive-metastore
beekeeper
Service for automatically managing and cleaning up unreferenced data
Stars: ✭ 43 (+16.22%)
Mutual labels:  hive, metastore, hive-metastore
DaFlow
Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (-35.14%)
Mutual labels:  hive, etl
Addax
Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.
Stars: ✭ 615 (+1562.16%)
Mutual labels:  hive, etl
AirflowETL
Blog post on ETL pipelines with Airflow
Stars: ✭ 20 (-45.95%)
Mutual labels:  etl, data-engineering
simple-ddl-parser
Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.
Stars: ✭ 76 (+105.41%)
Mutual labels:  hive, ddls
apiary
Apiary provides modules which can be combined to create a federated cloud data lake
Stars: ✭ 30 (-18.92%)
Mutual labels:  hive, hive-metastore
web-click-flow
网站点击流离线日志分析
Stars: ✭ 14 (-62.16%)
Mutual labels:  hive, etl
Wedatasphere
WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!
Stars: ✭ 372 (+905.41%)
Mutual labels:  hive, etl
Pyetl
python ETL framework
Stars: ✭ 33 (-10.81%)
Mutual labels:  hive, etl
Luigi Warehouse
A luigi powered analytics / warehouse stack
Stars: ✭ 72 (+94.59%)
Mutual labels:  hive, etl
DataX-src
DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。
Stars: ✭ 21 (-43.24%)
Mutual labels:  hive, etl
Aws Serverless Data Lake Framework
Enterprise-grade, production-hardened, serverless data lake on AWS
Stars: ✭ 179 (+383.78%)
Mutual labels:  etl, data-engineering
Airbyte
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Stars: ✭ 4,919 (+13194.59%)
Mutual labels:  etl, data-engineering
Datax
DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server
Stars: ✭ 116 (+213.51%)
Mutual labels:  hive, etl
Butterfree
A tool for building feature stores.
Stars: ✭ 126 (+240.54%)
Mutual labels:  etl, data-engineering
Setl
A simple Spark-powered ETL framework that just works 🍺
Stars: ✭ 79 (+113.51%)
Mutual labels:  etl, data-engineering
Aws Data Wrangler
Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Stars: ✭ 2,385 (+6345.95%)
Mutual labels:  etl, data-engineering
qwery
A SQL-like language for performing ETL transformations.
Stars: ✭ 28 (-24.32%)
Mutual labels:  hive, etl
Dataspherestudio
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Stars: ✭ 1,195 (+3129.73%)
Mutual labels:  hive, etl
View All Similar Projects ➔

Hive Metastore Client

A client for connecting and running DDLs on Hive Metastore using Thrift protocol.

Release Python Version License Code style: black

Source Downloads Page Installation Command
PyPi PyPi Downloads Link pip install hive-metastore-client

Build status

Develop Stable Documentation Sonar
Test Publish Documentation Status Quality Gate Status

This library supports Python version 3.7+.

To check library main features you can check Hive Metastore Client's Documentation, which is hosted by Read the Docs.

An example of how to use the library for running DDL commands in hive metastore:

from hive_metastore_client.builders import DatabaseBuilder
from hive_metastore_client import HiveMetastoreClient

database = DatabaseBuilder(name='new_db').build()
with HiveMetastoreClient(HIVE_HOST, HIVE_PORT) as hive_metastore_client:
    hive_metastore_client.create_database(database)

To learn more use cases in practice, see Hive Metastore Client examples

Requirements and Installation

Hive Metastore Client depends on Python 3.7+

Python Package Index hosts reference to a pip-installable module of this library, using it is as straightforward as including it on your project's requirements.

pip install hive-metastore-client

License

Apache License 2.0

Contributing

All contributions are welcome! Feel free to open Pull Requests. Check the development and contributing guidelines described in CONTRIBUTING.md

Made with ❤️ by the Data Engineering team from QuintoAndar

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].