GoogleCloudPlatform / Bigquery Utils
Licence: apache-2.0
Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
Stars: ✭ 338
Programming Languages
java
68154 projects - #9 most used programming language
Projects that are alternatives of or similar to Bigquery Utils
Ethereum Etl
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 956 (+182.84%)
Mutual labels: sql, bigquery
Bitcoin Etl
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 174 (-48.52%)
Mutual labels: sql, bigquery
Ddlparse
DDL parase and Convert to BigQuery JSON schema and DDL statements
Stars: ✭ 52 (-84.62%)
Mutual labels: sql, bigquery
Franchise
🍟 a notebook sql client. what you get when have a lot of sequels.
Stars: ✭ 3,823 (+1031.07%)
Mutual labels: sql, bigquery
iris3
An upgraded and improved version of the Iris automatic GCP-labeling project
Stars: ✭ 38 (-88.76%)
Mutual labels: bigquery, google-cloud-platform
Node Mysql Utilities
Query builder for node-mysql with introspection, etc.
Stars: ✭ 98 (-71.01%)
Mutual labels: sql, utilities
Mara Example Project 2
An example mini data warehouse for python project stats, template for new projects
Stars: ✭ 154 (-54.44%)
Mutual labels: sql, bigquery
Dataflow Tutorial
Cloud Dataflow Tutorial for Beginners
Stars: ✭ 17 (-94.97%)
Mutual labels: google-cloud-platform, bigquery
Bigquery Grafana
Google BigQuery Datasource Plugin for Grafana.
Stars: ✭ 188 (-44.38%)
Mutual labels: google-cloud-platform, bigquery
Professional Services
Common solutions and tools developed by Google Cloud's Professional Services team
Stars: ✭ 1,923 (+468.93%)
Mutual labels: google-cloud-platform, bigquery
ob google-bigquery
This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.
Stars: ✭ 43 (-87.28%)
Mutual labels: bigquery, google-cloud-platform
argon
Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector
Stars: ✭ 31 (-90.83%)
Mutual labels: bigquery, google-cloud-platform
Nodejs Bigquery
Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.
Stars: ✭ 268 (-20.71%)
Mutual labels: sql, bigquery
Flask Appbuilder
Simple and rapid application development framework, built on top of Flask. includes detailed security, auto CRUD generation for your models, google charts and much more. Demo (login with guest/welcome) - http://flaskappbuilder.pythonanywhere.com/
Stars: ✭ 3,603 (+965.98%)
Mutual labels: sql
Datafuse
Datafuse is a free Cloud-Native Analytics DBMS(Inspired by ClickHouse) implemented in Rust
Stars: ✭ 327 (-3.25%)
Mutual labels: sql
Syntax Parser
Light and fast 🚀parser! With zero dependents. - Sql Parser Demo added!
Stars: ✭ 317 (-6.21%)
Mutual labels: sql
Automigrate
version your SQL schemas with git + automatically migrate them
Stars: ✭ 318 (-5.92%)
Mutual labels: sql
Freezer
A simple & fluent Android ORM, how can it be easier ? RxJava2 compatible
Stars: ✭ 326 (-3.55%)
Mutual labels: sql
Monetdb Old
This is the official mirror of the MonetDB Mercurial repository. Please note that we do not accept pull requests on github. The regression test results can be found on the MonetDB Testweb http://monetdb.cwi.nl/testweb/web/status.php .For contributions please see: https://www.monetdb.org/Developers
Stars: ✭ 317 (-6.21%)
Mutual labels: sql
BigQuery Utils
BigQuery is a serverless, highly-scalable, and cost-effective cloud data warehouse with an in-memory BI Engine and machine learning built in. This repository provides useful utilities to assist you in migration and usage of BigQuery.
Getting Started
This repository is broken up into:
- Dashboards - Pre-built dashboards for common use cases
-
Performance Testing - Examples for doing performance testing
- JMeter - Examples for using JMeter to test BigQuery performance
-
Scripts - Python, Shell, & SQL scripts
- billing - Example queries over the GCP billing export
- Stored Procedures - Example stored procedures
-
Tools - Custom tooling for working with BigQuery
- Cloud Functions - Cloud Functions to automate common use cases
- UDFs - User-defined functions for common usage as well as migration
-
Views - Views over system tables such as audit logs or the
INFORMATION_SCHEMA- query_audit - View to simplify querying the audit logs which can be used to power dashboards (example).
Public UDFs
For more information on UDFs and using those provided in the repository with BigQuery, see the README in the udfs folder.
Contributing
See the contributing instructions to get started contributing.
To contribute UDFs to this repository, see the instructions in the udfs folder.
License
All solutions within this repository are provided under the Apache 2.0 license. Please see the LICENSE file for more detailed terms and conditions.
Disclaimer
This repository and its contents are not an official Google Product.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].