Hadoop ConnectorsLibraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
Stars: ✭ 218 (+1576.92%)
Mara Example Project 2An example mini data warehouse for python project stats, template for new projects
Stars: ✭ 154 (+1084.62%)
logicaLogica is a logic programming language that compiles to StandardSQL and runs on Google BigQuery.
Stars: ✭ 1,469 (+11200%)
sparkbqSparklyr extension package to connect to Google BigQuery
Stars: ✭ 16 (+23.08%)
QuixQuix Notebook Manager
Stars: ✭ 184 (+1315.38%)
etlflowEtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.
Stars: ✭ 38 (+192.31%)
Professional ServicesCommon solutions and tools developed by Google Cloud's Professional Services team
Stars: ✭ 1,923 (+14692.31%)
tag-managerWebsite analytics, JavaScript error tracking + analytics, tag manager, data ingest endpoint creation (tracking pixels). GDPR + CCPA compliant.
Stars: ✭ 279 (+2046.15%)
Sql RunnerRun templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake
Stars: ✭ 68 (+423.08%)
google-cloudA collection of Google Cloud Platform (GCP) plugins
Stars: ✭ 34 (+161.54%)
flight2bqRTLSDR ADS-B dump1090 to Google BigQuery
Stars: ✭ 33 (+153.85%)
go-bqloaderbqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.
Stars: ✭ 16 (+23.08%)
GeomancerAutomated feature engineering for geospatial data
Stars: ✭ 194 (+1392.31%)
starlakeStarlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing
Stars: ✭ 16 (+23.08%)
Bitcoin EtlETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 174 (+1238.46%)
bqvThe simplest tool to manage views of BigQuery.
Stars: ✭ 22 (+69.23%)
Spark Bigquery ConnectorBigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Stars: ✭ 126 (+869.23%)
polygon-etlETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
Stars: ✭ 53 (+307.69%)
Cube.js📊 Cube — Open-Source Analytics API for Building Data Apps
Stars: ✭ 11,983 (+92076.92%)
Ethereum Etl AirflowAirflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. What datasets do you want to be added to Ethereum ETL? Vote here: https://blockchain-etl.convas.io.
Stars: ✭ 89 (+584.62%)
dekartGIS Visualisation for Amazon Athena and BigQuery
Stars: ✭ 131 (+907.69%)
bigquery-data-lineageReference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Stars: ✭ 112 (+761.54%)
Spark BigqueryGoogle BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
Stars: ✭ 65 (+400%)
pgsinkLogically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
Stars: ✭ 53 (+307.69%)
dbt-ml-preprocessingA SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.
Stars: ✭ 128 (+884.62%)
hive compared bqhive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
Stars: ✭ 27 (+107.69%)
becquerelGateway server that provides an OData interface to BigQuery and Elasticsearch
Stars: ✭ 17 (+30.77%)
Pandas GbqPandas Google BigQuery
Stars: ✭ 243 (+1769.23%)
astroAstro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Stars: ✭ 79 (+507.69%)
MproveOpen source Business Intelligence tool 🎉
Stars: ✭ 212 (+1530.77%)
DataflowTemplatesConvenient Dataflow pipelines for transforming data between cloud data sources
Stars: ✭ 22 (+69.23%)
Bigquery GrafanaGoogle BigQuery Datasource Plugin for Grafana.
Stars: ✭ 188 (+1346.15%)
argonCampaign Manager 360 and Display & Video 360 Reports to BigQuery connector
Stars: ✭ 31 (+138.46%)
ScioA Scala API for Apache Beam and Google Cloud Dataflow.
Stars: ✭ 2,247 (+17184.62%)
amplitude-bigqueryExport your events from Amplitude to Google BigQuery/Google Cloud Storage
Stars: ✭ 28 (+115.38%)
Gpt2 Bert Reddit Bota bot that generates realistic replies using a combination of pretrained GPT-2 and BERT models
Stars: ✭ 158 (+1115.38%)
gcp-mlGoogle Cloud Platform Machine Learning Samples
Stars: ✭ 31 (+138.46%)
Go BqstreamerStream data into Google BigQuery concurrently using InsertAll()
Stars: ✭ 133 (+923.08%)
objectiv-analyticsPowerful product analytics for data teams, with full control over data & models.
Stars: ✭ 399 (+2969.23%)
MaisUniversalizando o acesso a dados no Brasil. Docs: https://basedosdados.github.io/mais/
Stars: ✭ 122 (+838.46%)
bigquery-to-datastoreExport a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
Stars: ✭ 56 (+330.77%)
BeastLoad data from Kafka to any data warehouse
Stars: ✭ 119 (+815.38%)
bigflowA Python framework for data processing on GCP.
Stars: ✭ 96 (+638.46%)
team-timesheetsTime tracking web app built as a replacement for old school timesheets.
Stars: ✭ 25 (+92.31%)
MagnolifyA collection of Magnolia add-on modules
Stars: ✭ 81 (+523.08%)
spark-on-k8s-gcp-examplesExample Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
Stars: ✭ 36 (+176.92%)
Linq To BigqueryLINQ to BigQuery is C# LINQ Provider for Google BigQuery. It also enables Desktop GUI Client with LINQPad and plug-in driver.
Stars: ✭ 69 (+430.77%)
iris3An upgraded and improved version of the Iris automatic GCP-labeling project
Stars: ✭ 38 (+192.31%)
target-and-marketA data-driven tool to identify the best candidates for a marketing campaign and optimize it.
Stars: ✭ 19 (+46.15%)
airflow-tutorialUse Airflow to move data from multiple MySQL databases to BigQuery
Stars: ✭ 96 (+638.46%)
kuromoji-for-bigqueryTokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale
Stars: ✭ 11 (-15.38%)
public-datasetsThe list of public blockchain datasets in BigQuery
Stars: ✭ 86 (+561.54%)
gsc-loggerGoogle Search Console Logger for Google App Engine
Stars: ✭ 38 (+192.31%)