ScioA Scala API for Apache Beam and Google Cloud Dataflow.
Stars: ✭ 2,247 (+2240.63%)
Mutual labels: bigquery, beam, dataflow
argonCampaign Manager 360 and Display & Video 360 Reports to BigQuery connector
Stars: ✭ 31 (-67.71%)
Mutual labels: bigquery, gcp
astroAstro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Stars: ✭ 79 (-17.71%)
Mutual labels: bigquery, workflows
Ethereum EtlPython scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 956 (+895.83%)
Mutual labels: bigquery, gcp
iris3An upgraded and improved version of the Iris automatic GCP-labeling project
Stars: ✭ 38 (-60.42%)
Mutual labels: bigquery, gcp
bigquery-to-datastoreExport a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
Stars: ✭ 56 (-41.67%)
Mutual labels: bigquery, beam
snowplow-bigquery-loaderLoads Snowplow enriched events into Google BigQuery
Stars: ✭ 15 (-84.37%)
Mutual labels: bigquery, gcp
Airflow ToolkitAny Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥 >> [ 🚀, 🚢 ]
Stars: ✭ 51 (-46.87%)
Mutual labels: composer, gcp
Ethereum Etl AirflowAirflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. What datasets do you want to be added to Ethereum ETL? Vote here: https://blockchain-etl.convas.io.
Stars: ✭ 89 (-7.29%)
Mutual labels: bigquery, gcp
Bitcoin EtlETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 174 (+81.25%)
Mutual labels: bigquery, gcp
hive-bigquery-storage-handlerHive Storage Handler for interoperability between BigQuery and Apache Hive
Stars: ✭ 16 (-83.33%)
Mutual labels: bigquery, gcp
DataflowTemplatesConvenient Dataflow pipelines for transforming data between cloud data sources
Stars: ✭ 22 (-77.08%)
Mutual labels: bigquery, dataflow
etlflowEtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.
Stars: ✭ 38 (-60.42%)
Mutual labels: bigquery, gcp
polygon-etlETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
Stars: ✭ 53 (-44.79%)
Mutual labels: bigquery, gcp
gcp-mlGoogle Cloud Platform Machine Learning Samples
Stars: ✭ 31 (-67.71%)
Mutual labels: bigquery, gcp
dataflow-fsi-exampleUsing Google Cloud, this project is an example of how to detect anomalies in financial, technical indicators by modeling their expected distribution and thus inform when the Relative Strength Indicator (RSI) is unreliable.
Stars: ✭ 26 (-72.92%)
Mutual labels: gcp, dataflow
Datashare ToolkitDIY commercial datasets on Google Cloud Platform
Stars: ✭ 41 (-57.29%)
Mutual labels: bigquery, gcp
bigquery-data-lineageReference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Stars: ✭ 112 (+16.67%)
Mutual labels: bigquery, dataflow