112 Open source projects that are alternatives of or similar to spark-on-k8s-gcp-examples

A collection of Google Cloud Platform (GCP) plugins

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

An example mini data warehouse for python project stats, template for new projects

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake

Quix Notebook Manager

Google-provided Cloud Dataflow template pipelines for solving simple in-Cloud data tasks

📂 A small library with a limited set of Google Cloud Storage operations 🦀

Easily view PyPI download statistics via Google's BigQuery.

Common solutions and tools developed by Google Cloud's Professional Services team

Blazing fast, instant realtime GraphQL APIs on your DB with fine grained access control, also trigger webhooks on database events.

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. What datasets do you want to be added to Ethereum ETL? Vote here: https://blockchain-etl.convas.io.

Automated feature engineering for geospatial data

DDL parase and Convert to BigQuery JSON schema and DDL statements

NPM package for copying and converting Cloud Firestore data to BigQuery.

tbls is a CI-Friendly tool for document a database, written in Go.

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

Simple Python client for interacting with Google BigQuery.

Google Search Console Logger for Google App Engine

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

A tool for data sampling, data generation, and data diffing

RTLSDR ADS-B dump1090 to Google BigQuery

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

📊 Cube — Open-Source Analytics API for Building Data Apps

Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.

A collection of Magnolia add-on modules

Open source Business Intelligence tool 🎉

LINQ to BigQuery is C# LINQ Provider for Google BigQuery. It also enables Desktop GUI Client with LINQPad and plug-in driver.

Website analytics, JavaScript error tracking + analytics, tag manager, data ingest endpoint creation (tracking pixels). GDPR + CCPA compliant.

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Google BigQuery Datasource Plugin for Grafana.

DIY commercial datasets on Google Cloud Platform

ScalikeJDBC extension for Google BigQuery

Export PostgreSQL tables to Google BigQuery

A Scala API for Apache Beam and Google Cloud Dataflow.

Cloud Dataflow Tutorial for Beginners

Managed Machine Learning Systems and Internet of Things Live Lesson

An interface to Google's BigQuery from R.

a bot that generates realistic replies using a combination of pretrained GPT-2 and BERT models

🍟 a notebook sql client. what you get when have a lot of sequels.

super handy google cloud Pub/Sub CLI

Web-based SQL editor run in your own private cloud. Supports MySQL, Postgres, SQL Server, Vertica, Crate, ClickHouse, Trino, Presto, SAP HANA, Cassandra, Snowflake, BigQuery, SQLite, and more with ODBC

Stream data into Google BigQuery concurrently using InsertAll()

HTTP Archive's annual "State of the Web" report made by the web community

hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.

Code For The Issue Label Bot, an App that automatically labels issues using machine learning, available on the GitHub Marketplace. This is also code for the blog article: "How to automate tasks on GitHub with machine learning for fun and profit"

Universalizando o acesso a dados no Brasil. Docs: https://basedosdados.github.io/mais/

Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Loads Snowplow enriched events into Google BigQuery

Load data from Kafka to any data warehouse

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

Pandas Google BigQuery

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

GCP Variant Transforms

golang wrapper for all (to-be) kinds of message brokers

GIS Visualisation for Amazon Athena and BigQuery

Public reusable components for Polyaxon