141 Open source projects that are alternatives of or similar to Dataflowtemplates

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

Cloud Dataflow Tutorial for Beginners

A data-driven tool to identify the best candidates for a marketing campaign and optimize it.

Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.

Time tracking web app built as a replacement for old school timesheets.

Visualize Google BigQuery geospatial data using Google Maps Platform APIs

📁 This library is a Scala reactive DSL for object storage (e.g. S3/Amazon, S3/CEPH, Google Cloud Storage).

Stream Twitter Data into BigQuery with Cloud Dataprep

Continuous Archiving for Postgres

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Open Source Feature Flagging and A/B Testing Platform

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

🎣 List of `pre-commit` hooks to ensure the quality of your `dbt` projects.

Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.

A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift and Postgres with Spatial Analytics capabilities

a high-performance, POSIX-ish Amazon S3 file system written in Go

Use Airflow to move data from multiple MySQL databases to BigQuery

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Minimal cloud oriented Bazel gRPC cache

Simple Python client for interacting with Google BigQuery.

parse-server adapter for Google Cloud Storage

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

Easily view PyPI download statistics via Google's BigQuery.

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

An exporter for converting BigQuery results into Prometheus metrics

An upgraded and improved version of the Iris automatic GCP-labeling project

Google BigQuery for Laravel

☁️ Flexible and Fluent framework-agnostic driver based system to manage storage in Node.js

BigQuery Schema Conversion Tool

Web-based SQL editor run in your own private cloud. Supports MySQL, Postgres, SQL Server, Vertica, Crate, ClickHouse, Trino, Presto, SAP HANA, Cassandra, Snowflake, BigQuery, SQLite, and more with ODBC

The ViUR application development framework - legacy version 2.x for Python 2.7

Loads Snowplow enriched events into Google BigQuery

CLI tool to easily Decorate BigQuery table name

A Google Cloud Storage filesystem for Laravel

Google Cloud Platform Machine Learning Samples

Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

zips files in a Google Cloud Storage [tm] bucket

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

The simplest tool to manage views of BigQuery.

Blazing fast, instant realtime GraphQL APIs on your DB with fine grained access control, also trigger webhooks on database events.

ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.

Google Cloud Storage for Shrine

Local emulator for Google Cloud Storage

HTTP Archive's annual "State of the Web" report made by the web community

This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.

Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector

🍟 a notebook sql client. what you get when have a lot of sequels.

Host static websites with Google Cloud Storage and App Engine

Provides an Arc backend for Google Cloud Storage

☁️ nodejs kafka connect connector for Google BigQuery

Code For The Issue Label Bot, an App that automatically labels issues using machine learning, available on the GitHub Marketplace. This is also code for the blog article: "How to automate tasks on GitHub with machine learning for fun and profit"

The list of public blockchain datasets in BigQuery

💾 ☁️ Tutorial for interacting with Google Cloud Storage via the Python SDK.

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

An interface to Google's BigQuery from R.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

A tool for data sampling, data generation, and data diffing