535 Open source projects that are alternatives of or similar to go-bqloader

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

☁️ nodejs kafka connect connector for Google BigQuery

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

The ViUR application development framework - legacy version 2.x for Python 2.7

[Unmaintained] ⚙️ A simple Google Cloud Function in Go to transform / proxy Stackdriver Static Webhook notifications to Discord.

A tool for managing secrets on Google Cloud

Collection of sample apps showcasing popular use cases using Cloud Functions for Firebase

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

An example mini data warehouse for python project stats, template for new projects

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Google-provided Cloud Dataflow template pipelines for solving simple in-Cloud data tasks

Cloud Dataflow Tutorial for Beginners

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Run Sonatype Nexus Repository Manager OSS on top of Kubernetes (GKE). Includes instructions for automated backups (GCS) and day-to-day usage.

Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

A Google Cloud Storage filesystem for Laravel

Minimal cloud oriented Bazel gRPC cache

Clojure wrapper for google-cloud-storage Java client.

C++ Client Libraries for Google Cloud Services

Flysystem Adapter for Google Cloud Storage

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

The simplest tool to manage views of BigQuery.

An upgraded and improved version of the Iris automatic GCP-labeling project

A Scala API for Apache Beam and Google Cloud Dataflow.

Bulk Stash is a docker rclone service to sync, or copy, files between different storage services. For example, you can copy files either to or from a remote storage services like Amazon S3 to Google Cloud Storage, or locally from your laptop to a remote storage.

This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.

📼 Package media content for online streaming(DASH and HLS) using FFmpeg

📃 Smashingly simple, and scalable ("serverless") HTML to PDF conversions using Google Cloud Functions, and Puppeteer.

Provides an Arc backend for Google Cloud Storage

A collection of Magnolia add-on modules

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

🔄 Simple tool for ETL. From SQL to Redis.

The list of public blockchain datasets in BigQuery

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

Build a Node.js & Angular 2 Web App using Google Cloud Platform

Google Cloud Instance Scheduler helping to reduce costs by 60% on average for non-production environments.

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A Monolog extension for formatting log entries for Google Cloud Logging

数据质量控制系统

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

ETL for the NASDAQ symbol file

Kubernetes mutating webhook for `secrets-init` injection

OCR with Google's AI technology (Cloud Vision API)

Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)

code, labs and lectures for the course

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

Crate for authenticating Server to Server Apps for Google Cloud Engine.

This script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn Mee and Mee Siam.

PowerShell cmdlets for the Google Cloud Platform

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

Google Vision Api for PHP (https://cloud.google.com/vision/)

A CLI and library to run Singer Taps and Targets

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

SOULs 🔥 Build Serverless Apps faster like Rails. Powered by Ruby GraphQL, RBS/Steep, Active Record, RSpec, RuboCop, and Google Cloud.

Google Translate API wrapper translates only changes between revisions of big texts

A collection of Google Cloud Platform (GCP) plugins

ETL jobs for Firefox Telemetry