1085 Open source projects that are alternatives of or similar to blockchain-etl-streaming

Useful SQL queries for Blockchain ETL datasets in BigQuery.

Study materials for the Google Cloud Professional Data Engineering Exam

Stream Twitter Data into BigQuery with Cloud Dataprep

Fancy stream processing made operationally mundane

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

An upgraded and improved version of the Iris automatic GCP-labeling project

Datart is a next generation Data Visualization Open Platform

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Dockerized Django Back-end API using DRF with Angular Front-end Tutorial

A python package to create a database on the platform using our moj data warehousing framework

Example project implementing best practices for PySpark ETL jobs and applications.

A lightweight stream processing library for Go

🐟 A streaming ETL for fish

Add digests to container and init container images in Kubernetes pod and pod template specs. Use either as a mutating admission webhook, or as a client-side KRM function with kpt or kustomize.

Open Service Broker for Google Cloud Platform

An Elasticsearch client tailored to data science workflows.

GitHub Action for interacting with Google Cloud Platform (GCP)

ELT Code for your Data Warehouse

Beneath is a serverless real-time data platform ⚡️

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

A tool for building feature stores.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Swift (Darwin) library for logging application events in Google Cloud.

A collection of tools for extracting FHIR resources and analytics services on top of that data.

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

Blog post on ETL pipelines with Airflow

This action deploys your container image to Cloud Run.

If you are looking to become a Google Cloud Engineer , then you are at the right place. GCPSketchnote is series where I share Google Cloud concepts in quick and easy to learn format.

Google Cloud Platform Certification resources.

Elixir package for Oauth authentication via Google Cloud APIs

Resources to prepare for Google Certified Cloud Architect Professional Exam - 2017

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

Use Firebase tools to incorporate common features into your games!

Python library for building Pangeo Forge recipes.

A schema-aware Scala library for data transformation

Example of an ETL Pipeline using Airflow

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

An extensible Java framework for building XML and non-XML streaming applications

Creating time bound IAM Conditions with ease and flair

Cross-application messaging for Ruby and Rails using Google Cloud Pub/Sub

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

A Python stream processing engine modeled after Yahoo! Pipes

A simple Spark-powered ETL framework that just works 🍺

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

GISJOGJA - aplikasi web based sistem informasi geografis (SIG) / GIS wisata kota JOGJA - www.firstplato.com

All files containing commands which can be used to complete GCP quests and challenge labs

Enterprise-grade, production-hardened, serverless data lake on AWS

Course Material for in28minutes courses on Java, Spring Boot, DevOps, AWS, Google Cloud, and Azure.

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Minimal authentication library for Google Cloud Platform (GCP)

A GitHub Action that deploys source code to Google App Engine.

A set of demo applications that make use of google speech, nlp and vision apis based in angular2

A client for connecting and running DDLs on hive metastore.

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

Forseti Security

Fog for Google Cloud Platform

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

A GitHub Action for authenticating to Google Cloud.