227 Open source projects that are alternatives of or similar to airflow-tutorial

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

A collection of Google Cloud Platform (GCP) plugins

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Sparklyr extension package to connect to Google BigQuery

Configuration and definitions of Airflow for OpenTrials

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

A complete development environment setup for working with Airflow

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Apache Airflow - OpenApi Client for Python

Build DataOps platform with Apache Airflow and dbt on AWS

Logica is a logic programming language that compiles to StandardSQL and runs on Google BigQuery.

Apache Airflow CI pipeline

使用Spring Security + JWT Token + RBAC的方式实现认证和授权，持久层使用Mybatis plus。避免每次重复编写认证和授权功能、角色管理、异常处理、参数校验等代码，直接上手业务代码，不再烦恼于构建项目与风格统一。

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

Personal Data Engineering Projects

Database Naming Conventions & Best Practices

Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector

Gateway server that provides an OData interface to BigQuery and Elasticsearch

A desktop App that allow users to import Excel data into MySQL database and manage data.

Execution of DBT models using Apache Airflow through Docker Compose

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Testbed of AI Systems Quality Management

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Powerful product analytics for data teams, with full control over data & models.

DBT Cloud Plugin for Airflow

Hive Storage Handler for interoperability between BigQuery and Apache Hive

The list of public blockchain datasets in BigQuery

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)

Scalable MySQL Cluster with ProxySQL Load Balancer and Orchestrator

📖 book note,读书笔记

DBMS Mini Project that basically designed for online music player

REST API using Node with typescript, KOA framework. TypeORM for SQL. Middlewares JWT (auth), CORS, Winston Logger, Error, Response

Export Airflow metrics (from mysql) in prometheus format

MySequel Web is an open source web based GUI tool to access your MySql database. It is similar to PHP My Admin of WAMP. Here you can access any MySQL database with proper connection strings. We do not save or store any of your connection strings or data. Every thing related to your connection strings are volatile. You can host this as a simple n…

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

Plugins do Airflow para implementação de pipelines de dados

Time tracking web app built as a replacement for old school timesheets.

Online Library Management. User can search, check in, checkout book. System adds fines automatically if the book is not checked in by due date

Observatory Platform Package

Node with mysql boilerplate

Convenient Dataflow pipelines for transforming data between cloud data sources

Get your MLOps (Level 1) platform started and going fast.

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Implementing Naive Bayes Classification algorithm into PHP to classify given text as ham or spam. This application uses MySql as database.

Export your events from Amplitude to Google BigQuery/Google Cloud Storage

☁️ nodejs kafka connect connector for Google BigQuery

Proactive Software Asset Management. Agent component

Simple SQL table fuzzing

An upgraded and improved version of the Iris automatic GCP-labeling project

Parcel for Apache Airflow

A Python framework for data processing on GCP.

Migrate an existing Java EE workload to Azure

Visualize Airflow's schedule by exporting future DAG runs as events to Google Calendar.

CodeSignal solutions

Air Data Computer

The simplest tool to manage views of BigQuery.

With this code, you can search all database with narrowing down the Tables & Column to search in, Resulting in low traversing & high performance

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.