203 Open source projects that are alternatives of or similar to airflow-dbt-python

DBT Cloud Plugin for Airflow

Metric collection, data testing and monitoring for SQL accessible data

Example end to end data engineering project.

Build DataOps platform with Apache Airflow and dbt on AWS

A curated list of awesome dbt resources

Example of an ETL Pipeline using Airflow

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Airflow Deployment on AWS ECS Fargate Using Cloudformation

Execution of DBT models using Apache Airflow through Docker Compose

Blog post on ETL pipelines with Airflow

A Data Engineering & Machine Learning Knowledge Hub

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Plugins do Airflow para implementação de pipelines de dados

Personal Data Engineering Projects

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

No description or website provided.

dbt-sugar is a CLI tool that allows users of dbt to have fun and ease performing actions around dbt models

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Apache Airflow integration for dbt

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)

Elyra extends JupyterLab Notebooks with an AI centric approach.

Automating Your Data Pipeline with Apache Airflow

🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)

Bitnami Docker Image for Apache Airflow

Continuously synchronize directories from remote object store to local filesystem

Fast iterative local development and testing of Apache Airflow workflows

A series of DAGs/Workflows to help maintain the operation of Airflow

Airflow plugin to export dag and task based metrics to Prometheus.

A facebook for data

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability

Udacity Data Engineering Nano Degree (DEND)

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

A Helm chart to install Apache Airflow on Kubernetes

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Dynamically generate Apache Airflow DAGs from YAML configuration files

Airflow training for the crunch conf

Turbine: the bare metals that gets you Airflow

A web frontend for scheduling Jupyter notebook reports

Airflow basics tutorial

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Docker Apache Airflow

A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces

Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor

Kubernetes custom controller and CRDs to managing Airflow

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

ETLy is an add-on dashboard service on top of Apache Airflow.

Yet another helpdesk based on multiple providers

Airflow workflow management platform chef cookbook.

Minikube for big data with Scala and Spark

Airflow Unit Tests and Integration Tests

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

A distributed workflow runner focusing on performance and simplicity.

A plugin for Apache Airflow that allows you to manage the users that can login

Astronomer Core Docker Images

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥 >> [ 🚀, 🚢 ]