122 Open source projects that are alternatives of or similar to dbt-airflow-docker-compose

Apache Airflow integration for dbt

Build DataOps platform with Apache Airflow and dbt on AWS

DBT Cloud Plugin for Airflow

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

No description or website provided.

Airflow Deployment on AWS ECS Fargate Using Cloudformation

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

afctl helps to manage and deploy Apache Airflow projects faster and smoother.

Bitnami Docker Image for Apache Airflow

The metrics layer for your data. Join us at https://metriql.com/slack

A curated list of awesome dbt resources

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)

A dbt adapter for Databricks.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Real Time Twitter Sentiment Analysis Product

Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)

💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.

Example end to end data engineering project.

Package for dbt that allows users to train, audit and use BigQuery ML models.

ETLy is an add-on dashboard service on top of Apache Airflow.

Example DAGs using hooks and operators from Airflow Plugins

A distributed workflow runner focusing on performance and simplicity.

Workflow engine for Kubernetes

Apache Airflow Website

Curated list of resources about Apache Airflow

Bare minimal Airflow on Kubernetes (Local, EKS, AKS)

Airflow plugin to export dag and task based metrics to Prometheus.

Kedro-Airflow makes it easy to deploy Kedro projects to Airflow.

A Helm chart to install Apache Airflow on Kubernetes

Functional Airflow DAG definitions.

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Flask-AppBuilder SecurityManager for OpenIDConnect

Airflow configuration for Telemetry

Parcel for Apache Airflow

Fast iterative local development and testing of Apache Airflow workflows

Blog post on ETL pipelines with Airflow

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'

Udacity Data Engineering Nano Degree (DEND)

PipelineAI Kubeflow Distribution

Airflow training for the crunch conf

Testbed of AI Systems Quality Management

Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor

Airflow workflow management platform chef cookbook.

Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥 >> [ 🚀, 🚢 ]

A web frontend for scheduling Jupyter notebook reports

Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation, validation and loading of data from S3 -> Redshift -> S3

A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI tool of your choice and even run your code on it.

A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability

Continuously synchronize directories from remote object store to local filesystem

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

A series of DAGs/Workflows to help maintain the operation of Airflow

Helper code to interact with Rasgo via our SDK, PyRasgo

Metric collection, data testing and monitoring for SQL accessible data

Elyra extends JupyterLab Notebooks with an AI centric approach.

A facebook for data

Airflow Unit Tests and Integration Tests

Apache Airflow - OpenApi Client for Python