98 Open source projects that are alternatives of or similar to Dag Factory

Apache Airflow - OpenApi Client for Python

Apache Airflow Website

Export Airflow metrics (from mysql) in prometheus format

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

Apache Airflow integration for dbt

A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI tool of your choice and even run your code on it.

A plugin for Apache Airflow that allows you to manage the users that can login

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

Observatory Platform Package

Apache Airflow CI pipeline

A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability

triggering a DAG run multiple times

A complete development environment setup for working with Airflow

Minikube for big data with Scala and Spark

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Real Time Twitter Sentiment Analysis Product

Kubernetes custom controller and CRDs to managing Airflow

Kedro-Airflow makes it easy to deploy Kedro projects to Airflow.

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.

Bitnami Docker Image for Apache Airflow Scheduler

A web frontend for scheduling Jupyter notebook reports

Build DataOps platform with Apache Airflow and dbt on AWS

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.

Metric collection, data testing and monitoring for SQL accessible data

Cloudformation templates for deploying Airflow in ECS

Configuration and definitions of Airflow for OpenTrials

No description or website provided.

Plugins do Airflow para implementação de pipelines de dados

Identifies and collects data on cc-licensed content across web crawl data and public apis.

Execution of DBT models using Apache Airflow through Docker Compose

A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces

Testbed of AI Systems Quality Management

Use Airflow to move data from multiple MySQL databases to BigQuery

Parcel for Apache Airflow

Example of an ETL Pipeline using Airflow

Functional Airflow DAG definitions.

Air Data Computer

Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'

Airflow basics tutorial

A way for home buyers to know about factors affecting a state

Personal Data Engineering Projects

Flask-AppBuilder SecurityManager for OpenIDConnect

Astronomer Core Docker Images

Blog post on ETL pipelines with Airflow

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

PipelineAI Kubeflow Distribution

A Data Engineering & Machine Learning Knowledge Hub

Example DAGs using hooks and operators from Airflow Plugins

Get your MLOps (Level 1) platform started and going fast.

Curated list of resources about Apache Airflow

A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract data from S3, apply a series of transformations and load into S3 and Redshift.

DBT Cloud Plugin for Airflow

Turbine: the bare metals that gets you Airflow

Docker Apache Airflow

Yet another helpdesk based on multiple providers

A plugin for Apache Airflow that allows you to edit DAGs in browser

Visualize Airflow's schedule by exporting future DAG runs as events to Google Calendar.