169 Open source projects that are alternatives of or similar to apache-airflow-cloudera-parcel

Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)

ETLy is an add-on dashboard service on top of Apache Airflow.

Example DAGs using hooks and operators from Airflow Plugins

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

PipelineAI Kubeflow Distribution

Example end to end data engineering project.

Kickstarts your Twitch Extension using React

Workflow engine for Kubernetes

Metric collection, data testing and monitoring for SQL accessible data

Airflow Deployment on AWS ECS Fargate Using Cloudformation

Automating Your Data Pipeline with Apache Airflow

💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.

afctl helps to manage and deploy Apache Airflow projects faster and smoother.

A way for home buyers to know about factors affecting a state

Bitnami Docker Image for Apache Airflow

A React boilerplate based on Redux, React Router, styled components and Parcel

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'

A distributed workflow runner focusing on performance and simplicity.

Curated list of resources about Apache Airflow

Bare minimal Airflow on Kubernetes (Local, EKS, AKS)

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

Elyra extends JupyterLab Notebooks with an AI centric approach.

📖 [译] Airflow 中文文档

A Helm chart to install Apache Airflow on Kubernetes

Blog post on ETL pipelines with Airflow

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Apache Airflow Website

Airflow configuration for Telemetry

Parcel plugin for declaring externals. These externals will not be bundled. 📦

Fast iterative local development and testing of Apache Airflow workflows

Real Time Twitter Sentiment Analysis Product

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

📦 parcel demo/example for vue

Udacity Data Engineering Nano Degree (DEND)

Kedro-Airflow makes it easy to deploy Kedro projects to Airflow.

Airflow training for the crunch conf

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor

⚡ parcel-bundle + vuejs + vue-router demo

Airflow workflow management platform chef cookbook.

A web frontend for scheduling Jupyter notebook reports

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥 >> [ 🚀, 🚢 ]

Flask-AppBuilder SecurityManager for OpenIDConnect

Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation, validation and loading of data from S3 -> Redshift -> S3

A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability

Continuously synchronize directories from remote object store to local filesystem

A fast annotation processor to make your objects `Parcelable` without writing any of the boilerplate.

A series of DAGs/Workflows to help maintain the operation of Airflow

Airflow Unit Tests and Integration Tests

A facebook for data

An example of how PureScript outputs are just CommonJS modules that you can use in any way you want.

Airflow plugin to export dag and task based metrics to Prometheus.

A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI tool of your choice and even run your code on it.

Functional Airflow DAG definitions.

A truffle box for svelte

Android Parcelable support for the Kotlinx Serialization library.

🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)