184 Open source projects that are alternatives of or similar to fab-oidc

Airflow Unit Tests and Integration Tests

A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract data from S3, apply a series of transformations and load into S3 and Redshift.

Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor

Cloudformation templates for deploying Airflow in ECS

Command line utility for interacting with OAuth2 infrastructure to generate tokens

Identifies and collects data on cc-licensed content across web crawl data and public apis.

Airflow workflow management platform chef cookbook.

Use Airflow to move data from multiple MySQL databases to BigQuery

Airflow plugin to export dag and task based metrics to Prometheus.

Air Data Computer

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥 >> [ 🚀, 🚢 ]

Personal Data Engineering Projects

Blog post on ETL pipelines with Airflow

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation, validation and loading of data from S3 -> Redshift -> S3

Get your MLOps (Level 1) platform started and going fast.

A Helm chart to install Apache Airflow on Kubernetes

DBT Cloud Plugin for Airflow

Continuously synchronize directories from remote object store to local filesystem

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

Configuration and definitions of Airflow for OpenTrials

A series of DAGs/Workflows to help maintain the operation of Airflow

Plugins do Airflow para implementação de pipelines de dados

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Execution of DBT models using Apache Airflow through Docker Compose

A facebook for data

Testbed of AI Systems Quality Management

A Kubernetes operator for Dex

Parcel for Apache Airflow

Functional Airflow DAG definitions.

Airflow configuration for Telemetry

Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

A way for home buyers to know about factors affecting a state

A web frontend for scheduling Jupyter notebook reports

ASP.NET Core, Microsoft.Owin/ASP.NET 4.x and JavaScript samples for OpenIddict

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Versatile OpenID Connect stack for ASP.NET Core and Microsoft.Owin (compatible with ASP.NET 4.6.1)

Fast iterative local development and testing of Apache Airflow workflows

An OAuth2 and OpenID Connect Debugger

Dynamically generate Apache Airflow DAGs from YAML configuration files

Projeto Login Cidadão

💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.

Ultimate Javascript Object Signing and Encryption (JOSE) and JSON Web Token (JWT) Implementation for .NET and .NET Core

Airflow basics tutorial

npm package for OpenID Connect, OAuth Code Flow with PKCE, Refresh tokens, Implicit Flow

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

Portier Broker reference implementation, written in Rust

A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces

A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability

Udacity Data Engineering Nano Degree (DEND)

Yet another helpdesk based on multiple providers

No description or website provided.

A Data Engineering & Machine Learning Knowledge Hub

Web application for Kubernetes CLI configuration with OIDC

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

PipelineAI Kubeflow Distribution

Metric collection, data testing and monitoring for SQL accessible data