32 Open source projects that are alternatives of or similar to AzureDataFactoryHOL

This code allows you to load any existing Azure Data Factory project file (*.dfproj) and perform further actions like "Export to ARM Template" or to debug custom C# activities

Kotlin Multiplatform project (MPP), JVM and JS

A slightly more-than-trivial full-stack application built with DDD & CQRS concepts

A Kafka Connect source connector that generates data for tests

Real-Time Event Streaming & Change Data Capture

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Education & lessons learned from the field. Mainly focusing on AKS and Containers.

Workshop that teaches how to apply Dapr to an existing .NET, Java or Python based microservices application.

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

SignTool Library and Azure Key Vault Support

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

How to authenticate to Google Big Query when connecting from Azure Data Factory v2

Microsoft Cloud Workshop Asia for Intelligent Cloud / Intelligent Edge

seatunnel plugin developing examples.

Placeholder for multiple Postman collections for different workshops

This sample shows how to deploy an AKS cluster with Application Gateway, Application Gateway Ingress Controller, Azure Container Registry, Log Analytics and Key Vault.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

Blog post on ETL pipelines with Airflow

Handle secrets in Docker using AWS KMS, SSM parameter store, Secrets Manager, or Azure Key Vault

Bring your own data Labs: Build a serverless data pipeline based on your own data

www.vixtract.ru

MCW Big data analytics and visualization

Code samples for a SQL Saturday presentation on the topic of Automating Azure Analysis Services

This extension adds Azure Data Factory release tasks to Azure Pipelines.

Hands on labs and content for students and educators to learn and teach the Internet of Things at schools, universities, coding clubs, community colleges and bootcamps

Production Ready Data Integration Product, documentation：

SEO dashboard from Search console Data using the Google Search API, Mysql database , NodeJS RESTAPI( ExpressJS) and reactJs Dashboard

implementing an end-to-end tweets ETL/Analysis pipeline.

A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract data from S3, apply a series of transformations and load into S3 and Redshift.