123 Open source projects that are alternatives of or similar to awesome-dbt

dbt-sugar is a CLI tool that allows users of dbt to have fun and ease performing actions around dbt models

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

A Data Engineering & Machine Learning Knowledge Hub

Clean APIs for data cleaning. Python implementation of R package Janitor

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

📝 A compilation of everything that I learn; Computer Science, Software Development, Engineering, Math, and Coding in General. Read the rendered results here ->

Projects done in the Data Engineering Nanodegree by Udacity.com

A python package to create a database on the platform using our moj data warehousing framework

Ansible playbook to deploy distributed technologies

Open Source Feature Flagging and A/B Testing Platform

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

A tool for building feature stores.

Data validation and organization of metadata for data frames and database tables

Free and open source schema versioning and database migration made natively with .NET Core.

Turn complex requirements to workflows without leaving the comfort of your technology stack.

📊 📋 Dashboards using YAML or JSON files

Open Metadata and Governance

A package to easily open an instance of a Google spreadsheet and interact with worksheets through Pandas DataFrames.

Feature Store for Machine Learning

A simple Spark-powered ETL framework that just works 🍺

Example of an ETL Pipeline using Airflow

A list of useful resources to learn Data Engineering from scratch

Python library for building Pangeo Forge recipes.

Quilt is a self-organizing data hub for S3

Summary of my projects on kaggle

Git-like capabilities for your object storage

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

The easiest way to automate your data

An automatic ML model optimization tool.

Example project implementing best practices for PySpark ETL jobs and applications.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Accumulated knowledge and experience in the field of Data Engineering

A convention over configuration workflow orchestrator. Develop locally (Jupyter or your favorite editor), deploy to Airflow or Kubernetes.

Always know what to expect from your data.

Accelerate data science

An Awesome List of Open-Source Data Engineering Projects

A Clojure dataframe library that runs on Spark

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Apache Superset is a Data Visualization and Data Exploration Platform

Fancy stream processing made operationally mundane

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Example end to end data engineering project.

The Data Engineering Cookbook

Study materials for the Google Cloud Professional Data Engineering Exam

Automate building ML classification pipelines in .NET

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Beneath is a serverless real-time data platform ⚡️

Enterprise-grade, production-hardened, serverless data lake on AWS

ELT Code for your Data Warehouse

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep learning, Computer Science, programming, software engineering, etc.

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

dbt adapter for SQL Server and Azure SQL

Deep Neural Network architecture as a predictive optimal controller for {HVAC+Solar cell + battery} disturbance afflicted system vs classic Model Predictive Control

Go to: https://github.com/alexklibisz/elastiknn

Metric collection, data testing and monitoring for SQL accessible data

Airflow Deployment on AWS ECS Fargate Using Cloudformation