122 Open source projects that are alternatives of or similar to dbt-sugar

A curated list of awesome dbt resources

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

Metric collection, data testing and monitoring for SQL accessible data

Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase

Airflow Deployment on AWS ECS Fargate Using Cloudformation

Go to: https://github.com/alexklibisz/elastiknn

A collection of online resources to help you on your Tech journey.

Projects done in the Data Engineering Nanodegree by Udacity.com

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

CSVs sliced, diced & analyzed.

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

Fivetran's ad reporting dbt package. Combine your Facebook, Google, Pinterest, Linkedin, Twitter, Snapchat and Microsoft advertising spend using this package.

Dummy variable generation with fit/transform capabilities

A package to easily open an instance of a Google spreadsheet and interact with worksheets through Pandas DataFrames.

Datart is a next generation Data Visualization Open Platform

Free and open source schema versioning and database migration made natively with .NET Core.

A curated list of big data engineering tools, resources and communities.

A list of useful resources to learn Data Engineering from scratch

Execution of DBT models using Apache Airflow through Docker Compose

A tool for building feature stores.

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

📊 📋 Dashboards using YAML or JSON files

Python client for using Prefect Cloud with Saturn Cloud

A simple Spark-powered ETL framework that just works 🍺

A dbt adapter for Databricks.

Ansible playbook to deploy distributed technologies

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

A daily digest of the articles or videos I've found interesting, that I want to share with you.

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

A convention over configuration workflow orchestrator. Develop locally (Jupyter or your favorite editor), deploy to Airflow or Kubernetes.

Easy way to define, execute and store quality rules for your data.

Enterprise-grade, production-hardened, serverless data lake on AWS

Generate lookml for views from dbt models

An automatic ML model optimization tool.

DEPRECATED: Stream data processing micro-framework

A Clojure dataframe library that runs on Spark

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

Study materials for the Google Cloud Professional Data Engineering Exam

The metrics layer for your data. Join us at https://metriql.com/slack

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

funsies is a lightweight workflow engine 🔧

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

Less-Resilient MapReduce framework for Go

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Package for dbt that allows users to train, audit and use BigQuery ML models.

Accelerate data science

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Apache Superset is a Data Visualization and Data Exploration Platform

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Example end to end data engineering project.

Helper code to interact with Rasgo via our SDK, PyRasgo

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Useful SQL queries for Blockchain ETL datasets in BigQuery.

A client for connecting and running DDLs on hive metastore.

An Elasticsearch client tailored to data science workflows.

Python package for Customizable Data Preprocessing Pipelines

Real estate dagster pipeline

DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.

Blog post on ETL pipelines with Airflow