3789 Open source projects that are alternatives of or similar to Luigi Warehouse

Udacity Data Engineering Nano Degree (DEND)

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

📊 Cube — Open-Source Analytics API for Building Data Apps

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Configurable Extract, Transform, and Load

深圳地铁大数据客流分析系统🚇🚄🌟

Free and open source schema versioning and database migration made natively with .NET Core.

tbls is a CI-Friendly tool for document a database, written in Go.

Object Relational Mapping

550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...

Linq to database provider.

后端开发常用框架文档及中文翻译，包含 Spring 系列文档（Spring, Spring Boot, Spring Cloud, Spring Security, Spring Session），大数据（Apache Hive, HBase, Apache Flume），日志（Log4j2, Logback），Http Server（NGINX，Apache），Python，数据库（OpenTSDB，MySQL，PostgreSQL）等最新官方文档以及对应的中文翻译。

Kiba enhancement for Ruby ETL.

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

DDL parase and Convert to BigQuery JSON schema and DDL statements

The CSV to database command line loader

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Big Data Ecosystem Docker

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Data validation and organization of metadata for data frames and database tables

python ETL framework

Idempotent MySQL/PostgreSQL schema management by SQL

Universal command-line interface for SQL databases

Entity Relation Diagrams generation tool

Simple and Powerful ORM for Go, support mysql,postgres,tidb,sqlite3,mssql,oracle, Moved to https://gitea.com/xorm/xorm

A simple Node.js ORM for PostgreSQL, MySQL and SQLite3 built on top of Knex.js

SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

A PHP SQL query builder using PDO

Rich SQL client for Postgresql, MySQL, MS SQL, Amazon Redshift, Google Firebase (Firestore)

Generate typescript interface definitions from SQL database schema

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

MyBB is a free and open source forum software.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

A safe, extensible ORM and Query Builder for Rust

Crie um aplicativo com todas as tabelas de um dos seus bancos sem uma linha de código.

Netkiller Free ebook - 免费电子书

Ridgepole is a tool to manage DB schema. It defines DB schema using Rails DSL, and updates DB schema according to DSL. (like Chef/Puppet)

Add table-level database locking to ActiveRecord

Detect threats with log data and improve cloud security posture

eXperDB-DB2PG is a data migration solution that transfers data extracted from various DBMSs to eXperDB or PostgreSQL. Currently, Oracle and Oracle Spatial, MySQL, SQL Server(MS-SQL) and Sybase data can be transferred.

TreeFrog Framework : High-speed C++ MVC Framework for Web Application

AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.

Wait4X is a cli tool to wait for everything! It can be wait for a port to open or enter to rquested state.

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Official repository of the SOCI - The C++ Database Access Library

ASP.NET Core CMS

Serverless AWS Lambda with Node.js,Postgres Rest API with Sequelize.

EOSIO sql database plugin

与 Lealone 集成的各类插件(例如网络框架以及不同的数据库协议和存储引擎)

📝 Migrated to(迁移至) https://github.com/Kuangcp/Note 当前仓库已经废弃, 对应的博客网站:

Store history data in SQL Database: MySQL, PostgreSQL or SQLite

SQL builder and query library for golang

React/Java 技术栈，代码和数据云端生成，本地部署低代码平台，手写代码和生成代码目录分离，适合专业开发人员开发长期维护的软件。

Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake