2021 Open source projects that are alternatives of or similar to astro

A vendor-neutral storage library for Golang: Write once, run on every storage service.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

Verneuil is a VFS extension for SQLite that asynchronously replicates databases to S3-compatible blob stores.

Read and write Python objects to S3, caching them on your hard drive to avoid unnecessary IO.

pytablewriter is a Python library to write a table in various formats: CSV / Elasticsearch / HTML / JavaScript / JSON / LaTeX / LDJSON / LTSV / Markdown / MediaWiki / NumPy / Excel / Pandas / Python / reStructuredText / SQLite / TOML / TSV.

Python ETL(Extract-Transform-Load) tool / Data migration tool

Streaming replication for SQLite.

Rivery CLI

Sensible database change management

Configurable Extract, Transform, and Load

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Database CRUD Application Built on Electron | MySQL, Postgres, SQLite

Personal Data Engineering Projects

Continuously synchronize directories from remote object store to local filesystem

Entity-Relationship diagram code generator library

Enterprise Grade Single-Step Streaming Data Infrastructure Setup. (Under Development)

Example DAGs using hooks and operators from Airflow Plugins

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

A complete docker package for deploying django which is easy to understand and deploy anywhere.

Rust DataBase Connectivity (RDBC) :: Common Rust API for database drivers

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Continuous Archiving for Postgres

Simple and Powerful ORM for Go, support mysql,postgres,tidb,sqlite3,mssql,oracle, Moved to https://gitea.com/xorm/xorm

Database migrations. CLI and Golang library.

node.js database migration tool

A minimalist (geospatial) ETL

A database migration tool. Supports SQL migrations and Go functions.

An SQL wrapper for vim

🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)

UGin is an API boilerplate written in Go (Golang) with Gin Framework.

Database migrations. CLI and Golang library.

Listen to your to PostgreSQL database in realtime via websockets. Built with Elixir.

A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift and Postgres with Spatial Analytics capabilities

A Common DSL for Migrating Databases

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

This repository contains a docker image configured to use the SSH File Transfer Protocol (SFTP) to transfer all its files to Cloud Blob Storage Services. This image can be deployed on a Kubernetes cluster with Helm.

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

An example mini data warehouse for python project stats, template for new projects

Ebean ORM

Python based Wikidata framework for easy dataframe extraction

Connection-Pooling Compile-Time ORM for Nim

Go io/fs.FS filesystem implementations for various URL schemes

A library for secure, deduplicated, transactional, and verifiable data storage

jobflow is a library for writing computational workflows.

Library packs for google cloud functions

Ionic Plugin for Uploading Images to Amazon S3

No description or website provided.

Export Airflow metrics (from mysql) in prometheus format

Web application providing an intuitive user experience to databases.

skimpy is a light weight tool that provides summary statistics about variables in data frames within the console.

The Main application that provides the core interface via the glific APIs

A complete template for 2022 focused on around React, Postgres and various web3 integrations. You can use the template to make a website, a web application, a hybrid decentralized web application, or even a DAO.

This app utilizes a SQLite databse, MVVM, along with these Xamarin.Forms controls: Search Bar, Picker, Grid, StackLayout, Navigation Page, ListView, ViewCell. It also shows how to tweak the UI to best appear on larger tablet screens.

Parse JSON columns with Bookshelf.js

🔥 TypeORM - Express - Angular 8 - NestJS Server Side Rendering (SSR) 😺