441 Open source projects that are alternatives of or similar to starlake

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Open Source Feature Flagging and A/B Testing Platform

locopy: Loading/Unloading to Redshift and Snowflake using Python.

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift and Postgres with Spatial Analytics capabilities

tbls is a CI-Friendly tool for document a database, written in Go.

Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake

Free and open source schema versioning and database migration made natively with .NET Core.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Web-based SQL editor run in your own private cloud. Supports MySQL, Postgres, SQL Server, Vertica, Crate, ClickHouse, Trino, Presto, SAP HANA, Cassandra, Snowflake, BigQuery, SQLite, and more with ODBC

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

Fluent migrations framework for .NET

Udacity Data Engineering Nano Degree (DEND)

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

BigQuery Schema Conversion Tool

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

☁️ nodejs kafka connect connector for Google BigQuery

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

A luigi powered analytics / warehouse stack

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

DDL parase and Convert to BigQuery JSON schema and DDL statements

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

🎣 List of `pre-commit` hooks to ensure the quality of your `dbt` projects.

An example mini data warehouse for python project stats, template for new projects

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

RBM implemented with spiking neurons in Python. Contrastive Divergence used to train the network.

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

BETL. Meta data driven ETL generation using T-SQL

Application to compare results of two SQL queries

PHP PDO driver for snowflake

Data migration framework for Django that migrates legacy data into your new django app

数据采集平台zdh,etl 处理服务

Helm chart for deploying a Matrix homeserver stack

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

ETL flow framework based on Yaml configs in Python

DevOps pipeline for Real Time Social/Web Mining

A Python framework for data processing on GCP.

Hive Storage Handler for interoperability between BigQuery and Apache Hive

大数据学习笔记，学习路线，技术案例整理。

ETL for the IEX Stocks API

Rin is a Redshift data Importer by SQS messaging.

A curated list of awesome system integration software and resources.

JDBC driver for Neo4j

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

This Laravel package to generate 64 bit identifier like the snowflake within Twitter.

This is an Excel Addin for Windows that reads and writes data to Snowflake

GIS Visualisation for Amazon Athena and BigQuery

Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub

ScalikeJDBC extension for Google BigQuery

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

Export your events from Amplitude to Google BigQuery/Google Cloud Storage

Powerful product analytics for data teams, with full control over data & models.

Snowfall component for Vue.js, let it snow on your page! ❄ demo: https://fuxy526.github.io/snowf/

❄ An Lock Free ID Generator for Golang based on Snowflake Algorithm (Twitter announced).