328 Open source projects that are alternatives of or similar to DataBridge.NET

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Configurable Extract, Transform, and Load

python ETL framework

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

www.vixtract.ru

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Real-Time Event Streaming & Change Data Capture

mito ETL tool

consume maxwell generated message from kafka,export it to another mysql.

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

A visual ETL development and debugging tool for big data

A SQL-like language for performing ETL transformations.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

This repository is a getting started guide to Singer.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Bender - Serverless ETL Framework

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

A simplified, lightweight ETL Framework based on Apache Spark

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。

A tool for building feature stores.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

BETL. Meta data driven ETL generation using T-SQL

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

TIP OOPT - Transponder Abstraction Interface

Flock: A Low-Cost Streaming Query Engine on FaaS Platforms

matsim swiss rail

WASP framework for Python

Synchronization Algorithm Exploration: Techniques to synchronize a SQL database with external destinations.

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

🔄 Simple tool for ETL. From SQL to Redis.

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

☁️ nodejs kafka connect connector for Google BigQuery

Reverse engineering dell'API dell'app di Trenitalia

Building data processing pipelines for documents processing with NLP using Apache NiFi and related services

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

数据质量控制系统

📖 Generation and Applications of Knowledge Graphs in Systems and Networks Biology

Tools for working with GTFS public transit data in ArcGIS

ETL for the NASDAQ symbol file

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

A .NET class library that allows you to import data from different sources into a unified destination

Calculate your carbon footprint 🏭👣 from food, transport, purchases, fashion, electricity and digital activities like streaming, NFT or blockchain.

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

大数据采集,抽取平台

code, labs and lectures for the course

Cross-vendor normalisation for network syslog messages, following the OpenConfig and IETF YANG models

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

Data migration framework for Django that migrates legacy data into your new django app

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.