215 Open source projects that are alternatives of or similar to Etlbox

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Bender - Serverless ETL Framework

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

A visual ETL development and debugging tool for big data

www.vixtract.ru

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

Configurable Extract, Transform, and Load

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

mito ETL tool

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Configurable data bridge for permanent ETL jobs

A simplified, lightweight ETL Framework based on Apache Spark

This repository is a getting started guide to Singer.

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

A SQL-like language for performing ETL transformations.

A tool for building feature stores.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

BETL. Meta data driven ETL generation using T-SQL

Real-Time Event Streaming & Change Data Capture

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

python ETL framework

The MarkLogic Data Hub: documentation ==>

Production Ready Data Integration Product, documentation：

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

The CSV to database command line loader

Česká otevřená data

Use Pentaho's open source data integration tool (Kettle) to create Extract-Transform-Load (ETL) processes to update a Socrata open data portal. Documentation is available at http://open-data-etl-utility-kit.readthedocs.io/en/stable

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview

Logstash - transport and process your logs, events, or other data

Big Data Toolkit for the JVM

Udacity Data Engineering Nano Degree (DEND)

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

LinkedPipes ETL is an RDF based, lightweight ETL tool

Download DIG to run on your laptop or server.

Linq to database provider.

基于spring boot通过java代码调用kette

Knowledge Graph Toolkit

A simple Spark-powered ETL framework that just works 🍺

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

A visual process builder for Laravel

A cross-platform command line tool for parallelised content extraction and analysis.

Enterprise-grade, production-hardened, serverless data lake on AWS

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Mass processing data with a complete ETL for .net developers

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

A luigi powered analytics / warehouse stack

Server application to serve U.S. federal spending data via a RESTful API

Sync data between persistence engines, like ETL only not stodgy

Global Biotic Interactions provides access to existing species interaction datasets

A Singer.io Target for Postgres