219 Open source projects that are alternatives of or similar to OpenKettleWebUI

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

BETL. Meta data driven ETL generation using T-SQL

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

www.vixtract.ru

python ETL framework

A visual ETL development and debugging tool for big data

A simplified, lightweight ETL Framework based on Apache Spark

This repository is a getting started guide to Singer.

Ruby scripting for pentaho-kettle

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

mito ETL tool

A SQL-like language for performing ETL transformations.

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

Configurable data bridge for permanent ETL jobs

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Real-Time Event Streaming & Change Data Capture

Configurable Extract, Transform, and Load

A tool for building feature stores.

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

Bender - Serverless ETL Framework

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

MySQL / MariaDB import for DTD feeds (fares, timetable and routeing)

Data migration framework for Django that migrates legacy data into your new django app

Python based Wikidata framework for easy dataframe extraction

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

📜 A CLI toolkit for extracting and working with your digital history

Java调用Kettle API执行转换和作业，Java代码生成Kettle转换。

🗺 GIS plugins for Pentaho Data Integration

An Elasticsearch client tailored to data science workflows.

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

A dbt adapter for Databricks.

A minimalist (geospatial) ETL

Live import all your Google Sheets to your data warehouse

A client for connecting and running DDLs on hive metastore.

NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile y…

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

seatunnel plugin developing examples.

Blog post on ETL pipelines with Airflow

A collection of tools for extracting FHIR resources and analytics services on top of that data.

ETL jobs for Firefox Telemetry

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

Yet Another ETL in PHP

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

Thain is a distributed flow schedule platform.

📘 Making Data, the DataMade Way

数据采集平台zdh,etl 处理服务

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Example DAGs using hooks and operators from Airflow Plugins

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.