215 Open source projects that are alternatives of or similar to Openkettlewebui

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

python ETL framework

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

Configurable Extract, Transform, and Load

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

www.vixtract.ru

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

This repository is a getting started guide to Singer.

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

A SQL-like language for performing ETL transformations.

BETL. Meta data driven ETL generation using T-SQL

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

A visual ETL development and debugging tool for big data

A tool for building feature stores.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Real-Time Event Streaming & Change Data Capture

mito ETL tool

Bender - Serverless ETL Framework

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

Configurable data bridge for permanent ETL jobs

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

A simplified, lightweight ETL Framework based on Apache Spark

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

Download DIG to run on your laptop or server.

A python library to push ethereum blockchain data into an sql database.

A realtime ETL engine

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

Knowledge Graph Toolkit

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

A simple Spark-powered ETL framework that just works 🍺

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Extract your data from the Yunmai weighing scales cloud API so you can use it elsewhere

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.

Detect threats with log data and improve cloud security posture

A visual process builder for Laravel

The backoffice web application of d:swarm (https://github.com/dswarm/dswarm-documentation/wiki)

🐟 A streaming ETL for fish

The CSV to database command line loader

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

A Python stream processing engine modeled after Yahoo! Pipes

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Česká otevřená data

A luigi powered analytics / warehouse stack

a go daemon that syncs MongoDB to Elasticsearch in realtime

React components to build CSV files on the fly basing on Array/literal object of data

Sync data between persistence engines, like ETL only not stodgy

Example project implementing best practices for PySpark ETL jobs and applications.

A lightweight stream processing library for Go