hamiltonA scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.
Stars: ✭ 612 (+3725%)
Mutual labels: etl, etl-framework
DaFlowApache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (+50%)
Mutual labels: etl, etl-framework
BenderBender - Serverless ETL Framework
Stars: ✭ 171 (+968.75%)
Mutual labels: etl, etl-framework
etlflowEtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.
Stars: ✭ 38 (+137.5%)
Mutual labels: etl, etl-framework
morph-kgcPowerful RDF Knowledge Graph Generation with [R2]RML Mappings
Stars: ✭ 77 (+381.25%)
Mutual labels: etl, data-integration
AirbyteAirbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Stars: ✭ 4,919 (+30643.75%)
Mutual labels: etl, data-integration
vixtractwww.vixtract.ru
Stars: ✭ 40 (+150%)
Mutual labels: etl, etl-framework
ButterfreeA tool for building feature stores.
Stars: ✭ 126 (+687.5%)
Mutual labels: etl, etl-framework
BETL-oldBETL. Meta data driven ETL generation using T-SQL
Stars: ✭ 17 (+6.25%)
Mutual labels: etl, etl-framework
link-moveA model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.
Stars: ✭ 32 (+100%)
Mutual labels: etl, etl-framework
Metlmito ETL tool
Stars: ✭ 153 (+856.25%)
Mutual labels: etl, etl-framework
csvpluscsvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
Stars: ✭ 67 (+318.75%)
Mutual labels: etl, etl-framework
HydrographA visual ETL development and debugging tool for big data
Stars: ✭ 144 (+800%)
Mutual labels: etl, etl-framework
cubetlCubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)
Stars: ✭ 21 (+31.25%)
Mutual labels: etl, etl-framework
Mara PipelinesA lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Stars: ✭ 1,841 (+11406.25%)
Mutual labels: etl, data-integration
EtlboxA lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.
Stars: ✭ 203 (+1168.75%)
Mutual labels: etl, etl-framework
Openkettlewebui一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中
Stars: ✭ 125 (+681.25%)
Mutual labels: etl, etl-framework
TransformalizeConfigurable Extract, Transform, and Load
Stars: ✭ 125 (+681.25%)
Mutual labels: etl, etl-framework
DIRECTDIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.
Stars: ✭ 20 (+25%)
Mutual labels: etl, etl-framework
datalake-etl-pipelineSimplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (+143.75%)
Mutual labels: etl, etl-framework
