qweryA SQL-like language for performing ETL transformations.
Stars: ✭ 28 (+33.33%)
ChoetlETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Stars: ✭ 372 (+1671.43%)
Pyetlpython ETL framework
Stars: ✭ 33 (+57.14%)
DaFlowApache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (+14.29%)
TransformalizeConfigurable Extract, Transform, and Load
Stars: ✭ 125 (+495.24%)
OpenKettleWebUI一款基于kettle的数据处理web调度控制平台,支持文档资源库和数据库资源库,通过web平台控制kettle数据转换,可作为中间件集成到现有系统中
Stars: ✭ 138 (+557.14%)
Ethereum EtlPython scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 956 (+4452.38%)
MetorikkuA simplified, lightweight ETL Framework based on Apache Spark
Stars: ✭ 361 (+1619.05%)
EtlalchemyExtract, Transform, Load: Any SQL Database in 4 lines of Code.
Stars: ✭ 460 (+2090.48%)
Openkettlewebui一款基于kettle的数据处理web调度控制平台,支持文档资源库和数据库资源库,通过web平台控制kettle数据转换,可作为中间件集成到现有系统中
Stars: ✭ 125 (+495.24%)
etlflowEtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.
Stars: ✭ 38 (+80.95%)
StetlStetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.
Stars: ✭ 64 (+204.76%)
Getting StartedThis repository is a getting started guide to Singer.
Stars: ✭ 734 (+3395.24%)
BenderBender - Serverless ETL Framework
Stars: ✭ 171 (+714.29%)
EtlboxA lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.
Stars: ✭ 203 (+866.67%)
dogETLA lib to transform data from jdbc,csv,json to ecah other.
Stars: ✭ 15 (-28.57%)
Etl.netMass processing data with a complete ETL for .net developers
Stars: ✭ 129 (+514.29%)
Hale(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)
Stars: ✭ 84 (+300%)
Omniparseromniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
Stars: ✭ 148 (+604.76%)
dswarman open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)
Stars: ✭ 57 (+171.43%)
Metlmito ETL tool
Stars: ✭ 153 (+628.57%)
dbddbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
Stars: ✭ 30 (+42.86%)
csvpluscsvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
Stars: ✭ 67 (+219.05%)
HydrographA visual ETL development and debugging tool for big data
Stars: ✭ 144 (+585.71%)
Ether sqlA python library to push ethereum blockchain data into an sql database.
Stars: ✭ 41 (+95.24%)
Etl with pythonETL with Python - Taught at DWH course 2017 (TAU)
Stars: ✭ 68 (+223.81%)
DataBridge.NETConfigurable data bridge for permanent ETL jobs
Stars: ✭ 16 (-23.81%)
vixtractwww.vixtract.ru
Stars: ✭ 40 (+90.48%)
DIRECTDIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.
Stars: ✭ 20 (-4.76%)
link-moveA model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.
Stars: ✭ 32 (+52.38%)
flockFlock: A Low-Cost Streaming Query Engine on FaaS Platforms
Stars: ✭ 232 (+1004.76%)
hamiltonA scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.
Stars: ✭ 612 (+2814.29%)
ButterfreeA tool for building feature stores.
Stars: ✭ 126 (+500%)
Csv2dbThe CSV to database command line loader
Stars: ✭ 102 (+385.71%)
BETL-oldBETL. Meta data driven ETL generation using T-SQL
Stars: ✭ 17 (-19.05%)
datalake-etl-pipelineSimplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (+85.71%)
olap睿思BI-OLAP开源多维分析系统
Stars: ✭ 101 (+380.95%)
elastic-query-export🚚 Export Data from ElasticSearch to CSV/JSON using a Lucene Query (e.g. from Kibana) or a raw JSON Query string
Stars: ✭ 56 (+166.67%)
DataProfilerWhat's in your data? Extract schema, statistics and entities from datasets
Stars: ✭ 843 (+3914.29%)
csv2xlsxFast and simple opensource command line tool to convert CSV do XLSX
Stars: ✭ 38 (+80.95%)
tv📺(tv) Tidy Viewer is a cross-platform CLI csv pretty printer that uses column styling to maximize viewer enjoyment.
Stars: ✭ 1,763 (+8295.24%)
artemis cliA command-line application for tutors to more productively grade programming excises on ArTEMiS
Stars: ✭ 12 (-42.86%)
sql-to-redis🔄 Simple tool for ETL. From SQL to Redis.
Stars: ✭ 18 (-14.29%)
mikThe Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).
Stars: ✭ 32 (+52.38%)
municipios-brDados em formato aberto sobre municípios e unidades federativas do Brasil.
Stars: ✭ 58 (+176.19%)
quickstepQuickstep project
Stars: ✭ 22 (+4.76%)
mdtable2csvconvert tables in .md to .csv
Stars: ✭ 91 (+333.33%)
eecA fast and lower memory excel write/read tool.一个非POI底层,支持流式处理的高效且超低内存的Excel读写工具
Stars: ✭ 93 (+342.86%)
ottosocial👍 ottosocial is a CLI to schedule tweets via CSV
Stars: ✭ 23 (+9.52%)
datasetsThe primary repository for all of the CORGIS Datasets
Stars: ✭ 19 (-9.52%)
csvlixirA CSV reading/writing application for Elixir.
Stars: ✭ 32 (+52.38%)
import-cli-simpleThis the meta package for Pacemaker Community, a Symfony based CLI application that provides import functionality for products, categories, attributes, and attribute-sets. The default format is CSV, adapters for XML are also available. The application can be declaratively extended by additional operations, which can be used to reassemble and exe…
Stars: ✭ 69 (+228.57%)
TextrudeCode generation from YAML/JSON/CSV models via SCRIBAN templates
Stars: ✭ 79 (+276.19%)
DQCS数据质量控制系统
Stars: ✭ 34 (+61.9%)
conveyCSV processing and web related data types mutual conversion
Stars: ✭ 16 (-23.81%)