233 Open source projects that are alternatives of or similar to wrangle

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile y…

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

RTSP video streaming server implementation based on Live555 and FFmpeg

A lib to transform data from jdbc,csv,json to ecah other.

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

A declarative transformation language for GraphQL 🍸

Thain is a distributed flow schedule platform.

CVparser is software for parsing or extracting data out of CV/resumes.

📘 Making Data, the DataMade Way

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

Example DAGs using hooks and operators from Airflow Plugins

☁️ nodejs kafka connect connector for Google BigQuery

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

R client for the Elasticsearch HTTP API

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

Live import all your Google Sheets to your data warehouse

A cross-platform command line tool for parallelised content extraction and analysis.

AI Super - Resolution

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview

DSP and filtering library

Linked Data & RDF Manufacturing Tools in Clojure

Python package for tackling multi-class imbalance problems. http://www.cs.put.poznan.pl/mlango/publications/multiimbalance/

Bender - Serverless ETL Framework

distributed data sync with operational transformation/transforms

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

An example mini data warehouse for python project stats, template for new projects

Cygrid is a cython-powered convolution-based gridding module for astronomy

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

ETL for the IEX Stocks API

Big Data Toolkit for the JVM

数据质量控制系统

基于spring boot通过java代码调用kette

JDBC driver for Neo4j

Mass processing data with a complete ETL for .net developers

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Configurable Extract, Transform, and Load

StarGAN2 for practice

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Application transformation tool

Data processing & ETL framework for Ruby

Magic potions to clean and transform your data 🧙

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

Python based Wikidata framework for easy dataframe extraction

The CSV to database command line loader

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

Resampling Tools for Time Series Forecasting with Modeltime

A CLI and library to run Singer Taps and Targets

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

A dbt adapter for Databricks.