233 Open source projects that are alternatives of or similar to wrangle

Data migration framework for Django that migrates legacy data into your new django app

数据采集平台zdh,etl 处理服务

Official pytorch implementation of the paper: "A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection"

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

An Elasticsearch client tailored to data science workflows.

Yet Another ETL in PHP

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A curated list of awesome system integration software and resources.

Spatiotemporal resampling methods for mlr3

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

ETL jobs for Firefox Telemetry

大数据采集,抽取平台

🔄 Simple tool for ETL. From SQL to Redis.

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

Flock: A Low-Cost Streaming Query Engine on FaaS Platforms

BETL. Meta data driven ETL generation using T-SQL

code, labs and lectures for the course

ETL flow framework based on Yaml configs in Python

Synchronization Algorithm Exploration: Techniques to synchronize a SQL database with external destinations.

Mathematical Morphology in Any Number of Dimensions

ETL for the NASDAQ symbol file

MySQL / MariaDB import for DTD feeds (fares, timetable and routeing)

Refinery is a tool to extract and transform semi-structured data from Excel spreadsheets of different layouts in a declarative way.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

A lib to transform data from jdbc,csv,json to ecah other.

A declarative transformation language for GraphQL 🍸

CVparser is software for parsing or extracting data out of CV/resumes.

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

☁️ nodejs kafka connect connector for Google BigQuery

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

Live import all your Google Sheets to your data warehouse

AI Super - Resolution

DSP and filtering library

Python package for tackling multi-class imbalance problems. http://www.cs.put.poznan.pl/mlango/publications/multiimbalance/

distributed data sync with operational transformation/transforms

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

Cygrid is a cython-powered convolution-based gridding module for astronomy

ETL for the IEX Stocks API

数据质量控制系统

JDBC driver for Neo4j

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

StarGAN2 for practice

Application transformation tool

Magic potions to clean and transform your data 🧙

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Python based Wikidata framework for easy dataframe extraction

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

A flexible framework for analyzing and transforming FPGA netlists. Official repository.

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

Resampling Tools for Time Series Forecasting with Modeltime

A CLI and library to run Singer Taps and Targets

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub