217 Open source projects that are alternatives of or similar to link-move

🔮 Transform, query, and download geospatial data on the web.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Linq to database provider.

A luigi powered analytics / warehouse stack

A serverless cluster computing system for the Go programming language

SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!

A Singer.io Target for Postgres

Server application to serve U.S. federal spending data via a RESTful API

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

ETLy is an add-on dashboard service on top of Apache Airflow.

数据可视化, 数据挖掘, 数据处理 ETL

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

Logical Replication extension for PostgreSQL 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.

The premier open source Data Quality solution

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Power of appbase.io via CLI, with nifty imports from your favorite data sources

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.

The backoffice web application of d:swarm (https://github.com/dswarm/dswarm-documentation/wiki)

A client for connecting and running DDLs on hive metastore.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Utility that converts an .etl file containing a Windows network packet capture into .pcapng format.

React components to build CSV files on the fly basing on Array/literal object of data

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

A lightweight stream processing library for Go

Python based Wikidata framework for easy dataframe extraction

A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.

AIStore: scalable storage for AI applications

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

Data processing & ETL framework for Ruby

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

基于web版kettle开发的一套分布式综合调度,管理,ETL开发的用户专业版B/S架构工具

Blog post on ETL pipelines with Airflow

A collection of tools for extracting FHIR resources and analytics services on top of that data.

A cross-platform command line tool for parallelised content extraction and analysis.

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

An orchestration platform for the development, production, and observation of data assets.

A Python stream processing engine modeled after Yahoo! Pipes

Categorical Query Language IDE

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

An extensible Java framework for building XML and non-XML streaming applications

🗺 GIS plugins for Pentaho Data Integration

Fancy stream processing made operationally mundane

The MarkLogic Data Hub: documentation ==>

ETL Library for Machine Learning - data pipelines, data munging and wrangling

A MongoDB to Elasticsearch connector

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

A python package to create a database on the platform using our moj data warehousing framework

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

A Go native tabular data extraction package. Currently supports .xls, .xlsx, .csv, .tsv formats.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview

The CSV to database command line loader

Tool and library to convert ETW logs to JSON files