217 Open source projects that are alternatives of or similar to google-sheets-etl

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Beneath is a serverless real-time data platform ⚡️

A MongoDB to Elasticsearch connector

Blog post on ETL pipelines with Airflow

Server application to serve U.S. federal spending data via a RESTful API

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

Python based Wikidata framework for easy dataframe extraction

mito ETL tool

Thain is a distributed flow schedule platform.

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Utility that converts an .etl file containing a Windows network packet capture into .pcapng format.

A dbt adapter for Databricks.

Categorical Query Language IDE

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

Enterprise-grade, production-hardened, serverless data lake on AWS

A client for connecting and running DDLs on hive metastore.

Linq to database provider.

ETL flow framework based on Yaml configs in Python

数据可视化, 数据挖掘, 数据处理 ETL

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

A visual ETL development and debugging tool for big data

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

A tool for building feature stores.

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

🗺 GIS plugins for Pentaho Data Integration

R client for the Elasticsearch HTTP API

JDBC driver for Neo4j

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

Download and warehouse historical trading data

A cross-platform command line tool for parallelised content extraction and analysis.

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview

A minimalist (geospatial) ETL

Linked Data & RDF Manufacturing Tools in Clojure

MySQL / MariaDB import for DTD feeds (fares, timetable and routeing)

Bender - Serverless ETL Framework

NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile y…

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

BETL. Meta data driven ETL generation using T-SQL

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

A collection of tools for extracting FHIR resources and analytics services on top of that data.

An example mini data warehouse for python project stats, template for new projects

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

www.vixtract.ru

Big Data Toolkit for the JVM

ETL for the IEX Stocks API

基于spring boot通过java代码调用kette

📘 Making Data, the DataMade Way

Mass processing data with a complete ETL for .net developers

📜 A CLI toolkit for extracting and working with your digital history

Configurable Extract, Transform, and Load

Example DAGs using hooks and operators from Airflow Plugins

Yet Another ETL in PHP

数据采集平台zdh,etl 处理服务

A curated list of awesome system integration software and resources.