214 Open source projects that are alternatives of or similar to iex-stocks

Server application to serve U.S. federal spending data via a RESTful API

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

A Python stream processing engine modeled after Yahoo! Pipes

Thain is a distributed flow schedule platform.

mito ETL tool

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

A tool for building feature stores.

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

Enterprise-grade, production-hardened, serverless data lake on AWS

The MarkLogic Data Hub: documentation ==>

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

Linq to database provider.

🗺 GIS plugins for Pentaho Data Integration

数据可视化, 数据挖掘, 数据处理 ETL

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

A visual ETL development and debugging tool for big data

Python based Wikidata framework for easy dataframe extraction

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Utility that converts an .etl file containing a Windows network packet capture into .pcapng format.

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

A client for connecting and running DDLs on hive metastore.

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器，分布式爬虫

Categorical Query Language IDE

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

A collection of tools for extracting FHIR resources and analytics services on top of that data.

Linked Data & RDF Manufacturing Tools in Clojure

📜 A CLI toolkit for extracting and working with your digital history

Bender - Serverless ETL Framework

www.vixtract.ru

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

MySQL / MariaDB import for DTD feeds (fares, timetable and routeing)

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

📘 Making Data, the DataMade Way

An example mini data warehouse for python project stats, template for new projects

A dbt adapter for Databricks.

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

Example DAGs using hooks and operators from Airflow Plugins

Big Data Toolkit for the JVM

JDBC driver for Neo4j

基于spring boot通过java代码调用kette

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Mass processing data with a complete ETL for .net developers

A minimalist (geospatial) ETL

Configurable Extract, Transform, and Load

R client for the Elasticsearch HTTP API

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Data processing & ETL framework for Ruby

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile y…

A cross-platform command line tool for parallelised content extraction and analysis.

A curated list of awesome system integration software and resources.

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

Blog post on ETL pipelines with Airflow

A MongoDB to Elasticsearch connector