279 Open source projects that are alternatives of or similar to maxwell-sink

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

Kafka Connect connector for Redis

fdtd3d is an open source 1D, 2D, 3D FDTD electromagnetics solver with MPI, OpenMP and CUDA support for x86, arm, arm64 architectures

A curated list of awesome system integration software and resources.

A commandline tool for resetting Kafka Connect source connector offsets.

JDBC driver for Neo4j

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

Simple way to copy data from relational databases into kafka.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

A persistence framework for game developers

📜 A CLI toolkit for extracting and working with your digital history

Kafka MongoDb sink connector

🗺 GIS plugins for Pentaho Data Integration

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.

Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.

A client for connecting and running DDLs on hive metastore.

ETL for OIC Options Chains

NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile y…

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

A collection of tools for extracting FHIR resources and analytics services on top of that data.

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

Kafka Connect FileSystem Connector

Kafka Connect connectors for Azure Cosmos DB

Thain is a distributed flow schedule platform.

Real-Time Event Streaming & Change Data Capture

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

🥑 Kafka connect sink connector for ArangoDB

Utility that converts an .etl file containing a Windows network packet capture into .pcapng format.

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

A visual ETL development and debugging tool for big data

Categorical Query Language IDE

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

A MongoDB to Elasticsearch connector

code, labs and lectures for the course

Enterprise-grade, production-hardened, serverless data lake on AWS

Kafka Connect Examples

A schema-aware Scala library for data transformation

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

Yet Another ETL in PHP

Linq to database provider.

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

Server application to serve U.S. federal spending data via a RESTful API

A lib to transform data from jdbc,csv,json to ecah other.

数据可视化, 数据挖掘, 数据处理 ETL

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

mito ETL tool

Code relating to scraping public police data.

BETL. Meta data driven ETL generation using T-SQL

Live import all your Google Sheets to your data warehouse

A Kafka source connector capturing Scylla CDC changes

Ruby scripting for pentaho-kettle

Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink