279 Open source projects that are alternatives of or similar to maxwell-sink

A Kafka Connect source connector that generates data for tests

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步，主要定位是为实时交易系统服务，亦可用于大数据的数据同步（ETL领域）。

☁️ nodejs kafka connect connector for Google BigQuery

Configurable data bridge for permanent ETL jobs

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

ETL jobs for Firefox Telemetry

An Elasticsearch client tailored to data science workflows.

In-memory Java DataFrame library

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Synchronization Algorithm Exploration: Techniques to synchronize a SQL database with external destinations.

ETL for the NASDAQ symbol file

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

网站点击流离线日志分析

CVparser is software for parsing or extracting data out of CV/resumes.

A data transformation package for deep learning with Autonomio, Keras and TensorFlow.

Flock: A Low-Cost Streaming Query Engine on FaaS Platforms

an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Kafka Connect Examples

A CLI and library to run Singer Taps and Targets

大数据采集,抽取平台

CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

fdtd3d is an open source 1D, 2D, 3D FDTD electromagnetics solver with MPI, OpenMP and CUDA support for x86, arm, arm64 architectures

A commandline tool for resetting Kafka Connect source connector offsets.

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

A persistence framework for game developers

Kafka MongoDb sink connector

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.

ETL for OIC Options Chains

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

Kafka Connect connectors for Azure Cosmos DB

Real-Time Event Streaming & Change Data Capture

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

🥑 Kafka connect sink connector for ArangoDB

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Data migration framework for Django that migrates legacy data into your new django app

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

code, labs and lectures for the course

A schema-aware Scala library for data transformation

🔄 Simple tool for ETL. From SQL to Redis.

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

A lib to transform data from jdbc,csv,json to ecah other.

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Code relating to scraping public police data.

Live import all your Google Sheets to your data warehouse

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A Kafka source connector capturing Scylla CDC changes

Ruby scripting for pentaho-kettle

Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.