1318 Open source projects that are alternatives of or similar to Smooks

A lightweight stream processing library for Go

A simplified, lightweight ETL Framework based on Apache Spark

Event-driven workflow automation framework

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Distributed Stream and Batch Processing

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

Platform for Situated Intelligence

Open-source distributed computation and storage platform

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

🔀 FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.

A Python stream processing engine modeled after Yahoo! Pipes

🐟 A streaming ETL for fish

A simple Spark-powered ETL framework that just works 🍺

Big Data Toolkit for the JVM

Fancy stream processing made operationally mundane

Event-Driven microservices with Kafka Streams

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

A visual ETL development and debugging tool for big data

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

The MarkLogic Data Hub: documentation ==>

Stroom is a highly scalable data storage, processing and analysis platform.

☁️ nodejs kafka connect connector for Google BigQuery

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

an online learning algorithm library for Storm

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

High performance data aggregating storage

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

The Refreshingly Simple Cross-Platform C++ Dataflow / Pipelining / Stream Processing / Reactive Programming Framework

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Building event-driven applications the easy way in Go.

Small and simple stream-based CEP tool for IoT devices connected to an MQTT broker

Mirror of Apache VXQuery

ETL Library for Machine Learning - data pipelines, data munging and wrangling

The Metadata Platform for the Modern Data Stack

Give a custom shape to any android view, Material Design 2 ready

KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes

Event triggering with Tekton!

Slide Decks

tableExport（table导出文件，支持json、csv、txt、xml、word、excel、image、pdf）

DITA Open Toolkit — the open-source XML publishing engine for content authored in the Darwin Information Typing Architecture.

XML, NEWS, RSS & Scrapping Reader maked in Xamarin, for educational purpose.

Machine Learning Platform for Kubernetes (MLOps tools for experimentation and automation)

CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.

The fast & forgiving HTML and XML parser

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

A visual approach to serverless development. Think. Build. Repeat.

Enabling queries on compressed data.

A JavaScript library for web-based content editing.

Event/Data distribution system without any configuration, but with data delivery guarantees

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

A python package to create a database on the platform using our moj data warehousing framework

Distributed KV Streams

📋 A Python Parser for PubMed Open-Access XML Subset and MEDLINE XML Dataset