GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → reugn → Go Streams

reugn / Go Streams

Licence: mit
A lightweight stream processing library for Go

Programming Languages

go
31211 projects - #10 most used programming language

Labels

rediswebsocketkafkapipelineetlstream-processingstreamspipelineskafka-streamsstreaming-data

Projects that are alternatives of or similar to Go Streams

Awesome Kafka
A list about Apache Kafka
Stars: ✭ 397 (-35.45%)
Mutual labels:  kafka, stream-processing, kafka-streams, streaming-data
Benthos
Fancy stream processing made operationally mundane
Stars: ✭ 3,705 (+502.44%)
Mutual labels:  kafka, etl, stream-processing, streaming-data
Kafka Streams
equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨
Stars: ✭ 613 (-0.33%)
Mutual labels:  streams, kafka, stream-processing, kafka-streams
Flink Learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Stars: ✭ 11,378 (+1750.08%)
Mutual labels:  kafka, stream-processing, redis
Spring Samples For All
spring、spring-boot、spring-cloud 常用整合用例
Stars: ✭ 401 (-34.8%)
Mutual labels:  kafka, redis, websocket
Kspp
A high performance/ real-time C++ Kafka streams framework (C++17)
Stars: ✭ 80 (-86.99%)
Mutual labels:  kafka, stream-processing, kafka-streams
Airbyte
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Stars: ✭ 4,919 (+699.84%)
Mutual labels:  pipeline, etl, pipelines
Istio Micro
istio 微服务示例代码 grpc+protobuf+echo+websocket+mysql+redis+kafka+docker-compose
Stars: ✭ 194 (-68.46%)
Mutual labels:  kafka, redis, websocket
Kafka Tutorials
Kafka Tutorials microsite
Stars: ✭ 144 (-76.59%)
Mutual labels:  kafka, stream-processing, kafka-streams
Data Accelerator
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (-59.84%)
Mutual labels:  kafka, kafka-streams, streaming-data
frizzle
The magic message bus
Stars: ✭ 14 (-97.72%)
Mutual labels:  pipeline, stream-processing, streaming-data
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (-62.6%)
Mutual labels:  streams, kafka, kafka-streams
godsend
A simple and eloquent workflow for streaming messages to micro-services.
Stars: ✭ 15 (-97.56%)
Mutual labels:  streams, stream-processing, streaming-data
Examples
Demo applications and code examples for Confluent Platform and Apache Kafka
Stars: ✭ 571 (-7.15%)
Mutual labels:  kafka, stream-processing, kafka-streams
Logisland
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Stars: ✭ 97 (-84.23%)
Mutual labels:  kafka, stream-processing, kafka-streams
Faust
Python Stream Processing
Stars: ✭ 5,899 (+859.19%)
Mutual labels:  kafka, stream-processing, kafka-streams
Kafka Streams In Action
Source code for the Kafka Streams in Action Book
Stars: ✭ 167 (-72.85%)
Mutual labels:  kafka, stream-processing, streaming-data
Machine
Machine is a workflow/pipeline library for processing data
Stars: ✭ 78 (-87.32%)
Mutual labels:  pipeline, stream-processing, streaming-data
Logrange
High performance data aggregating storage
Stars: ✭ 181 (-70.57%)
Mutual labels:  streams, stream-processing, pipelines
Smooks
An extensible Java framework for building XML and non-XML streaming applications
Stars: ✭ 293 (-52.36%)
Mutual labels:  etl, stream-processing, pipelines
View All Similar Projects ➔

go-streams

Build Status PkgGoDev Go Report Card codecov

A lightweight stream processing library for Go.
go-streams provides a simple and concise DSL to build data pipelines. pipeline-architecture-example

Wiki
In computing, a pipeline, also known as a data pipeline, is a set of data processing elements connected in series, where the output of one element is the input of the next one. The elements of a pipeline are often executed in parallel or in time-sliced fashion. Some amount of buffer storage is often inserted between elements.

Overview

Building blocks:

  • Source - A Source is a set of stream processing steps that has one open output.
  • Flow - A Flow is a set of stream processing steps that has one open input and one open output.
  • Sink - A Sink is a set of stream processing steps that has one open input. Can be used as a Subscriber.

Flow capabilities (flow package):

  • Map
  • FlatMap
  • Filter
  • PassThrough
  • Split
  • FanOut
  • Merge
  • Throttler
  • SlidingWindow
  • TumblingWindow

Supported Connectors:

Examples

Usage samples are available in the examples directory.

License

Licensed under the MIT License.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].