1617 Open source projects that are alternatives of or similar to Bandar Log

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Big Data Toolkit for the JVM

An extensible Java framework for building XML and non-XML streaming applications

A visual ETL development and debugging tool for big data

A Presto client for the Go programming language.

Example end to end data engineering project.

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Spring Boot 2.x code examples

Apache Spark and Apache Kafka integration example

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Stream computing platform for bigdata

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Kafka Connect HDFS connector

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Demo applications and code examples for Confluent Platform and Apache Kafka

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command. Integrations with Cloudwatch and Datadog. Authentication recently added

Schema Registry

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

code, labs and lectures for the course

Open-Source Web GUI for Apache Kafka Management

☁️ nodejs kafka connect connector for Google BigQuery

OLAP and ETL of Big Data

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

StreamLine - Streaming Analytics

A simplified, lightweight ETL Framework based on Apache Spark

A simple Spark-powered ETL framework that just works 🍺

Fancy stream processing made operationally mundane

The official home of the Presto distributed SQL query engine for big data

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Enterprise Network Flow Collector (IPFIX, sFlow, Netflow) from Verizon Media

Distributed Stream and Batch Processing

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

This is a NodeJS/Angular 2 frontend UI for Kafka cluster monitoring with Burrow

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

大数据入门指南 ⭐

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

CMAK is a tool for managing Apache Kafka clusters

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Real Time Analytics and Data Pipelines based on Spark Streaming

A lightweight stream processing library for Go

Deploy Prometheus monitoring system

Kubernetes Setup for Prometheus and Grafana

Mirror of Apache Storm

A Flexible and Powerful Parameter Server for large-scale machine learning

Very simplified shop sales system made in a microservices architecture using quarkus

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Successor: https://github.com/fluxcd/flux2 — The GitOps Kubernetes operator

A curated list of Site Reliability and Production Engineering resources.

Mirror of Apache Sqoop

Promgen is a configuration file generator for Prometheus

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.

A powerful and easy to configure uptime and ssl monitor