216 Open source projects that are alternatives of or similar to Real-time-Data-Warehouse

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

SQL Server Change Stream sample using Debezium

Previously used repository for new Debezium modules and connectors in incubation phase (archived)

⚾ Streaming left joins in Kafka for change data capture

A Kafka source connector capturing Scylla CDC changes

Apache Spark Course Material

Source for the Debezium website; Please log issues in our tracker at https://issues.redhat.com/projects/DBZ/.

Flink Demo

Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.

Spark structured streaming examples with using of version 3.0.0

Upserts, Deletes And Incremental Processing on Big Data.

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.

基于Apache-bahir-kudu-connector的flink-connector-kudu，支持Flink1.11.x DynamicTableSource/Sink，支持Range分区等

MySQL/MariaDB binlog replication client for .NET

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

SQL Parsers for BigData, built with antlr4.

Oracle database CDC (Change Data Capture)

Listen to your to PostgreSQL database in realtime via websockets. Built with Elixir.

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

LarkMidTable 是一站式开源的数据中台，实现中台的 基础建设，数据治理，数据开发，监控告警，数据服务，数据的可视化，实现高效赋能数据前台并提供数据服务的产品。

The Internals of Delta Lake

Microservice application with various Redis use-cases with RediSearch, RedisGraph and Streams. The data are synchronize between MySQL and Redis using Debezium as a CDC engine

TiDB connectors for Flink/Hive/Presto

A scalable Netflix DBLog implementation for PostgreSQL

Open Source Oracle database CDC written purely in C++. Reads transactions directly from database redo log files and streams in JSON or Protobuf format to: Kafka, RocketMQ, flat file, network stream (plain TCP/IP or ZeroMQ)

is an hypercube of data

A highly efficient daemon for streaming data from Kafka into Delta Lake

A library for performing Content-Defined Chunking (CDC) on data streams.

SANSA Query Layer

A simple request response cycle using Websockets, Eclipse Vert-x server, Apache Kafka, Apache Flink.

Apache Flink connectors for Pravega.

Spark VCF data source implementation for Dataframes

An encrypted data analytics platform

Albis: High-Performance File Format for Big Data Systems

Live import all your Google Sheets to your data warehouse

A curated list of awesome big data frameworks, ressources and other awesomeness.

A Signature R package for the National Syndromic Surveillance Program (NSSP) at the Centers for Disease Control and Prevention (CDC). A collection of tools, functions, and R Markdown templates that supports the Community of Practice of the NSSP.

A full-stack .NET 6 Microservices build on Minimal APIs and C# 10

Some spring sample projects

Fast and portable delta encoding for .NET in 100% safe, managed code.

Sample project for Apache Flink with Streaming Engine and JDBC Sink

No description or website provided.

seatunnel plugin developing examples.

This repository contains the code base for the Open Stream Processing Benchmark.

🍉基于Hadoop和HBase的大规模海量数据去重

a PWA to note shopping list and see shopping history

PostgreSQL Logical Replication client for node.js

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

SwiftUI + CoreData user interface for DeltaCore & Friends.

Learning Flink : Flink CEP,Flink Core,Flink SQL

This is a top level repository for code examples related to Data Warehousing and Very Large Databases.

Easy parsing of Apache HTTPD and NGINX access logs with Java, Hadoop, Hive, Pig, Flink, Beam, Storm, Drill, ...

A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.

Near real time cloud native data pipeline in AWS (CDC+Sink). Hosts code for RedshiftSink. RDS to RedshiftSink Pipeline with masking and reloading support.

Smart Automation Tool for building modern Data Lakes and Data Pipelines

A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0

Python idiomatic SDK for Cortex™ Data Lake.

bring sf to spark in production

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

flink 流处理源码分析