961 Open source projects that are alternatives of or similar to Delta Architecture

Divolte Collector

Kafka connect Elastic sink connector, with just in time index/delete behaviour.

🎩 Most advanced high level Node.js Kafka client

java-study 是本人学习Java过程中记录的一些代码！从Java基础的数据类型、jdk1.8的Lambda、Stream和日期的使用、 IO流、数据集合、多线程使用、并发编程、23种设计模式示例代码、常用的工具类， 以及一些常用框架，netty、mina、springboot、kafka、storm、zookeeper、redis、elasticsearch、hbase、hive等等。

A Data Engineering & Machine Learning Knowledge Hub

Bucketing and partitioning system for Parquet

Distributed scikit-learn meta-estimators in PySpark

Learning Apache spark,including code and data .Most part can run local.

Terraform provider for managing Apache Kafka Topics + ACLs

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

本项目已迁移至 github.com/jetlinks

Essential Spark extensions and helper methods ✨😲

Easily load data from kafka to ClickHouse

Official code repository for GATK versions 4 and up

A tool for performing consistent backups of MongoDB Clusters or Replica Sets

dnc 去中心化 开源社区 轻联盟 dncto.com QQ群 779699538

Spark structured streaming examples with using of version 3.0.0

Kafka Connect Elasticsearch Source

Distributed KV Streams

List of Computer Science courses with video lectures.

本项目收藏这些年来看过或者听过的一些不错的书籍，在整理文件时看见这些，发现删掉有点可惜，放着又太浪费空间，本着分享的原则，就把它们共享出来，一方面给需要的读者提供这些书籍，另一方面也是一种像知识库的积累吧

GoRose(go orm), a mini database ORM for golang, which inspired by the famous php framwork laravle's eloquent. It will be friendly for php developer and python or ruby developer. Currently provides six major database drivers: mysql,sqlite3,postgres,oracle,mssql, Clickhouse.

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

The XP Framework is an all-purpose, object oriented PHP framework.

A resilient and scalable shopping cart system designed using Event Sourcing (ES) and Command Query Responsibility Segregation (CQRS)

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

dllib is a distributed deep learning library running on Apache Spark

零基础学习spark，大数据学习

Skytable is an extremely fast, secure and reliable real-time NoSQL database with automated snapshots and TLS

Developing Spark External Data Sources using the V2 API

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Minikube for big data with Scala and Spark

An open source framework for building data analytic applications.

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

High performance HBase / Spark SQL engine

blog entries

Geo Spatial Data Analytics on Spark

⏳ Futures, Streams & Async/Await for PHP's Swoole asynchronous run-time.

KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.

A curated list of awesome resources and learning materials in the field of X internals

Apache Kafka client library for Erlang/Elixir

A library that provides useful extensions to Apache Spark and PySpark.

Python Helper library for Jupyter Notebooks

Event emitter for watching text streams with regex patterns

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

A compiler for automatically re-targeting sequential Java code to Apache Spark.

Type System for Data Analysis in Python

A community-developed, free, open source, microservices API automation and load testing framework built using JUnit core runners for Http REST, SOAP, Security, Database, Kafka and much more. Zerocode Open Source enables you to create, change, orchestrate and maintain your automated test cases declaratively with absolute ease.

Web Streams, based on the WHATWG spec reference implementation

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

The Internals of Spark Structured Streaming

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

High Performance HTTP Sidecar Load Balancer

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

Kafka Connect connector for JDBC-compatible databases

Kafka UI and Monitoring Tool