826 Open source projects that are alternatives of or similar to Abris

type-class based data cleansing library for Apache Spark SQL

My own version of r/place, done in a weekend

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Spark examples

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Kafka command line tool that likes JSON

Superman是什么：构建Java 高级开发技术的知识体系，从基础不断打怪升级成为超人之路（更新中.......）

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Optimize and improve the Label propagation algorithm

🐂基于springcloud +dubbo构建的模拟秒杀项目，模块化设计，集成了分库分表、elasticsearch🔍、gateway、mybatis-plus、spring-session等常用开源组件

A large-scale entity and relation database supporting aggregation of properties

Enterprise Network Flow Collector (IPFIX, sFlow, Netflow) from Verizon Media

Research on distributed system

A Flexible and Powerful Parameter Server for large-scale machine learning

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

A luigi powered analytics / warehouse stack

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

A pandas-like deferred expression system, with first-class SQL support

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

Big Data for Data Engineers Coursera Specialization from Yandex

SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失

A solution to help you build automation and gitops in your Apache Kafka deployments. The Kafka gitops!

Expressive types for Spark.

Golang app to read records from a set of kafka topics and write them to an elasticsearch cluster

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

Distributed Deep learning with Keras & Spark

Udacity Data Engineering Nano Degree (DEND)

Official code repository for GATK versions 4 and up

a fast and simple distributed publish-subscribe messaging system (mq)

This is a NodeJS/Angular 2 frontend UI for Kafka cluster monitoring with Burrow

Source code for James Lee's Aparch Spark with Java course

An extensible distributed system for reliable nearline data streaming at scale

An Event Sourcing service template with DDD, TDD and SOLID. It has High Cohesion and Loose Coupling, it's a good start for your next Microservice application.

This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.

A collection of kafka-resources

Asp.Net Core 5 Clean Architecture (Microservices, Modular Monolith, Monolith) samples (+Blazor, Angular 11, React 17, Vue 2.6), Domain-Driven Design, CQRS, Event Sourcing, SOLID, Asp.Net Core Identity Custom Storage, Identity Server 4 Admin UI, Entity Framework Core, Selenium E2E Testing, SignalR Notification, Hangfire Tasks Scheduling, Health Checks, Security Headers, ...

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Example project implementing best practices for PySpark ETL jobs and applications.

Spring Boot application showing basic configuration to work with Kafka

💥 A simple multi-purpose connection pool client (Kafka & Hbase & Redis & RMDB & Socket & Http)

DoctorK is a service for Kafka cluster auto healing and workload balancing

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Command Dispatcher, Processor, and Distributed Task Queue

DataFusion has now been donated to the Apache Arrow project

Ansible Kafka role

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

CMAK is a tool for managing Apache Kafka clusters

Distributed Prometheus time series database

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

Apache Spark Connector for Azure Kusto

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Boiler plate framework to use Spark and ZIO together.

Reliable messages resolve distributed transactions

Run spark calculations from Ammonite

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Python Helper library for Jupyter Notebooks