2100 Open source projects that are alternatives of or similar to Bigdata Notes

Java源码分析 【源码笔记】专注于Java后端系列框架的源码分析，每周持续推出Java后端系列框架的源码分析文章。

Kafka Zookeeper RESTful API to perform topic/consumer group administration/metric(offset\lag\message) collection and monitor

docker compose files to create a fully working kafka stack

Serverless Platform for the stateful services

Kafka Web UI

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

Apache Spark Website

Collection of Kubernetes Operators built with KUDO.

Kafka Connect FileSystem Connector

An open source framework for building data analytic applications.

A serverless cluster computing system for the Go programming language

Geo Spatial Data Analytics on Spark

A framework for writing Spark 2.x applications in a pretty way

Apache Phoenix Query Server

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

程序员进阶书籍（视频），持续更新（Programmer Books）

type-class based data cleansing library for Apache Spark SQL

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能

Alluxio, data orchestration for analytics and machine learning in the cloud

Python client for Hadoop® YARN API

基于Hadoop的分布式云存储系统 🌴

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

🍉基于Hadoop和HBase的大规模海量数据去重

Data pipeline project

Repair hbase metadata table from hdfs.

电商用户行为分析大数据平台

基于hadoop+hbase+springboot实现分布式网盘系统

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

A cohesive & pragmatic framework of FP centric Scala libraries

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Core utility library & data connectors designed for simpler usage in Scala

DevOps pipeline for Real Time Social/Web Mining

Liquibase extension to add Impala Database support

Avro Schema Evolution made easy

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Mirror of Apache Storm

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

SiteWhere is an industrial strength open-source application enablement platform for the Internet of Things (IoT). It provides a multi-tenant microservice-based infrastructure that includes device/asset management, data ingestion, big-data storage, and integration through a modern, scalable architecture. SiteWhere provides REST APIs for all system functionality. SiteWhere provides SDKs for many common device platforms including Android, iOS, Arduino, and any Java-capable platform such as Raspberry Pi rapidly accelerating the speed of innovation.

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.

Manage Apache Atlas and Ranger configuration for your Hadoop environment.

clusterdock is a framework for creating Docker-based container clusters

基于大数据的图书推荐系统

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

Distributed Stream and Batch Processing

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Distributed Big Data Orchestration Service

【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

Kubernetes Universal Declarative Operator (KUDO)