533 Open source projects that are alternatives of or similar to docker-hadoop

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

大数据入门指南 ⭐

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

基于wifi抓取信息的大数据查询分析系统

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Distributed Java micro-services using ZooKeeper

Hadoop utility to compact small files

一个对用户行为日志进行分析的大数据项目

Mount HDFS with fuse, works with kerberos!

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Kafka Connect HDFS connector

Fast desktop client for Hadoop Distributed File System

基于Hadoop的分布式云存储系统 🌴

同步Hive数据仓库数据到Elasticsearch的小工具

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.

Support TensorFlow on YARN

A Java NIO file system provider for HDFS

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

零基础学习spark，大数据学习

A pandas-like deferred expression system, with first-class SQL support

Mirror of Linkedin's Camus

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Python client for Hadoop® YARN API

💎🔥大数据学习笔记

Export Hadoop YARN (resource-manager) metrics in prometheus format

Hadoop WebHDFS output plugin for Fluentd

Big Data Ecosystem Docker

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

AI on Hadoop

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

大数据学习笔记，学习路线，技术案例整理。

Scalable data processing pipelines in JavaScript

A tool and library for easily deploying applications on Apache YARN

Kafka Connect FileSystem Connector

A complete (distributed) BigData stack, running in containers

Fundamentals of Spark with Python (using PySpark), code examples

An easy way to deploy your Akka services to a distributed environment.

Train TensorFlow models on YARN in just a few lines of code!

Final boilerplate code of the JavaScript Stack from Scratch tutorial –

🔒 Your lockfile, up to date, all the time

zero config, zero dependency bundler for tiny javascript packages

A Lerna-like tool for managing Javascript monorepos using Yarn

Gulp Webpack Starter - fast static website builder. The starter uses gulp toolkit and webpack bundler. Download to get an awesome development experience!

💡 Use the right package manager

A fast, reliable, and secure NPM/Yarn bridge for Composer

Run `yarn install`, `npm install` or `pnpm install` on git hooks automatically

🚀 Minimal preact structure

Recoded version of Visual Studio Code extension 'vs-deploy', which provides commands to deploy files to one or more destinations.

Bash completion for Yarn

Zero-runtime-dependency package acting as bridge between Node projects and their package managers

Estimate script execution time

An example app built on Ruby on Rails 6.1 + React.js 17 + TypeScript 4.2 + Docker Compose

Learn how npm or Yarn v1 works.

⚡️ Super-powered JavaScript project management

A barebones boilerplate for getting started on a bespoke front end.

Spark Streaming监控平台，支持任务部署与告警、自启动