840 Open source projects that are alternatives of or similar to Shifu

bigdatatutorial

Java开发者或者大数据开发者面试知识点整理

一个大数据架构师应该掌握的技能

Tidy up Spark and Hadoop tutorials.

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Today I Learned

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

大数据学习笔记，学习路线，技术案例整理。

Forecast stock prices using machine learning approach. A time series analysis. Employ the Use of Predictive Modeling in Machine Learning to Forecast Stock Return. Approach Used by Hedge Funds to Select Tradeable Stocks

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

A collection of pentest tools and resources targeting Hadoop environments

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

大数据生态圈学习

Code Library for My Blog

Documentation placeholder and utilities for all the other containers.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Data Lineage Tracking And Visualization Solution

大数据入门指南 ⭐

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs

大数据分析可视化实践

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

A Drone plugin for caching current workspace files between builds to reduce your build times

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

云研发，是一种生于云上的闭环 + 代码化的软件开发方式。它可以让业务人员、开发人员、运营人员等在同一个云端共同协作、透明化地完成整个软件的生命周期（需求、设计、编码、构建、部署、运营），而非相互隔离，又或者是借助于多个软件才能完成工作。

Spark、Flink等离线任务的调度以及实时任务的监控

Old archived draft proposal for smart pipelines. Go to the new Hack-pipes proposal at js-choi/proposal-hack-pipes.

Big Data Ecosystem Docker

The safe post-production pipeline - https://getavalon.github.io/2.0

Jenkins实践文档 最新站点地址: http://www.idevops.site

Apache Nutch is an extensible and scalable web crawler

텐서플로우와 머신러닝으로 시작하는 자연어처리(로지스틱회귀부터 트랜스포머 챗봇까지)

Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)

Decision Trees, Random Forest, Dynamic Time Warping, Naive Bayes, KNN, Linear Regression, Logistic Regression, Mixture Of Gaussian, Neural Network, PCA, SVD, Gaussian Naive Bayes, Fitting Data to Gaussian, K-Means

A Lightweight Decision Tree Framework supporting regular algorithms: ID3, C4,5, CART, CHAID and Regression Trees; some advanced techniques: Gradient Boosting (GBDT, GBRT, GBM), Random Forest and Adaboost w/categorical features support for Python

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

Learn how to build a CI/CD pipeline for SAM-based applications

☔️ => ⛅️ => ☀️

Machine Learning Pipelines for Kubeflow

The official home of the Presto distributed SQL query engine for big data

spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface

A set of tools to understand what is happening inside a Random Forest

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

Elastic Crontab System 简单易用的分布式定时任务管理系统

推荐项目（实时推荐和离线推荐）

Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version

🔥🌟《Machine Learning 格物志》: ML + DL + RL basic codes and notes by sklearn, PyTorch, TensorFlow, Keras & the most important, from scratch!💪 This repository is ALL You Need!

Mirror of Apache Hadoop common

Fluid dynamics component of Chemical Engineering Design Library (ChEDL)