Learning Spark零基础学习spark,大数据学习
Stars: ✭ 37 (-97.73%)
Mutual labels: hadoop, hdfs, spark
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-99.2%)
Mutual labels: spark, hadoop, hdfs
Bigdata dockerBig Data Ecosystem Docker
Stars: ✭ 161 (-90.12%)
Mutual labels: hadoop, hdfs, spark
Spark With PythonFundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-90.8%)
Mutual labels: hadoop, hdfs, spark
Repository个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。
Stars: ✭ 92 (-94.36%)
Mutual labels: hadoop, hdfs, spark
hive to es同步Hive数据仓库数据到Elasticsearch的小工具
Stars: ✭ 21 (-98.71%)
Mutual labels: hadoop, impala, hdfs
fastdata-clusterFast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)
Stars: ✭ 20 (-98.77%)
Mutual labels: spark, hadoop, hdfs
bigdata-funA complete (distributed) BigData stack, running in containers
Stars: ✭ 14 (-99.14%)
Mutual labels: spark, hadoop, hdfs
God Of Bigdata专注大数据学习面试,大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
Stars: ✭ 6,008 (+268.59%)
Mutual labels: hadoop, hdfs, spark
Devops Python Tools80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Stars: ✭ 406 (-75.09%)
Mutual labels: hadoop, hdfs, spark
Bigdata Interview🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
Stars: ✭ 857 (-47.42%)
Mutual labels: hadoop, hdfs, spark
Data Science Ipython NotebooksData science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Stars: ✭ 22,048 (+1252.64%)
Mutual labels: pandas, hadoop, spark
Bigdata Notes大数据入门指南 ⭐
Stars: ✭ 10,991 (+574.29%)
Mutual labels: hadoop, hdfs, spark
Xlearning Xdmlextremely distributed machine learning
Stars: ✭ 113 (-93.07%)
Mutual labels: hadoop, spark
WeblogsanalysissystemA big data platform for analyzing web access logs
Stars: ✭ 37 (-97.73%)
Mutual labels: hadoop, spark
Docker HadoopA Docker container with a full Hadoop cluster setup with Spark and Zeppelin
Stars: ✭ 54 (-96.69%)
Mutual labels: hadoop, spark
Rumble⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
Stars: ✭ 58 (-96.44%)
Mutual labels: hdfs, spark
Docker Spark ClusterA Spark cluster setup running on Docker containers
Stars: ✭ 57 (-96.5%)
Mutual labels: hadoop, spark
WaimakWaimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
Stars: ✭ 60 (-96.32%)
Mutual labels: hadoop, spark
Apache Spark Hands OnEducational notes,Hands on problems w/ solutions for hadoop ecosystem
Stars: ✭ 74 (-95.46%)
Mutual labels: hadoop, spark