All Projects → xubo245 → Sparklearning

xubo245 / Sparklearning

Learning Apache spark,including code and data .Most part can run local.

Programming Languages

scala
5932 projects

Projects that are alternatives of or similar to Sparklearning

Home
ApacheCN 开源组织:公告、介绍、成员、活动、交流方式
Stars: ✭ 1,199 (+114.87%)
Mutual labels:  spark, ml
Spark Tda
SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.
Stars: ✭ 45 (-91.94%)
Mutual labels:  spark, ml
Ludwig
Data-centric declarative deep learning framework
Stars: ✭ 8,018 (+1336.92%)
Mutual labels:  learning, ml
Sk Dist
Distributed scikit-learn meta-estimators in PySpark
Stars: ✭ 260 (-53.41%)
Mutual labels:  spark, ml
Mmlspark
Simple and Distributed Machine Learning
Stars: ✭ 2,899 (+419.53%)
Mutual labels:  spark, ml
Feast
Feature Store for Machine Learning
Stars: ✭ 2,576 (+361.65%)
Mutual labels:  spark, ml
Makine Ogrenmesi
Makine Öğrenmesi Türkçe Kaynak
Stars: ✭ 82 (-85.3%)
Mutual labels:  learning, ml
Transmogrifai
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Stars: ✭ 2,084 (+273.48%)
Mutual labels:  spark, ml
awesome-AI-kubernetes
❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc
Stars: ✭ 95 (-82.97%)
Mutual labels:  spark, ml
Featran
A Scala feature transformation library for data science and machine learning
Stars: ✭ 420 (-24.73%)
Mutual labels:  spark, ml
Cdap
An open source framework for building data analytic applications.
Stars: ✭ 509 (-8.78%)
Mutual labels:  spark
Sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
Stars: ✭ 513 (-8.06%)
Mutual labels:  spark
Designcode Swiftui
📱 An app fully written in SwiftUI showcasing beautiful design and animations.
Stars: ✭ 529 (-5.2%)
Mutual labels:  learning
Wtfjs
🤪 A list of funny and tricky JavaScript examples
Stars: ✭ 24,594 (+4307.53%)
Mutual labels:  learning
Magellan
Geo Spatial Data Analytics on Spark
Stars: ✭ 507 (-9.14%)
Mutual labels:  spark
Lopq
Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.
Stars: ✭ 530 (-5.02%)
Mutual labels:  spark
Moviebox
Machine learning movie recommending system
Stars: ✭ 504 (-9.68%)
Mutual labels:  learning
Tour of rust
A tour of rust's language features
Stars: ✭ 503 (-9.86%)
Mutual labels:  learning
Renderhelp
⚡️ 可编程渲染管线实现,帮助初学者学习渲染
Stars: ✭ 494 (-11.47%)
Mutual labels:  learning
Spark Daria
Essential Spark extensions and helper methods ✨😲
Stars: ✭ 553 (-0.9%)
Mutual labels:  spark

为了更好的学习和理解spark,也为了记录自己学习过程中遇到的各种问题,方便以后查询,故写了相关博客,也公开了代码和数据,代码基本都可以本地(local)运行。论文部分由于是ppt,故没有放上来。

0.总目录:

SparkLearning博客:http://blog.csdn.net/bob601450868/article/category/5730447
SparkLearning代码和数据:https://github.com/xubo245/SparkLearning
书籍和视频等学习资料推荐: Spark学习资料汇总

1.环境

SparkLearning是在spark上运行的,spark搭建等请见spark官网或其他网站。 SparkLearning运行环境:
jdk1.7
maven 3.3.9
Spark-1.5.2
scala-2.10.4
idea 15.04/eclipse-4.3.2
spark-assembly-1.5.2-hadoop2.6.0.jar(下载地址: http://pan.baidu.com/s/1hrSxiDI)

2.说明:

SparkLearning项目带有数据,下载会比较慢,如果只想下载部分文件夹,可以使用svn。另外也在20160810弄了一个没有数据的project,方便下载:https://github.com/xubo245/SparkLearning_NoData

3.具体博客目录:

(1).Spark基本学习篇: 

SparkBaseLearning文档
SparkBaseLearning代码

(2).Spark代码篇:

SparkCodeLearning文档
SparkCodeLearning代码

(3).Spark组件之Mllib学习篇

MLlibLearning文档
MLlibLearning代码

(4).Spark组件之SparkSQL学习篇

SparkSQLLearning文档
SparkSQLLearning代码

(5).Spark组件之SparkR学习篇

SparkRLearning文档
SparkRLearning代码

(6).Spark组件之Spark Streaming学习篇

SparkStreamingLearning文档
SparkStreamingLearning代码

(7). Spark组件之GraphX学习篇

GraphXLearning文档
GraphXLearning代码

(8).Spark-Avro学习篇

SparkAvroLearning文档
SparkAvroLearning代码

(9).Spark生态之Alluxio(Tachyon)学习篇

AlluxioLearning文档
AlluxioLearning代码

(10).Spark生态之spark-csv篇:

SparkCsvLearning文档
SparkCsvLearning代码

(11).Spark疑问篇

SparkQuestion文档

(12).MLLearning:

MLLearning文档
MLLearning代码

MLlibLearning project: https://github.com/xubo245/MLlibLearning

(13). Spark源码学习

SparkSourceLearning文档
SparkSourceLearning代码

Help

If you have any questions or suggestions, please write it in the issue of this project or send an e-mail to me: [email protected]

Wechat: xu601450868
QQ: 601450868

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].