All Projects → thangdnsf → BigCLAM-ApacheSpark

thangdnsf / BigCLAM-ApacheSpark

Licence: MIT license
Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

Programming Languages

scala
5932 projects

Projects that are alternatives of or similar to BigCLAM-ApacheSpark

connected-component
Map Reduce Implementation of Connected Component on Apache Spark
Stars: ✭ 68 (+70%)
Mutual labels:  apache-spark, graphx
Awesome Community Detection
A curated list of community detection research papers with implementations.
Stars: ✭ 1,874 (+4585%)
Mutual labels:  community-detection, bigclam
streamsx.kafka
Repository for integration with Apache Kafka
Stars: ✭ 13 (-67.5%)
Mutual labels:  apache-spark
LabelPropagation
A NetworkX implementation of Label Propagation from a "Near Linear Time Algorithm to Detect Community Structures in Large-Scale Networks" (Physical Review E 2008).
Stars: ✭ 101 (+152.5%)
Mutual labels:  community-detection
SANSA-Stack
Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/
Stars: ✭ 130 (+225%)
Mutual labels:  apache-spark
SimP-GCN
Implementation of the WSDM 2021 paper "Node Similarity Preserving Graph Convolutional Networks"
Stars: ✭ 43 (+7.5%)
Mutual labels:  graph-mining
vue-large-scale-folder-structure
Vue Js, 2 vue-cli large scale folder structure with vuex, vue-router, axios
Stars: ✭ 29 (-27.5%)
Mutual labels:  large-scale
Location-based-Restaurants-Recommendation-System
Big Data Management and Analysis Final Project
Stars: ✭ 44 (+10%)
Mutual labels:  apache-spark
net.jgp.books.spark.ch07
Spark in Action, 2nd edition - chapter 7 - Ingestion from files
Stars: ✭ 13 (-67.5%)
Mutual labels:  apache-spark
osm-parquetizer
A converter for the OSM PBFs to Parquet files
Stars: ✭ 71 (+77.5%)
Mutual labels:  apache-spark
datalake-etl-pipeline
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (-2.5%)
Mutual labels:  apache-spark
sparklygraphs
Old repo for R interface for GraphFrames
Stars: ✭ 13 (-67.5%)
Mutual labels:  apache-spark
awesome-tools
curated list of awesome tools and libraries for specific domains
Stars: ✭ 31 (-22.5%)
Mutual labels:  apache-spark
PLSC
Paddle Large Scale Classification Tools,supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, DeiT, FaceViT.
Stars: ✭ 113 (+182.5%)
Mutual labels:  large-scale
spark-twitter-sentiment-analysis
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Stars: ✭ 55 (+37.5%)
Mutual labels:  apache-spark
Sparkora
Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟
Stars: ✭ 51 (+27.5%)
Mutual labels:  apache-spark
learn-by-examples
Real-world Spark pipelines examples
Stars: ✭ 84 (+110%)
Mutual labels:  apache-spark
learning-hadoop-and-spark
Companion to Learning Hadoop and Learning Spark courses on Linked In Learning
Stars: ✭ 146 (+265%)
Mutual labels:  apache-spark
geospark
bring sf to spark in production
Stars: ✭ 53 (+32.5%)
Mutual labels:  apache-spark
M-NMF
An implementation of "Community Preserving Network Embedding" (AAAI 2017)
Stars: ✭ 119 (+197.5%)
Mutual labels:  community-detection

BigCLAM-ApacheSpark

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

Score: A+

In this thesis, I provide a general view of communities and its real life applications. I introduce BigCLAM models proposed by Yang and Leskovec (2013), a popular model is used overlapping community detection algorithm. In particular, I proposed a few methods convex optimization and implemented BigCLAM in Apache Spark is evaluated as lightning-fast cluster computing to able detect community in the large-scale networks.

Figure 1-1

Figure 1-2

Contact:[email protected]

Every comment would be appreciated.

If you want to use parts of any code of mine:

let me know and use it!

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].