168 Open source projects that are alternatives of or similar to BigCLAM-ApacheSpark

A curated list of community detection research papers with implementations.

Map Reduce Implementation of Connected Component on Apache Spark

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.

A recommender system for discovering GitHub repos, built with Apache Spark

Apache Spark™ and Scala Workshops

Repository for integration with Apache Kafka

Profile and monitor your ML data pipeline end-to-end

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

Implementation of the WSDM 2021 paper "Node Similarity Preserving Graph Convolutional Networks"

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Vue Js, 2 vue-cli large scale folder structure with vuex, vue-router, axios

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Big Data Management and Analysis Final Project

📚 Various cheatsheets in PDF

A NetworkX implementation of Label Propagation from a "Near Linear Time Algorithm to Detect Community Structures in Large-Scale Networks" (Physical Review E 2008).

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Astronomy Broker based on Apache Spark

Apache Spark on AWS Lambda

Old repo for R interface for GraphFrames

Project for James' Apache Spark with Scala course

A connector for Apache Spark to access Exasol

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

The Internals of Spark SQL

curated list of awesome tools and libraries for specific domains

Infrastructures™ for Machine Learning Training/Inference in Production.

Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, DeiT, FaceViT.

pyspark methods to enhance developer productivity 📣 👯 🎉

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Notes on Apache Spark (pyspark)

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

Train and run Pytorch models on Apache Spark.

Real-world Spark pipelines examples

Apache Spark Connector for Azure Cosmos DB

bring sf to spark in production

A Spark Atlas connector to track data lineage in Apache Atlas

Implementation of the KDD 2020 paper "Graph Structure Learning for Robust Graph Neural Networks"

Fundamentals of Spark with Python (using PySpark), code examples

Spark in Action, 2nd edition - chapter 7 - Ingestion from files

Simple windows desktop application for viewing & querying Apache Parquet files

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

A visual ETL development and debugging tool for big data

A converter for the OSM PBFs to Parquet files

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

A NetworkX implementation of "Ego-splitting Framework: from Non-Overlapping to Overlapping Clusters" (KDD 2017).

Use the TPC-DS benchmark to test Spark SQL performance

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Griffon Data Science Virtual Machine

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

Apache Spark docker image

No description or website provided.

An implementation of "Community Preserving Network Embedding" (AAAI 2017)

复杂网络社区发现算法、评价指标、常用数据集整理

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.