pyspark-algorithmsPySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2
Stars: ✭ 72 (-73.72%)
dlsaDistributed least squares approximation (dlsa) implemented with Apache Spark
Stars: ✭ 25 (-90.88%)
Data Algorithms Book MapReduce, Spark, Java, and Scala for Data Algorithms Book
Stars: ✭ 949 (+246.35%)
big dataA collection of tutorials on Hadoop, MapReduce, Spark, Docker
Stars: ✭ 34 (-87.59%)
Spark With PythonFundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-45.26%)
future.batchtools🚀 R package future.batchtools: A Future API for Parallel and Distributed Processing using batchtools
Stars: ✭ 77 (-71.9%)
dtailDTail is a distributed DevOps tool for tailing, grepping, catting logs and other text files on many remote machines at once.
Stars: ✭ 112 (-59.12%)
dicodileExperiments for "Distributed Convolutional Dictionary Learning (DiCoDiLe): Pattern Discovery in Large Images and Signals"
Stars: ✭ 15 (-94.53%)
karKAR: A Runtime for the Hybrid Cloud
Stars: ✭ 18 (-93.43%)
serverHashtopolis - A Hashcat wrapper for distributed hashcracking
Stars: ✭ 954 (+248.18%)
ODSC India 2018My presentation at ODSC India 2018 about Deep Learning with Apache Spark
Stars: ✭ 26 (-90.51%)
pyspark-cheatsheetPySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
Stars: ✭ 115 (-58.03%)
frovedisFramework of vectorized and distributed data analytics
Stars: ✭ 59 (-78.47%)
SciFlowScientific workflow management
Stars: ✭ 49 (-82.12%)
spark-extensionA library that provides useful extensions to Apache Spark and PySpark.
Stars: ✭ 25 (-90.88%)
bloomfilterBloomfilter written in Golang, includes rotation and RPC
Stars: ✭ 61 (-77.74%)
DataEngineeringThis repo contains commands that data engineers use in day to day work.
Stars: ✭ 47 (-82.85%)
kuwalaKuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…
Stars: ✭ 474 (+72.99%)
easyFLAn experimental platform to quickly realize and compare with popular centralized federated learning algorithms. A realization of federated learning algorithm on fairness (FedFV, Federated Learning with Fair Averaging, https://fanxlxmu.github.io/publication/ijcai2021/) was accepted by IJCAI-21 (https://www.ijcai.org/proceedings/2021/223).
Stars: ✭ 104 (-62.04%)
infantryRun MapReduce in user's browser.
Stars: ✭ 14 (-94.89%)
DevOpsDevOps code to deploy eScience services
Stars: ✭ 19 (-93.07%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-59.49%)
mobiusMobius is an AI infra platform including realtime computing and training.
Stars: ✭ 22 (-91.97%)
st-hadoopST-Hadoop is an open-source MapReduce extension of Hadoop designed specially to analyze your spatio-temporal data efficiently
Stars: ✭ 17 (-93.8%)
interbitTo the end of servers
Stars: ✭ 23 (-91.61%)
incubator-linkisLinkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.
Stars: ✭ 2,459 (+797.45%)
CipherComputeThe free EAP version of the Cosmian Collaborative Confidential Computing platform. Try it!
Stars: ✭ 20 (-92.7%)
swarm-learningA simplified library for decentralized, privacy preserving machine learning
Stars: ✭ 142 (-48.18%)
kafka-compose🎼 Docker compose files for various kafka stacks
Stars: ✭ 32 (-88.32%)
lineageGenerate beautiful documentation for your data pipelines in markdown format
Stars: ✭ 16 (-94.16%)
Charm4pyParallel Programming with Python and Charm++
Stars: ✭ 259 (-5.47%)
optimism-v2ARCHIVE of monorepo implementing Boba, an L2 Compute solution built on Optimistic Ethereum - active repo is at https://github.com/bobanetwork/boba
Stars: ✭ 34 (-87.59%)
mapreduceA in-process MapReduce library to help you optimizing service response time or concurrent task processing.
Stars: ✭ 93 (-66.06%)
SadlyDistributedDistributing your code(soul), in almost any language(state), among a cluster of idle browsers(voids)
Stars: ✭ 20 (-92.7%)
QCFractalA distributed compute and database platform for quantum chemistry.
Stars: ✭ 107 (-60.95%)
PFL-Non-IIDThe origin of the Non-IID phenomenon is the personalization of users, who generate the Non-IID data. With Non-IID (Not Independent and Identically Distributed) issues existing in the federated learning setting, a myriad of approaches has been proposed to crack this hard nut. In contrast, the personalized federated learning may take the advantage…
Stars: ✭ 58 (-78.83%)
distexDistributed process pool for Python
Stars: ✭ 101 (-63.14%)
basinBasin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
Stars: ✭ 25 (-90.88%)
realtimemap-dotnetA showcase for Proto.Actor - an ultra-fast distributed actors solution for Go, C#, and Java/Kotlin.
Stars: ✭ 47 (-82.85%)
IoTPyPython for streams
Stars: ✭ 24 (-91.24%)
sparklanesA lightweight data processing framework for Apache Spark
Stars: ✭ 17 (-93.8%)
Prime95Prime95 source code from GIMPS to find Mersenne Prime.
Stars: ✭ 25 (-90.88%)
connected-componentMap Reduce Implementation of Connected Component on Apache Spark
Stars: ✭ 68 (-75.18%)
jobAnalytics and searchJobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.
Stars: ✭ 25 (-90.88%)
protoactor-goProto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
Stars: ✭ 4,138 (+1410.22%)
blockchain-reading-listA reading list on blockchain and related technologies, targeted at technical people who want a deep understanding of those topics.
Stars: ✭ 93 (-66.06%)
GleamFast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
Stars: ✭ 2,949 (+976.28%)