GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → daleroberts → pypar

daleroberts / pypar

Licence: GPL-3.0 License
Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

Programming Languages

python
139335 projects - #7 most used programming language
c
50402 projects - #5 most used programming language

Labels

big-datampimap-reduce

Projects that are alternatives of or similar to pypar

Poseidon
A search engine which can hold 100 trillion lines of log data.
Stars: ✭ 1,793 (+2616.67%)
Mutual labels:  big-data, map-reduce
pyspark-cheatsheet
PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
Stars: ✭ 115 (+74.24%)
Mutual labels:  big-data
yask
YASK--Yet Another Stencil Kit: a domain-specific language and framework to create high-performance stencil code for implementing finite-difference methods and similar applications.
Stars: ✭ 81 (+22.73%)
Mutual labels:  mpi
bftkv
A distributed key-value storage that's tolerant to Byzantine fault.
Stars: ✭ 27 (-59.09%)
Mutual labels:  big-data
fuzzball
Ongoing development of the Fuzzball MUCK server software and associated functionality.
Stars: ✭ 38 (-42.42%)
Mutual labels:  mpi
PartitionedArrays.jl
Vectors and sparse matrices partitioned into pieces for parallel distributed-memory computations.
Stars: ✭ 45 (-31.82%)
Mutual labels:  mpi
research-computing-with-cpp
UCL-RITS *C++ for Research* engineering course
Stars: ✭ 16 (-75.76%)
Mutual labels:  mpi
pytorch kmeans
Implementation of the k-means algorithm in PyTorch that works for large datasets
Stars: ✭ 38 (-42.42%)
Mutual labels:  big-data
big data
A collection of tutorials on Hadoop, MapReduce, Spark, Docker
Stars: ✭ 34 (-48.48%)
Mutual labels:  big-data
big-data-lite
Samples to the Oracle Big Data Lite VM
Stars: ✭ 41 (-37.88%)
Mutual labels:  big-data
hack parallel
The core parallel and shared memory library used by Hack, Flow, and Pyre
Stars: ✭ 39 (-40.91%)
Mutual labels:  map-reduce
dbcsr
DBCSR: Distributed Block Compressed Sparse Row matrix library
Stars: ✭ 65 (-1.52%)
Mutual labels:  mpi
EFDCPlus
www.eemodelingsystem.com
Stars: ✭ 9 (-86.36%)
Mutual labels:  mpi
PencilArrays.jl
Distributed Julia arrays using the MPI protocol
Stars: ✭ 40 (-39.39%)
Mutual labels:  mpi
tbslas
A parallel, fast solver for the scalar advection-diffusion and the incompressible Navier-Stokes equations based on semi-Lagrangian/Volume-Integral method.
Stars: ✭ 21 (-68.18%)
Mutual labels:  mpi
analisis-numerico-computo-cientifico
Análisis numérico y cómputo científico
Stars: ✭ 42 (-36.36%)
Mutual labels:  mpi
v6.dooring.public
可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.
Stars: ✭ 323 (+389.39%)
Mutual labels:  big-data
hyper-engine
Python library for Bayesian hyper-parameters optimization
Stars: ✭ 80 (+21.21%)
Mutual labels:  big-data
egis
Egis - a handy Ruby interface for AWS Athena
Stars: ✭ 38 (-42.42%)
Mutual labels:  big-data
big-sorter
Java library that sorts very large files of records by splitting into smaller sorted files and merging
Stars: ✭ 49 (-25.76%)
Mutual labels:  big-data
View All Similar Projects ➔

Logo

PyPar is a python library that provides efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

Build Status

PyPar is used by a number of large projects, such as:

Example

A simple 'pass the parcel' example.

import pypar as pp

ncpus = pp.size()
rank = pp.rank()
node = pp.get_processor_name()

print 'I am rank %d of %d on node %s' % (rank, ncpus, node)

if rank == 0:
  msg = 'P0'
  pp.send(msg, destination=1)
  msg = pp.receive(source=rank-1)
  print 'Processor 0 received message "%s" from rank %d' % (msg, rank-1)
else:
  source = rank-1
  destination = (rank+1) % ncpus
  msg = pp.receive(source)
  msg = msg + 'P' + str(rank)
  pp.send(msg, destination)

pp.finalize()
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].