All Categories → No Category → map-reduce

Top 10 map-reduce open source projects

A search engine which can hold 100 trillion lines of log data.

✭ 1,793

go java Roff Protocol Buffer shell Makefile big-data search-engine map-reduce poseidon

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

✭ 2,949

go Yacc distributed-systems distributed-computing map-reduce

data-parallelism

juliafolds.github.io/data-parallelism/

✭ 22

julia CSS HTML Makefile high-performance parallel distributed-computing map-reduce iterators transducers franklin

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

✭ 54

python workflow data-science spark pandas map-reduce business-intelligence olap data-wrangling data-preprocessing feature-engineering data-processing data-preparation

Fast & furious GroupBy operations for dask.array

✭ 42

python xarray map-reduce dask

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

✭ 66

python c big-data mpi map-reduce

The core parallel and shared memory library used by Hack, Flow, and Pyre

✭ 39

ocaml c parallel map-reduce shared-memory

future.mapreduce

[EXPERIMENTAL] R package: future.mapreduce - Utility Functions for Future Map-Reduce API Packages

✭ 12

r package map-reduce futures

Open source implementation of the SOQL.

✭ 15

typescript javascript library sql dml map-reduce query-engine resolvers soql object-query graph-query

Data-parallelism on CUDA using Transducers.jl and for loops (FLoops.jl)

✭ 48

julia Makefile gpu high-performance parallel cuda map-reduce iterators transducers

1-10 of 10 map-reduce projects