All Projects → lsds → SEEP

lsds / SEEP

Licence: other
Cluster computing using Stateful Dataflow Graphs

Programming Languages

java
68154 projects - #9 most used programming language

Projects that are alternatives of or similar to SEEP

Dnai.Editor
Dnai Editor - Visual Scripting (Node Editor)
Stars: ✭ 117 (+368%)
Mutual labels:  dataflow-programming
compost
Manage lifecycle of stateful components
Stars: ✭ 15 (-40%)
Mutual labels:  stateful
mehdb
Educational Kubernetes-native NoSQL datastore using StatefulSet and persistent volumes
Stars: ✭ 22 (-12%)
Mutual labels:  stateful
NNet
algorithm for study: multi-layer-perceptron, cluster-graph, cnn, rnn, restricted boltzmann machine, bayesian network
Stars: ✭ 24 (-4%)
Mutual labels:  cluster-computing
graflow
A graph stream library for Javascript
Stars: ✭ 53 (+112%)
Mutual labels:  dataflow-programming
tutorial
Tutorials to help you build your first Swim app
Stars: ✭ 27 (+8%)
Mutual labels:  stateful
Persimmon
A visual dataflow programming language for sklearn
Stars: ✭ 174 (+596%)
Mutual labels:  dataflow-programming
PageStatusTransformer
A low invasive state management on Android
Stars: ✭ 12 (-52%)
Mutual labels:  stateful
odak
🔬 Scientific computing library for optics 🔭, computer graphics 💻 and visual perception 👀
Stars: ✭ 99 (+296%)
Mutual labels:  cluster-computing
edge-home-orchestration-go
Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.
Stars: ✭ 68 (+172%)
Mutual labels:  cluster-computing
esProc
esProc SPL is a scripting language for data processing, with well-designed rich library functions and powerful syntax, which can be executed in a Java program through JDBC interface and computing independently.
Stars: ✭ 1,257 (+4928%)
Mutual labels:  cluster-computing
osdg-tool
OSDG is an open-source tool that maps and connects activities to the UN Sustainable Development Goals (SDGs) by identifying SDG-relevant content in any text. The tool is available online at www.osdg.ai. API access available for research purposes.
Stars: ✭ 22 (-12%)
Mutual labels:  sdg
dflow
is a minimal Dataflow programming engine
Stars: ✭ 70 (+180%)
Mutual labels:  dataflow-programming
angular-webpack-material-lazyload-typescript-starter-template
Angular starter template using typescript, angular-material, ui-router, oclazyload with webpack support.
Stars: ✭ 55 (+120%)
Mutual labels:  stateful
traffic
Massively real-time traffic streaming application
Stars: ✭ 25 (+0%)
Mutual labels:  stateful
Chigraph
A visual systems language for beginners compiled using LLVM
Stars: ✭ 247 (+888%)
Mutual labels:  dataflow-programming
StatefulLiveData
StatefulLiveData is a lean, yet powerful tool that harnesses the capabilities of LiveData and enhances them, enabling the observer to distinguish between different states the data can be in, such as Success, Loading and Error.
Stars: ✭ 18 (-28%)
Mutual labels:  stateful
transit
Massively real-time city transit streaming application
Stars: ✭ 20 (-20%)
Mutual labels:  stateful
zenoh-flow
zenoh-flow aims at providing a zenoh-based data-flow programming framework for computations that span from the cloud to the device.
Stars: ✭ 27 (+8%)
Mutual labels:  dataflow-programming
ripple
Simple shared surface streaming application
Stars: ✭ 17 (-32%)
Mutual labels:  stateful
SEEP is an experimental parallel data processing system that is being developed
by the Large-Scale Distributed Systems (LSDS) research group
(http://lsds.doc.ic.ac.uk) at Imperial College London. It is licsensed under
EPL (Eclipse Public License).

The SEEP system is under heavy development and should be considered an alpha
release. This is not considered a "stable" branch.

Further details on SEEP, including papers that explain the underlying model 
can be found at the project website:
http://lsds.doc.ic.ac.uk/projects/SEEP

The SEEP system consists of two modules, the runtime system (seep-system) and a
compiler (java2sdg). Below is some information regarding how to build the
system and modules.

BUILDING:
#####################
The project follows the standard Maven directory structure, with two
differentiated modules, seep-system and seep-java2sdg.

There are two options to build the SEEP system:

Option 1, single jar (recommended) -- run:

mvn clean compile assembly:single

This produces one jar with all dependencies included.

Option 2, without dependencies -- to compile it:

mvn -DskipTests package

In this case, ensure that the classpath includes the dependencies.

You can alternatively build only individual modules, by running the same
options above inside seep-system or seep-java2sdg, respectively.

************
seep-system
************

RUNNING:
#########################
The system requires one master node and N worker nodes (one worker node per
Operator).

First set the IP address of the master node in "mainAddr" inside
config.properties and build the SEEP system.

Next run the master in the designated node:

java -jar <system.jar> Master <query.jar> <Base-class>

where query.jar is the compiled query and the last parameter is the name of 
the base class, not a path.

Finally run as many worker nodes as your query requires:

java -jar <system.jar> Worker

Local mode:

To run the SEEP system in a single local machine, append a different port to
each Worker node:

java -jar <system.jar> Worker <port>

*************
seep-java2sdg
*************

RUNNING:
###########################
It is mandatory to indicate an input program, an output file name and a target
(dot/seepjar) and the classpath to the driver program and its dependencies.
Examples: 

java -jar <java2sdg.jar> -i Driver -t dot -o myOutput -cp examples/

The above code will process input program "Driver" using the dependencies in
"examples/" to generate an output file "myOutput.dot".
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].