All Projects → dspinellis → Dgsh

dspinellis / Dgsh

Licence: other
Shell supporting pipelines to and from multiple processes

Programming Languages

c
50402 projects - #5 most used programming language
shell
77523 projects

Projects that are alternatives of or similar to Dgsh

bash-streams-handbook
💻 Learn Bash streams, pipelines and redirection, from beginner to advanced.
Stars: ✭ 153 (-41.38%)
Mutual labels:  unix, pipeline
Unix Stream
Turn Java 8 Streams into Unix like pipelines
Stars: ✭ 119 (-54.41%)
Mutual labels:  pipeline, unix
kirai
String formatting library for Java, Android, Web and Unix Terminal
Stars: ✭ 69 (-73.56%)
Mutual labels:  unix
pyrealtime
Realtime data processing and plotting pipelines in Python
Stars: ✭ 62 (-76.25%)
Mutual labels:  pipeline
godot-exporter
Godot Engine Automation Pipeline Android – iOS – Linux – MacOS – Windows – HTML5 – Itch.io.
Stars: ✭ 54 (-79.31%)
Mutual labels:  pipeline
CSpydr
A static typed low-level compiled programming language inspired by Rust and C
Stars: ✭ 17 (-93.49%)
Mutual labels:  unix
ploio
Safe, Reliable, and Fast Production Deployments for Kubernetes
Stars: ✭ 11 (-95.79%)
Mutual labels:  pipeline
pipeline-editor
Cloud Pipelines Editor is a web app that allows the users to build and run Machine Learning pipelines without having to set up development environment.
Stars: ✭ 22 (-91.57%)
Mutual labels:  pipeline
Ricing
a book about ricing unix-like systems
Stars: ✭ 257 (-1.53%)
Mutual labels:  unix
basin
Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
Stars: ✭ 25 (-90.42%)
Mutual labels:  pipeline
autoconf-archive
A mirror of the GNU Autoconf Archive, a collection of more than 500 macros for GNU Autoconf that have been contributed as free software by friendly supporters of the cause from all over the Internet.
Stars: ✭ 70 (-73.18%)
Mutual labels:  unix
4bsd-uucp
Simulate a UUCP network with 4.3BSD SimH images
Stars: ✭ 28 (-89.27%)
Mutual labels:  unix
re-mote
Re-mote operations using SSH and Re-gent
Stars: ✭ 61 (-76.63%)
Mutual labels:  pipeline
cli-property-manager
Use this Property Manager CLI to automate Akamai property changes and deployments across many environments.
Stars: ✭ 22 (-91.57%)
Mutual labels:  pipeline
dotfiles
🗂 ~josh
Stars: ✭ 19 (-92.72%)
Mutual labels:  unix
kedro
A Python framework for creating reproducible, maintainable and modular data science code.
Stars: ✭ 6,068 (+2224.9%)
Mutual labels:  pipeline
uapi
Unix API
Stars: ✭ 18 (-93.1%)
Mutual labels:  unix
cam-track
Windows, Unix, Raspberry Pi Computer python program to Track Camera X, Y Movements and Convert to Camera Pointing Position. Useful for Stabilization or Robotics Course Correction
Stars: ✭ 27 (-89.66%)
Mutual labels:  unix
latent-semantic-analysis
Pipeline for training LSA models using Scikit-Learn.
Stars: ✭ 20 (-92.34%)
Mutual labels:  pipeline
Unix History Make
Code and data to create a git repository representing the Unix source code history
Stars: ✭ 258 (-1.15%)
Mutual labels:  unix

The Directed Graph Shell (dgsh)

Build Status

The directed graph shell, dgsh, allows the expressive expression of efficient big data set and streams processing pipelines using existing Unix tools as well as custom-built components. It is a Unix-style shell allowing the specification of pipelines with non-linear scatter-gather operations. These form a directed acyclic process graph, which is typically executed by multiple processor cores, thus increasing the operation's processing throughput.

You can find a complete introduction, reference documentation, and illustrated examples in the suite's web site.

See also, a quick video overview and the associated (open access) paper, Extending Unix pipelines to DAGs, published in the IEEE Transactions on Computers, 66(9):1547–1561, 2017.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].