All Projects → spotify → Pythonflow

spotify / Pythonflow

Licence: apache-2.0
🐍 Dataflow programming for python.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Pythonflow

Goflow
Flow-based and dataflow programming library for Go (golang)
Stars: ✭ 1,276 (+493.49%)
Mutual labels:  dataflow
Msgflo
Distributed Flow-Based Programming via message queues
Stars: ✭ 136 (-36.74%)
Mutual labels:  dataflow
Pyt
A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications
Stars: ✭ 2,061 (+858.6%)
Mutual labels:  dataflow
Gcp Variant Transforms
GCP Variant Transforms
Stars: ✭ 100 (-53.49%)
Mutual labels:  dataflow
Event Gateway
React to any event with serverless functions across clouds
Stars: ✭ 1,604 (+646.05%)
Mutual labels:  dataflow
Umbrella
"A collection of functional programming libraries that can be composed together. Unlike a framework, thi.ng is a suite of instruments and you (the user) must be the composer of. Geared towards versatility, not any specific type of music." — @loganpowell via Twitter
Stars: ✭ 2,186 (+916.74%)
Mutual labels:  dataflow
Google Cloud Eclipse
Google Cloud Platform plugin for Eclipse
Stars: ✭ 75 (-65.12%)
Mutual labels:  dataflow
Vue Blocks
Vue2 dataflow graph editor
Stars: ✭ 201 (-6.51%)
Mutual labels:  dataflow
Flowbase
A Flow-based Programming inspired micro-framework / un-framework for Go (Golang)
Stars: ✭ 129 (-40%)
Mutual labels:  dataflow
Nipyapi
A convenient Python wrapper for Apache NiFi
Stars: ✭ 169 (-21.4%)
Mutual labels:  dataflow
Derivatives
🌱 Your companion to create derived values from a single source (atom)
Stars: ✭ 101 (-53.02%)
Mutual labels:  dataflow
Chamber
🔮 Simplifies sharing fields and communication between Android components with custom scopes that are lifecycle aware.
Stars: ✭ 106 (-50.7%)
Mutual labels:  dataflow
Embb
Embedded Multicore Building Blocks (EMB²): Library for parallel programming of embedded systems. Star us on GitHub? +1
Stars: ✭ 153 (-28.84%)
Mutual labels:  dataflow
Nextflow
A DSL for data-driven computational pipelines
Stars: ✭ 1,337 (+521.86%)
Mutual labels:  dataflow
Scio
A Scala API for Apache Beam and Google Cloud Dataflow.
Stars: ✭ 2,247 (+945.12%)
Mutual labels:  dataflow
Intelmq Manager
IntelMQ Manager is a graphical interface to manage configurations for IntelMQ framework.
Stars: ✭ 81 (-62.33%)
Mutual labels:  dataflow
Nn dataflow
Explore the energy-efficient dataflow scheduling for neural networks.
Stars: ✭ 141 (-34.42%)
Mutual labels:  dataflow
Microflo
Live dataflow programming for microcontrollers and embedded
Stars: ✭ 207 (-3.72%)
Mutual labels:  dataflow
Azure Services Map
A visual representation and reference to Azure services
Stars: ✭ 189 (-12.09%)
Mutual labels:  dataflow
Blocks.js
JavaScript dataflow graph editor
Stars: ✭ 165 (-23.26%)
Mutual labels:  dataflow

Pythonflow: Dataflow programming for python. Build Status Documentation Status

Pythonflow is a simple implementation of dataflow programming for python. Users of Tensorflow will immediately be familiar with the syntax.

At Spotify, we use Pythonflow in data preprocessing pipelines for machine learning models because

  • it automatically caches computationally expensive operations,
  • any part of the computational graph can be easily evaluated for debugging purposes,
  • it allows us to distribute data preprocessing across multiple machines.

See the documentation for details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].