GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → argoproj → Argo Workflows

argoproj / Argo Workflows

Licence: apache-2.0
Workflow engine for Kubernetes

Programming Languages

go
31211 projects - #10 most used programming language
typescript
32286 projects
Makefile
30231 projects
SCSS
7915 projects
shell
77523 projects
python
139335 projects - #7 most used programming language

Labels

machine-learningkubernetesworkflowworkflow-engineairflowdagcncfargok8scloud-nativehacktoberfestknativeargo-workflows

Projects that are alternatives of or similar to Argo Workflows

Xene
A distributed workflow runner focusing on performance and simplicity.
Stars: ✭ 56 (-99.44%)
Mutual labels:  dag, workflow-engine, airflow, workflow
Workflows
Run Cloud Native workflows on any environment using Dapr
Stars: ✭ 84 (-99.16%)
Mutual labels:  workflow-engine, workflow, cloud-native
Kubesphere
The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️
Stars: ✭ 8,315 (-17.05%)
Mutual labels:  cncf, k8s, cloud-native
Kogito Examples
Kogito examples - Kogito is a cloud-native business automation technology for building cloud-ready business applications.
Stars: ✭ 96 (-99.04%)
Mutual labels:  workflow-engine, workflow, cloud-native
Kogito Runtimes
Kogito Runtimes - Kogito is a cloud-native business automation technology for building cloud-ready business applications.
Stars: ✭ 188 (-98.12%)
Mutual labels:  workflow-engine, workflow, cloud-native
Kruise
Automate application management on Kubernetes (project under CNCF)
Stars: ✭ 2,819 (-71.88%)
Mutual labels:  cncf, k8s, cloud-native
siddhi-operator
Operator allows you to run stream processing logic directly on a Kubernetes cluster
Stars: ✭ 16 (-99.84%)
Mutual labels:  cncf, k8s, cloud-native
Airflow Maintenance Dags
A series of DAGs/Workflows to help maintain the operation of Airflow
Stars: ✭ 914 (-90.88%)
Mutual labels:  dag, airflow, workflow
Kube Scan
kube-scan: Octarine k8s cluster risk assessment tool
Stars: ✭ 566 (-94.35%)
Mutual labels:  k8s, cloud-native
Smartflow Sharp
基于C#语言研发的Smartflow-Sharp工作流组件，该工作流组件的特点是简单易用、方便扩展、支持多种数据库访问、高度可定制化，支持用户按需求做功能的定制开发，节省用户的使用成本
Stars: ✭ 594 (-94.07%)
Mutual labels:  workflow-engine, workflow
Dragonfly
Dragonfly is an intelligent P2P based image and file distribution system.
Stars: ✭ 5,720 (-42.94%)
Mutual labels:  cncf, cloud-native
Nexclipper
Metrics Pipeline for interoperability and Enterprise Prometheus
Stars: ✭ 533 (-94.68%)
Mutual labels:  cncf, cloud-native
Prefect
The easiest way to automate your data
Stars: ✭ 7,956 (-20.63%)
Mutual labels:  workflow-engine, workflow
Django River
Django workflow library that supports on the fly changes ⛵
Stars: ✭ 609 (-93.92%)
Mutual labels:  workflow-engine, workflow
Networkservicemesh
The Hybrid/Multi-cloud IP Service Mesh
Stars: ✭ 456 (-95.45%)
Mutual labels:  cncf, cloud-native
Ngx Graph
Graph visualization library for angular
Stars: ✭ 704 (-92.98%)
Mutual labels:  dag, workflow
Airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Stars: ✭ 24,101 (+140.43%)
Mutual labels:  airflow, workflow
Sig Security
🔐CNCF Special Interest Group on Security -- secure access, policy control, privacy, auditing, explainability and more!
Stars: ✭ 662 (-93.4%)
Mutual labels:  cncf, cloud-native
Openyurt
OpenYurt - Extending your native Kubernetes to edge(project under CNCF)
Stars: ✭ 750 (-92.52%)
Mutual labels:  k8s, cloud-native
Scipipe
Robust, flexible and resource-efficient pipelines using Go and the commandline
Stars: ✭ 826 (-91.76%)
Mutual labels:  workflow-engine, workflow
View All Similar Projects ➔

slack CI CII Best Practices Twitter Follow

What is Argo Workflows?

Argo Workflows is an open source container-native workflow engine for orchestrating parallel jobs on Kubernetes. Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition).

  • Define workflows where each step in the workflow is a container.
  • Model multi-step workflows as a sequence of tasks or capture the dependencies between tasks using a directed acyclic graph (DAG).
  • Easily run compute intensive jobs for machine learning or data processing in a fraction of the time using Argo Workflows on Kubernetes.

Argo is a Cloud Native Computing Foundation (CNCF) hosted project.

Argo Workflows in 5 minutes

Use Cases

  • Machine Learning pipelines
  • Data and batch processing
  • ETL
  • Infrastructure automation
  • CI/CD

Why Argo Workflows?

  • Argo Workflows is the most popular workflow execution engine for Kubernetes.
  • It can run 1000s of workflows a day, each with 1000s of concurrent tasks.
  • Our users say it is lighter-weight, faster, more powerful, and easier to use
  • Designed from the ground up for containers without the overhead and limitations of legacy VM and server-based environments.
  • Cloud agnostic and can run on any Kubernetes cluster.

Read what people said in our latest survey

Try Argo Workflows

Access the demo environment (login using Github)

Screenshot

Ecosystem

Ecosystem

Argo Events | Argo Workflows Catalog | Couler | Katib | Kedro | Kubeflow Pipelines | Onepanel | Ploomber | Seldon | SQLFlow

Client Libraries

Check out our Java, Golang and Python clients.

Quickstart

kubectl create namespace argo
kubectl apply -n argo -f https://raw.githubusercontent.com/argoproj/argo-workflows/master/manifests/install.yaml

Who uses Argo Workflows?

Official Argo Workflows user list

Documentation

Features

  • UI to visualize and manage Workflows
  • Artifact support (S3, Artifactory, Alibaba Cloud OSS, HTTP, Git, GCS, raw)
  • Workflow templating to store commonly used Workflows in the cluster
  • Archiving Workflows after executing for later access
  • Scheduled workflows using cron
  • Server interface with REST API (HTTP and GRPC)
  • DAG or Steps based declaration of workflows
  • Step level input & outputs (artifacts/parameters)
  • Loops
  • Parameterization
  • Conditionals
  • Timeouts (step & workflow level)
  • Retry (step & workflow level)
  • Resubmit (memoized)
  • Suspend & Resume
  • Cancellation
  • K8s resource orchestration
  • Exit Hooks (notifications, cleanup)
  • Garbage collection of completed workflow
  • Scheduling (affinity/tolerations/node selectors)
  • Volumes (ephemeral/existing)
  • Parallelism limits
  • Daemoned steps
  • DinD (docker-in-docker)
  • Script steps
  • Event emission
  • Prometheus metrics
  • Multiple executors
  • Multiple pod and workflow garbage collection strategies
  • Automatically calculated resource usage per step
  • Java/Golang/Python SDKs
  • Pod Disruption Budget support
  • Single-sign on (OAuth2/OIDC)
  • Webhook triggering
  • CLI
  • Out-of-the box and custom Prometheus metrics
  • Windows container support
  • Embedded widgets
  • Multiplex log viewer

Community Meetings

We host monthly community meetings where we and the community showcase demos and discuss the current and future state of the project. Feel free to join us! For Community Meeting information, minutes and recordings please see here.

Participation in the Argo Workflows project is governed by the CNCF Code of Conduct

Community Blogs and Presentations

Project Resources

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].