WeBankFinTech / Schedulis
Licence: apache-2.0
Schedulis is a high performance workflow task scheduling system that supports high availability and multi-tenant financial level features, Linkis computing middleware, and has been integrated into data application development portal DataSphere Studio
Stars: ✭ 222
Programming Languages
java
68154 projects - #9 most used programming language
Projects that are alternatives of or similar to Schedulis
bitnami-docker-airflow-scheduler
Bitnami Docker Image for Apache Airflow Scheduler
Stars: ✭ 19 (-91.44%)
Mutual labels: workflow, scheduler
Aiida Core
The official repository for the AiiDA code
Stars: ✭ 238 (+7.21%)
Mutual labels: scheduler, workflow
Powerjob
Enterprise job scheduling middleware with distributed computing ability.
Stars: ✭ 3,231 (+1355.41%)
Mutual labels: scheduler, workflow
Dagster
An orchestration platform for the development, production, and observation of data assets.
Stars: ✭ 4,099 (+1746.4%)
Mutual labels: scheduler, workflow
Airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Stars: ✭ 24,101 (+10756.31%)
Mutual labels: scheduler, workflow
Active workflow
Turn complex requirements to workflows without leaving the comfort of your technology stack.
Stars: ✭ 413 (+86.04%)
Mutual labels: scheduler, workflow
Wexflow
An easy and fast way to build automation and workflows on Windows, Linux, macOS, and the cloud.
Stars: ✭ 2,435 (+996.85%)
Mutual labels: scheduler, workflow
Crython
Lightweight task scheduler using cron expressions
Stars: ✭ 197 (-11.26%)
Mutual labels: scheduler
Litegraph.js
A graph node engine and editor written in Javascript similar to PD or UDK Blueprints, comes with its own editor in HTML5 Canvas2D. The engine can run client side or server side using Node. It allows to export graphs as JSONs to be included in applications independently.
Stars: ✭ 2,735 (+1131.98%)
Mutual labels: workflow
Threadly
A library of tools to assist with safe concurrent java development. Providing unique priority based thread pools, and ways to distrbute threaded work safely.
Stars: ✭ 196 (-11.71%)
Mutual labels: scheduler
Zeebe Modeler
Desktop Application for modeling Zeebe Workflows with BPMN
Stars: ✭ 198 (-10.81%)
Mutual labels: workflow
Bit
A tool for component-driven application development.
Stars: ✭ 14,443 (+6405.86%)
Mutual labels: workflow
Alfred Workflow
Full-featured library for writing Alfred 3 & 4 workflows
Stars: ✭ 2,622 (+1081.08%)
Mutual labels: workflow
Quartzite
Quarzite is a thin idiomatic Clojure layer on top the Quartz Scheduler
Stars: ✭ 194 (-12.61%)
Mutual labels: scheduler
Plynx
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
Stars: ✭ 192 (-13.51%)
Mutual labels: workflow
Pallets
Simple and reliable workflow engine, written in Ruby
Stars: ✭ 216 (-2.7%)
Mutual labels: workflow
Sfdx Mass Action Scheduler
🚀 Declaratively schedule Process Builder, Flows, Quick Actions, Email Alerts, Workflow Rules, or Apex to process records from Reports, List Views, SOQL, or Apex.
Stars: ✭ 200 (-9.91%)
Mutual labels: scheduler
简介
Schedulis 是一个基于 LinkedIn 的开源项目 Azkaban 开发的工作流任务调度系统。该调度系统具备高性能,高可用(去中心化多调度中心和多执行器)和多租户资源隔离等金融级特性;现已被集成到数据应用开发门户 DataSphere Studio。
Schedulis 支持常规的 Command Shell 和 Linkis(HadoopMR、 Hive、Spark、Sqoop、 Python)大数据任务;同时还支持特色的数据检查和工作流之间的依赖任务;支持完善的告警和工作流执行策略;提供多种类型的参数设置,动态全局变量和简单易用的 UI。
与 DataSphere Studio 和 Linkis 的对接
DataSphere Studio 可以将编辑好的工作流一键发布到 Schedulis 进行调度,而 Schedulis 也实现了 Linkis 插件,用于向 Linkis 提交任务,这样使得 Schedulis 与 DataSphere Studio 和 Linkis 能够无缝衔接,从而实现数据应用开发全流程的连贯顺滑用户体验。
与业界现有调度系统的比较
下面将 Schedulis 和业界现有的调度系统做了个对比,包括:Azkaban, Airflow 和 Xxl-job
模块 | 描述 | Schedulis | Azkaban | Airflow | Xxl-job |
---|---|---|---|---|---|
HA | 调度中心高可用 | 支持 | 不支持 | 不支持 | 支持 |
资源管理 | 执行节点多租户 | 支持 | 不支持 | 不支持 | 不支持 |
运行视图 | 工作流结构图(DAG) | 清晰显示任务状态,任务类型,工作流状态,重试次数等关键信息 | 只显示工作流和任务状态 | 只显示任务状态 | 只显示任务状态 |
WeDataSphere整合 | 对DataSphere Studio和Linkis的支持 | 与DSS和Linkis无缝对接 | 不支持 | 不支持 | 不支持 |
特色功能 | 循环执行 | 支持 | 不支持 | 不支持 | 不支持 |
灵活的工作流参数 | 支持不同级别多种设置方式的工作流参数 | 不支持 | 不支持 | 不支持 | |
hive表数据到达检查 | 支持 | 不支持 | 不支持 | 不支持 | |
工作流之间交互依赖 | 支持 | 不支持 | 不支持 | 不支持 | |
失败策略 | 支持任务失败暂停、跳过、重试、超时处理 |
不支持失败策略 |
支持部分任务重跑策略 |
支持任务超时处理和失败重试 |
|
系统管理 | 用户管理 | 支持 | 不支持 | 支持 | 不支持 |
界面预览
架构设计
文档列表
Communication
如果您想得到最快的响应,请给我们提 issue,或者扫码进群:
License
Schedulis is under the Apache 2.0 License. See the License file for details.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].