kubernetes-sigs / Kube Batch
Licence: apache-2.0
A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
Programming Languages
go 31211 projects - #10 most used programming language
Projects that are alternatives of or similar to Kube Batch
VolcanoA Cloud Native Batch System (Project under CNCF)
Stars: ✭ 2,114 (+162.94%)
Mutual labels: bigdata, hpc
Su2SU2: An Open-Source Suite for Multiphysics Simulation and Design
Stars: ✭ 731 (-9.08%)
Mutual labels: hpc
BigsliceA serverless cluster computing system for the Go programming language
Stars: ✭ 469 (-41.67%)
Mutual labels: bigdata
CromwellScientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
Stars: ✭ 655 (-18.53%)
Mutual labels: hpc
Easylambdadistributed dataflows with functional list operations for data processing with C++14
Stars: ✭ 475 (-40.92%)
Mutual labels: hpc
MfemLightweight, general, scalable C++ library for finite element methods
Stars: ✭ 667 (-17.04%)
Mutual labels: hpc
Bigdataie大数据博客、笔试题、教程、项目、面经的整理
Stars: ✭ 445 (-44.65%)
Mutual labels: bigdata
GearpumpLightweight real-time big data streaming engine over Akka
Stars: ✭ 745 (-7.34%)
Mutual labels: bigdata
RaftlibThe RaftLib C++ library, streaming/dataflow concurrency via C++ iostream-like operators
Stars: ✭ 717 (-10.82%)
Mutual labels: hpc
VkfftVulkan Fast Fourier Transform library
Stars: ✭ 594 (-26.12%)
Mutual labels: hpc
BigartmFast topic modeling platform
Stars: ✭ 563 (-29.98%)
Mutual labels: bigdata
CdsData syncing in golang for ClickHouse.
Stars: ✭ 501 (-37.69%)
Mutual labels: bigdata
UcxUnified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
Stars: ✭ 471 (-41.42%)
Mutual labels: hpc
Future🚀 R package: future: Unified Parallel and Distributed Processing in R for Everyone
Stars: ✭ 735 (-8.58%)
Mutual labels: hpc
TensorbaseTensorBase BE is building a high performance, cloud neutral bigdata warehouse for SMEs fully in Rust.
Stars: ✭ 440 (-45.27%)
Mutual labels: bigdata
OhpcOpenHPC Integration, Packaging, and Test Repo
Stars: ✭ 544 (-32.34%)
Mutual labels: hpc
Coding Now学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等
Stars: ✭ 750 (-6.72%)
Mutual labels: bigdata
Spark Movie LensAn on-line movie recommender using Spark, Python Flask, and the MovieLens dataset
Stars: ✭ 745 (-7.34%)
Mutual labels: bigdata
kube-batch
kube-batch is a batch scheduler for Kubernetes, providing mechanisms for applications which would like to run batch jobs leveraging Kubernetes. It builds upon a decade and a half of experience on running batch workloads at scale using several systems, combined with best-of-breed ideas and practices from the open source community.
Refer to tutorial on how to use kube-batch to run batch job in Kubernetes.
Overall Architecture
The following figure describes the overall architecture and scope of kube-batch; the out-of-scope part is going to be handled by other projects, e.g. Volcano
Who uses kube-batch?
As the kube-batch Community grows, we'd like to keep track of our users. Please send a PR with your organization name.
Currently officially using kube-batch:
- Kubeflow
- Volcano
- Baidu Inc
- TuSimple
- MOGU Inc
- Vivo
Community, discussion, contribution, and support
Learn how to engage with the Kubernetes community on the community page.
You can reach the maintainers of this project at:
Code of conduct
Participation in the Kubernetes community is governed by the Kubernetes Code of Conduct.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at
[email protected].
