hydra-zen
A library that facilitates configurable, reproducible, and scalable workflows, using Hydra.
Check out our documentation for more information.
Interested in machine learning? Check out our guide for using PyTorch Lightning with hydra-zen.
hydra-zen is a Python library that simplifies the process of writing code (research-grade or production-grade) that is:
- Configurable: you can configure all aspects of your code from a single interface (the command line or a single Python function).
- Repeatable: each run of your code will be self-documenting; the full configuration of your software is saved alongside your results.
- Scalable: launch multiple runs of your software, be it on your local machine or across multiple nodes on a cluster.
It builds off – and is fully compatible with – Hydra, a framework for elegantly configuring complex applications. hydra-zen helps simplify the process of using Hydra by providing specialized functions for creating configs and launching Hydra jobs. Please refer to our documentation for examples and more details.
Installation
hydra-zen is lightweight: its only dependencies are hydra-core and typing-extensions.
pip install hydra-zenContributing
Before opening a PR to this repo, consider posting an issue or a discussion topic to share your ideas with us. We will work with you to ensure your feature is well-scoped and that your hard work goes to good use.
(See an obvious bug or typo? Go ahead and just open a PR :) )
For further details refer to these docs.
Join the Discussion
Share ideas, ask questions, and chat with us over at hydra-zen's discussion board.
Citation
Using hydra-zen for your research? Please cite the following publication:
@article{soklaski2022tools,
title={Tools and Practices for Responsible AI Engineering},
author={Soklaski, Ryan and Goodwin, Justin and Brown, Olivia and Yee, Michael and Matterer, Jason},
journal={arXiv preprint arXiv:2201.05647},
year={2022}
}
Disclaimer
DISTRIBUTION STATEMENT A. Approved for public release: distribution unlimited.
© 2023 MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Subject to FAR 52.227-11 – Patent Rights – Ownership by the Contractor (May 2014)
SPDX-License-Identifier: MIT
This material is based upon work supported by the Under Secretary of Defense for Research and Engineering under Air Force Contract No. FA8702-15-D-0001. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Under Secretary of Defense for Research and Engineering.
A portion of this research was sponsored by the United States Air Force Research Laboratory and the United States Air Force Artificial Intelligence Accelerator and was accomplished under Cooperative Agreement Number FA8750-19-2-1000. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the United States Air Force or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein.
The software/firmware is provided to you on an As-Is basis