Top 2 warmup open source projects

Radam
On the Variance of the Adaptive Learning Rate and Beyond
pytorch-lr-scheduler
PyTorch implementation of some learning rate schedulers for deep learning researcher.
1-2 of 2 warmup projects