All Categories → No Category → cosine-annealing

Top 2 cosine-annealing open source projects

Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks" https://arxiv.org/abs/1506.01186 for PyTorch framework

✭ 130

python scheduler clr optimizer pytorch restarts triangular adamw cosine-annealing cyclical-learning-rate adamw-optimizer

word2vec-pytorch

Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling

✭ 145

python word2vec pytorch skipgram wordembeddings sub-sampling negative-sampling cosine-annealing

1-2 of 2 cosine-annealing projects