cosine annealing
good simple explanation and figure: https://www.kaggle.com/residentmario/cosine-annealed-warm-restart-learning-schedulers
good simple explanation and figure: https://www.kaggle.com/residentmario/cosine-annealed-warm-restart-learning-schedulers