cosine annealing

Published by admin on

good simple explanation and figure: https://www.kaggle.com/residentmario/cosine-annealed-warm-restart-learning-schedulers

Categories: deep learning
Tags:

0 Comments

Leave a Reply

Your email address will not be published.

Related Posts

deep learning

good summary on torch optim schedulers

https://sanghyu.tistory.com/113

deep learning

paper summary: “Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization”

arxiv: https://arxiv.org/pdf/1703.06868.pdf key points arbitrary style transfer in real time use adaptive instance normalization(AdaIN) layers which aligns the mean and variance of content features allows to control content-style trade-off, style interpolation, color/spatial control previous works optimization Read more…

deep learning

few shot learning good articles

https://towardsdatascience.com/advances-in-few-shot-learning-a-guided-tour-36bc10a68b77 great brief summary over matching networks, prototypical networks, model-agnostic meta-learning(MAML). well, the first two topics are well explained but MAML section needs a lot more thinking to understand. Also, I think MAML is closer Read more…