pytorch
is it okay to calculate loss in cpu and backpropagate in torch?
When using torch, while it is common to run the network in gpu, I wasn’t always so sure if it was mandatory for me to calculate the loss on the same gpu as the output Read more…
deep learning
paper review: “High-Performance Large-Scale Image Recognition Without Normalization”
arxiv: https://arxiv.org/pdf/2102.06171v1.pdf key points introduce NF nets which combines multiple ideas to avoid using batch norm to get on-par performance but along with just using a bunch of non-BN techniques, this paper introduces adaptive gradient Read more…
Uncategorized
gitignore ignore config files except sample config file
I usually keep my configuration files under a directory named config but I don’t want these config files to be tracked by git. However, I do place a sample configuration file which I wish to Read more…