When using torch, while it is common to run the network in gpu, I wasn’t always so sure if it was mandatory for me to calculate the loss on the same gpu as the output at all times. If I Read more…
arxiv: https://arxiv.org/pdf/2102.06171v1.pdf key points introduce NF nets which combines multiple ideas to avoid using batch norm to get on-par performance but along with just using a bunch of non-BN techniques, this paper introduces adaptive gradient clipping(AGC) to make it actually Read more…
I usually keep my configuration files under a directory named config but I don’t want these config files to be tracked by git. However, I do place a sample configuration file which I wish to be tracked by git. Normally, Read more…
I am relatively new to postgres and at first I was backing up and restoring databases using pgadmin4. I was just using postgres user because this is the default one that you get to use when working with pgadmin. After Read more…
here is the sample code for drawing a single axis in a figure. The above is the result. I have tried to create several subplots and add heatmap to each one with individual colorbars on its side, but it seems Read more…
arxiv: https://arxiv.org/abs/1803.01534
this paper propose a network structure(“PANet”) with bottom up path augmentation and a few other tweak methods which results in better instance segmentation performance.
(more…)arxiv: https://arxiv.org/pdf/1807.06521.pdf
trying to attach attention module to CNN. but instead of blindly attaching it which would compute a 3D attention map which is computationally expensive, this work proposes to compute spatial attention and channel attention separately which achieves a similar effect with much less parameters.
(more…)arxiv: https://arxiv.org/abs/1406.4729
pools a fixed number of features from final feature map of backbone which can be fed to the dense layer afterwards, thus allowing network to work in a non-fixed input size manner.
(more…)arxiv: https://arxiv.org/abs/2003.12294
this approach will try to take global context into account by adopting transformer, and also use similar structure to reason semantic content.
(more…)