Chadrick's Blog

  • Posts

Posting various stuff…

pytorch

is it okay to calculate loss in cpu and backpropagate in torch?

When using torch, while it is common to run the network in gpu, I wasn’t always so sure if it was mandatory for me to calculate the loss on the same gpu as the output at all times. If I Read more…

By chadrick_author, 2 days2 days ago
deep learning

paper review: “High-Performance Large-Scale Image Recognition Without Normalization”

arxiv: https://arxiv.org/pdf/2102.06171v1.pdf key points introduce NF nets which combines multiple ideas to avoid using batch norm to get on-par performance but along with just using a bunch of non-BN techniques, this paper introduces adaptive gradient clipping(AGC) to make it actually Read more…

By chadrick_author, 2 days2 days ago
Uncategorized

gitignore ignore config files except sample config file

I usually keep my configuration files under a directory named config but I don’t want these config files to be tracked by git. However, I do place a sample configuration file which I wish to be tracked by git. Normally, Read more…

By chadrick_author, 2 weeks2 weeks ago
postgres

convert subquery columns into array of json objects

By admin, 3 weeks ago
postgres

postgres database backup and restoring

I am relatively new to postgres and at first I was backing up and restoring databases using pgadmin4. I was just using postgres user because this is the default one that you get to use when working with pgadmin. After Read more…

By admin, 3 weeks3 weeks ago
python

matplotlib draw heatmap figure with colorbar

here is the sample code for drawing a single axis in a figure. The above is the result. I have tried to create several subplots and add heatmap to each one with individual colorbars on its side, but it seems Read more…

By chadrick_author, 3 weeks3 weeks ago
deep learning

paper review: “Path Aggregation Network for Instance Segmentation”

arxiv: https://arxiv.org/abs/1803.01534

key point

this paper propose a network structure(“PANet”) with bottom up path augmentation and a few other tweak methods which results in better instance segmentation performance.

(more…)
By admin, 2 months2 months ago
deep learning

paper review: “CBAM: Convolutional Block Attention Module”

arxiv: https://arxiv.org/pdf/1807.06521.pdf

key point

trying to attach attention module to CNN. but instead of blindly attaching it which would compute a 3D attention map which is computationally expensive, this work proposes to compute spatial attention and channel attention separately which achieves a similar effect with much less parameters.

(more…)
By admin, 2 months ago
deep learning

paper review: Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

arxiv: https://arxiv.org/abs/1406.4729

key points

pools a fixed number of features from final feature map of backbone which can be fed to the dense layer afterwards, thus allowing network to work in a non-fixed input size manner.

(more…)
By admin, 2 months ago
deep learning

paper review: Towards Accurate Scene Text Recognition with Semantic Reasoning Networks

arxiv: https://arxiv.org/abs/2003.12294

key point

this approach will try to take global context into account by adopting transformer, and also use similar structure to reason semantic content.

(more…)
By admin, 2 months2 months ago

Posts navigation

1 2 … 16 Next
Recent Posts
  • is it okay to calculate loss in cpu and backpropagate in torch?
  • paper review: “High-Performance Large-Scale Image Recognition Without Normalization”
  • gitignore ignore config files except sample config file
  • convert subquery columns into array of json objects
  • postgres database backup and restoring
Categories
  • algorithm
  • c/c++
  • cuda
  • data science
  • deep learning
  • error fix
  • kicad
  • kotlin
  • linux
  • postgres
  • python
  • pytorch
  • tensorflow
  • Uncategorized
  • web
Recent Comments
  • Anonymous on solving “‘grub-efi-amd64-signed’ package failed to install into /target/.” error while installing ubuntu 20.04
  • Anonymous on how to install cudnn(from tar file)
  • Vaishal on solving “‘grub-efi-amd64-signed’ package failed to install into /target/.” error while installing ubuntu 20.04
  • Anonymous on paper review: Intriguing properties of neural networks (getting adversarial samples using L-BGFS method)
  • Shraddha on cv2 resize interpolation methods
Archives
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
Meta
  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org
  • Posts
Hestia | Developed by ThemeIsle