admin, Author at Chadrick's Blog

deep learning

paper summary: “Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization”

arxiv: https://arxiv.org/pdf/1703.06868.pdf key points arbitrary style transfer in real time use adaptive instance normalization(AdaIN) layers which aligns the mean and variance of content features allows to control content-style trade-off, style interpolation, color/spatial control previous works optimization approach using backprop of network to minimize style loss and content loss. This can be Read more…

By admin, 3 days3 days ago

deep learning

paper summary: “Aggregated Residual Transformations for Deep Neural Networks” (ResNext Paper)

key point compared to resnet, the residual blocks are upgraded to have multiple “paths” or as the paper puts it “cardinality” which can be treated as another model architecture design hyper parameter. resnext architectures that have sufficient cardinality shows improved performance tldr: use improved residual blocks compared to resnet Different Read more…

By admin, 1 month1 month ago

deep learning

cosine annealing

good simple explanation and figure: https://www.kaggle.com/residentmario/cosine-annealed-warm-restart-learning-schedulers

By admin, 2 months ago

linux

bash function shortcut for watch nvidia-smi

add the following to .bashrc or .bash_aliases

By admin, 2 months2 months ago

deep learning

paper review: “Semantic Segmentation using Adversarial Networks”

https://arxiv.org/pdf/1611.08408.pdf key point use adversarial net to distinguish if input masks are from segmentation net or ground truth. this allows to add auxiliary loss, like below: where mce: multi class cross-entropy bce: binary cross entropy s(): segmentation network a(): adversarial network y: ground truth x: input s(x): segmentation network output Read more…

By admin, 2 months2 months ago

postgres

convert subquery columns into array of json objects

By admin, 3 months ago

postgres

postgres database backup and restoring

I am relatively new to postgres and at first I was backing up and restoring databases using pgadmin4. I was just using postgres user because this is the default one that you get to use when working with pgadmin. After developing a web project using postgres, I needed to move Read more…

By admin, 3 months2 months ago

deep learning

paper review: “Path Aggregation Network for Instance Segmentation”

arxiv: https://arxiv.org/abs/1803.01534

key point

this paper propose a network structure(“PANet”) with bottom up path augmentation and a few other tweak methods which results in better instance segmentation performance.

(more…)

By admin, 4 months4 months ago

deep learning

paper review: “CBAM: Convolutional Block Attention Module”

arxiv: https://arxiv.org/pdf/1807.06521.pdf

key point

trying to attach attention module to CNN. but instead of blindly attaching it which would compute a 3D attention map which is computationally expensive, this work proposes to compute spatial attention and channel attention separately which achieves a similar effect with much less parameters.

(more…)

By admin, 4 months ago

deep learning

paper review: Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

arxiv: https://arxiv.org/abs/1406.4729

key points

pools a fixed number of features from final feature map of backbone which can be fed to the dense layer afterwards, thus allowing network to work in a non-fixed input size manner.

(more…)

By admin, 4 months ago