deep learning
image dataset converted to tfrecord stats
I had 658240 image dataset. Each set has image and mask. Both are png files. Each image file was size of 224 x 224. To total size was 30G. After converting it to tfrecord, the size reduced to 27G.
deep learning
forcing memory release of gpu
identifying which pid is occupying the gpu can be found following this thread. However, the gpu number in the above link is not identical with the gpu number displayed with nvidia-smi. In my case, the processes that were occupying the gpu memory did not show up in nvidia-smi but it showed Read more…
linux
restart rmate when stuck
sometimes rmate setup in a remote server may not work. Causes could be numerous: simply you left it open too long and the server somehow showed erraneous behavior, or you had to abruptly shutdown your ssh connection in a forceful manner. When the rmate is stuck, it will simply not Read more…