Colab Pro+ Segmentation Experiments

The good thing is - Runs in the background, Close the browser, and re-login after a few hours

Cons - 

• Was not as fast as I expected it to complete the training
• Background execution terminates after 24 hours, Does not support long training
• Sometimes console was busy and unresponsive

For 50$ this is the cheapest option at the moment :)

Experiment #1 - 20K Training Images, 5K Test Images

• GPU, High RAM
• TPU, High RAM
• Colab pro+
• Batch size - 100

Failed 

Experiment #2 - 10K Training Images, 2K Test Images

• GPU, High RAM
• Colab pro+
• Batch size - 75

Failed 

Experiment #3 - 10K Training Images, 2K Test Images

• GPU, High RAM
• Colab pro+
• Batch size - 25

In Progress

Experiment #4 - 10K Training Images, 2K Test Images

• Segmentation 512 x 512
• Batch Size = 15
• GPU High RAM

1- 3 Epochs, Incremental Iterations

20 Epochs Seems ok, Not so bad

Everything seems to balance batch size, incremental training, GPU, and TPU based on the problem statement

Segmentation on 512 x 512 seems to have better performance compared to segmentation on 224 x 224

Continue Experiments!!!