PyTorch 101, Part 4: Memory Management and Using Multiple GPUs
This article covers PyTorch's advanced GPU management features, including how to multiple GPU's for your network, whether be it data or model parallelism. We conclude with best practises for debugging memory error.