Divide and Conquer: The Role of Warps in Parallel Processing
In this review, we look at the role of warps in parallel processing in GPUs to try and understand what our machines are doing under the hood when training AI models.
Melani is a Technical Writer at DigitalOcean based in Toronto. She has experience in teaching, data quality, consulting, and writing. Melani graduated with a BSc and Master’s from Queen's University.
In this review, we look at the role of warps in parallel processing in GPUs to try and understand what our machines are doing under the hood when training AI models.
In this article, we examine the mechanisms behind GPU memory hierarchy.