pytorch PyTorch 101, Part 5: Understanding Hooks In this post, we cover debugging and Visualisation in PyTorch. We go over PyTorch hooks and how to use them to debug our backpass, visualise activations and modify gradients.
Tutorial PyTorch 101, Part 4: Memory Management and Using Multiple GPUs This article covers PyTorch's advanced GPU management features, including how to multiple GPU's for your network, whether be it data or model parallelism. We conclude with best practises for debugging memory error.
Tutorial PyTorch 101, Part 3: Going Deep with PyTorch In this tutorial, we dig deep into PyTorch's functionality and cover advanced tasks such as using different learning rates, learning rate policies and different weight initialisations etc
pytorch PyTorch 101, Part 2: Building Your First Neural Network In this part, we will implement a neural network to classify CIFAR-10 images. We cover implementing the neural network, data loading pipeline and a decaying learning rate schedule.
Deep Learning PyTorch 101, Part 1: Understanding Graphs, Automatic Differentiation and Autograd In this article, we dive into how PyTorch's Autograd engine performs automatic differentiation.
Series: Data Augmentation Data Augmentation for Bounding Boxes: Rethinking image transforms for object detection How to adapt major image augmentation techniques for object detection purposes. We also cover the implementation of horizontal flip augmentation.
Series: Data Augmentation Data Augmentation for Bounding Boxes: Scaling and Translation We implement Scale and Translate augmentation techniques, and what to do if a portion of your bounding box is outside the image after the augmentation.
Computer Vision Data Augmentation for Bounding Boxes: Rotation and Shearing This is part 3 of the series where we are looking at ways to adapt image augmentation techniques to object detection tasks. In this part, we will cover how to implement how to rotate and shear images as well as bounding boxes using OpenCV's affine transformation features.
Series: Data Augmentation Data Augmentation For Bounding Boxes: Building Input Pipelines for your detector Previously, we have covered a variety of image augmentation techniques such as Flipping, rotation, shearing, scaling and translating. This part is about how to bring it all together and bake it into the input pipeline for your deep network.
Series: Optimization Intro to optimization in deep learning: Busting the myth about batch normalization Batch Normalisation does NOT reduce internal covariate shift. This posts looks into why internal covariate shift is a problem and how batch normalisation is used to address it.
Series: Optimization Intro to optimization in deep learning: Vanishing gradients and choosing the right activation function An look into how various activation functions like ReLU, PReLU, RReLU and ELU are used to address the vanishing gradient problem, and how to chose one amongst them for your network.
Series: Optimization Intro to optimization in deep learning: Momentum, RMSProp and Adam In this post, we take a look at a problem that plagues training of neural networks, pathological curvature.
Series: Optimization Intro to optimization in deep learning: Gradient Descent An in-depth explanation of Gradient Descent, and how to avoid the problems of local minima and saddle points.
Series: YOLO object detector in PyTorch How to implement a YOLO (v3) object detector from scratch in PyTorch: Part 1 Tutorial on building YOLO v3 detector from scratch detailing how to create the network architecture from a configuration file, load the weights and designing input/output pipelines.
Series: YOLO object detector in PyTorch How to implement a YOLO (v3) object detector from scratch in PyTorch: Part 2 Part 2 of the tutorial series on how to implement your own YOLO v3 object detector from scratch in PyTorch.
Series: YOLO object detector in PyTorch How to implement a YOLO (v3) object detector from scratch in PyTorch: Part 3 Part 3 of the tutorial series on how to implement a YOLO v3 object detector from scratch in PyTorch.
Series: YOLO object detector in PyTorch How to implement a YOLO (v3) object detector from scratch in PyTorch: Part 4 Part 4 of the tutorial series on how to implement a YOLO v3 object detector from scratch using PyTorch.
Series: YOLO object detector in PyTorch How to implement a YOLO (v3) object detector from scratch in PyTorch: Part 5 Part 5 of the tutorial series on how to implement a YOLO v3 object detector from scratch using PyTorch.
