2 years ago
Neural Network
The Swish Activation Function
This blogpost is an in-depth discussion of the Google Brain paper titled "Searching for activation functions" which has since revived research into activation functions.
2 years ago
2 years ago
xUnit Spatial Activation Function for Image Denoising
This article provides an in-depth look at the CVPR 2018 paper titled "xUnit: Learning a Spatial Activation Function for Efficient Image Restoration" and its importance in the domain of image reconstruction.
2 years ago
2 years ago
Question Answering Models: A Comparison
This article covers a deeper level understanding of Question Answering models in NLP, the datasets commonly used, and how to choose a pre-trained model by considering various factors like the document structure, runtime cost, etc.
2 years ago
Concurrent Spatial and Channel Squeeze & Excitation (scSE) Nets
In this article, we will take a look at the paper "Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks" which serves as a design update for the popular Squeeze-and-Excitation attention module.
2 years ago
Shuffle Attention for Deep Convolutional Neural Networks (SA-Net)
This article gives an in-depth summary of the ICASSP paper titled "SA-Net: Shuffle Attention for Deep Convolutional Neural Networks."
2 years ago
