Dropout as Shared-Parameter Bagging
A concrete way to understand dropout in deep learning: sampled subnetworks with shared weights, standing in for a much more expensive ensemble.
Deep Learning
Notes on dropout and model averaging in Goodfellow, Bengio, and Courville's Deep Learning.
1 post