Dropout as Shared-Parameter Bagging
A concrete way to understand dropout in deep learning: sampled subnetworks with shared weights, standing in for a much more expensive ensemble.
Regularization
Notes on dropout, shared parameters, and model averaging as regularization mechanisms.
1 post