Deep Learning

Posts on deep learning concepts, textbook notes, regularization, and the structural assumptions behind neural networks.

3 posts currently filed under Deep Learning.

Dropout as Implicit Bagging in Deep Learning

A concrete way to understand dropout in deep learning: shared-parameter ensemble training that approximates bagging without training separate models.

Chapter 6 sharpened how I think about architecture as a structural assumption, not just a tuning choice.

A short review of Part I of Goodfellow, Bengio, and Courville's Deep Learning textbook, focused on the mathematical foundations.