Posts tagged coursera
Transfer Learning
How much of a pre-trained network to freeze given your dataset size, why features stop transferring as you go deeper, and the caching trick that makes it fast.
EfficientNet
EfficientNet's compound scaling rule, the FLOPs constraint that makes it work, the grid-searched constants, and the ImageNet accuracy it buys.
MobileNet Architecture
Why MobileNetV2 expands before it filters, what makes the residual inverted, and why the last layer of the block has no ReLU on it.
MobileNet
Depthwise separable convolution derived and costed: where the 1/N + 1/f-squared ratio comes from, and what an 8-9x saving actually looks like.
The Inception Network
How GoogLeNet stacks nine Inception modules into 6.8M parameters, what the auxiliary classifiers were really for, and what v2 and v3 changed.
Inception Network Motivation
Why the Inception module refuses to choose a filter size, and the 120M to 12.4M bottleneck arithmetic that makes running all of them affordable.