Skip to content
ml-recall

#adamw

1 question from Training Deep Networks

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: True or false

mediumAI-checkedTraining Deep Networks

True or false: with plain SGD, adding an L2 penalty λ∥w∥2\lambda\lVert w\rVert^2 to the loss is equivalent to weight decay (shrinking the weights by a constant factor each step), but with Adam it is not.

Choose one option