Question 1: Short answer
easyAI-checkedTraining Deep NetworksMax-norm regularization caps the Euclidean length of every unit's incoming weight vector at : after an update, a vector whose norm exceeds is rescaled to norm . An update leaves the weights . After the constraint is applied, the first weight is and the second is .
Fill in every blank (hints in the boxes). Enter moves to the next blank.