Skip to content
ml-recall

#weight-initialization

1 question from Training Deep Networks

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

easyAI-checkedTraining Deep Networks

A rule of thumb initializes the weights of a layer uniformly in [−y,y][-y, y] with y=1/ny = 1/\sqrt{n}, where nn is the number of inputs to each neuron. An MLP for Fashion-MNIST has layers 784 → 256 → 128 → 10. What is yy for the second layer (256 → 128)?

a number, 4 decimals