Question 1: Short answer
easyAI-checkedTraining Deep NetworksA rule of thumb initializes the weights of a layer uniformly in with , where is the number of inputs to each neuron. An MLP for Fashion-MNIST has layers 784 → 256 → 128 → 10. What is for the second layer (256 → 128)?