Skip to content
ml-recall

#training-challenges

1 question from Training Deep Networks

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Single choice

easyAI-checkedTraining Deep Networks

A 20-layer network with sigmoid activations is being trained. Logging the gradient norm of each layer's weights gives about 10−110^{-1} for the last layer, 10−410^{-4} for a middle layer and 10−810^{-8} for the first layer, whose weights barely change. Which training challenge is this?

Choose one option