Skip to content
ml-recall

#backpropagation

42 questions from Optimization & Calculus, Neural Network Basics, Deep Learning Frameworks, Autoencoders & VAEs

Timed test

20 questions · 20 min · score and explanations at the end

Longer test or by difficulty: mixed test with #backpropagation

Take a test
Q 1 / 42Score 0 / 0

Question 1: Short answer

hardAI-checkedOptimization & Calculus

Continue with the pass/fail network z1=W1x+b1z^1 = W^1 x + b^1, a1=ReLU(z1)a^1 = \mathrm{ReLU}(z^1), y^=σ(W2a1+b2)\hat y = \sigma(W^2 a^1 + b^2), where

W1=[0.5−110.5],b1=[−1−1],W2=[12],b2=−1,W^1 = \begin{bmatrix} 0.5 & -1 \\ 1 & 0.5 \end{bmatrix},\quad b^1 = \begin{bmatrix} -1 \\ -1 \end{bmatrix},\quad W^2 = \begin{bmatrix} 1 & 2 \end{bmatrix},\quad b^2 = -1,

x=(2,1)⊤x = (2, 1)^\top, y=1y = 1, binary cross-entropy loss, so z1=(−1,1.5)z^1 = (-1, 1.5) and y^=σ(2)≈0.8808\hat y = \sigma(2) \approx 0.8808. After one gradient-descent step with η=0.5\eta = 0.5, what is the new value of W211W^1_{21} (row 2, column 1: the weight from input x1x_1 to hidden unit 2)? Give 4 decimals.

4 decimals