Skip to content
ml-recall

#td3

1 question from Value-Based Methods

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

mediumAI-checkedValue-Based Methods

TD3 learns two critics and forms one target from their target networks, y=r+γ(1−d)min⁡i=1,2Qϕi,targ(s′,a′(s′))y = r + \gamma(1-d)\min_{i=1,2} Q_{\phi_{i,\text{targ}}}(s', a'(s')). For a transition with r=1r = 1, γ=0.99\gamma = 0.99, d=0d = 0 (not terminal), and target critics giving 1010 and 88 at (s′,a′(s′))(s', a'(s')), what is yy?

a number, 2 decimals