Skip to content
ml-recall

#optimistic-initialization

1 question from Value-Based Methods

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

mediumAI-checkedValue-Based Methods

A Q-learning agent with γ=0.99\gamma = 0.99 initializes every Q(s,a)Q(s, a) optimistically to 1/(1−γ)=1001/(1 - \gamma) = 100, the largest possible return when rewards lie in [0,1][0, 1]. It takes action aa in state ss, receives reward 0 and lands in s′s', whose Q-values are all still 100. With learning rate α=0.1\alpha = 0.1, what is Q(s,a)Q(s, a) after the update?

a number, 1 decimal