Skip to content
ml-recall

#shift-invariance

1 question from Alignment & Reasoning

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: True or false

mediumAI-checkedAlignment & Reasoning

A reward model is trained with the pairwise loss −log⁡σ(r(x,yw)−r(x,yl))-\log \sigma\big(r(x, y_w) - r(x, y_l)\big). True or false: adding the same constant, say +5+5, to every reward the model outputs changes the value of this loss.

Choose one option