Skip to content
ml-recall

#pairwise-loss

1 question from Alignment & Reasoning

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

easyAI-checkedAlignment & Reasoning

A reward model is trained with the pairwise loss −log⁡σ(r(x,yw)−r(x,yl))-\log \sigma\big(r(x, y_w) - r(x, y_l)\big), where ywy_w is the response the labeler preferred and yly_l the other one. On one comparison it currently outputs r(x,yw)=0.5r(x, y_w) = 0.5 and r(x,yl)=1.7r(x, y_l) = 1.7. What is the loss on this pair (natural log)?

a number, 3 decimals