Skip to content
ml-recall

#brevity-penalty

1 question from NLP Tasks

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

hardAI-checkedNLP Tasks

Reference: "a small cat sat on the warm mat" (8 words)

Candidate: "the cat sat on the mat" (6 words)

Compute BLEU with unigrams and bigrams only, uniform weights w1=w2=12w_1 = w_2 = \tfrac12: BLEU=BP⋅exp⁡(12ln⁡p1+12ln⁡p2)\mathrm{BLEU} = \mathrm{BP} \cdot \exp\big(\tfrac12 \ln p_1 + \tfrac12 \ln p_2\big), where pnp_n are the clipped (modified) n-gram precisions and BP=e1−r/c\mathrm{BP} = e^{1 - r/c} if the candidate length cc is at most the reference length rr (else 1).

a number between 0 and 1, 3 decimals