ml-recall

#nucleus-sampling

1 question from Language Modeling

Timed test

1 question · 1 min · score and explanations at the end

Take a test

Q 1 / 1Score 0 / 0

Shuffle questions

Question 1: Short answer

mediumAI-checkedLanguage Modeling

A language model gives the next-token probabilities $(0.5, 0.2, 0.15, 0.1, 0.05)$ . Nucleus (top- $p$ ) sampling with $p = 0.8$ keeps the smallest set of most likely tokens whose probabilities add up to at least $p$ , renormalizes, and samples. With what probability is the most likely token chosen?

Enter: check / next