Skip to content
ml-recall

#absolute-discounting

2 questions from Language Modeling

Timed test

2 questions · 2 min · score and explanations at the end

Take a test
Q 1 / 2Score 0 / 0

Question 1: Short answer

mediumAI-checkedLanguage Modeling

After a context ww, a corpus shows N=10N = 10 following tokens of three word types, with counts 5, 3 and 2. The vocabulary has V=10V = 10 words, so 7 types never followed ww. Absolute discounting with δ=0.5\delta = 0.5 subtracts δ\delta from every non-zero count, gives seen words (r−δ)/N(r - \delta)/N, and shares the freed probability mass equally among the unseen types. What is the probability of each unseen word?

a probability, 3 significant digits