Skip to content
ml-recall

#subsampling

1 question from Text Representation & Embeddings

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

easyAI-checkedText Representation & Embeddings

When training word embeddings, each occurrence of a word wiw_i is discarded with probability max⁡(1−t/f(wi), 0)\max\left(1 - \sqrt{t / f(w_i)},\ 0\right), where f(wi)f(w_i) is the word's share of all tokens and t=10−4t = 10^{-4}. The word "the" makes up 4% of the corpus. What fraction of its occurrences is discarded? Round to 2 decimals.

a probability, 2 decimals