Skip to content
ml-recall

#hierarchical-softmax

1 question from Text Representation & Embeddings

Timed test

1 question · 1 min · score and explanations at the end

Take a test
Q 1 / 1Score 0 / 0

Question 1: Short answer

mediumAI-checkedText Representation & Embeddings

Hierarchical softmax over a 4-word vocabulary uses a balanced binary tree: a root, a left inner node with leaves w1,w2w_1, w_2 and a right inner node with leaves w3,w4w_3, w_4. Stepping to the left child of node nn multiplies by σ(un⊤vc)\sigma(\mathbf{u}_n^\top\mathbf{v}_c), stepping to the right child by σ(−un⊤vc)\sigma(-\mathbf{u}_n^\top\mathbf{v}_c). For a center word with uroot⊤vc=1.0\mathbf{u}_\textrm{root}^\top\mathbf{v}_c = 1.0 and uright⊤vc=0.5\mathbf{u}_\textrm{right}^\top\mathbf{v}_c = 0.5, what is P(w3∣wc)P(w_3 \mid w_c)? Round to 3 decimals.

a probability, 3 decimals