ml-recall

#sinusoidal

2 questions from Attention & Transformers

Timed test

2 questions · 2 min · score and explanations at the end

Take a test

Q 1 / 2Score 0 / 0

Shuffle questions

Question 1: Short answer

mediumAI-checkedAttention & Transformers

The sinusoidal positional encoding is $PE_{(pos,\,2i)} = \sin(pos/10000^{2i/d})$ and $PE_{(pos,\,2i+1)} = \cos(pos/10000^{2i/d})$ . With $d = 4$ , what is the entry in dimension 2 (counting from 0) of the encoding of position $pos = 2$ ?

Enter: check / next