#rotary-position-embedding

Question 1: Select all that apply

Which statements about Rotary Position Embedding (RoPE) are true? Select all that apply.

It multiplies queries and keys by a position-dependent rotation matrix1
Each rotated vector encodes its absolute position, while their dot product depends on the positions only through the relative offset2
Like sinusoidal encodings, it is added to the token embeddings at the input layer3
It removes the need for any positional information in the model4