#contextual-embeddings

Question 1: Single choice

mediumAI-checkedText Representation & Embeddings

The word "bank" means different things in "i went to the bank to deposit cash" and "i went to the bank to sit down". You need a vector for "bank" that reflects its meaning in the given sentence. Which design provides it?

Run a bidirectional encoder over the whole sentence and take its output at "bank"1
Look up "bank" in a table of pretrained word2vec or GloVe vectors2
Run a left-to-right language model over the sentence and take its hidden state at "bank"3
Average the GloVe vectors of all the words in the sentence4

#contextual-embeddings

Timed test