#encoder-only

Question 1: Select all that apply

Which statements about the three families of transformer language models are true? Select all that apply.

Decoder-only models such as GPT are designed for text generation1
Decoder-only models are trained with masked language modeling2
Encoder-only models such as BERT are used for understanding tasks such as classification and named-entity recognition3
Decoder-only models are trained to predict the next token4
In an encoder-decoder model, the decoder generates each token from the previously generated tokens and the encoder's outputs5