Skip to content
ml-recall

#masking

2 questions from Recurrent Neural Networks, Language Modeling

Timed test

2 questions · 2 min · score and explanations at the end

Take a test
Q 1 / 2Score 0 / 0

Question 1: Single choice

mediumAI-checkedRecurrent Neural Networks

In seq2seq training, target sentences are padded with <pad> up to num_steps tokens. What goes wrong if the cross-entropy loss is averaged over all positions, padding included?

Choose one option