#stateful-rnn

Question 1: Single choice

mediumAI-checkedRecurrent Neural Networks

An RNN is trained on random windows of 50 consecutive time steps cut from a long series, and its hidden state starts from zeros at the beginning of every window (a stateless RNN). What is the longest pattern it can learn to exploit?

Patterns spanning at most 50 time steps1
Patterns of any length, because the hidden state carries information forward2
Patterns of up to 50 × batch size time steps, since a whole batch is processed together3
Only patterns of a single time step, since the state is reset4

Timed test