#horizontal-scaling

Question 1: Single choice

A production agent service runs many identical instances behind a load balancer. Why should each instance keep no conversation state in its own process memory?

So that each user is always routed back to the very same instance as before, every time1
Because LLMs cannot read earlier messages of a conversation2
Because keeping state in memory makes the model's answers less accurate3
So any instance can serve any request, with state kept in an external store4

Timed test