Question 1: Single choice
mediumAI-checkedOptimization & CalculusAdaGrad (, negligible ) trains two weights. Weight A belongs to a frequent feature and has received the gradient at each of the first 16 steps. Weight B belongs to a rare feature: its gradient was 0 at steps 1–15 and at step 16. At step 16, how many times larger is B's step than A's?