Question 1: Short answer
mediumAI-checkedOptimization & CalculusAn RMSProp implementation uses and , with initialized to 0, and . If you set , what is the effective learning rate that multiplies at every step?
13 questions from Optimization & Calculus, ML Fundamentals, Nearest Neighbors & Kernel Methods, Support Vector Machines, Decision Trees & Ensembles, Probabilistic & Graphical Models, Dimensionality Reduction, Language Modeling
13 questions · 13 min · score and explanations at the end
An RMSProp implementation uses and , with initialized to 0, and . If you set , what is the effective learning rate that multiplies at every step?