Skip to content
ml-recall

#gaussian-policy

3 questions from Policy Gradient & Actor-Critic

Timed test

3 questions · 3 min · score and explanations at the end

Take a test
Q 1 / 3Score 0 / 0

Question 1: Short answer

mediumAI-checkedPolicy Gradient & Actor-Critic

A diagonal Gaussian policy has mean μ=(0.5, −1)\mu = (0.5,\ -1) and log standard deviations log⁡σ=(0, ln⁡2)\log\sigma = (0,\ \ln 2) in some state. What is log⁡π(a∣s)\log \pi(a \mid s) of the action a=(1.5, 1)a = (1.5,\ 1)? Use log⁡π=−12(∑i[(ai−μi)2σi2+2log⁡σi]+klog⁡2π)\log\pi = -\tfrac12\left(\sum_i \left[\frac{(a_i-\mu_i)^2}{\sigma_i^2} + 2\log\sigma_i\right] + k\log 2\pi\right) and give 3 decimals.

a number, 3 decimals