Skip to content
ml-recall

#logit

4 questions from Information Theory, Logistic Regression & Softmax, Neural Network Basics

Timed test

4 questions · 4 min · score and explanations at the end

Take a test
Q 1 / 4Score 0 / 0

Question 1: Short answer

mediumAI-checkedInformation Theory

The binary entropy in bits is H(p)=−plog⁡2p−(1−p)log⁡2(1−p)H(p) = -p \log_2 p - (1 - p) \log_2 (1 - p). What is H′(0.2)H'(0.2), the derivative with respect to pp at p=0.2p = 0.2?

a number