#information

Question 1: Single choice

Before a message arrives you are uncertain about its content; afterwards you are less so. In Shannon's theory, how is the information conveyed by the message related to your uncertainty?

It is the decrease in uncertainty: entropy before minus entropy after1
It is the increase in uncertainty caused by receiving the message2
It is the length of the message in symbols, whatever their probabilities3
It is largest for messages the receiver was sure to get4

Timed test