HW6

Dear all,

Here is HW6.

1. A group of students have the average height of 170 cm and the standard deviation of 15 cm. How many bits on average are approximately needed to store the height of a student with the precision of 0.1 cm if the height is normally distributed?

2. On slide 8 of the note, please compute (a) the KL-divergence and (b) the cross entropy between the targeted and computed distributions for both examples.

3. Let say we throw a dice twice and the outcomes are D1 and D2. And let S=D1 + D2. Please compute (a) H(D1|S=3) (b) I(D1;D2|S=3) (c) I(D1;D2)

Best,

Sam