Discrete Stochastic Processes

Lesson 3 of 10

Conditional Expectation and the Tower Property

Seeing the first die rules out 30 of 36 worlds and moves the expected sum away from 7, yet averaged over every face you might see, the forecast is still 7.

Worlds disappearing

Roll two fair dice, call the first one D1D_1, and let XX be the sum. Before you look there are 36 equally likely worlds, and the sum balances at E[X]=7E[X] = 7. Picture 36 blocks on a beam with the fulcrum under 7.

Now someone tells you the first die shows 5. Thirty worlds vanish. The six that survive have sums 6,7,8,9,10,116, 7, 8, 9, 10, 11, each now with probability 1/61/6, and the beam re-balances at

E[X∣D1=5]=6+7+8+9+10+116=8.5.E[X \mid D_1 = 5] = \frac{6+7+8+9+10+11}{6} = 8.5.

That is all conditioning on an event does. You throw away the worlds that are ruled out, rescale the survivors so their probabilities add to 1, and find the new balance point. In symbols, for an event AA with P(A)>0P(A) > 0 and its indicator 1A\mathbf{1}_A (1 on AA, 0 off it),

E[X∣A]=E[X1A]P(A).E[X \mid A] = \frac{E[X \mathbf{1}_A]}{P(A)}.

With A={D1=5}A = \{D_1 = 5\} we get E[X1A]=51/36E[X \mathbf{1}_A] = 51/36 and P(A)=6/36P(A) = 6/36, so the ratio is 51/6=8.551/6 = 8.5 again.

If the first die had shown 2, the survivors would have sums 3 through 8 and the fulcrum would slide left to 5.55.5. New information moves your expected value, and which way it moves depends on what you learn.