Probability

The Coin Game That Makes Everyone Poorer

How far a random variable can stray when you know only its mean or its variance, and why E[f(X)] differs from f(E[X]) in a direction you can predict, which is where volatility drag and option convexity come from.

What to remember

  • Markov: for X≥0X \ge 0, P(X≥a)≤E[X]/aP(X \ge a) \le E[X]/a. It is sharp: mass at 00 and at aa attains it, and it fails for variables that can go negative.
  • Chebyshev is Markov applied to (X−μ)2(X - \mu)^2: P(∣X−μ∣≥kσ)≤1/k2P(|X - \mu| \ge k\sigma) \le 1/k^2, so at most 25% of any distribution lies 2σ2\sigma or more from the mean (4.55% for a normal).
  • Applied to a sample mean, Chebyshev gives P(∣Xˉ−μ∣≥ε)≤σ2/(nε2)P(|\bar X - \mu| \ge \varepsilon) \le \sigma^2/(n\varepsilon^2), a one-line proof of the weak LLN and a guaranteed sample size (2000 flips for ±0.05\pm 0.05 at 95%, against 385 from the CLT).
  • Jensen: E[f(X)]≥f(E[X])E[f(X)] \ge f(E[X]) for convex ff, reversed for concave ff, with gap ≈12f′′(μ) σ2\approx \tfrac12 f''(\mu)\,\sigma^2. So E[X2]≥(E[X])2E[X^2] \ge (E[X])^2, E[1/X]≥1/E[X]E[1/X] \ge 1/E[X] and E[ln⁡X]≤ln⁡E[X]E[\ln X] \le \ln E[X].
  • Compounded growth runs near μ−σ2/2\mu - \sigma^2/2 (volatility drag): +20%+20\% or −10%-10\% averages 5% but compounds at about 3.9% a year.
  • Convex payoffs gain from spread: a call is worth more than its payoff at the expected price, which is why option value rises with volatility and a long option is long gamma.
  • In a multiplicative bet the mean grows at the arithmetic mean of the factors and the typical path at the geometric mean (AM–GM is Jensen on ln⁡\ln): ×1.5\times 1.5 or ×0.6\times 0.6 averages +5%+5\% a flip, yet the median loses 5.1% a flip, and staking the Kelly fraction 14\frac14 turns it into a gain of 0.62%.
Read the lessonInequalities: Markov, Chebyshev and Jensen, with a checkpoint at the end.