Problem bank

Problem 209 of 333MediumStochastic ProcessesP209

Is the running maximum Markov?

  1. Let SnS_n be a symmetric random walk started at 0 with independent steps of ±1\pm 1, each with probability 1/21/2, and let Mn=max⁡0≤k≤nSkM_n = \max_{0 \le k \le n} S_k be its running maximum.

    (a) Is MnM_n a martingale?

    (b) Is MnM_n a Markov process?

    (c) Is the pair (Sn,Mn)(S_n, M_n) a Markov process?