Problem bank

Problem 68 of 333MediumStochastic ProcessesP068

Periodic markov chain

  1. Define irreducible and aperiodic for a Markov chain. Give an example of an irreducible chain that is periodic.