Consider here the following Markov chain.