A Markov chain is said to be irreducible if every state Ej can be reached from every other state Ej after a finite number of transitions.