All the states in an irreducible infinite Markov chain may belong to one, and only one, of the following three classes:

• transient case;
• recurrent null state;
• recurrent nonnull state.