Markov processes or chains are described as a series of "states" which transition from one to another, and have a given probability for each transition.