Feedback
Corrections? Updates? Omissions? Let us know if you have suggestions to improve this article (requires login).
Thank you for your feedback

Our editors will review what you’ve submitted and determine whether to revise the article.

Markov chain, sequence of possibly dependent discrete random variables (x1, x2, x3,…)—identified by increasing values of a parameter, commonly time—with the property that any prediction of the next value of the sequence (xn) is based on the last state (xn − 1) alone. That is, the future value of such a variable is independent of its past. The term Markov process is used for sequences in which the random variables can assume continuous values. In mathematics, probability...