Chapman kolmogorov equation for a discrete markov chain is. .