3.3
Solution of difference equations arising out of pgf
4.1
Introduction to Markov chains
Chapter 4
Markov chains
4.1
Introduction to Markov chains
4.2
Class structure
4.3
Analysing Markov chains
4.4
Asymptotic and invariant distributions
4.5
Classification of states
4.6
Calculating the asymptotic distribution
4.7
Ehrenfest model of diffusion and its invariant distribution
4.8
Expected hitting times
4.9
N
-step formula for transition matrices - intro.
4.10
More general
N
-step formulae