Catalog Β· Discrete Stochastic Processes Lecture 7 of 25 Lecture 7: Finite-state Markov Chains; The Matrix Approach β Previous Lecture 6: From Poisson to Markov Next β Lecture 8: Markov Eigenvalues and Eigenvectors β Mark complete Materials Transcript (PDF) β transcript