Catalog Β· Discrete Stochastic Processes Lecture 9 of 25 Lecture 9: Markov Rewards and Dynamic Programming β Previous Lecture 8: Markov Eigenvalues and Eigenvectors Next β Lecture 10: Renewals and the Strong Law of Large Numbers β Mark complete Materials Transcript (PDF) β transcript