Markov Chains

Stochastic Processes
Markov Chains
Author

John Robin Inston

Published

December 14, 2025

Modified

March 16, 2026

10 realizations of a symmetric random walk.

✏️ Information

In this topic we study discrete time Stochastic Processes, countable sequences of random variables indexed in time. The material covered in these notes was prepareed during my time working as a teaching assistant under both Prof. Tomoyuki Ichiba and Prof. Vellaisamy Palaniappan for their respective versions of the PSTAT160A Stochastic Processes course at UC Santa Barbara.

📚 Material

My online lecture notes for this course can be found here.

Below are links to documents I have prepared for my past sections as well as a collection of additional exercise sheets covering similar questions to those covered in past assignments and exams. These documents can also be found in the respective course pages on my GitHub.

Past Teaching Material

🙏 Thanks!

If you found any of this material helpful consider buying me a coffee but only if you can afford to! Thank you for visiting this course page. 😊

Back to top