Section: Discrete Time Markov Chains | 580SM - STOCHASTIC MODELLING AND SIMULATION 2018 | Moodle@Units

Home Courses Support

Section outline

- Select activity Slides: Discrete Time Markov Chains
  
  Slides: Discrete Time Markov Chains File PDF
- Select activity Video: Introduction to Discrete Time Markov Chains
  
  Video: Introduction to Discrete Time Markov Chains URL
- Select activity Video: DTMC transient and reachability probabilities
  
  Video: DTMC transient and reachability probabilities URL
- Select activity Video: Steady state distribution and simulation of DTMC
  
  Video: Steady state distribution and simulation of DTMC URL
- Select activity Book: Durrett - Essentials of Stochastic Processes
  
  Book: Durrett - Essentials of Stochastic Processes File PDF
- Select activity Book: Norris - Markov Chains
  
  Book: Norris - Markov Chains File PDF
- Select activity DTMC_lab
  
  DTMC_lab File ZIP