Click simulation of DTMC.pdf link to view the file.