Click Esercizi_catene_Markov_3.pdf link to view the file.