Markov Models: From Graph to Matrix
If we can represent the model as a graph, then we can represent it as a matrix, and that lets us use software to do the repetitive calculations.
There's an Error!
I make a bizarre error near the end of this pencast. I enter the transition probabilities in to the matrix in the wrong order, but then carry out the calculations as though they were in the right order?! Here's how those values should look (the 0.7 and 0.3 should be swapped). Sorry for any confusion!

Playback speed: