Step 1: Choose any Markov Chain with a 3x3 transition matrix that is irreducible and aperiodic. The reason it needs to be irreducible and aperiodic is because we are looking for a Markov Chain that converges. Calculate the stationary distribution of the Markov Chain by hand.
Step 2: Simulate the Markov Chain in Matlab. You can do as many iterations as you choose as long as it is large enough to determine if the Markov Chain converges. Discuss the results of the simulation. Note that the Markov Chain should converge because we specifically wanted to choose one that converges.
Step 3: Create a plot of the results in Matlab.
Please provide the Matlab code that you used and the Markov Chain you used to complete this task.