Visualize a Sample Path for a Finite Markov Process

    
Visualize a sample path for a discrete Markov process:
Visualize a sample path for a continuous Markov process: