Finite Markov Chains: Examples

Daisuke Oyama

Faculty of Economics, University of Tokyo

Julia translation of the Python version, translated by Ryumei Nakada

This notebook demonstrates how to analyze finite-state Markov chains with the MarkovChain class. For basic concepts and properties on Markov chains, see

For algorithmic issues in detecting reducibility and periodicity of a Markov chain, see, for example,

from which we draw some examples below.

In [1]:
using Plots
using QuantEcon
using StatsBase
In [2]:
plotlyjs()