The _master equation_ for the Markov chain is a vector differential equation:

\$\Gamma_{\sigma}'(t) = H(\Gamma_{\sigma}(t))\$

where \$$H\$$ is a linear operator to be constructed from the weighted graph for the Markov chain.