2-dimensional hidden markov
3-dimensional Markov chain
absorbing Markov process
adaptive Markov parameter
asynchronous hidden Markov model
average reward Markov decision process
Bayesian Markov decision process
Bernstein-Markov inequality
binary Markov random field