2-dimensional hidden markov
3-dimensional Markov chain
absorbing Markov process
adaptive Markov parameter
asynchronous hidden Markov model
average reward Markov decision process
Bayesian Markov decision process
binary Markov random field
birth and death chain in Markov environment
birth and death Markov chain Moner Carlo
cascade connection hidden Markov model