23
$\begingroup$

Which is a good introductory book for Markov chains and Markov processes?

Thank you.

$\endgroup$
2
  • $\begingroup$ See also math.stackexchange.com/questions/27514/… $\endgroup$
    – user940
    Commented Nov 21, 2011 at 5:03
  • 4
    $\begingroup$ I think it would be very helpful if you would write something about your background. Are you famliar with measure theoretic probability? Are you mainly interested in finite Markov chains? $\endgroup$ Commented May 11, 2012 at 18:39

5 Answers 5

5
$\begingroup$

Theory of Markov Processes by Eugene Dynkin is a paperback published by Dover, so it has the advantage of being inexpensive. The author has made many contributions to the subject. Dynkin's lemma, the Dynkin diagram and the Dynkin system are named after him.

$\endgroup$
4
$\begingroup$

"An Introduction to Stochastic Modeling" by Karlin and Taylor is a very good introduction to Stochastic processes in general. Bulk of the book is dedicated to Markov Chain. This book is more of applied Markov Chains than Theoretical development of Markov Chains. This book is one of my favorites especially when it comes to applied Stochastics.

$\endgroup$
1
$\begingroup$

An Introduction to Markov Chain Analysis and An Introduction to Markov Processes would be a good start.

$\endgroup$
1
$\begingroup$

A foundational paper is :

An Introduction to Hidden Markov Models - Rabiner 1986

which explains the processes from first principles which is sadly rare on academic papers.

$\endgroup$
1
$\begingroup$

Allen, Arnold O.: "Probability, Statistics, and Queueing Theory with Computer Science Applications", Academic Press, Inc., San Diego, 1990 (second Edition)

This is a very good book including some chapters about Markov chains, Markov processes and queueing theory.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .