Which is a good introductory book for Markov chains and Markov processes?
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It only takes a minute to sign up.Sign up to join this community
Theory of Markov Processes by Eugene Dynkin is a paperback published by Dover, so it has the advantage of being inexpensive. The author has made many contributions to the subject. Dynkin's lemma, the Dynkin diagram and the Dynkin system are named after him.
"An Introduction to Stochastic Modeling" by Karlin and Taylor is a very good introduction to Stochastic processes in general. Bulk of the book is dedicated to Markov Chain. This book is more of applied Markov Chains than Theoretical development of Markov Chains. This book is one of my favorites especially when it comes to applied Stochastics.