Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I would like to ask if any of you know of a good resource containing rigorous proof (using sigma-algebras) of Markov Property and Strong Markov Property respectively in terms of Discrete Time Markov Chains.

(All resources I have found dealt with Continuous Time Markov Chains or with discrete MP/SMP in terms of Brownian Motion.)

Thanks, C.

share|improve this question
add comment

2 Answers

up vote 0 down vote accepted

Varadhan's "Probability Theory" has a proof of the SMP for discrete-time chains.

share|improve this answer
    
You might also want to look at Kai Lai Chung's text as well, which spends some time looking at discrete MC's. –  A Blumenthal Feb 26 '13 at 19:32
    
Thank you, that's just what I've been looking for. –  Carlos Feb 26 '13 at 20:03
add comment

See Theorem 6.3.4. of Probability: Theory and Applications (4th edition) by Richard Durrett.

Also, a very accessible proof is found in Theorem 1.4.2 of Markov Chains by J.R. Norris.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.