Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

After answering the question Expectation of a stopping time uniquely determined by a function I was looking for the literature on the mean hitting/exit time for a discrete-time Markov process. In Meyn and Tweedie, Durett and some other books I haven't find such an information. Google also didn't help much for the discrete-time setting.

I guess that for the uncountable state space, mean hitting time equation shares the same properties as for the countable state space - but I would prefer to read a book chapter on this topic.

Dynkin briefly discussed it, though for the continuous time and too briefly.

share|improve this question

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.