Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Suppose that we have an ergodic finite Markov chain $C$ with a fintie state space $S$, and we have random variables $X_s$ where $s\in S$. Consider the following random walk

$S_0=0$ and $S_{i+1}=S_i +X_{C_i}$.

(In words, the random walk $S$ is somehow time-inhomogeneous.)

Is the property of this random walk well studied? Can I get some reference. Thanks.

share|improve this question
    
29271: Any luck with an answer below? –  Did May 7 '12 at 12:16
    
$\color{red}{\text{0% accept rate}}$ –  Did Sep 15 '12 at 4:31
add comment

2 Answers 2

up vote 2 down vote accepted

This model is called random walk in random scenery. It was introduced by Harry Kesten and Frank Spitzer in 1979 in their paper A limit theorem related to a new class of self similar processes and is an active research subject: see the book Random Walk in Random And Non-Random Environments by Pál Révész, and the survey by Frank den Hollander and Jeffrey E. Steif, somewhat more oriented towards the ergodic properties.

share|improve this answer
    
+1. Nice to know! –  Tim Apr 22 '12 at 14:46
add comment

Look for markov random walk or markov renewal process. It depends what you are interested in, but that latter are discussed briefly in Ross' probability models.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.