Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

For a Markov chain $\{X_n, n\ge0\}$ with transition probabilities $P_{i,j}$, consider the conditional probability that $X_n = m$ given that the chain started at time $0$ in state $i$ and has not entered state $r$ by time $n$, where $r$ is a specified state not equal to either $i$ or $m$. We are interested in whether this conditional probability is equal to the $n$ stage transition probability of a Markov Chain whose state space does not include state $r$ and whose transition probabilities are

$$Q_{i,j} = \frac{P_{i,j}}{1 - P_{i,r}}, i,j \neq r$$

We want to either prove the equality

$$P\{ X_n = m \mid X_0 = i, X_k \neq r, k = 1,\dots, n\} = Q_{i,m}^n$$

or provide a counter example.

Initially I thought that the two quantities are equal, but later I was able to find a counterexample, but still is not able to get the intuition behind the two quantities not being equal.

share|improve this question
@joriki : To some folks this seems intuitively correct. Please visit the link mathoverflow.net/questions/117182/a-problem-on-dtmc. –  sosha Dec 26 '12 at 14:37
Sorry, my comment was wrong; I've removed it. You should have linked to the cross-post at MO right away instead of wasting my time with a question that had already been answered elsewhere. And you still haven't linked to this thread at MO. –  joriki Dec 26 '12 at 15:21
add comment

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.