Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I am studying Bayesian Networks. Given that variables:
$W$: Wet grass
$R$: Rain
$S$: Sprinkler

I know the probabilities of:

$P(S | C)$
$P(S | !C)$
$P(R | C)$
$P(R | !C)$
$P(W | R,S)$
$P(W | R,!S)$
$P(W | !R,S)$
$P(W | !R,!S)$

with them how can I calculate:

$P(R|W) = ?$


$P(R|S, W) = ?$

Here is my Bayesian Network:

enter image description here

PS: I could calculate P(S) and P(R). If anybody can just show me how to find P(R|S) I may solve this question.

share|improve this question
I don't know the terms. Is that conditional independence or etc.? That's why I am asking this as a question because it is not clear when searching on Internet about it. –  kamaci Nov 10 '12 at 18:04
The $|$ means conditional probability. It doesn't have anything to do with independence. –  Jonathan Christensen Nov 10 '12 at 19:50
This is worked out in the WEKA book, isn't it? –  Hans Engler Nov 17 '12 at 15:32

2 Answers 2

up vote 0 down vote accepted

The key thing to remember here is the defining characteristic of a Bayesian network, which is that each node only depends on its predecessors and only affects its successors. This can be expressed through the local Markov property: each variable is conditionally independent of its non-descendants given the values of its parent variables. In this case, that means that $S$ and $R$ are conditionally independent given $C$: $$P[R=r\wedge S=s \;\vert\; C=c]=P[R=r \;\vert\; C=c]\cdot P[S=s \;\vert\; C=c],$$ for any truth values $r,s,c$. With this in hand, you can calculate any conditional probability you want. For example, $$ P[R|S]=\frac{P[RS]}{P[S]}=\frac{P[RS | C]P[C] + P[RS| !C]P[!C]}{P[S|C]P[C]+P[S|!C]P[!C]}=\frac{P[R|C]P[S|C]P[C]+P[R|!C]P[S|!C]P[!C]}{P[S|C]P[C]+P[S|!C]P[!C]}.$$

share|improve this answer
This looks like what exactly I want. Thanks. Can you offer me a formula for calculating P(W) with that rule? –  kamaci Nov 16 '12 at 21:18
@kamaci: To calculate $P[W]$, you would sum over the four possible combinations of the parent variables: $P[W] = P[W|RS]P[RS] + P[W|R!S]P[R!S] + P[W|!R,S]P[!R,S]+P[W|!R,!S]P[!R,!S]$. –  mjqxxxx Nov 19 '12 at 22:53

$P(S|W)$ isn't determined by that information. Consider the following probabilities:

$$ \begin{array}{r|cccc} &RS&!RS&R!S&!R!S\\\hline W&a&b&c&d\\ !W&e&f&g&h \end{array} $$

You know $a/(a+e)$, $b/(b+f)$, $c/(c+g)$, $d/(d+h)$ and $a+b+e+f$, and you want to know $(a+b)/(a+b+c+d)$. But we can change $c+d$ while keeping $a+b$ and everything you know fixed, and thus we can change $(a+b)/(a+b+c+d)$ while keeping everything you know fixed.

For instance, the probabilities

$$ \begin{array}{r|cccc} &RS&!RS&R!S&!R!S\\\hline W&0.1&0.1&0.1&0.2\\ !W&0.1&0.1&0.2&0.1 \end{array} $$

lead to the same given values as

$$ \begin{array}{r|cccc} &RS&!RS&R!S&!R!S\\\hline W&0.1&0.1&0.15&0.1\\ !W&0.1&0.1&0.3&0.05 \end{array} $$

but to different values of $P(S|W)$.

share|improve this answer
You say that: P(W)=P(W|R,S)+P(W|!R,S)+P(W|R,!S)+P(W|!R,!S) I got this point. However I didn't understand how could you find P(S)P(W|S) as like that? –  kamaci Nov 11 '12 at 15:34
Apologies for the original incorrect answer; I've replaced it by one that's hopefully correct. –  joriki Nov 11 '12 at 16:23
Is there any tutorial to explain how to rewrite P(W|R,S) with another form? –  kamaci Nov 11 '12 at 18:13
is that equation: P(R|S) = P(S) true? –  kamaci Nov 11 '12 at 18:29
If R and S are independent then it is true. You didn't specify in your post whether they were independent or not, though. –  Jonathan Christensen Nov 11 '12 at 22:04

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.