0
votes
1answer
28 views

How to compute this conditional probability in Bayesian Networks?

I met a problem related to conditional probability from the article "Bayesian Networks without Tears"(download) on page 3. According to the Figure 2, the author says $$P(fo=yes|lo=true, ...
0
votes
1answer
16 views

Does the parameter change during data generation in Bayesian Inference?

Let's assume that we have the following graphical model: This graph encodes the joint distribution $P(p,x_1,x_2,x_3,x_4) = P(p)\prod_{i=1}^{4}P(x_i|p)$. In the Bayesian inference, if we know ...
1
vote
0answers
49 views

Is my interpretation of Bayesian probability and inference correct?

I have the following interpretation of the Bayesian probability and inference (without referring to Measure Theory, I am still at the very beginning of learning it): Let's say we have five random ...
-3
votes
1answer
33 views

Derive/ prove: p(a,b|c) = p(a|b,c).p(b|c)

How can this expression be derived? p(a,b|c) = p(a|b,c).p(b|c) where a,b,c are random variables. UPDATE: from the following ...
1
vote
1answer
37 views

Question about the Bayesian Inference of a parameter

In order to understand the difference between the Frequentist and Bayesian inference, I was reading the presentation at: http://www.stat.ufl.edu/archived/casella/Talks/BayesRefresher.pdf . In order to ...
0
votes
1answer
45 views

solving a simple inverse problem related to elliptic pde

Suppose that I have the elliptic PDE $\nabla(\nabla A(x)\cdot U(x)) = 0$ where $x \in [0,l_1]\times [0,l_2]$ with boundary conditions $U(0,x_2) = 0, U(l_1,x_2)=1$ and $U_{x_1}(x_1,0)=0, ...
0
votes
0answers
27 views

Bayes Theorem with multiple observations

Let $H \in \{1,..,K\}$ be a discrete random variable and $e_1, e_2$ be observed values of 2 other random variable $E_1$ and $E_2$. We wish to calculate the vector ...
1
vote
2answers
62 views

rationalwiki on “Extraordinary claims require extraordinary evidence”

I don't have a strong background in probability/statistics and I'm trying to understand the example at ...
2
votes
2answers
43 views

How to find out number of possible outcomes by trying over and over?

While working on my network exploration tool project, I've ran across the problem of reliably determining number of possible exit addresses of a tunnel with single entrance. I've came up with ...
2
votes
1answer
48 views

Strange conditional probability problem

Not sure if this problem even makes sense, but anyway: Lets say you have a button which switches on a light. The light lights green with probability $p$ and red with probability $1-p$. If you push ...
1
vote
0answers
17 views

Assessing goodness of fit in Bayesian framework

I am following a Bayesian approach (specifying an underlying class of models and a prior) in order to produce a predictive distribution of some quantity. The question I am troubled with is: how can I ...
1
vote
0answers
39 views

Bayesian probability re: people vs. coins

Imagine you're a court clerk recording information about court appearances in a munincipal court. Past records show that on a typical day in this court, in 50% of criminal cases heard, the accused ...
1
vote
3answers
49 views

Can this conditional probability be answered using Bayesian Theorem (or at all) with the information given

I have a conditional probability problem I'm unsure can be answered given the information I have - as such I'm unsure if Bayesian Theorem is the way to answer it, or if the answer is staring at me in ...
1
vote
0answers
26 views

Infinite fourth moment and maximum entropy

Alright, I expect this is a silly question, but I don't actually know, so. Suppose there is some random variable that's distributed on the reals, and all I know about the distribution is its mean ...
0
votes
1answer
29 views

Need help with P(D) in a Bayesian model

So I've been reading about Bayesian models so I tried I'd have a toy example I could play with. Consider the following: You are at a bus stop and you observe the bus arriving at various times $t_1, ...
0
votes
0answers
29 views

Countable Baye's theorem?

Disclaimer: If this is a foolish question, I'm sorry.. this is the first time I've looked at probability theory in very many years, and have begun to re-read everything from scratch... Question: If ...
2
votes
1answer
55 views

Jaynes' taxicab problem

I am currently reading Jaynes' Probability Theory, The Logic of Science and am still trying to absorb everything. On page 190, he poses the following intriguing question, paraphrased here. Suppose ...
1
vote
2answers
43 views

Betting: Gambler's Fallacy vs. Law of Large Numbers

I know this has been asked before, but I think not in this exact way, so here goes: Suppose you're going to bet on the flip of a coin. Your bet is always "HEADS", but the amount of your bet may vary, ...
1
vote
0answers
33 views

How would I analyze the accuracy of a model that predicts World Cup matches?

Say, someone made a bunch of predictions for each game between Team A and Team B, such that there's a predicted probability for each of the three possible outcomes adding up to $1.0$ : Team A winning, ...
3
votes
4answers
66 views

Bayes, two tests in a row

I came up with a standard Bayesian example as to point out my confusion. There is an epidemic. A person has a probability $\frac{1}{100}$ to have the disease. The authorities decide to test the ...
1
vote
1answer
36 views

Confusion in Posterior Probability Calculation

I know posterior probability as, $P(\theta|x)= [(P(x|\theta)*(P(\theta))/(P(x))]$, as given in http://en.wikipedia.org/wiki/Posterior_probability I am slightly confused with the term ...
0
votes
1answer
30 views

Bayes - bias of a coin

struggling with a basic question on the bias of a coin. Assume that i believe, as prior, that a coin is 40% probable to be fair and 60% probable to be unfair, with the estimated prior bias following a ...
3
votes
2answers
81 views

A house is guarded by two alarms

I am trying to wrap my head around the following problem A house is guarded by two alarms. If Alarm 1 fires, p(theft) = 80% If Alarm 2 fires, p(theft) = 70% If both alarms fire at the same time, ...
1
vote
1answer
21 views

Bayes with conditional independence

I have a problem that I can't work out I've two conditional independent A,B such as $P(A,B|C) = P(A|C)P(B|C)$ Now I've to find posterior formula for: $P(C | A,B)$, now what I got was pretty ...
0
votes
1answer
21 views

What is this distribution formulated with w, m and sum sign?

I have a binary classification problem, part of which is defined as follows : p(x|y=1) $\sim w (m_1 , \sum_1$) and p(x|y=0) $\sim w (m_0 , \sum_0$) Where $\sum_1$ is a covariance matrix : $$ ...
0
votes
1answer
45 views

Why a beta distribution with the parameters $\alpha=0$ and $\beta=0$ as a prior is bad

what happened if I define a beta distribution with $\alpha=0$ and $\beta=0$ as a prior? in other words if $p(\theta) \varpropto \frac{1}{\theta(1-\theta)}$. Thanks
0
votes
0answers
54 views

Marginal and conditional probability table without joint probability table

I've a Bayesian network, with discrete node values: for every node I've the conditional probability table $p(A|B)$, where $A$ is the node itself and $B$ is the set of the parents nodes. Now I would ...
2
votes
2answers
49 views

Bayesian learning for input “If A, then B.”

Can anyone point me to literature on Bayesian learning when the new information has the form “If A, then B”? I’m familiar with the rule that after one learns X, posterior probability P(Y) equals prior ...
0
votes
0answers
26 views

How do I prove and expand Bayesian Networks?

Attempting to understand Exercise 20 (pdf page 44) in the paper: (Warning: large paper; small exercise) Bayesian Reasoning and Machine Learning The party animal problem corresponds to the ...
2
votes
0answers
42 views

Does this question work with Bayes formula?

Looking at slide 11, Example 1.10 from: http://www-users.aston.ac.uk/~cornford/probmod/ProbMod310810_Ch1.pdf Luke has been told he’s lucky and has won a prize in the lottery. There are 5 prizes ...
0
votes
1answer
13 views

Probability of one node given all the others in a bayes network

For a bayes network which has $n$ nodes, $X_1, X_2, ... , X_n$. Is there any efficient way to calculate $P(X_i|X_1,X_2,...,X_{i-1},X_{i+1},...X_n)$, without constructing the full joint distribution?
2
votes
1answer
80 views

Bayes factor and Posterior odds

Consider the following posterior odds \begin{equation*} \frac{P(H|D_1,D_2)}{P(\overline{H}|D_1,D_2)}=\frac{P(D_2|H,D_1)\times P(D_1|H)P(H)}{P(D_2|\overline{H},D_1)\times ...
0
votes
1answer
46 views

determining maximum a posteriori (MAP) hypothesis

I have this problem: You are given a coin that may or may not be biased. Specifically, you have three hypotheses about the coin: ...
0
votes
0answers
87 views

Bayes' Theorem Question, with a twist

I have a very old past high school exam question I am trying to solve (for interest only). It's a straightforward application of Bayes' Theorem, with the last part of the question containing a slight ...
1
vote
1answer
37 views

When using Bayes Rule, what are the rules for flipping the conditions and the event of interest?

Here is Bayes Rule: $$P(A\mid B) = \frac{P(B\mid A) P(A)}{P(B)}$$ This paper (http://www.cogsci.northwestern.edu/Bayes/Sivia_1996.pdf) uses Bayes rule on page 21 in the context of model selection ...
0
votes
0answers
19 views

Bayesian Network understanding

I am confused by the definition of Bayesian Network. It's well know that graph $G$ of Bayesian Network can be viewed in two very different ways: As a data structure that provides the skeleton for ...
0
votes
0answers
44 views

Monty Hall Problem Extended Using Bayes's Theory

I know there is a question on the website concerning the extension of the monty hall problem. The question is provided with very good answers given by the participants on the website which I would ...
1
vote
0answers
46 views

Monty Hall Problem Solve Using Detailed Algebra

I have been searching the monty hall problem for two days now and I generally understand it but I am having a very hard time solving the monty hall problem using Bayes's theory. I do not know what ...
2
votes
0answers
20 views

Is this problem suited for Bayesian inference?

Suppose that the quality of a widget is distributed according to a score, given by a normal distribution with mean 1 and variance σ^2. A fraction, π of all widgets are defective. The cost of having an ...
1
vote
3answers
67 views

Probability of independent events $P(ab)=P(a)*P(b)$

I know there are two ways to say event $a$ and $b$ are independent: $P(a)*P(b)=P(ab)$ $P(a\mid b)=P(a)$ and I can derive one from the other with the Bayes Formula $P(a|b)=P(ab)/P(b)$. My question ...
1
vote
1answer
28 views

Conditional probability with bayes rule??

http://cseweb.ucsd.edu/~dasgupta/103/2b.pdf part 2.1.2 implies $P(X|Y \cap Z) = \frac{P(X|Y)}{P(Y|Z)}$ Seems to imply that this is true but if you take bayes, the left hand side is: $P(X|Y \cap Z) = ...
3
votes
2answers
79 views

Conjugate priors make calculations easier but at what cost to the model?

As I understand, when we have a parametric pdf and need to estimate the parameter based on some observed fact, we tend to choose a conjugate prior of the pdf for the parameter. Because conjugate prior ...
0
votes
0answers
26 views

How many numbers for the full joint?

Suppose you have 3 binary nodes A, B, C. A and B are independent given C. How many numbers do we need for the full joint? How many numbers do we need for the Baysesian Net? I know the answers to ...
0
votes
0answers
18 views

What happens if the recursive bayes is performed without updating the data?

With a relatively good prior, and recursive Bayes' is performed with new data every iteration, the posterior converges to the real value, under ideal circumstances. But what happens if recursive ...
0
votes
0answers
19 views

Estimating the magnitude of a change in a non-stationary stochastic process

In this paper by Adams and MacKay, they present an algorithm for the online detection of change-points in a stochastic process subject to some hypotheses. Their algorithm gives both the predictive ...
2
votes
3answers
109 views

Questions about Bayesian inference

From Wikipedia The prior distribution is the distribution of the parameter(s) before any data is observed, i.e. $p(\theta \mid \alpha )$. ... The sampling distribution is the distribution of ...
2
votes
1answer
76 views

Probability - when there is an argument between experts?

A, B and C are all expert doctors. When each of them (individually) gives a diagnosis (in a yes/no question), the chance of accuracy is 90%, or 9/10. In a case where A and B argue for a certain ...
0
votes
0answers
40 views

Poisson distribution probability from a single measurement

This question came up while reading a medical paper - the study showed $m_1$ out of $n_1$ people doing $X_1$ died, while only $m_2$ out of $n_2$ people died when doing $X_2$. I'm trying to ...
1
vote
1answer
47 views

What am I doing wrong in calculating Fisher Information of Triangular Distribution?

I am trying to find Jeffrey's prior for the Triangular distribution which has the following probability density function: $$f(x\mid \theta) = \begin{cases} \dfrac{2x}{\theta} & : x ...
2
votes
0answers
52 views

Posterior predictive distribution in a Bernoulli process.

Suppose there are $k$ successes in a Bernoulli population $ X = \{x_1, \ldots, x_n\}$. I would like to calculate the posterior predictive distribution $f(x | X)$ where $x = \{0,1\}$. I assume the ...