1
vote
3answers
44 views

Can this conditional probability be answered using Bayesian Theorem (or at all) with the information given

I have a conditional probability problem I'm unsure can be answered given the information I have - as such I'm unsure if Bayesian Theorem is the way to answer it, or if the answer is staring at me in ...
1
vote
0answers
21 views

Infinite fourth moment and maximum entropy

Alright, I expect this is a silly question, but I don't actually know, so. Suppose there is some random variable that's distributed on the reals, and all I know about the distribution is its mean ...
0
votes
1answer
26 views

Need help with P(D) in a Bayesian model

So I've been reading about Bayesian models so I tried I'd have a toy example I could play with. Consider the following: You are at a bus stop and you observe the bus arriving at various times $t_1, ...
0
votes
0answers
28 views

Countable Baye's theorem?

Disclaimer: If this is a foolish question, I'm sorry.. this is the first time I've looked at probability theory in very many years, and have begun to re-read everything from scratch... Question: If ...
2
votes
1answer
52 views

Jaynes' taxicab problem

I am currently reading Jaynes' Probability Theory, The Logic of Science and am still trying to absorb everything. On page 190, he poses the following intriguing question, paraphrased here. Suppose ...
1
vote
2answers
41 views

Betting: Gambler's Fallacy vs. Law of Large Numbers

I know this has been asked before, but I think not in this exact way, so here goes: Suppose you're going to bet on the flip of a coin. Your bet is always "HEADS", but the amount of your bet may vary, ...
-1
votes
0answers
23 views

learning phenomena in bayesian technique

I have identified using bayesian method for my auto tagging application. I am dealing with user facebook post. Post belongs to ...
1
vote
0answers
33 views

How would I analyze the accuracy of a model that predicts World Cup matches?

Say, someone made a bunch of predictions for each game between Team A and Team B, such that there's a predicted probability for each of the three possible outcomes adding up to $1.0$ : Team A winning, ...
3
votes
4answers
66 views

Bayes, two tests in a row

I came up with a standard Bayesian example as to point out my confusion. There is an epidemic. A person has a probability $\frac{1}{100}$ to have the disease. The authorities decide to test the ...
1
vote
1answer
36 views

Confusion in Posterior Probability Calculation

I know posterior probability as, $P(\theta|x)= [(P(x|\theta)*(P(\theta))/(P(x))]$, as given in http://en.wikipedia.org/wiki/Posterior_probability I am slightly confused with the term ...
0
votes
1answer
29 views

Bayes - bias of a coin

struggling with a basic question on the bias of a coin. Assume that i believe, as prior, that a coin is 40% probable to be fair and 60% probable to be unfair, with the estimated prior bias following a ...
3
votes
2answers
80 views

A house is guarded by two alarms

I am trying to wrap my head around the following problem A house is guarded by two alarms. If Alarm 1 fires, p(theft) = 80% If Alarm 2 fires, p(theft) = 70% If both alarms fire at the same time, ...
1
vote
1answer
19 views

Bayes with conditional independence

I have a problem that I can't work out I've two conditional independent A,B such as $P(A,B|C) = P(A|C)P(B|C)$ Now I've to find posterior formula for: $P(C | A,B)$, now what I got was pretty ...
0
votes
1answer
21 views

What is this distribution formulated with w, m and sum sign?

I have a binary classification problem, part of which is defined as follows : p(x|y=1) $\sim w (m_1 , \sum_1$) and p(x|y=0) $\sim w (m_0 , \sum_0$) Where $\sum_1$ is a covariance matrix : $$ ...
0
votes
1answer
38 views

Why a beta distribution with the parameters $\alpha=0$ and $\beta=0$ as a prior is bad

what happened if I define a beta distribution with $\alpha=0$ and $\beta=0$ as a prior? in other words if $p(\theta) \varpropto \frac{1}{\theta(1-\theta)}$. Thanks
0
votes
0answers
49 views

Marginal and conditional probability table without joint probability table

I've a Bayesian network, with discrete node values: for every node I've the conditional probability table $p(A|B)$, where $A$ is the node itself and $B$ is the set of the parents nodes. Now I would ...
2
votes
2answers
49 views

Bayesian learning for input “If A, then B.”

Can anyone point me to literature on Bayesian learning when the new information has the form “If A, then B”? I’m familiar with the rule that after one learns X, posterior probability P(Y) equals prior ...
0
votes
0answers
25 views

How do I prove and expand Bayesian Networks?

Attempting to understand Exercise 20 (pdf page 44) in the paper: (Warning: large paper; small exercise) Bayesian Reasoning and Machine Learning The party animal problem corresponds to the ...
2
votes
0answers
42 views

Does this question work with Bayes formula?

Looking at slide 11, Example 1.10 from: http://www-users.aston.ac.uk/~cornford/probmod/ProbMod310810_Ch1.pdf Luke has been told he’s lucky and has won a prize in the lottery. There are 5 prizes ...
0
votes
1answer
13 views

Probability of one node given all the others in a bayes network

For a bayes network which has $n$ nodes, $X_1, X_2, ... , X_n$. Is there any efficient way to calculate $P(X_i|X_1,X_2,...,X_{i-1},X_{i+1},...X_n)$, without constructing the full joint distribution?
2
votes
1answer
79 views

Bayes factor and Posterior odds

Consider the following posterior odds \begin{equation*} \frac{P(H|D_1,D_2)}{P(\overline{H}|D_1,D_2)}=\frac{P(D_2|H,D_1)\times P(D_1|H)P(H)}{P(D_2|\overline{H},D_1)\times ...
0
votes
1answer
44 views

determining maximum a posteriori (MAP) hypothesis

I have this problem: You are given a coin that may or may not be biased. Specifically, you have three hypotheses about the coin: ...
0
votes
0answers
85 views

Bayes' Theorem Question, with a twist

I have a very old past high school exam question I am trying to solve (for interest only). It's a straightforward application of Bayes' Theorem, with the last part of the question containing a slight ...
1
vote
1answer
35 views

When using Bayes Rule, what are the rules for flipping the conditions and the event of interest?

Here is Bayes Rule: $$P(A\mid B) = \frac{P(B\mid A) P(A)}{P(B)}$$ This paper (http://www.cogsci.northwestern.edu/Bayes/Sivia_1996.pdf) uses Bayes rule on page 21 in the context of model selection ...
0
votes
0answers
19 views

Bayesian Network understanding

I am confused by the definition of Bayesian Network. It's well know that graph $G$ of Bayesian Network can be viewed in two very different ways: As a data structure that provides the skeleton for ...
0
votes
0answers
43 views

Monty Hall Problem Extended Using Bayes's Theory

I know there is a question on the website concerning the extension of the monty hall problem. The question is provided with very good answers given by the participants on the website which I would ...
1
vote
0answers
46 views

Monty Hall Problem Solve Using Detailed Algebra

I have been searching the monty hall problem for two days now and I generally understand it but I am having a very hard time solving the monty hall problem using Bayes's theory. I do not know what ...
2
votes
0answers
19 views

Is this problem suited for Bayesian inference?

Suppose that the quality of a widget is distributed according to a score, given by a normal distribution with mean 1 and variance σ^2. A fraction, π of all widgets are defective. The cost of having an ...
1
vote
3answers
64 views

Probability of independent events $P(ab)=P(a)*P(b)$

I know there are two ways to say event $a$ and $b$ are independent: $P(a)*P(b)=P(ab)$ $P(a\mid b)=P(a)$ and I can derive one from the other with the Bayes Formula $P(a|b)=P(ab)/P(b)$. My question ...
1
vote
1answer
26 views

Conditional probability with bayes rule??

http://cseweb.ucsd.edu/~dasgupta/103/2b.pdf part 2.1.2 implies $P(X|Y \cap Z) = \frac{P(X|Y)}{P(Y|Z)}$ Seems to imply that this is true but if you take bayes, the left hand side is: $P(X|Y \cap Z) = ...
3
votes
2answers
77 views

Conjugate priors make calculations easier but at what cost to the model?

As I understand, when we have a parametric pdf and need to estimate the parameter based on some observed fact, we tend to choose a conjugate prior of the pdf for the parameter. Because conjugate prior ...
0
votes
0answers
26 views

How many numbers for the full joint?

Suppose you have 3 binary nodes A, B, C. A and B are independent given C. How many numbers do we need for the full joint? How many numbers do we need for the Baysesian Net? I know the answers to ...
0
votes
0answers
15 views

What happens if the recursive bayes is performed without updating the data?

With a relatively good prior, and recursive Bayes' is performed with new data every iteration, the posterior converges to the real value, under ideal circumstances. But what happens if recursive ...
0
votes
0answers
19 views

Estimating the magnitude of a change in a non-stationary stochastic process

In this paper by Adams and MacKay, they present an algorithm for the online detection of change-points in a stochastic process subject to some hypotheses. Their algorithm gives both the predictive ...
2
votes
3answers
103 views

Questions about Bayesian inference

From Wikipedia The prior distribution is the distribution of the parameter(s) before any data is observed, i.e. $p(\theta \mid \alpha )$. ... The sampling distribution is the distribution of ...
2
votes
1answer
76 views

Probability - when there is an argument between experts?

A, B and C are all expert doctors. When each of them (individually) gives a diagnosis (in a yes/no question), the chance of accuracy is 90%, or 9/10. In a case where A and B argue for a certain ...
0
votes
0answers
40 views

Poisson distribution probability from a single measurement

This question came up while reading a medical paper - the study showed $m_1$ out of $n_1$ people doing $X_1$ died, while only $m_2$ out of $n_2$ people died when doing $X_2$. I'm trying to ...
1
vote
1answer
46 views

What am I doing wrong in calculating Fisher Information of Triangular Distribution?

I am trying to find Jeffrey's prior for the Triangular distribution which has the following probability density function: $$f(x\mid \theta) = \begin{cases} \dfrac{2x}{\theta} & : x ...
1
vote
0answers
49 views

Posterior predictive distribution in a Bernoulli process.

Suppose there are $k$ successes in a Bernoulli population $ X = \{x_1, \ldots, x_n\}$. I would like to calculate the posterior predictive distribution $f(x | X)$ where $x = \{0,1\}$. I assume the ...
3
votes
0answers
27 views

If $P(B\text{ }|\text{ }A)=1-\epsilon$ and $P(C\text{ }|\text{ }B)=1$ then $P(C\text{ }|\text{ }A)\geq 1-\epsilon$ [duplicate]

If $$1=P(C\text{ }|\text{ }B)=\frac{P(C\cap B)}{P(B)}$$ then we know that $P(C\cap B)=P(B)$. If $P(B\text{ }|\text{ }A)=1-\epsilon$ for $\epsilon\geq 0$ then $$P(A)=\frac{P(B\cap ...
1
vote
2answers
31 views

Wordy Bayesian Question

Five million boys below the age of five live in Erewon. The priests of Erewon are sure that one of them (chosen by fate at random) embodies the spirit of Captain Coin Tosser, who can predict heads or ...
0
votes
1answer
74 views

Calculate the posterior probability of the disease

Suppose the prior probability of the germ carrier is 10%. When in tests, germ carriers have the probability of $95\%$ to give positive results and $5\%$ to give negative; non-germ carriers have the ...
1
vote
0answers
22 views

Estimating variance from a combination of processes

I am fiddling with some Bayesian probabilities for some astronomical data analysis. I have a ccd image and am testing the null hypothesis (no signal is present - all contributions due to noise) on it. ...
1
vote
0answers
89 views

Interpreting Bayes' thereom with density functions

I'm studying about Bayes' theorem and according to the theorem: $$P(A\mid B) = \frac{P(B\mid A)P(A)}{P(B)}$$ This I can understand where it comes from etc. But if I use Bayes' theorem on density ...
0
votes
1answer
32 views

Uniform prior distribution multiple results

When I have a simple Bernoulli trial with a certain variable taking, for instance, values 0 and 1, I have a constant prior distribution for the $\theta$ parameter, i.e. pdf $p(\theta) = 1$ between 0 ...
2
votes
0answers
86 views

Maximum Posterior: $ p(\bf{w}\mid\bf{x},\bf{t},\alpha,\beta) \propto p(\bf{t}\mid\bf{x},\bf{w},\beta)p(\bf{w}\mid\alpha) $ for Gaussian Distribution

At the moment I take a look at the book Pattern Recognition and Machine Learning from Christopher Bishop and as I try to understand the basics of the probability theory I get stuck trying to ...
3
votes
1answer
502 views

Bayesian posterior with truncated normal prior

Suppose we observe one draw from the random variable $X$, which is distributed with normal distribution $\mathcal{N}(\mu,\sigma^2)$. The variance $\sigma^2$ is known, $\mu$ isn't. We want to estimate ...
1
vote
1answer
34 views

Posterior distribution as a distribution for a new random variable?

So in Bayesian framework one uses observed data $X=\{x_1,\dots,x_n\}$ to update the prior $p(\theta)$. My question is it justified mathematically to say that $p(\theta\mid x_1,\dots,x_n)$ corresponds ...
0
votes
1answer
40 views

Reversing a conditional probability

If I'm given a P(X|Y) table and P(Y), how can I find P(Y|X)? I understand that $P(Y|X)=\frac{P(X|Y)P(Y)}{P(X)}$ but how do i find P(X)? Furthermore, If i'm told that random variable X is given a ...
1
vote
1answer
48 views

Please explain to me why $ \int_b p(a|b) db \neq p(a) $

I have one question that bugs me. How is it that: $ \int_a p(a|b) da = \int_a \frac{p(a,b)}{p(b)} da = 1 $ but $ \int_b p(a|b) db = \int_b \frac{p(a,b)}{p(b)} db \neq p(a) $ I don't understand ...