The approach and interpretation of probability associated with Bayes theorem; usually used as opposed to the frequentist approach. It can be seen as an extension of logic that enables reasoning with propositions whose truth or falsity is uncertain. A Bayesian probabilist starts with some prior ...

learn more… | top users | synonyms

1
vote
1answer
90 views

Bayesian Probability Question - Parameter Estimation

I would like help on the following question and I will show my work. Here is the question in my notes and I will follow up with my work: Q: Suppose a forest is segmented into strips, referred to as ...
0
votes
0answers
30 views

Is a prior distribution always a random probability measure?

Let $(\mathcal{X}, \mathcal{B})$ be a measurable space and let its probability measure be $P$. In Bayesian statistics, we may wish to define a prior $\mu$ on the space of all such probability ...
1
vote
0answers
19 views

Determining the liklihood in Baye's rule for parameter estimation

I have used Bayesian statistics in classes but what I am trying to do now is different than anything I have done in class. Previously, I was given information and certain numbers adn I could ...
0
votes
0answers
73 views

Monty Hall Problem Extended Using Bayes's Theory

I know there is a question on the website concerning the extension of the monty hall problem. The question is provided with very good answers given by the participants on the website which I would ...
1
vote
1answer
97 views

completing the square for matrices

I'd like to calculate the posterior distribution given the prior distribution $w\sim N(0,\Sigma_p)$ and the likelihood $y|X,w\sim N(X^\top w,\sigma_n^2I).$ Ignoring everything that does not contain ...
1
vote
0answers
63 views

Monty Hall Problem Solve Using Detailed Algebra

I have been searching the monty hall problem for two days now and I generally understand it but I am having a very hard time solving the monty hall problem using Bayes's theory. I do not know what ...
-1
votes
2answers
60 views

Help with Bayes's theory

I know how to use this form of the Bayes's theory : $P(A | B) = P(A ∩ B)/ P(B)$ But how do I use?: $P (A | B,C) = P (B | A,C) P(A | C)/ P(B | C)$ What does the comma mean? I know its a simple ...
0
votes
1answer
102 views

Finding a posterior distribution of an exponential distribution parameter theta

Suppose that $X_1, ... , X_n$ each have an exponential distribution with parameter $\theta$, and suppose that the prior for $\theta$ is an exponential distribution with parameter $\lambda$. Find the ...
2
votes
0answers
30 views

Is this problem suited for Bayesian inference?

Suppose that the quality of a widget is distributed according to a score, given by a normal distribution with mean 1 and variance σ^2. A fraction, π of all widgets are defective. The cost of having an ...
1
vote
3answers
105 views

Probability of independent events $P(ab)=P(a)*P(b)$

I know there are two ways to say event $a$ and $b$ are independent: $P(a)*P(b)=P(ab)$ $P(a\mid b)=P(a)$ and I can derive one from the other with the Bayes Formula $P(a|b)=P(ab)/P(b)$. My question ...
1
vote
0answers
54 views

Generalized Bayes Estimator

Consider a decision problem in which the model parameter, $\theta$, is any integer, the distribution for the integer observation, y, given $\theta$ is $P(y|\theta) = 1/3$ if $y \in [\theta - 1, \theta ...
1
vote
0answers
40 views

Why is the marginalized inverse-Wishart distribution not equal to the inverse-gamma distribution?

Given that the inverse-gamma distribution is the one-dimensional version of the inverse-Wishart distribution, why will (philosophically speaking) an inverse-Wishart distribution that originally has ...
0
votes
1answer
55 views

Give the Bayesian Posterior Mode

Suppose that $X_1, X_2, \ldots, X_n$ are IID Bernoulli random variables with success probability equal to an unknown parameter $\theta \in [0,1]$. Let $A$ and $B$ be nonnegative constants. If we ...
1
vote
1answer
38 views

Conditional probability with bayes rule??

http://cseweb.ucsd.edu/~dasgupta/103/2b.pdf part 2.1.2 implies $P(X|Y \cap Z) = \frac{P(X|Y)}{P(Y|Z)}$ Seems to imply that this is true but if you take bayes, the left hand side is: $P(X|Y \cap Z) = ...
3
votes
2answers
89 views

Conjugate priors make calculations easier but at what cost to the model?

As I understand, when we have a parametric pdf and need to estimate the parameter based on some observed fact, we tend to choose a conjugate prior of the pdf for the parameter. Because conjugate prior ...
0
votes
1answer
36 views

How many numbers for the full joint?

Suppose you have 3 binary nodes A, B, C. A and B are independent given C. How many numbers do we need for the full joint? How many numbers do we need for the Baysesian Net? I know the answers to ...
0
votes
1answer
35 views

In Bayesian approaches, comparing the approximated distribution and the true distribution

I'm asked to compare the distance of the approximated distribution and the true distribution in a Bayesian approach. While we used Laplace approximation to find the MAP of the target posterior ...
2
votes
3answers
145 views

Questions about Bayesian inference

From Wikipedia The prior distribution is the distribution of the parameter(s) before any data is observed, i.e. $p(\theta \mid \alpha )$. ... The sampling distribution is the distribution of ...
1
vote
1answer
59 views

Questions about Auctions

I am having a hard time figuring out a problem. In a first price auction with a reserve price R and values of the bidders are U[0,1], how do we find expected revenue given the strategy of both of them ...
2
votes
1answer
80 views

Probability - when there is an argument between experts?

A, B and C are all expert doctors. When each of them (individually) gives a diagnosis (in a yes/no question), the chance of accuracy is 90%, or 9/10. In a case where A and B argue for a certain ...
2
votes
2answers
114 views

Coin toss with unknown probability – Bayesian interpretation

I have observed a coin being tossed $n$ times. I do not know whether the coin is fair or not, but in every single toss I observed, the coin came up heads. What should my belief about $p$ (the ...
1
vote
1answer
172 views

Posterior Distribution with prior standard exponential (mean 1) and data distribution of poisson

So I have the likelihood being: $\prod^{n}_{i=1}(\frac{\lambda^{x}e^{-\lambda}}{x!})$ which is proportional to $\lambda^{\sum_{i=1}^{n}x_{i}}e^{-n\lambda}$ The prior is standard exponential ...
1
vote
0answers
35 views

Estimate distance between approximated posterior and true posterior

I'm working on a paper about using graphical models to do some prediction tasks with known observations. Since the model is complicated, finding the maximum a posteriori on the true posterior ...
1
vote
0answers
38 views

Does this Gamma posterior make sense?

quick question about the form of a posterior distribution. Suppose that $\theta \sim Gamma(a, b)$ and that, given $\theta$, $Y$ has CDF $$F(Y\mid\theta) = 1 - e^{-\theta(e^y - 1)},\quad ...
1
vote
1answer
60 views

What am I doing wrong in calculating Fisher Information of Triangular Distribution?

I am trying to find Jeffrey's prior for the Triangular distribution which has the following probability density function: $$f(x\mid \theta) = \begin{cases} \dfrac{2x}{\theta} & : x ...
2
votes
0answers
127 views

Posterior predictive distribution in a Bernoulli process.

Suppose there are $k$ successes in a Bernoulli population $ X = \{x_1, \ldots, x_n\}$. I would like to calculate the posterior predictive distribution $f(x | X)$ where $x = \{0,1\}$. I assume the ...
0
votes
1answer
51 views

Bayesian Predictive distribution with two marginal posteriors

If we have a random variable $Y$ with pdf $P(Y|a,b)$, where $a$ and $b$ are parameters (with range $0$ to $\infty$). As well as marginal posterior distributions for $a$ and $b$, these are $P(a\vert ...
3
votes
0answers
27 views

If $P(B\text{ }|\text{ }A)=1-\epsilon$ and $P(C\text{ }|\text{ }B)=1$ then $P(C\text{ }|\text{ }A)\geq 1-\epsilon$ [duplicate]

If $$1=P(C\text{ }|\text{ }B)=\frac{P(C\cap B)}{P(B)}$$ then we know that $P(C\cap B)=P(B)$. If $P(B\text{ }|\text{ }A)=1-\epsilon$ for $\epsilon\geq 0$ then $$P(A)=\frac{P(B\cap ...
2
votes
2answers
42 views

Wordy Bayesian Question

Five million boys below the age of five live in Erewon. The priests of Erewon are sure that one of them (chosen by fate at random) embodies the spirit of Captain Coin Tosser, who can predict heads or ...
0
votes
1answer
107 views

Calculate the posterior probability of the disease

Suppose the prior probability of the germ carrier is 10%. When in tests, germ carriers have the probability of $95\%$ to give positive results and $5\%$ to give negative; non-germ carriers have the ...
1
vote
1answer
76 views

Showing the Posterior distribution is a Gamma

Assume $X\sim \mathrm{iid}\operatorname{Pareto}(a,b)$, and $b \le \min(X)$, then $$f_n({\bf x}; \theta) = a^n b^{-n} \prod^n_{i=1}\left( \frac{b}{x_i} \right) ^{1 + a} $$ We assume b is known and ...
1
vote
0answers
27 views

Estimating variance from a combination of processes

I am fiddling with some Bayesian probabilities for some astronomical data analysis. I have a ccd image and am testing the null hypothesis (no signal is present - all contributions due to noise) on it. ...
1
vote
1answer
422 views

How to calculate pseudo-determinant for implementing Naive-Bayes

(People who followed Bayesian tag, please read the third paragraph) Problem: I need to calculate pseudo-determinant of a matrix (preferably in MATLAB, but no ...
1
vote
0answers
110 views

Interpreting Bayes' thereom with density functions

I'm studying about Bayes' theorem and according to the theorem: $$P(A\mid B) = \frac{P(B\mid A)P(A)}{P(B)}$$ This I can understand where it comes from etc. But if I use Bayes' theorem on density ...
0
votes
1answer
38 views

Uniform prior distribution multiple results

When I have a simple Bernoulli trial with a certain variable taking, for instance, values 0 and 1, I have a constant prior distribution for the $\theta$ parameter, i.e. pdf $p(\theta) = 1$ between 0 ...
0
votes
1answer
32 views

Likelihood function for $\theta = 0$ (Calculate $\sum_{i=1}^4x_i ^2$ given $\sum_{i=1}^4 x_i$)

I need to find $L_x(\theta)$ for $X_1, X_2, X_3, X_4$ c.i.i.d random variables such that $X_i | \theta \sim N(\theta,1)$ when: $\theta = 0$ $\bar{x} = -0.7$ ($\bar{x} = \Large\frac{\sum_{i=1}^n ...
1
vote
0answers
74 views

Hypotesis test: $X_i | \theta \sim Exp(\theta)$ (Likelihood Ratio Test)

Construct the Likelihood-Ratio Test to test $H_o: \theta = 0$ versus $H_1 :\theta \neq 0$ supposing that $X_1, X_2,...,X_n$ are c.i.i.d random variables such that $X_i | \theta \sim Exp(\theta)$ P.S: ...
2
votes
0answers
99 views

Maximum Posterior: $ p(\bf{w}\mid\bf{x},\bf{t},\alpha,\beta) \propto p(\bf{t}\mid\bf{x},\bf{w},\beta)p(\bf{w}\mid\alpha) $ for Gaussian Distribution

At the moment I take a look at the book Pattern Recognition and Machine Learning from Christopher Bishop and as I try to understand the basics of the probability theory I get stuck trying to ...
4
votes
1answer
1k views

Bayesian posterior with truncated normal prior

Suppose we observe one draw from the random variable $X$, which is distributed with normal distribution $\mathcal{N}(\mu,\sigma^2)$. The variance $\sigma^2$ is known, $\mu$ isn't. We want to estimate ...
1
vote
1answer
38 views

Posterior distribution as a distribution for a new random variable?

So in Bayesian framework one uses observed data $X=\{x_1,\dots,x_n\}$ to update the prior $p(\theta)$. My question is it justified mathematically to say that $p(\theta\mid x_1,\dots,x_n)$ corresponds ...
0
votes
0answers
44 views

How to prove theorem about consistency of Markov edge process?

How to prove such theorem: Markov edge process $p_E(y_E)$ with respect to DAG $G=(V,E)$ defined as $p_E(y_E) = \prod_{v \in V} p_E\left(y_{E_{\rm out}(v)} \,\big|\, y_{E_{\rm in}(v) } \right) = ...
0
votes
0answers
35 views

Hypothesis testing with Baysian methods: How many animals must I test to be sure that a disease isn't present?

I colleague has come to me with a question which I have answered for him but the only statistics I have done was what I did at school and a one semester course on Bayesian methods at university, so I ...
1
vote
0answers
30 views

Measure theoretic basis of joint distrib of parameters and data in Bayesian analysis

In Bayesian statistics you have a prior density for your parameters $\Theta$, $\pi(\theta)$ for $\theta\in\mathcal{T}\subset\mathbb{R}^k$, have the conditional distribution of the data given the ...
0
votes
1answer
44 views

Reversing a conditional probability

If I'm given a P(X|Y) table and P(Y), how can I find P(Y|X)? I understand that $P(Y|X)=\frac{P(X|Y)P(Y)}{P(X)}$ but how do i find P(X)? Furthermore, If i'm told that random variable X is given a ...
1
vote
0answers
57 views

Calculating Bayes factor

Example: Integer-valued data $y = (y_1, ...,y_n):$ $M_1 = Geometric(\theta_1)$ likelihood with $Beta(\alpha_1, \beta_1)$ prior on $\theta_1;$ $M_2=Poisson(\theta_2)$ likelihood with $Gamma(\alpha_2, ...
1
vote
1answer
61 views

Please explain to me why $ \int_b p(a|b) db \neq p(a) $

I have one question that bugs me. How is it that: $ \int_a p(a|b) da = \int_a \frac{p(a,b)}{p(b)} da = 1 $ but $ \int_b p(a|b) db = \int_b \frac{p(a,b)}{p(b)} db \neq p(a) $ I don't understand ...
0
votes
1answer
88 views

Bayesian Network - unclear homework example

I am not sure if it is me or the example: A doctor gives a patient a drug dependent on their age and gender. The patient has a probability to recover depending on whether s/he receives the drug, ...
0
votes
2answers
81 views

Conditional Independence - Bayesian Network

May the probability distribution $ P(A,B,C,D) $ given as: $ P(A,B,C,D) = P(A)P(B)P(C|A,B)P(D|C) $ The task is to show that this holds $ A \bot B | \emptyset $ and $A\bot D|C$. First thing I'd like ...
1
vote
1answer
35 views

Difference of a likelihood function for a vector and a single value

$p(x\mid C)$ is defined as the probability density of a point $x$ given that it belongs to a class $C.$ But what of $p(\mathbf{x}\mid C)$ where $\mathbf{x}$ is a vector? I'm finding hard to ...
1
vote
1answer
32 views

Conjugate Bayesian analysis

Suppose that conditional on $\tau$, the random variable $X$ has normal distribution with mean zero and variance $1/ \tau$. The prior distribution for $\tau$ is Gamma with parameter $\alpha$ and ...