The approach and interpretation of probability associated with Bayes theorem; usually used as opposed to the frequentist approach. It can be seen as an extension of logic that enables reasoning with propositions whose truth or falsity is uncertain. A Bayesian probabilist starts with some prior ...

learn more… | top users | synonyms

0
votes
0answers
7 views

Bayes factor and Posterior odds

Consider the following posterior odds \begin{equation*} \frac{P(H|D_1,D_2)}{P(\overline{H}|D_1,D_2)}=\frac{P(D_2|H,D_1)\times P(D_1|H)P(H)}{P(D_2|\overline{H},D_1)\times ...
0
votes
0answers
11 views

Bayesian mean square error

Given a i.i.d sample $X_{1},..,X_{n}$ of bernoulli random variables test 2 hypotheses $H_{0}:p=2/3$ and $H_{1}:p=1/3$. Bayesian prior is $\pi(2/3)=1/3$ and $\pi(1/3)=2/3$. Find the bayesian criterion ...
0
votes
0answers
7 views

Computing Object Classification with bayesian statistics

Say I want to know if there is a zebra $\theta$, in an image $x$. According to Bayes statistics applies to image recognition, I should be computing: ...
0
votes
0answers
16 views

Bayesian ranking system acting up

My Bayesian ranking system seems to be acting quirky.. and I'm wondering about my implementation. This is basically my formula: ...
-3
votes
1answer
131 views

Probability and Bayes Theorem [closed]

Imagine a foot-by-foot square drawn on the ground, oriented so that one of its sides faces north. We can refer to the four corners of the square as the northeast, northwest, southeast and southwest ...
0
votes
1answer
35 views

determining maximum a posteriori (MAP) hypothesis

I have this problem: You are given a coin that may or may not be biased. Specifically, you have three hypotheses about the coin: ...
0
votes
0answers
15 views

Jeffery's prior - help

I'm studying Bayesian inference and looking at prior choices. Currently I have looked at Laplace's uniform prior choice and now I am trying to understand Jeffrey's prior. I am having trouble ...
0
votes
0answers
22 views

Can likelihood be changed when the prior changes?

I have a data which follows gamma distribution and want to know the uncertainty of the parameters of this data. •Data∼Gamma(α,β) •Parameters α∼Gamma(kα,θα) β∼Gamma(kβ,θβ) I used Winbugs (code ...
0
votes
0answers
56 views

Bayes' Theorem Question, with a twist

I have a very old past high school exam question I am trying to solve (for interest only). It's a straightforward application of Bayes' Theorem, with the last part of the question containing a slight ...
0
votes
0answers
5 views

EKF to fuse gyroscope and accelerometer readings

I found it interesting to implement EKF for fusing gyroscope and accelerometer data. Trying reach my goal i discovered a lab with some theory explaned, also it has nice app for the phone to stream ...
1
vote
0answers
21 views

Growing of a score function

The argument that I'm dealing is very specific, I hope to make you understand the problem without going into detail. I have this score function: \begin{align} score = MargL^q + MargL^{\theta} ...
1
vote
1answer
32 views

When using Bayes Rule, what are the rules for flipping the conditions and the event of interest?

Here is Bayes Rule: $$P(A\mid B) = \frac{P(B\mid A) P(A)}{P(B)}$$ This paper (http://www.cogsci.northwestern.edu/Bayes/Sivia_1996.pdf) uses Bayes rule on page 21 in the context of model selection ...
5
votes
0answers
69 views

What is the most general formalism for machine learning?

Most of the literature I can find in the field of machine learning is extremely practical, listing many techniques you can use like neural networks, SVMs, random forests, and so on. There are lots of ...
0
votes
0answers
14 views

Bayesian Network understanding

I am confused by the definition of Bayesian Network. It's well know that graph $G$ of Bayesian Network can be viewed in two very different ways: As a data structure that provides the skeleton for ...
1
vote
1answer
40 views

Bayesian Probability Question - Parameter Estimation

I would like help on the following question and I will show my work. Here is the question in my notes and I will follow up with my work: Q: Suppose a forest is segmented into strips, referred to as ...
0
votes
0answers
20 views

Is a prior distribution always a random probability measure?

Let $(\mathcal{X}, \mathcal{B})$ be a measurable space and let its probability measure be $P$. In Bayesian statistics, we may wish to define a prior $\mu$ on the space of all such probability ...
1
vote
0answers
7 views

Determining the liklihood in Baye's rule for parameter estimation

I have used Bayesian statistics in classes but what I am trying to do now is different than anything I have done in class. Previously, I was given information and certain numbers adn I could ...
0
votes
0answers
39 views

Monty Hall Problem Extended Using Bayes's Theory

I know there is a question on the website concerning the extension of the monty hall problem. The question is provided with very good answers given by the participants on the website which I would ...
1
vote
1answer
23 views

completing the square for matrices

I'd like to calculate the posterior distribution given the prior distribution $w\sim N(0,\Sigma_p)$ and the likelihood $y|X,w\sim N(X^\top w,\sigma_n^2I).$ Ignoring everything that does not contain ...
1
vote
0answers
35 views

Monty Hall Problem Solve Using Detailed Algebra

I have been searching the monty hall problem for two days now and I generally understand it but I am having a very hard time solving the monty hall problem using Bayes's theory. I do not know what ...
-2
votes
2answers
36 views

Help with Bayes's theory [duplicate]

I know how to use this form of the Bayes's theory : $P(A | B) = P(A ∩ B)/ P(B)$ But how do I use?: $P (A | B,C) = P (B | A,C) P(A | C)/ P(B | C)$ What does the comma mean? I know its a simple ...
0
votes
1answer
27 views

Finding a posterior distribution of an exponential distribution parameter theta

Suppose that $X_1, ... , X_n$ each have an exponential distribution with parameter $\theta$, and suppose that the prior for $\theta$ is an exponential distribution with parameter $\lambda$. Find the ...
2
votes
0answers
17 views

Is this problem suited for Bayesian inference?

Suppose that the quality of a widget is distributed according to a score, given by a normal distribution with mean 1 and variance σ^2. A fraction, π of all widgets are defective. The cost of having an ...
1
vote
3answers
57 views

Probability of independent events $P(ab)=P(a)*P(b)$

I know there are two ways to say event $a$ and $b$ are independent: $P(a)*P(b)=P(ab)$ $P(a\mid b)=P(a)$ and I can derive one from the other with the Bayes Formula $P(a|b)=P(ab)/P(b)$. My question ...
1
vote
0answers
38 views

Generalized Bayes Estimator

Consider a decision problem in which the model parameter, $\theta$, is any integer, the distribution for the integer observation, y, given $\theta$ is $P(y|\theta) = 1/3$ if $y \in [\theta - 1, \theta ...
1
vote
0answers
18 views

Why is the marginalized inverse-Wishart distribution not equal to the inverse-gamma distribution?

Given that the inverse-gamma distribution is the one-dimensional version of the inverse-Wishart distribution, why will (philosophically speaking) an inverse-Wishart distribution that originally has ...
0
votes
1answer
37 views

Give the Bayesian Posterior Mode

Suppose that $X_1, X_2, \ldots, X_n$ are IID Bernoulli random variables with success probability equal to an unknown parameter $\theta \in [0,1]$. Let $A$ and $B$ be nonnegative constants. If we ...
1
vote
1answer
25 views

Conditional probability with bayes rule??

http://cseweb.ucsd.edu/~dasgupta/103/2b.pdf part 2.1.2 implies $P(X|Y \cap Z) = \frac{P(X|Y)}{P(Y|Z)}$ Seems to imply that this is true but if you take bayes, the left hand side is: $P(X|Y \cap Z) = ...
3
votes
2answers
77 views

Conjugate priors make calculations easier but at what cost to the model?

As I understand, when we have a parametric pdf and need to estimate the parameter based on some observed fact, we tend to choose a conjugate prior of the pdf for the parameter. Because conjugate prior ...
0
votes
0answers
25 views

How many numbers for the full joint?

Suppose you have 3 binary nodes A, B, C. A and B are independent given C. How many numbers do we need for the full joint? How many numbers do we need for the Baysesian Net? I know the answers to ...
0
votes
0answers
13 views

What happens if the recursive bayes is performed without updating the data?

With a relatively good prior, and recursive Bayes' is performed with new data every iteration, the posterior converges to the real value, under ideal circumstances. But what happens if recursive ...
0
votes
0answers
19 views

Bayes updating (Beta Distribution)

I have been trying to use Bayes' theorem to update a Beta distribution B(alpha, beta). For each iteration of randomly drawn values from some Beta distribution, I multiply my 2D joint likelihood ...
0
votes
0answers
16 views

Estimating the magnitude of a change in a non-stationary stochastic process

In this paper by Adams and MacKay, they present an algorithm for the online detection of change-points in a stochastic process subject to some hypotheses. Their algorithm gives both the predictive ...
0
votes
1answer
25 views

In Bayesian approaches, comparing the approximated distribution and the true distribution

I'm asked to compare the distance of the approximated distribution and the true distribution in a Bayesian approach. While we used Laplace approximation to find the MAP of the target posterior ...
0
votes
0answers
13 views

Folded normal distribution

I am using bayesian stats for image classification and I have a variety of input variables. These inputs are normally distributed except for two. One has a truncated normal distribution and the other ...
0
votes
0answers
14 views

Left-censoring in time series

This is from a Bayesian problem I'm working on. I have worked out \begin{align} f(y_1,...,y_T|\varphi)=f(y_1|\varphi)f(y_2|y_1,\varphi)...f(y_T|y_1,y_2,...,y_{T-1},\varphi), \end{align} and all terms ...
2
votes
3answers
92 views

Questions about Bayesian inference

From Wikipedia The prior distribution is the distribution of the parameter(s) before any data is observed, i.e. $p(\theta \mid \alpha )$. ... The sampling distribution is the distribution of ...
1
vote
1answer
44 views

Questions about Auctions

I am having a hard time figuring out a problem. In a first price auction with a reserve price R and values of the bidders are U[0,1], how do we find expected revenue given the strategy of both of them ...
2
votes
1answer
73 views

Probability - when there is an argument between experts?

A, B and C are all expert doctors. When each of them (individually) gives a diagnosis (in a yes/no question), the chance of accuracy is 90%, or 9/10. In a case where A and B argue for a certain ...
0
votes
0answers
34 views

Poisson distribution probability from a single measurement

This question came up while reading a medical paper - the study showed $m_1$ out of $n_1$ people doing $X_1$ died, while only $m_2$ out of $n_2$ people died when doing $X_2$. I'm trying to ...
2
votes
2answers
56 views

Coin toss with unknown probability – Bayesian interpretation

I have observed a coin being tossed $n$ times. I do not know whether the coin is fair or not, but in every single toss I observed, the coin came up heads. What should my belief about $p$ (the ...
1
vote
1answer
40 views

Posterior Distribution with prior standard exponential (mean 1) and data distribution of poisson

So I have the likelihood being: $\prod^{n}_{i=1}(\frac{\lambda^{x}e^{-\lambda}}{x!})$ which is proportional to $\lambda^{\sum_{i=1}^{n}x_{i}}e^{-n\lambda}$ The prior is standard exponential ...
1
vote
0answers
22 views

Estimate distance between approximated posterior and true posterior

I'm working on a paper about using graphical models to do some prediction tasks with known observations. Since the model is complicated, finding the maximum a posteriori on the true posterior ...
1
vote
0answers
32 views

Does this Gamma posterior make sense?

quick question about the form of a posterior distribution. Suppose that $\theta \sim Gamma(a, b)$ and that, given $\theta$, $Y$ has CDF $$F(Y\mid\theta) = 1 - e^{-\theta(e^y - 1)},\quad ...
1
vote
1answer
33 views

What am I doing wrong in calculating Fisher Information of Triangular Distribution?

I am trying to find Jeffrey's prior for the Triangular distribution which has the following probability density function: $$f(x\mid \theta) = \begin{cases} \dfrac{2x}{\theta} & : x ...
1
vote
0answers
33 views

Posterior predictive distribution in a Bernoulli process.

Suppose there are $k$ successes in a Bernoulli population $ X = \{x_1, \ldots, x_n\}$. I would like to calculate the posterior predictive distribution $f(x | X)$ where $x = \{0,1\}$. I assume the ...
0
votes
1answer
26 views

Bayesian Predictive distribution with two marginal posteriors

If we have a random variable $Y$ with pdf $P(Y|a,b)$, where $a$ and $b$ are parameters (with range $0$ to $\infty$). As well as marginal posterior distributions for $a$ and $b$, these are $P(a\vert ...
0
votes
0answers
36 views

Finding the joint posterior distribution of AR(2) process

Suppose we have AR(2) process for $\{y_t, t=3,4,..\}$ and let $a_1,a_2,\sigma^2$ be the parameters of the time series. We assume that $y_1$ and $y_2$ er independent normally distributed with mean zero ...
3
votes
0answers
27 views

If $P(B\text{ }|\text{ }A)=1-\epsilon$ and $P(C\text{ }|\text{ }B)=1$ then $P(C\text{ }|\text{ }A)\geq 1-\epsilon$ [duplicate]

If $$1=P(C\text{ }|\text{ }B)=\frac{P(C\cap B)}{P(B)}$$ then we know that $P(C\cap B)=P(B)$. If $P(B\text{ }|\text{ }A)=1-\epsilon$ for $\epsilon\geq 0$ then $$P(A)=\frac{P(B\cap ...
1
vote
2answers
30 views

Wordy Bayesian Question

Five million boys below the age of five live in Erewon. The priests of Erewon are sure that one of them (chosen by fate at random) embodies the spirit of Captain Coin Tosser, who can predict heads or ...