The approach and interpretation of probability associated with Bayes theorem; usually used as opposed to the frequentist approach. It can be seen as an extension of logic that enables reasoning with propositions whose truth or falsity is uncertain. A Bayesian probabilist starts with some prior ...

learn more… | top users | synonyms

6
votes
0answers
68 views

Probability of number of people who know a rumor

Suppose that among a group of $n$ people, some unknown number of people $K$ know a rumor. If someone knows the rumor, there is a probability $p$ that they will tell it to us if we ask. If they don't ...
6
votes
0answers
157 views

Normalizing factor for product of Gaussian densities - interpretation with Bayes theorem

The normalizing factor for the product of two multivariate Gaussian densities, $f(x)$ and $g(x)$ with mean vectors $a$ and $b$ respectively, and covariance matrices $A$ and $B$ respectively, is itself ...
5
votes
0answers
161 views

Prove the estimator $\hat{B}$ of ridge regression = mean of the posterior distribution under a Gaussian prior

I want to prove that the estimator of ridge regression is the mean of the posterior distribution under Gaussian prior. $$y \sim N(X\beta,\sigma^2I),\quad \text{prior }\beta \sim N(0,\gamma^2 I).$$ ...
5
votes
0answers
292 views

Bartlett's paradox in Bayesian evidence

I've come across Bartlett's "paradox" (not to be confused with Lindley's paradox, also known as the Lindley-Bartlett paradox) in Bayesian statistics. The paradox originates from Bartlett's 1957 paper, ...
4
votes
0answers
74 views

Bayesian linear regression cost function

I am studying classification using linear regression . Now, I want to map it in Bayesian regression. Let talk about binary classification using linear regression again. Assume that I have a set ...
4
votes
0answers
64 views

Fredholm Integral in Bayesian Appliation

Let $X = x_1, x_2, \ldots, x_n$ be a sequence of Bernoulli random variables with $k$ successes. Suppose that, given $X$, the posterior predictive probability of $x_{n+1} = x$ is known to be $g(x)$ ...
3
votes
0answers
84 views

What is the math behind calling election seats with confidence, before all votes have been counted?

On election night, predictions are made on the winner of each district, after only a fraction of the vote has been counted up. How is this done? Say there is a seat up for election, and 10,000 votes ...
3
votes
0answers
124 views

Is there a name in the literature for a projectivized measure?

By a projectivized measure I mean a nonzero measure on some measurable space $X$ up to scaling. If a nonzero measure is finite, its projectivization can be identified with its normalization (to have ...
2
votes
0answers
44 views

Bayesian inference exercise

I am learning online Bayesian Statistics and I have a test in a couple of days. I have no idea how to solve this exercise, any help will be appreciated. There might be something similar in the quiz... ...
2
votes
0answers
34 views

a variant of MLE of a normal distribution

It is well-known that if we have "n" sample observations from normal distribution with unknown mean, then the sample mean would be the MLE for the mean of the normal distribution. However, let's ...
2
votes
0answers
107 views

Correlation of belief distributions from distinct signals

Anne and Bob are two Bayesians who initially share a non-degenerate prior about a binary state of the world. Anne observes some signal (i.e., an experiment in Blackwell's terminology) about the state ...
2
votes
0answers
47 views

How can I infer order from partially ordered discrete sequences?

A really interesting problem that I can't stop thinking about! Have run in to this a couple of times but yet to find a smart approach to either solve or frame this problem. This is my try at ...
2
votes
0answers
67 views

In what sense is the Bayesian posterior mean a “convex combination”?

This is related to a previous question that hasn't gotten an answer: Definition of convex combination with matrix-vector multiplication Suppose I want to estimate $x \in \mathbb{R}^n$ from two ...
2
votes
0answers
158 views

Bayesian Shrinkage Factor

Vasicek(1973), referenced in this paper(See bottom of page 16) explains a method of shrinking individual betas $\beta^{TS}$ toward a cross-sectional mean $\beta^{XS}$ as follows: for each time $t$, ...
2
votes
0answers
81 views

Optimal Stopping for One-Armed Bandit with a Fixed, Known Payout.

I'm very new to bandit problems (apologies if I've formatted my question incorrectly), but I have to solve the optimal stopping of what I think is a very simple case. I have a bandit problem with one ...
2
votes
0answers
73 views

Bayesian Chain rule

I am going thorugh a Naive Bayes Classifier, and faced the following: $p(y|a,b,c) = \frac{p(a|y,b)*p(y|c)}{p(a|b,c)}$ When I am trying to derive the above, these are my steps: ...
2
votes
0answers
50 views

Does this question work with Bayes formula?

Looking at slide 11, Example 1.10 from: http://www-users.aston.ac.uk/~cornford/probmod/ProbMod310810_Ch1.pdf Luke has been told he’s lucky and has won a prize in the lottery. There are 5 prizes ...
2
votes
0answers
32 views

Is this problem suited for Bayesian inference?

Suppose that the quality of a widget is distributed according to a score, given by a normal distribution with mean 1 and variance σ^2. A fraction, π of all widgets are defective. The cost of having an ...
2
votes
0answers
75 views

Generalized Bayes Estimator

Consider a decision problem in which the model parameter, $\theta$, is any integer, the distribution for the integer observation, y, given $\theta$ is $P(y|\theta) = 1/3$ if $y \in [\theta - 1, \theta ...
2
votes
0answers
195 views

Posterior predictive distribution in a Bernoulli process.

Suppose there are $k$ successes in a Bernoulli population $ X = \{x_1, \ldots, x_n\}$. I would like to calculate the posterior predictive distribution $f(x | X)$ where $x = \{0,1\}$. I assume the ...
2
votes
0answers
117 views

Maximum Posterior: $ p(\bf{w}\mid\bf{x},\bf{t},\alpha,\beta) \propto p(\bf{t}\mid\bf{x},\bf{w},\beta)p(\bf{w}\mid\alpha) $ for Gaussian Distribution

At the moment I take a look at the book Pattern Recognition and Machine Learning from Christopher Bishop and as I try to understand the basics of the probability theory I get stuck trying to ...
2
votes
0answers
58 views

Computing evidence for least-squares fit

I'm at a loss trying to implement Bayesian model selection for standard least-squares polynomials fits. I have three polynomials of order $1$, $2$, and $3$, and a sequence of $(x,y)$ data points. ...
2
votes
0answers
105 views

Probability distribution for a digit of a number

If someone choose a digit $\alpha$ and a digit $\beta$ independently. Each one can be in $0,1, ...,9$. So $\mu = \alpha \beta$ (e.g. if $\alpha = 5$ and $\beta = 3$ then $\mu =53$). And I observe a ...
2
votes
0answers
73 views

Gaussian Bayesian filtering with bound observation ($b_1<x<b_2$)

Suppose we have a Normal r.v $$ x \sim \mathcal{N}(\mu, \sigma^2) $$ and a Normal prior of $\mu$ $$ \mu \sim \mathcal{N}(\theta, \delta^2) $$ I know how to do the Bayesian update with a ...
1
vote
0answers
14 views

Hypothesis test in Bayesian statistics

Let $X\sim N(\theta,1)$ and 5 independent observations $X=(4.9,5.6,5.1,4.6,3.6)$. The prior probability that $\theta=4.01$ is $0.5$. The remain values of $\theta$ are given the density of ...
1
vote
0answers
20 views

Posterior of Normal with prior Cauchy

Let $X\sim N(\theta,1)$ and $\pi(\theta)\sim \mathrm{Cauchy}(0,1)$ find a 90% credible set for $\theta$ To find the credible set I need to find the distribution of $f(\theta\mid x)$, but ...
1
vote
0answers
6 views

Bayes risk and Bayes decision

We are considering a sample of size $n$ from an exponential distribution, with parameter $w >0$. We wish to produce an estimate for $d$, for $w$ , with loss function: $L(w, d)=w(w-d)^2$ The prior ...
1
vote
0answers
19 views

Ranking players and puzzles from performance in a single player game format

I have a 1000 crossword puzzles and a 1000 solvers - each individual is assigned a 100 arbitrary puzzles to solve (so each solver gets exactly 100 puzzles but each puzzle could have 1-1000 solvers) - ...
1
vote
0answers
19 views

Gaussian distribution with Gamma variance

I am using a hierarchical Bayesian model. In one part of it, I have a normal distribution with mean zero and a variance sampled from a Gamma distribution for some hyper-parameters $a_0$ and $a_1$: ...
1
vote
0answers
10 views

How to determine the transition probability in Sequential Importance Sampling (SIS) for Particle Filter

Given a state-space model \begin{align} x_k &= f_k(x_{k-1}, v_{k-1}),\\ z_k &= h_k(x_k, w_k), \end{align} where $x_k \in {\mathbb R}^{n}$ and $y_k \in {\mathbb R}^{m}$ are the system state ...
1
vote
0answers
17 views

Drawing uniform samples from the *range* of a non-invertible function

I am looking for a Bayesian technique to draw samples from a uniform distribution over the range of a non-invertible (that is, there isn’t even a formula) function $\mathbf{f}: \mathbb{R}^N ...
1
vote
0answers
14 views

Multilinear loss in Uniform-Exponential model

Let a prior $\pi(\theta)=\frac{1}{3}(\mathbb{I}_{[0,1]}(\theta)+\mathbb{I}_{[2,3]}(\theta)+\mathbb{I}_{[4,5]}(\theta))$ and $f(x\mid\theta)=\theta e^{-\theta x}$. Taking the multilinear loss ...
1
vote
0answers
21 views

Jeffrey's prior

I am currently working on a question, however I am a bit confused about which one I need to work out. Question: Derive Jeffrey's prior $J(\phi)$ when $\theta = e^\phi$ for $f(x|\theta) = \theta ...
1
vote
0answers
26 views

Bayesian inference for sum of random variables

Assume that we have a random variable $Z = X + Y$ for $X$ and $Y$ independent. Then if w use two independent data-sets $D_1$ and $D_2$ to try and approximate the distribution of $Z$, i.e. ...
1
vote
0answers
15 views

Relation between Bayesian analysis and Bayesian hierarchical analysis?

I have been studying a Bayesian hierarchical model. In that model all I am dealing is with the estimation of parameters. In Bayesian analysis, loosely speaking, we update our prior knowledge (in light ...
1
vote
0answers
12 views

Problems in notations in a paper on Bayesian space-time models

Suppose I have been given some process $Y$. Let $Y(s,t)$ denote the value of process at location $s$ and time $t$. For my experiment, I consider a model described as - $$Y(s,t) = \mu(s) + ...
1
vote
0answers
12 views

Meaning of “T-vector of time series values”?

I am currently studying a paper on Hierarchical Bayesian space-time models. In that, we have denoted $Y(s,t)$ to be the process of interest ate location $s$ and time $t$ in a gridded space-time. $Y(s, ...
1
vote
0answers
18 views

Expected utility of action, given probability model

We record measurements of an appartus every day. If apparatus doesn't break (it has probability equal to $1-p_2$), it will measure zero with probability $p_1$. If apparatus breaks (probability $p2$), ...
1
vote
0answers
31 views

Find a conditional probability of a Bayes' Net knowing only the prior probability of the root.

Given three nodes A,B,C that form a Bayes Network as the following: (A)-->(B)-->(C) If we know the prior probability of A is 0.3, i.e. P(A)=0.3, is this ...
1
vote
0answers
19 views

Posterior for Beta Binomial Distribution with Repeated Observations

I'm working on a question with simultaneous learning about an underlying population and individual members of the population. The basic setup is: Let $N_g$ be the size of a population. At any point ...
1
vote
0answers
36 views

Can the parameter of prior probability depends on data?

In Bayseian approach https://en.wikipedia.org/wiki/Prior_probability we often use prior probability. Can we have a prior probability distribution with parameters and while estimating the posterior ...
1
vote
0answers
31 views

Bayesian Gaussian Mixture model

I am trying to fit basic Gaussian mixture with a Bayesian model. My likelihood function is Gaussian, with std=1, and the only parameter is the mean, chosen from $\{0,1,\dots,14,15\}$ and my prior is ...
1
vote
0answers
26 views

Choosing a non-convex global optimization algorithm based on the number of permitted steps

Can anyone comment on the most suitable approach for the following optimization problem: We are given finite bounds for a set of $n$ real-valued parameters of an unknown deterministic function. The ...
1
vote
0answers
14 views

Denominator in Maximum Posterior Estimation - How to Interpret?

Suppose we're given a sequence $x_1,\ldots,x_n$ of realizations of i.i.d. $\mathcal{N}(\mu,\sigma^2)$ random variables and we want to apply maximum posterior estimation to estimate the parameters ...
1
vote
0answers
37 views

How do I solve a under-determined quadratic multi-variate system?

I have the following equation: $$ Y = \beta_0 + \beta_1 X_1 + \beta_2 X_2 + \beta_3 X_3 + \beta_{11} X_{1}^2 + \beta_{22} X_{2}^2 + \beta_{33} X_{3}^2 + \beta_{12} X_{1} X_{2} + \beta_{23} X_{2} ...
1
vote
0answers
29 views

Markov-Chain Monte-Carlo: Are transformations on the inputs valid?

The problem: I am trying to solve a high dimensional (up to ~50) class of data fitting & modelling problems. The user specifies the problem, so I would like to make the configuration as easy as ...
1
vote
0answers
53 views

Confusion with Bayesian Linear Regression

In the book Gaussian Processes for Machine Learning in Chapter 2 p. 11 (see http://www.gaussianprocess.org/gpml/chapters/RW2.pdf), eq. 2.9 states: $p(f_* | X, y) = \int p(f_* | x_*,w) p(w|X, y)dw$ ...
1
vote
0answers
43 views

Distribution of unknown covariance matrix, given variance of linear combination

Suppose I am uncertain about the covariance of a vector-valued random variable $X$, but the variance of some linear combination is known. How does this affect the distribution of $X$? Specifically ...
1
vote
0answers
16 views

Working out closed form of shifted poisson distribution

In the article "Bayesian variable selection for Poisson regression with underreported responses" the author defines $t_i^0$ as the number of actual occurences in a study in the $i$th covariate ...
1
vote
0answers
164 views

distribution of the length for a random walk on an infinite 2D grid

In connection with the flatland paradox, consider a 2D-random walk $(X_n)$ on $\mathbb{Z}^2$: the four moves of length one to W,E,N, and S are equaly likely at each time. For a fixed number of moves ...