0
votes
0answers
19 views

What is the problem with this model parameter estimation algorithm?

In a statistical model with parameters $\theta$ and unobserved laten variables $Z$, the model likelihood is $$L(\theta;X)=Pr(X|\theta)=\sum_ZPr(X,Z|\theta)$$ The standard way to estimate $\theta$ ...
0
votes
0answers
22 views

learning phenomena in bayesian technique

I have identified using bayesian method for my auto tagging application. I am dealing with user facebook post. Post belongs to ...
0
votes
1answer
18 views

Improper Uniform Prior Distribution

In Bayesian method, choosing the prior distribution is an important step when using the Bayesian method. When choosing prior, we consider the prior knowledge to choose which prior distribution is the ...
0
votes
0answers
20 views

Jeffery's prior - help

I'm studying Bayesian inference and looking at prior choices. Currently I have looked at Laplace's uniform prior choice and now I am trying to understand Jeffrey's prior. I am having trouble ...
6
votes
1answer
98 views

What is the most general formalism for machine learning?

Most of the literature I can find in the field of machine learning is extremely practical, listing many techniques you can use like neural networks, SVMs, random forests, and so on. There are lots of ...
1
vote
0answers
22 views

Why is the marginalized inverse-Wishart distribution not equal to the inverse-gamma distribution?

Given that the inverse-gamma distribution is the one-dimensional version of the inverse-Wishart distribution, why will (philosophically speaking) an inverse-Wishart distribution that originally has ...
0
votes
1answer
28 views

In Bayesian approaches, comparing the approximated distribution and the true distribution

I'm asked to compare the distance of the approximated distribution and the true distribution in a Bayesian approach. While we used Laplace approximation to find the MAP of the target posterior ...
2
votes
3answers
102 views

Questions about Bayesian inference

From Wikipedia The prior distribution is the distribution of the parameter(s) before any data is observed, i.e. $p(\theta \mid \alpha )$. ... The sampling distribution is the distribution of ...
1
vote
0answers
25 views

Estimate distance between approximated posterior and true posterior

I'm working on a paper about using graphical models to do some prediction tasks with known observations. Since the model is complicated, finding the maximum a posteriori on the true posterior ...
0
votes
0answers
23 views

Bayesian Variable and Model Selection, Books and Review Papers Desired

I'm hoping that the community will be able to suggest some literature for studying this topic. There seems to be very few books on the subject. There are some chapters in some books which provide ...
0
votes
1answer
29 views

Likelihood function for $\theta = 0$ (Calculate $\sum_{i=1}^4x_i ^2$ given $\sum_{i=1}^4 x_i$)

I need to find $L_x(\theta)$ for $X_1, X_2, X_3, X_4$ c.i.i.d random variables such that $X_i | \theta \sim N(\theta,1)$ when: $\theta = 0$ $\bar{x} = -0.7$ ($\bar{x} = \Large\frac{\sum_{i=1}^n ...
1
vote
0answers
55 views

Hypotesis test: $X_i | \theta \sim Exp(\theta)$ (Likelihood Ratio Test)

Construct the Likelihood-Ratio Test to test $H_o: \theta = 0$ versus $H_1 :\theta \neq 0$ supposing that $X_1, X_2,...,X_n$ are c.i.i.d random variables such that $X_i | \theta \sim Exp(\theta)$ P.S: ...
0
votes
1answer
129 views

Gaussian with a linear combination random variable mean

A very simple (looks like...) statistical problem, however I don't even know how to name it in a formal way... Suppose in a Bayesian framework I have random variables $y, x_1,$ and $x_2$, $$f(x) = ...
0
votes
0answers
36 views

Uniform choice for Prior Distribution

My prior function is $\Phi\left(\mathbf{k}_\ell,W_\ell\right)=\frac{1}{N}\log p\left(\mathbf{k}_\ell,W_\ell\right)$ which is determined once I choose the Bayesian prior parameter likelihood ...
4
votes
3answers
125 views

Is there any research field dedicated to estimating a “game” itself in game theory?

Game theory stuffs usually provide how a "game" works and then tries to figure out solutions - but I am wondering if there is any research field dedicated to estimating the full rules of a game. So ...
0
votes
0answers
62 views

Estimating the radius of a circle

I have a circle iwth radius $r$. I want to test the hypothesis that $r \leq 2$ vs. $r >2$ based on the posterior of $r$. $r$ follows the prior distribution: $f(r) = \frac{2}{r^{2}}$, $ r >0.5$. ...
2
votes
0answers
93 views

Probability distribution for a digit of a number

If someone choose a digit $\alpha$ and a digit $\beta$ independently. Each one can be in $0,1, ...,9$. So $\mu = \alpha \beta$ (e.g. if $\alpha = 5$ and $\beta = 3$ then $\mu =53$). And I observe a ...
1
vote
1answer
51 views

Bayesian learning

Imagine we assume there are two different types of coins: Coin A: a fair coin, p(heads) = 0.5. Coin B: biased to heads at p(heads)=0.7. We then want to learn from samples which coin we are ...
0
votes
1answer
74 views

Hypothesis Testing Bayesian Way

I'm having trouble with the following problem: Suppose a machine is composed of 2 components (1 and 2, independent from each other). Each component has a exponential failure probability distribution ...
1
vote
1answer
88 views

Two definitions of Bayes Sufficiency

"Bayes Sufficiency" is defined in two ways. Are they equivalent? Setting A statistical experiment $S$ is a triplet $\left(\left(\Theta,\mathcal{F}\right),\left(\Omega,\mathcal{A}\right),P\right)$, ...
6
votes
1answer
471 views

Trying to understand the basics of bayesian inference

This paper gives a somewhat gentle introduction to Bayesian inference: http://www.miketipping.com/papers/met-mlbayes.pdf I got to section 2.3 without much problems but got stuck in understanding that ...