The approach and interpretation of probability associated with Bayes theorem; usually used as opposed to the frequentist approach. It can be seen as an extension of logic that enables reasoning with propositions whose truth or falsity is uncertain. A Bayesian probabilist starts with some prior ...

learn more… | top users | synonyms

6
votes
0answers
108 views

Normalizing factor for product of Gaussian densities - interpretation with Bayes theorem

The normalizing factor for the product of two multivariate Gaussian densities, $f(x)$ and $g(x)$ with mean vectors $a$ and $b$ respectively, and covariance matrices $A$ and $B$ respectively, is itself ...
4
votes
0answers
53 views

Bayesian linear regression cost function

I am studying classification using linear regression . Now, I want to map it in Bayesian regression. Let talk about binary classification using linear regression again. Assume that I have a set ...
3
votes
0answers
53 views

What is the math behind calling election seats with confidence, before all votes have been counted?

On election night, predictions are made on the winner of each district, after only a fraction of the vote has been counted up. How is this done? Say there is a seat up for election, and 10,000 votes ...
3
votes
0answers
59 views

Fredholm Integral in Bayesian Appliation

Let $X = x_1, x_2, \ldots, x_n$ be a sequence of Bernoulli random variables with $k$ successes. Suppose that, given $X$, the posterior predictive probability of $x_{n+1} = x$ is known to be $g(x)$ ...
3
votes
0answers
117 views

Is there a name in the literature for a projectivized measure?

By a projectivized measure I mean a nonzero measure on some measurable space $X$ up to scaling. If a nonzero measure is finite, its projectivization can be identified with its normalization (to have ...
2
votes
0answers
49 views

Bartlett's paradox in Bayesian evidence

I've come across Bartlett's "paradox" (not to be confused with Lindley's paradox, also known as the Lindley-Bartlett paradox) in Bayesian statistics. The paradox originates from Bartlett's 1957 paper, ...
2
votes
0answers
24 views

a variant of MLE of a normal distribution

It is well-known that if we have "n" sample observations from normal distribution with unknown mean, then the sample mean would be the MLE for the mean of the normal distribution. However, let's ...
2
votes
0answers
82 views

Correlation of belief distributions from distinct signals

Anne and Bob are two Bayesians who initially share a non-degenerate prior about a binary state of the world. Anne observes some signal (i.e., an experiment in Blackwell's terminology) about the state ...
2
votes
0answers
40 views

How can I infer order from partially ordered discrete sequences?

A really interesting problem that I can't stop thinking about! Have run in to this a couple of times but yet to find a smart approach to either solve or frame this problem. This is my try at ...
2
votes
0answers
53 views

In what sense is the Bayesian posterior mean a “convex combination”?

This is related to a previous question that hasn't gotten an answer: Definition of convex combination with matrix-vector multiplication Suppose I want to estimate $x \in \mathbb{R}^n$ from two ...
2
votes
0answers
109 views

Bayesian Shrinkage Factor

Vasicek(1973), referenced in this paper(See bottom of page 16) explains a method of shrinking individual betas $\beta^{TS}$ toward a cross-sectional mean $\beta^{XS}$ as follows: for each time $t$, ...
2
votes
0answers
32 views

Improper Lebesgue prior normalization in Bayesian filtering

Suppose we have a conditionally Gaussian Linear State Space Model (CGLSSM) where $Y_t=(X_t,S_t)_{t \in \mathbb{N}}$ is the Markov chain of hidden states, where for each $t \in \mathbb{N}$, $S_t \in ...
2
votes
0answers
70 views

Optimal Stopping for One-Armed Bandit with a Fixed, Known Payout.

I'm very new to bandit problems (apologies if I've formatted my question incorrectly), but I have to solve the optimal stopping of what I think is a very simple case. I have a bandit problem with one ...
2
votes
0answers
47 views

Does this question work with Bayes formula?

Looking at slide 11, Example 1.10 from: http://www-users.aston.ac.uk/~cornford/probmod/ProbMod310810_Ch1.pdf Luke has been told he’s lucky and has won a prize in the lottery. There are 5 prizes ...
2
votes
0answers
31 views

Is this problem suited for Bayesian inference?

Suppose that the quality of a widget is distributed according to a score, given by a normal distribution with mean 1 and variance σ^2. A fraction, π of all widgets are defective. The cost of having an ...
2
votes
0answers
134 views

Posterior predictive distribution in a Bernoulli process.

Suppose there are $k$ successes in a Bernoulli population $ X = \{x_1, \ldots, x_n\}$. I would like to calculate the posterior predictive distribution $f(x | X)$ where $x = \{0,1\}$. I assume the ...
2
votes
0answers
107 views

Maximum Posterior: $ p(\bf{w}\mid\bf{x},\bf{t},\alpha,\beta) \propto p(\bf{t}\mid\bf{x},\bf{w},\beta)p(\bf{w}\mid\alpha) $ for Gaussian Distribution

At the moment I take a look at the book Pattern Recognition and Machine Learning from Christopher Bishop and as I try to understand the basics of the probability theory I get stuck trying to ...
2
votes
0answers
140 views

Building Bayesian Networks, Causality and Cyclic Reasoning

I am studying Bayesian Statistics and I am trying to get a good understanding on Bayesian Networks, which seems to be vital in order to make something useful in Machine Learning. Most of the texts I ...
2
votes
0answers
53 views

Computing evidence for least-squares fit

I'm at a loss trying to implement Bayesian model selection for standard least-squares polynomials fits. I have three polynomials of order $1$, $2$, and $3$, and a sequence of $(x,y)$ data points. ...
2
votes
0answers
102 views

Probability distribution for a digit of a number

If someone choose a digit $\alpha$ and a digit $\beta$ independently. Each one can be in $0,1, ...,9$. So $\mu = \alpha \beta$ (e.g. if $\alpha = 5$ and $\beta = 3$ then $\mu =53$). And I observe a ...
2
votes
0answers
72 views

Gaussian Bayesian filtering with bound observation ($b_1<x<b_2$)

Suppose we have a Normal r.v $$ x \sim \mathcal{N}(\mu, \sigma^2) $$ and a Normal prior of $\mu$ $$ \mu \sim \mathcal{N}(\theta, \delta^2) $$ I know how to do the Bayesian update with a ...
1
vote
0answers
33 views

How do I solve a under-determined quadratic multi-variate system?

I have the following equation: $$ Y = \beta_0 + \beta_1 X_1 + \beta_2 X_2 + \beta_3 X_3 + \beta_{11} X_{1}^2 + \beta_{22} X_{2}^2 + \beta_{33} X_{3}^2 + \beta_{12} X_{1} X_{2} + \beta_{23} X_{2} ...
1
vote
0answers
17 views

Markov-Chain Monte-Carlo: Are transformations on the inputs valid?

The problem: I am trying to solve a high dimensional (up to ~50) class of data fitting & modelling problems. The user specifies the problem, so I would like to make the configuration as easy as ...
1
vote
0answers
37 views

Confusion with Bayesian Linear Regression

In the book Gaussian Processes for Machine Learning in Chapter 2 p. 11 (see http://www.gaussianprocess.org/gpml/chapters/RW2.pdf), eq. 2.9 states: $p(f_* | X, y) = \int p(f_* | x_*,w) p(w|X, y)dw$ ...
1
vote
0answers
24 views

Distribution of unknown covariance matrix, given variance of linear combination

Suppose I am uncertain about the covariance of a vector-valued random variable $X$, but the variance of some linear combination is known. How does this affect the distribution of $X$? Specifically ...
1
vote
0answers
96 views

distribution of the length for a random walk on an infinite 2D grid

In connection with the flatland paradox, consider a 2D-random walk $(X_n)$ on $\mathbb{Z}^2$: the four moves of length one to W,E,N, and S are equaly likely at each time. For a fixed number of moves ...
1
vote
0answers
15 views

Evaluating an expected value in Jeffrey's prior for binomial distribution

The material I'm reading derives Jeffrey's prior (or rather, the Fisher information for the Jeffrey's) for single-parameter binomial distribution in a manner quite similar to this Wikipedia article. ...
1
vote
0answers
34 views

Under what assumptions is the following first moment monotone?

I'm working on an economic model and am encountering the following mathematical issue. Let $x\sim \mathcal{N}(\mu,1)$, and define $$V(\mu)=\int_0^{\hat x(\mu)}x ...
1
vote
0answers
52 views

Baye's Classifier for recovering a signal from a measurement

Below is the question i am having trouble with: Independent and identically distributed symbols s(n) = ±1 are transmitted over the channel C(z) = 1 + z −1 . Symbols s(n) = +1 occur with probability p ...
1
vote
0answers
50 views

Evidence propagation in bayesian network

I'm currently trying to wrap my head around evidence propagation in bayesian network (simple tree propagation) but I'm having trouble finding information about the process. As an example, let's take ...
1
vote
0answers
37 views

complicated posterior distribution

I have a question concerning a rather specific posterior. It should be a simple application of Bayes' Theorem. However, I am always confused here. I try my best to describe the situation. There are ...
1
vote
0answers
37 views

Rate of convergence of Bayesian posterior

Suppose a data generating process (DGP) is parameterized by some unknown parameter $\theta_0$, say $P_{\theta_0}$, and we want to estimate the value of $\theta_0$ using Bayesian method. Let ...
1
vote
0answers
19 views

Bayesian shrinkage doesn't affect eigenspace

The book Machine Learning a Probabilistic Perspective by Kevin Murphy on page 130 states following fact without proof: Consider the MLE estimate of covariance matrix $\Sigma_{\text{MLE}}$. The ...
1
vote
0answers
154 views

Explanation of the TrueSkill bayesian ranking algorithm in a two-person game, like Tennis?

TrueSkill is mostly used for ranking and matching players on Xbox Online Games, it is a general rating model that could be applied to any game, including Chess, Tennis or Football. It models every ...
1
vote
0answers
25 views

Which is a good book to read about convergence of posterior measure?

I am working on Bayesian statistics and would like to know about a good text book about convergence of posterior measure.
1
vote
0answers
245 views

About Bayesian formula and rating system

I'm building a scoring system with score from 0 to 5) and I would like to sort products according to the number of reviews and their scores. After some research on the Internet I have found two ...
1
vote
0answers
35 views

Recursive Bayesian Estimation, $p(C_k|x)$ as likelihood

I''ve been struggeling with this problem for the last couple of days. The main goal is to use the probabilistic classification output $p(C_k|x)$, from for example a logistic regression, to enhance ...
1
vote
0answers
43 views

Comparing models to smoothed data

I am attempting to fit a model to a noisy data set. I am performing this modeling in two stages - first, smoothing it out by fitting an analytic mixture model to it, and second, fitting my final model ...
1
vote
0answers
55 views

Bayesian Chain rule

I am going thorugh a Naive Bayes Classifier, and faced the following: $p(y|a,b,c) = \frac{p(a|y,b)*p(y|c)}{p(a|b,c)}$ When I am trying to derive the above, these are my steps: ...
1
vote
0answers
17 views

What should I be learning to combine Bayesian networks with measurement variables?

I've been reading up on Bayesian networks recently and maybe I'm missing something about the intuition. I don't know if I've picked the correct tags for this question, so I apologize in advance. The ...
1
vote
0answers
26 views

Assessing goodness of fit in Bayesian framework

I am following a Bayesian approach (specifying an underlying class of models and a prior) in order to produce a predictive distribution of some quantity. The question I am troubled with is: how can I ...
1
vote
0answers
53 views

Bayesian probability re: people vs. coins

Imagine you're a court clerk recording information about court appearances in a munincipal court. Past records show that on a typical day in this court, in 50% of criminal cases heard, the accused ...
1
vote
0answers
41 views

Infinite fourth moment and maximum entropy

Alright, I expect this is a silly question, but I don't actually know, so. Suppose there is some random variable that's distributed on the reals, and all I know about the distribution is its mean ...
1
vote
0answers
33 views

Given the data set is the Bayesian estimation the best solution for solving the expected value?

I am very new to this. I have several measurements that from which I need to estimate a truth value. Each of them comes with an estimated error. I know that the observation error are biased (I don't ...
1
vote
0answers
87 views

Game Theory - Bayes Rule, Sequential Game

I am trying to solve the following model, but I get a few weird results. Sorry if it is too long... Nature moves first and with probability $p$ assigns player's 1 type to be High ($1-p$ for Low) ...
1
vote
0answers
48 views

How would I analyze the accuracy of a model that predicts World Cup matches?

Say, someone made a bunch of predictions for each game between Team A and Team B, such that there's a predicted probability for each of the three possible outcomes adding up to $1.0$ : Team A winning, ...
1
vote
0answers
43 views

multiplication of 2 PDFs

If I multiply the two PDFs, does the variance of the result PDF becomes narrower than the two PDFs always? In other words, if I multiply likelihood and prior to get the posterior, is the variance of ...
1
vote
0answers
194 views

Estimating conditional probability as a function of time

My question relates to estimating from a time series a time dependent conditional probability without having a prior parametric model of anything. Suppose I have two variables: r and I, and each can ...
1
vote
0answers
29 views

Growing of a score function

The argument that I'm dealing is very specific, I hope to make you understand the problem without going into detail. I have this score function: \begin{align} score = MargL^q + MargL^{\theta} ...
1
vote
0answers
23 views

Determining the liklihood in Baye's rule for parameter estimation

I have used Bayesian statistics in classes but what I am trying to do now is different than anything I have done in class. Previously, I was given information and certain numbers adn I could ...