Estimation theory is a branch of statistics and signal processing that deals with estimating the values of parameters based on measured/empirical data that has a random component.

learn more… | top users | synonyms

1
vote
1answer
45 views

Maximum Likelihood Question

The aim is to find the maximum likelihood estimator for theta. $f(x)$ is given and we can assume that $1\le x\le-1$. I have completed the steps seen in the image, however I am having difficulty ...
1
vote
0answers
44 views

Unbiased estimator for maximum

Assume $n$ independent random variables with unknown distributions $\{X_1,X_2,...,X_n\}$. Multiple "samples" or observations for each of these variables are given (not necessarily with the same ...
1
vote
0answers
59 views

Working with the sum of two independent random variables, and estimating a parameter

A network source sends a sequence of zeros and ones, $X_1, X_2, ...$ with $X_i$(iid) Bernoulli with $p = P(X_i = 1), 0 < p < 1$. Due to disturbances the received sequence is $Y_1, Y_2, ...$ ...
1
vote
1answer
41 views

Shapiro-Wilk test

I am trying to determine if a given sample comes from a Normal distribution. For that purpose I want to perform a Shapiro-Wilk test in the way stated on wikipedia. My concern comes with the vector ...
1
vote
2answers
675 views

how to calculate vehicle speed using mathematics and Image processing?

i am doing my project in image processing.using segmentation i have detected the moving part(i.e the car) in the video successfully. But now i want to calculate speed of vehicle. in the above ...
1
vote
0answers
101 views

Expectation of $\cos(\|X\|)$ where $X \sim \mathcal{N}(\mu,\Sigma)$

Do: $$ \int_{-\infty}^\infty \int_{-\infty}^\infty \cos\left(\sqrt{x^2+y^2}\right) e^{-\frac{1}{2}\left[\frac{(x-\mu_x)^2}{\sigma_x^2} + ...
1
vote
0answers
31 views

ML estimate of sum of guassian variables?

consider the sum $z=x_{1}+...+x_{k}$, where the scalar variables $x_{i}$ are statistically independent and Gaussian, each having the same mean $0$ and variance $\sigma^2_{x}.$ how can I construct the ...
1
vote
0answers
46 views

Convergence rate of an estimator

Say we are interested in estimating some unknown real scalar parameter $\alpha$ using data. Suppose the estimator $\widehat \alpha_N$ of $\alpha$ using the data is consistent. I want to know what it ...
1
vote
0answers
97 views

Estimation of a Ito's semi-martingale linear functional

Could someone check my solution for the following problem please? Or maybe propose a smarter/shorter solution. Consider a stochastic process $X=(X_t)_{t \in [0,1]}$ defined in a filtred ...
1
vote
1answer
120 views

Maximum likelihood estimator of $P(X < y)$ for fixed $y$

I'm having a problem understanding the following question. Given the following density function $f_X(x; \theta) = (\theta +1)x^\theta$ on $0<x<1$, find the maximum likelihood estimator for ...
1
vote
0answers
87 views

Time series (stochastic process) estimating parameters using characteristic function

I have a time series of assets ${A_1, A_2, ..., A_n}$, which is described by a sophisticated distribution having the following characteristic function: $\phi(u; t;\theta)$, where $\theta$ is a vector ...
1
vote
0answers
27 views

Making sense of an equation

I'm wanting to impliment a formula but I'm having issues understanding some of the components that make it up. The premise of the equation is to use a modified version of Kalman filter that estimates ...
1
vote
1answer
44 views

Statistics: why is this probablility smaller?

a shipment of goods contains two containers, one container has 300 units and the other container has 700 units. A supervisor checks 30 units in the first container and he finds $X_1$ broken units and ...
1
vote
1answer
43 views

Overestimate of $|\oint_{|z|=R} f(z) \mathrm{d}z|$ with $f(z)=\frac{z^a}{z^2+1}$, $0<|a|<1\mathrm{with} \;a \in \mathbb R$

How can I overestimate, $|\oint_{|z|=R} f(z) \mathrm{d}z |$ with $f(z)=\frac{z^a}{z^2+1}$, $0<|a|<1 \; \mathrm{with} \;a \in \mathbb R$ ? I tried this: $|\oint_{|z|=R} f(z) \mathrm{d}z | <= ...
1
vote
0answers
30 views

A question on Stochastic Approximation

I have just started learning stochastic approximation methods, so the question I'm going to ask may be a trivial one in this field, but I need to know this seriousely. I know, that if $g(x,\xi)$ is a ...
1
vote
1answer
73 views

Is it possible to “customize” the multinomial distribution to your specifications?

So according to the multinomial distribution, the probability function $\Pr(X_1 = x_1, X_2 = x_2, \dots, X_k = x_k)$ is equal to $\dfrac{n!}{x_1! x_2! \cdots x_k!} \cdot p_1^{x_1}\cdot p_2^{x_2} ...
1
vote
1answer
295 views

How to calculate probability using multinomial distribution?

So according to the multinomial distribution, the probability function $\Pr(X_1 = x_1, X_2 = x_2, \dots, X_k = x_k)$ is equal to $\dfrac{n!}{x_1! x_2! \cdots x_k!} \cdot p_1^{x_1}\cdot p_2^{x_2} ...
1
vote
0answers
26 views

ML Estimation for number of animals in a park. Hypothesis Testing.

A park of area $S=10 000 km^2$ was surveyed for bears, and out of $n$ disjoint regions of equal area $s=1km^2$, there were $n_k$ regions with $k=0,1,....,N$ bears. On each of these regions, the amount ...
1
vote
1answer
35 views

Improving related estimates

There are three underlying quantities $x$, $y$, and $a$, where $x$ and $y$ are vectors, and $a$ is a scalar. They are related by $x = ay$. We get noisy observations, $x_0,y_0$. We want to find $a$, ...
1
vote
0answers
30 views

Is there a way to estimate the range of fitting coefficients from only the data?

Considering an approximation $f$ for a set of $N$ data points $(x,y)$ using, for example, $M$ radial basis functions at arbitrary sites in the domain $f_i = \sum_{j=1} ^M c_j\phi(||x_i-x_j||)$ where ...
1
vote
0answers
91 views

Hypothesis testing problem of Normal distributions.

Consider the following Hypothesis Testing problem: Hypothesis $H_0$ : $X \sim N(\mu_0, \sigma_0)$. Mean $\mu_0$ is known but only upper and lower bounds on $\sigma_0$ are known. Hypothesis $H_1$ : ...
1
vote
1answer
273 views

Use Held-out estimator for unseen events

Held out estimator is an empiric estimation technique for calculating probabilities of events. (I would put a Wikipedia link, but i couldn't find a wikipedia page on this subject) The main idea is to ...
1
vote
1answer
392 views

Numerical calculation of fisher information

I am trying to obtain numerically the fisher information. Given a likelihood function $$ f(X,\theta),$$ with $X \in [0,1]$. The fisher information is given by $$ ...
1
vote
1answer
97 views

biasedness/unbiasedness of an MLE.

To show whether an MLE I just found is biased/unbiased, would I need to find the expectation of the answer? Plus would I do this by integrating $\text{MLE} \cdot \text{pdf}$. My MLE is $ ...
1
vote
0answers
85 views

Estimating the number of observations from a set of samples

I repeatedly measure a value $S_n$ which is the sum of a set of $n$ hidden inputs. The goal is to identify the number of hidden inputs. All of the hidden inputs are driven by an experimenter ...
1
vote
0answers
73 views

Showing that statistic is unbiased

Let $X $ be observed data. Let $\hat{\theta}(X)$ be an unbiased estimate of $\theta$ and let T be a sucient statistic for $\theta$. Define the new estimator $\hat\theta^{*}$ of $\theta$, $$ ...
1
vote
0answers
52 views

Estimate the size of a set given random sub sets.

Assuming there is a set $S$ that you are given subsets of, $s_1, s_2, ..., s_n$, estimate $|S|$ (and a confidence interval if possible) making as few assumptions as possible. I'm not going to quibble ...
1
vote
0answers
128 views

Worst-case error related to Cramer-Rao bound

I would like to understand the relation (if any) between the Cramer-Rao Lower Bound of estimation theory and the following simple definition of "reconstruction accuracy" which doesn't use any ...
1
vote
1answer
189 views

The fundamental gaussian identities of bayesian estimation

In bayesian estimation, when the model and plant noise is hold , the optimal estimator is Kalman filter. but I am wondering is there any literature that could prove the following gaussian identities? ...
1
vote
0answers
110 views

Maximum Likelihood Estimator of SNR for a Known Signal Superimposed in AWGN

I would like to evaluate the Maximum Likelihood Estimator for the SNR of a given signal: $ x(t) = as(t-\tau) + n(t) $ Under the following assumptions (This is the model of Radar Signal): The input ...
1
vote
0answers
32 views

MLE estimation of parameters, converting normalized observations to integers and back

I am fitting a model's parameters to grouped data by maximizing the likelihood equation: $L(\theta)=N!\prod_{i=1}^{G}\frac{p_i(\theta)^{n_i}}{n_i!}$ $\theta$ is the vector of parameters. $n_i$ is ...
0
votes
2answers
50 views

Biased MLE estimate of mean (expectation)

Please give an example of p.m.f. or p.d.f. , the maximum likely-hood estimate of whose mean (expectation) is a biased estimator . Thanks
0
votes
1answer
35 views

Does consistent estimators have in-variance property?

If $(T_n)$ is a sequence of consistent estimators of a parameter $\theta$ ( i.e. for every $ \epsilon >0$ , $\lim_{n \to \infty} P [ \space |T_n -\theta|< \epsilon ]=1$ ) , then is it true that ...
0
votes
1answer
61 views

proving unbiasedness of an estimator

Question given independent random variable $X_{1},X_{2},...,X_{n}$ from a geometric distribution with parameter $p$. we have an estimator for $p$, mainly $T=Y/n$ where Y is number of $i$ that ...
0
votes
1answer
281 views

Estimator for second moment for Poisson random variable

Let $X \sim Poiss(\lambda)$. As, $\displaystyle \sum_{i=1}^{N} X_i $ is sufficient statistic for both mean (and variance) of $Y$, so we can define the unbiased estimate for mean as , $ s=\frac{1}{N} ...
0
votes
1answer
130 views

Sample size required to estimate population proportion with given precision

It plans to conduct a study on the percentage of homeowners who have at least two TVs. What should be the sample size if we want to ensure that $95\%$ of estimation error is less than $0.01$? ...
0
votes
2answers
78 views

MAP Estimator with Laplacian Noise

I need to calculate the MAP estimator of $ x $ in the following case: $$ \left [ \begin{matrix} {y}_{1}\\ {y}_{2} \end{matrix} \right ] = \left [ \begin{matrix} x\\ x \end{matrix} \right ] + ...
0
votes
1answer
481 views

Does an UMVUE's variance match the Cramer-Rao lower bound?

I know it can match the CRLB, but does it have to, if it is an UMVUE?
0
votes
1answer
76 views

Several Unbiased Estimators

If I have some data set $ D={X_1,...X_N} $ and have an esitmator be "pick the first point" $X_1$, how can I show that this estimator is unbiased? I also have to show why its highly undesirable, and I ...
0
votes
1answer
146 views

Estimation of discrete random variable

Suppose you have a discrete random variable $X_1$ with known probability mass function. I guess that choosing a variable drawn from the same pmf would be the best way to guess $X_1$ assuming all ...
0
votes
1answer
19 views

Show that $\hat{\mu}$ has minimal variance

So two independent analyses of a content in a water sample have been made using two different methods, both without systematical errors but with different standard deviations. Method $B$ is assumed to ...
0
votes
1answer
28 views

Maximum Likelihood Estimator of $\theta$

I have the following question I tried to answer I got answer that same like this answer Is this true answer? (Note that: in the question $0<p<\frac{1}{2}$, but in this answer ...
0
votes
2answers
62 views

Variance of Variance Estimation Test

I am trying to verify, through numerical simulation, the expression for the variance of the variance estimation, namely: Var(s^2)=2/n sigma^4 where n is the number of samples, and sigma is the ...
0
votes
1answer
54 views

calculating UMVUE of parameter $(1-\sigma^2)^-\frac{n}{2}$.

suppose $X_1,X_2,\ldots,X_n$ be random sample of $N(0,\sigma^2)$. how can I calculate UMVUE of parameter $(1-\sigma^2)^-\frac{n}{2}$. I know $T=\sum_{i=1}^n X_i^2$ is Sufficient and complete ...
0
votes
1answer
83 views

estimate coefficients of $y = \alpha x + \beta y + \gamma z + \epsilon$

I know how to find $m$ and $b$ for $y= mx +b$, which is : $m= \frac{\bar{x}\bar{y}- \bar{xy}}{(\bar{x})^2 - \bar{x^2}}$ and $b= \bar{y} - m\bar{x}$ How can we estimate $\alpha, \beta, \gamma$ and ...
0
votes
1answer
60 views

Maximum likelihood estimator for general multinomial

Let $(X_1,\ldots,X_r)\sim\text{multinomial}(n,(p_1,\ldots,p_r))$, where $p_r=1-p_1-\cdots-p_{r-1}$. The random likelihood is $Ap_1^{X_1}\ldots p_r^{X_r}$, for some non-zero $A$. The random ...
0
votes
1answer
21 views

Computing likelihood for data corrupted by zero mean noise

The following statement is from a text on Statistical Estimation. I am trying to figure out how the likelihood function was arrived at. By definition of likelihood, ...
0
votes
1answer
32 views

Improving data gaussianity using neural networks

I wanted to know if there is a way to use neural networks (deep neural networks or autoencoders) for a data gaussianization. I wonder how could the output data distribution be monitored and ...
0
votes
1answer
37 views

$|p- \dfrac xn|>|q- \dfrac xn|$ $\implies$ $p^x(1-p)^{n-x}<q^x(1-q)^{n-x}$?

If $p,q \in (0,1)$ , and $ n \in \mathbb N$ be given and $x$ be given integer between $0$ and $n$ such that $|p- \dfrac xn|>|q- \dfrac xn|$ , then is it true that ...
0
votes
1answer
162 views

questions on bias of estimator

a) Let $X_{1},...,X_{n}$ be i.i.d Uniform$[0,\theta]$. Show that estimator $\beta(X)=max(X_{1},..,X_{n})$ is a biased estimator for $\theta$.Find an unbiased estimator, based on $\theta$. My attempt: ...