Estimation theory is a branch of statistics and signal processing that deals with estimating the values of parameters based on measured/empirical data that has a random component.

learn more… | top users | synonyms

1
vote
0answers
19 views

Estimation of Linear Projection

Given a linear system: $Y=AX+W$ Where: $X$ is the input signal of size $N \times K$ $Y$ is the output signal of size $M \times K$ $A$ is a projection of size $M\times N$; with $M >> N$ $W$ ...
1
vote
1answer
34 views

asymptotic normality and unbiasedness of mle

Suppose $\hat{\theta}_n$ is the MLE for some parameter $\theta$. Suppose also that the MLE is such that the Cramer regularity conditions are fulfilled, and $\hat{\theta}_n$ is asymptotically normal ...
1
vote
2answers
28 views

How to periodically estimate states of a LTI if the output is measured irregularly?

How can I periodically estimate the states of a discrete linear time-invariant system in the form $$\vec{x}(k+1)=\textbf{A}\vec{x}(k)+\textbf{B}\vec{u}(k)$$ ...
1
vote
1answer
33 views

Maximum Likelihood Question

The aim is to find the maximum likelihood estimator for theta. $f(x)$ is given and we can assume that $1\le x\le-1$. I have completed the steps seen in the image, however I am having difficulty ...
1
vote
0answers
16 views

Unbiased estimator for maximum

Assume $n$ independent random variables with unknown distributions $\{X_1,X_2,...,X_n\}$. Multiple "samples" or observations for each of these variables are given (not necessarily with the same ...
1
vote
0answers
34 views

Working with the sum of two independent random variables, and estimating a parameter

A network source sends a sequence of zeros and ones, $X_1, X_2, ...$ with $X_i$(iid) Bernoulli with $p = P(X_i = 1), 0 < p < 1$. Due to disturbances the received sequence is $Y_1, Y_2, ...$ ...
1
vote
1answer
30 views

Shapiro-Wilk test

I am trying to determine if a given sample comes from a Normal distribution. For that purpose I want to perform a Shapiro-Wilk test in the way stated on wikipedia. My concern comes with the vector ...
1
vote
0answers
70 views

Expectation of $\cos(\|X\|)$ where $X \sim \mathcal{N}(\mu,\Sigma)$

Do: $$ \int_{-\infty}^\infty \int_{-\infty}^\infty \cos\left(\sqrt{x^2+y^2}\right) e^{-\frac{1}{2}\left[\frac{(x-\mu_x)^2}{\sigma_x^2} + ...
1
vote
0answers
26 views

ML estimate of sum of guassian variables?

consider the sum $z=x_{1}+...+x_{k}$, where the scalar variables $x_{i}$ are statistically independent and Gaussian, each having the same mean $0$ and variance $\sigma^2_{x}.$ how can I construct the ...
1
vote
2answers
91 views

Maximum likelihood estimator?

I am looking at some questions from Mods 2010 and I can't figure this one out. I think my problem is technical... We have a sample (L1,R1), ...,(Ln,Rn) with Lj and Rj normally distributed independent ...
1
vote
0answers
28 views

Convergence rate of an estimator

Say we are interested in estimating some unknown real scalar parameter $\alpha$ using data. Suppose the estimator $\widehat \alpha_N$ of $\alpha$ using the data is consistent. I want to know what it ...
1
vote
0answers
72 views

Estimation of a Ito's semi-martingale linear functional

Could someone check my solution for the following problem please? Or maybe propose a smarter/shorter solution. Consider a stochastic process $X=(X_t)_{t \in [0,1]}$ defined in a filtred ...
1
vote
0answers
68 views

Time series (stochastic process) estimating parameters using characteristic function

I have a time series of assets ${A_1, A_2, ..., A_n}$, which is described by a sophisticated distribution having the following characteristic function: $\phi(u; t;\theta)$, where $\theta$ is a vector ...
1
vote
0answers
22 views

Making sense of an equation

I'm wanting to impliment a formula but I'm having issues understanding some of the components that make it up. The premise of the equation is to use a modified version of Kalman filter that estimates ...
1
vote
1answer
41 views

Statistics: why is this probablility smaller?

a shipment of goods contains two containers, one container has 300 units and the other container has 700 units. A supervisor checks 30 units in the first container and he finds $X_1$ broken units and ...
1
vote
1answer
41 views

Overestimate of $|\oint_{|z|=R} f(z) \mathrm{d}z|$ with $f(z)=\frac{z^a}{z^2+1}$, $0<|a|<1\mathrm{with} \;a \in \mathbb R$

How can I overestimate, $|\oint_{|z|=R} f(z) \mathrm{d}z |$ with $f(z)=\frac{z^a}{z^2+1}$, $0<|a|<1 \; \mathrm{with} \;a \in \mathbb R$ ? I tried this: $|\oint_{|z|=R} f(z) \mathrm{d}z | <= ...
1
vote
0answers
23 views

A question on Stochastic Approximation

I have just started learning stochastic approximation methods, so the question I'm going to ask may be a trivial one in this field, but I need to know this seriousely. I know, that if $g(x,\xi)$ is a ...
1
vote
1answer
63 views

Is it possible to “customize” the multinomial distribution to your specifications?

So according to the multinomial distribution, the probability function $\Pr(X_1 = x_1, X_2 = x_2, \dots, X_k = x_k)$ is equal to $\dfrac{n!}{x_1! x_2! \cdots x_k!} \cdot p_1^{x_1}\cdot p_2^{x_2} ...
1
vote
1answer
157 views

How to calculate probability using multinomial distribution?

So according to the multinomial distribution, the probability function $\Pr(X_1 = x_1, X_2 = x_2, \dots, X_k = x_k)$ is equal to $\dfrac{n!}{x_1! x_2! \cdots x_k!} \cdot p_1^{x_1}\cdot p_2^{x_2} ...
1
vote
0answers
23 views

ML Estimation for number of animals in a park. Hypothesis Testing.

A park of area $S=10 000 km^2$ was surveyed for bears, and out of $n$ disjoint regions of equal area $s=1km^2$, there were $n_k$ regions with $k=0,1,....,N$ bears. On each of these regions, the amount ...
1
vote
1answer
33 views

Improving related estimates

There are three underlying quantities $x$, $y$, and $a$, where $x$ and $y$ are vectors, and $a$ is a scalar. They are related by $x = ay$. We get noisy observations, $x_0,y_0$. We want to find $a$, ...
1
vote
0answers
22 views

Is there a way to estimate the range of fitting coefficients from only the data?

Considering an approximation $f$ for a set of $N$ data points $(x,y)$ using, for example, $M$ radial basis functions at arbitrary sites in the domain $f_i = \sum_{j=1} ^M c_j\phi(||x_i-x_j||)$ where ...
1
vote
0answers
79 views

Hypothesis testing problem of Normal distributions.

Consider the following Hypothesis Testing problem: Hypothesis $H_0$ : $X \sim N(\mu_0, \sigma_0)$. Mean $\mu_0$ is known but only upper and lower bounds on $\sigma_0$ are known. Hypothesis $H_1$ : ...
1
vote
1answer
221 views

Numerical calculation of fisher information

I am trying to obtain numerically the fisher information. Given a likelihood function $$ f(X,\theta),$$ with $X \in [0,1]$. The fisher information is given by $$ ...
1
vote
1answer
82 views

biasedness/unbiasedness of an MLE.

To show whether an MLE I just found is biased/unbiased, would I need to find the expectation of the answer? Plus would I do this by integrating $\text{MLE} \cdot \text{pdf}$. My MLE is $ ...
1
vote
0answers
74 views

Estimating the number of observations from a set of samples

I repeatedly measure a value $S_n$ which is the sum of a set of $n$ hidden inputs. The goal is to identify the number of hidden inputs. All of the hidden inputs are driven by an experimenter ...
1
vote
0answers
70 views

Showing that statistic is unbiased

Let $X $ be observed data. Let $\hat{\theta}(X)$ be an unbiased estimate of $\theta$ and let T be a sucient statistic for $\theta$. Define the new estimator $\hat\theta^{*}$ of $\theta$, $$ ...
1
vote
0answers
49 views

Estimate the size of a set given random sub sets.

Assuming there is a set $S$ that you are given subsets of, $s_1, s_2, ..., s_n$, estimate $|S|$ (and a confidence interval if possible) making as few assumptions as possible. I'm not going to quibble ...
1
vote
0answers
121 views

Worst-case error related to Cramer-Rao bound

I would like to understand the relation (if any) between the Cramer-Rao Lower Bound of estimation theory and the following simple definition of "reconstruction accuracy" which doesn't use any ...
1
vote
1answer
145 views

The fundamental gaussian identities of bayesian estimation

In bayesian estimation, when the model and plant noise is hold , the optimal estimator is Kalman filter. but I am wondering is there any literature that could prove the following gaussian identities? ...
1
vote
0answers
102 views

Maximum Likelihood Estimator of SNR for a Known Signal Superimposed in AWGN

I would like to evaluate the Maximum Likelihood Estimator for the SNR of a given signal: $ x(t) = as(t-\tau) + n(t) $ Under the following assumptions (This is the model of Radar Signal): The input ...
1
vote
0answers
29 views

MLE estimation of parameters, converting normalized observations to integers and back

I am fitting a model's parameters to grouped data by maximizing the likelihood equation: $L(\theta)=N!\prod_{i=1}^{G}\frac{p_i(\theta)^{n_i}}{n_i!}$ $\theta$ is the vector of parameters. $n_i$ is ...
0
votes
2answers
69 views

Asymtptotic limit of $e^x$ [closed]

I am looking for functions $A,B$ such that $$ A < e^x < B.$$ $A,B$ should be as close to $e^x$ as possible. I was trying to find something, but all I found was very distant. Can someone suggest ...
0
votes
2answers
42 views

Biased MLE estimate of mean (expectation)

Please give an example of p.m.f. or p.d.f. , the maximum likely-hood estimate of whose mean (expectation) is a biased estimator . Thanks
0
votes
1answer
31 views

Does consistent estimators have in-variance property?

If $(T_n)$ is a sequence of consistent estimators of a parameter $\theta$ ( i.e. for every $ \epsilon >0$ , $\lim_{n \to \infty} P [ \space |T_n -\theta|< \epsilon ]=1$ ) , then is it true that ...
0
votes
1answer
45 views

proving unbiasedness of an estimator

Question given independent random variable $X_{1},X_{2},...,X_{n}$ from a geometric distribution with parameter $p$. we have an estimator for $p$, mainly $T=Y/n$ where Y is number of $i$ that ...
0
votes
1answer
50 views

Sample size required to estimate population proportion with given precision

It plans to conduct a study on the percentage of homeowners who have at least two TVs. What should be the sample size if we want to ensure that $95\%$ of estimation error is less than $0.01$? ...
0
votes
1answer
210 views

Does an UMVUE's variance match the Cramer-Rao lower bound?

I know it can match the CRLB, but does it have to, if it is an UMVUE?
0
votes
1answer
59 views

Several Unbiased Estimators

If I have some data set $ D={X_1,...X_N} $ and have an esitmator be "pick the first point" $X_1$, how can I show that this estimator is unbiased? I also have to show why its highly undesirable, and I ...
0
votes
1answer
138 views

Estimation of discrete random variable

Suppose you have a discrete random variable $X_1$ with known probability mass function. I guess that choosing a variable drawn from the same pmf would be the best way to guess $X_1$ assuming all ...
0
votes
1answer
26 views

$|p- \dfrac xn|>|q- \dfrac xn|$ $\implies$ $p^x(1-p)^{n-x}<q^x(1-q)^{n-x}$?

If $p,q \in (0,1)$ , and $ n \in \mathbb N$ be given and $x$ be given integer between $0$ and $n$ such that $|p- \dfrac xn|>|q- \dfrac xn|$ , then is it true that ...
0
votes
2answers
42 views

MAP Estimator with Laplacian Noise

I need to calculate the MAP estimator of $ x $ in the following case: $$ \left [ \begin{matrix} {y}_{1}\\ {y}_{2} \end{matrix} \right ] = \left [ \begin{matrix} x\\ x \end{matrix} \right ] + ...
0
votes
1answer
147 views

questions on bias of estimator

a) Let $X_{1},...,X_{n}$ be i.i.d Uniform$[0,\theta]$. Show that estimator $\beta(X)=max(X_{1},..,X_{n})$ is a biased estimator for $\theta$.Find an unbiased estimator, based on $\theta$. My attempt: ...
0
votes
1answer
27 views

Literature study for Optimal Estimation Theory

It seems Optimal Estimation/Control Theory requires a lot more than undergraduate maths. Any good book that would help me get started? I have so far referred the following books but found them quite ...
0
votes
1answer
17 views

Likelihood function for only one trial

I have a trial $\mathbb X = (X_1,X_2,....X_n)$. $X_i$ has specified distribution with unknow parameter $\theta$. I want to find an estimator of this parameter. So I can use methods like Likelihood ...
0
votes
1answer
26 views

Estimator of a Random Variable

Given a random varable $Y$ where $$ f_Y(y) = \begin{cases}e^{-(y-k)} \quad x>k\\0\quad \text{otherwise}\end{cases} $$ Given $n$ observations of $Y$. Is the sample mean $\bar{Y}$ an unbiased ...
0
votes
1answer
74 views

calculating mean squared error for the Mean.

Exam Question There are two independent random variables $X_{1}$ $\&$ $X_{2}$ that are having normal distribution with mean $\mu$. Further Var$(X_{1})=1$ and Var$(X_{2})=2$.an unbiased estimator ...
0
votes
1answer
45 views

Variance of unbiased estimator

Let $Y_1,Y_2,...,Y_N$ be a random sample from a distribution with probability density function $f_Y(y,\theta) = 2y/\theta^2$ if $0<y<\theta$ and $0$ otherwise. (a) Show that $W = 3\bar{Y}/2$ ...
0
votes
1answer
68 views

is any upper bound for mean square error of an unbiased estimator?

There is always a lower bound for an unbiased estimator called Cramer-Rao Lower Bound. Does any one remember any upper bound for unbiased estimator? The upper bound is used for worst-case analysis of ...
0
votes
1answer
76 views

A quick chanllenge: height and weight probability problem

The average height and weight of a group of people is 175cm and 70kg; Find the upper bound of the portion of the people who are over 200cm and over 100kg. I thought about Markov inequality, but I ...