Estimation theory is a branch of statistics and signal processing that deals with estimating the values of parameters based on measured/empirical data that has a random component.

learn more… | top users | synonyms

0
votes
1answer
457 views

Estimator for second moment for Poisson random variable

Let $X \sim Poiss(\lambda)$. As, $\displaystyle \sum_{i=1}^{N} X_i $ is sufficient statistic for both mean (and variance) of $Y$, so we can define the unbiased estimate for mean as , $ s=\frac{1}{N} \...
0
votes
1answer
42 views

Improving data gaussianity using neural networks

I wanted to know if there is a way to use neural networks (deep neural networks or autoencoders) for a data gaussianization. I wonder how could the output data distribution be monitored and ...
0
votes
1answer
147 views

Sample size required to estimate population proportion with given precision

It plans to conduct a study on the percentage of homeowners who have at least two TVs. What should be the sample size if we want to ensure that $95\%$ of estimation error is less than $0.01$? ...
0
votes
2answers
97 views

MAP Estimator with Laplacian Noise

I need to calculate the MAP estimator of $ x $ in the following case: $$ \left [ \begin{matrix} {y}_{1}\\ {y}_{2} \end{matrix} \right ] = \left [ \begin{matrix} x\\ x \end{matrix} \right ] + \...
0
votes
1answer
583 views

Does an UMVUE's variance match the Cramer-Rao lower bound?

I know it can match the CRLB, but does it have to, if it is an UMVUE?
0
votes
1answer
82 views

Several Unbiased Estimators

If I have some data set $ D={X_1,...X_N} $ and have an esitmator be "pick the first point" $X_1$, how can I show that this estimator is unbiased? I also have to show why its highly undesirable, and I ...
0
votes
1answer
147 views

Estimation of discrete random variable

Suppose you have a discrete random variable $X_1$ with known probability mass function. I guess that choosing a variable drawn from the same pmf would be the best way to guess $X_1$ assuming all ...
0
votes
1answer
44 views

Bayesian Estimation: calculating an integral

I am reading a book on Bayesian filtering and I have a question regarding calculating transition density $p(X_t|X_{t-1})$. My question is how the term $p(X_t|X_{t-1}, V_{t}=v)$ is converted to the ...
0
votes
1answer
21 views

Which test statistic is better for testing population mean?

Consider the following situation: a stochastic variable $X: (\Omega, \mathcal{F}) \to (\mathbb{R}, \mathcal{R})$ is known to be normally distributed with some mean $\mu$ and some variance $\sigma^2$. ...
0
votes
1answer
31 views

What is an estimator?

If $p_y$ is a probability function for a density, which depends on the value of $y$ (for example, $y$ might be the mean in the poisson distribution). Assuming that $y$ is random -- i.e. unknown -- ...
0
votes
1answer
42 views

Prove the consistency of Gamma distribution estimators

Given $X$ a random variable in a Gamma distribution, $f(x ; \alpha,\beta)$, and: $E(X) = \alpha \beta$ $Var(X) = \alpha \beta^2$ $\hat \alpha = $$\bar X \over \beta$ $\hat \beta = $$\frac {n \bar ...
0
votes
1answer
35 views

Help me understand this matrix derivative (for the LS estimation proof)

I'm trying to understand this proof of LS estimation, but I've never studied matrix calculus. I've managed to find a couple of identities on the web and and I see how to get the first part of the ...
0
votes
1answer
37 views

IMPROVED - Proving that a statistics is not sufficient (Gaussian case).

Let $X=(X_1,...,X_n)$ be i.i.d. $N(0,\sigma^2)$. How to show that $$\frac{2}{n}\sum_{i=1}^{n}X_i$$ is not a sufficient statistic? I have already proven that $\max_{i=1,...,n}X_i$ is a sufficient ...
0
votes
2answers
26 views

Show that $\hat{\mu}$ has minimal variance

So two independent analyses of a content in a water sample have been made using two different methods, both without systematical errors but with different standard deviations. Method $B$ is assumed to ...
0
votes
1answer
36 views

Maximum Likelihood Estimator of $\theta$

I have the following question I tried to answer I got answer that same like this answer Is this true answer? (Note that: in the question $0<p<\frac{1}{2}$, but in this answer $...
0
votes
2answers
114 views

Variance of Variance Estimation Test

I am trying to verify, through numerical simulation, the expression for the variance of the variance estimation, namely: Var(s^2)=2/n sigma^4 where n is the number of samples, and sigma is the ...
0
votes
1answer
68 views

calculating UMVUE of parameter $(1-\sigma^2)^-\frac{n}{2}$.

suppose $X_1,X_2,\ldots,X_n$ be random sample of $N(0,\sigma^2)$. how can I calculate UMVUE of parameter $(1-\sigma^2)^-\frac{n}{2}$. I know $T=\sum_{i=1}^n X_i^2$ is Sufficient and complete ...
0
votes
1answer
109 views

estimate coefficients of $y = \alpha x + \beta y + \gamma z + \epsilon$

I know how to find $m$ and $b$ for $y= mx +b$, which is : $m= \frac{\bar{x}\bar{y}- \bar{xy}}{(\bar{x})^2 - \bar{x^2}}$ and $b= \bar{y} - m\bar{x}$ How can we estimate $\alpha, \beta, \gamma$ and $\...
0
votes
1answer
71 views

Maximum likelihood estimator for general multinomial

Let $(X_1,\ldots,X_r)\sim\text{multinomial}(n,(p_1,\ldots,p_r))$, where $p_r=1-p_1-\cdots-p_{r-1}$. The random likelihood is $Ap_1^{X_1}\ldots p_r^{X_r}$, for some non-zero $A$. The random log-...
0
votes
1answer
21 views

Computing likelihood for data corrupted by zero mean noise

The following statement is from a text on Statistical Estimation. I am trying to figure out how the likelihood function was arrived at. By definition of likelihood, $p_{\bf{X}|\theta}p(\bf{X}|\...
0
votes
1answer
43 views

$|p- \dfrac xn|>|q- \dfrac xn|$ $\implies$ $p^x(1-p)^{n-x}<q^x(1-q)^{n-x}$?

If $p,q \in (0,1)$ , and $ n \in \mathbb N$ be given and $x$ be given integer between $0$ and $n$ such that $|p- \dfrac xn|>|q- \dfrac xn|$ , then is it true that $p^x(1-p)^{n-x}<q^x(1-q)^{n-x}...
0
votes
1answer
164 views

questions on bias of estimator

a) Let $X_{1},...,X_{n}$ be i.i.d Uniform$[0,\theta]$. Show that estimator $\beta(X)=max(X_{1},..,X_{n})$ is a biased estimator for $\theta$.Find an unbiased estimator, based on $\theta$. My attempt: $...
0
votes
2answers
64 views

Literature study for Optimal Estimation Theory

It seems Optimal Estimation/Control Theory requires a lot more than undergraduate maths. Any good book that would help me get started? I have so far referred the following books but found them quite ...
0
votes
1answer
22 views

Likelihood function for only one trial

I have a trial $\mathbb X = (X_1,X_2,....X_n)$. $X_i$ has specified distribution with unknow parameter $\theta$. I want to find an estimator of this parameter. So I can use methods like Likelihood ...
0
votes
1answer
34 views

Estimator of a Random Variable

Given a random varable $Y$ where $$ f_Y(y) = \begin{cases}e^{-(y-k)} \quad x>k\\0\quad \text{otherwise}\end{cases} $$ Given $n$ observations of $Y$. Is the sample mean $\bar{Y}$ an unbiased ...
0
votes
1answer
198 views

calculating mean squared error for the Mean.

Exam Question There are two independent random variables $X_{1}$ $\&$ $X_{2}$ that are having normal distribution with mean $\mu$. Further Var$(X_{1})=1$ and Var$(X_{2})=2$.an unbiased estimator ...
0
votes
1answer
95 views

Variance of unbiased estimator

Let $Y_1,Y_2,...,Y_N$ be a random sample from a distribution with probability density function $f_Y(y,\theta) = 2y/\theta^2$ if $0<y<\theta$ and $0$ otherwise. (a) Show that $W = 3\bar{Y}/2$ ...
0
votes
1answer
125 views

is any upper bound for mean square error of an unbiased estimator?

There is always a lower bound for an unbiased estimator called Cramer-Rao Lower Bound. Does any one remember any upper bound for unbiased estimator? The upper bound is used for worst-case analysis of ...
0
votes
1answer
101 views

A quick chanllenge: height and weight probability problem

The average height and weight of a group of people is 175cm and 70kg; Find the upper bound of the portion of the people who are over 200cm and over 100kg. I thought about Markov inequality, but I ...
0
votes
1answer
56 views

Estimator in a one dimensional normal setting with only one observation

Let $X$ have the distribution $N(\theta,1)$ where $\theta \ge 0$. Is $T=X$ an admissible estimator with respect to the mean squared error? Construct an estimator that respects the assumption $\theta ...
0
votes
1answer
349 views

Finding UMVUE from Lehmann-Sheffe Directly

I am having some trouble with an example from the book I am following. Let $X_1,X_2,...,X_n$ for $n>2$ be an iid set of $N(\mu,\sigma^2)$ random variables with, $\mu\in\mathbb{R}$ and $\sigma^2\in\...
0
votes
1answer
15 views

Estimating $\hat{p}$

let $X\sim Bin(n,p)$ and $\hat{p} =\frac{X}{n}$ a) Find a constant c such that $E[c\hat{p}(1-\hat{p})]=p(1-p)$ My work: $$ \begin{align} cE[\hat{p}(1-\hat{p})] &=E[\frac{X}{n}]-E[\frac{X^...
0
votes
1answer
54 views

Random Poisson Sample, Probability in terms of $\vartheta$

If $X_1, X_2, \ldots, X_n$ are a random sample from a Poisson Distribution with mean $\vartheta>0$, how do you find $P(X\le 1)$ in terms of $\vartheta$? I've proven that summing $X_i$ for $i=1,\...
0
votes
1answer
145 views

Finding expected value of variance estimator (sum expansion problem)

I am trying to show that variance estimator $\frac{1}{n}\sum_{i=1}^{n}(X_i-\bar{X})^2$ is biased. I have an example in the book, and there is one step of this derivation I cannot understand: $\frac{1}...
0
votes
1answer
9k views

Calculating the variance of an estimator (unclear on one step)

How can you go from $4V(\bar X)$ to $\displaystyle \frac{4}{n}V(X_1)$? I understand the rest of the steps...
0
votes
1answer
300 views

Empirical Bayes estimator for a Beta-Binomial parameters

Let $X_t$ be collected from a Binomial distribution with parameters $N_t$ and $P_t$, where $N_t$ is known for $t= 1, 2, \dots , T$. On the other hand, $P_t \sim \operatorname{Beta}(\alpha_t, \beta_t)$....
0
votes
1answer
355 views

Scale Median for MRE Estimators with Absolute Difference Error Function for Scale Families

Lehmann, in Theory of Point Estimation p.212, defines scale median as the solution to: $${E(X)I(X\le c)} = {E(X)I(X\ge c)}$$ given $X$ is a positive random variable, and ${E(X)}< \infty$. Now ...
0
votes
1answer
106 views

How to estimate parameters of a normal distribution?

Suppose one knew that 105 workers were evaluated by their boss. Such evaluation is distributed according to a normal distribution with mean $\mu$ and std. deviation $\sigma$. We also know that 20 ...
0
votes
1answer
33 views

How to obtain estimate of covariance matrix that will be guarantee to be semi-positive define?

How to obtain estimate of covariance matrix that will be guarantee to be semi-positive define ? (Is CrossValidated better place for this question ?)
0
votes
1answer
492 views

how can I get minimum error probability for this decision problem?

I have the decision problem for 4 hypotheses as follows: $$H_j: Y_k=N_k-s_{jk},\ k=1,2,\ldots,n;\ j=0,1,2,3.$$ where signals are $s_{jk}=E_0\sin(w_cT(k-1)+(j+\frac{1}{2})\frac{\pi}{2}).$ $$$$ In ...
0
votes
2answers
1k views

Exponential Distribution Maximum Likelihood

I found the following question in a past exam paper and I would like to ask how to solve it as I can't find anything in the notes related to it: ...
0
votes
1answer
152 views

Proof of convergence of a sum of mean-consistent estimators

After a few weeks off I am back at my self-study of Measure-Theoretic probability. As always, I thank the community for any detail and answers they can provide as I try to work myself through these ...
0
votes
1answer
233 views

Estimation Theory - Maximum Likelihood Estimation

The below homework question comes from Larsen and Marx, 4th edition. Is the maximum likelihood estimator for $\sigma^{2}$ in a normal pdf, where both $\mu$ and >$\sigma^{2}$ are unknown, ...
0
votes
1answer
279 views

How to match a discrete distribution to a continuous distribution in information theoretic sense?

Let $$ S \sim N(\mu, \sigma^2) $$ be a normally distributed random variable with known $\mu$ and $\sigma^2$. Suppose, we observe $$ X = \begin{cases} T & \text{if $S \ge 0$}, \\ -T & \text{...
0
votes
1answer
46 views

Estimating a function given a noisy sequence of its output

I am new to this forum. Please forgive me if this question is elementary, but I am somewhat lost and could use a little guidance. Suppose I have an unknown function $f(i)=x_i$. I have a sequence of ...
0
votes
3answers
134 views

Fair selection of most popular items among separate voting sets

This is a practical problem that arose in real life, which I believe creates interesting mathematical questions. There is a festival of small plays lasting 8 weeks. Each week 10 short plays are ...
0
votes
1answer
45 views

Bayesian Example

Ex. suppose that $x=2$ denotes the number of successes in $n=5$ independent trials with probability $θ$ of success, that is $x$ has a binomial distribution with the parameters $n=5$ and $ θ$. ...
0
votes
0answers
8 views

A question about Estimation problem in digital communication setup.

I originally asked this problem here http://dsp.stackexchange.com/questions/31503/estimation-problem-for-m-ary-pam-transmission-over-awgn-channel-problem I would appreciate if someone can take a ...
0
votes
0answers
32 views

Expected value of maximum likelihood estimator of a Bernoulli random variable

While reading the text from Keith H. Thompson on the Estimation of the Proportion of Vectors in a Natural Population of Insects, I came across the following part where I don't understand everything. ...
0
votes
0answers
10 views

If a family of densities is not complete then is it necessary that there isn't any MVUE?

The question is about the truth of this statement: "If the family $\{f(x;\theta):\theta\in\Omega\}$ is not complete, then there doesn't exist any MVUE" MVUE is an abbreviation for "Minimum Variance ...