Estimation theory is a branch of statistics and signal processing that deals with estimating the values of parameters based on measured/empirical data that has a random component.

learn more… | top users | synonyms

2
votes
1answer
74 views

How to compute the unique MLE from an Exponential Family of Distributions?

Let $$ f(x;\theta)=\frac{1}{\pi} \frac{e^{\theta x}\cos(\theta \pi/2)}{\cosh(x)}, x\in{\mathbb{R}} $$ be a family of densities and which is clearly exponential family. Then what is the Maximum ...
0
votes
2answers
59 views

MAP Estimator with Laplacian Noise

I need to calculate the MAP estimator of $ x $ in the following case: $$ \left [ \begin{matrix} {y}_{1}\\ {y}_{2} \end{matrix} \right ] = \left [ \begin{matrix} x\\ x \end{matrix} \right ] + ...
1
vote
1answer
99 views

Conditional expectation and Rao Blackwell

Consider a family of densitites $f(x,\theta)=\frac{\exp(-\sqrt{x})}{\theta}$. Let $X_1$ be a single observation from this family. I have shown that $\sqrt{X_1}/2$ is an unbiased estimator. Now ...
3
votes
1answer
172 views

Is a probability density function necessarily a $L^2$ function?

If a nonnegative continuous real valued function $f$ is integrable over $\mathbb{R}$ with $$\int_\mathbb{R} f\,\mathrm{d}x = 1,$$ does it hold true $$\int_\mathbb{R} f^2 \,\mathrm{d}x<\infty?$$ ...
2
votes
0answers
65 views

Alternatives to Fisher information

The Fisher information matrix is defined as the following: $$\mathcal{I}(\theta)=E[(\frac{\partial \log f(x;\theta)}{\partial \theta})^2]=-E[\frac{\partial^2 \log f(x;\theta)}{\partial \theta ...
1
vote
2answers
54 views

how to estimate the phase parameter of a complex function

There is a complex serie: $f(t_n)=\alpha_n+\beta_n i$, for $n = 1,...,N$,$t_n,\alpha_n$ and $\beta_n$ are known.When we have know that $f(t)$ has the following form: $$f(t)=Ae^{-iBt}$$ with unknown ...
0
votes
1answer
29 views

How to compute MAP estimate of y?

Suppose that a scalar random variable y is of the form $y=z+v$, where the pdf of $v$ is $p_{v}(t)=\frac{t}{2}$ on the interval $[0,2]$, and the pdf of $z$ is $p_{z}(t)=2t$on the interval $[0,1]$. Both ...
0
votes
1answer
154 views

questions on bias of estimator

a) Let $X_{1},...,X_{n}$ be i.i.d Uniform$[0,\theta]$. Show that estimator $\beta(X)=max(X_{1},..,X_{n})$ is a biased estimator for $\theta$.Find an unbiased estimator, based on $\theta$. My attempt: ...
1
vote
1answer
96 views

statistics inequality

Let $\theta$ be a discrete pararmeter and $\gamma_{n}$ be an estimator. Prove that for any $c>0$ we have that $$\text{E}[(\gamma_n-\theta)^2] \ge\Pr[|\gamma_n-\theta|>c]\cdot c^2$$
1
vote
0answers
27 views

ML estimate of sum of guassian variables?

consider the sum $z=x_{1}+...+x_{k}$, where the scalar variables $x_{i}$ are statistically independent and Gaussian, each having the same mean $0$ and variance $\sigma^2_{x}.$ how can I construct the ...
0
votes
1answer
288 views

log likelihood function of a cauchy distribution

What is the log likelihood function of a random varible x with cauchy distribution (0,1)? I've tried to work it out. I think its $\log (1+x)^2$. Is that correct?
1
vote
1answer
94 views

When is a minimum distance decoder also a maximum likelihood decoder?

It is well known that if we have a binary symmetric channel with crossover probability $\epsilon<0.5$ and we send a word $x$ through it, the most likely word is the one with minimum hamming ...
0
votes
1answer
33 views

Given 50 IID normals, find the exact SE for the estimate of $\sigma^2$?

Given 50 I.I.D Normal distributions random variables $X_i$, the Maximum Likelihood estimator for $\sigma^2$ is $\hat{\sigma}^2$, as proven in my lecture notes. Find the EXACT SE. My Attempt: ...
1
vote
0answers
40 views

Convergence rate of an estimator

Say we are interested in estimating some unknown real scalar parameter $\alpha$ using data. Suppose the estimator $\widehat \alpha_N$ of $\alpha$ using the data is consistent. I want to know what it ...
2
votes
0answers
79 views

Identification of real functions

this my second question, so I'm still new... thanks in advance for any help! Basically, I'm looking for some references and tools to study the following problem. Consider the following function ...
1
vote
1answer
75 views

Finding the MLE of pareto dist., and trouble interpreting $\prod$ notation properly.

I am generally having trouble understanding how to use product notation when calculating Maximum Likelihood Estimators. The example bellow is from a random sample $X_1,...,X_n$. Find the MLE of ...
0
votes
1answer
33 views

Mean Square Estimate problem

I have to find $\textbf{s}_{MS}$ given $\textbf{r} = h\textbf{s}+\textbf{n}$ where $h$ is a Bernoulli random variable with $Pr(h=1)=Pr(h=0) = 1/2$ and $\textbf{s}$ and $\textbf{n}$ are independent ...
0
votes
1answer
42 views

Literature study for Optimal Estimation Theory

It seems Optimal Estimation/Control Theory requires a lot more than undergraduate maths. Any good book that would help me get started? I have so far referred the following books but found them quite ...
1
vote
0answers
88 views

Estimation of a Ito's semi-martingale linear functional

Could someone check my solution for the following problem please? Or maybe propose a smarter/shorter solution. Consider a stochastic process $X=(X_t)_{t \in [0,1]}$ defined in a filtred ...
5
votes
1answer
240 views

Maximum Likelihood Estimator of the exponential function parameter based on Order Statistics

Let $X_1, \ldots, X_n$ be a random sample from the exponential distribution $\exp(\lambda)$. Let $$M_n=\max\{X_1, \ldots, X_n\}$$ with probability density function $$g_{M_n}(x)=n\lambda e^{-\lambda ...
1
vote
1answer
254 views

Find the Method Moment Estimator of parameter $\theta$

Find the MME of parameter $\theta$ in the distribution with the density $f(x,\theta)=(\theta +1)x^{-(\theta+2)}$, for $x>1$ and $\theta >0$. So far I think I have a basic understanding of the ...
1
vote
1answer
89 views

Is Sample Covariance Tied to a Specific Distribution

In many sources on data analysis, the author(s) talk about calculating covariance of the data, and the formula is given as such $$ \Sigma = cov(X) = E[(X-E[X])(X-E[X])^T]$$ This formulation is given ...
0
votes
1answer
22 views

Likelihood function for only one trial

I have a trial $\mathbb X = (X_1,X_2,....X_n)$. $X_i$ has specified distribution with unknow parameter $\theta$. I want to find an estimator of this parameter. So I can use methods like Likelihood ...
3
votes
1answer
73 views

How is the “cooking” done in surveys

In my country there's an official center undertaking surveys of voting intention every 4 months. However, they provide only "direct" voting intention, and the statistics obtained are usually pretty ...
0
votes
1answer
33 views

Estimator of a Random Variable

Given a random varable $Y$ where $$ f_Y(y) = \begin{cases}e^{-(y-k)} \quad x>k\\0\quad \text{otherwise}\end{cases} $$ Given $n$ observations of $Y$. Is the sample mean $\bar{Y}$ an unbiased ...
1
vote
2answers
119 views

Estimation theory: Finding MSE and Variance of an Estimator

Let $\hat{A}$ be an estimator of $A$ where $a<A<b$ and $\tilde{A}$ be another estimator such that$$\tilde{A} = \cases{a \text{ if } \hat A \leq a\\\hat A \text{ if } a< \hat A <b\\{b ...
3
votes
2answers
92 views

Calculating likelihood of event based on retrospective analysis

I have a simple dataset consisting of the dates/times at which certain medications were taken by a patient. By looking retrospectively I'd like to make a best guess estimate as to which medication ...
2
votes
3answers
97 views

More accurate estimation of mathematical constant $e$

Very often in books and also on Wikipedia we can find that: $$e \approx \left(1+\frac{1}{n}\right)^n$$ but I want more accurate estimation, it means instead using $\approx$ I wonder if I can use ...
1
vote
1answer
116 views

Maximum likelihood estimator of $P(X < y)$ for fixed $y$

I'm having a problem understanding the following question. Given the following density function $f_X(x; \theta) = (\theta +1)x^\theta$ on $0<x<1$, find the maximum likelihood estimator for ...
0
votes
0answers
24 views

Estimate the population mean when random selection is not possible

Consider I have a jar with marbles labeled 0 and 1 in it. They're not well mixed so the possibility of obtaining a sample sized 1000 with mean 0.6 and another sample sized 1000 with mean 0.4 is not so ...
1
vote
2answers
124 views

If $(X_i)$ are i.i.d. exponential $\lambda$, then $\hat\lambda=n/\sum{X_i}$ is a biased estimator of $\lambda$

the main problem is that i have no clue on calculating $E(\frac{1}{x})$ let $U = \frac{1}{\frac{1}{n}\sum{X_i}}$ then, $E(U) = n*E(\frac{1}{\sum{X_i}})$. I think that i'm supposed to calculate: ...
1
vote
1answer
48 views

How to estimate a vocabulary size?

I have a list of the 1 million most common English words ordered by number of times they appear on all books in Google Books. I want for the user to select from a list of 100 words (small sample) ...
0
votes
1answer
53 views

proving unbiasedness of an estimator

Question given independent random variable $X_{1},X_{2},...,X_{n}$ from a geometric distribution with parameter $p$. we have an estimator for $p$, mainly $T=Y/n$ where Y is number of $i$ that ...
1
vote
0answers
82 views

Time series (stochastic process) estimating parameters using characteristic function

I have a time series of assets ${A_1, A_2, ..., A_n}$, which is described by a sophisticated distribution having the following characteristic function: $\phi(u; t;\theta)$, where $\theta$ is a vector ...
0
votes
1answer
108 views

calculating mean squared error for the Mean.

Exam Question There are two independent random variables $X_{1}$ $\&$ $X_{2}$ that are having normal distribution with mean $\mu$. Further Var$(X_{1})=1$ and Var$(X_{2})=2$.an unbiased estimator ...
0
votes
1answer
19 views

Estimating Attendence

I am trying to estimate attendance at events. What I have is daily/weekly ticket sales numbers. The goal is to analyze the ticket sales each day and estimate where we might be at by the day of the ...
0
votes
0answers
44 views

Variance of a difference in estimated proportions with trivariate discrete distributions

Let a multivariate distribution be given by $P(Y,S_1,S_2)$, where all three variables are discrete, $Y$ is multivalued, $S_1=(0,1)$ and $S_2=(0,1)$, respectively, and all may be dependent. Define the ...
2
votes
0answers
65 views

Unbiased estimator with conditional expectation.

Suppose that $X$ has a binomial distribution with parameter $N=1$ and $p=1/2$. Y, which is independent of $X$, has a normal distribution with mean $\mu$ and variance 1. Consider the estimator $\mu$ of ...
0
votes
1answer
59 views

Variance of unbiased estimator

Let $Y_1,Y_2,...,Y_N$ be a random sample from a distribution with probability density function $f_Y(y,\theta) = 2y/\theta^2$ if $0<y<\theta$ and $0$ otherwise. (a) Show that $W = 3\bar{Y}/2$ ...
0
votes
1answer
86 views

is any upper bound for mean square error of an unbiased estimator?

There is always a lower bound for an unbiased estimator called Cramer-Rao Lower Bound. Does any one remember any upper bound for unbiased estimator? The upper bound is used for worst-case analysis of ...
1
vote
0answers
24 views

Making sense of an equation

I'm wanting to impliment a formula but I'm having issues understanding some of the components that make it up. The premise of the equation is to use a modified version of Kalman filter that estimates ...
1
vote
2answers
108 views

Finding the MLE of a function when L'($\theta$) doesn't depend on $\theta$

Here's the problem: Find the MLE of of $\theta$ when $f(x\mid\theta)=(1+x\theta)/2$ for $-1<x<1$, $=0$ otherwise. $0<\theta<1$ Find the maximum likelihood of $\theta$ and find its ...
4
votes
2answers
70 views

estimation of a parameter

The question is: $x_i = \alpha + \omega_i, $ for $i = 1, \ldots, n.$ where $\alpha$ is a non-zero constant, but unknown, parameter to be estimated, and $\omega_i$ are uncorrelated, zero_mean, ...
1
vote
1answer
34 views

Conjugate Bayesian analysis

Suppose that conditional on $\tau$, the random variable $X$ has normal distribution with mean zero and variance $1/ \tau$. The prior distribution for $\tau$ is Gamma with parameter $\alpha$ and ...
2
votes
1answer
26 views

How to show this estimation?

i have this polynom $$p(x) = \sum_{i=0}^{m}a_ix^i$$ I want to show, that if $\tilde{z}$ is the approximation to the simple zero digit $z \neq 0$ in first approximation, the following estimation ...
0
votes
1answer
25 views

How to show, that a relative mistake of a special function can be estimated in a given way

how to show, that if you have a function like this $$ y = f(x_1,...,x_m) := c \frac{x_1 *...*x_r}{x_{r+1},...,x_m}, \quad 1 < r \leq m,$$ the relative mistake in first order can be estimated ...
0
votes
1answer
85 views

A quick chanllenge: height and weight probability problem

The average height and weight of a group of people is 175cm and 70kg; Find the upper bound of the portion of the people who are over 200cm and over 100kg. I thought about Markov inequality, but I ...
0
votes
1answer
140 views

Maximum Likelihood

Find maximum likelihood estimator $\hat\theta$ of $f(x;\theta) = (1/2)\exp(-|x-\theta|)$, for $-\infty \leq x < \infty$ and $-\infty \leq x < \infty$. I am confused of how to deal with the ...
1
vote
1answer
147 views

Optimal combination of two estimates

I have a set of random variables, $X_1,\dots,X_N$. They are i.i.d. Gaussian with zero mean and $w$ variance. I observe $Y_1,\dots,Y_N$ where $Y_i=\sum_{j=1}^N a_{ij} X_j+N_i$ where all $a_{ij}$s are ...
1
vote
1answer
44 views

Statistics: why is this probablility smaller?

a shipment of goods contains two containers, one container has 300 units and the other container has 700 units. A supervisor checks 30 units in the first container and he finds $X_1$ broken units and ...