Estimation theory is a branch of statistics and signal processing that deals with estimating the values of parameters based on measured/empirical data that has a random component.

learn more… | top users | synonyms

0
votes
2answers
66 views

Asymtptotic limit of $e^x$ [closed]

I am looking for functions $A,B$ such that $$ A < e^x < B.$$ $A,B$ should be as close to $e^x$ as possible. I was trying to find something, but all I found was very distant. Can someone suggest ...
3
votes
1answer
66 views

How is the “cooking” done in surveys

In my country there's an official center undertaking surveys of voting intention every 4 months. However, they provide only "direct" voting intention, and the statistics obtained are usually pretty ...
0
votes
1answer
25 views

Estimator of a Random Variable

Given a random varable $Y$ where $$ f_Y(y) = \begin{cases}e^{-(y-k)} \quad x>k\\0\quad \text{otherwise}\end{cases} $$ Given $n$ observations of $Y$. Is the sample mean $\bar{Y}$ an unbiased ...
1
vote
2answers
102 views

Estimation theory: Finding MSE and Variance of an Estimator

Let $\hat{A}$ be an estimator of $A$ where $a<A<b$ and $\tilde{A}$ be another estimator such that$$\tilde{A} = \cases{a \text{ if } \hat A \leq a\\\hat A \text{ if } a< \hat A <b\\{b ...
3
votes
2answers
66 views

Calculating likelihood of event based on retrospective analysis

I have a simple dataset consisting of the dates/times at which certain medications were taken by a patient. By looking retrospectively I'd like to make a best guess estimate as to which medication ...
0
votes
0answers
23 views

Prove that an estimator is UMVU under the usual “assumptions of regularity”

I'm asked to prove that some estimator is UMVU under the usual assumptions of regularity. I'm not sure what is meant with 'usual assumptions of regularity'. Do they mean with this that I can just ...
2
votes
3answers
82 views

More accurate estimation of mathematical constant $e$

Very often in books and also on Wikipedia we can find that: $$e \approx \left(1+\frac{1}{n}\right)^n$$ but I want more accurate estimation, it means instead using $\approx$ I wonder if I can use ...
0
votes
1answer
98 views

Maximum likelihood estimator of $P(X < y)$ for fixed $y$

I'm having a problem understanding the following question. Given the following density function $f_X(x; \theta) = (\theta +1)x^\theta$ on $0<x<1$, find the maximum likelihood estimator for ...
0
votes
0answers
21 views

Estimate the population mean when random selection is not possible

Consider I have a jar with marbles labeled 0 and 1 in it. They're not well mixed so the possibility of obtaining a sample sized 1000 with mean 0.6 and another sample sized 1000 with mean 0.4 is not so ...
0
votes
0answers
47 views

Computing an estimator for a piecewise distribution?

Suppose I have a random variable $X$ that follows a distribution with a piecewise function $f(x|\theta)$. What is the correct way to compute an estimator $\theta$ for this function? Should the ...
1
vote
2answers
96 views

Let $(X_1…X_n)$ have an exp($\lambda$) distribution. Prove that $\frac{1}{\frac{1}{n}\sum{X_i}}$ is not a unbiased estimator of $\lambda$

the main problem is that i have no clue on calculating $E(\frac{1}{x})$ let $U = \frac{1}{\frac{1}{n}\sum{X_i}}$ then, $E(U) = n*E(\frac{1}{\sum{X_i}})$. I think that i'm supposed to calculate: ...
1
vote
1answer
34 views

How to estimate a vocabulary size?

I have a list of the 1 million most common English words ordered by number of times they appear on all books in Google Books. I want for the user to select from a list of 100 words (small sample) ...
0
votes
1answer
41 views

proving unbiasedness of an estimator

Question given independent random variable $X_{1},X_{2},...,X_{n}$ from a geometric distribution with parameter $p$. we have an estimator for $p$, mainly $T=Y/n$ where Y is number of $i$ that ...
1
vote
0answers
59 views

Time series (stochastic process) estimating parameters using characteristic function

I have a time series of assets ${A_1, A_2, ..., A_n}$, which is described by a sophisticated distribution having the following characteristic function: $\phi(u; t;\theta)$, where $\theta$ is a vector ...
0
votes
1answer
53 views

calculating mean squared error for the Mean.

Exam Question There are two independent random variables $X_{1}$ $\&$ $X_{2}$ that are having normal distribution with mean $\mu$. Further Var$(X_{1})=1$ and Var$(X_{2})=2$.an unbiased estimator ...
0
votes
1answer
18 views

Estimating Attendence

I am trying to estimate attendance at events. What I have is daily/weekly ticket sales numbers. The goal is to analyze the ticket sales each day and estimate where we might be at by the day of the ...
0
votes
0answers
41 views

Variance of a difference in estimated proportions with trivariate discrete distributions

Let a multivariate distribution be given by $P(Y,S_1,S_2)$, where all three variables are discrete, $Y$ is multivalued, $S_1=(0,1)$ and $S_2=(0,1)$, respectively, and all may be dependent. Define the ...
2
votes
0answers
44 views

Unbiased estimator with conditional expectation.

Suppose that $X$ has a binomial distribution with parameter $N=1$ and $p=1/2$. Y, which is independent of $X$, has a normal distribution with mean $\mu$ and variance 1. Consider the estimator $\mu$ of ...
0
votes
1answer
40 views

Variance of unbiased estimator

Let $Y_1,Y_2,...,Y_N$ be a random sample from a distribution with probability density function $f_Y(y,\theta) = 2y/\theta^2$ if $0<y<\theta$ and $0$ otherwise. (a) Show that $W = 3\bar{Y}/2$ ...
0
votes
1answer
56 views

is any upper bound for mean square error of an unbiased estimator?

There is always a lower bound for an unbiased estimator called Cramer-Rao Lower Bound. Does any one remember any upper bound for unbiased estimator? The upper bound is used for worst-case analysis of ...
1
vote
2answers
90 views

Finding the MLE of a function when L'($\theta$) doesn't depend on $\theta$

Here's the problem: Find the MLE of of $\theta$ when $f(x\mid\theta)=(1+x\theta)/2$ for $-1<x<1$, $=0$ otherwise. $0<\theta<1$ Find the maximum likelihood of $\theta$ and find its ...
0
votes
0answers
40 views

maximum likelihood estimate

Two random variable X and Y have the following joint pdf: $P_{XY}(x, y) = \begin{cases} 10y,& \text{for } 0\leq y \leq x^2 \text{and} 0 \leq x \leq 1,\\ 0, & ...
4
votes
2answers
60 views

estimation of a parameter

The question is: $x_i = \alpha + \omega_i, $ for $i = 1, \ldots, n.$ where $\alpha$ is a non-zero constant, but unknown, parameter to be estimated, and $\omega_i$ are uncorrelated, zero_mean, ...
1
vote
1answer
27 views

Conjugate Bayesian analysis

Suppose that conditional on $\tau$, the random variable $X$ has normal distribution with mean zero and variance $1/ \tau$. The prior distribution for $\tau$ is Gamma with parameter $\alpha$ and ...
0
votes
0answers
40 views

Maximization of The Likelihood Function of Vector Entries and Its Norm

I'd be happy for assistance with the maximization of the likelihood function of the following model. The Parameters Vector $ \mathbf{\Theta} = [{x}_{1}, {x}_{2}] $. The measurement vector is $ ...
2
votes
1answer
22 views

How to show this estimation?

i have this polynom $$p(x) = \sum_{i=0}^{m}a_ix^i$$ I want to show, that if $\tilde{z}$ is the approximation to the simple zero digit $z \neq 0$ in first approximation, the following estimation ...
0
votes
1answer
24 views

How to show, that a relative mistake of a special function can be estimated in a given way

how to show, that if you have a function like this $$ y = f(x_1,...,x_m) := c \frac{x_1 *...*x_r}{x_{r+1},...,x_m}, \quad 1 < r \leq m,$$ the relative mistake in first order can be estimated ...
0
votes
1answer
73 views

A quick chanllenge: height and weight probability problem

The average height and weight of a group of people is 175cm and 70kg; Find the upper bound of the portion of the people who are over 200cm and over 100kg. I thought about Markov inequality, but I ...
0
votes
1answer
114 views

Maximum Likelihood

Find maximum likelihood estimator $\hat\theta$ of $f(x;\theta) = (1/2)\exp(-|x-\theta|)$, for $-\infty \leq x < \infty$ and $-\infty \leq x < \infty$. I am confused of how to deal with the ...
1
vote
1answer
115 views

Optimal combination of two estimates

I have a set of random variables, $X_1,\dots,X_N$. They are i.i.d. Gaussian with zero mean and $w$ variance. I observe $Y_1,\dots,Y_N$ where $Y_i=\sum_{j=1}^N a_{ij} X_j+N_i$ where all $a_{ij}$s are ...
1
vote
1answer
41 views

Statistics: why is this probablility smaller?

a shipment of goods contains two containers, one container has 300 units and the other container has 700 units. A supervisor checks 30 units in the first container and he finds $X_1$ broken units and ...
1
vote
1answer
41 views

Overestimate of $|\oint_{|z|=R} f(z) \mathrm{d}z|$ with $f(z)=\frac{z^a}{z^2+1}$, $0<|a|<1\mathrm{with} \;a \in \mathbb R$

How can I overestimate, $|\oint_{|z|=R} f(z) \mathrm{d}z |$ with $f(z)=\frac{z^a}{z^2+1}$, $0<|a|<1 \; \mathrm{with} \;a \in \mathbb R$ ? I tried this: $|\oint_{|z|=R} f(z) \mathrm{d}z | <= ...
0
votes
1answer
176 views

expectation of Gamma distribution help

If x∼Gamma(1,λ) how would i find the expected value E(e^bx) where b=aλ I'm kinda stuck as to how to approach the question. Some help will be greatly appreciated Thank you in advance
2
votes
2answers
57 views

Why we always put log() before the joint pdf when we use MLE(Maximum likelihood Estimation)?

Maybe this question is simple, but I really need some help. When we use the Maximum Likelihood Estimation(MLE) to estimate the parameters, why we always put the log() before the joint density? To use ...
0
votes
1answer
46 views

Suitability of skew normal for rating task and calculation

in an experiment, I ask participants to rate qualities on a continuous scale. I expect the results to be normal distributed and I am confident that assuming a normal works fairly well for most values. ...
0
votes
0answers
40 views

Assigning prior to $\gamma$ in composite power function $P(t) = max[\lambda t^{-\beta}, \gamma]$

I want to estimate the parameters $\lambda, \beta$ and $\gamma$ using a bayesian approach and an MCMC sampler. With the exception of $t$ all variables are random variables between $0$ and $1$. $t$ is ...
1
vote
0answers
21 views

A question on Stochastic Approximation

I have just started learning stochastic approximation methods, so the question I'm going to ask may be a trivial one in this field, but I need to know this seriousely. I know, that if $g(x,\xi)$ is a ...
-1
votes
1answer
198 views

CRLB to find UMVUE

In what situation can one obtain an estimator that reaches the Cramer-Rao lower bound, i.e. an efficient estimator? I know the rules for finding UMVUEs, and I know they are efficient if they reach ...
0
votes
1answer
153 views

Does an UMVUE's variance match the Cramer-Rao lower bound?

I know it can match the CRLB, but does it have to, if it is an UMVUE?
1
vote
2answers
149 views

Does convergence in probability not imply convergence in distribution for Least Squares estimators?

I have a question relating to convergence in probability and distribution for least squares estimators. Frequently, I see in textbooks that $\hat{\beta} \rightarrow^p b$. Where $b$ is the population ...
0
votes
0answers
18 views

Difference between two model fitting schemes

We have some experimental data, $x \mapsto \hat{f}$ and we're trying to fit a known model of the form $$f(x\ \left|\right.\ a_1, a_2, a_3, b_1, b_2, b_3) = a_1 F(b_1, x) + a_2 F(b_2, x) + a_3 F(b_3, ...
2
votes
0answers
38 views

What are the properties of median-unbiased estimators?

On Wikipedia it says that " A median-unbiased estimator minimizes the risk with respect to the absolute-deviation loss function, as observed by Laplace." How to prove this? Note that I asked on Cross ...
1
vote
1answer
59 views

Is it possible to “customize” the multinomial distribution to your specifications?

So according to the multinomial distribution, the probability function $\Pr(X_1 = x_1, X_2 = x_2, \dots, X_k = x_k)$ is equal to $\dfrac{n!}{x_1! x_2! \cdots x_k!} \cdot p_1^{x_1}\cdot p_2^{x_2} ...
1
vote
1answer
145 views

How to calculate probability using multinomial distribution?

So according to the multinomial distribution, the probability function $\Pr(X_1 = x_1, X_2 = x_2, \dots, X_k = x_k)$ is equal to $\dfrac{n!}{x_1! x_2! \cdots x_k!} \cdot p_1^{x_1}\cdot p_2^{x_2} ...
1
vote
1answer
202 views

Find maximum likelihood estimator, trick?

Let $Y_1, Y_2, \ldots, Y_n$ iid random variables with density $f(y)=\theta\cdot y^{\theta-1}$, $0<y<1$, $\theta >0$. I need to show that the maximum likelihood estimator of $\theta$ is ...
3
votes
2answers
81 views

Estimating time in harmonic signal

I hope someone can help me with the following problem: Assume a periodic signal of the form $$\begin{align} s(t) &= \sum\limits_{p=1}^P \sin(p\Omega_0t)\\ &= \sum\limits_{p=1}^P ...
0
votes
0answers
78 views

Markov Chain : Montonicity of Sample Mean

Let $\{X_n\}_{n\geq1}$ be an irreducible, ergodic Markov chain with discrete state-space $S$, transition probability matrix $P$ and steady state distribution $\pi = \{\pi_j\}_{j\in S}$. Let $f$ be a ...
1
vote
0answers
23 views

ML Estimation for number of animals in a park. Hypothesis Testing.

A park of area $S=10 000 km^2$ was surveyed for bears, and out of $n$ disjoint regions of equal area $s=1km^2$, there were $n_k$ regions with $k=0,1,....,N$ bears. On each of these regions, the amount ...
0
votes
1answer
71 views

Bounds on least squares and weighted least squares estimator

I was wondering if I can get some help in getting bounds on the parameters estimated by least squares (LS) and weighted least squares (WLS) methods. Suppose our observation model is: $\mathbf{y} = ...
1
vote
1answer
80 views

Using Neyman pearson lemma when ratio comes out to be zero.

Consider a Bernoulli random variable: $$X_i= \begin{cases} 1, & \text{with probability }p \\ 0, & \text{with probability }1-p \end{cases}$$ You observe the outcomes of two Bernoulli trials ...