1
vote
0answers
17 views

Alternatives to Fisher information

The Fisher information matrix is defined as the following: $$\mathcal{I}(\theta)=E[(\frac{\partial \log f(x;\theta)}{\partial \theta})^2]=-E[\frac{\partial^2 \log f(x;\theta)}{\partial \theta ...
1
vote
1answer
117 views

questions on bias of estimator

a) Let $X_{1},...,X_{n}$ be i.i.d Uniform$[0,\theta]$. Show that estimator $\beta(X)=max(X_{1},..,X_{n})$ is a biased estimator for $\theta$.Find an unbiased estimator, based on $\theta$. My attempt: ...
0
votes
0answers
15 views

Predicting future outcomes from samples when sample sizes and distributions are not controlled and vary

I'm very stale in my statistics and am trying to calculate my confidence around a certain mean outcome from an investment firm (I'll use lay person terms so that I am not assuming any particular type ...
1
vote
1answer
75 views

statistics inequality

Let $\theta$ be a discrete pararmeter and $\gamma_{n}$ be an estimator. Prove that for any $c>0$ we have that $$\text{E}[(\gamma_n-\theta)^2] \ge\Pr[|\gamma_n-\theta|>c]\cdot c^2$$
0
votes
1answer
42 views

log likelihood function of a cauchy distribution

What is the log likelihood function of a random varible x with cauchy distribution (0,1)? I've tried to work it out. I think its $\log (1+x)^2$. Is that correct?
0
votes
0answers
15 views

Looking for hints on how to prove the convergence of this iterative estimator! [duplicate]

Let $X_n$ be a Poisson process with mean $\lambda^*$. The following sequence estimates the parameter of the Poisson process: $ X_{n+1} = \hat{\lambda}_{n+1} + ...
1
vote
2answers
60 views

Maximum likelihood estimator?

I am looking at some questions from Mods 2010 and I can't figure this one out. I think my problem is technical... We have a sample (L1,R1), ...,(Ln,Rn) with Lj and Rj normally distributed independent ...
0
votes
1answer
23 views

Given 50 IID normals, find the exact SE for the estimate of $\sigma^2$?

Given 50 I.I.D Normal distributions random variables $X_i$, the Maximum Likelihood estimator for $\sigma^2$ is $\hat{\sigma}^2$, as proven in my lecture notes. Find the EXACT SE. My Attempt: ...
1
vote
0answers
18 views

Convergence rate of an estimator

Say we are interested in estimating some unknown real scalar parameter $\alpha$ using data. Suppose the estimator $\widehat \alpha_N$ of $\alpha$ using the data is consistent. I want to know what it ...
1
vote
1answer
42 views

Finding the MLE of pareto dist., and trouble interpreting $\prod$ notation properly.

I am generally having trouble understanding how to use product notation when calculating Maximum Likelihood Estimators. The example bellow is from a random sample $X_1,...,X_n$. Find the MLE of ...
0
votes
1answer
25 views

Mean Square Estimate problem

I have to find $\textbf{s}_{MS}$ given $\textbf{r} = h\textbf{s}+\textbf{n}$ where $h$ is a Bernoulli random variable with $Pr(h=1)=Pr(h=0) = 1/2$ and $\textbf{s}$ and $\textbf{n}$ are independent ...
0
votes
0answers
9 views

Estimating variance from the sequence

Suppose that we have $\{X_n\}\to X\sim N(0,\Omega)$ where $X_n$ can be obtained from observations. My problem is to estimate $\Omega$ consistently. If $var X_n$ converges to a "finite" matrix, then ...
1
vote
1answer
75 views

Find the Method Moment Estimator of parameter $\theta$

Find the MME of parameter $\theta$ in the distribution with the density $f(x,\theta)=(\theta +1)x^{-(\theta+2)}$, for $x>1$ and $\theta >0$. So far I think I have a basic understanding of the ...
1
vote
1answer
43 views

Is Sample Covariance Tied to a Specific Distribution

In many sources on data analysis, the author(s) talk about calculating covariance of the data, and the formula is given as such $$ \Sigma = cov(X) = E[(X-E[X])(X-E[X])^T]$$ This formulation is given ...
3
votes
1answer
57 views

How is the “cooking” done in surveys

In my country there's an official center undertaking surveys of voting intention every 4 months. However, they provide only "direct" voting intention, and the statistics obtained are usually pretty ...
3
votes
2answers
56 views

Calculating likelihood of event based on retrospective analysis

I have a simple dataset consisting of the dates/times at which certain medications were taken by a patient. By looking retrospectively I'd like to make a best guess estimate as to which medication ...
0
votes
0answers
21 views

Prove that an estimator is UMVU under the usual “assumptions of regularity”

I'm asked to prove that some estimator is UMVU under the usual assumptions of regularity. I'm not sure what is meant with 'usual assumptions of regularity'. Do they mean with this that I can just ...
0
votes
1answer
77 views

Maximum likelihood estimator of $P(X < y)$ for fixed $y$

I'm having a problem understanding the following question. Given the following density function $f_X(x; \theta) = (\theta +1)x^\theta$ on $0<x<1$, find the maximum likelihood estimator for ...
0
votes
0answers
21 views

Estimate the population mean when random selection is not possible

Consider I have a jar with marbles labeled 0 and 1 in it. They're not well mixed so the possibility of obtaining a sample sized 1000 with mean 0.6 and another sample sized 1000 with mean 0.4 is not so ...
0
votes
1answer
36 views

proving unbiasedness of an estimator

Question given independent random variable $X_{1},X_{2},...,X_{n}$ from a geometric distribution with parameter $p$. we have an estimator for $p$, mainly $T=Y/n$ where Y is number of $i$ that ...
0
votes
1answer
43 views

calculating mean squared error for the Mean.

Exam Question There are two independent random variables $X_{1}$ $\&$ $X_{2}$ that are having normal distribution with mean $\mu$. Further Var$(X_{1})=1$ and Var$(X_{2})=2$.an unbiased estimator ...
0
votes
0answers
40 views

Variance of a difference in estimated proportions with trivariate discrete distributions

Let a multivariate distribution be given by $P(Y,S_1,S_2)$, where all three variables are discrete, $Y$ is multivalued, $S_1=(0,1)$ and $S_2=(0,1)$, respectively, and all may be dependent. Define the ...
2
votes
0answers
38 views

Unbiased estimator with conditional expectation.

Suppose that $X$ has a binomial distribution with parameter $N=1$ and $p=1/2$. Y, which is independent of $X$, has a normal distribution with mean $\mu$ and variance 1. Consider the estimator $\mu$ of ...
0
votes
1answer
30 views

Variance of unbiased estimator

Let $Y_1,Y_2,...,Y_N$ be a random sample from a distribution with probability density function $f_Y(y,\theta) = 2y/\theta^2$ if $0<y<\theta$ and $0$ otherwise. (a) Show that $W = 3\bar{Y}/2$ ...
1
vote
2answers
85 views

Finding the MLE of a function when L'($\theta$) doesn't depend on $\theta$

Here's the problem: Find the MLE of of $\theta$ when $f(x\mid\theta)=(1+x\theta)/2$ for $-1<x<1$, $=0$ otherwise. $0<\theta<1$ Find the maximum likelihood of $\theta$ and find its ...
1
vote
1answer
41 views

Statistics: why is this probablility smaller?

a shipment of goods contains two containers, one container has 300 units and the other container has 700 units. A supervisor checks 30 units in the first container and he finds $X_1$ broken units and ...
2
votes
2answers
47 views

Why we always put log() before the joint pdf when we use MLE(Maximum likelihood Estimation)?

Maybe this question is simple, but I really need some help. When we use the Maximum Likelihood Estimation(MLE) to estimate the parameters, why we always put the log() before the joint density? To use ...
0
votes
1answer
43 views

Suitability of skew normal for rating task and calculation

in an experiment, I ask participants to rate qualities on a continuous scale. I expect the results to be normal distributed and I am confident that assuming a normal works fairly well for most values. ...
-1
votes
1answer
161 views

CRLB to find UMVUE

In what situation can one obtain an estimator that reaches the Cramer-Rao lower bound, i.e. an efficient estimator? I know the rules for finding UMVUEs, and I know they are efficient if they reach ...
0
votes
1answer
132 views

Does an UMVUE's variance match the Cramer-Rao lower bound?

I know it can match the CRLB, but does it have to, if it is an UMVUE?
1
vote
2answers
133 views

Does convergence in probability not imply convergence in distribution for Least Squares estimators?

I have a question relating to convergence in probability and distribution for least squares estimators. Frequently, I see in textbooks that $\hat{\beta} \rightarrow^p b$. Where $b$ is the population ...
1
vote
1answer
162 views

Find maximum likelihood estimator, trick?

Let $Y_1, Y_2, \ldots, Y_n$ iid random variables with density $f(y)=\theta\cdot y^{\theta-1}$, $0<y<1$, $\theta >0$. I need to show that the maximum likelihood estimator of $\theta$ is ...
0
votes
0answers
25 views

ML Estimation, graphical method?

I have a problem in statistics that I don't quite know how to do: "Generate a 1000-element data sample from the Rayleigh distribution. Graph the log-likelihood function $\ln L(\alpha; \vec{x})$ as a ...
1
vote
0answers
23 views

ML Estimation for number of animals in a park. Hypothesis Testing.

A park of area $S=10 000 km^2$ was surveyed for bears, and out of $n$ disjoint regions of equal area $s=1km^2$, there were $n_k$ regions with $k=0,1,....,N$ bears. On each of these regions, the amount ...
1
vote
1answer
71 views

Using Neyman pearson lemma when ratio comes out to be zero.

Consider a Bernoulli random variable: $$X_i= \begin{cases} 1, & \text{with probability }p \\ 0, & \text{with probability }1-p \end{cases}$$ You observe the outcomes of two Bernoulli trials ...
0
votes
1answer
45 views

Estimator in a one dimensional normal setting with only one observation

Let $X$ have the distribution $N(\theta,1)$ where $\theta \ge 0$. Is $T=X$ an admissible estimator with respect to the mean squared error? Construct an estimator that respects the assumption $\theta ...
3
votes
1answer
2k views

Maximum Likelihood Estimator for Multinomial.

Suppose that 50 measuring scales made by a machine are selected at random from the production of the machine and their lengths and widths are measured. It was found that 45 had both measurements ...
0
votes
0answers
42 views

How to calculate $Q_n$estimator

How to calculate $Q_n$estimator from this formula for sample $1\;3\; 6\;2\;7\;5$: $$Q_n=d\left\{|x_i-x_j|;\;\;i<j\right\}_{(k)}$$ where d is constant factor and $k={h \choose 2}\thickapprox ...
0
votes
0answers
35 views

How to obtain confidence intervals for a sample of independent normally distributed random variables

Let $X_1$, ..., $X_n$ be independent observations with distribution $N(\mu,\sigma^2)$ where $\mu \in \mathbb{R}$ and $\sigma^2>0$ are both unkown. What is an easy way to derive confidence ...
1
vote
2answers
74 views

What exactly is simple consistency?

Now yes, I know the definition: A sequence of estimators $\{T_n\}$of $\tau(\theta)$ are consistent if for every $\epsilon > 0$ $$ \lim_{n\to\infty}P[|T_n-\tau(\theta)|\leq\epsilon]=1 \\\text{ ...
3
votes
1answer
349 views

CRLB/UMVUE estimation of $\theta$

We have a random sample $X_1,X_2,\ldots,X_n$ from a probabilitiy distribution with density $f(x;\theta) = \theta x^{-\theta-1} $ given that $x > 1$, and $0$ else. where $\theta >1 $ is an ...
0
votes
1answer
12 views

Estimating $\hat{p}$

let $X\sim Bin(n,p)$ and $\hat{p} =\frac{X}{n}$ a) Find a constant c such that $E[c\hat{p}(1-\hat{p})]=p(1-p)$ My work: $$ \begin{align} cE[\hat{p}(1-\hat{p})] ...
1
vote
1answer
65 views

find $\theta_{MLE}$ for a function

For $$ f(x;\theta)=(\theta+1)x^{-\theta-2} $$ find the maxmimum likelihood estimators (MLEs) for $\theta$ based on a random sample of size $n$. My work so far: $$ \begin{align} \prod_{i=1}^n ...
0
votes
1answer
42 views

Random Poisson Sample, Probability in terms of $\vartheta$

If $X_1, X_2, \ldots, X_n$ are a random sample from a Poisson Distribution with mean $\vartheta>0$, how do you find $P(X\le 1)$ in terms of $\vartheta$? I've proven that summing $X_i$ for ...
1
vote
1answer
33 views

Improving related estimates

There are three underlying quantities $x$, $y$, and $a$, where $x$ and $y$ are vectors, and $a$ is a scalar. They are related by $x = ay$. We get noisy observations, $x_0,y_0$. We want to find $a$, ...
1
vote
1answer
262 views

Maximum likelihood estimators, hypergeometric and binomial

I'm trying to solve a two part problem. The set up is as follows: consider a bag with $\theta$ red marbles and $7-\theta$ blue marbles, with $\theta$ being unknown. Let $x$ denote the number of red ...
1
vote
1answer
442 views

Rao-Blackwell unbiased estimator geometric distribution

I'm looking at review questions and having trouble with this one! Let $X_1,\ldots,X_n$ be i.i.d. geometric R.V.s with the pmf: $(1-p)^{x-1}p$, for $x=1,2,\ldots$ and $0<p<1$. I need to use ...
1
vote
0answers
64 views

Hypothesis testing problem of Normal distributions.

Consider the following Hypothesis Testing problem: Hypothesis $H_0$ : $X \sim N(\mu_0, \sigma_0)$. Mean $\mu_0$ is known but only upper and lower bounds on $\sigma_0$ are known. Hypothesis $H_1$ : ...
0
votes
1answer
971 views

Calculating the variance of an estimator (unclear on one step)

How can you go from $4V(\bar X)$ to $\displaystyle \frac{4}{n}V(X_1)$? I understand the rest of the steps...
2
votes
0answers
103 views

Cramer-Rao bound for $\chi^2$ distribution parameter estimates.

I've stuck in unpleasant problem with noncentral $\chi^2$ distribution. I work with random variables, distributed as $\chi^2_{\nu}(\lambda)$, where $\nu$ is the degree of freedom and $\lambda$ is ...