Mathematical statistics is the study of statistics from a mathematical standpoint, using probability theory as well as other branches of mathematics such as linear algebra and analysis.

learn more… | top users | synonyms

8
votes
2answers
7k views

Statistics: Could someone show why this exponential pdf integrates into this particular cdf

I have the following exponential distribution: $$f(\lambda, x) = \begin{cases} \lambda e^{-\lambda x} &\text{if } x \geq 0 \\ 0 & \text{if } x<0. \end{cases}$$ I need to show that this ...
8
votes
4answers
5k views

How to accurately calculate the error function erf(x) with a computer?

I am looking for an accurate algorithm to calculate the error function I have tried using [this formula] (http://stackoverflow.com/a/457805) (Handbook of Mathematical Functions, formula ...
8
votes
3answers
417 views

Probability of getting a job when applying for 3 places

I have the following problem. You apply for jobs and know that if you send your application then every job appointment procedure has two stages: You can be either invited or not invited ...
8
votes
4answers
323 views

A statistical approach to the prisoners problem

Two days ago, I found this problem on reddit (I didn't have access to reddit when I did the math, so I did it with 24 instead of 23, and I decided the warden picked someone every day, not "whenever he ...
8
votes
3answers
251 views

distribution of $X^2 + Y^2$

Suppose $X$ and $Y$ are independent uniform distributions between $(0,1)$. What is the distribution of $X^2 + Y^2$? I derived that the pdf of $X^2$ is $\frac{1}{2\sqrt{x}}$ for $0\leq x \leq 1$. How ...
8
votes
1answer
9k views

Maximum Likelihood Estimator of parameters of multinomial distribution

Suppose that 50 measuring scales made by a machine are selected at random from the production of the machine and their lengths and widths are measured. It was found that 45 had both measurements ...
8
votes
1answer
7k views

Proof that the hypergeometric distribution with large $N$ approaches the binomial distribution.

I have this problem on a textbook that doesn't have a solution. It is: Let $$f(x)=\frac{\binom{r}{x} \binom{N-r}{n-x}}{\binom{N}{n}}\;,$$ and keep $p=\dfrac{r}{N}$ fixed. Prove that $$\lim_{N ...
8
votes
2answers
67 views

Why does probability need the Axiom of pairwise disjoint events? [duplicate]

I'm a beginning student of Probability and Statistics and I've been reading the book Elementary Probability for Applications by Rick Durret. In this book, he outlines the 4 Axioms of Probability. ...
8
votes
3answers
385 views

Stein's lemma condition

(Apologies if I break some conventions, this is my first time posting!) I am working on proving Stein's characterization of the Normal distribution: for Z $\sim N(0,1)$ and some differentiable ...
8
votes
6answers
9k views

Great Book on Probability and Statistics (for Computer Scientists)

I'm a Computer Science sophomore and we're studying Probability and Statistics (fundamentals and all). The teacher recommends a book which I don't like since it does not even try and explain ...
8
votes
4answers
5k views

A good book on Statistical Inference?

Anyone can suggest me one or more good books on Statistical Inference (estimators, UMVU estimators, hypotesis testing, UMP test, interval estimators, ANOVA one-way and two-way...) based on rigorous ...
8
votes
1answer
593 views

Monotonic behavior of a function

I have the following problem related to a statistics question: Prove that the function defined for $x\ge 1, y\ge 1$, ...
8
votes
1answer
161 views

relative size of most factors of semiprimes, close?

when chatting about RSA a cohort just asserted something like "most prime factors of semiprimes are roughly the same size" measured in bits. ie "bits" is the number of digits in the base2 ...
8
votes
1answer
337 views

What is the intuition behind the generalized confidence interval?

What is the intuition behind the generalized confidence interval? My best description on GCI that it is the way to derive a formula to calcuate the area of the center region in a asymetry distribution ...
8
votes
1answer
129 views

Heavy-tailed distributions

I have encountered the following two definitions of heavy-tailedness (right tail) for a $[0,\infty)$-valued random variable $X$ satisfying $\mathbb{E}[X]<\infty$: (i) ...
8
votes
2answers
167 views

Lies, damned lies, and statistics

A story currently in the U.S. news is that an organization has (in)conveniently had several specific hard disk drives fail within the same short period of time. The question is what is the likelihood ...
8
votes
3answers
460 views

Roll a fair die until a 6 appears for the third time. What is the chance that all six values have occurred?

The question in the title is a homework question that I have been stumped on for some time. My approach thus far was to treat it as an occupancy problem. From class we derived the following formula ...
8
votes
1answer
121 views

Expected value and variance of ratio of two sums of two sets of random variables

Let $X_1,X_2,\ldots,X_n$ be iid $\operatorname{Gamma}(\alpha,\beta)$ random variables. Suppose that, conditionally on $X_1,X_2,\ldots,X_n$, the random variables $Y_1,Y_2,\ldots,Y_n$ are independent ...
8
votes
1answer
157 views

If half the population were murderers, and they could only kill once, how many would survive?

So here's the rules: Half the population are murderers Each murderer can only kill once We assume the nobody will fight back, and only murderers can murder Murderers can kill other murderers Only ...
8
votes
2answers
495 views

Can the maximum likelihood estimator be unbiased and fail to achieve Cramer-Rao lower bound?

If some maximum likelihood estimator (MLE) turns out to be unbiased (which does not necessarily holds), then does it achieve the Cramer-Rao lower bound (CRLB) even in finite sample? (It does when the ...
7
votes
5answers
3k views

Arithmetic mean. Why does it work?

I've been using the formula for the arithmetic mean all my life, but I'm not sure why it works. My current intuition is this one: The arithmetic mean is a number that when multiplied by the number ...
7
votes
4answers
5k views

Unbiased Estimator for a Uniform Variable Support

Let $ x_i $ be iid observations in a sample from a uniform distribution over $ \left[ 0, \theta \right] $. Now I need to estimate $ \theta $ based on $N$ observations and I want the estimator to be ...
7
votes
2answers
234 views

Finding $E\left[\frac{\sum_{i=1}^n X_i^2}{(\sum_{i=1}^n X_i)^2}\right]$ of a sample of gamma random variables

Suppose $X_1,\ldots,X_n$ is a random sample from the $\Gamma(k,\lambda)$ distribution where $\lambda$ is unknown and $k$ is a positive integer and known. How can I find $$E\left[\frac{\sum_{i=1}^n ...
7
votes
3answers
1k views

What is the expected number of dice one needs to roll to get any monotonically increasing series of 1 to 6?

Similar to: "What is the expected number of dice one needs to roll to get 1,2,3,4,5,6 in order?" but we allow repeats so 1,1,2,2,3,4,4,4,4,5,5,6 would count. My answer (or simulation) is flawed as I ...
7
votes
4answers
10k views

How many rolls do I need to determine if my dice are fair?

Roughly how many times do I need to roll a 6-sided die to feel confident that it's giving "fair" results? What about a 10-sided or 20-sided die? Note that I will be actually manually rolling physical ...
7
votes
5answers
2k views

Coin tosses until I'm out of money

The question I think is a simple one, but I've been unable to answer or find an answer for it yet: There's a simple game: if you flip heads you win a dollar (from the house), but if you flip tails ...
7
votes
4answers
6k views

What does it mean to integrate with respect to the distribution function?

If $f(x)$ is a density function and $F(x)$ is a distribution function of a random variable $X$ then I understand that the expectation of x is often written as: $$E(X) = \int x f(x) dx$$ where the ...
7
votes
1answer
17k views

What is the expectation of $ X^2$ where $ X$ is distributed normally?

I know that if $X$ were distributed as a standard normal, then $X^2$ would be distributed as chi-squared, and hence have expectation $1$, but I'm not sure about for a general normal. Thanks
7
votes
1answer
228 views

Is pi lying on the ground, and on TV?

Consider the leaves from a bunch of trees in a terraced plaza in the Autumn. It may well happen that the tiles of the terrace are squares whose length easily exceeds the length of the stem of the ...
7
votes
5answers
13k views

Given a data set, how do you do a sinusoidal regression on paper? What are the equations, algorithms?

Most regressions are easy. Trivial once you know how to do it. Most of them involve substitutions which transform the data into a linear regression. But I have yet to figure out how to do a ...
7
votes
4answers
9k views

Relationship between Binomial and Bernoulli?

How should I understand the difference or relationship between Binomial and Bernoulli distribution?
7
votes
2answers
2k views

What can I do with measure theory that I can't with probability and statistics

I've studied mathematics and statistics at undergraduate level and am pretty happy with the main concepts. However, I've come across measure theory several times, and I know it is a basis for ...
7
votes
3answers
4k views

Calculate variance from a stream of sample values

I'd like to calculate a standard deviation for a very large (but known) number of sample values, with the highest accuracy possible. The number of samples is larger than can be efficiently stored in ...
7
votes
1answer
3k views

What's the difference between Rao-Blackwell Theorem and Lehmann-Scheffé Theorem?

I know that the Rao-Blackwell theorem states that an unbiased estimator given a sufficient statistic will yield the best unbiased estimator. Is the only difference between Lehmann-Scheffé and ...
7
votes
2answers
6k views

Proof of the independence of the sample mean and sample variance

I've been trying to establish that the sample mean and the sample variance are independent. One motivation is to try and write the sample variance, $S^{2}$ as a function of $\left\{ ...
7
votes
3answers
6k views

How to calculate relative error when true value is zero?

How do I calculate relative error when the true value is zero? Say I have $x_{true} = 0$ and $x_{test}$. If I define relative error as: $\text{relative error} = \frac{x_{true}-x_{test}}{x_{true}}$ ...
7
votes
2answers
303 views

How does accuracy of a survey depend on sample size and population size?

Which survey is more accurate? Assume the samples are taken perfectly randomly. A sample of 100 people out of a population of 1000 (sample is 10% of population) A sample of 1000 people out of a ...
7
votes
2answers
191 views

What is the T-distribution, and what is it used for?

(I'll post my own answer to this, but don't hesitate to post your own!) Student's t-distribution, or T-distribution, was introduced in 1908 by William Sealey Gossett writing under the pseudonym ...
7
votes
3answers
247 views

Birthday “Paradox” - another, different, version!

Background Many people are familiar with the so-called Birthday "Paradox" that, in a room of $23$ people, there is a better than $50/50$ chance that two of them will share the same birthday. In its ...
7
votes
2answers
7k views

Probability density function of a product of uniform random variables

Let $z = xy$ be a product of two uniform random variables, with $x$ having the range $[a, b)$ and $y$ the range $[c, d)$. What is the probability density function of $z$, and how is it calculated?
7
votes
1answer
2k views

Expected number of card draws to get all 4 suits

You have a standard 52 card deck, with 13 cards of each of the 4 suits (Hearts, Diamonds, Spades, Clubs). What is the expected number of cards you have to draw from the deck until you have all 4 suits ...
7
votes
3answers
9k views

Is There Something Called a Weighted Median?

I was given some data that represents the number of lines in a document as well as the line count per hour (which is the lines in the document divided by the number of hours that the document was ...
7
votes
1answer
5k views

Probability of duplicate GUID

A GUID (globally unique identifier) is a 32 character hexadecimal string: http://en.wikipedia.org/wiki/Globally_Unique_Identifier If you randomly generate 2, the chance of them being the same is ...
7
votes
2answers
122 views

Determine the Size of a Test Bank

Suppose you have two people take an exam which is composed of 30 questions which are randomly chosen from a test bank of n questions. Person A and Person B both take different randomly generated ...
7
votes
2answers
7k views

What does the Big intersection or union sign of a set means?

Normally what I know is that you can make a union or an intersection between 2 sets. In this expression Its a big union of a set. I'm asking about the meaning of such expression, What does it mean. ...
7
votes
4answers
3k views

Consecutive Coin Toss with static tosses

I'm writing an algorithm for a coin toss problem. But I have a problem understanding the calculation given. Here is the question: You have an unbiased coin which you want to keep tossing until ...
7
votes
1answer
145 views

Monte-Carlo for the Wasserstein metric

Let $(X,d)$ be some metric space and assume that $d\leq 1$. Further, let $\mu, $ $\nu$ be two Borel probability measures on $X$ and let $$ \Gamma(\mu,\nu) = \{\gamma - \text{measure on }X\times ...
7
votes
1answer
55 views

Never seen this notation before: $\int (y-f(x))^2 Pr(dx,dy) $

I have never seen an integral like this: $$\int (y-f(x))^2 Pr(dx,dy) $$ What is that? More precisely what is $Pr(dx,dy)$? And how is that integral defined? I found it in Elements of Statistical ...
7
votes
1answer
163 views

How Do I Find My Car

I have been discussing this problem with a coworker for a few days now and neither of us have made any headway on it. I would appreciate any help with a possible solution or maybe a suggestion of a ...
7
votes
1answer
113 views

What is the limit behavior of this random sum?

Let $(X_n\mid n\in\mathbb{N})$ be an i.i.d. sequence of random variables taking values in $\mathbb{R}$. What can be said about the limit behavior of \begin{equation} S_n:=\sum_{i=1}^n\frac{X_i}{i} ...