Mathematical statistics is the study of statistics from a mathematical standpoint, using probability theory as well as other branches of mathematics such as linear algebra and analysis.

learn more… | top users | synonyms

7
votes
4answers
2k views

I roll 6-sided dice until the sum exceeds 50. What is the expected value of the final roll?

I roll 6-sided dice until the sum exceeds 50. What is the expected value of the final roll? I am not sure how to set this one up. This one is not homework, by the way, but a question I am making up ...
7
votes
1answer
216 views

Is pi lying on the ground, and on TV?

Consider the leaves from a bunch of trees in a terraced plaza in the Autumn. It may well happen that the tiles of the terrace are squares whose length easily exceeds the length of the stem of the ...
7
votes
2answers
11k views

Examples of Simpson's Paradox

I'm looking for fresh examples of Simpson's paradox for use in my statistics courses. The examples I've been using are fine, but I'd like to have some new ones, and I'm hoping folks here might know a ...
7
votes
2answers
4k views

Statistics: Could someone show why this exponential pdf integrates into this particular cdf

I have the following exponential distribution: $$f(\lambda, x) = \begin{cases} \lambda e^{-\lambda x} &\text{if } x \geq 0 \\ 0 & \text{if } x<0. \end{cases}$$ I need to show that this ...
7
votes
2answers
1k views

What can I do with measure theory that I can't with probability and statistics

I've studied mathematics and statistics at undergraduate level and am pretty happy with the main concepts. However, I've come across measure theory several times, and I know it is a basis for ...
7
votes
1answer
3k views

What's the difference between Rao-Blackwell Theorem and Lehmann-Scheffé Theorem?

I know that the Rao-Blackwell theorem states that an unbiased estimator given a sufficient statistic will yield the best unbiased estimator. Is the only difference between Lehmann-Scheffé and ...
7
votes
3answers
16k views

Why the sum of residuals equals 0 when we do a sample regression by OLS?

That's my question, I have looking round online and people post a formula by they don't explain the formula. Could anyone please give me a hand with that ? cheers
7
votes
2answers
185 views

What is the T-distribution, and what is it used for?

(I'll post my own answer to this, but don't hesitate to post your own!) Student's t-distribution, or T-distribution, was introduced in 1908 by William Sealey Gossett writing under the pseudonym ...
7
votes
3answers
234 views

Stein's lemma condition

(Apologies if I break some conventions, this is my first time posting!) I am working on proving Stein's characterization of the Normal distribution: for Z $\sim N(0,1)$ and some differentiable ...
7
votes
1answer
1k views

Expected number of card draws to get all 4 suits

You have a standard 52 card deck, with 13 cards of each of the 4 suits (Hearts, Diamonds, Spades, Clubs). What is the expected number of cards you have to draw from the deck until you have all 4 suits ...
7
votes
4answers
3k views

Consecutive Coin Toss with static tosses

I'm writing an algorithm for a coin toss problem. But I have a problem understanding the calculation given. Here is the question: You have an unbiased coin which you want to keep tossing until ...
7
votes
3answers
7k views

Is There Something Called a Weighted Median?

I was given some data that represents the number of lines in a document as well as the line count per hour (which is the lines in the document divided by the number of hours that the document was ...
7
votes
1answer
159 views

How Do I Find My Car

I have been discussing this problem with a coworker for a few days now and neither of us have made any headway on it. I would appreciate any help with a possible solution or maybe a suggestion of a ...
7
votes
1answer
107 views

What is the limit behavior of this random sum?

Let $(X_n\mid n\in\mathbb{N})$ be an i.i.d. sequence of random variables taking values in $\mathbb{R}$. What can be said about the limit behavior of \begin{equation} S_n:=\sum_{i=1}^n\frac{X_i}{i} ...
7
votes
2answers
290 views

Mean and Median in a Classic River Crossing Problem

Consider the following classic problem: Four people on the west side of a river wish to use their single boat to get to the east side of a river. Each boat ride can hold at most two people, and the ...
7
votes
1answer
9k views

Average percent increase not equal to total percent increase?

I tried searching around for this but it was difficult to boil down the search terms. Plus nothing seemed to be showing up anyway. What's an easy way to show that the average percentage increase of n ...
7
votes
1answer
295 views

Does “50/50 chance of.. . ” convey information?

I distinctly remember the professor in the undergrad introductory systems & control course saying that "when weather forecasters say there's a 50% chance of precipitation, they are conveying no ...
7
votes
1answer
1k views

Maximum Likelihood Estimation of an Ornstein-Uhlenbeck process

I am wondering whether an analytical expression of the maximum likelihood estimates of an Ornstein-Uhlenbeck process is available. The setup is the following: Consider a one-dimensional ...
7
votes
1answer
240 views

Tuning the birthday paradox

I have limited access to a collection $X_1,\ldots,X_m$ of sets of positive integers. Each $X_i$ is "moderately large" (a brief survey has found them to contain about $10^6$ elements in each set), but ...
7
votes
3answers
194 views

Estimate the size of a set from which a sample has been equiprobably drawn?

Here is the problem I'm trying to solve: In order to send spam, a spammer generates fake nicknames, by picking random girl names (and appending a random number to it). I suppose it randomly and ...
7
votes
2answers
568 views

Buckets of Balls, Will one fill if I add another Ball?

I was refereed here by stackoverflow.com. With some searching I found this: another balls and bins question, but its not quite what I am looking for. Rather the inverse. IE the expected number of ...
7
votes
1answer
378 views

License Plate Statistics

California issues license plates in numeric order (if we turn the letters into numbers). I have fun noticing the latest plate I have seen. I am interested in what you can derive from a series of ...
7
votes
1answer
93 views

Spivak alike books for Probability and/or Statistics

I am looking for a Probability/Statistics book with an style alike to that of Spivak's Calculus, that is, a book with the following characteristics: Directed more towards Math majors rather than ...
7
votes
2answers
332 views

Can the maximum likelihood estimator be unbiased and fail to achieve Cramer-Rao lower bound?

If some maximum likelihood estimator (MLE) turns out to be unbiased (which does not necessarily holds), then does it achieve the Cramer-Rao lower bound (CRLB) even in finite sample? (It does when the ...
7
votes
1answer
141 views

Seasonal adjustment and Fourier analysis

I've been reading up on seasonal adjustment (removing "seasonal" periodic components from a time series) recently and although I see a lot of fancy work around ARIMA models and fancy ways to detect ...
7
votes
1answer
142 views

Why can't I use the variance of the sample average in the Central Limit Theorem for the weak-stationary process?

Under mild conditions $\dfrac{\bar{X}-\mu}{\sqrt{\sigma^2/n}}$ approaches the standard normal (where $\sigma^2$ is the process variance, not the marginal variance $\sigma^2_x$). Why is the ...
7
votes
1answer
544 views

Empirical distribution vs. the true one: How fast $KL( \hat{P}_n || Q)$ converges to $KL( P || Q)$?

Let $X_1,X_2,\dots$ be i.i.d. samples drawn from a discrete space $\mathcal{X}$ according to probability distribution $P$, and denote the resulting empirical distribution based on n samples by ...
7
votes
1answer
890 views

Median of the F-distribution

Is the median of the F-distribution with m and n degrees of freedom decreasing in n, for any m? From experiments it looks like it might be, but I have been unable to prove it.
7
votes
3answers
431 views

Variance of a max function

Say $x_1$ and $x_2$ are normal random variables with known means and standard deviations and $C$ is a constant. If $y = \max(x_1,x_2,C)$, what is $\mathrm{Var}(y)$? Well, I forgot to tell that $x_1$ ...
7
votes
3answers
1k views

Sufficient statistics vs. Bayesian sufficient statistics

Given sample data $x_1, \ldots, x_n$ generated from a probability distribution $f(x|\theta)$ ($\theta$ being an unknown parameter), a statistic $T(x_1, \ldots, x_n)$ of the sample data is called ...
7
votes
0answers
62 views

Hottest Days of The Year

Recently, there has been much talk in the media of it being the hottest day of the year so far. It has always seemed to me that there are likely many more of these in the northern hemisphere than the ...
7
votes
0answers
580 views

Idempotence and the Rao–Blackwell theorem

Original question: In the Wikipedia article on the Rao–Blackwell theorem, we read: In case the sufficient statistic is also a complete statistic, i.e., one which "admits no unbiased ...
7
votes
0answers
310 views

Does this calculation have a name, or a generic formulation?

Background I would appreciate help in identifying / explaining this operation: To calculate each of the $n$ values of $f(\Phi)$: sample from the distribution of each of $i$ parameters, $\phi_i$ ...
6
votes
2answers
918 views

Uniform distribution with probability density function. Find the value of $k$.

For a random sample $X_1,X_2,...X_n$ from a uniform $[0,\Theta]$ distribution, with probability density function $$f(x;\Theta) = \left\{ \begin{array} \ \frac{1}{\Theta} & 0\le x \le\Theta,\\ 0 ...
6
votes
5answers
1k views

Coin tosses until I'm out of money

The question I think is a simple one, but I've been unable to answer or find an answer for it yet: There's a simple game: if you flip heads you win a dollar (from the house), but if you flip tails ...
6
votes
3answers
515 views

Why does the keyword “distinct” change the solution to much?

I don't understand why the second answer is different from the first. Aren't they the exact same thing? How many ways can we distribute 10 distinct balls into 5 distinct boxes? $5^{10}$ is correct ...
6
votes
3answers
8k views

How many rolls do I need to determine if my dice are fair?

Roughly how many times do I need to roll a 6-sided die to feel confident that it's giving "fair" results? What about a 10-sided or 20-sided die? Note that I will be actually manually rolling physical ...
6
votes
4answers
581 views

Closed form equation for win percentage of two battling armies

I was pondering a battle mechanic for a board game that is similar to, but simpler than battling armies in Risk. Consider one army of size X and a second army of size Y. The battle occurs by ...
6
votes
6answers
53k views

How to calculate percentile? Is it possible to get 100 percentile?

How do we calculate percentile? I think it should be calculated as: P = Total number of candidates L = Number of candidates whose marks are below yours ...
6
votes
4answers
2k views

How can I calculate “most popular” more accurately?

I'm developing a website at the moment. The website allows users to "rate" a post from 0 to 5. Posts can then be displayed in order of popularity. At the moment, my method of calculation is pretty ...
6
votes
3answers
8k views

What does expected value of sum of two discrete random variables mean?

I am confused with summing two random variables. Suppose $X$ and $Y$ are two random variables denoting how much is gained from each two games. If two games are played together, we can gain $E[X] + ...
6
votes
2answers
5k views

Proof of the independence of the sample mean and sample variance

I've been trying to establish that the sample mean and the sample variance are independent. One motivation is to try and write the sample variance, $S^{2}$ as a function of $\left\{ ...
6
votes
4answers
479 views

What happens if I toss a coin with decreasing probability to get a head?

Yesterday night, while I was trying to sleep, I found myself stuck with a simple statistics problem. Let's imagine we have a "magical coin", which is completely identical to a normal coin but for a ...
6
votes
1answer
673 views

How to quantify the differencen between 2/4 and 20/40?

Assume I have two methods to do prediction. The first method makes 4 predictions and 2 out of 4 are correct. The second method makes 40 predictions and 20 out of 40 are correct. The prediction ...
6
votes
4answers
109 views

If $X \sim N(0,1)$, why is $E(X^2)=1$?

If $X$ is a normally distributed with mean $0$ and variance $1$, expectation of $X$ equals $0$ but why is $E(X^2)=1$?
6
votes
4answers
3k views

What does it mean when a statistician says I’m 90% confident that the mean of the population is between 1 and 9?

Does that mean if I draw samples from the population that 90% of the time I'll get a number between 1 and 9? Added: assume normal distribution for the population.
6
votes
1answer
731 views

What is the expected number of runs of same color in a standard deck of cards?

Standard deck has $52$ cards, $26$ Red and $26$ Black. A run is a maximum contiguous block of cards, which has the same color. Eg. $(R,B,R,B,...,R,B)$ has $52$ runs. $(R,R,R,...,R,B,B,B,...,B)$ has ...
6
votes
3answers
195 views

Birthday “Paradox” - another, different, version!

Background Many people are familiar with the so-called Birthday "Paradox" that, in a room of $23$ people, there is a better than $50/50$ chance that two of them will share the same birthday. In its ...
6
votes
2answers
6k views

Probability density function of a product of uniform random variables

Let $z = xy$ be a product of two uniform random variables, with $x$ having the range $[a, b)$ and $y$ the range $[c, d)$. What is the probability density function of $z$, and how is it calculated?
6
votes
3answers
148 views

How do I calculate the odds of a given set of dice results occurring before another given set?

Dice odds seem simple at first glance, but I've never taken a Calculus based statistics course or game theory, and I think I may need to in order to solve some of the things I'm trying to solve. I can ...