Mathematical statistics is the study of statistics from a mathematical standpoint, using probability theory as well as other branches of mathematics such as linear algebra and analysis.

learn more… | top users | synonyms

12
votes
3answers
622 views

Fast computation/estimation of the nuclear norm of a matrix

The nuclear norm of a matrix is defined as the sum of its singular values, as given by the Singular Value Decomposition of the matrix itself. It is of central importance in Signal Processing and ...
12
votes
1answer
5k views

Is there a proof of Benford's Law? [duplicate]

As stated by Wikipedia (here): Benford's law, also called the first-digit law, states that in lists of numbers from many (but not all) real-life sources of data, the leading digit is distributed ...
12
votes
0answers
260 views

Kähler Geodesics

Consider the Kähler manifold in coordinates $(a,b)$ given by the complex Riemannian metric $$\begin{pmatrix} ...
11
votes
2answers
14k views

Examples of Simpson's Paradox

I'm looking for fresh examples of Simpson's paradox for use in my statistics courses. The examples I've been using are fine, but I'd like to have some new ones, and I'm hoping folks here might know a ...
11
votes
4answers
13k views

Is there a simple test for uniform distributions?

I have a function that (more or less) is supposed to select a small number $m$ of random numbers from the range $[1,n]$ (for some $n \gg m$) and I need to test that it work. Is there an easy to ...
11
votes
1answer
4k views

sum of squares of dependent gaussian random variables

Ok, so the Chi-Squared distribution with n degrees of freedom is the sum of the squares of n independent gaussian random variables. The trouble is, my gaussian random variables are not independent. ...
11
votes
2answers
772 views

You see a route 14 bus on the moon. What is the most likely number of bus routes on the moon?

This question was asked on a forum and while many argued that the answer is 14 (since the probability of you seeing bus 14 is maximum in this case), I argued against it that they were working ...
11
votes
3answers
3k views

Why are additional constraint and penalty term equivalent in ridge regression?

Tikhonov regularization (or ridge regression) adds a constraint that $\|\beta\|^2$, the $L^2$-norm of the parameter vector, is not greater than a given value (say $c$). Equivalently, it may solve ...
11
votes
3answers
447 views

How many books are in a library?

My cousin is at elementary school and every week is given a book by his teacher. He then reads it and returns it in time to get another one the next week. After a while we started noticing that he ...
11
votes
1answer
93 views

Is this condition enough to determine a random variable?

For two positive random variables X,Y, we know that if $E[X^r]=E[Y^r]$ for any r holds, the cdf of X and Y can still be different. Then it occur to me what about changing $r\in \mathbb{N}$ to $r\in ...
11
votes
1answer
383 views

Hyper Birthday Paradox?

There are $N$ buckets. Each second we add one new ball to a random bucket - so at $t=k$, there are a total of $k$ balls collectively in the buckets. At $t=1$, we expect that at least one bucket ...
10
votes
4answers
13k views

How many times to roll a die before getting two consecutive sixes?

Basically, on average, how many times do you have to roll a fair six-sided die before getting two consecutive sixes?
10
votes
1answer
414 views

M.SE reputation distribution

What distribution does the reputation points per user follow on math.SE (or on entire stackexchange)? Is there a mathematical explanation/model of it?
10
votes
5answers
17k views

What is degree of freedom in statistics?

In statistics, degree of freedom is widely used in regression analysis, ANOVA and so on. But, what is degree of freedom ? Wikipedia said that The number of degrees of freedom is the number ...
10
votes
5answers
10k views

What is the use of moments in statistics

Can any one give an "simple" explaination about what is the use of moments in statistics.Why we need moments? what we can learn from it? if possible please use less equations. Advance thanks for your ...
10
votes
3answers
1k views

With $n$ balls and $n$ bins, what is the probability that exactly $k$ bins have exactly $1$ ball?

I've got a balls and bins problem. Suppose I throw $n$ balls uniformly at random into $n$ bins. What is the probability that exactly $k$ bins end up with exactly $1$ ball? I know this seems a ...
10
votes
5answers
6k views

Zero correlation does not imply independence

I just learned that when discussing variables, although independence implies zero correlation zero correlation does not necessarily imply independence. While I understand the concept, I can't imagine ...
10
votes
2answers
413 views

Does variance do any good to gambling game makers?

People always like to evaluate the variance, but is there any way for variance to be interesting to the gambling game makers? In another word, what is a pratical gambling game that involving some ...
10
votes
2answers
267 views

What is the difference between probability and statistics?

Is it that probability is top-down (going from pure distributions to predictions about events) and statistics is bottom-up (going from specific events to predicting pure distributions?) I'm pretty ...
10
votes
3answers
1k views

The pseudoness of pseudorandom number generators

Is there a reasonable statistic test one can do to standard random number generators (say, one of those that come built in in Python libs) which shows they are not really random? (By reasonable I ...
10
votes
1answer
4k views

easy to implement method to fit a power function (regression)

I want to fit to a dataset a power function ($y=Ax^B$). What is the best and easiest method to do this. I need the $A$ and $B$ parameters too. I'm using in general financial data in my project, which ...
10
votes
1answer
12k views

comparing distribution of two data sets

I need to compare the distribution (unknown) of a set of data to the distribution of another one (unknown). In particular, I want to check for equality of the two distributions. What are some ...
10
votes
2answers
969 views

What is the relationship between the Boltzmann distribution and information theory?

I'm reading a paper on Boltzmann machines (a type of neural network in Machine Learning), and it mentions that "The Boltzmann distribution has some beautiful mathematical properties and it is ...
10
votes
1answer
484 views

Math Intuition and Natural Motivation Behind t-Student Distribution

I am trying to understand with basic mathematical background how the $t$-Student distribution is a "natural" $pdf$ to define. So I hope that this not too-general a question, but given that the ...
10
votes
3answers
283 views

How can you trust a bettor?

Two friends of mine are trying to convince me that they are good at betting. They infact have a certain profit after n bets. They provided me with all the bets they have made so far: odds, outcome and ...
10
votes
3answers
218 views

Finding a more direct way to reach $\mathbb{E} \left( \sum (X_i - \mu)^2 \right) - \mathbb{E} \left( \sum (X_i - \overline{X})^2 \right) = \sigma^2$

Let $X_i$ be independent random variables, $\forall\,i \in \mathbf{n} \equiv \{0,\dots,n-1\}$, with identical expectation value $\mathbb{E}(X_i)=\mu$, and identical variance ...
10
votes
1answer
125 views

Random point distribtion

How to generate numerically a set of random points $(x_1,y_1), (x_2,y_2),\cdots, (x_N,y_N)$ such that the pair-wise distances $d = \sqrt { (x_i-x_j)^2 + (y_i-y_j)^2}$, for all $ 0<i\le N, ...
10
votes
0answers
116 views

Looking for references related to an inequality in order statistics

I was reading the paper "on the minimum of several random variables". In example 10 item (ii) it states: Let $1\leq k\leq n$. Let $g_i,i\leq n$, be independent $N(0,1)$ Gaussian random variables. ...
9
votes
4answers
176 views

Is there a closed form expression for $\int_{- \infty}^\infty \int_{-\infty}^y \frac{1}{2 \pi} e^{-(1/2) ( x^2+y^2 )} \mathrm{d}x\,\mathrm{d}y$?

I have been trying to evaluate the integral: $$\int_{- \infty}^\infty \int_{-\infty}^y \frac{1}{2 \pi} e^{-(1/2) ( x^2+y^2 )}\mathrm {d}x\,\mathrm{d}y$$ I know of course that the integral equals ...
9
votes
2answers
1k views

Why is polynomial regression considered a kind of linear regression?

Why is polynomial regression considered a kind of linear regression? This is what I mean by polynomial regression. For example, the hypothesis function is $$h(x; t_0, t_1, t_2) = t_0 + t_1 x + t_2 ...
9
votes
4answers
2k views

What is the deepest / most interesting known connection between Trigonometry and Statistics?

I'm teaching both at the same time to different classes in high school, so I just wondered about this. Added by OP on 16.May.2011 (Beijing time) I mean Statistics only, without Probability. In ...
9
votes
3answers
13k views

What does expected value of sum of two discrete random variables mean?

I am confused with summing two random variables. Suppose $X$ and $Y$ are two random variables denoting how much is gained from each two games. If two games are played together, we can gain $E[X] + ...
9
votes
2answers
28k views

maximum estimator method more known as MLE of a uniform distribution

Let $ X_1, ... X_n $ a sample of independent random variables with uniform distribution $(0,$$ \theta $$ ) $ Find a $ $$ \widehat\theta $$ $ estimator for theta using the maximun estimator ...
9
votes
3answers
1k views

Intuition about the Central Limit Theorem

I'm studying statistics, and would like to better understand the Central Limit Theorem. The proof I found on Wikipedia requires some previous knowledge I do not currently possess. Is there a quick ...
9
votes
3answers
462 views

Expected Value of R squared

Let $n$ be a fixed positive integer. Generate $n$ numbers $x_1, x_2, ..., x_n$ from the set $[0,1]$, with the probability distribution being the uniform one and the $x_i$ all being independent of each ...
9
votes
3answers
27k views

Why the sum of residuals equals 0 when we do a sample regression by OLS?

That's my question, I have looking round online and people post a formula by they don't explain the formula. Could anyone please give me a hand with that ? cheers
9
votes
4answers
7k views

How would I figure out how many anagrams of mississippi don't contain the word psi?

I'm really confused how I'd calculate this. I know it's the number of permutations of mississippi minus the number of permutations that contain psi, but considering there's repetitions of those ...
9
votes
6answers
954 views

Recommend a statistics fundamentals book

To give you some background, I have a grasp on the basics of statistics and probability theory and even remember touching Bayes theorem at the university data mining course. But being a few years away ...
9
votes
3answers
1k views

In what sense is the Jeffreys prior invariant?

I've been trying to understand the motivation for the use of the Jeffreys prior in Bayesian statistics. Most texts I've read online make some comment to the effect that the Jeffreys prior is ...
9
votes
1answer
121 views

On the central limit theorem

The Central Limit Theorem states for a sequence of i.i.d. random variables $\{X_i\}$, $$\frac{\overline{X} - \mu}{\sigma/\sqrt{n}} \to N(0,1)$$ in distribution as $n \to \infty$. I saw in some ...
9
votes
1answer
172 views

Is Entropy = Information circular or trivial?

I have seen several "maximum entropy distributions" used in the mathematical and statistical literature, often with the justification that they are "minimally informed" beyond the assumptions and data ...
9
votes
2answers
406 views

How far do I need to drive to find an empty parking spot?

A parking lot consists of an infinite row of bays. Cars arrive at random intervals (mean interval $T_a$) and stay for a random time (mean stay $T_s$). The time intervals are memoryless (negative ...
9
votes
1answer
317 views

On the probability of obtaining 27 sets in the card game Set

For people not familiar with the card game Set, see its entry on Wikipedia and/or one of the related questions here on Math SE. It might be faster to just play the game a couple of times though, see ...
9
votes
0answers
869 views

Maximum likelihood and sufficient statistics

$$f_T(t;B,C) = \frac{\exp(-t/C)-\exp(-t/B)}{C-B}$$ where our mean is $C+B$ and $t>0$. so far i have found my log likelihood functions and differentiated them as follows: $$dl/dB = ...
8
votes
2answers
10k views

Proof of $\frac{(n-1)S^2}{\sigma^2} \backsim \chi^2_{n-1}$

It's a standard result that given $X_1,\cdots ,X_n $ random sample from $N(\mu,\sigma^2)$, the random variable $$\frac{(n-1)S^2}{\sigma^2}$$ has a chi-square distribution with $(n-1)$ degrees of ...
8
votes
4answers
2k views

I roll 6-sided dice until the sum exceeds 50. What is the expected value of the final roll?

I roll 6-sided dice until the sum exceeds 50. What is the expected value of the final roll? I am not sure how to set this one up. This one is not homework, by the way, but a question I am making up ...
8
votes
4answers
426 views

Probability with unknown variables

An urn contains $10$ red marbles and $10$ black marbles while a second urn contains $25$ red marbles and an unknown number of black marbles. A random marble will be selected from each urn and the ...
8
votes
5answers
2k views

Geometric mean never exceeds arithmetic mean

This was a mathematical induction question proposed in a textbook, and I've exhausted multiple approaches (proving RHS - LHS > 0, splitting the fraction, fractional exponents, etc.) The geometric ...
8
votes
3answers
7k views

Expected value of the product of functions of two independent random variables

If $X$ and $Y$ are independent random variables, are the statements below true $$E(e^{X+Y} ) = E(e^X)\times E(e^Y)$$ and $$E(X^2\times Y^2) = E(X^2)\times E(Y^2)$$ , where $E(\cdot)$ = expectation? ...
8
votes
3answers
275 views

How come in statistics there is very little justification for the formulas used and proofs are almost nonexistent [closed]

I don't understand why people accept certain formulas in statistics without a mathematical proof style argument. You see this a lot in statistics textbooks and unfortunately this spills over with the ...