Mathematical statistics is the study of statistics from a mathematical standpoint, using probability theory as well as other branches of mathematics such as linear algebra and analysis.

learn more… | top users | synonyms

11
votes
3answers
381 views

How many books are in a library?

My cousin is at elementary school and every week is given a book by his teacher. He then reads it and returns it in time to get another one the next week. After a while we started noticing that he ...
11
votes
1answer
2k views

Under what circumstance will a covariance matrix be positive semi-definite rather than positive definite?

I have a covariance matrix: $\operatorname{cov}(\mathbf{X}, \mathbf{X}) = \operatorname{E}[(\mathbf{X} - \operatorname{E}[\mathbf{X}])(\mathbf{X} - \operatorname{E}[\mathbf{X}])^T]$ According to ...
11
votes
1answer
5k views

Is there a proof of Benford's Law? [duplicate]

As stated by Wikipedia (here): Benford's law, also called the first-digit law, states that in lists of numbers from many (but not all) real-life sources of data, the leading digit is distributed ...
11
votes
0answers
105 views

Number of moves necessary to solve rubic's cube by pure chance

Suppose, random moves are made to solve rubic's cube. A move consists of a $90$-degree-rotation of some side. The starting position is also random. What is $E(X)$, where $X$ is the number of moves ...
11
votes
0answers
242 views

Kähler Geodesics

Consider the Kähler manifold in coordinates $(a,b)$ given by the complex Riemannian metric $$\begin{pmatrix} ...
10
votes
1answer
397 views

M.SE reputation distribution

What distribution does the reputation points per user follow on math.SE (or on entire stackexchange)? Is there a mathematical explanation/model of it?
10
votes
3answers
1k views

With $n$ balls and $n$ bins, what is the probability that exactly $k$ bins have exactly $1$ ball?

I've got a balls and bins problem. Suppose I throw $n$ balls uniformly at random into $n$ bins. What is the probability that exactly $k$ bins end up with exactly $1$ ball? I know this seems a ...
10
votes
2answers
359 views

Does variance do any good to gambling game makers?

People always like to evaluate the variance, but is there any way for variance to be interesting to the gambling game makers? In another word, what is a pratical gambling game that involving some ...
10
votes
3answers
2k views

Why are additional constraint and penalty term equivalent in ridge regression?

Tikhonov regularization (or ridge regression) adds a constraint that $\|\beta\|^2$, the $L^2$-norm of the parameter vector, is not greater than a given value (say $c$). Equivalently, it may solve ...
10
votes
2answers
258 views

What is the difference between probability and statistics?

Is it that probability is top-down (going from pure distributions to predictions about events) and statistics is bottom-up (going from specific events to predicting pure distributions?) I'm pretty ...
10
votes
3answers
1k views

The pseudoness of pseudorandom number generators

Is there a reasonable statistic test one can do to standard random number generators (say, one of those that come built in in Python libs) which shows they are not really random? (By reasonable I ...
10
votes
2answers
38k views

What is the equation used to calculate a linear trendline?

In excel it is done automatically but how to manually calculate a linear trendline over a set of points?
10
votes
2answers
851 views

What is the relationship between the Boltzmann distribution and information theory?

I'm reading a paper on Boltzmann machines (a type of neural network in Machine Learning), and it mentions that "The Boltzmann distribution has some beautiful mathematical properties and it is ...
10
votes
3answers
274 views

How can you trust a bettor?

Two friends of mine are trying to convince me that they are good at betting. They infact have a certain profit after n bets. They provided me with all the bets they have made so far: odds, outcome and ...
10
votes
3answers
208 views

Finding a more direct way to reach $\mathbb{E} \left( \sum (X_i - \mu)^2 \right) - \mathbb{E} \left( \sum (X_i - \overline{X})^2 \right) = \sigma^2$

Let $X_i$ be independent random variables, $\forall\,i \in \mathbf{n} \equiv \{0,\dots,n-1\}$, with identical expectation value $\mathbb{E}(X_i)=\mu$, and identical variance ...
10
votes
1answer
362 views

Hyper Birthday Paradox?

There are $N$ buckets. Each second we add one new ball to a random bucket - so at $t=k$, there are a total of $k$ balls collectively in the buckets. At $t=1$, we expect that at least one bucket ...
9
votes
4answers
166 views

Is there a closed form expression for $\int_{- \infty}^\infty \int_{-\infty}^y \frac{1}{2 \pi} e^{-(1/2) ( x^2+y^2 )} \mathrm{d}x\,\mathrm{d}y$?

I have been trying to evaluate the integral: $$\int_{- \infty}^\infty \int_{-\infty}^y \frac{1}{2 \pi} e^{-(1/2) ( x^2+y^2 )}\mathrm {d}x\,\mathrm{d}y$$ I know of course that the integral equals ...
9
votes
4answers
1k views

What is the deepest / most interesting known connection between Trigonometry and Statistics?

I'm teaching both at the same time to different classes in high school, so I just wondered about this. Added by OP on 16.May.2011 (Beijing time) I mean Statistics only, without Probability. In ...
9
votes
3answers
1k views

Intuition about the Central Limit Theorem

I'm studying statistics, and would like to better understand the Central Limit Theorem. The proof I found on Wikipedia requires some previous knowledge I do not currently possess. Is there a quick ...
9
votes
3answers
326 views

Expected Value of R squared

Let $n$ be a fixed positive integer. Generate $n$ numbers $x_1, x_2, ..., x_n$ from the set $[0,1]$, with the probability distribution being the uniform one and the $x_i$ all being independent of each ...
9
votes
1answer
3k views

easy to implement method to fit a power function (regression)

I want to fit to a dataset a power function ($y=Ax^B$). What is the best and easiest method to do this. I need the $A$ and $B$ parameters too. I'm using in general financial data in my project, which ...
9
votes
4answers
6k views

How would I figure out how many anagrams of mississippi don't contain the word psi?

I'm really confused how I'd calculate this. I know it's the number of permutations of mississippi minus the number of permutations that contain psi, but considering there's repetitions of those ...
9
votes
1answer
10k views

comparing distribution of two data sets

I need to compare the distribution (unknown) of a set of data to the distribution of another one (unknown). In particular, I want to check for equality of the two distributions. What are some ...
9
votes
2answers
576 views

Applications of information geometry to the natural sciences

I am contemplating undergraduate thesis topics, and am searching for a topic that combines my favorite areas of analysis, differential geometry, graph theory, and probability, and that also has ...
9
votes
4answers
868 views

Recommend a statistics fundamentals book

To give you some background, I have a grasp on the basics of statistics and probability theory and even remember touching Bayes theorem at the university data mining course. But being a few years away ...
9
votes
2answers
1k views

In what sense is the Jeffreys prior invariant?

I've been trying to understand the motivation for the use of the Jeffreys prior in Bayesian statistics. Most texts I've read online make some comment to the effect that the Jeffreys prior is ...
9
votes
1answer
147 views

Is Entropy = Information circular or trivial?

I have seen several "maximum entropy distributions" used in the mathematical and statistical literature, often with the justification that they are "minimally informed" beyond the assumptions and data ...
9
votes
2answers
374 views

How far do I need to drive to find an empty parking spot?

A parking lot consists of an infinite row of bays. Cars arrive at random intervals (mean interval $T_a$) and stay for a random time (mean stay $T_s$). The time intervals are memoryless (negative ...
9
votes
1answer
235 views

On the probability of obtaining 27 sets in the card game Set

For people not familiar with the card game Set, see its entry on Wikipedia and/or one of the related questions here on Math SE. It might be faster to just play the game a couple of times though, see ...
9
votes
0answers
95 views

Looking for references related to an inequality in order statistics

I was reading the paper "on the minimum of several random variables". In example 10 item (ii) it states: Let $1\leq k\leq n$. Let $g_i,i\leq n$, be independent $N(0,1)$ Gaussian random variables. ...
9
votes
0answers
816 views

Maximum likelihood and sufficient statistics

$$f_T(t;B,C) = \frac{\exp(-t/C)-\exp(-t/B)}{C-B}$$ where our mean is $C+B$ and $t>0$. so far i have found my log likelihood functions and differentiated them as follows: $$dl/dB = ...
8
votes
2answers
8k views

Proof of $\frac{(n-1)S^2}{\sigma^2} \backsim \chi^2_{n-1}$

It's a standard result that given $X_1,\cdots ,X_n $ random sample from $N(\mu,\sigma^2)$, the random variable $$\frac{(n-1)S^2}{\sigma^2}$$ has a chi-square distribution with $(n-1)$ degrees of ...
8
votes
2answers
819 views

Why is polynomial regression considered a kind of linear regression?

Why is polynomial regression considered a kind of linear regression? This is what I mean by polynomial regression. For example, the hypothesis function is $$h(x; t_0, t_1, t_2) = t_0 + t_1 x + t_2 ...
8
votes
3answers
246 views

How come in statistics there is very little justification for the formulas used and proofs are almost nonexistent [closed]

I don't understand why people accept certain formulas in statistics without a mathematical proof style argument. You see this a lot in statistics textbooks and unfortunately this spills over with the ...
8
votes
4answers
4k views

How to accurately calculate the error function erf(x) with a computer?

I am looking for an accurate algorithm to calculate the error function I have tried using [this formula] (http://stackoverflow.com/a/457805) (Handbook of Mathematical Functions, formula ...
8
votes
4answers
289 views

A statistical approach to the prisoners problem

Two days ago, I found this problem on reddit (I didn't have access to reddit when I did the math, so I did it with 24 instead of 23, and I decided the warden picked someone every day, not "whenever he ...
8
votes
5answers
10k views

What is degree of freedom in statistics?

In statistics, degree of freedom is widely used in regression analysis, ANOVA and so on. But, what is degree of freedom ? Wikipedia said that The number of degrees of freedom is the number ...
8
votes
3answers
243 views

distribution of $X^2 + Y^2$

Suppose $X$ and $Y$ are independent uniform distributions between $(0,1)$. What is the distribution of $X^2 + Y^2$? I derived that the pdf of $X^2$ is $\frac{1}{2\sqrt{x}}$ for $0\leq x \leq 1$. How ...
8
votes
1answer
5k views

Proof that the hypergeometric distribution with large $N$ approaches the binomial distribution.

I have this problem on a textbook that doesn't have a solution. It is: Let $$f(x)=\frac{\binom{r}{x} \binom{N-r}{n-x}}{\binom{N}{n}}\;,$$ and keep $p=\dfrac{r}{N}$ fixed. Prove that $$\lim_{N ...
8
votes
5answers
7k views

Great Book on Probability and Statistics (for Computer Scientists)

I'm a Computer Science sophomore and we're studying Probability and Statistics (fundamentals and all). The teacher recommends a book which I don't like since it does not even try and explain ...
8
votes
1answer
515 views

Monotonic behavior of a function

I have the following problem related to a statistics question: Prove that the function defined for $x\ge 1, y\ge 1$, ...
8
votes
1answer
258 views

What is the intuition behind the generalized confidence interval?

What is the intuition behind the generalized confidence interval? My best description on GCI that it is the way to derive a formula to calcuate the area of the center region in a asymetry distribution ...
8
votes
1answer
86 views

On the central limit theorem

The Central Limit Theorem states for a sequence of i.i.d. random variables $\{X_i\}$, $$\frac{\overline{X} - \mu}{\sigma/\sqrt{n}} \to N(0,1)$$ in distribution as $n \to \infty$. I saw in some ...
8
votes
1answer
114 views

Heavy-tailed distributions

I have encountered the following two definitions of heavy-tailedness (right tail) for a $[0,\infty)$-valued random variable $X$ satisfying $\mathbb{E}[X]<\infty$: (i) ...
8
votes
2answers
152 views

Lies, damned lies, and statistics

A story currently in the U.S. news is that an organization has (in)conveniently had several specific hard disk drives fail within the same short period of time. The question is what is the likelihood ...
8
votes
3answers
270 views

Roll a fair die until a 6 appears for the third time. What is the chance that all six values have occurred?

The question in the title is a homework question that I have been stumped on for some time. My approach thus far was to treat it as an occupancy problem. From class we derived the following formula ...
8
votes
1answer
148 views

If half the population were murderers, and they could only kill once, how many would survive?

So here's the rules: Half the population are murderers Each murderer can only kill once We assume the nobody will fight back, and only murderers can murder Murderers can kill other murderers Only ...
8
votes
1answer
122 views

Random point distribtion

How to generate numerically a set of random points $(x_1,y_1), (x_2,y_2),\cdots, (x_N,y_N)$ such that the pair-wise distances $d = \sqrt { (x_i-x_j)^2 + (y_i-y_j)^2}$, for all $ 0<i\le N, ...
7
votes
5answers
3k views

Arithmetic mean. Why does it work?

I've been using the formula for the arithmetic mean all my life, but I'm not sure why it works. My current intuition is this one: The arithmetic mean is a number that when multiplied by the number ...
7
votes
4answers
4k views

Unbiased Estimator for a Uniform Variable Support

Let $ x_i $ be iid observations in a sample from a uniform distribution over $ \left[ 0, \theta \right] $. Now I need to estimate $ \theta $ based on $N$ observations and I want the estimator to be ...