Mathematical statistics is the study of statistics from a mathematical standpoint, using probability theory as well as other branches of mathematics such as linear algebra and analysis.

learn more… | top users | synonyms

6
votes
4answers
4k views

A good book on Statistical Inference?

Anyone can suggest me one or more good books on Statistical Inference (estimators, UMVU estimators, hypotesis testing, UMP test, interval estimators, ANOVA one-way and two-way...) based on rigorous ...
6
votes
2answers
412 views

expectation of $ \left(\sum_{i=1}^n {x_i} \right)^2 $

If $x_i$ is exponentially distributed $(i=1,...,n)$ with parameter $\lambda$ and $x_i$'s are mutually independent, what is the expectation of $\left(\sum_{i=1}^n {x_i} \right)^2$ in terms of $n$ and ...
6
votes
3answers
136 views

Chances of someone being of a certain gender at websites

I have 2 of websites and I know the chances of a visitor being a female or male. Let's say I have 2 website where the chance of a new visitor being a female is 80%. If the visitor comes on website 1 ...
6
votes
2answers
465 views

How to find a confidence interval for a Maximum Likelihood Estimate

My cousin is at elementary school and every week is given a book by his teacher. He then reads it and returns it in time to get another one the next week. After a while we started noticing that he was ...
6
votes
1answer
132 views

relative size of most factors of semiprimes, close?

when chatting about RSA a cohort just asserted something like "most prime factors of semiprimes are roughly the same size" measured in bits. ie "bits" is the number of digits in the base2 ...
6
votes
1answer
126 views

Monte-Carlo for the Wasserstein metric

Let $(X,d)$ be some metric space and assume that $d\leq 1$. Further, let $\mu, $ $\nu$ be two Borel probability measures on $X$ and let $$ \Gamma(\mu,\nu) = \{\gamma - \text{measure on }X\times ...
6
votes
2answers
270 views

What is a confidence interval?

What are the nature and purpose of confidence intervals?
6
votes
1answer
596 views

Expected Value of a Continuous Random Variable

I've been reviewing my probability and statistics book and just got up to continuous distributions. The book defines the expected value of a continuous random variable as: $E[H(X)] = ...
6
votes
1answer
6k views

sum of two independent exponential distribution

let $Y_1\sim \exp(\lambda_1)$ and $Y_2\sim \exp(\lambda_2)$ and $V=Y_1+Y_2$ Show that the pdf of $p_V(x)$ of $V$ has the following form ...
6
votes
2answers
1k views

The probability of a drunk person/random walk

A drunk person wonders aimlessly along a path by going forward 1 step and backward 1 step with equal probabilities of $\frac12$. a) After 10 steps, what is the probability that he has moved 2 steps ...
6
votes
2answers
2k views

Probability/Combinatorics Problem. A closet containing n pairs of shoes.

A closet contains n pairs of shoes. If 2r shoes are chosen at random, (where 2r < n), what is the probability that the chosen shoes will contain no matching pair? I have tried thinking about this ...
6
votes
2answers
500 views

Bag with infinite number of colored balls

Consider a situation with a bag with infinity number of balls. Each ball is of some color. Number of colors is finite but it is not known. Balls are drawn from the bag one by one and checked for the ...
6
votes
1answer
571 views

Statistics: Why do we divide by $\sqrt{n}$ for sample standard deviation

Can someone tell me if my explanations/understanding is on the right track? Suppose we have a set of variances, each of them identical, where $V_{1}(x) + V_{2}(x) + ...+ V_{j}(x) = \sigma^2$. If we ...
6
votes
1answer
146 views

Calculating the average of a possibly infinite “compound” length

Sorry for the ambiguous title, I couldn't find a good word to describe my problem. So here is my problem: You are a player, and you have a dice. You have N number of throws available then you can't ...
6
votes
1answer
1k views

Maximum Likelihood Estimation of an Ornstein-Uhlenbeck process

I am wondering whether an analytical expression of the maximum likelihood estimates of an Ornstein-Uhlenbeck process is available. The setup is the following: Consider a one-dimensional ...
6
votes
1answer
258 views

Can I build a program that will tell me if a real world data set looks linear, logarithmic, exponential etc?

I have a bunch of real world data sets and from manually plotting some of the data in graphs, I've discovered some data sets look pretty much logarithmic and some look linear, or exponential (and some ...
6
votes
2answers
108 views

Spinners from yesteryear: A challenging probability problem

While browsing the Internet I found an old horse racing game where the results were determined by a spinner. The names of 6 different horses were listed an equal number of times on the spinner. Each ...
6
votes
1answer
118 views

Asymptotic efficiency of maximum likelihood estimate

Let us consider a simple statistical model $\{f_{\theta}\}$ where $\theta\in U$, an open subset of $\mathbb{R}$. Let $X_1,\dots,X_n$ be sample drawn from $f_{\theta}$. I know, under some regularity ...
6
votes
2answers
475 views

Intuition of Gamma Family

The function $$f(t) = \frac{t^{\alpha-1}e^{-t}}{\Gamma(\alpha)}, \ \ 0 < t < \infty$$ is a pdf. But Why is the gamma family defined as $$f(x| \alpha, \beta) = \frac{1}{\Gamma(\alpha) ...
6
votes
2answers
198 views

Might such a sequence of mathematical expectations be able to predict uncertain events?

This question might sound a little bit mystical, but it seemed like an interesting idea, so I am posting it here. Despite the title, I know it probably does not work miracles, but here goes anyway. I ...
6
votes
1answer
622 views

Symmetric matrix decomposition with orthonormal basis of non-eigenvectors

I like to understand the following transformation found in documentation for deriving Kalman filter. Abstract Formulation: Given 2 symmetric matrices $A$ ,$B$ $\in$ $\mathbb R^{3,3}$ with $A \ne B$ ...
6
votes
1answer
140 views

How to determine if binomial events are independent?

I have a sequence of binary experiment results, something like 1100010000100... My first hypothesis is that these events are independent, but I'd like to know if there is some way to test this. I ...
6
votes
2answers
458 views

Taylor series approximation statistics

how can I show the following: Let $X_1, X_2,\ldots, X_n$ be i.i.d Poisson with mean $\lambda$. Let $Y = |\{i: X_i =0\}|$. Then $\lambda$ is estimated by $$\eta = - \log(Y/n)$$ Use Taylor series to ...
6
votes
3answers
3k views

Correlation Coefficient and Determination Coefficient

I'm really new to linear regression and am trying to teach myself. In my textbook there's a problem that asks why $R^{2}$ in the regression of $Y$ on $X =$ the sample correlation between X and Y the ...
6
votes
1answer
182 views

How to find a flat using game theory?

I had the idea that maybe probability/game theory knowledge helps finding a flat more systematically. I assume that I have some online offers with number parameters: prize size (square meters) ...
6
votes
1answer
120 views

Help with convergence in distribution

$Y$ is a random variable with $$M(t) = \frac{1}{(2-\exp(t))^s}.$$ Does $$\frac{Y-E(Y)}{\sqrt{\operatorname{Var}(Y)}}$$ converge in distribution as $s$ tends to infinity? I let $Z = ...
6
votes
1answer
197 views

If W is a random matrix with variance $\mathbb{E}[W W^{T}]$, what's $\mathbb{E}[W^{T} P W]$?

I know quite a few identities about quadratic forms of random vectors, but I'm having difficulty coaxing something out of this quadratic form of random matrices. Suppose I know $\mathbb{E}[W W^{T}]$ ...
6
votes
1answer
746 views

“How many public playgrounds exist in the United States?” How to answer using statistics and probability

I have a goal of estimating how many public playgrounds exist in the United States. There are many methods of gathering real data about playgrounds, but, unfortunately, there is no single authority ...
6
votes
0answers
48 views

What is a formal definition of 'randomness'?

What is a rigorous mathematical/logical definition of 'randomness'? Under what conditions can we truthfully apply the predicate 'is random'?
6
votes
1answer
61 views

An estimator for the c.d.f $F$ at a point $x_0$?

Problem: Let $X_1,X_2,\ldots,X_n$ be independent identically distributed random variables (i.i.d's) with common CDF $F$. Fix $x_0\in\mathbb{R}$ and find an unbiased estimator for $F(x_0)$. Show ...
6
votes
0answers
75 views

Donsker's Theorem for triangular arrays

Assume we have a sequence of smooth i.i.d. random variables $(X_i)_{i=1}^{\infty}$. Given $\alpha>0$, does some sort of Donsker's Theorem hold for $\left(\frac{X_i}{n^{\alpha}}\right)_{i=1}^n$? ...
6
votes
0answers
93 views

Finding an upper bound for $\frac{d}{d\theta}\beta^*(\theta)|_{\theta=\theta_0}$

Suppose that a random variable X has a distribution depending on a parameter $\theta$, $\theta \in \Theta$, and consider a test of hypothesis $H_0: \theta = \theta_0$ versus the alternative $H_1: ...
6
votes
1answer
85 views

About cutting Almonds

Every year, during Christmas baking, I chop almonds, which causes me to puzzle over the same question, and I don't quite know how to approach it. I start out with N almonds. Let's assume they are all ...
6
votes
3answers
421 views

Variance of a max function

Say $x_1$ and $x_2$ are normal random variables with known means and standard deviations and $C$ is a constant. If $y = \max(x_1,x_2,C)$, what is $\mathrm{Var}(y)$? Well, I forgot to tell that $x_1$ ...
6
votes
0answers
574 views

Idempotence and the Rao–Blackwell theorem

Original question: In the Wikipedia article on the Rao–Blackwell theorem, we read: In case the sufficient statistic is also a complete statistic, i.e., one which "admits no unbiased ...
5
votes
5answers
2k views

Can an event be possible if its probability is zero?

Consider a computer program that generates any random number between 0 and 1(exclusive). There are infinitely many numbers between 0 and 1. So the probability that the random-number generate the same ...
5
votes
4answers
6k views

What is the purpose of the standard deviation?

I don't have any knowledge of statistics beyond high school common sense. Why is the standard deviation usually seen in combinatorics textbooks, and why is the standard deviation defined ...
5
votes
3answers
4k views

Average wait time arriving at subway randomly

If the subway comes every 10 minutes on average, what is the expected wait time if I arrive at the station randomly? Can someone help me mathematically understand this problem?
5
votes
2answers
11k views

Sum of two independent geometric random variables

Let X and Y be independent random variables, $ P(X = k) = P(Y = k) = p(1 - p)^{k-1} $ How do you show that the pmf of $ Z = X + Y $, is negative binomial, and how do you find $ P(X = Y) $?
5
votes
2answers
187 views

How to prove a random variable taking values in $[0,1]$ range has variance no larger than $\frac{1}{4}$?

How can I prove that a random variable taking values in $[0,1]$ has variance no larger than $\frac{1}{4}$? If it matters, discrete and continuous proofs are both welcome.
5
votes
2answers
336 views

Name this paradox about most common first digits in numbers

I remember hearing about a paradox (not a real paradox, more of a surprising oddity) about frequency of the first digit in a random number being most likely 1, second most likely 2, etc. This was for ...
5
votes
3answers
886 views

Can you demystify the Power Law?

How would you describe the Power Law in simple words? The Wikipedia entry is too long and verbose. I would like to understand the concept of the power law and how and why it shows up everywhere. For ...
5
votes
4answers
2k views

Geometric mean never exceeds arithmetic mean

This was a mathematical induction question proposed in a textbook, and I've exhausted multiple approaches (proving RHS - LHS > 0, splitting the fraction, fractional exponents, etc.) The geometric ...
5
votes
2answers
4k views

Definition of mean as an integral over the CDF

I'm reading a statistics textbook which defines the mean of a random variable $X$ with CDF $F$ as a statistical function $t(\centerdot)$, where $$ t(F) = \int x \, dF(x).$$ Can someone explain this ...
5
votes
4answers
4k views

What does it mean to integrate with respect to the distribution function?

If $f(x)$ is a density function and $F(x)$ is a distribution function of a random variable $X$ then I understand that the expectation of x is often written as: $$E(X) = \int x f(x) dx$$ where the ...
5
votes
2answers
199 views

Is there a name for the matrix $X(X^tX)^{-1}X^{t}$?

In my work, I have repeatedly stumbled across the matrix (with a generic matrix $X$ of dimensions $m\times n$ with $m>n$ given) $\Lambda=X(X^tX)^{-1}X^{t}$. It can be characterized by the ...
5
votes
5answers
8k views

Given a data set, how do you do a sinusoidal regression on paper? What are the equations, algorithms?

Most regressions are easy. Trivial once you know how to do it. Most of them involve substitutions which transform the data into a linear regression. But I have yet to figure out how to do a ...
5
votes
2answers
171 views

Improper integral of $\frac{x}{e^{x}+1}$

The improper integral of $\frac{x}{e^x-1}$ (along the positive real line) comes up in a lot of places, you can even invoke the Riemann-zeta and Gamma functions to solve it nicely. However, I just ...
5
votes
5answers
664 views

What does it mean to do MLE with a continuous variable

I am struggling with the semantics of continuous random variables. For example, we do maximum likelihood estimation, in which we try to find the parameter $\theta$ which, for some observed data $D$, ...
5
votes
1answer
236 views

$X$, $Y$ gaussian variables, $\mathbb{E}[X^2Y]$ and $\mathbb{E}[X^3Y]$ as a function of its means, variances and covariance?

Let be X and Y two not independent Gaussian random variables of means $\mu_X$, $\mu_Y$ and variances $\sigma_X$, $\sigma_Y$, respectively. Let also be $\Sigma$ the covariance between X and Y. I'd ...