Mathematical statistics is the study of statistics from a mathematical standpoint, using probability theory as well as other branches of mathematics such as linear algebra and analysis.

learn more… | top users | synonyms

6
votes
3answers
5k views

Improbable vs Impossible?

I was wondering how mathematics in general or any of its sub fields e.g.statistics, probability, define the words Improbable and Impossible. I get their English meaning, that something is impossible ...
6
votes
3answers
7k views

What is the difference between all types of Markov Chains?

I have been looking for some good material covering Markov Chains but everything seems so difficult to me... After reading about the subject, I figured out that there is basically three kinds of ...
6
votes
3answers
5k views

Deriving Mean and Variance of Laplace Distribution

It has been a long time since I have used calculus, and I am trying to understand how the mean and variance of the Laplace distribution with pdf $$f(x|\mu,\sigma) = \dfrac{1}{2 ...
6
votes
5answers
1k views

What does multiplication mean in probability theory?

For independent events, the probability of both occurring is the product of the probabilities of the individual events: $Pr(A\; \text{and}\;B) = Pr(A \cap B)= Pr(A)\times Pr(B)$. Example: if you ...
6
votes
4answers
306 views

Why do statisticians like “$n-1$” instead of “$n$”?

Does anyone have an intuitive explanation (no formulas, just words! :D) about the "$n-1$" instead of "$n$" in the unbiased variance estimator $$S_n^2 = \dfrac{\sum\limits_{i = 1}^n ...
6
votes
4answers
173 views

What is a good measure of “controversy”, given a support score and opposition score?

Suppose I have a topic or discussion, and a number of "support" and "opposition" points on each side (You can also think of them as "upvotes" and "downvotes") and I want to calculate a score of how ...
6
votes
2answers
10k views

Defective items probability question.

Hi I'm working with probability as part of an engineering course, and I'm struggling with the following tutorial question: Components of a certain type are shipped to a supplier in batches of ten. ...
6
votes
3answers
3k views

Example of Sufficient and Insufficient Statistic?

I am having trouble understanding the concept of a sufficient statistic. I have read What is a sufficient statistic? and Sufficient Statistic (Wikipedia) Can someone please give an example of: a ...
6
votes
2answers
1k views

What is the expected number of dice one needs to roll to get 1,2,3,4,5,6 in order?

If I have a fair die and throw it until I get a run of 1,2,3,4,5,6 in order, how many times on average must I throw the dice?
6
votes
2answers
8k views

Deriving Moment Generating Function of the Negative Binomial?

My textbook did the derivation for the binomial distribution, but omitted the derivations for the Negative Binomial Distribution. I know it is supposed to be similar to the Geometric, but it is not ...
6
votes
3answers
6k views

Kendall tau calculation

Can someone explain how the Kendall tau works? I can't seem to find a good explaination/tutorial/example. I've been running corr(x,y,'kendall') from Matlab's ...
6
votes
2answers
1k views

Why is the Kullback-Leibler divergence not symmetric?

As known the Kullback-Leibler Divergence: $$\operatorname{KL}=\sum_{i=1}^n \ln(\frac{P(i)}{Q(i)})P(i)$$ is not symmetric. I would like to know how this can be seen from the formula. I am aware that ...
6
votes
1answer
3k views

pairwise correlation of three random variables

Assume three random variables have all equal pairwise correlation. What are the possible values of this correlation? Can all of these values be achieved? The solution says $\rho \in [-\frac 12,1]$, ...
6
votes
1answer
468 views

Is there a way to check the correctness of your answer to a probability question?

In CS, there's a systematic way to check if your code is buggy or not as you write code. Is there a way to check the correctness of your answer to a probability question without using a textbook? For ...
6
votes
1answer
445 views

Function of a random variable: expectation

Let $\{X_i\}_{i=1}^n$ be a sequence of i.i.d. random variables (i.e. a random sample) with pdf: $$f_X(x) = e^{-(x-\theta)} \, e^{-e^{-(x-\theta)}} · \mathbf{1}_{x\in \mathbf{R}}$$ The goal is ...
6
votes
1answer
745 views

Expected Value of a Continuous Random Variable

I've been reviewing my probability and statistics book and just got up to continuous distributions. The book defines the expected value of a continuous random variable as: $E[H(X)] = ...
6
votes
2answers
421 views

expectation of $ \left(\sum_{i=1}^n {x_i} \right)^2 $

If $x_i$ is exponentially distributed $(i=1,...,n)$ with parameter $\lambda$ and $x_i$'s are mutually independent, what is the expectation of $\left(\sum_{i=1}^n {x_i} \right)^2$ in terms of $n$ and ...
6
votes
2answers
120 views

Which theory is used to calculate the position and energy of a point source?

Consider an empty room with one point source that emits a stationary signal (constant sound, radioactive radiation, ...). The energy nor the position of the point source is known. We send someone in ...
6
votes
3answers
144 views

Chances of someone being of a certain gender at websites

I have 2 of websites and I know the chances of a visitor being a female or male. Let's say I have 2 website where the chance of a new visitor being a female is 80%. If the visitor comes on website 1 ...
6
votes
2answers
652 views

How to find a confidence interval for a Maximum Likelihood Estimate

My cousin is at elementary school and every week is given a book by his teacher. He then reads it and returns it in time to get another one the next week. After a while we started noticing that he was ...
6
votes
1answer
11k views

The expectation of absolute value of random variables

I need some help with the following problem: Let $X_1,...,X_n$ be a random sample from Normal$(0,1)$ population. Define $$Y_1=| {{1 \over n}\sum_{i=1}^{n}X_i}|, \ Y_2={1 \over ...
6
votes
2answers
1k views

The Birthday Problem

I've been reading about the birthday problem which, as I'm sure many of you will know, is a statistical problem which aims at finding out the how many people you would need in a random group to be ...
6
votes
1answer
343 views

Is there an introduction to probability and statistics that balances frequentist and bayesian views?

Perhaps, roughly, I might be described as advanced undergraduate regarding mathematics. However, I have not learned statistics and have only learned elementary probability. Does there exist a book or ...
6
votes
2answers
280 views

What is a confidence interval?

What are the nature and purpose of confidence intervals?
6
votes
2answers
3k views

Probability/Combinatorics Problem. A closet containing n pairs of shoes.

A closet contains n pairs of shoes. If 2r shoes are chosen at random, (where 2r < n), what is the probability that the chosen shoes will contain no matching pair? I have tried thinking about this ...
6
votes
1answer
3k views

Given every horse's chance of winning a race, what is the probability that a specific horse will finish in nth place?

I have been interested in calculating a specific horse's chance of finishing in nth place given every horse's chance of winning in a particular race. i.e. Given the following: ...
6
votes
1answer
11k views

sum of two independent exponential distribution

let $Y_1\sim \exp(\lambda_1)$ and $Y_2\sim \exp(\lambda_2)$ and $V=Y_1+Y_2$ Show that the pdf of $p_V(x)$ of $V$ has the following form ...
6
votes
2answers
3k views

The probability of a drunk person/random walk

A drunk person wonders aimlessly along a path by going forward 1 step and backward 1 step with equal probabilities of $\frac12$. a) After 10 steps, what is the probability that he has moved 2 steps ...
6
votes
1answer
2k views

Distribution of Sum of Discrete Uniform Random Variables

I just had a quick question that I hope someone can answer. Does anyone know what the distribution of the sum of discrete uniform random variables is? Is it a normal distribution? Thanks!
6
votes
2answers
601 views

Bag with infinite number of colored balls

Consider a situation with a bag with infinity number of balls. Each ball is of some color. Number of colors is finite but it is not known. Balls are drawn from the bag one by one and checked for the ...
6
votes
1answer
100 views

$L^1$ convergence of PDFs vs $L^2$ convergence of CDFs

Let $f_n$ denote a sequence of PDFs, and $F_n$ denote the corresponding sequence of CDFs. Given $L^1$ convergence of the PDFs to some PDF $f$, $$\int_\mathbb{R} |f_n(x) -f(x)| dx \rightarrow 0$$ ...
6
votes
3answers
167 views

Are there order statistics for a Gaussian variable raised to a power?

Let $X$ be a random variable with a standard normal distribution. Let $Y = |X|^{2p}$. I am trying to find the distribution for $Y_{(n)}$, i.e., the largest value of $Y$ out of $n$ samples. I have ...
6
votes
3answers
77 views

distribution of one random over the sum of random variables

Suppose that $X_1,\ldots,X_n$ are independent random variables with $X_i\sim Gamma(\alpha_i,\beta)$. Define $U_i=\frac{X_i}{X_1+\cdots+X_n}$ for $i=1,2,\ldots,n$. Show that $U_i\sim ...
6
votes
2answers
34k views

Linear regression: degrees of freedom of SST, SSR, and RSS

I'm trying to understand the concept of degrees of freedom in the specific case of the three quantities involved in a linear regression solution, i.e. $SST=SSR+SSE, $ i.e. Total sum of squares = ...
6
votes
1answer
258 views

Calculating the average of a possibly infinite “compound” length

Sorry for the ambiguous title, I couldn't find a good word to describe my problem. So here is my problem: You are a player, and you have a dice. You have N number of throws available then you can't ...
6
votes
3answers
5k views

Correlation Coefficient and Determination Coefficient

I'm really new to linear regression and am trying to teach myself. In my textbook there's a problem that asks why $R^{2}$ in the regression of $Y$ on $X =$ the sample correlation between X and Y the ...
6
votes
1answer
274 views

Can I build a program that will tell me if a real world data set looks linear, logarithmic, exponential etc?

I have a bunch of real world data sets and from manually plotting some of the data in graphs, I've discovered some data sets look pretty much logarithmic and some look linear, or exponential (and some ...
6
votes
1answer
64 views

Check answer, How to find Cov(x,y) and Var(2x-y)?

I have the following tableau ...
6
votes
1answer
62 views

Limit of median of uniform distribution

Let $X_1,X_2,\ldots$ be a random sample from the uniform distribution on the interval $(0,1)$. Assuming that $n$ is odd, find the pdf of the sample median (say $M_n$). Does the pdf of the r.v. ...
6
votes
2answers
124 views

Spinners from yesteryear: A challenging probability problem

While browsing the Internet I found an old horse racing game where the results were determined by a spinner. The names of 6 different horses were listed an equal number of times on the spinner. Each ...
6
votes
1answer
138 views

Asymptotic efficiency of maximum likelihood estimate

Let us consider a simple statistical model $\{f_{\theta}\}$ where $\theta\in U$, an open subset of $\mathbb{R}$. Let $X_1,\dots,X_n$ be sample drawn from $f_{\theta}$. I know, under some regularity ...
6
votes
2answers
697 views

Intuition of Gamma Family

The function $$f(t) = \frac{t^{\alpha-1}e^{-t}}{\Gamma(\alpha)}, \ \ 0 < t < \infty$$ is a pdf. But Why is the gamma family defined as $$f(x| \alpha, \beta) = \frac{1}{\Gamma(\alpha) ...
6
votes
2answers
203 views

Might such a sequence of mathematical expectations be able to predict uncertain events?

This question might sound a little bit mystical, but it seemed like an interesting idea, so I am posting it here. Despite the title, I know it probably does not work miracles, but here goes anyway. I ...
6
votes
1answer
684 views

Symmetric matrix decomposition with orthonormal basis of non-eigenvectors

I like to understand the following transformation found in documentation for deriving Kalman filter. Abstract Formulation: Given 2 symmetric matrices $A$ ,$B$ $\in$ $\mathbb R^{3,3}$ with $A \ne B$ ...
6
votes
1answer
292 views

What is a formal definition of 'randomness'?

What is a rigorous mathematical/logical definition of 'randomness'? Under what conditions can we truthfully apply the predicate 'is random'?
6
votes
1answer
150 views

How to determine if binomial events are independent?

I have a sequence of binary experiment results, something like 1100010000100... My first hypothesis is that these events are independent, but I'd like to know if there is some way to test this. I ...
6
votes
2answers
646 views

Taylor series approximation statistics

how can I show the following: Let $X_1, X_2,\ldots, X_n$ be i.i.d Poisson with mean $\lambda$. Let $Y = |\{i: X_i =0\}|$. Then $\lambda$ is estimated by $$\eta = - \log(Y/n)$$ Use Taylor series to ...
6
votes
1answer
558 views

Why does maximum likelihood estimation work the way that it does?

I'm wrapping my head around MLE right now and there's something about it that bothers me, irrationally I'm sure. I believe I understand the procedure: essentially we hold our observations fixed and ...
6
votes
1answer
183 views

How to find a flat using game theory?

I had the idea that maybe probability/game theory knowledge helps finding a flat more systematically. I assume that I have some online offers with number parameters: prize size (square meters) ...
6
votes
1answer
124 views

Help with convergence in distribution

$Y$ is a random variable with $$M(t) = \frac{1}{(2-\exp(t))^s}.$$ Does $$\frac{Y-E(Y)}{\sqrt{\operatorname{Var}(Y)}}$$ converge in distribution as $s$ tends to infinity? I let $Z = ...