The tag has no wiki summary.

learn more… | top users | synonyms

11
votes
2answers
431 views

What is the distribution of gaps?

Randomly select $n$ numbers from the universe $\{1,2\dots,m\}$ with or without replacement, and sort the numbers in ascending order. We can get a list of number $\{a_1,a_2,\dots,a_n\}$, and then we ...
6
votes
2answers
325 views

Collisions in a sample of uniform distribution

Asked at a Microsoft interview: Assume you have a uniform distribution (can be discrete or continuous) of size X and you randomly select a sample of size Y. 1) What is the probability in terms of X ...
5
votes
4answers
360 views

Sampling from a $2$d normal with a given covariance matrix

How would one sample from the $2$-dimensional normal distribution with mean $0$ and covariance matrix $$\begin{bmatrix} a & b\\b & c \end{bmatrix}$$ given the ability to sample from the ...
5
votes
4answers
170 views

Algorithm for randomly choosing learning cards

I'm programming a learning software. It works with question-/answercards. I´m searching for a algorithm that gives me a higher probability for cards that the user has answered wrong. My actual idea ...
5
votes
1answer
308 views

How is a Halton sequence related to a Latin hypercube?

I currently use a Halton sequence to choose parameter sets for a prognostic model (e.g. using metabolic rate and protein content parameters to predict growth rate). From my understanding, both a ...
4
votes
2answers
97 views

To sample or not to sample?

I have the following issue (I want to predict sports results). Let $X$ be a discrete RV with $m$ possible outcomes, each having probability $p_i$, for $i=1,\ldots,m$. Assume that I have a large iid ...
4
votes
4answers
160 views

Sample: don't confuse measurements with actual values?

In Wikipedia's article on Sample there is the following remark: ''Note that a sample of random variables (i.e. a set of measurable functions) must not be confused with the realizations of these ...
4
votes
1answer
141 views

Uniform sampling of points on a simplex

I have this problem: I'm trying to sample the relation $$ \sum_{i=1}^N x_i = 1 $$ in the domain where $x_i>0\ \forall i$. Right now I'm just extracting $N$ random numbers $u_i$ from a uniform ...
4
votes
1answer
960 views

Probability to choose specific item in a “weighted sampling without replacement” experiment

Given $n$ items with weight $w_n$ each -- what is the probability that item $i$ is chosen in a $k$-out-of-$n$ "weighted random sampling without replacement" experiment? Can a closed-form solution that ...
4
votes
3answers
333 views

What is “sampling from a distribution”?

Exercise 4.11.3 of Grimmett and Stirzaker's Probability and Random Processes reads "Use the rejection method to sample from the gamma density $\Gamma(\lambda,t)$ where $t (\geq 1)$ may not be assumed ...
4
votes
1answer
55 views

Uniform sampling with replacement item frequency

Suppose we are sampling from $N$ distinct items uniformly with replacement $M$ times. What can be said about the distribution of frequencies of items drawn? For example, if I sort all the frequencies ...
4
votes
2answers
207 views

Monte Carlo estimator of the number of 1's in a very long binary sequence

Preface The question below is related to a problem I am working on, which requires counting the number of times a logic-valued function evaluates "TRUE" given an input value. The size of my input set ...
3
votes
1answer
87 views

Maximum likelihood estimation - why is $\mathcal{L}$ not the joint pdf?

Here's an excerpt from my notes: Define the likelihood function: $$\mathcal{L}(\vec{x};\theta)=\prod_{i=1}^{n} f(x_i;\theta)$$ Where $f$ is the pdf of the distribution we're sampling the $x$'s ...
3
votes
1answer
84 views

Samples in the convex body vs. samples on the convex surface

Let $K$ be a bounded convex body in $\mathbb{R}^n$. Suppose we have a sampler $\mathcal{S}_1$ that can generate points uniformly distributed in $\mathrm{int}K$, and another sampler $\mathcal{S}_2$ ...
3
votes
2answers
247 views

Simple random sampling without replacement of huge dataset

For an application I'm working on, I need to sample a small set of values from a very large data set, on the order of few hundred taken from about 60 million(and growing). Usually I use the technique ...
3
votes
1answer
150 views

Finding the population size from the common elements of multiple samples

A coworker of mine has taken a certification exam twice and has seen the same ten questions on both exams. I am curious if it is possible to determine the total number of questions in the question ...
3
votes
2answers
185 views

Determining sparse frequency distribution via discrete Fourier transform

Consider the function $$f(t) = 2 \sin(t)+\sin(2t)+25 \sin(400t)$$ (for example). In this case, how many samples of this function would I have to take, and at what sampling frequency, to determine the ...
3
votes
1answer
89 views

Adaptive sampling for 2D functions with discontinuities

I have a 2D function, $f(x,y)$, which I can compute on a computer. The function is expensive to calculate, so I would like to use an adaptive sampling method to plot it in a region. That is, I want ...
3
votes
1answer
83 views

Is it possible to sample the Dirac delta function?

The Dirac delta function can be a probability measure with the unit/Heaviside step function as its cumulative distribution function. Is it possible to sample such a distribution? If a random variable ...
3
votes
2answers
60 views

What does it mean to sample, in measure theoretic terms?

Suppose I have some random variable $X$ defined on some probability space $(\Omega, \mathcal{F}, \mathbb{P})$. What does it mean, in measure theoretic terms, to draw a sample from $X$? When $\Omega$ ...
3
votes
0answers
163 views

Relationship between DFT and FFT/DTFT

Question 1: Assume we already know $x(t):[0,2\pi]\to\mathbb{R}$'s Fourier series $x[n]_{n=-\infty}^\infty$. Perform DFT on $x[n]_{n=0}^N$. How is the result connected to $x(t)$? WHY? Question 2: ...
3
votes
0answers
111 views

Problems sampling from a $pdf$ over $SO\left(3\right)$

I have a probability density function over $SO\left(3\right)$, which I am trying to sample from. The $pdf$ is given as a generalized fourier series: $$ f\left(\omega,\theta,\phi\right)=\sum ...
3
votes
0answers
433 views

Notation for sampling random variate

Is there standard notation for sampling a value from a probability distribution? Like, if I had a random variable $X$, setting $x$ to whatever value I happened to sample from $X$ on this occasion? I ...
2
votes
4answers
131 views

Is it true that $\mathbb E[{\frac{X}{Y}]}={\frac{\mathbb E[X]}{\mathbb E[Y]}}$?

If $X$ and $Y$ are both random variables, does it hold $$\mathbb E\left[\frac{X}{Y}\right]={\frac{\mathbb E[X]}{\mathbb E[Y]}}$$ ??
2
votes
2answers
59 views

unbiased estimator in a random sample

I Have a statistic statement here which I need to decide if it's true or false Statement: "When the sample size is random, there is no way to get an unbiased estimator for the population average." ...
2
votes
1answer
93 views

Non-i.i.d Empirical Risk Minimization

I'm not a statisticians so please forgive me if I posed a silly question, but it's a real problem for me in my research. Suppose we have defined risk in a regression problem as $R(f)=\int l(f(x),y) ...
2
votes
1answer
105 views

Monte Carlo Rejection Sampling Method

I have the following passage from a set of lecture notes I am working on that I would like to understand a little better. $\underline{\text{Algorithm for Rejection Sampling}}$: Given two densities ...
2
votes
3answers
415 views

estimate population percentage within an interval, given a small sample

Given a small sample from a normally-distributed population, how do I calculate the confidence that a specified percentage of the population is within some bounds [A,B]? To make it concrete, if I ...
2
votes
1answer
84 views

Uniform sampling of multicolored balls

If I uniformly sample-without-replacement a small bunch of multicolored balls (say, five colors) from one urn into a "smaller" urn, will the distribution of ball colors in the smaller urn be the same ...
2
votes
2answers
151 views

Generate a Monte Carlo sample from a PDF defined by a Fourier Series

I have a probability distribution (PDF) defined by a Fourier series.. actually it's a purely cosine series over a known range. The PDF quite smooth, so most of the power is in the low 5 or so ...
2
votes
1answer
91 views

Sample size from population?

This is probably very rudimentary maths, but given a strict population size ($N = 20$ for example), is the sample size any number $<N$? For use in calculation of confidence intervals using a ...
2
votes
4answers
53 views

Can a sampling based method estimate how many species exist?

I've got in to a bit of a debate online and I'm hoping some people here can help clear it up. The position I'm arguing against is "It's impossible even come up with a ballpark estimate for how many ...
2
votes
1answer
274 views

How can I sample a bivariate Gaussian distribution using Gibbs sampling?

I'm trying to sample a bivariate Gaussian distribution using Gibbs sampling, but I think I don't have the correct conditional probabilities. According to this lecture slides, the conditional ...
2
votes
1answer
222 views

Proof that $\frac{(\bar X-\mu)}{\sigma}$ and $\sum_{i=1}^n\frac{(X_i-\bar X)^2}{\sigma^2}$ are independent

Let $X_i\sim N(\mu,\sigma^2)$ ; where$[i=1,2,\ldots,n]$ $Z_i\sim N(0,1)$ ; where$[i=1,2,\ldots,n]$ Proof that $\bar Z=\frac{(\bar X-\mu)}{\sigma}$ and $\sum_{i=1}^{n}(Z_i-\bar ...
2
votes
1answer
69 views

Sampling labeled items on a conveyor belts

I have items on a moving conveyor belt. Every item has a label with a number that goes from $1$ to $N$; on the conveyor belt there are more than $N$ items. I have a camera above the items on the belt, ...
2
votes
1answer
90 views

$\chi^2$ test and sampling variance

Let $f(x)$ denote the pdf of a $\chi^2$-distribution with $n\in\mathbb{N}$ degrees of freedom given by $$f(x) = \frac{2^{-n/2}}{\Gamma(n/2)}\cdot x^{n/2-1}\cdot\mathrm ...
2
votes
0answers
15 views

Sampling from a graph

Suppose you have a graph $G=(V,E)$ that is unobservable globally and you wish to take a sample from the vertices of that graph to infer something about its global properties from local properties. ...
2
votes
0answers
25 views

Variance of a Population of Two Indpendent Random Variables

I have a question regarding a problem I'm looking at out of personal curiosity. Here is the basic setup of the problem: There is a population that contains half of type A, and half of type B. The ...
2
votes
1answer
33 views

Approaching a desired but infeasible distribution when constructing a sample

Suppose you have $N$ balls in $C$ different colors, and a "desired" distribution of those $C$ colors (eg 20% red, 80% blue). Your task is to build a sample (not really a random sample per se) of $S$ ...
2
votes
0answers
107 views

Central Limit Theorem Clarification [duplicate]

The Central Limit Theorem states that the sampling distribution of the sample mean: Converges in distribution to a normal distribution. Has an expected value (mean of the sampling distribution of ...
2
votes
1answer
73 views

Inverse of the German Tank Problem?

I have a problem that maps to estimating the discrete distance to a goal. The sample space is n discrete positions on a circle labeled sequentially; n is known. A target position is randomly ...
2
votes
0answers
124 views

Notation for sampling a random variable

my question is pretty much the same as the one asked here: Notation for sampling random variate (I did not find a satisfying answer there...): I have a random variable $X \sim U(1, 10)$. I want to ...
2
votes
0answers
67 views

Sampling probability

I have a pool of 36 samples (each is a pool itself). If I take a subset of eight samples at random from this pool, how do I calculate the probability of obtaining two of the same type of sample from ...
2
votes
1answer
481 views

unbiased estimator of sample variance using two samples

I have a couple questions, I'm hoping someone can help! Let $X_1...X_n$ is a random i.i.d. sample from a $N(\mu,\sigma^2)$ distribution, and $Y_1...Y_m$ is a random i.i.d. sample from a ...
2
votes
0answers
100 views

How to sample from a product-of-sums distribution?

$A$ is a $M$x$N$ matrix whose entries are positive. $x$ is a $N$ dimensional binary (i.e. consisting of $0$s and $1$s) vector and the number of $1$s in $x$ is constant. Let $y = Ax$. The distribution ...
2
votes
0answers
93 views

Approximability of continuous sampling by discrete sampling - definitions?

Are there standard definitions that express the notion that sampling from a given continuous random variable can be approximated "to any desired degree of accuracy" by sampling from an appropriately ...
2
votes
1answer
161 views

Sampling from discrete probability distribution from first principles

I have a set $S=\{a_1,a_2,\dots,a_n\}$. The probability with which each of the element is selected is $\{p_1,p_2,\dots,p_n\}$ respectively (where of course $p_1+p_2+\cdots+p_n=1$). I want to ...
2
votes
1answer
111 views

Designing an efficient sampling strategy

In a Monte Carlo simulation, my goal is to compute an estimate of the mean of a distribution via sampling. Traditional, straightforward statistics generates samples (via simulation) and computes the ...
1
vote
1answer
230 views

probability of a certain event in a repeated sampling with replacement (without ordering)

I have a problem that is bugging me for a couple of weeks now. I have asked some friends etc but the answers were not satisfying at all. So here we go. Suppose we have a set ...
1
vote
1answer
26 views

generating random samples with a PDF

I have the PDF of a distribution from which it is not possible to get a closed from for the CDF or inverse CDF. Is there a technique that would allow me to generate samples from this distribution ...