Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

As the title states, is there a continuous analogue of a Hypergeometric distribution?

If $ X \sim H(m,n,N)$ is a common Hypergeometric distribution, where $N$ is the population size, $n$ is the number of draws, and $m$ is the number of success. In my case $N,n,m$ are not integer, therefore I could have a not integer number of success.

share|improve this question
add comment

1 Answer

up vote 7 down vote accepted

Short version, yes.

Long version, it's complicated. There is an interesting link between probability distributions and orthogonal polynomials. For instance, consider the Hermite polynomials, $H_0, H_1, \ldots$. These are orthogonal with respect to the weight function $e^{-x^2/2}$ on the support $(-\infty,\infty)$. In other words, $\int_{-\infty}^{\infty}H_i(x)H_j(x)e^{-x^2/2}dx = \sqrt{2\pi}i!\delta_{ij}$.

The weighting function and the coefficient having a factor $\sqrt{2\pi}$ should ring a bell; specifically, you find these represented in a standard normal distribution.

Norbert Wiener recognized that the two are intricately linked and developed what is called the Gauss-Hermite Polynomial Chaos. In short, we can write a random variable $k$ of any distribution as an infinite series about a random variable $\zeta$ of a normal (Gaussian) distribution by using the Hermite polynomials as basis functions: $$ k = \sum_{i=0}^{\infty}k_i H_i(\zeta).$$

It turns out, you can generalize this to other distributions, and to discrete distributions.

There is something called the Askey Scheme, which is essentially a family tree relating hypergeometric orthogonal polynomials. Many of the weighting functions for these polynomials are distribution functions for probability distributions, meaning we can perform a Wiener-Askey Polynomial Chaos expansion for any random variable about another random variable of almost any distribution of our choosing. See also: http://www.dam.brown.edu/scicomp/media/report_files/BrownSC-2003-07.pdf

The hypergeometric family linked to the discrete hypergeometric distribution is the Hahn family of polynomials. The continuous analogue is uncreatively called the "Continuous Hahn" family. This leads to the following answer:

The weighting function of the Continuous Hahn polynomials will give you the continuous analogue of the discrete hypergeometric distribution. In fact, it is most likely identical to within a scaling parameter. These functions are quite complicated, so it is not intuitive.

The polynomial chaos distribution is quite interesting and powerful. If you look at the series expansion, it is analogous to a Taylor expansion of a random variable. Importantly, it allows you to write a random variable in a possibly unknown or complicated distribution in terms of any distribution of your choosing; as with any series expansion, the challenge is to then compute the deterministic coefficients. This becomes quite potent when you have, say, a dynamical system parameterized about a random parameter -- instead of using complicated stochastic models, or time-consuming Monte-Carlo analysis, you can frame the problem as one of computing a handful of deterministic coefficients, and generate statistical moments and/or Monte Carlo samples from them easily.

Interestingly, the first coefficient, $k_0$ always represents the distribution mean.

share|improve this answer
    
Ah, you're using the physicist's normalization for Hermite polynomials... :) –  J. M. Aug 4 '12 at 4:56
    
@J.M. In this example yes -- and only because I couldn't recall the exact structure of the coefficients in the inner product (so I wiki'd it :D). In practice, though, I tend to use neither the probabilist's nor the physicist's normalization for generalized Polynomial Chaos. It is much more convenient to choose the normalization such that $\langle H_i^2(\zeta) \rangle = 1$ for all $i = j$. That normalization is somewhere "in between" the two. –  Arkamis Aug 4 '12 at 5:00
    
Interesting. So, the only practical way to do it would be to have a look to polynomial chaos distribution. Furthermore, the current r.v. $X$, which I was looking for a continuous analogue, is used to compute another r.v.. The transformation is very similar to $Y = H(X)$. Where $H$ is the entropy function. It would be really great if I was able to compute the expected value of $Y$. –  Simone Aug 7 '12 at 0:32
1  
@Simone Generalized polynomial chaos makes it very easy to do that. You can take an intrusive approach, where you replace the random variable $X$ in your transformation with its polynomial chaos expansion. You compute a second polynomial chaos expansion about the same RV for $Y$: $$ Y = \sum_{i=0}^P Y_i \Phi_i(\zeta),$$ $$ X = \sum_{i=0}^P X_i \Phi_i(\zeta),$$ $$ Y = H(X) = H\left(\sum_{i=0} X_i(\zeta)\Phi_i(\zeta)\right).$$ Since it is "very easy" to compute the deterministic coefficients $X_i$, all you need to do is compute $Y_i$ using the Galerkin method. Also, $E[Y] = Y_0$. –  Arkamis Aug 7 '12 at 1:36
1  
The Galerkin approach exploits orthogonality of the polynomial basis family $\Phi(\zeta)$ on its support to allow for the generation of $P+1$ equations to compute the $P+1$ $Y_i$'s. Simply project the expansion of $Y$ onto each orthogonal basis polynomial, $\langle Y \Phi_i(\zeta)$, and then (depending on the form of your equation $H(X)$) orthogonality should wipe out all of the "cross" terms, leaving you to compute something along the lines of $$Y_i = \frac{\langle Y \Phi_i(\zeta) \rangle}{\langle \Phi_i^2(\zeta)\rangle}.$$ –  Arkamis Aug 7 '12 at 1:40
show 4 more comments

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.