Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I'm reading a book named The Elements of Statistical Learning by Hastie, in section 2.5, Local Methods in High Dimensions, it says that the sampling density is proportional to $N^{\frac{1}{p}}$, where $p$ is the dimension of the input space and $N$ is the sample size.

I'm confused, what does it mean by sampling density? I do know, intuitively, as the dimension becomes larger, the sample becomes more sparse. But I don't understand exactly where does $N^{\frac{1}{p}}$ come from.

Could anyone give me a hint? Thanks a lot!

share|improve this question

1 Answer 1

up vote 2 down vote accepted

Recall that the sampling density or sampling rate is the number of recorded samples per unit distance.

Assume that a sample of size $N$ is taken from the unit cube $[0,1]^p$ in $\mathbb R^p$ (but the argument applies to every domain of finite volume). Roughly speaking, each point in the sample takes a volume $1/N$ of the domain, hence the distance between this point and its neighbors scales as $1/N^{1/p}$.

share|improve this answer
    
Thanks for your explanation! And yet I'm still a little confused by "per unit distance". What does "per unit distance" mean? Why do we define it in this way? –  Tansy Jan 22 '13 at 0:27
    
A density of 0.01 per meter means that your nearest neighbour is at roughly 100 meters from you. –  Did Jan 22 '13 at 7:57

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.