Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Many nonlinear manifold learning methods used for dimensional reduction (isomap, diffusion maps, local preserving projections, etc) solve the symmetric eigenvalue problem and then use the eigenvectors whose eigenvalues are the two "most trivial" as the reduced dimensions. Would these always be the smallest (non-zero) eigenvalues and if so, isn't the noise and outlier residual values usually in such eigenvectors? Why not the two largest eigenvalues? Given the trivial viewpoint, what is being done to send or pack information into the eigenvectors with the smallest eigenvalues?

Looking at the fundamental definition of the eigenvalue, that is, an eigenvalue represents the variance of elements in its associated eigenvector, there must be a technique being exploited which nevertheless packs informativeness about class structure into the two eigenvectors while keeping the variance down. Hence, you are taking the eigenvectors, which typically only carry large outlier (extreme) values, and packing information into them that's representative of the original cluster structure at higher dimensions. Thus, "junk" eigenvectors are assigned to carry all the information when done.

share|cite|improve this question

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.