Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Are there any good online resources to learn multivariate statistics? ( With topics such as Multiple Linear Regression, Principal Component Analysis, Factor Analysis, Cluster Analysis and Discriminant Analysis)

share|cite|improve this question
You may want to also ask this question over at – Byron Schmuland Mar 10 '11 at 14:58
up vote 2 down vote accepted

Statsoft has a pretty good comprehensive online guide which I can recommend:

-Ralph Winters

share|cite|improve this answer
Thanks for the link. I didn't read it much yet but it is quite comprehensive. – user8067 Mar 10 '11 at 15:20

Hopefully I can help with intuitively understanding PCA with my cartoon:

Visual Intuition (zoom in)

enter image description here

Intuition via utility

I think the main usage for PCA is to be able to categorise different distinct "things" e.g. Shiny cells vs. Dark cells in a way that leads to least error. E.g. Imagine sam was hiding behind me and I pinched a cell off the left side of his body then asked you to guess the color of the cell, by looking at the winning photo, or even the winning line, you can make a very good guess it will be a "dark cell".

Intuition via Analogy

So my understanding is that PCA is like taking a "picture" in a lower dimension, but the various methods used out there attempt to make the picture as informative as possible by deciding which "angle" to take the picture from (notice for 1D the angle of "squishing line" also vary).

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.