Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I'm looking over the answers for old statistics exams in preparation for my own exam, while reviewing a question concerning discriminant analysis I found something really odd.

I have input variables and a class label for each observation

x1 = [2, 10, 6, 14, 6, 10]
x2 = [8, 6, 4, 10, 12, 8]
t  = [1, 1, 1, 2, 2, 2]

Normally for DA I would calculate the mean for each group (both groups have mean 8) however the exam asks for the 'group mean vectors' which according to the answers should be:

 u1 = [6, 6]
 u2 = [10, 10]

However I can't find anywhere how these were calculated. A Google search for 'group mean vector' turns up nothing and if I search for Discriminant Analysis methods all I find is using the means for each group (scalars not vectors).

The second strange things happens in calculating the covariance matrix. Instead of calculating one covariance matrix for both groups, they ask for a "common group covariance matrix" (again Google is useless here, so strange!)

Apparently you have to calculate a matrix per group first and then add these for both groups together (cell per cell) and divide each cell by 2. For x1 this 'group matrix' is:

top_left = 0.5[(2-6)^2 + (6-6)^2 + (10-6)^2 = 16
bottom_right = 0.5[(8-6)^2 + (6-6)^2 + (4-6)^2 = 4
others = 0.5[(2-6)(8-6) + (10-6)(6-6) + (6-6)(4-6) = -4

=>  16 -4
    -4  4

A couple of strange things here: The number 14, from data set x1 is never used! The number 8 does not appear in group x1 (but does in group 2, but no other numbers from group 2 are used).

I'm at a loss: how is a 'group mean vector' calculated and how is the matrix for each individual group calculated?

share|cite|improve this question
Consider asking at – user53153 Feb 2 '13 at 17:29
Hey 5PM, In the end I found out what was meant. I forgot about the question here though. I'll just put the answer online in case someone is looking for this later as well. – Roy T. Feb 2 '13 at 18:27
up vote 1 down vote accepted

For reference, the answer I found later (reproduced from slides)

Where D is the dimension (2 in the example in the question) and K is the class (there are again 2 classes, or targets, in my example)

Group mean

The matrix for each group is then:

Group matrx

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.