Tell me more ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

I have been doing multinomial logistic regression analysis using SPSS 19. I have encountered the following problem when I run the analysis procedure:

"Unexpected singularities in the Hessian matrix are encountered. This indicates that either some predictor variables should be excluded or some categories should be merged."

A little background about my data used. I have four categorical predictors with two levels each, 1 or 2. The response variable in my model is a three-level categorical variable. I used the last level as the reference category. I tried to compare the coefficients of the intercept with that of the four predictors in the two logits so as to find which level of the response variable may cause this problem. The big differences in coefficients between the intercept and three of the predictors suggest that it might be the reference category that has the problem. However, I could not combine the levels of the response variable (which I'm not allowed for my research).

I have also tried to exclude the predictors one by one, but still got the same problem.

Could anyone please tell me what I should do to solve this problem?

Thanks!

share|improve this question
2  
This probably would be more appropriate for CV, but my suspicion is that your data is perversely configured, causing your Hessian to be (numerically) not positive definite... – J. M. Apr 29 '11 at 14:48
@J.M. Apparently it is already posted there. stats.stackexchange.com/questions/10146/… – Willie Wong Apr 29 '11 at 17:00

closed as off topic by Qiaochu Yuan Apr 30 '11 at 11:47

Questions on Mathematics Stack Exchange are expected to relate to math within the scope defined in the FAQ. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about closed questions here.

Browse other questions tagged or ask your own question.