Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Could someone provide a good reference for learning matrix calculus? I've recently moved to a more engineering-oriented field where it's commonly used and don't have much experience with it.

share|cite|improve this question
Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)? – Marek Nov 11 '10 at 19:46
Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works. – Simon Nov 11 '10 at 19:55
up vote 5 down vote accepted

Actually the books cited above by Sivaram are excellent for numerical stuff. If you want "matrix calculus" then the following books might be helpful:

  1. Matrix Differential Calculus with Applications in Statistics and Econometrics by Magnus and Neudecker

  2. Functions of Matrices by N. Higham

  3. Calculus on Manifolds by Spivak

Some classic, but very useful material can also be found in

  1. Introduction to Matrix Analysis by Bellman.

As a simple example, the books will teach (unless you already know it) how to compute, say, the derivative of $f(X) = \log\det(X)$ for an invertible matrix $X$.

share|cite|improve this answer

Gene Howard Golub, Charles F. Van Loan book on "Matrix Computations" is regarded as the "Bhagavad Gita" for Matrix Algorithms.

There is also another book by "Gene Howard Golub, Gerard Meurant" on "Matrices, moments, and quadrature with applications".

Also, "Numerical Linear Algebra" by Trefethen and Bau is well-written and easy to read.

I would highly recommend Trefethen and Bau since I have read it completely. I feel it is ideal for self-study or for a one quarter course. Once you are done with this you can take a look at Golubs' book. Golubs' book is really good for reference.

share|cite|improve this answer
Beautiful, thanks! – Simon Nov 11 '10 at 19:47

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.