52
$\begingroup$

I've come across a paper that mentions the fact that matrices commute if and only if they share a common basis of eigenvectors. Where can I find a proof of this statement?

$\endgroup$
  • 3
    $\begingroup$ You can find a good and detailed discussion of this fact in the book "Linear Algebra", by Kenneth Hoffman and Ray Kunze, chapter 6 (Elementary Canonical forms). $\endgroup$ – Ronaldo Oct 7 '10 at 17:00
  • 8
    $\begingroup$ As a physics student, I would like to mention that this simple theorem, is tremendously useful and important in quantum mechanics, and gives rise to the concepts of compatible and incompatible variables, which is essential for the measurements and probabilistic interpretation of quantum mechanics. $\endgroup$ – user23238 Feb 17 '13 at 13:01
57
$\begingroup$

Suppose that $A$ and $B$ are $n\times n$ matrices, with complex entries say, that commute.
Then we decompose $\mathbb C^n$ as a direct sum of eigenspaces of $A$, say $\mathbb C^n = E_{\lambda_1} \oplus \cdots \oplus E_{\lambda_m}$, where $\lambda_1,\ldots, \lambda_m$ are the eigenvalues of $A$, and $E_{\lambda_i}$ is the eigenspace for $\lambda_i$. (Here $m \leq n$, but some eigenspaces could be of dimension bigger than one, so we need not have $m = n$.)

Now one sees that since $B$ commutes with $A$, $B$ preserves each of the $E_{\lambda_i}$: If $A v = \lambda_i v, $ then $A (B v) = (AB)v = (BA)v = B(Av) = B(\lambda_i v) = \lambda_i Bv.$

Now we consider $B$ restricted to each $E_{\lambda_i}$ separately, and decompose each $E_{\lambda_i}$ into a sum of eigenspaces for $B$. Putting all these decompositions together, we get a decomposition of $\mathbb C^n$ into a direct sum of spaces, each of which is a simultaneous eigenspace for $A$ and $B$.

NB: I am cheating here, in that $A$ and $B$ may not be diagonalizable (and then the statement of your question is not literally true), but in this case, if you replace "eigenspace" by "generalized eigenspace", the above argument goes through just as well.

$\endgroup$
  • 1
    $\begingroup$ I'm a bit unclear on "putting decompositions together" part...does it give you an explicit form for the common set of eigenvectors? $\endgroup$ – Yaroslav Bulatov Oct 7 '10 at 18:32
  • 4
    $\begingroup$ @Yaroslav: Dear Yaroslav, Yes, you will be able to get an explicit form for the common set of eigenvectors, but it may be complicated to compute (at least if you are computing by hand). What you need to do is to find a basis for each $E_{\lambda_i}$. You can then write a matrix for $B$ (restricted to $E_{\lambda_i}$) in terms of this basis, and then by the usual diagonalization procedure (applied to this new matrix) find a new basis for $E_{\lambda_i}$ consisting of eigenvectors for $B$. (So these will be simultaneous eigenvectors for $B$ and $A$ --- with $A$-eigenvalue all equal to ... $\endgroup$ – Matt E Oct 7 '10 at 18:33
  • 4
    $\begingroup$ ... $\lambda_i$.) You do this for each $\lambda_i$, and putting all of the bases you found for each $E_{\lambda_i}$ together, you get a basis for $\mathbb C^n$ consisting of simultaneous eigenvectors. As Qiaochu points out, the situation is easiest when all the $E_{\lambda_i}$ are one-dimensional (i.e. when $A$ has distinct eigenvalues) since then you don't need to do the second step of computing eigenvectors for $B$; each $E_{\lambda_i}$ will automatically consists of simultaneous eigenvectors for $A$ and $B$ (again, this is just in the special case when $A$ has distinct eigenvalues). $\endgroup$ – Matt E Oct 7 '10 at 18:37
  • 3
    $\begingroup$ Also, as your probably know, in the quantum mechanics literature, the situation when the $E_{\lambda_i}$ are bigger than one-dimensional is sometimes referred to by saying that the operator $A$ has degeneracies. $\endgroup$ – Matt E Oct 7 '10 at 18:38
  • $\begingroup$ @MattE Hi Matt, can you explain a little bit in detail on what can be said when $A$ or $B$ is not diagonalizable? As in this case one is no longer guaranteed to have the relation $Av = \lambda_iv$, and I don't see how your argument can be extended. In particular, given two commuting matrices $A$ and $B$, if $B$ is symmetric and $A$ is not diagonalizable, is a subspace of $\mathbb{R}^n$ that is invariant under $A$ also invariant under $B$? $\endgroup$ – Yuanzhao Mar 11 '17 at 18:28
34
$\begingroup$

This is false in a sort of trivial way. The identity matrix $I$ commutes with every matrix and has eigenvector set all of the underlying vector space $V$, but no non-central matrix has this property.

What is true is that two matrices which commute and are also diagonalizable are simultaneously diagonalizable. The proof is particularly simple if at least one of the two matrices has distinct eigenvalues.

$\endgroup$
  • 4
    $\begingroup$ (And this can be improved to "simultaneously Jordanized", among other things) $\endgroup$ – Mariano Suárez-Álvarez Oct 7 '10 at 13:56
  • 1
    $\begingroup$ Dear Qiaochu, I suspect that the question means "admit a common set of eigenvectors", not that every eigenvector for one is an eigenvector fo the other. $\endgroup$ – Matt E Oct 7 '10 at 15:19
  • $\begingroup$ Yes, I meant Matt's version, the precise statement was "Thus, the Hamiltonian and all the translation operators of the crystal commute with each other. They possess, therefore, a common set of eigenstates." which I figured would have an equivalent statement in linear algebra $\endgroup$ – Yaroslav Bulatov Oct 7 '10 at 17:56
  • 9
    $\begingroup$ @MarianoSuárez-Alvarez: That's not true. Take the 3 x 3 matrix nilpotent $A$ with ones just above the diagonal and all other entries zero. Then $A$ and $A^2$ commute, but are not simultaneously Jordanized (because $A$ is a single Jordan block, so any $P$ Jordanizing it must give $PAP^{-1} = A$ and thus $PA^2P^{-1} = A^2$ is not in Jordan form). It is true that any two commuting matrices can be simultaneously put in upper triangular form, though, maybe that's what you were remembering? $\endgroup$ – Omar Antolín-Camarena Nov 26 '12 at 18:50
  • 8
    $\begingroup$ @MarianoSuárez-Alvarez: Your comment is just wrong, as is shown in this answer. $\endgroup$ – Marc van Leeuwen May 6 '14 at 8:52
4
$\begingroup$

Let $S$ be a set of commuting matrices over an algebraically closed field $F$. Then there may not be a common basis of eigenvectors (since any of them may not be diagonalizable!) but there must be at least a common eigenvector:

Burnside's theorem on matrix algebras states that if $F$ is algebraically closed, $V$ is a finite-dimensional $F$-vector space and $S$ is a proper subalgebra of $\text{End}(V)$ then there exists a nontrivial $S$-invariant subspace, i.e, there exists $W\leq V$ with $0\neq W\neq V$ such that $s(W)\subseteq W$ for every $s\in S$.

Suppose $S\subseteq M_n(F)$ with $n>1$ is commuting. Observe that a subspace of $F^n$ is $S$-invariant if and only if it is invariant for $<S>$, the subalgebra of $M_n(F)$ generated by $S$. Since $S$ is commuting, $<S>$ is also commuting and therefore $<S>\neq M_n(F)$. Burnside's theorem applies, and so there exists a proper and nontrivial subspace $V\leq F^n$ which is invariant for all $S$. If $V$ has dimension more than $1$ then $<S>\neq\text{End}(V)$, since $<S>$ is commuting, and we can apply Burnside's theorem again. By induction there exists an $S$-invariant subspace of dimension $1$, and so a common eigenvector for the matrices in $S$.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.