# Eigenspaces of Symmetric Matrices

I was looking at a post regarding the orthogonality of the eigenvectors of a symmetric matrix, and wanted to see if the following statement is true, and why?

A matrix is symmetric if and only if it's eigenspaces are orthogonal.

Is this true and why?

-
Consider $$\begin{bmatrix}0 & 1 \\ 0 & 0\end{bmatrix}.$$ – wj32 Oct 31 '12 at 8:19

In this form it is not exactly true. For example, we can take a matrix that has no eigenspaces at all, like $$A=\left(\begin{array}{ll}0&1\\-1&0\end{array}\right).$$ It is not symmetric, and technically all of its eigenspaces are orthogonal ))

However, the following is true: a real $n\times n$ square matrix $A$ is symmetric if and only if all of its eigenspaces are orthogonal and the sum of these eigenspaces is the whole $\mathbb{R}^n$. This condition is equivalent to saying that there is an orthonormal basis consisting of eigenvectors of $A$, and this is the statement from the post that you mentioned.

UPDATE: If you're interested in the same question but for matrices over $\mathbb{C}$ and using orthogonality that arises from the standard inner product $(a,b) = \sum a_i \overline{b}_i$, then the statement isn't true. The counterexample is the same matrix $A$ as above. It is not symmetric and not Hermitian, but it has two eigenspaces generated by vectors $(1, i)^T$ and $(1, -i)^T$ which are orthogonal.

-
@Robert: Suppose that $A$ has no eigenspaces. Then it’s automatically true that if $x$ and $y$ are vectors in different eigenspaces of $A$, then $x\cdot y=0$. However, it’s true on a technicality: it’s true because there are no such $x$ and $y$, and an implication with a false premise is automatically true. – Brian M. Scott Oct 31 '12 at 8:35
@DanShved: Are you sure you don't want to use the standard inner product on $\mathbb{C}^n$? – wj32 Oct 31 '12 at 8:39
@DanShved: What I meant was in the case of $\mathbb{C}$, you could immediately "upgrade" your statement by performing the following substitutions: real -> complex; symmetric -> Hermitian; $\mathbb{R}^n$ -> $\mathbb{C}^n$, and adding a real eigenvalues requirement – wj32 Oct 31 '12 at 8:55
@RobertS.Barnes: If a matrix $M$ has orthogonal eigenspaces that sum to $\mathbb{R}^n$, then choose an orthonormal basis for each eigenspace, resulting in an orthonormal basis for $\mathbb{R}^n$ and an orthogonal matrix $P$. We have $M=PDP^T$ where $D$ is diagonal, so $M^T=PD^T P^T=PDP^T=M$. For the other direction, see en.wikipedia.org/wiki/… – wj32 Oct 31 '12 at 9:08
@RobertS.Barnes: Yes. As I mentioned before, you need to add in the condition that all eigenvalues must be real. – wj32 Oct 31 '12 at 10:35

A definition of "symmetric" which should prove useful here is: if < , > is a canonically chosen inner product, we say T is symmetric if and only if for all vectors $u,v \in V$ we have < u, Tv> = < Tu, v>.

Assume that the dimension of V is equal to the sum of the dimensions of the eigenspaces $E_1,...,E_k$ associated to the eigenvalues $\lambda_1,...,\lambda_k$. Then we can write any vectors $u,v \in V$ as $\sum_{i=1}^k u_i$ and $\sum_{i=1}^k v_i$ respectively. < u, Tv> can then be rewritten <$\sum u_i$, T $\sum v_i$> = < $\sum u_i$, $\sum T v_i$> = < $\sum u_i$, $\sum \lambda_i v_i$>.

Now we use orthogonality. If the eigenspaces are orthogonal to eachother, then this expression becomes $\sum$ < $u_i$, $\lambda_i v_i$> = $\sum \lambda_i$< $u_i$, $v_i$> = $\sum$ < $\lambda_i u_i$, $v_i$> = < $\sum \lambda_i u_i$, $\sum v_i$> = < Tu, v>.

The reverse implication isn't hard, simply consider the equality < u, Tv> = < Tu, v> when u, v are two eigenvectors corresponding to two different eigenvalues.

-
What does $=.$ mean? – Robert S. Barnes Oct 31 '12 at 9:51
So the concept of symmetry in matrices is tied to the definition of the inner product. So you can only have symmetric matrices over inner product spaces? Over any inner product space? – Robert S. Barnes Oct 31 '12 at 9:53
@RobertS.Barnes: The notion of a symmetric matrix does not require an inner product to be defined. However, if you have an inner product space (over $\mathbb{R}$ or $\mathbb{C}$) then by definition a self-adjoint (i.e. "symmetric") operator $T$ is one that satisfies $\langle u, Tv \rangle = \langle Tu,v \rangle$ for all $u,v$. Without a traditional inner product, there are various things you could do. See this question for more details: math.stackexchange.com/questions/58146/… – wj32 Oct 31 '12 at 10:45