# What exactly are eigen-things?

Wikipedia defines an eigenvector like this:

An eigenvector of a square matrix is a non-zero vector that, when multiplied by the matrix, yields a vector that differs from the original vector at most by a multiplicative scalar.

So basically in layman language: An eigenvector is a vector that when you multiply it by a square matrix, you get the same vector or the same vector multiplied by a scalar.

There are a lot of terms which are related to this like eigenspaces and eigenvalues and eigenbases and such, which I don't quite understand, in fact, I don't understand at all.

Can someone give an explanation connecting these terms? So that it is clear what they are and why they are related.

-
Are you confused by their definitions, or do you want to see what their applications are? – Herng Yi Feb 11 '13 at 10:36
@HerngYi Their applications are also very interesting, but I think I need to grasp their definitions first. I find that wikipedia obfuscates their definitions a lot which makes it unclear to me. So the former – Eigeneverything Feb 11 '13 at 10:39
Salman Khan should do a screencast on eigen vectors. – Chloe Feb 12 '13 at 1:29
Few links: blog.stata.com/2011/03/09/… mathoverflow.net/questions/31838/… And there is a really interesting gif on that wiki site, if you are a visual type. – ante.ceperic Feb 13 '13 at 9:53
@Eigeneverything You made ​​me laugh when I read what you wrote: "There are a lot of terms which are related to this like eigenspaces and eigenvalues and eigenbases and such, which I don't quite understand, in fact, I don't understand at all" and looking at your username I found another term Eigeneverything. Thank you and I hope all is well now with these eigen.... :) – user63181 Jul 25 '13 at 14:22

Eigenvectors are those vectors that exhibit especially simple behaviour under a linear transformation: Loosely speaking, they don't bend and rotate, they simply grow (or shrink) in length (though a different interpretation of growth/shrinkage may apply if the ground field is not $\mathbb R$). If it is possible to express any other vector as a linear combination of eigenvectors (preferably if you can in fact find a whole basis made of eigenvectors) then applying the - otherwise complicated - linear transformation suddenly becomes easy because with respect to a basis of eigenvectors the linear transformation is given simply by a diagonal matrix.

Especially when one wants to investigate higher powers of a linear transformation, this is practically only possible for eigenvectors: If $Av=\lambda v$, then $A^nv=\lambda^nv$, and even exponentials become easy for eigenvectors: $\exp(A)v:=\sum\frac1{n!}A^n v=e^\lambda v$. By the way, the exponential functions $x\mapsto e^{cx}$ are eigenvectors of a famous linear tranformation: differentiation, i.e. mapping a function $f$ to its derivative $f'$. That's precisely why exponetials play an important role as base solutions for linear differential equations (or even their discrete counterpart, linear recurrences like the Fibonacci numbers).

All other terminology is based on this notion: An (nonzero) eigenvector $v$ such that $Av$ is a multiple of $v$ determines its eigenvalue $\lambda$ as the scalar factor such that $Av=\lambda v$. Given an eigenvalue $\lambda$, the set of eigenvectors with that eigenvalue is in fact a subspace (i.e. sums and multiples of eigenvectors with the same(!) eigenvalue are again eigen), called the eigenspace for $\lambda$. If we find a basis consisting of eigenvectors, then we may obviously call it eigenbasis. If the vectors of our vector space are not mere number tuples (such as in $\mathbb R^3$) but are also functions and our linear transformation is an operator (such as differentiation), it is often convenient to call the eigenvectors eigenfunctions instead; for example, $x\mapsto e^{3x}$ is an eigenfunction of the differentiation operator with eigenvalue $3$ (because the derivative of it is $x\mapsto 3e^{3x}$).

-
+1 If I'd realised you were writing this, I wouldn't have bothered with my own answer! – Tara B Feb 11 '13 at 11:02
@Hagen, "The don't bend and and rotate, they simply grow (or shrink) in length" - if you meant to write that they don't bend or rotate that's incorrect: the eigenspace may be complex in which case there is a rotation involved. – alancalvitti Feb 11 '13 at 15:11
It's now probably worth updating Wikipedia with this information, and a link to this source. – Yann Feb 11 '13 at 19:52
@alancalvitti: Surely rotation is a notion we only tend to imagine properly in real vector spaces...for example multiplication of a complex number by $i$ is rotation by $90$ degrees...but only when viewed in $\mathbb{R}^2$ as a REAL vector space. – fretty Feb 13 '13 at 16:25
Yes, it is the complex plane, but in order to view it as a plane you need to choose an isomorphism with $\mathbb{R}^2$... – fretty Feb 13 '13 at 18:00

Given a square matrix $A$, an eigenvalue is every such scalar appearing for some eigenvector.

The eigenspace to an eigenvalue is the vector space spanned by all eigenvectors, where this particular scalar occurs.

-
I'm sorry to edit this after you answered, but could you also include any other eigens such as eigenbases? – Eigeneverything Feb 11 '13 at 10:39
Wait, can there be multiple scalars per eigenfactors? I might be missing something (I haven't revised in a while) but that sounds counter-intuitive to me – Eigeneverything Feb 11 '13 at 10:42
*eigenvectors I'm sorry – Eigeneverything Feb 11 '13 at 10:52
There can't. That's not what Julian meant. But the sentence is a little ambiguous, so I can understand you reading it that way. – Tara B Feb 11 '13 at 10:54

The term "eigen" comes from german and means "proper". It means that the eigenvectors and eigenvalues have a special status with respect to the operator/matrix you are studying. In this case, it is that they are essentially invariant with respect to applications of the operator/matrix. After application you get back the same eigenvector multiplied by a factor that factor being the eigenvalue.

Since some people doubt that "proper" is an appropriate translation in this context, I'll have you know that "proper vector" is sometimes used as a synonym for "eigenvector". Also see this and this.

So, I think the meaning here is really that of having a special or peculiar status.

-
Actually, "proper" rather means "eigentlich", I think, whereas "eigen" is more or less "own". At least one should remember the trivia that there is no mathematician named Eigen (as opposed to the Killing form, which is named after a W. Killing and not because it kills vectors) – Hagen von Eitzen Feb 11 '13 at 10:44
@HagenvonEitzen Indeed, the dutch word is also eigen. – Eigeneverything Feb 11 '13 at 10:45
'proper' is listed as one of the possible meanings of 'eigen' in one dictionary I looked at, but I don't think that is the appropriate meaning in this context. – Tara B Feb 11 '13 at 11:03
'eigen' means 'proper' only insofar as 'proper' means 'for oneself', as in 'proprietary' or French propre. Mostly eigen means self-oriented. – AlexChaffee Feb 11 '13 at 19:10
FWIW, I've seen a number of old British linear algebra papers interchangeably use "characteristic value/vector" and "proper value/vector". – J. M. Apr 12 '13 at 11:41

Matrices can be viewed as linear maps on vector spaces...in fact if working over a nice field such as the field of real numbers, matrices give geometrical transformations.

For example the reflection in the line $y=x$ in $\mathbb{R}^2$ can be simulated by multiplication by the matrix:

$\left(\begin{array}[aa]\\ 0 1 \\ 1 0\end{array}\right)$

Now it is clear that geometrically there are certain symmetries here. For example if you choose any point on the line $y=x$ it gets sent to itself and if you choose any point on the line $y=-x$ then it gets sent to a point in the complete opposite direction from the origin.

This information is essentially what the eigenvalues and eigenvectors of the above matrix captures. The eigenvectors are the vectors on those two lines and the eigenvalues are the corresponding scalar multiple of the vector you get after applying the reflection.

Things on the line $y=x$ got sent to themselves, i.e. $Av = v$, a scalar multiple of $1$.

Things on the line $y=-x$ got sent to the negative of themselves, i.e. $Av = -v$, a scalar multiple of $-1$.

Thus we expect two eigenvalues $\pm 1$ and two "eigenspaces", $V_1, V_{-1}$ consisting of all vectors of eigenvalues $1$ and $-1$ respectively.

These spaces are exactly the vectors lying on the lines $y=x$ and $y=-x$ respectively.

Of course there are ways to work out these things using only the matrix but hopefully you can see a bit of significance to them now. They come in useful in many areas of maths.

-

As far as I understand it, the 'eigen' in words like eigenvalue, eigenvector etc. means something like 'own', or a better translation in English would perhaps be 'characteristic'.

Each square matrix has some special scalars and vectors associated with it. The eigenvectors are the vectors which the matrix preserves (up to scalar multiplication). As you probably know, an $n\times n$ matrix acts as a linear transformation on an $n$-dimensional space, say $F^n$. A vector and its scalar multiples form a line through the origin in $F^n$, and so you can think of the eigenvectors as indicating lines through the origin preserved by the linear transformation corresponding to the matrix.

Defn Let $A$ be an $n\times n$ matrix over a field $F$. A vector $v\in F^n$ is an eigenvector of $A$ if $Av = \lambda v$ for some $\lambda$ in $F$. A scalar $\lambda\in F$ is an eigenvalue of $A$ if $Av = \lambda v$ for some $v\in F^n$.

The eigenvalues are then the factors by which these special lines through the origin are either stretched or contracted.

-

Think of the eigenvalue $\lambda$ as a magnification factor: If $|\lambda | < 1,$ you have a contraction. If $|\lambda | > 1,$ you have a dilation. If $|\lambda | = 1,$ then the transformation preserves the length of the vector, possibly reversing its direction.

-

If you are interested in a "physicist" way of thinking about it, then Quantum Mechanics(QM) is probably the best way to understand the meaning of eigenvalues.

As you probably know, in QM we work with operators, i.e. momentum operator, energy operator etc. Those operators can be expressed in terms of matrices. Now, if we, say, want to find all the possible energies that our systems admits, one would have to find the eigenvalues of its energy matrix! Furthermore, those operators are self-adjoint which means that their eigenvalues are always real. So, the physical point of view makes sense.

For example, the energy levels of a simple harmonic oscillator are quantized. One can see that by looking at the eigenvalues of its energy matrix (called Hamiltonian of the system) which are discrete, i.e. the corresponding energies are found to be

$E_{n}=\hbar\omega \left(n+\frac{1}{2}\right)$

Hope this helps!

-