With the definition of matrix norm as

$$\|M \|=\sup_x \{ |Mx|: |x|=1 \},$$

where $M$ is square and $|\cdot|$ denotes the standard euclidean 2-norm. I'm trying to prove that

$$\|M\|^2=\|M^T\|^2 = \mathrm{largest \; eigenvalue \; of \;} M^TM?$$

  • $\begingroup$ The title isn't accurate. $\endgroup$ – Git Gud Mar 20 '14 at 15:51
  • $\begingroup$ @Git Gud - how's this? $\endgroup$ – David Simmons Mar 20 '14 at 16:39
  • $\begingroup$ The relevant thing in the question is proving it equals the largest eigenvalue, not that it equals the norm of the transpose (that will be an easy consequence). $\endgroup$ – Git Gud Mar 20 '14 at 16:40

Hint: note that $$ \|Mx\|^2 = (Mx)^T(Mx) = x^T(M^TM)x $$

  • $\begingroup$ So similarly we have $$||M^Tx||^2 = x^TMM^T x,$$ I'm not sure where you would go from here though. $\endgroup$ – David Simmons Mar 20 '14 at 16:03
  • $\begingroup$ Re my previous comment, for real matrices $M$ we have $M^TM=MM^T$ ... $\endgroup$ – David Simmons Mar 20 '14 at 16:27
  • 1
    $\begingroup$ @DaveS: As Git Gud and copper.hat note, the next thing to note is that $M^TM$ and $MM^T$ always have the same eigenvalues, since $AB$ and $BA$ have the same eigenvalues for arbitrary matrices $A,B$. $\endgroup$ – Omnomnomnom Mar 20 '14 at 23:06
  • $\begingroup$ I know that the derivative of $||x||_2^2$ w.r.t $x$ is equal to $2x$. But what about the derivative of $||x^T||_2^2$ w.r.t $x$. Is it the same $2x$? or $2x^T$? $\endgroup$ – Christina Oct 27 '16 at 5:49

Show that the non zero eigenvalues of $AB$ and $BA$ are the same. (In this case $A=M,B=M^T$).


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.