9
$\begingroup$

In here: http://ocw.mit.edu/courses/mathematics/18-06sc-linear-algebra-fall-2011/positive-definite-matrices-and-applications/symmetric-matrices-and-positive-definiteness/MIT18_06SCF11_Ses3.1sum.pdf

A positive definite matrix is a symmetric matrix A for which all eigenvalues are positive. - Gilbert Strang

I have heard of positive definite quadratic forms, but never heard of definiteness for a matrix.

  • Because definiteness is higher dimensional analogy for whether if something is convex (opening up) or concave (opening down). It does not make sense to me to say a matrix is opening up, or matrix is opening down.

Therefore it does not make sense to say that a matrix has definiteness.

  • In addition, when we say $M \in \mathbb{R}^{n \times n}$ positive definite, what is the first thing we do? We plug $M$ into a function(al) $x^T (\cdot) x$ and check whether the function is positive for all $x \in \mathbb{R}^n$. Clearly, that means we are defining this definiteness with respect to $x^T (\cdot) x$ and NOT $M$ itself.

    Furthermore, when matrix have complex eigenvalues, then we ditch the notion of definiteness property all together. Clearly, definiteness is a flimsy property for matrices if we can just throw it away when it becomes inconvenient.


I will grant you that if we were to define positive definite matrices, we should only define with respect to symmetric matrices. This is the definition on Wikipedia, the definition used by numerous linear algebra books and many applied math books.

But then when confronted with a matrix of the form

$$\begin{bmatrix} 1 & -1 \\ 0 & 1 \end{bmatrix}$$

I still firmly believe that this matrix is not positive definite because it is not symmetric. Because to me positive definiteness implies symmetry.

To what degree is it widely agreed upon in the math community that a positive definite matrix is defined strictly with respect to symmetric matrices and why only with respect to symmetric matrices?

$\endgroup$
  • 1
    $\begingroup$ A matrix $A$ is said to be positive definite if $x^TAx>0$ $\endgroup$ – Kushal Bhuyan Dec 1 '15 at 16:48
  • 2
    $\begingroup$ @Quintic Consider matrix $A$ = $\begin{bmatrix} 1 & 1 \\ -1 & 1 \end{bmatrix}$ it has eigenvalues $1 \pm i$, none of which is real, which by implication positive (or negative for that matters). But the quadratic form is $x_1^2 + x_2^2$ > 0 for all $x_1, x_2 \in \mathbb{R}$ not equal to zero. none of the eigenvalues are positive. So are you saying that a matrix can be positive definite even if none of the eigenvalues are real and positive? $\endgroup$ – Carlos - the Mongoose - Danger Dec 1 '15 at 17:58
12
$\begingroup$

The positive definiteness (as you already pointed out) is a property of quadratic forms. However, there is a "natural" one-to-one correspondence between symmetric matrices and quadratic forms, so I really cannot see any reason why not to "decorate" symmetric matrices with positive definiteness (and other similar adjectives) just because it is in "reality" the form they define which actually has this property. I can see this one-to-one correspondence as one of the reasons why the symmetry should be implicitly assumed when talking about positive definite matrices.

One can of course devise a different name for this property, but why? In addition, positive definite matrix is a pretty standard term so if you continue reading on matrices I'm sure you will find it more and more often.

Some authors (not only on Math.SE) allow positive definite matrices to be nonsymmetric by saying that $M$ is such that $x^TMx>0$ for all nonzero $x$. In my opinion this adds more confusion than good (not only on Math.SE). Also note that (with a properly "fixed" inner product) such a definition would not even make sense in the complex case if the matrix was allowed to be non-Hermitian ($x^*Mx$ is real for all $x$ if and only if...).

Anyway, for real matrices, it of course makes sense to study nonsymmetric matrices giving a positive definite quadratic form through $x^TMx$ (which effectively means that the symmetric part is positive definite). However, I find denoting them as positive definite quite unlucky.

$\endgroup$
5
$\begingroup$

If the square matrix A is positive definite then the hypersurface defined by

$$Y=X^T.A.X$$

is convex.

Symmetric real-valued matrices are diagonizable, i.e., even when viewed as complex matrices their eigenvalues are all real.

For general complex square matrices replace 'symmetric' with 'hermitean'.

$\endgroup$
-2
$\begingroup$

To make it simple, definiteness is the noun form for definite, an adjective. Basically they refer to the same thing.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.