Linked Questions
13 questions linked to/from Why is $A^TA$ invertible if $A$ has independent columns?
2
votes
1answer
666 views
Linearly Independent columns and invertibility of transpose [duplicate]
If a matrix $A$ has linearly independent columns, why is $A^TA$ invertible?
I think it has to do with $A^TA$ being square and that $A^TAx$=0 only has the trivial solution, but I don't really know ...
0
votes
2answers
125 views
Linear Algebra Problem - columns of $A$ are linearly independent $\Rightarrow$ $A^TA$ non-singular [duplicate]
I am trying to go in this direction only. Is this proof correct? ($A$ is an $m \times n$ matrix).
I am considering the contrapositive of the statement:
Suppose $A^TA$ is singular.
Then $\det (A^TA)...
25
votes
2answers
20k views
Proof of when is $A=X^TX$ invertible?
Say we have an $n\times m$ matrix $X$. What are the specific properties that $X$ must have so that $A=X^TX$ invertible?
I know that when the rows and columns are independent, then matrix $A$ (which ...
7
votes
4answers
7k views
If $A^TA$ is invertible, then $A$ has linearly independent column vectors
Question:
Prove that for a $m \times n$ matrix $A$, if $A^TA$ is invertible, then $A$ has linearly independent column vectors.
I am hitting a complete blank with this proof, I have the following ...
2
votes
1answer
338 views
Algebraic Rules for Matrix Equations
I am learning Linear Algebra through Professor Gilbert Strangs lectures on MIT OCW.
A concept I recently covered is finding the best solution to $ AX=b$ when $b$ does not lie in the column space of $...
1
vote
2answers
125 views
Invertibility of $(\textbf{A}^T\textbf{A}+\epsilon \textbf{I})$?
I'm given a problem:
$\sigma_1 \geq \sigma_2 \geq ... \geq \sigma_r$ are the nonzero singular values of $\textbf{A}\in\mathbb{R}^{M\times N}$. If $\epsilon \neq 0$ is a real scalar, s.t. $|\epsilon| &...
2
votes
1answer
143 views
Left inverse of a matrix with full rank
Consider the following matrix
$ A = \begin{bmatrix} 0 & 4 & 4 \\
1 & 1 & 1 \\
4 & 0 & 4 \\
4 & 4 & 0 \\
1 & 1 & 1
\end{bmatrix}$ over $\mathbb{F}_5^{5 \times ...
2
votes
1answer
103 views
$A\in \mathbb{R}^{m\times n}, m\ge n$ and $\operatorname{rank}(A) = n$. Prove that $A^tA$ is nonsingular
Let $A\in \mathbb{R}^{m\times n}, m\ge n$ and $\operatorname{rank}(A) = n$. Prove
that $A^tA$ is nonsingular
I found this answer https://math.stackexchange.com/a/1840814/166180
which gives some ...
1
vote
1answer
98 views
Proving change of basis matrix from $\mathcal B$ to $\mathcal B'$ is $\mathbf P$=$(\mathbf Y^T \mathbf Y)^{-1}\mathbf Y^T\mathbf X$
If $\mathcal B=${${x_1,x_2,...,x_n}$} and $\mathcal B'=${${y_1,y_2,...,y_n}$} are bases for an $n$-dimensional subspace of $\mathcal V \subset R^m$.
Say I let $X_{mxn}$ and $Y_{mxn}$ be the matrices ...
0
votes
1answer
54 views
Show that if $A \in \mathbb{C}^{m \times n}$ is of full rank, then null$(A^*)$ is the orthogonal complement of range$(A)$.
Show that if $A \in \mathbb{C}^{m \times n}$ is of full rank, then null$(A^*)$ is the orthogonal complement of range$(A)$.
I saw the above fact listed in this linked MSE proof.
My attempt to ...
2
votes
0answers
77 views
Show $X^TX$ is not invertible [duplicate]
Suppose that the first column of $X \in R^{N \times (p+1)}$ is full of $1$s.
Show that in the following cases, there exists no inverse matrices for $X^TX$.
(a). $N < p+1$
(b). $N \ge p+1$ and two ...
0
votes
1answer
48 views
Find rank of matrix [closed]
If $X$ is a $N \times D$ matrix with $(D\gg N)$ with $\operatorname{rank}(X) = N$, what is $\operatorname{rank}(X^T \cdot X)$ where $X^T$ is the transpose matrix of $X$?
I am little new to linear ...
0
votes
1answer
28 views
Why is $\sum_i^n \mathbf{x_i}\mathbf{x_i}'$ positive definite?
Let $\mathbf{x_i}=[ x_{i1}, x_{i2}, x_{i3} ]'$. Why can we say that $\sum_i^n \mathbf{x_i}\mathbf{x_i}'$ is positive definite?