Linear algebra is concerned with vector spaces of all dimensions and linear transformations between them, including systems of linear equations, bases, dimensions, subspaces, matrices, determinants, traces, eigenvalues and eigenvectors, diagonalization, Jordan forms, etc. For questions specifically ...

learn more… | top users | synonyms (1)

130
votes
21answers
26k views

If $AB = I$ then $BA = I$

If $A$ and $B$ are square matrices such that $AB = I$ where $I$ is identity matrix. Show that $BA = I$. I do not understand anything more than the following. Elementary row operations. Linear ...
101
votes
4answers
22k views

Norms Induced by Inner Products and the Parallelogram Law

Let $ V $ be a normed vector space (over $\mathbb{R}$, say, for simplicity) with norm $ \lVert\cdot\rVert$. It's not hard to show that if $\lVert \cdot \rVert = \sqrt{\langle \cdot, \cdot \rangle}$ ...
366
votes
10answers
59k views

What's an intuitive way to think about the determinant?

In my linear algebra class, we just talked about determinants. So far I’ve been understanding the material okay, but now I’m very confused. I get that when the determinant is zero, the matrix doesn’t ...
15
votes
9answers
2k views

A linear operator commuting with all such operators is a scalar multiple of the identity.

The question is from Axler's "Linear Algebra Done Right", which I'm using for self-study. We are given a linear operator $T$ over a finite dimensional vector space $V$. We have to show that $T$ is a ...
39
votes
4answers
36k views

Union of two vector subspaces not a subspace?

I'm having a difficult time understanding this statement. Can someone please explain with a concrete example?
15
votes
7answers
1k views

Determinant of a specially structured matrix ($a$'s on the diagonal, all other entries equal to $b$)

I have the following $n\times n$ matrix: $$A=\begin{bmatrix} a & b & \ldots & b\\ b & a & \ldots & b\\ \vdots & \vdots & \ddots & \vdots\\ b & b & \ldots &...
28
votes
5answers
3k views

Similar matrices and field extensions

Given a field $F$ and a subfield $K$ of $F$. Let $A$, $B$ be $n\times n$ matrices such that all the entries of $A$ and $B$ are in $K$. Is it true that if $A$ is similar to $B$ in $F^{n\times n}$ then ...
23
votes
5answers
6k views

Given a matrix, is there always another matrix which commutes with it?

Given a matrix $A$ over a field $F$, does there always exist a matrix $B$ such that $AB = BA$? (except the trivial case and the polynomial ring?)
15
votes
1answer
687 views

Determinant of a rank $1$ update of a scalar matrix, or characteristic polynomial of a rank $1$ matrix

This question aims to create an "abstract duplicate" of numerous questions that ask about determinants of specific matrices (I may have missed a few): Eigenvalues of a matrix of $1$'s ...
72
votes
4answers
12k views

Is there a quick proof as to why the vector space of $\mathbb{R}$ over $\mathbb{Q}$ is infinite-dimensional?

It would seem that one way of proving this would be to show the existence of non-algebraic numbers. Is there a simpler way to show this?
19
votes
7answers
7k views

How to prove and interpret $\operatorname{rank}(AB) \leq \operatorname{min}(\operatorname{rank}(A), \operatorname{rank}(B))$?

Let $A$ and $B$ be two matrices which can be multiplied. Then $$\operatorname{rank}(AB) \leq \operatorname{min}(\operatorname{rank}(A), \operatorname{rank}(B)).$$ I proved $\operatorname{rank}(AB) \...
9
votes
3answers
2k views

The Center of $\operatorname{GL}(n,k)$

The given question: Let $k$ be a field and $n \in \mathbb{N}$. Show that the centre of $\operatorname{GL}(n, k)$ is $\lbrace\lambda I\mid λ ∈ k^∗\rbrace$. I have spent a while trying to prove this ...
36
votes
7answers
19k views

What is a good book to study linear algebra?

I'm looking for a book to learn Algebra. The programme is the following. The units marked with a $\star$ are the ones I'm most interested in (in the sense I know nothing about) and those with a $\circ$...
7
votes
3answers
8k views

Prove rank $A^TA$ = rank $A$ for any $A_{m \times n}$

How can I prove rank $A^TA$ = rank $A$ for any $A_{m \times n}$? This is an exercise in my textbook associated with orthogonal projections and Gram–Schmidt process but I am unsure how they are ...
74
votes
17answers
72k views

Where to start learning Linear Algebra? [closed]

I'm starting a very long quest to learn about math, so that I can program games. I'm mostly a corporate developer, and it's somewhat boring and non exciting. When I began my career, I chose it because ...
6
votes
3answers
237 views

reference for linear algebra books that teach reverse Hermite method for symmetric matrices

January 13, 2016: book that does this mentioned in a question today, Linear Algebra Done Wrong by Sergei Treil. He calls it non-orthogonal diagonalization of a quadratic form, calls his first method ...
28
votes
3answers
7k views

Matrix is conjugate to its own transpose

Mariano mentioned somewhere that everyone should prove once in their life that every matrix is conjugate to its transpose. I spent quite a bit of time on it now, and still could not prove it. At the ...
123
votes
8answers
76k views

What is the importance of eigenvalues/eigenvectors?

What is the importance of eigenvalues/eigenvectors?
27
votes
1answer
20k views

Simultaneously Diagonalizable Proof

Two $n\times n$ matrices $A, B$ are said to be simultaneously diagonalizable if there is a nonsingular matrix $S$ such that both $S^{-1}AS$ and $S^{-1}BS$ are diagonal matrices. a.) Show that ...
10
votes
3answers
2k views

A vector space over $R$ is not a countable union of proper subspaces

I was looking for alternate proofs of the theorem that "a vector space $V$ of dimension greater than $1$ over an infinite field $\mathbf{F}$ is not a union of fewer than $|\mathbf{F}|$ proper ...
58
votes
9answers
85k views

Inverse of the sum of matrices

I have two square matrices - $A$ and $B$. $A^{-1}$ is known and I want to calculate $(A+B)^{-1}$. Are there theorems that help with calculating the inverse of the sum of matrices? In general case $B^{-...
0
votes
4answers
548 views

Given a $4\times 4$ symmetric matrix, is there an efficient way to find its eigenvalues and diagonalize it?

I have a $4\times 4$ matrix $$A=\left(\begin{array}{cccc}8 & 11 & 4 & 3\\11 & 12 & 4 & 7\\4 & 4 & 7 & 12\\3 & 7 & 12 & 17\end{array}\right).$$ I want to ...
57
votes
3answers
5k views

Why are vector spaces not isomorphic to their duals?

Assuming the axiom of choice, set $\mathbb F$ to be some field (we can assume it has characteristics $0$). I was told, by more than one person, that if $\kappa$ is an infinite cardinal then the ...
16
votes
3answers
4k views

When are minimal and characteristic polynomials the same?

Assume that we are working over a complex space $W$ of dimension $n$. When would an operator on this space have the same characteristic and minimal polynomial? I think the easy case is when the ...
11
votes
5answers
3k views

The characteristic and minimal polynomial of a companion matrix

The companion matrix of a monic polynomial in 1 variable over a field $F$ plays an important role in understanding the structure of finite dimensional $F[x]$-modules. It is an important fact that the ...
8
votes
3answers
3k views

Sylvester's determinant identity

Sylvester's determinant identity states that if $A$ and $B$ are matrices of sizes $m\times n$ and $n\times m$, then $$ \det(I+AB) = \det(I+BA), $$ where in the first case $I$ denotes the $m\times m$ ...
31
votes
9answers
31k views

How to show that $\det(AB) =\det(A)\det(B)$

Given two square matrices $A$ and $B$, how do you show that $\det(AB) = \det(A)\det(B)$, where $\det(\cdot)$ is the determinant of the matrix?
26
votes
2answers
7k views

Why is the ring of matrices over a field simple?

Denote by $M_{n \times n}(k)$ the ring of $n$ by $n$ matrices with coefficients in the field $k$. Then why does this ring not contain any two-sided ideal? Thanks for any clarification, and this is ...
7
votes
2answers
631 views

If a field $F$ is such that $\left|F\right|>n-1$ why is $V$ a vector space over $F$ not equal to the union of proper subspaces of $V$

If $U_1$, $U_2,\ldots,U_n$ are proper subspaces of a vector space $V$ over a field $F$, and $|F|\gt n-1$, why is $V$ not equal to the union of the subspaces $U_1$, $U_2,\ldots,U_n$?
9
votes
3answers
1k views

Proof of this result related to Fibonacci numbers: $\begin{pmatrix}1&1\\1&0\end{pmatrix}^n=\begin{pmatrix}F_{n+1}&F_n\\F_n&F_{n-1}\end{pmatrix}$?

$$\begin{pmatrix}1&1\\1&0\end{pmatrix}^n=\begin{pmatrix}F_{n+1}&F_n\\F_n&F_{n-1}\end{pmatrix}$$ Somebody has any idea how to go about proving this result? I know a proof by ...
46
votes
2answers
2k views

Axiom of choice and automorphisms of vector spaces

A classical exercise in group theory is "Show that if a group has a trivial automorphism group, then it is of order 1 or 2." I think that the straightforward solution uses that a exponent two group is ...
13
votes
3answers
22k views

Product of symmetric positive semidefinite matrices is positive definite?

I see on wikipedia that the product of two symmetric positive definite matrices is also positive definite (Edit: the matrices must commute or else this is false; I leave the false statement here so ...
11
votes
8answers
2k views

How to calculate the following determinants (all ones, minus $I$)

How do I calculate the determinant of the following $n\times n$ matrices $ \left[ \begin {matrix} 0 & 1 & \ldots & 1 \\ 1 & 0 & \ldots & 1 \\ \vdots & \vdots & \...
14
votes
6answers
2k views

How to solve this recurrence relation? $f_n = 3f_{n-1} + 12(-1)^n$

How to solve this particular recurrence relation ? $$f_n = 3f_{n-1} + 12(-1)^n,\quad f_1 = 0$$ such that $f_2 = 12, f_3 = 24$ and so on. I tried out a lot but due to $(-1)^n$ I am not able to ...
6
votes
3answers
3k views

I don't understand why the inverse is this?

my question is related to matrix inverting and Hill cipher(you don't have to know what it is to help me) My teacher gave me an example. First we have a matrix (the key matrix) that multiplied by a ...
49
votes
3answers
35k views

Why is the eigenvector of a covariance matrix equal to a principal component?

If I have a covariance matrix for a data set and I multiply it times one of it's eigenvectors. Let's say the eigenvector with the highest eigenvalue. The result is the eigenvector or a scaled ...
26
votes
3answers
16k views

matrices commute=common basis of eigenvectors?

I've come across a paper that mentions this as a fact...where can I find the proof?
15
votes
3answers
2k views

Traces of all positive powers of a matrix are zero implies it is nilpotent

Let $A$ be an $n\times n$ complex nilpotent matrix. Then we know that because all eigenvalues of $A$ must be $0$, it follows that $\text{tr}(A^n)=0$ for all positive integers $n$. What I would like ...
24
votes
4answers
4k views

Do $ AB $ and $ BA $ have same minimal and characteristic polynomials?

Let $ A, B $ be two square matrices of order $n$. Do $ AB $ and $ BA $ have same minimal and characteristic polynomials? I have a proof only if $ A$ or $ B $ is invertible. Is it true for all cases?
14
votes
5answers
7k views

Determinant of a block lower triangular matrix

I'm trying to prove the following: Let $A$ be a $k\times k$ matrix, let $D$ have size $n\times n$, and $C$ have size $n\times k$. Then, $$\det\left(\begin{array}{cc} A&0\\ C&D \end{array}\...
10
votes
2answers
2k views

Does the set of matrix commutators form a subspace?

The following is an interesting problem from Linear Algebra 2nd Ed - Hoffman & Kunze (3.5 Q17). Let $W$ be the subspace spanned by the commutators of $M_{n\times n}\left(F\right)$: $$C=\left[A, ...
15
votes
5answers
13k views

How to prove $\text{Rank}(AB)\leq \min(\text{Rank}(A), \text{Rank}(B))$? [duplicate]

How to prove $\text{Rank}(AB)\leq \min(\text{Rank}(A), \text{Rank}(B))$?
22
votes
4answers
12k views

Understanding of the theorem that all norms are equivalent in finite dimensional vector space

(Edit: Replaced $||\cdot||_0$ with $||\cdot||_1$ to clarify.) The following is a well-known result in functional analysis: If the vector space $X$ is finite dimensional, all norms are equivalent. ...
8
votes
2answers
14k views

Simultaneous diagonalization

Let $V$ be a vector space of finite dimension and let $T,S$ linear diagonalizable transformations from $V$ to itself. I need to prove that if $TS=ST$ every eigenspace $V_\lambda$ of $S$ is $T$-...
1
vote
1answer
1k views

Bilinear Form Diagonalisation

We have the following symmetric bilinear form on $\\Q^4$ (vector space over rational numbers) with respect to standard basis $\{e_1,e_2,e_3,e_4\}$ $$g(v,w)=v^tAw$$ $$A=\begin{bmatrix}1 & 2 &3&...
2
votes
2answers
172 views

Find the transitional matrix that would transform this form to a diagonal form.

Let the quadratic form $F(x,y,z)$ be given as below $F(x,y,z)=2x^2+3y^2+5z^2-xy-xz-yz$ Find the transitional matrix that would transform this form to a diagonal form. I got the symmetric ...
38
votes
4answers
4k views

Solutions to the matrix equation $\mathbf{AB-BA=I}$ over general fields

Some days ago, I was thinking on a problem, which states that $AB-BA=I$ does not have a solution in $M_{n\times n}(\mathbb R)$ and $M_{n\times n}(\mathbb C)$. (Here $M_{n\times n}(\mathbb F)$ denotes ...
36
votes
5answers
30k views

How do I tell if matrices are similar?

I have two $2\times 2$ matrices, $A$ and $B$, with the same determinant. I want to know if they are similar or not. I solved this by using a matrix called $S$: $$\left(\begin{array}{cc} a& b\\ ...
25
votes
3answers
35k views

A matrix and its transpose have the same set of eigenvalues

Let $ \sigma(A)$ be the set of all eigenvalues of $A$. Show that $ \sigma(A) = \sigma(A^T)$ where $A^T$ is the transposed matrix of $A$.
6
votes
2answers
2k views

How to show if $ \lambda$ is an eigenvalue of $AB^{-1}$, then $ \lambda$ is an eigenvalue of $ B^{-1}A$?

Statement: If $ \lambda$ is an eigenvalue of $AB^{-1}$, then $ \lambda$ is an eigenvalue of $ B^{-1}A$ and vice versa. One way of the proof. We have $B(B^{-1}A ) B^{-1} = AB^{-1}. $ Assuming $ \...