Linear algebra is concerned with vector spaces of all dimensions and linear transformations between them. This includes: systems of linear equations, basis, dimension, subspaces, matrices, determinant, trace, eigenvalues and eigenvectors, diagonalization, Jordan form, etc. For questions specifically ...

learn more… | top users | synonyms

80
votes
17answers
16k views

If $AB = I$ then $BA = I$

If $A$ and $B$ are square matrices such that $AB = I$ where $I$ is identity matrix. Show that $BA = I$. I do not understand anything more than the following. Elementary row operations. Linear ...
225
votes
11answers
25k views

What's an intuitive way to think about the determinant?

In my linear algebra class, we just talked about determinants. So far I’ve been understanding the material okay, but now I’m very confused. I get that when the determinant is zero, the matrix doesn’t ...
42
votes
16answers
30k views

Where to start learning Linear Algebra?

I'm starting a very long quest to learn about math, so that I can program games. I'm mostly a corporate developer, and it's somewhat boring and non exciting. When I began my career, I chose it because ...
22
votes
5answers
7k views

What is a good book to study linear algebra?

I'm looking for a book to learn Algebra. The programme is the following. The units marked with a $\star$ are the ones I'm most interested in (in the sense I know nothing about) and those with a ...
27
votes
4answers
18k views

Union of two vector subspaces not a subspace?

I'm having a difficult time understanding this statement. Can someone please explain with a concrete example?
-1
votes
3answers
498 views

Solution of 3 equations in 3 unknowns [closed]

Find the value of $c$ which makes it possible to solve: $$u+v+2w=2,$$ $$2u+3v-w=5,$$ $$3u+4v+w=c$$
48
votes
4answers
6k views

Is there a quick proof as to why the vector space of $\mathbb{R}$ over $\mathbb{Q}$ is infinite-dimensional?

It would seem that one way of proving this would be to show the existence of non-algebraic numbers. Is there a simpler way to show this?
18
votes
5answers
4k views

Given a matrix, is there always another matrix which commutes with it?

Given a matrix $A$ over a field $F$, does there always exist a matrix $B$ such that $AB = BA$? (except the trivial case and the polynomial ring?)
13
votes
8answers
4k views

How to prove and interpret $\operatorname{rank}(AB) \leq \operatorname{min}(\operatorname{rank}(A), \operatorname{rank}(B))$?

Let A and B be two matrices which can be multiplied. Then $\operatorname{rank}(AB) \leq \operatorname{min}(\operatorname{rank}(A), \operatorname{rank}(B))$ I proved $\operatorname{rank}(AB) \leq ...
10
votes
3answers
1k views

A vector space over $R$ is not a countable union of proper subspaces

I was looking for alternate proofs of the theorem that "a vector space $V$ of dimension greater than $1$ over an infinite field is not a union of fewer than $|\mathbf{F}|$ proper subspaces" and ...
14
votes
6answers
1k views

How to solve this recurrence relation? $f_n = 3f_{n-1} + 12(-1)^n$

How to solve this particular recurrence relation ? $$f_n = 3f_{n-1} + 12(-1)^n,\quad f_1 = 0$$ such that $f_2 = 12, f_3 = 24$ and so on. I tried out a lot but due to $(-1)^n$ I am not able to ...
5
votes
8answers
1k views

How to calculate the following determinants (all ones, minus $I$)

How do I calculate the determinant of the following $n\times n$ matrices $ \left[ \begin {matrix} 0 & 1 & \ldots & 1 \\ 1 & 0 & \ldots & 1 \\ \vdots & \vdots & ...
8
votes
7answers
673 views

Determinant of a specially structured matrix

I have the following $n\times n$ matrix: $$A=\begin{bmatrix}a&b&\cdots&b\\b&a&\cdots&b\\\vdots& &\ddots&\vdots\\b&\cdots&b&a\end{bmatrix}$$ where $0 ...
42
votes
2answers
2k views

Axiom of choice and automorphisms of vector spaces

A classical exercise in group theory is "Show that if a group has a trivial automorphism group, then it is of order 1 or 2." I think that the straightforward solution uses that a exponent two group is ...
66
votes
6answers
32k views

What is the importance of eigenvalues/eigenvectors?

What is the importance of eigenvalues/eigenvectors?
11
votes
3answers
2k views

When are minimal and characteristic polynomials the same?

Assume that we are working over a complex space $W$ of dimension $n$. When would an operator on this space have the same characteristic and minimal polynomial? I think the easy case is when the ...
113
votes
2answers
45k views

What is the intuitive relationship between SVD and PCA

Singular value decomposition (SVD) and principal component analysis (PCA) are two eigenvalue methods used to reduce a high-dimensional dataset into fewer dimensions while retaining important ...
21
votes
9answers
15k views

How to show that $\det(AB) =\det(A)\det(B)$

Given two square matrices $A$ and $B$, how do you show that $\det(AB) = \det(A)\det(B)$, where $\det(\cdot)$ is the determinant of the matrix?
18
votes
2answers
10k views

matrices commute=common basis of eigenvectors?

I've come across a paper that mentions this as a fact...where can I find the proof?
9
votes
2answers
1k views

Does the set of matrix commutators form a subspace?

The following is an interesting problem from Linear Algebra 2nd Ed - Hoffman & Kunze (3.5 Q17). Let $W$ be the subspace spanned by the commutators of $M_{n\times n}\left(F\right)$: $$C=\left[A, ...
4
votes
2answers
452 views

If a field $F$ is such that $\left|F\right|>n-1$ why is $V$ a vector space over $F$ not equal to the union of proper subspaces of $V$

If $U_1$, $U_2,\ldots,U_n$ are proper subspaces of a vector space $V$ over a field $F$, and $|F|\gt n-1$, why is $V$ not equal to the union of the subspaces $U_1$, $U_2,\ldots,U_n$?
15
votes
4answers
636 views

Relation of this antisymmetric matrix $r = \left(\begin{smallmatrix}0 &1\\-1&0\end{smallmatrix}\right)$ to $i$

I was reviewing some matrices and found this interesting if $r = \begin{pmatrix} 0&1\\ -1&0 \end{pmatrix}$ then $rr=-I$, also $$\exp{(\theta r)} = \cos\theta I + \sin\theta r$$ No wonder, the ...
10
votes
4answers
5k views

Prove that $A+I$ is invertible if $A$ is nilpotent [duplicate]

Possible Duplicate: Units and Nilpotents Given $A^{2012}=0$ prove that $A+I$ is invertible and find an expression for $(A+I)^{-1}$ in terms of $A$. ($I$ is the identity matrix).
10
votes
5answers
4k views

How to prove $\text{Rank}(AB)\leq \min(\text{Rank}(A), \text{Rank}(B))$? [duplicate]

How to prove $\text{Rank}(AB)\leq \min(\text{Rank}(A), \text{Rank}(B))$?
41
votes
4answers
3k views

Why are vector spaces not isomorphic to their duals?

Assuming the axiom of choice, set $\mathbb F$ to be some field (we can assume it has characteristics $0$). I was told, by more than one person, that if $\kappa$ is an infinite cardinal then the ...
26
votes
4answers
15k views

How do I tell if matrices are similar?

I have two $2\times 2$ matrices, $A$ and $B$, with the same determinant. I want to know if they are similar or not. I solved this by using a matrix called $S$: $$\left(\begin{array}{cc} a& b\\ ...
3
votes
2answers
7k views

Simultaneous diagonalization

Let $V$ be a vector space from a finite dimension and let $T,S$ linear diagonalizable transformations from $V$ to itself. I need to prove that: a. If $TS=ST$ so every eigenspace $V_\lambda$ of $S$ ...
7
votes
3answers
2k views

Sylvester's determinant identity

Sylvester's determinant identity states that if $A$ and $B$ are matrices of sizes $m\times n$ and $n\times m$, then $$ det(I+AB)=det(I+BA), $$ where in the first case $I$ denotes the $m\times m$ ...
7
votes
2answers
749 views

The Center of $\operatorname{GL}(n,k)$

The given question: Let $k$ be a field and $n \in \mathbb{N}$. Show that the centre of $\operatorname{GL}(n, k)$ is $\lbrace\lambda I\mid λ ∈ k^∗\rbrace$. I have spent a while trying to prove this ...
20
votes
2answers
4k views

Why is the ring of matrices over a field simple?

Denote by $M_{n \times n}(k)$ the ring of $n$ by $n$ matrices with coefficients in the field $k$. Then why does this ring not contain any two-sided ideal? Thanks for any clarification, and this is ...
11
votes
1answer
8k views

Simultaneously Diagonalizable Proof

Two $n$ x $n$ matrices $A, B$ are said to be simultaneously diagonalizable if there is a nonsingular matrix $S$ such that both $S^{-1}AS$ and $S^{-1}BS$ are diagonal matrices. a.) Show ...
14
votes
2answers
4k views

Matrix is conjugate to its own transpose

Mariano mentioned somewhere that everyone should prove once in their life that every matrix is conjugate to its transpose. I spent quite a bit of time on it now, and still could not prove it. At the ...
11
votes
7answers
1k views

A linear operator commuting with all such operators is a scalar multiple of the identity.

The question is from Axler's "Linear Algebra Done Right", which I'm using for self-study. We are given a linear operator $T$ over a finite dimensional vector space $V$. We have to show that $T$ is a ...
5
votes
3answers
12k views

Product of symmetric positive semidefinite matrices is positive definite?

I see on wikipedia that the product of two symmetric positive definite matrices is also positive definite. Does the same result hold for the product of two positive semidefinite matrices? My proof of ...
7
votes
4answers
14k views

Similar matrices have the same eigenvalues with the same geometric multiplicity

Suppose $A$ and $B$ are similar matrices. Show that $A$ and $B$ have the same eigenvalues with the same geometric multiplicities. Similar matrices: Suppose $A$ and $B$ are $n\times n$ matrices ...
4
votes
4answers
2k views

The characteristic and minimal polynomial of a companion matrix

The companion matrix of a monic polynomial in 1 variable over a field $F$ plays an important role in understanding the structure of finite dimensional $F[x]$-modules. It is an important fact that the ...
30
votes
7answers
43k views

Inverse of the sum of matrices

I have two square matrices - $A$ and $B$. $A^{-1}$ is known and I want to calculate $(A+B)^{-1}$. Are there theorems that help with calculating the inverse of the sum of matrices? In general case ...
32
votes
4answers
2k views

Solutions to the matrix equation $\mathbf{AB-BA=I}$ over general fields

Some days ago, I was thinking on a problem, which states that $AB-BA=I$ does not have a solution in $M_{n\times n}(\mathbb R)$ and $M_{n\times n}(\mathbb C)$. (Here $M_{n\times n}(\mathbb F)$ denotes ...
19
votes
2answers
7k views

Motivation behind Definition of Matrix Multiplication

I have just watched the first half of the 3rd lecture of Gilbert Strang on the open course ware with link: http://ocw.mit.edu/courses/mathematics/18-06-linear-algebra-spring-2010/video-lectures/ It ...
37
votes
4answers
2k views

linear algebra over a division ring vs. over a field

When I was studying linear algebra in the first year, from what I remember, vector spaces were always defined over a field, which was in every single concrete example equal to either $\mathbb{R}$ or ...
11
votes
4answers
28k views

Eigenvectors of real symmetric matrices are orthogonal

Can someone point me to a paper, or show here, why symmetric matrices have orthogonal eigenvectors? In particular, I'd like to see proof that for a symmetric matrix $A$ there exists decomposition $A = ...
6
votes
2answers
1k views

How to show if $ \lambda$ is an eigenvalue of $AB^{-1}$, then $ \lambda$ is an eigenvalue of $ B^{-1}A$?

Statement: If $ \lambda$ is an eigenvalue of $AB^{-1}$, then $ \lambda$ is an eigenvalue of $ B^{-1}A$ and vice versa. One way of the proof. We have $B(B^{-1}A ) B^{-1} = AB^{-1}. $ Assuming $ ...
18
votes
5answers
2k views

Similar matrices and field extensions

Given a field $F$ and a subfield $K$ of $F$. Let $A$, $B$ be $n\times n$ matrices such that all the entries of $A$ and $B$ are in $K$. Is it true that if $A$ is similar to $B$ in $F^{n\times n}$ ...
11
votes
1answer
2k views

Probability that a random binary matrix is invertible?

What is the probability that a random $\{0,1\}$, $n \times n$ matrix is invertible? Assume the 0 and 1 are each present in an entry with probability $\frac{1}{2}$. Is there an explicit formula as a ...
13
votes
3answers
581 views

For every matrix $A\in M_{2}( \mathbb{C}) $ there's $X\in M_{2}( \mathbb{C})$ such that $X^2=A$?

True\False? For every matrix $A\in M_{2}( \mathbb{C}) $ there's $X\in M_{2}( \mathbb{C})$ such that $X^2=A$. I know that every complexed matrix has a Jordan form matrix $J$ such that $P^{-1}CP=J$, ...
2
votes
2answers
244 views

Determining eigenvalues, eigenvectors of $A\in \mathbb{R}^{n\times n}(n\geq 2)$.

Let $a$ and $b$ be distinct nonzero real numbers and let $A\in \mathbb{R}^{n\times n}(n\geq 2)$ with each diagonal entry equal to $a$ and each off-diagonal entry equal to $b$. Determine all ...
1
vote
1answer
173 views

differential equations, diagonalizable matrix

I have a question of differential equations of the form. $\textbf{x}'(t)=A*\textbf{x(t)}$, where x is an n-dimensional matrix, and A is an n*n real matrix. I have learned to solve this if a is ...
33
votes
2answers
17k views

Why is the eigenvector of a covariance matrix equal to a principal component?

If I have a covariance matrix for a data set and I multiply it times one of it's eigenvectors. Let's say the eigenvector with the highest eigenvalue. The result is the eigenvector or a scaled ...
22
votes
7answers
7k views

Why determinant of a 2 by 2 matrix is the area of a parallelogram?

Let $A=\begin{bmatrix}a & b\\ c & d\end{bmatrix}$ be a two by two matrix where the first row of $A$ is $a, b$ and the second row of $A$ is $c, d$. How could we show that $ad-bc$ is the area of ...
19
votes
2answers
2k views

necessary and sufficient condition for trivial kernel of a matrix over a commutative ring

In answering Do these matrix rings have non-zero elements that are neither units nor zero divisors? I was surprised how hard it was to find anything on the Web about the generalization of the ...