Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [linear-algebra]

Linear algebra is concerned with vector spaces of all dimensions and linear transformations between them, including systems of linear equations, bases, dimensions, subspaces, matrices, determinants, traces, eigenvalues and eigenvectors, diagonalization, Jordan forms, etc. For questions specifically concerning matrices, use the (matrices) tag. For questions specifically concerning matrix equations, use the (matrix-equations) tag.

251
votes
25answers
53k views

If $AB = I$ then $BA = I$

If $A$ and $B$ are square matrices such that $AB = I$, where $I$ is the identity matrix, show that $BA = I$. I do not understand anything more than the following. Elementary row operations. Linear ...
36
votes
1answer
3k views

Determinant of a rank $1$ update of a scalar matrix, or characteristic polynomial of a rank $1$ matrix

This question aims to create an "abstract duplicate" of numerous questions that ask about determinants of specific matrices (I may have missed a few): Eigenvalues of a matrix of $1$'s ...
14
votes
3answers
1k views

reference for linear algebra books that teach reverse Hermite method for symmetric matrices

January 13, 2016: book that does this mentioned in a question today, Linear Algebra Done Wrong by Sergei Treil. He calls it non-orthogonal diagonalization of a quadratic form, calls his first method ...
171
votes
4answers
42k views

Norms Induced by Inner Products and the Parallelogram Law

Let $ V $ be a normed vector space (over $\mathbb{R}$, say, for simplicity) with norm $ \lVert\cdot\rVert$. It's not hard to show that if $\lVert \cdot \rVert = \sqrt{\langle \cdot, \cdot \rangle}$ ...
25
votes
9answers
3k views

Determinant of a specially structured matrix ($a$'s on the diagonal, all other entries equal to $b$)

I have the following $n\times n$ matrix: $$A=\begin{bmatrix} a & b & \ldots & b\\ b & a & \ldots & b\\ \vdots & \vdots & \ddots & \vdots\\ b & b & \ldots &...
573
votes
12answers
107k views

What's an intuitive way to think about the determinant?

In my linear algebra class, we just talked about determinants. So far I’ve been understanding the material okay, but now I’m very confused. I get that when the determinant is zero, the matrix doesn’t ...
34
votes
9answers
7k views

A linear operator commuting with all such operators is a scalar multiple of the identity.

The question is from Axler's "Linear Algebra Done Right", which I'm using for self-study. We are given a linear operator $T$ over a finite dimensional vector space $V$. We have to show that $T$ is a ...
68
votes
6answers
75k views

Union of two vector subspaces not a subspace?

I'm having a difficult time understanding this statement. Can someone please explain with a concrete example?
100
votes
9answers
171k views

Inverse of the sum of matrices

I have two square matrices - $A$ and $B$. $A^{-1}$ is known and I want to calculate $(A+B)^{-1}$. Are there theorems that help with calculating the inverse of the sum of matrices? In general case $B^{-...
44
votes
3answers
30k views

Prove rank $A^TA$ = rank $A$ for any $A_{m \times n}$

How can I prove rank $A^TA$ = rank $A$ for any $A_{m \times n}$? This is an exercise in my textbook associated with orthogonal projections and Gram–Schmidt process but I am unsure how they are ...
40
votes
8answers
15k views

How to prove and interpret $\operatorname{rank}(AB) \leq \operatorname{min}(\operatorname{rank}(A), \operatorname{rank}(B))$?

Let $A$ and $B$ be two matrices which can be multiplied. Then $$\operatorname{rank}(AB) \leq \operatorname{min}(\operatorname{rank}(A), \operatorname{rank}(B)).$$ I proved $\operatorname{rank}(AB) \...
35
votes
5answers
10k views

Given a matrix, is there always another matrix which commutes with it?

Given a matrix $A$ over a field $F$, does there always exist a matrix $B$ such that $AB = BA$? (except the trivial case and the polynomial ring?)
3
votes
1answer
4k views

Kernels and reduced row echelon form - explanation

The following text is written in my textbook and I don't really understand it: If $A = (a_{ij}) \in$ Mat$(m x N, F)$ is a matrix in reduced row echelon form with $r$ nonzero rows and pivots in the ...
50
votes
11answers
30k views

What is a good book to study linear algebra?

I'm looking for a book to learn Algebra. The programme is the following. The units marked with a $\star$ are the ones I'm most interested in (in the sense I know nothing about) and those with a $\circ$...
44
votes
5answers
5k views

Similar matrices and field extensions

Given a field $F$ and a subfield $K$ of $F$. Let $A$, $B$ be $n\times n$ matrices such that all the entries of $A$ and $B$ are in $K$. Is it true that if $A$ is similar to $B$ in $F^{n\times n}$ then ...
70
votes
1answer
44k views

Simultaneously Diagonalizable Proof

Two $n\times n$ matrices $A, B$ are said to be simultaneously diagonalizable if there is a nonsingular matrix $S$ such that both $S^{-1}AS$ and $S^{-1}BS$ are diagonal matrices. a.) Show that ...
34
votes
5answers
9k views

Do $ AB $ and $ BA $ have same minimal and characteristic polynomials?

Let $ A, B $ be two square matrices of order $n$. Do $ AB $ and $ BA $ have same minimal and characteristic polynomials? I have a proof only if $ A$ or $ B $ is invertible. Is it true for all cases?
48
votes
4answers
11k views

Matrix is conjugate to its own transpose

Mariano mentioned somewhere that everyone should prove once in their life that every matrix is conjugate to its transpose. I spent quite a bit of time on it now, and still could not prove it. At the ...
45
votes
9answers
79k views

How to show that $\det(AB) =\det(A)\det(B)$

Given two square matrices $A$ and $B$, how do you show that $\det(AB) = \det(A)\det(B)$, where $\det(\cdot)$ is the determinant of the matrix?
33
votes
3answers
45k views

Is the product of symmetric positive semidefinite matrices positive definite?

I see on Wikipedia that the product of two commuting symmetric positive definite matrices is also positive definite. Does the same result hold for the product of two positive semidefinite matrices? ...
15
votes
3answers
5k views

The Center of $\operatorname{GL}(n,k)$

The given question: Let $k$ be a field and $n \in \mathbb{N}$. Show that the centre of $\operatorname{GL}(n, k)$ is $\lbrace\lambda I\mid λ ∈ k^∗\rbrace$. I have spent a while trying to prove this ...
218
votes
10answers
142k views

What is the importance of eigenvalues/eigenvectors?

What is the importance of eigenvalues/eigenvectors?
122
votes
16answers
146k views

Where to start learning Linear Algebra? [closed]

I'm starting a very long quest to learn about math, so that I can program games. I'm mostly a corporate developer, and it's somewhat boring and non exciting. When I began my career, I chose it because ...
47
votes
6answers
27k views

Understanding of the theorem that all norms are equivalent in finite dimensional vector spaces

The following is a well-known result in functional analysis: If the vector space $X$ is finite dimensional, all norms are equivalent. Here is the standard proof in one textbook. First, pick a ...
113
votes
6answers
26k views

Is there a quick proof as to why the vector space of $\mathbb{R}$ over $\mathbb{Q}$ is infinite-dimensional?

It would seem that one way of proving this would be to show the existence of non-algebraic numbers. Is there a simpler way to show this?
91
votes
19answers
172k views

Calculate Rotation Matrix to align Vector A to Vector B in 3d?

I have one triangle in 3d space that I am tracking in a simulation. Between time steps I have the the previous normal of the triangle and the current normal of the triangle along with both the current ...
23
votes
3answers
6k views

Sylvester's determinant identity

Sylvester's determinant identity states that if $A$ and $B$ are matrices of sizes $m\times n$ and $n\times m$, then $$ \det(I_m+AB) = \det(I_n+BA)$$ where $I_m$ and $I_n$ denote the $m \times m$ ...
26
votes
2answers
11k views

Order of general- and special linear groups over finite fields.

Let $\mathbb{F}_3$ be the field with three elements. Let $n\geq 1$. How many elements do the following groups have? $\text{GL}_n(\mathbb{F}_3)$ $\text{SL}_n(\mathbb{F}_3)$ Here GL is the general ...
29
votes
3answers
11k views

When are minimal and characteristic polynomials the same?

Assume that we are working over a complex space $W$ of dimension $n$. When would an operator on this space have the same characteristic and minimal polynomial? I think the easy case is when the ...
12
votes
3answers
3k views

Proof of this result related to Fibonacci numbers: $\begin{pmatrix}1&1\\1&0\end{pmatrix}^n=\begin{pmatrix}F_{n+1}&F_n\\F_n&F_{n-1}\end{pmatrix}$?

$$\begin{pmatrix}1&1\\1&0\end{pmatrix}^n=\begin{pmatrix}F_{n+1}&F_n\\F_n&F_{n-1}\end{pmatrix}$$ Somebody has any idea how to go about proving this result? I know a proof by ...
130
votes
4answers
170k views

Eigenvectors of real symmetric matrices are orthogonal

Can someone point me to a paper, or show here, why symmetric matrices have orthogonal eigenvectors? In particular, I'd like to see proof that for a symmetric matrix $A$ there exists decomposition $A = ...
78
votes
7answers
97k views

Show that the determinant of $A$ is equal to the product of its eigenvalues

Show that the determinant of a matrix $A$ is equal to the product of its eigenvalues $\lambda_i$. So I'm having a tough time figuring this one out. I know that I have to work with the characteristic ...
15
votes
2answers
2k views

If a field $F$ is such that $\left|F\right|>n-1$ why is $V$ a vector space over $F$ not equal to the union of $n$ proper subspaces of $V$

If $U_1$, $U_2,\ldots,U_n$ are proper subspaces of a vector space $V$ over a field $F$, and $|F|\gt n-1$, why is $V$ not equal to the union of the subspaces $U_1$, $U_2,\ldots,U_n$?
17
votes
5answers
7k views

The characteristic and minimal polynomial of a companion matrix

The companion matrix of a monic polynomial in 1 variable over a field $F$ plays an important role in understanding the structure of finite dimensional $F[x]$-modules. It is an important fact that the ...
2
votes
4answers
1k views

Given a $4\times 4$ symmetric matrix, is there an efficient way to find its eigenvalues and diagonalize it?

I have a $4\times 4$ matrix $$A=\left(\begin{array}{cccc}8 & 11 & 4 & 3\\11 & 12 & 4 & 7\\4 & 4 & 7 & 12\\3 & 7 & 12 & 17\end{array}\right).$$ I want to ...
74
votes
9answers
113k views

When is matrix multiplication commutative?

I know that matrix multiplication in general is not commutative. So, in general: $A, B \in \mathbb{R}^{n \times n}: A \cdot B \neq B \cdot A$ But for some matrices, this equations holds, e.g. A = ...
15
votes
8answers
5k views

How to calculate the following determinants (all ones, minus $I$)

How do I calculate the determinant of the following $n\times n$ matrices $ \left[ \begin {matrix} 0 & 1 & \ldots & 1 \\ 1 & 0 & \ldots & 1 \\ \vdots & \vdots & \...
24
votes
5answers
40k views

How to prove $\text{Rank}(AB)\leq \min(\text{Rank}(A), \text{Rank}(B))$? [duplicate]

How to prove $\text{Rank}(AB)\leq \min(\text{Rank}(A), \text{Rank}(B))$?
8
votes
3answers
7k views

Finding Intersection of an ellipse with another ellipse when both are rotated

Equation of first ellipse=> $$\dfrac {((x-xFirstEllipseCenterPoint)\cdot \cos(A)+(y-yFirstEllipseCenterPoint)\cdot \sin(A))^2}{(a_1^2)}+\dfrac{((x-xFirstEllipseCenterPoint)\cdot \sin(A)-(y-...
84
votes
3answers
9k views

Why are vector spaces not isomorphic to their duals?

Assuming the axiom of choice, set $\mathbb F$ to be some field (we can assume it has characteristics $0$). I was told, by more than one person, that if $\kappa$ is an infinite cardinal then the ...
84
votes
14answers
26k views

Looking for an intuitive explanation why the row rank is equal to the column rank for a matrix

I am looking for an intuitive explanation as to why/how row rank of a matrix = column rank. I've read the proof at http://en.wikipedia.org/wiki/Rank_of_a_linear_transformation and I understand the ...
87
votes
6answers
94k views

Proof that the Trace of a Matrix is the sum of its Eigenvalues

I have looked extensively for a proof on the internet but all of them were too obscure. I would appreciate if someone could lay out a simple proof for this important result. Thank you.
36
votes
1answer
15k views

How to count number of bases and subspaces of a given dimension in a vector space over a finite field? [duplicate]

Let $V_{n}(F)$ be a vector space over the field $F=\mathbb Z_{p}$ with $\dim V_{n} = n$, i.e., the cardinality of $V_{n}(\mathbb Z_{p}) = p^{n}$. What is a general criterion to find the number of ...
44
votes
12answers
21k views

Very good linear algebra book.

I plan to self-study linear algebra this summer. I am sorta already familiar with vectors, vector spaces and subspaces and I am really interested in everything about matrices (diagonalization, ...), ...
19
votes
3answers
7k views

Diagonalizable transformation restricted to an invariant subspace is diagonalizable

Question: $V$ is a linear space over $\mathbb{C}$, $A$ is a linear transformation on $V$ which is diagonalizable (i.e. there is a basis of $V$ consists of eigenvectors of $A$). If $W\subseteq V$ is ...
20
votes
6answers
12k views

Determinant of a block lower triangular matrix

I'm trying to prove the following: Let $A$ be a $k\times k$ matrix, let $D$ have size $n\times n$, and $C$ have size $n\times k$. Then, $$\det\left(\begin{array}{cc} A&0\\ C&D \end{array}\...
20
votes
4answers
7k views

$I_m - AB$ is invertible if and only if $I_n - BA$ is invertible.

The problem is from Algebra by Artin, Chapter 1, Miscellaneous Problems, Exercise 8. I have been trying for a long time now to solve it but I am unsuccessful. Let $A,B$ be $m \times n$ and $n \...
13
votes
3answers
2k views

A vector space over $R$ is not a countable union of proper subspaces

I was looking for alternate proofs of the theorem that "a vector space $V$ of dimension greater than $1$ over an infinite field $\mathbf{F}$ is not a union of fewer than $|\mathbf{F}|$ proper ...
47
votes
3answers
29k views

Matrices commute if and only if they share a common basis of eigenvectors?

I've come across a paper that mentions the fact that matrices commute if and only if they share a common basis of eigenvectors. Where can I find a proof of this statement?
35
votes
2answers
13k views

Why is the ring of matrices over a field simple?

Denote by $M_{n \times n}(k)$ the ring of $n$ by $n$ matrices with coefficients in the field $k$. Then why does this ring not contain any two-sided ideal? Thanks for any clarification, and this is ...