Questions tagged [vector-spaces]

For questions about vector spaces and their properties. More general questions about linear algebra belong under the [linear-algebra] tag. A vector space is a space which consists of elements called "vectors", which can be added and multiplied by scalars

Filter by
Sorted by
Tagged with
191 votes
21 answers

Calculate Rotation Matrix to align Vector $A$ to Vector $B$ in $3D$?

I have one triangle in $3D$ space that I am tracking in a simulation. Between time steps I have the previous normal of the triangle and the current normal of the triangle along with both the current ...
user1084113's user avatar
  • 2,089
175 votes
7 answers

Is there a quick proof as to why the vector space of $\mathbb{R}$ over $\mathbb{Q}$ is infinite-dimensional?

It would seem that one way of proving this would be to show the existence of non-algebraic numbers. Is there a simpler way to show this?
Elchanan Solomon's user avatar
145 votes
11 answers

Physical meaning of the null space of a matrix

What is an intuitive meaning of the null space of a matrix? Why is it useful? I'm not looking for textbook definitions. My textbook gives me the definition, but I just don't "get" it. E.g.: I think ...
user541686's user avatar
  • 13.7k
113 votes
3 answers

Why are infinitely dimensional vector spaces not isomorphic to their duals?

Assuming the axiom of choice, set $\mathbb F$ to be some field (we can assume it has characteristics $0$). I was told, by more than one person, that if $\kappa$ is an infinite cardinal then the ...
Asaf Karagila's user avatar
  • 393k
112 votes
7 answers

Is the vector cross product only defined for 3D?

Wikipedia introduces the vector product for two vectors $\vec a$ and $\vec b$ as $$ \vec a \times\vec b=(\| \vec a\| \|\vec b\|\sin\Theta)\vec n $$ It then mentions that $\vec n$ is the vector normal ...
VF1's user avatar
  • 1,983
109 votes
7 answers

Geometric interpretation of $\det(A^T) = \det(A)$

$$\det(A^T) = \det(A)$$ Using the geometric definition of the determinant as the area spanned by the columns, could someone give a geometric interpretation of the property?
dfg's user avatar
  • 3,851
101 votes
1 answer

In categorical terms, why is there no canonical isomorphism from a finite dimensional vector space to its dual?

I've read in several places that one motivation for category theory was to be able to give precise meaning to statements like, "finite dimensional vector spaces are canonically isomorphic to their ...
Ben Blum-Smith's user avatar
90 votes
2 answers

Difference between metric and norm made concrete: The case of Euclid

This is a follow-up question on this one. The answers to my questions made things a lot clearer to me (Thank you for that!), yet there is some point that still bothers me. This time I am making ...
vonjd's user avatar
  • 8,780
86 votes
9 answers

In Linear Algebra, what is a vector?

I understand that a vector space is a collection of vectors that can be added and scalar multiplied and satisfies the 8 axioms, however, I do not know what a vector is. I know in physics a vector is ...
Paul Lee's user avatar
  • 1,015
84 votes
19 answers

How to find perpendicular vector to another vector?

How do I find a vector perpendicular to a vector like this: $$3\mathbf{i}+4\mathbf{j}-2\mathbf{k}?$$ Could anyone explain this to me, please? I have a solution to this when I have $3\mathbf{i}+4\...
niko's user avatar
  • 959
80 votes
3 answers

Connections between metrics, norms and scalar products (for understanding e.g. Banach and Hilbert spaces)

I am trying to understand the differences between $$ \begin{array}{|l|l|l|} \textbf{vector space} & \textbf{general} & \textbf{+ completeness}\\\hline \text{metric}& \text{metric space} &...
vonjd's user avatar
  • 8,780
74 votes
7 answers

What is the main difference between a vector space and a field?

In my opinion both are almost same. However there should be some differenes like any two elements can be multiplied in a field but it is not allowed in vector space as only scalar multiplication is ...
Vineel Kumar Veludandi's user avatar
73 votes
1 answer

What is the logic/rationale behind the vector cross product?

I don't think I ever understood the rationale behind this. I get that the dot product $\mathbf{a} \cdot \mathbf{b} =\lVert \mathbf{a}\rVert \cdot\lVert \mathbf{b}\rVert \cos\theta$ is derived from ...
Danxe's user avatar
  • 1,685
71 votes
14 answers

What isn't a vector space?

I'm really confused about vector spaces. We're learning about them in Linear Algebra, and my book doesn't give good examples of what a vector space is. I understand sets and vectors, but I don't ...
Aleksandr Hovhannisyan's user avatar
71 votes
15 answers

Dot Product Intuition

I'm searching to develop the intuition (rather than memorization) in relating the two forms of a dot product (by an angle theta between the vectors and by the components of the vector ). For ...
nerdy's user avatar
  • 3,268
64 votes
4 answers

How to tell if a set of vectors spans a space?

I want to know if the set $\{(1, 1, 1), (3, 2, 1), (1, 1, 0), (1, 0, 0)\}$ spans $\mathbb{R}^3$. I know that if it spans $\mathbb{R}^3$, then for any $x, y, z, \in \mathbb{R}$, there exist $c_1, c_2, ...
Javier's user avatar
  • 7,288
62 votes
10 answers

A linear operator commuting with all such operators is a scalar multiple of the identity.

The question is from Axler's "Linear Algebra Done Right", which I'm using for self-study. We are given a linear operator $T$ over a finite dimensional vector space $V$. We have to show that $T$ is a ...
abeln's user avatar
  • 555
62 votes
1 answer

Effect of elementary row operations on determinant?

1) Switching two rows or columns causes the determinant to switch sign 2) Adding a multiple of one row to another causes the determinant to remain the same 3) Multiplying a row as a constant results ...
dfg's user avatar
  • 3,851
61 votes
6 answers

What are some examples of infinite dimensional vector spaces?

I would like to have some examples of infinite dimensional vector spaces that help me to break my habit of thinking of $\mathbb{R}^n$ when thinking about vector spaces.
emDiaz's user avatar
  • 773
61 votes
7 answers

How to find a basis for the intersection of two vector spaces in $\mathbb{R}^n$?

What is the general way of finding the basis for intersection of two vector spaces in $\mathbb{R}^n$? Suppose I'm given the bases of two vector spaces U and W: $$ \mathrm{Base}(U)= \left\{ \left(1,1,...
Cu7l4ss's user avatar
  • 963
58 votes
9 answers

If the field of a vector space weren't characteristic zero, then what would change in the theory?

In the book of Linear Algebra by Werner Greub, whenever we choose a field for our vector spaces, we always choose an arbitrary field $F$ of characteristic zero, but to understand the importance of the ...
Our's user avatar
  • 7,285
57 votes
3 answers

Is there a vector space that cannot be an inner product space?

Quick question: Can I define some inner product on any arbitrary vector space such that it becomes an inner product space? If yes, how can I prove this? If no, what would be a counter example? Thanks ...
Huy's user avatar
  • 6,644
55 votes
2 answers

How to show that quotient space $X/Y$ is complete when $X$ is Banach space, and $Y$ is a closed subspace of $X$?

How to show that quotient space $X/Y$ is complete when $X$ is Banach space, and $Y$ is a closed subspace of $X$? Here's my attempt: Given a Cauchy sequence $\{q_n\}_{n \in \mathbb{N}}$ in $X/Y$, each ...
Metta World Peace's user avatar
54 votes
3 answers

Every proper subspace of a normed vector space has empty interior

There is a conjecture: "The only subspace of a normed vector space $V$ that has a non-empty interior, is $V$ itself." (here, the topology is the obvious set of all open sets generated by the metric $||...
Somabha Mukherjee's user avatar
53 votes
2 answers

What kind of matrices are non-diagonalizable?

I'm trying to build an intuitive geometric picture about diagonalization. Let me show what I got so far. Eigenvector of some linear operator signifies a direction in which operator just ''works'' ...
ante.ceperic's user avatar
  • 5,221
52 votes
6 answers

What do mathematicians mean by "equipped"?

I am a mathematical illiterate, so I do not know what people mean when they say "equipped". For example, I say that a Hilbert space is a vector space equipped with an inner product. What does that ...
Olórin's user avatar
  • 5,395
51 votes
4 answers

Pathologies in module theory

Linear algebra is a very well-behaved part of mathematics. Soon after you have mastered the basics you got a good feeling for what kind of statements should be true -- even if you are not familiar ...
Gregor's user avatar
  • 993
49 votes
11 answers

Why study finite-dimensional vector spaces in the abstract if they are all isomorphic to $R^n$?

Timothy Gowers asks Why study finite-dimensional vector spaces in the abstract if they are all isomorphic to $R^n$? and lists some reasons. The most powerful of these is probably There are many ...
49 votes
3 answers

Difference between sum and direct sum

What is the difference between sum of two vectors and direct sum of two vector subspaces? My textbook is confusing about it. Any help would be appreciated.
Marion Crane's user avatar
  • 2,527
49 votes
8 answers

Is every axiom in the definition of a vector space necessary?

Definition: A vector space over a field $K$ consists of a set $V$ and two binary operations $+: V \times V \to V$ and $\cdot: K \times V \to V$ satisfying the following axioms: Commutativity of $+$. ...
David Zhang's user avatar
  • 8,835
48 votes
6 answers

Reflection across a line?

The linear transformation matrix for a reflection across the line $y = mx$ is: $$\frac{1}{1 + m^2}\begin{pmatrix}1-m^2&2m\\2m&m^2-1\end{pmatrix} $$ My professor gave us the formula above with ...
dsd's user avatar
  • 505
48 votes
7 answers

How to understand dot product is the angle's cosine?

How can one see that a dot product gives the angle's cosine between two vectors. (assuming they are normalized) Thinking about how to prove this in the most intuitive way resulted in proving a ...
Leo's user avatar
  • 1,539
47 votes
6 answers

understanding of the "tensor product of vector spaces"

In Gowers's article "How to lose your fear of tensor products", he uses two ways to construct the tensor product of two vector spaces $V$ and $W$. The following are the two ways I understand: $V\...
user avatar
46 votes
11 answers

Finding a unit vector perpendicular to another vector

For example we have the vector $8i + 4j - 6k$, how can we find a unit vector perpendicular to this vector?
adil's user avatar
  • 507
46 votes
3 answers

Inner Product Spaces over Finite Fields

Inner product spaces are defined over a field $\mathbb{F}$ which is either $\mathbb{R}$ or $\mathbb{C}$. I want to know what happens if we try to define them over some finite field. Here's an example:...
Sadeq Dousti's user avatar
  • 3,261
45 votes
3 answers

A rank-one matrix is the product of two vectors

Let $A$ be an $n\times m$ matrix. Prove that $\operatorname{rank} (A) = 1$ if and only if there exist column vectors $v \in \mathbb{R}^n$ and $w \in \mathbb{R}^m$ such that $A=vw^t$. Progress: I'm ...
coconutbandit's user avatar
43 votes
3 answers

What is the proof that covariance matrices are always semi-definite?

Suppose that we have two different discreet signal vectors of $N^\text{th}$ dimension, namely $\mathbf{x}[i]$ and $\mathbf{y}[i]$, each one having a total of $M$ set of samples/vectors. $\mathbf{x}[m]...
hkBattousai's user avatar
  • 4,543
43 votes
4 answers

Why are real symmetric matrices diagonalizable?

A matrix is diagonalizable iff it has a basis of eigenvectors. Now, why is this satisfied in case of a real symmetric matrix ?
aaaaaa's user avatar
  • 2,656
42 votes
2 answers

How to efficiently use a calculator in a linear algebra exam, if allowed

We are allowed to use a calculator in our linear algebra exam. Luckily, my calculator can also do matrix calculations. Let's say there is a task like this: Calculate the rank of this matrix: $...
cnmesr's user avatar
  • 4,700
42 votes
2 answers

Understanding isomorphic equivalences of tensor product

I get some big picture of tensor and tensor product by reading their Wikipedia articles, and several questions and answers posted before by others. But I cannot figure out how to show the following ...
Tim's user avatar
  • 47.2k
41 votes
2 answers

Proof for triangle inequality for vectors

Generally,the length of the sum of two vectors is not equal to the sum of their lengths. To see this consider the vectors $u$ and $v$ as shown below. By considering $u$ and $v$ as two sides of a ...
alok's user avatar
  • 3,880
41 votes
3 answers

What is an Inner Product Space?

I've learned that the dot product is just one of many possible inner product spaces. Can someone explain this concept? When is it useful to define it as something other than the dot product?
Emil H's user avatar
  • 662
40 votes
2 answers

Relation between rank and number of distinct eigenvalues of a matrix

Let $T : V\to V$ be a linear transformation such that $\dim\operatorname{Range}(T)=k\leq n$, where $n=\dim V$. Show that $T$ can have at most $k+1$ distinct eigenvalues. I can realize that the rank ...
Ester's user avatar
  • 3,047
40 votes
1 answer

$\mathbb{R}$ and $\mathbb{R}^2$ isomorphic as groups?

Using the axiom of choice, $\mathbb{R}$ and $\mathbb{R}^2$ are equal-dimensional vector spaces over $\mathbb{Q}$ and so are isomorphic as $\mathbb{Q}$-vector spaces thus as groups. This is obvious, ...
Maxime Ramzi's user avatar
  • 43.4k
39 votes
1 answer

Why it is important for isomorphism between vector space and its double dual space to be natural?

I'm reading the book (by A. Kostrikin) on linear algebra and I feel like I'm really missing something about this idea. I understand the formal proofs of: a) isomorphism between vector space $V$ and ...
lithuak's user avatar
  • 1,205
37 votes
3 answers

Change of basis matrix to convert standard basis to another basis

Consider the basis $B=\left\{\begin{pmatrix} -1 \\ 1 \\0 \end{pmatrix}\begin{pmatrix} -1 \\ 0 \\1 \end{pmatrix}\begin{pmatrix} 1 \\ 1 \\1 \end{pmatrix} \right\}$ for $\mathbb{R}^3$. A) Find the ...
ground.clouds1's user avatar
37 votes
2 answers

Proof that two bases of a vector space have the same cardinality in the infinite-dimensional case.

I am having a difficulty setting up the proof of the fact that two bases of a vector space have the same cardinality for the infinite-dimensional case. In particular, let $V$ be a vector space over a ...
Manos's user avatar
  • 25.8k
37 votes
4 answers

Empty Set $\{\}$ is the Only Basis of the Zero Vector Space $\{0\}$

Question Suppose we want to find a basis for the vector space $\{0\}$. I know that the answer is that the only basis is the empty set. Is this answer a definition itself or it is a result of the ...
Hosein Rahnama's user avatar
36 votes
3 answers

How to check if a set of vectors is a basis

OK, I am having a real problem with this and I am desperate. I have a set of vectors $\{(1,0,-1), (2,5,1), (0,-4,3)\}$. How do I check is this is a basis for $\mathbb{R}^3?$ My text says a basis $B$ ...
Jesse's user avatar
  • 2,608
36 votes
2 answers

Why is cross product only defined in 3 and 7 dimensions? [duplicate]

Why $3$ and $7$? I know from some reading that Hurwitz's Theorem explains this, but can someone help me build some intuition behind this or perhaps provide a simpler explanation? It still seems ...
William Chang's user avatar

2 3 4 5