86
$\begingroup$

I know how to calculate the dot product of two vectors alright. However, it is not clear to me what, exactly, does the dot product represent.

The product of two numbers, $2$ and $3$, we say that it is $2$ added to itself $3$ times or something like that.

But when it comes to vectors $\vec{a} \cdot \vec{b}$, I'm not sure what to say. "It is $\vec{a}$ added to itself $\vec{b}$ times" which doesn't make much sense to me.

$\endgroup$
3
  • 1
    $\begingroup$ Adding $\vec{a}$ to itself $b$ times ($b$ being a number) is another operation, called the scalar product. The dot product involves two vectors and yields a number. $\endgroup$ – Yves Daoust May 22 '14 at 22:40
  • $\begingroup$ Something not mentioned but of interest is that the dot product is an example of a bilinear function, which can be considered a generalization of multiplication. $\endgroup$ – William Mar 15 at 23:34
  • $\begingroup$ Does this answer your question? Meaning of Dot Products in Regards to Linear Algebra $\endgroup$ – Ketan Mar 17 at 16:58

10 Answers 10

58
$\begingroup$

The dot product tells you what amount of one vector goes in the direction of another. For instance, if you pulled a box 10 meters at an inclined angle, there is a horizontal component and a vertical component to your force vector. So the dot product in this case would give you the amount of force going in the direction of the displacement, or in the direction that the box moved. This is important because work is defined to be force multiplied by displacement, but the force here is defined to be the force in the direction of the displacement.

http://youtu.be/KDHuWxy53uM

$\endgroup$
5
  • 19
    $\begingroup$ For this interpretation it's important that the vector you are projecting onto has unit length, otherwise you are getting the component of vector 1 along vector 2 scaled by the length of vector 2 $\endgroup$ – rVitale May 22 '14 at 22:52
  • 1
    $\begingroup$ Work is a good example of magnitude as well as direction. W = F.D, i.e work is the scalar product of the force and displacement vectors (assuming constant force and direction). $\endgroup$ – Tom Collinge May 23 '14 at 7:37
  • 3
    $\begingroup$ This answer is vague. As rVitale points out, your first sentence is only true if the "other" vector is a unit vector. When you say "[pull] a box 10 meters at an inclined angle", you need to be clearer about what the two vectors are: presumably, you mean the force vector and the vector along which the box moves. $\endgroup$ – David Richerby May 23 '14 at 9:08
  • 5
    $\begingroup$ Obviously it helped the OP. The criticism of the King is blasphemous. $\endgroup$ – King Squirrel May 23 '14 at 13:05
  • 2
    $\begingroup$ Oh this makes sense now. The dot product is zero when they're orthogonal because they don't have any common component! $\endgroup$ – Kenneth Worden Sep 13 '15 at 18:08
22
$\begingroup$

Geometric Meaning

As other answers have pointed out, the dot product $\vec{a} \cdot \vec{b}$ is related to the angle $\theta$ between $\vec{a}$ and $\vec{b}$ through:

$$\vec a \cdot \vec b = \Vert\vec a\Vert_2 \, \Vert\vec b\Vert_2 \, \cos \theta$$

Assuming that $a$ and $b$ point into similar directions, i.e., $\theta \leq 90°$, we can visualize what this relationship means (skipping the vector arrows and Euclidean norm subscript from now on):

enter image description here

$p$ is the vector resulting from an orthogonal projection of $a$ onto $b$. As the $\cos$ is the ratio between the adjacent leg ($p$) and the hypotenuse ($a$) in the right triangle, i.e.,

$$\cos \theta = \frac{\Vert p \Vert}{\Vert a \Vert},$$

we get for the inner product:

$$a \cdot b = \Vert a \Vert \, \Vert b \Vert \, \frac{\Vert p \Vert}{\Vert a \Vert} = \Vert p \Vert \Vert b \Vert$$

So, the inner product is the length of the vector $p$, the projection of $a$ onto $b$, multiplied by the length of $b$. If $a$ and $b$ point into opposite directions, i.e., $90° < \theta \leq 180°$, the dot product will be the negative: $a \cdot b = - \Vert p \Vert \Vert b \Vert$

Derivation

The problem is that the relationship between the dot product and the angle $\theta$ is not inherently given. By definition:

$$a \cdot b = \sum_i a_i b_i$$

So, we need to find a link between this and the cosine. From the definition of the dot product, we can see that it scales proportionally with the input vectors, so for non-unit vectors $u$ and $v$ with the corresponding unit vectors $\hat{u}$ and $\hat{v}$:

$$u \cdot v = \Vert u \Vert \cdot \Vert v \Vert \cdot \hat{u} \cdot \hat{v}$$

For simplicity, we will assume $a$ and $b$ to be unit vectors. Thus, we only need to show

$$a \cdot b = \cos \theta$$

or, by the definition of $\cos$, we need to show:

$$a \cdot b = \Vert p \Vert $$

Let's calculate the length of the projection $p$ using $a$ and $b$. We can start by using the Pythagorean theorem:

$$ \Vert p \Vert ^2 = \Vert a \Vert ^2 - \Vert c \Vert ^2$$

Because $a$ is a unit vector:

$$ \Vert p \Vert ^2 = 1 - \Vert c \Vert ^2$$

Now, we need to calculate the length of $c$ using the other rectangular triangle. Again, we use the fact that $b$ is a unit vector, i.e., $ \Vert b \Vert = 1$.

$$ \begin{align} \Vert c \Vert ^2 &= \Vert d \Vert ^2 - (\Vert b \Vert - \Vert p \Vert)^2 \\ &= \Vert d \Vert ^2 - (1 - \Vert p \Vert)^2 \\ &= \Vert d \Vert ^2 - 1 + 2 \Vert p \Vert - \Vert p \Vert^2 \end{align} $$

Now, we can insert this term for $\Vert c \Vert ^2$ in the equation above:

$$ \begin{align} \Vert p \Vert ^2 &= 1 - \Vert d \Vert ^2 + 1 - 2 \Vert p \Vert + \Vert p \Vert^2 \\ 0 &= 2 - \Vert d \Vert ^2 - 2 \Vert p \Vert \\ 2 \Vert p \Vert &= 2 - \Vert d \Vert ^2 \end{align} $$

In the figure, we see that $\vec a + \vec d = \vec b$. Therefore, $\vec d = \vec b - \vec a$, or:

$$d_i = b_i - a_i$$

Thus, we can express $\Vert d \Vert^2$ as:

$$ \begin{align} \Vert d \Vert ^2 &= \sum_i d_i^2 \\ &= \sum_i (b_i - a_i)^2 \\ &= \sum_i b_i^2 - 2 b_i a_i + a_i^2 \\ &= \sum_i b_i^2 - \sum_i 2 b_i a_i + \sum_i a_i^2 \\ &= \Vert b \Vert^2 - \sum_i 2 b_i a_i + \Vert a \Vert^2 \\ &= 1 - \sum_i 2 b_i a_i + 1 \\ &= 2 - 2 \sum_i b_i a_i \end{align} $$

Finally:

$$ \begin{align} 2 \Vert p \Vert &= 2 - \Vert d \Vert ^2 \\ &= 2 - (2 - 2 \sum_i b_i a_i) \\ &= 2 \sum_i b_i a_i \\ \Vert p \Vert &= \sum_i b_i a_i \end{align} $$

q.e.d.

$\endgroup$
7
  • 1
    $\begingroup$ Hello Kilian - thanks for this. I'm not sure how you got the expression for \norm{c}^2 in the second step and how you got the expression for the \norm{p}^2 in the third step. Could you please clarify? $\endgroup$ – G. Khanna Jan 26 '20 at 17:00
  • $\begingroup$ Same here, very interested in a clarification. $\endgroup$ – qreon Oct 24 '20 at 10:07
  • $\begingroup$ I updated the equations to make it more clear. Let me know if you have any further questions! $\endgroup$ – Kilian Batzner Nov 15 '20 at 12:11
  • $\begingroup$ Thanks for such detailed answer.. helped me to clear many doubts and concepts. $\endgroup$ – Believer Dec 27 '20 at 8:46
  • $\begingroup$ For me this post would be helped if you outlined what you are going to be proving, before the lenghy proof starts. Alternatively, I would put p is the vector resulting from an orthogonal projection of a onto b in bold. $\endgroup$ – DailyFrankPeter Jan 21 at 12:00
15
$\begingroup$

It might help to think of multiplication of real numbers in a more geometric fashion. $2$ times $3$ is the length of the interval you get starting with an interval of length $3$ and then stretching the line by a factor of $2$.

For dot product, in addition to this stretching idea, you need another geometric idea, namely projection. Imagine the line $L$ parallel to $\vec b$ through the origin $O$. Now imagine projecting from the tip of the vector $\vec a$, along a line perpendicular to $L$, until hitting $L$ at a point $P$. The dot product $\vec a \cdot \vec b$ is the length of the line segment you get by starting with the line segment $OP$ and then stretching the plane by a factor equal to the length of $\vec b$.

I'm being a little careless about plus and minus signs, but those can be incorporated into this picture too.

$\endgroup$
1
  • 4
    $\begingroup$ What's the importance of this? What do we get from the product? I mean why we are so interested in finding this dot product? $\endgroup$ – Wasiq Noor Jul 24 '18 at 2:26
13
$\begingroup$

I think of dot product as the "same-ness" of two vectors. If two vectors are orthogonal (90 degrees on one another) they are 'not at all the same' (dot product =0), and if they are parallel they are 'very much the same'. If you divide their dot product by the product of their magnitude, that is the argument for an arccosine function to find the angle between them. My application for the dot product is finding the angle between two vectors for calculating the force required to pull a cable through two or more pipes with a bend. It's hard to do this in a three dimensional world without knowing how to calculate the dot product. Math makes life really easy :)

$\endgroup$
8
$\begingroup$

First of all, if we write $\vec{a} = a \vec{u}$ and $\vec{b} = b \vec{v}$, where $a$ and $b$ are the length of $\vec{a}$ and $\vec{b}$ respectively, then $$\vec{a} \cdot \vec{b} = (a \vec{u})\cdot (b \vec{v}) = ab \,\, \vec{u} \cdot \vec{v};$$ this is a pretty natural property for a product to have.

Now as for $\vec{u} \cdot \vec{v}$, this is equal to $\cos \theta,$ where $\theta$ is the angle between $\vec{u}$ and $\vec{v}$.

As King Squirrel notes, this is also the length of the projection of $\vec{u}$ onto the line through $\vec{v}$, and also the length of the projection of $\vec{v}$ onto the line through $\vec{u}$.

So altogether we get

$$\vec{a} \cdot \vec{b} = a b \, \cos \theta,$$ and it has the interpretation in terms of projecting one vector onto another that King Squirrel discusses.

$\endgroup$
1
  • $\begingroup$ does this meaning have any remnant when used over $\Bbb F_p$? $\endgroup$ – 1.. Dec 9 '14 at 7:18
2
$\begingroup$

The dot product of two vectors u,v is the area of the parallelogram u,v' where v' is v rotated by 90 degrees.

$\endgroup$
2
  • 1
    $\begingroup$ This is the most interesting answer to me because it shows a link between cross product and dot product. I will give you the most I can which is one. $\endgroup$ – Sedumjoy Jul 13 '20 at 17:24
  • $\begingroup$ Haha, thank you! $\endgroup$ – Jules Jul 14 '20 at 19:04
2
$\begingroup$

Dot product is the product of magnitudes of 2 vectors with the Cosine of the angle between them. You can take the smaller or the larger angle between the vectors. That is if theta is the angle then you can take (360-theta) as well.

Geometrically, it will also be equal to (read it slowly) the product of “projection” of magnitude of one vector on the other and the magnitude of the 2nd vector.

In Physics, as an example, Mechanical Work is a scalar and a result of dot product of force and displacement vectors. Like-wise, Magnetic flux is the dot product of magnetic field and vector area

Let me try to explain this with an example. Say you wish to find the work done by a force F along X axis over a distance d. However the problem also tells you that the direction of the force is not along the X axis but at an angle of 60 degree with X axis.

Now you know that the work done is the product of force and displacement. But in this case you know that the force is not exactly totally acting in the direction of X axis, since it is inclined at 60 degree. So what you can do is, find what is the contribution of this force in the X direction. Well it turns out with simple trigonometry that it is F Cos60 in direction of X axis. Now you can say that the work done = F Cos 60 X d. This can also be represented as F.d = F d Cos 60. So you see, dot product gives us the magnitude of a certain entity (in this case work) by way of attributing a certain vector (in this case force F) in the direction of the other vector. Here "d" was the other vector along which work was being found

Dot product is a scalar quantity. Watch this video that I have made to understand this better-

What is Dot Product of Vectors

$\endgroup$
0
$\begingroup$

I don't think the dot product has a very obviously interesting visual interpretation.

I'm not a math teacher, but if I were asked to define the dot product in a course, I'd start by defining the scalar projection first. This has a very intuitive interpretation. And then you'd see immediately that, in order to compute the scalar projection, it's useful to compute the dot product.

So, in a normed vector space $E$, let $u,v \in E$ two vectors such as $u, v \neq 0$.

Formally, the scalar projection of $v$ over $u$ is the unique scalar $\alpha$ such as

$$ || \alpha u ||^2 + || v - \alpha u ||^2 = || v ||^2 $$

It might not be true in every normed vector space that such a unique scalar has to exist, but in $\mathbb{R}^n$ with the Euclidean norm at least, you can prove that it does exist and that it is indeed unique.

Intuitively/geometrically, you're fixing a point $P$ and you're trying to adjust the length and the orientation of a vector that goes in the same direction as $u$, (that's $\alpha u$), so that the triangle formed by the points: $P, P+v, P+\alpha u$ satisfies the Pythagorean property of a right triangle of hypothenuse $[P, P+v]$ (that's what the property $|| \alpha u ||^2 + || v - \alpha u ||^2 = || v ||^2$ expresses).

If you expand the condition

$$||\alpha u||² + ||v - \alpha u||² = ||v||²$$

using the definition of the Euclidean norm, you'll see that $\alpha$ has to be equal to

$$ \frac{\sum\limits_{i=1}^{n} u_i v_i}{||u||}$$

(and that this quantity does satisfy the condition).

So geometrically, what is the scalar product of $u$ and $v$ ? I'd say that it is this quantity that when divided by $||u||$ gives you the scalar projection of $v$ over $u$.

$\endgroup$
0
$\begingroup$

When one calculates A.B, two measurements happen: measurement of how small the angle between them is, and how long A and B are. A.B basically means projection length of A on B, with this length then scaled by the absolute length of B.

One way to think about the interpretation of the dot product is to think how would one maximise or minimise the dot product between two vectors. Let's assume we are trying to maximise the dot product between two vectors that we can modify:

The dot product will be grow larger as the angle between two vector decreases. The dot product A.B will also grow larger as the absolute lengths of A and B increase. This is because as A gets larger, its projected length will be longer, and as B's length gets larger, the scaling of A's projection will grow larger, given that B's absolute length will act as a scaler of A's projection length.

$\endgroup$
1
  • $\begingroup$ Please do not post the same answer more than once. If you find that the same answer will address multiple questions, then please flag the questions as duplicates. $\endgroup$ – Xander Henderson Mar 17 at 16:04
-2
$\begingroup$

When directions are considered, we essentially bring a new dimension to the perception of the entity. (Speed vs Velocity: 5km/h vs 5km/h towards east). Bringing the sense of direction, the question arises, how the entities interact?

In dot product, diagrammatically, what we find is, essentially, the area that is affected by the two entities taken together.

Consider Tetris. You have built a foundation already. Now, a new part is falling and you have the arrow keys to move it around. Two competing vectors, your movement and the falling of the brick/part, will determine how the new part is arranged. The area covered by the falling part would be determined by the dot product of the said vectors.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.