Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

What is the reason why we defined a matrix vector product (a transformation) this way:

$$\begin{pmatrix} a_1 & a_2 \\ a_3 & a_4 \\ \end{pmatrix}\cdot \begin{pmatrix} b_1\\ b_2\\ \end{pmatrix} = \begin{pmatrix} a_1\cdot b_1 + a_2\cdot b_2 \\ a_3\cdot b_1 + a_4\cdot b_2\\ \end{pmatrix}.$$

I know that when we want to represent a transformation, we care about the values that we're gonna multiply the vector's pieces, but why we use like a linear combination mechanism to multiply the vector's pieces?

I know that this may be a good reason:

  • We can create new vectors with more or less dimensions than the original vector, just by having one, two, or more lines in the matrix (os less lines).

PS: I can't just say that this is derived from the matrix matrix product, because this type of product is derived from the matrix vector product definition, so any 'proof' or reason that uses matrix matrix product definition will be circular.

share|cite|improve this question
Its a convenient shorthand. – copper.hat Nov 5 '13 at 18:05
This is very difficult to parse. – Dan Rust Nov 5 '13 at 18:46
Relevant (I think--I'm having a hard time understanding the question). – jkn Nov 5 '13 at 18:53

In spite of your PS, I believe that matrix matrix product is the reason, since every $n\times m$ matrix $A$ can be seen as linear transformation $\mathcal{A}: \mathbb{R}^m \to \mathbb{R}^n$. If you choose basis $\{e_1, \;... \;,e_n \}$ for $\mathbb{R}^n$ and basis $\{f_1, \;... \;,f_n \}$ for $\mathbb{R}^m$, then $A$, $A_{ij} = a_{ij}$, gives you information about $\mathcal{A}$-images of $f_j$-s: $$\mathcal{A}f_j = \sum_{i = 1}^n a_{ij}e_i\text{.}$$

If you have two such linear transformations $\mathcal{B}$ and $\mathcal{C}$ (with corresponding matrices $B$ and $C$) for which composition $\mathcal{B}\circ \mathcal{C}$ can be computed, the matrix matrix product of $B$ and $C$ gives you matrix $BC$, which corresponds to linear transformation $\mathcal{B}\circ \mathcal{C}$.

I agree that the last fact is not intuitive and my personal opinion is before the matrix matrix product was defined, they had asked themselves

Which matrix corresponds to composition of two linear transformations?

Let be $\mathcal{C}:X\to Y$ and $\mathcal{B}:Y\to Z$. Choosing basis for $X$ ($e_i$,), $Y$ ($f_i$,) and $Z$ ($g_i$,), it can be directly computed that $i$-th component of $(\mathcal{B}\circ \mathcal{C})e_j$ equals to $$\sum_k b_{ik}c_{kj}$$ so the matrix matrix product should be defined as it is nowadays.

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.