Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am studying the linear Independence and linear dependence of the vectors in my Linear algebra course and i am confused about the following theorem (The book is Linear Algebra and its applications by David C Lay) and i need some explanation of this theorem. enter image description here

In this theorem i am confused about "If S is linearly dependent and V1 not equal to zero then some Vj (with j>1) is a linear combination of the preceeding vectors"

share|cite|improve this question

Recall that a vector $w$ is a linear combination of $w_1,\ldots,w_k$ if there exist scalars $\lambda_1,\ldots,\lambda_k$ such that $w = \lambda_1w_1 + \cdots + \lambda_kw_k.$ A set $\{w_1,\ldots,w_k\}$ is linearly dependent if there exists a non-trivial solution to $\lambda_1w_1+\cdots+\lambda_kw_k = 0$, i.e. not all $\lambda_i = 0.$

Assume that $v_1 \neq 0$ and that $\{v_1,\ldots,v_n\}$ is linearly dependent.

Since $v_1 \neq 0$ it follows that $\{v_1\}$ is linearly independent.

Next, consider $\{v_1,v_2\}$. Either $\{v_1,v_2\}$ is linearly independent (LI) or linearly dependent (LD). If $\{v_1,v_2\}$ is LD then you have your $v_j$, namely $j=2$, because $\{v_1\}$ was LI while $\{v_1,v_2\}$ is LD meaning that $v_2$ is a linear combination of $v_1$.

If $\{v_1,v_2\}$ is LI then consider $\{v_1,v_2,v_3\}$. Either $\{v_1,v_2,v_3\}$ is LI or LD. If $\{v_1,v_2,v_3\}$ is LD then you have your $v_j$, namely $j = 3$, because $\{v_1,v_2\}$ was LI while $\{v_1,v_2,v_3\}$ is LD meaning that $v_3$ is a linear combination of $v_1$ and $v_2$.

If $\{v_1,v_2,v_3\}$ is LI then consider $\{v_1,v_2,v_3,v_4\}$, etc.

Continue this process. You will eventually find a $v_j$ for which $\{v_1,\ldots,v_{j-1}\}$ is LI and $\{v_1,\ldots,v_j\}$ is LD meaning that $v_j$ is a linear combination of $v_1,\ldots,v_{j-1}.$ If you don't find such a $v_j$ then you have a contradiction: you would have that $\{v_1,\ldots,v_n\}$ was LI, but you assumed it was LD!

share|cite|improve this answer

If $S=\left\{v_1,v_2,\ldots,v_\rho\right\}$ is linearly depended then \begin{equation}\lambda_1v_1+\lambda_2v_2+\cdots+\lambda_\rho v_\rho=0\end{equation} for some $\lambda_i$ not all zero. Let $j\in \{1,2,\ldots\rho\}$ be the least integer s.t. $\lambda_j=\lambda_{j+1}=\cdots=\lambda_\rho=0$. If we suppose that $v_1\neq0$ then $j>1$. Therefore \begin{equation}\lambda_1v_1+\cdots+\lambda_{j-1}v_{j-1}=0\end{equation} and $\lambda_{j-1}\neq0$. We conclude that \begin{equation}v_{j-1}=-\dfrac{\lambda_1}{\lambda_{j-1}}v_1-\cdots-\dfrac{\lambda_{j-2}}{\lambda_{j-1}}v_{j-2}.\end{equation}

share|cite|improve this answer

What exactly is your problem; general confusion is not well-defined.

It means that one of the vectors is a linear combination of all of those before, in other words, you can usually pick the last vector if the set is finite. If it is infinite, this theorem still holds true (as there cannot be more then $n$ linear independent vectors in a $n$-dimensional vector space).

An example: Let our set be $S=\{(1,2),(3,4),(4,6),(1,3)\}$ now, both $(4,6)$ and $(1,3)$ are linearly dependent to their predecessors, which are in turn, $\{(1,2),(3,4)\}$ and $\{(1,2),(3,4),(4,6)\}$. In fact, $(1,3)$ is already linear dependent to the first 2 vectors; the third is just "overkill".

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.