I am struggling to reconcile the two forms of the rank-nullity theorem:

  1. $\operatorname{Rank}(\mathbf{A}) + \operatorname{Null}(\mathbf{A}) = n$,
  2. $\dim(\mathbf{V}) = \dim(\operatorname{Im}(f)) + \dim(\operatorname{Ker}(f))$

In attempting to reconcile these, I have collected the following facts:

  • If we have $\mathbf{A}\mathbf{x} = \mathbf{b}$, then $\mathbf{A}\mathbf{x} = f(\mathbf{x})$ when thinking about it from the perspective of linear transformations. This means that the image of $f$ is $\mathbf{b}$, so we have $\operatorname{Im}(f) = \mathbf{b}$.
  • The rank of a matrix is equal to the dimension of its column space. Therefore, the rank of a matrix is equal to the number of leading ones in the matrix in reduced row echelon form. This is the $\operatorname{Rank}(A)$ part.
  • Dimension represents the number of elements in a basis.
  • Therefore, we have that $\dim(\operatorname{Im}(f)) = \dim(\mathbf{b})$.

I do not see how $\operatorname{Rank}(\mathbf{A}) = \dim(\operatorname{Im}(f))$. In fact, I not even see how a statement like $\dim(\operatorname{Im}(f))$ even makes any sense? $\operatorname{Rank}(\mathbf{A})$ makes sense, since we can calculate this by getting $\mathbf{A}$ into RREF, but how does $\dim(\operatorname{Im}(f)) = \dim(\mathbf{b})$ make any sense? I do not see the connection here.

I would greatly appreciate it if people could please take the time to clarify this.

  • $\begingroup$ Hint: if $A=(\mathbf{v_1\;v_2\;\ldots\; v_n})$, then $\mathrm{Dim}(\mathrm{Im}( A))$ is just the number of linearly independent vectors among $\mathbf{v_i}$s. Or in other words, $\{\bf v_i\}$ spans $\mathrm{Im} (A)$ (why?). $\endgroup$ – BAI Nov 15 '17 at 7:46

The image of $f$ isn't $b$. You don't seem to know the definition of the image of a function.

The image is the set of all possible outputs of the function $f$ as $x$ ranges over all vectors in the domain.

Edit, to address the question in the comments below my answer.

The image of $f$ is the span of the columns of $A$. The rank of $A$ is the number of linearly independent columns of $A$. Hence the rank is the size of a basis of the image, namely the basis consisting of the linearly independent columns of $A$. Since the rank is equal to the cardinality of a basis of the image, the rank is equal to the dimension of the image.

  • $\begingroup$ Thanks for the response. But how does this explain the relation between the $Rank(A)$ and $dim(Im(f))$? Can you please demonstrate why these are equal? $\endgroup$ – The Pointer Nov 15 '17 at 7:29
  • $\begingroup$ That is one definition of rank. Another definition, the one you seem to be using, is the number of pivots in the rref form of $A$. The number of pivots tells you how many linearly independent columns $A$ has. You can prove this is equal to the dimension of the image, as soon as you learn what the image really is. (Hint: the image is spanned by the columns of $A$.) $\endgroup$ – symplectomorphic Nov 15 '17 at 7:30
  • $\begingroup$ I added more details. $\endgroup$ – symplectomorphic Nov 15 '17 at 7:41
  • $\begingroup$ You are confusing the image of a function, period, and the image of a point under a function. This is an incredibly elementary distinction. The image of the function $f(x)=x^2$ is the set of all nonnegative real numbers, but the image of $3$ under $f$ is $9$. I don't see how you've asked questions about complex analysis and PDEs without understanding this. $\endgroup$ – symplectomorphic Nov 15 '17 at 8:02
  • $\begingroup$ en.wikipedia.org/wiki/Image_(mathematics)#Definition You're right. I've confused myself by reading through multiple different sources. $\endgroup$ – The Pointer Nov 15 '17 at 8:06

For the part you do not understand: since there is an isomorphism $$\overline{\varphi} : V/\text{Ker}(\varphi) \stackrel{\sim}{=} \varphi(V)$$ we have: \begin{equation} \text{dim}V/\text{Ker}(\varphi) = \text{dim}\varphi(V) \end{equation} By consequence of first isomorphism theorem, we have \begin{equation} \text{dim}V = \text{dim}\text{Ker}(\varphi) + \text{dim}V/\text{Ker}(\varphi) \end{equation} So it follows that, $$\dim V = \dim Ker(\varphi)+\dim \varphi(V)$$

And the above $\varphi$ is a linear transformation and of course $\varphi(V) = \text{Im}(V)$

Well, i am not sure if you have learnt the first isomorphism theorem or not, but this is the proper understanding of how the so called rank nullity is derived. So first things first, remember this theorem.

The next is easy to understand, we have well known mapping which is $$T_A: \mathbb{R}^n \to \mathbb{R}^n$$ which maps $$x \mapsto Ax$$ in which $x$ is a column vector in the $\mathbb{R}^n$ space and $A$ is THE matrix that is in question. Now : i hope you can easily verify the fact that in this linear transformation, we have dimension of kernel $T$ is merely the dimension of the nullspace of $A$ and the dimension of the image of $T$ is merely the dimension of the column space of $A$. And hence we see that indeed $$\text{rank}A = \dim \text{Im}T_A$$

My answer is still slightly vague and does not provide any intuition, but to piece it all together requires you to understand the fundamentals and of course the first isomorphism theorem.

  • $\begingroup$ The post didn't ask for a proof of the theorem. Your answer doesn't answer the question. $\endgroup$ – symplectomorphic Nov 15 '17 at 8:04
  • $\begingroup$ My comment (not yet proof) is to complement his understanding since he got an answer from you? It doesnt hurt to know something relevant. $\endgroup$ – nan Nov 15 '17 at 8:08
  • $\begingroup$ Answers here are supposed to give answers to the questions. Nowhere does the OP ask for a proof of the theorem. The question is about why the two statements of the theorem are equivalent. Your post is not relevant to that issue. $\endgroup$ – symplectomorphic Nov 15 '17 at 8:10
  • $\begingroup$ In my interpretation, he has some understanding of linear transformations and capable of understanding some abstract meaning of the theorem. And yes, i can definitely use my "proof" here to show these two statements are indeed equivalent if that is what you are worried about. $\endgroup$ – nan Nov 15 '17 at 8:18
  • $\begingroup$ I'm not worried about anything. I'm telling you how to improve your answers. Don't give irrelevant information. Answer the question directly and simply. I'll leave it there. $\endgroup$ – symplectomorphic Nov 15 '17 at 8:19

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.