Let's start to say that I'm one of those people that believe that the more mathematics you know the better it is.
That said based on what it seems that yours interests are I believe that you could be interested in learning quite enough category theory.
Category theory was originally developed by Eilenberg and Mac Lane in order to address problem in algebraic topology and homological algebra.
These two areas of mathematics continues still now to push forward to develop of category theory and indeed they bring to the study of new structures like model categories for the study of homotopy theory in context different than topological space, allowing also to applies homotopical technique to other field of research.
At the same time both algebraic topology and homological algebra develop using the language of category theory so that it become necessary to well know quite a bit of category theory to work in such fields. Of course if you want to good along in advanced study in geometry is very likely you'll have to look in these fields and so that you'll have to learn some category theory.
Of course there are other part of maths that uses category theory for instance algebraic geometry, in particular scheme theory use massively a lot of categorical tools, and logic too but I don't want to go to deep on this.
Nonetheless I personally give another good reason to study a little of category theory: using category theory teach to think in an arrow theoretic fashion and most importantly using categorical language make clear some intimate connection between different objects in mathematics. Many classical construction which are carried out in some categories very easily generalize to many category (although sometimes is required some additional structure on the category). That means that is possible to generalize lots of result to many context using the language of categories. What's more some times looking definition of object in some context form a categorical point of view can make easier to understand such definition: studying some new subject I've personally experienced a good improvement in the understanding of the new objects studied when I've translate all the stuff in categorical language, because many construction were similar to other construction I've seen in different context.
Of course that's just a personal opinion and a personal experience, but I believe that is worth to try learn some category theory.
In the end a suggestion, try to learn as much category theory as you can. If sometimes you get stuck don't bother too much, go along with your study the other stuff will become clearer later when you'll need it or when your mathematics knowledge will grow.
Hope this helps.