A lot of things have been said in the comments already, but let me try to put things into context:
The complex numbers are defined in a way that they behave just as you would expect algebraic expressions of the form $a+ib$ to behave, e.g. under addition and multiplication (so you have associativity, commutativity, distributivity..) with the addition that you then have to define what the product of two imaginary numbers is, which is done via defining $i^2 = - 1$.
You could in principle invent a new symbol to denote complex numbers, but the "+" notation has a lot of advantages in that it is intuitive (as pointed out above) and can be considered as a vector-valued statement. So you can write $a + ib = a\cdot 1 + b \cdot i$ and consider the symbols $1$ and $i$ as the two vectors $(1,0)$ and $(0,1)$, so you add another dimension to the real line to get the complex plane. So as a set, they are indistinguishable from $\mathbb{R}^{2}$.
As Jack, who was faster than me, pointed out, the complex numbers have a lot more structure than just being a set. They are, for example, a vector space over the field of real numbers, $\mathbb{R}$, since linear combinations with real coefficients of complex numbers are again complex. And if you consider it as such a space, they are actually isomorphic to (and hence indistinguishable from) $\mathbb{R}^{2}$.
The complex numbers can also be considered as a metric space (and hence a topological space) if you define as their metric the distance function in the complex plane, i.e.
$$
d(z_{1}, z_{2}) := | z_{1} - z_{2} |.
$$
Then, even as a metric space, they are indistinguishable from $\mathbb{R}^{2}$ (with the Euclidean metric). This means that you have the same kinds of open sets, the same notion of convergence (i.e. what it means for a sequence $(z_{n})_{n \in \mathbb{N}}$ to converge to a limit $z$) etc.
There are even more structures present here, for example $\mathbb{C}$ is also a normed space (because its metric is actually defined via a norm).
But most importantly, and this is what makes $\mathbb{C}$ so special and sets it apart from $\mathbb{R}^{2}$: they are a field. So you can not only add complex numbers (as you can with any vectors), but you can also multiply them in a natural way. And this multiplication has very far reaching consequences. It is, for example, the reason, why complex differentiability is so much stronger than total differentiability in $\mathbb{R}^{2}$.
So what I - and others - want to say is that, for many practical purposes, it is very convenient (and justified) to consider a complex number as the sum of its real and imaginary part, as if they were the components of a two-dimensional vector. But complex numbers are much more than just vectors, which is what makes them so special - and so interesting.
Hope that helps!