The remark "set $i^2=−1$ and assume all other algebraic properties work as usual" (quoted by @JackM in the comments) is indeed vague, but it's a good intuition to hold on to (the other answers here are more precise than what I'm about to say, but in their detail miss what I think is the key insight when teaching complex numbers).
You know about the real numbers: you can add, subtract, multiply and divide; you can therefore do squares and take the square roots of some numbers; and all this makes sense, or hangs together, in the sense that there are properties such as "if $a = 1/b$, then $a \cdot b = 1$", and so on.
You know about matrices: you can add, subtract and multiply these, and while there are properties such as "if $A = -B$ then $A+B=0$" for addition and subtraction, there's no way of defining division by a matrix in any way which respects the same sort of arithmetical rules that we have for Reals.
Now imagine there's a thing called $i$. We don't care (for the moment) what it 'is' nor how to represent it, but we decide that it has the property that $i \cdot i= -1$ (so it's clearly not a Real number). Can we do anything with this number?
The answer is yes, we can, and the elementary introduction to complex numbers consists of demonstrating that we can define addition, subtraction, multiplication and division of complex numbers in a way that results in these operations having the same properties that we find in the arithmetic of the Real numbers.
This is a very Big Deal, not least because it is (historically) one of the first suggestions that those rules of arithmetic are not specific to the Real numbers, but a possible object of study themselves (and further down this road lies group theory, and the study of rings, and modules, and all that jazz).
Just by the way: One of my undergraduate epiphanies when studying complex analysis – which is the attempt to do calculus with complex numbers rather than just reals – is the point when I realised what the difference was between complex analysis and (2D) vector analysis: only in complex analysis can you define the derivative using plain old $\lim_{{\mathrm d}x\to 0} [f(x+{\mathrm d}x)-f(x)]/{\mathrm d}x$, where ${\mathrm d}x$ is a complex number, because only in the complex plane can you divide by ${\mathrm d}x$ in this way; differentiation has to be defined in a more roundabout way on the 2D plane, precisely because there's no operation of 'dividing by a vector'. It's that fact (well, that plus the Cauchy-Riemann condition) that gives the complex plane the huge (amazing) amount of structure that complex analysis reveals it has.