I think you already have a good interpretation of complex numbers algebraic view. So I propose here the geometric approach of this numbers, following Hamilton, Clifford and Grassmann geometric view of algebra.
First, we need to separate the meaning about the number (1) and the number (-1). You can do this for trying to count negative numbers as one does with positive numbers, e.g. one cup, two notes, three boxes, minus four houses???
The later seems meaningless because we have not added a good definition about (-). For this, we need to think in the number not only as a quantification, but as a quantification AND a direction. So (-1) is not just a number as (4), but a number that one can interpret as a quantity in a certain direction.
So the geometric view of (+) and (-) is that of symbols whose when fixed with number defines a direction in a certain quantity, e.g. If (+3) means 3 steps of unity in the certain direction, say right, then (-3) means 3 steps in the opposite direction. This could be demonstrated with the axiomatic approaches that my colleagues presented above, but I want to propose here just a geometric view of all this.
In the Euclidean Geometry, we can assert more than the opposite notion. If we suppose a segment $AB$, with a certain magnitude, when applying (-1) in the segment, we rotate it $\pi$ rad. So $AB=-BA$.
This notion can be extended to "when applying positive number to a segment, it contracts (when between 0 and 1), maintain or stretch this segment. But when negative number are applied, besides the homothety, it rotates through $\pi$ rad."
It's just a geometric view, I'm not proposing here any rigorous justifications.
But this is just in the $\mathbb{R}$ line. Let's extend this thought to $\mathbb{R}^2$ plane.
We already know that $(-1)$ means rotates in $\pi$ rad, but as we now have this two lines orthogonally positioned, we also need to define an application (a number) which could rotate the segment $\pi/2$ rad. Let's suppose a new type of number, whose faces i don't see, but algebraically i can give him a name (a letter), say $i$. So as we can see (and you could prove it using the axioms of above answers), when applying twice $i$ to this segment, it rotates to $\pi$ rad and we can assert that $i^2=-1$. In this view, the meaning $i=\sqrt{-1}$ is just a consequence of $i^2=-1$.
Now, as Kline say here, Hamilton pointed out that
A complex number $a+bi$ is not a genuine sum in the sense that $2 + 3$ is. The
use of the plus sign is a historical accident and $bi$ cannot be added to $a$. The
complex number $a + bi$ is no more than an ordered couple $(a, b)$ of real
numbers.
i suppose this answer your saying "In the beginning, when there were just reals, these operations were defined for them. Then, i was created, literally a number whose value is undefined"
This allows us to use the knowledge of vectors. Indeed, Hamilton knew that a complex number is nothing more that a ratio between two segments. If $AB$ and $AC$ are two segments conveniently positioned at the origin $A$, a complex number $z=a+bi=(a,b)=e^{i\theta}$, with $\theta$ the angle between the complex number $z$ and the origin, is the operation necessary to rotate and stretch the segment $AB$ to give $AC$, or $AB\cdot z=AC\to z=\frac{AC}{AB}$, which allows us to use complex numbers as a type of rotational numbers, as the negative numbers are a directional system of numbers.
And Hamilton gave latter a full usefulness of the imaginary numbers to also rotate in $\mathbb{R}^3$, where the Quaternions, a four dimensional algebra, was born. And you could ask "why a four dimensional system of numbers is required to rotate three dimensional directed segments (vectors)?"
I'm not allowed to answer this question here, but i can tell you to read about the Clifford Algebras, the Geometric Algebra, which are an excellent extension of Hamilton's Quaternions with the concept of Grassmann's exterior algebra. In the geometric algebra, real numbers, complex numbers, quaternions, biquaternions, and other n-dimensional systems of numbers are synthesized in a rigorous way giving to all this abstract algebraic views a good geometrical interpretation.