Strictly speaking, you can't just make definitions and hope they work. Practically speaking though, mathematicians have a lot of machinery built precisely to make sense of definitions that basically go, "Hm, I wish I had a element that had this property" - and these sorts of definition are ubiquitous in many branches of math. This extends well beyond defining arithmetic on the complex numbers, but let me briefly explain how one may define $\mathbb C$ using the machinery that exists for algebraic structures.
There's a pretty common way to define the complex numbers that basically just says "$\mathbb C$ can be constructed by adding to $\mathbb R$ an extra element $i$ such that $i^2=-1$." You usually avoid square roots in any definition since they're a bit ambiguous. This definition reads as follows:
$$\mathbb C = \mathbb R[i]/(i^2+1)$$
This is a ring theoretic construction, so let me unpack it: we're going to construct $\mathbb C$ from $\mathbb R$ in two steps:
Consider first the polynomial ring $\mathbb R[i]$. This consists of every polynomial in some variable $i$ - so has terms such as $i^3+i^2+17i+289$ or $i^{100}$ or just real constants such as $\pi$ - all with the usual rules for adding and multiplying. Polynomial rings capture the idea of "adding" or "adjoining" a new variable to a given ring without specifying any particular properties thereof. If you wanted to add a new variable, but didn't know anything about it, this is what you'd get.
The $/(i^2+1)$ part of the definition says: Take that polynomial ring, and now consider two polynomials $P(i)$ and $Q(i)$ to be equivalent if their difference $P(i)-Q(i)$ is a multiple of $i^2+1$. This is a bit of a tricky thing to get your head around, but note that $i^2$ is equivalent to $-1$ since their difference is $1\cdot (i^2+1)$. Similarly, $i^4$ is equivalent to $1$ since the difference satisfies the relation:
$$i^4-1=(i^2-1)(i^2+1)$$
where these are equations of polynomials (and are true of any variable or value as input for $i$).
The second rule, as it turns out, makes every polynomial equivalent to one of the form $a+bi$ - if you have a quadratic or higher term, you can find some multiple of $i^2+1$ with the same leading term as your quadratic, and subtract this multiple from your original polynomial, leading to an equivalent polynomial of lesser degree. Algorithmically, if you wanted to figure out what $i^3+2i^2$ is, you would first subtract $i\cdot (i^2+1)=i^3+i$ from this to get $2i^2-i$, then subtract $2(i^2+1)$ from that to get that your original polynomial $i^3+2i^2$ is equivalent to $-i-2$. This process is known as polynomial long division.
Note that addition and multiplication rules can then be derived - for instance
$$(a+bi)+(c+di)=(a+b)+(c+d)i$$
is just ordinary addition of polynomials. For multiplication you get:
$$(a+bi)(c+di)=ac+(ad+bc)i+bdi^2$$
as polynomials and then you can subtract $bd(i^2+1)$ (which is equivalent to $0$) to get:
$$(a+bi)(c+di)=(ac-bd)+(ad+bc)i$$
in $\mathbb C$.
It turns out that this definition is really the same (in a sense that can be made precise as a universal property in category theory) as saying (where a "ring" is just a structure in which addition and multiplication are sensibly defined):
$\mathbb C$ is a ring containing $\mathbb R$ and an extra element $i$ where the only equalities between elements are those that can be proven from the assumption that $i^2+1=0$.
And the prior equations can be interpreted in this context too - if we knew that
$i^2=-1$, deducing that $(a+bi)(c+di)=(ac-bd)+(ad+bc)i$ would simply be done by distribution followed by a substitution. The explicit ring theoretic construction is mostly needed to ensure that there actually is some sensible $\mathbb C$ that realizes this property - however, these sorts of constructions exist in great generality; if all you want to do is add, subtract, and multiply (but not necessarily divide), you can basically add however many variables you like and demand that they satisfy as many polynomial equations as you want, and you'll get, well, something out - though that thing can be badly behaved in many ways (even in ways as extreme as "oops, everything equals zero now"). The complex numbers, however, turn out to be a very well-behaved example of such a construction, fundamentally because $i^2+1$ cannot be factored as a real polynomial.
It's a bit more tricky when you want to talk about analysis and topology (since this construction only deals with algebraic not analytical properties), but this is not a particularly great obstacle - this definition can be refined in various ways to preserve those kinds of structures too.