I read the statement that
$$\frac{1}{\zeta(s)} = \sum_{n=1}^\infty \frac{\mu(n)}{n^s} \textrm{ for } \Re(s) > 1 \qquad (*)$$
In fact I can guess what the proof is: just expand both $\zeta$ and the right hand side of (*) as an Euler product, use $\Re(s) > 1$ to handwave away any concerns of changing the order of taking limits and taking products and conclude that the outcome of multiplying the right hand side of (*) by $\zeta(s)$ is the product of infinitely many $1$'s, hence 1 itself. So far so good.
Now suppose I wanted to evaluate the the limit $s \to 1^+$ of the right hand side of ( * ) , or in layman's terms, compute the sum $\sum_{n=1}^\infty \frac{\mu(n)}{n}$. From (*) I would quickly conclude that
$$\sum_{n=1}^\infty \frac{\mu(n)}{n} = 0 \qquad (**)$$
since $\zeta(1) = \sum_{n=1}^\infty \frac{1}{n} = \infty$ (by the standard 'powers of 1/2'-argument) and, as we all know, $1/\infty = 0$. Very nice, very elementary, or... so it seems.
However the statement (**) is far from elementary: it is equivalent to the prime number theorem! (If you find that equivalence surprising: so did I. I asked a question about it three years ago, but the current question is about a different type of surprise that arises if we take this equivalence as given.)
We all know that the PNT is hard to prove. So what is wrong with simply taking the the limit $s \to 1$ in (*) as I did above? Am I secretly interchanging two limits where that is not allowed?
Where am I oversimplifying things?
I have a very vague feeling what is going on here (but perhaps I am completely off, so correct me if I am wrong) and that is that there is some weird theorem lurking in the background that states that we can only extend the equation (*) to the point $s = 1$ if and only if we can extend it to the entire line $\{s \colon \Re(s) = 1\}$. But what kind of weird theorem would that be? It goes again my nearly lifelong experience that one can do mathematics just fine without even realizing that complex numbers off the real line exist.