In Cox's book "Primes of form $x^2 + ny^2$", I stumbled upon a lemma $ \newcommand{\Z}{\mathbb{Z}} $
Lemma 1.14: If $D \equiv 0,1 \pmod{4}$ is a nonzero integer, then there is a unique homomorphism $\chi:(\Z/D\Z)^* \longrightarrow \{\pm 1\}$ such that $\chi([p]) = (D/p)$ for odd primes $p$ not dividing $D$. Furthermore, $\chi([-1]) = \operatorname{sign}(D)$.
One can prove this using quadratic reciprocity. But later on in one of the exercises, Cox suggests to prove quadratic reciprocity using this lemma - Problem 1.13 - we assume Lemma 1.14 holds for all nonzero $D\equiv 0,1 \mod4 $ and using this assumption we prove quadratic reciprocity.
He gives a hint, for two primes $p,q$, use $D=q^*=q(-1)^\frac{q-1}{2}$. Then $\chi = (q^*/\cdot)$ is one homomorphism, and $(\cdot/q)$ is another homomorphism from $(\Z/q\Z)^*$ to $\{\pm 1\}$. Since $(\Z/q\Z)^*$ is cyclic, there are only two homomorphisms from $(\Z/q\Z)^*$ to $\{\pm 1\}$. One of them is the trivial homomorphism, and the other one is the Legendre symbol, which is non-trivial. If they were equal then $\chi([p]) = (q^*/p)=(p/q)$ which proves quadratic reciprocity.
The only thing left to finish the proof would be to show that $\chi$ is not trivial. One way to do it is by showing that $\pm q$ is not a square modulo at least one prime coprime to $q$, but the only way I know to do that is either by using quadratic reciprocity or with an overkill using Chebotaryev.
Is there a simpler method to prove
For every odd prime $q$ there exists an odd prime $p$ such that $(q^*/p) = -1$.
or just
The unique homomorphism $\chi:(\Z/D\Z)^* \longrightarrow \{\pm 1\}$ that satisfies $\chi([p]) = (D/p)$ is not trivial when $D = q^*$.