The geometrical picture is the following: We are asked to find the local extrema of the distance from the point $(0,b)$ on the $y$-axis to points on the parabola $y=x^2$. From looking at a figure we can guess the following: If $b\gg1$ there are two local minima high up, and a local maximum at $(0,0)$. If $0<b\ll1$ there is just one local minimum at $(0,0)$, and the same holds when $b\leq0$.
The intended computation goes as follows: Set up the Lagrangian
$$\Phi:=x^2+(y-b)^2+\lambda(y-x^2)\ ,$$
and solve the system
$$\Phi_x=2x-2\lambda x=0,\quad \Phi_y=2(y-b)+\lambda=0,\quad y=x^2\ .$$
From $x(1-\lambda)=0$ we infer (i) $x=0$ or (ii) $\lambda=1$. In case (i) we then obtain $y=0$ and a certain value of $\lambda$, and in case (ii) we obtain $y=b-{1\over2}$. The condition $y=x^2$ then implies that case (ii) only leads to real solutions if $b\geq{1\over2}$, and in this case we have $x=\pm\sqrt{b-{1\over2}}$.
It follows that Lagrange's method has confirmed our geometric analysis of the problem. Note however that it is quite cumbersome to do a second derivative test in the framework of this method. Instead we can do the following: Consider the parametric representation $x\mapsto (x,x^2)$ of the parabola, and instead of $f$ plus constraint look at the pullback
$$\psi(x):=f(x,x^2)=x^2+(x^2-b)^2\qquad(-\infty< x<\infty)\ .$$
Now analyze this function $\psi$ as a function of one variable. You will get the same results (depending on $b$) as before, and in addition the second derivative test will confirm what you knew all along. The case $b={1\over2}$ is special: Here the first nonvanishing derivative is $\psi^{(4)}(0)=24$. Since $4$ is even and $24>0$ we have a local minimum there.