New Answer. Let $S_N$ denote the partial sum for the first $N$ terms. Then $S_N$ is related to the Stirling's Formula by the following computation:
\begin{align*}
S_N
&= \sum_{n=1}^{N} \left(n+\frac{1}{2}\right)\log(n+1) - \sum_{n=1}^{N} \left(n+\frac{1}{2}\right)\log n - N \\
&= \left(N+\frac{1}{2}\right)\log (N+1) - \log (N!) - N.
\end{align*}
Now we consider $e^{-S_N}$ instead. Using the formula $\int_{0}^{\infty}x^{n}e^{-sx}\,\mathrm{d}x=\frac{n!}{s^{n+1}}$,
\begin{align*}
\exp(-S_N)
&= \frac{N!e^{N}}{(N+1)^{N+\frac{1}{2}}} \\
&= \frac{N^{N+1}}{(N+1)^{N+\frac{1}{2}}} \int_{0}^{\infty} x^N e^{-N(x-1)} \, \mathrm{d}x \\
&= \frac{1}{(1+\frac{1}{N})^{N+\frac{1}{2}}} \int_{-\infty}^{\infty} \left(1 + \frac{u}{\sqrt{N}}\right)_{+}^N e^{-\sqrt{N}u} \, \mathrm{d}u,
\end{align*}
where we utilized the substitution $x=1+\frac{u}{\sqrt{N}}$ in the last step and $x_{+}:=\max\{0,x\}$ denotes the positive part of $x$. Then, taking limit as $N\to\infty$ and assuming for a moment that the order of limit and integral can be swapped, we get
\begin{align*}
\lim_{N\to\infty} \exp(-S_N)
&= \biggl( \lim_{N\to\infty} \frac{1}{(1+\frac{1}{N})^{N+\frac{1}{2}}} \biggr) \int_{-\infty}^{\infty} \lim_{N\to\infty} \left(1 + \frac{u}{\sqrt{N}}\right)_{+}^N e^{-\sqrt{N}u} \, \mathrm{d}u \\
&= \frac{1}{e} \int_{-\infty}^{\infty} e^{-u^2/2} \, \mathrm{d}u
= \frac{\sqrt{2\pi}}{e}.
\end{align*}
Here, the last step follows from the gaussian integral. Therefore
$$ \sum_{n=1}^{\infty} \left[ \left(n+\frac{1}{2}\right)\log\left(1+\frac{1}{n}\right)-1 \right] = \lim_{N\to\infty} S_N = 1 - \log\sqrt{2\pi} $$
provided the interchange of limit and integral is justified. For this, we note the following inequality:
$$ \log(1+x) \leq x - \frac{x^2}{2(1+x_+)}, \qquad x > -1 $$
From this, we deduce that
$$
\left(1 + \frac{u}{\sqrt{N}}\right)_{+}^N e^{-\sqrt{N}u}
\leq \exp\left(-\frac{u^2}{2(1+u_+)}\right)
$$
holds for all $N\geq 1$ and for all $u \in \mathbb{R}$. Therefore the dominated convergence theorem is applicable and the desired step is justified, completing the proof.
Old Answer. The sum converges absolutely by the Limit Comparison Test with $\zeta(2)$. Now for each given $n \geq 1$,
\begin{align*}
\left(n+\frac{1}{2}\right)\log\left(1+\frac{1}{n}\right)-1
&= \left(n+\frac{1}{2}\right)\left(\sum_{j=1}^{\infty}\frac{(-1)^{j-1}}{jn^j} \right)-1\\
&= - \frac{1}{4n^2} + \left(n+\frac{1}{2}\right)\sum_{j=3}^{\infty}\frac{(-1)^{j-1}}{jn^j}\\
&= - \frac{1}{4n^2} + \sum_{j=3}^{\infty}\frac{(-1)^{j-1}}{j}\left(\frac{1}{n^{j-1}}+\frac{1}{2n^j}\right).
\end{align*}
Using the formula $\int_{0}^{\infty}x^{s-1}e^{-nx}\,\mathrm{d}x=\frac{\Gamma(s)}{n^s}$, this may be recast as
\begin{align*}
&= \int_{0}^{\infty}\left[ - \frac{x}{4} + \sum_{j=3}^{\infty}\frac{(-1)^{j-1}}{j}\left( \frac{x^{j-2}}{(j-2)!} + \frac{x^{j-1}}{2(j-1)!} \right)\right] e^{-nx}\, \mathrm{d}x \\
&= \int_{0}^{\infty} \left( \frac{1}{x} - \left(\frac{1}{2x}+\frac{1}{x^2}\right)(1-e^{-x}) \right) e^{-nx} \, \mathrm{d}x.
\end{align*}
Summing this for $n = 1, 2, \dots$, we get
\begin{align*}
S
&:= \sum_{n=1}^{\infty} \left[ \left(n+\frac{1}{2}\right)\log\left(1+\frac{1}{n}\right)-1 \right] \\
&= \int_{0}^{\infty} \left( \frac{1}{x} - \left(\frac{1}{2x}+\frac{1}{x^2}\right)(1-e^{-x}) \right) \frac{1}{e^x - 1} \, \mathrm{d}x \\
&= \int_{0}^{\infty} \left( \frac{1}{x(e^x - 1)} - \left(\frac{1}{2x}+\frac{1}{x^2}\right)e^{-x} \right) \, \mathrm{d}x.
\end{align*}
To compute the right-hand side, we consider the following regularization:
\begin{align*}
S(s)
&:= \int_{0}^{\infty} \left( \frac{1}{x(e^x - 1)} - \left(\frac{1}{2x}+\frac{1}{x^2}\right)e^{-x} \right) x^s \, \mathrm{d}x \\
&= \int_{0}^{\infty} \left( \frac{x^{s-1}}{e^x - 1} - \frac{1}{2}x^{s-1}e^{-x} - x^{s-2}e^{-x} \right) \, \mathrm{d}x.
\end{align*}
This function is analytic for $\operatorname{Re}(s) > -1$, and $S = S(0)$. Moreover, for $s > 2$, we easily find that
\begin{align*}
S(s)
&= \Gamma(s)\zeta(s)-\frac{1}{2}\Gamma(s)-\Gamma(s-1) \\
&= \Gamma(s+1)\biggl( \frac{\zeta(s)-\frac{1}{2}-\frac{1}{s-1}}{s} \biggr).
\end{align*}
By the principle of analytic continuation, this identity must hold on all of $\operatorname{Re}(s)>-1$. So, letting $s \to 0$ to the above formula yields
$$ S = \lim_{s\to 0}S(s) = 1 + \zeta'(0). $$
Now the desired formula follows from $\zeta'(0) = -\log\sqrt{2\pi}$.