This is a partial answer. It attempt to justify some expressions I obtained for odd $m$ by manipulating the sums as divergence series.
What I have shown so far is for all odd $m \ge 3$ and $\le 99$, following sums
$$S_m \stackrel{def}{=} \sum_{n=1}^\infty (\sqrt{n} - \sqrt{n-1})^m$$
is a linear combination of zeta function at negative half-integer values.
For any $m > 0$, we have
$$(\sqrt{n} - \sqrt{n-1})^m = T_m(\sqrt{n}) - U_{m-1}(\sqrt{n})\sqrt{n-1}$$
where $T_m(x)$, $U_{m-1}(x)$ are the Chebyshev polynomials of first and second kind.
When $m = 2\ell+1$ is odd, $T_m(x)$ is an odd polynomial in $x$ with degreee $2\ell+1$ and $U_{m-1}(x)$ is an even polynomial in $x$ with degree $2\ell$. We can rewrite the partial sum of $S_m$ as
$$\begin{align}
S_{m,p} \stackrel{def}{=} \sum_{n=1}^p (\sqrt{n}-\sqrt{n-1})^m
& = \sum_{n=1}^p \left(T_m(\sqrt{n})-U_{m-1}(\sqrt{n})\sqrt{n-1} \right)\\
& = \left(\sum_{n=1}^p \left(T_m(\sqrt{n})-U_{m-1}(\sqrt{n+1})\sqrt{n}\right)\right)
+ U_{m-1}(\sqrt{p+1})\sqrt{p}
\end{align}
$$
What's inside the sum of last line will be $\sqrt{n}$ times a polynomial in $n$ of degree $\ell$.
Let $\alpha_0, \alpha_1, \cdots \alpha_\ell$ be the coefficients of this polynomial. i.e.
$$T_m(\sqrt{n})-U_{m-1}(\sqrt{n+1})\sqrt{n}
= \sum_{k=0}^\ell \alpha_k n^{k+1/2}$$
In terms of them, we have
$$S_{m,p} = \sum_{k=0}^\ell \alpha_k \sum_{n=1}^p n^{k+1/2} + U_{2\ell}(\sqrt{p+1})\sqrt{p}$$
For any $s > 0, \notin \mathbb{Z}$, we have following asymptotic expansion${}^{\color{blue}{[1]}}$
$$\sum_{n=1}^p n^s - \zeta(-s) \asymp \frac{1}{s+1}\sum_{k=0}^\infty \binom{s+1}{k} (-1)^k B_k p^{s+1-k}$$
Let $\Lambda(s,p)$ be the finite sum of those terms on RHS which diverges
as $p \to \infty$.
$$\Lambda(s,p) \stackrel{def}{=} \frac{1}{s+1}\sum_{k=0}^{\left\lfloor s + 1 \right\rfloor} \binom{s+1}{k} (-1)^k B_k p^{s+1-k}$$
By construction, these counter-terms will kill the divergence in the sum $\sum\limits_{n=1}^p n^s$ as $p \to \infty$.
More precisely, we have
$$\lim_{p\to\infty} \left( \sum_{n=1}^p n^s - \Lambda(s,p) \right) = \zeta(-s)$$
Rewrite the partial sums again, we have
$$S_{m,p} = \sum_{k=0}^\ell \alpha_k \left( \sum_{n=1}^p n^{k+1/2} - \Lambda(k+1/2,p)\right)
+
\underbrace{ \sum_{k=0}^\ell \alpha_k \Lambda(k+1/2,p)
+ U_{2\ell}(\sqrt{p+1})\sqrt{p}}_{R(m,p)}$$
If the piece $R(m,p)$ in above expression vanishes identically, we will have
$$S_m = \lim_{p\to\infty} S_{m,p} = \sum_{k=0}^\ell \alpha_k \zeta(-(k+1/2))$$
I don't know how to prove $R(m,p)$ vanish for general $m$. However, for odd $m \le 99$, I have used a CAS to compute $R(m,p)$ symbolically and verify all of them vanish identically.
As a result, for odd $m \le 100$, $S_m$ is a linear combination
for $\zeta(z)$ at negative half-integer values.
For reference, following is a short list of $S(m)$ for small odd $m$.
$$
\begin{align}
S_3 &= -6 \zeta(-1/2)\\
S_5 &= -40 \zeta(-3/2)\\
S_7 &= -14 \zeta(-1/2) -224 \zeta(-5/2) \\
S_9 &= -240 \zeta(-3/2) -1152 \zeta(-7/2)\\
S_{11} &= -22 \zeta(-1/2) -2464 \zeta(-5/2) -5632 \zeta(-9/2)\\
S_{13} &= -728 \zeta(-3/2) -19968 \zeta(-7/2) -26624 \zeta(-11/2)\\
S_{15} &= -30 \zeta(-1/2) -12096 \zeta(-5/2) -140800 \zeta(-9/2) -122880 \zeta(-13/2)\\
\end{align}
$$
Notes
- $\color{blue}{[1]}$ - I found this expansion in an exercise of Frank W.J. Olver's book "Asymptotics and Specical Functions". Look at $\S 8.3$ "Contour integral for the remainder term" for more info on this type of expansion.