I will argue that yes, if that $x:[t_0,\beta[\times W\to\mathbb R^n$ exists then it is continuous.
Let's prove sequential continuity: fix $(t_n,\alpha_n)$ converging to $(t^*,\alpha_0)$ (all in $[t_0,\beta[\times W$). We need to show $x(t_n,\alpha_n)\to x(t^*,\alpha_0).$ We will construct a neighbourhood of $(t^*,\alpha_0)$ on which $x$ is continuous, and since some tail of the sequence $(t_n,\alpha_n)$ is in this neighbourhood, this will give the necessary convergence. Set $T=\tfrac12(t^*+\beta),$ so $t_0\leq t^*<T<\beta.$
By Lemma 1 below there exist $A,X,L>0$ such that whenever $t,\alpha$ satisfy:
- $0\leq t\leq T$ and
- $\|\alpha-\alpha_0\|\leq A$ and
- $\|x(t,\alpha)-x(t,\alpha_0)\|\leq X$
then
$$\|x_1(t,\alpha)-x_1(t,\alpha_0)\|\leq L(\|\alpha-\alpha_0\|+\|x(t,\alpha)-x(t,\alpha_0)\|).\tag{*}$$
If necessary, shrink $A$ further to ensure that $g$ is Lipschitz on the region $\|\alpha-\alpha_0\|\leq A.$ This is possible by the local Lipschitz property of $g.$
By continuity of $g$, we can shrink $A$ if necessary to also ensure that whenever $\|\alpha-\alpha_0\|\leq A$ we have
$$\|\alpha-\alpha_0\|, \|g(\alpha)-g(\alpha_0)\|\leq \tfrac 1 2 X e^{-LT}.$$
We will now show:
$$\|x(t,\alpha)-x(t,\alpha_0)\|\leq(\|\alpha-\alpha_0\|+\|g(\alpha)-g(\alpha_0)\|)e^{Lt}\tag{G}$$
for all $0\leq t\leq T$ and $\|\alpha-\alpha_0\|\leq A.$ Note that the right-hand-side is at most $X.$
Suppose not. Fix some $\alpha$ for which (G) fails. There are two cases:
- (G) fails very badly: $\|x(t,\alpha)-x(t,\alpha_0)\|\geq X$ for some $0\leq t<T$ and $\|\alpha-\alpha_0\|\leq A$
- (G) fails mildly: $\|x(t,\alpha)-x(t,\alpha_0)\|\leq X$ for some $0\leq t\leq T$ and $\|\alpha-\alpha_0\|\leq A$
For the very bad case, we can take $t$ to be infimal such that $\|x(t',\alpha)-x(t',\alpha_0)\|\geq X,$ for some fixed $\alpha.$ In the mild case, just pick any $(t,\alpha)$ such that (G) fails. We now apply Gronwall's inequality to (*); for both the very bad and mild cases, we have arranged that (*) applies for all smaller $t.$ Gronwall gives:
\begin{align*}
\|x(t,\alpha)-x(t,\alpha_0)\|
&\leq \|\alpha-\alpha_0\|+\|x(t,\alpha)-x(t,\alpha_0)\|\\
&\leq (\|\alpha-\alpha_0\|+\|g(\alpha)-g(\alpha_0)\|)e^{Lt}
\end{align*}
as required. This proves (G).
This means that solutions starting close to $\alpha_0$ stay in the set $\|x(t,\alpha)-x(t,\alpha_0)\|\leq X$. This means they obey an ODE with a global Lipschitz condition on $[0,T]$. We can therefore apply Lemma 2 below to get a neighbourhood of $(t^*,\alpha_0)$ on which $x$ is continuous.
Lemma 1
For this argument we need that there is a neighbourhood of $C=\{(t,\alpha_0,x(t,\alpha_0))\mid 0\leq t\leq T\}$ on which $f$ is Lipschitz. Note that $C$ is compact - it's the graph of the continuous function $x|_{[0,T]\times \{\alpha_0\}}.$ So this is a special case of the more general statement:
For all metric spaces $X,Y$, compact subsets $C\subseteq X$, and locally Lipschitz functions $f:X\to Y$, there exists a neighbourhood of $C$ on which $f$ is Lipschitz.
The proof is to suppose otherwise. Then for each $n\geq 1$ there are distinct points $x_n,x'_n$ in the $1/n$-neighbourhood $B_X(C,1/n)$ with $d_Y(f(x_n),f(x'_n))\geq n d_X(x_n,x'_n) $. By compactness of $C$ we can restrict to a subsequence $n_k\to\infty$ such that $x_{n_k}$ and $x'_{n_k}$ converge to some $x\in C$. Since $f$ is locally Lipschitz, there exist $L,\epsilon>0$ such that $f$ is $L$-Lipschitz on $B(x,\epsilon)$. But for sufficiently large $k$ we have $x_{n_k},x'_{n_k}\in B(x,\epsilon)$ and $n_k>L$, which contradicts the choice of $x_{n_k},x'_{n_k}.$
Lemma 2
If $f$ is Lipschitz on $V'\subseteq V$, and $g$ is Lipschitz on $W'\subseteq W$, and $(t,\alpha,x(t,\alpha))\in V'$ for all $(t,\alpha)\in[0,T]\times W'$, then $x$ is continuous on $[t_0,T)\times W'.$
This is stated as known in the original question.