First, a remark: a convex lower semicontinuous function is weakly lower semicontinuous. Indeed, lower
semicontinuity is equivalent to the epigraph being closed in the appropriate topology. The epigraph
of a convex function is convex. A closed convex set is weakly closed.
Fix $\lambda>0$. For any $y$, the function $g_{y}(x)= f(y)+\frac{1}{2\lambda}|x-y|^2$ is convex. Taking infimum on both sides of $g_y((1-t)a+tb)\le (1-t)g_y(a)+tg_y(b)$, we find that $f_\lambda$ is convex.
Now fix $x$ and pick a sequence $(y_n)$ such that $g_{y_n}(x)\to f_\lambda(x)$. It is not hard to see that $g_y(x)\to +\infty$ when $\|y\|\to \infty$. Therefore, the sequence $(y_n)$ is bounded. Since we are in a reflexive space, there is a weakly convergent subsequence $y_{n_k}\to z$. Since $f$ is weakly lower semicontinuous (and so is the squared norm), it follows that $g_z(x) \le f_\lambda(x)$. Thus, the infimum in the definition of $f_\lambda$ is attained: $g_z(x) = f_\lambda(x)$.
For any other point $x' $ we have $f_\lambda(x')\le g_z(x') $. Hence
$f_\lambda(x')-f_\lambda(x) \le g_z(x')-g_z(x) $. Since the squared norm is differentiable, so is $g_z$. As $x'\to x$,
we find that $f_\lambda(x')-f_\lambda(x) \le \varphi(x'-x)+o(1)$ where $\varphi\in X^*$
is the derivative of $g_z$ at $x$. On the other hand, convexity implies
$f_\lambda(x')-f_\lambda(x)\ge \psi(x'-x)$ for some $\psi\in X^*$. It follows that $\varphi=\psi$, and this functional
is the Fréchet derivative of $f_\lambda$ at $x$.