Define $F (x):= \int_{0}^x f(t)dt$
By integration by parts, we observe that:
$$\begin{align}\frac{1}{h}\int_{-h}^h f(x+t)tdt &= \frac{1}{h}\int_{0}^h \big[ f(x+t)-f(x-t)]tdt\\& = F(x+h)+F(x-h) - \frac{1}{h}\int_{0}^h \big[ F(x+t)+F(x-t) \big]dt
\end{align}$$
So the provided limit for f implies that for all $x \in \mathbb{R}$
$$T(F)(x)=0$$
Where $T$ is an operator defined as
$$T(g)(x)=\lim_{h \rightarrow 0^+} \frac{1}{h^2} \left\{ g(x+h)+g(x-h)-\frac{1}{h}\int_{0}^h \big[ g(x+t)+g(x-t)\big]dt \right\} $$
for any continuous function $g$.
Note that $T(g)$ is not necessarily defined on all points in $\mathbb{R}$.
Let $\epsilon$ be any positive number , $(a,b)$ be any interval in $\mathbb{R}$. Define the functions
$$G(x)= F(x)-F(a)-\frac{F(b)-F(a)}{b-a}(x-a)+\epsilon(x-a)(x-b)$$
and
$$H(x)= F(x)-F(a)-\frac{F(b)-F(a)}{b-a}(x-a)\boldsymbol{-}\epsilon(x-a)(x-b)$$
We prove that $G(x) \le 0$ everywhere on $[a,b]$. If not then, because $G(a)=G(b)=0$, there is a point $c \in (a,b)$ at which $G$ attains its positive maximum. Observe that:
$$T(G)(c)= \lim_{h \rightarrow 0^+} \frac{1}{h^2} \left\{ G(c+h)+G(c-h)-\frac{1}{h}\int_{0}^h \big[ G(c+t)+G(c-t)\big]dt \right\} $$
Because $c$ is a maxima of $G$, the function $u(t):=G(c+t)+G(c-t)$ attains its local maximum at $t=0$. So we can choose a strictly decreasing positive sequence $(h_n, n \in \mathbb{N})$ such that $h_n$ converge to $0$ and $h_n \in \text{argmin}_{ t \in [0,h_n]} u(t)$ for all $n$ . Thus,
$$ G(c+h_n)+G(c-h_n)-\frac{1}{h_n}\int_{0}^{h_n} \big[ G(c+t)+G(c-t)\big]dt \le 0$$
Thus $T(G)(c) \le 0$. Note that the limit $T(G)(c)$ exists because $T(F)$ exists and in fact, according to the definition, we see that:
$$T(G)(c)=0+0+\frac{4}{3}\epsilon>0 $$
Which is a contradiction to what we have just proven.
So $G(x) \le 0$ on $[a,b]$. Similarly, we can prove that $H(x) \ge 0$ everywhere on $[a,b]$. These give:
$$ \left| F(x)-F(a)-\frac{F(b)-F(a)}{b-a}(x-a) \right| \le \epsilon (b-a)^2$$
for all $\epsilon>0$ and $x \in [a,b]$. Hence forth the conclusion.
Side note: The hypothesis is fairly tight as we can show that the Cantor function satisfies the condition on an almost everywhere set of $\mathbb{R}$ even though it is not constant.