It is false: I would define something piecewise-constant and discontinuous at irrational $x$ such as $f : \mathbb{Q} \to \mathbb{Q}$ by:
$f(x) = 1$ for $x > \frac{1}{\sqrt{2}}$
$f(x) = \frac{1}{2}$ for $\frac{1}{3\sqrt{2}}<x<\frac{1}{2\sqrt{2}}$
$f(x) = \frac{1}{3}$ for $\frac{1}{4\sqrt{2}}<x<\frac{1}{3\sqrt{2}}$, and so on for positive $x$, and $f(0) = 0$.
Similarly for negative $x$ define:
$f(x) = -1$ for $x < -\frac{1}{\sqrt{2}}$
$f(x) = -\frac{1}{2}$ for $-\frac{1}{2\sqrt{2}}<x<-\frac{1}{3\sqrt{2}}$
$f(x) = -\frac{1}{3}$ for $-\frac{1}{3\sqrt{2}}<x<-\frac{1}{4\sqrt{2}}$
and so on. Then $f$ is differentiable (since constant) at all rational $x$ other than 0, and $f'(0) = \sqrt{2}$.