I believe your understanding of the term antiderivative is correct. A function $F:[a,b] \to \mathbb{R}$ is an antiderivative of $f:[a,b] \to \mathbb{R}$, if it is differentiable and $F'(x) = f(x)$ for all $x \in [a,b]$.
It seems then the question is if $f$ has an antiderivative, then is it necessary that the function $x \mapsto |f(x)|$ has an antiderivative. Specifically, does there exist differentiable $G:[a,b] \to \mathbb{R}$ such that $G'(x) = |f(x)|$ for all $x \in [a,b]$?
The answer is no -- it is not necessary.
A counterexample is
$$f(x) = \begin{cases}\cos(x^{-1}), & 0 < x \leqslant 1 \\ 0, & x= 0 \end{cases}$$
Here $f$ has an antiderivative
$$F(x) = \int_0^x \cos (t^{-1}) \, dt$$
Since $f$ is continuous on $(0,1]$ we have, directly by the FTC, that $F'(x) = \cos(x^{-1})$ for $0 < x \leqslant 1$. We can also verify that $F(0) = 0$ and
$$\tag{*}F'(0) = \lim_{x \to 0} \frac{F(x) - F(0)}{x} = \lim_{x \to 0}\frac{1}{x}\int_0^x \cos (t^{-1}) \, dt = 0 = f(0) $$
The details of deriving the limit (*) are given here.
On the other hand, we have
$$g(x) = |f(x)| = \begin{cases}|\cos(x^{-1})|, & 0 < x \leqslant 1 \\ 0, & x= 0 \end{cases}$$
Suppose there exists an antiderivative $G$ such that $G'(x) = g(x)$ for all $x \in [0,1]$. Since $g$ is Riemann integrable (continuous except at one endpoint), it follows by the FTC that
$$G(x) - G(0) = \int_0^x g(t) \, dt$$
By continuity of $g$, clearly have $G'(x) = |\cos(x^{-1}|$ for $0 < x \leqslant 1$.
However,
$$\tag{**}G'(0) = \lim_{x \to 0} \frac{G(x) - G(0)}{x} = \lim_{x \to 0}\frac{1}{x}\int_0^x |\cos (t^{-1})| \, dt = \frac{2}{\pi} \neq 0 = g(0) $$
The details of deriving the limit (**) are given here in robjohn's answer.
This proves that no such antiderivative $G$ exists.
Aside
The issue of integrability of $f$ is peripheral as there are Riemann integrable functions without antiderivatives. Furthermore, if we have
$$F(x) = \int_{[a,x]} f,$$
as a Lebesgue integral and $F'(x) = f(x)$ almost everywhere but not for every $x \in [a,b]$, then $F$ does not qualify as an antiderivative.