Check out the Helmholtz decomposition.
It says that any vector field $\vec{F}$ can be written uniquely as $\vec{F} = \nabla \varphi + (\nabla \times \vec{A})$.
The gradient part is, of course, conservative, so it is the conservative part of $\vec{F}$.
The curl part vanishes for a conservative field because:
you can integrate along any loop
$$
\int_\gamma \vec{F} \cdot \vec{ds}
=
\int_\gamma (\nabla \phi + (\nabla \times \vec{A})) \cdot \vec{ds}
=
\int_\gamma (\nabla \times \vec{A}) \cdot \vec{ds}
$$
and that is zero (since $\vec{F}$ is conservative); on the other hand, by the Stokes theorem that last integral is also the flux of $(\nabla \times \vec{A})$ through any surface delimited by the loop $\gamma$; so $(\nabla \times \vec{A})$ is zero when integrated over any surface, however tiny, so it must be zero.