Let $H\le G$ and $g_1,g_2 \in C_G(H)$; then:
$$\forall h \in H, g_1g_2=g_1(hh^{-1})g_2=(g_1h)(h^{-1}g_2)=(hg_1)(g_2h^{-1})=h(g_1g_2)h^{-1} \tag 1$$
But $g_1g_2=g_2^{-1}(g_2g_1)g_2$, thence $(1)$ reads:
$$\forall h \in H, g_1g_2=h(g_1g_2)h^{-1}=h(g_2^{-1}(g_2g_1)g_2)h^{-1}=(hg_2^{-1})(g_2g_1)(hg_2^{-1})^{-1} \tag 2$$
Now, if $H=C_G(g)$, then $C_G(H) \le H^{(*)}$, so $\exists \bar h \in H \mid g_2=\bar h$; therefore $(2)$ implies:
$$g_1g_2=(\bar hg_2^{-1})(g_2g_1)(\bar hg_2^{-1})^{-1}=g_2g_1 \tag 3$$
Since $g_1,g_2$ are arbitrary in $C_G(C_G(g))$, this latter is abelian.
$^{(*)}$ In fact, let $H=C_G(g)$ and $\tilde g \in C_G(H)$; thence, $\tilde gh=h\tilde g, \forall h \in H$. Now, by definition of centralizer of $g$, it is $g \in H$; suppose, by contrapositive, $\tilde g \notin H$; thence, $\tilde gg \notin H \Rightarrow \tilde ggg\ne g\tilde gg \Rightarrow$ ($\tilde g$ commutes with every $h \in H$, and $g \in H$) $g\tilde gg \ne g\tilde gg$: contradiction. So, $\tilde g \in C_G(H) \Rightarrow \tilde g\in H$, whence $C_G(H)\le H$.