I solved it by rewriting the limit as indeterminate form $0/0$, then apply L'Hopital's rule 4 times, It was really lengthy and easy to make mistakes, If anyone got a better approach, please tell me!
$$ \begin{align} \lim_{x\to0^+}(\cot x-\frac{1}{x})(\cot x+\frac{1}{x})&=\lim_{x\to0^+}\frac{x^2\cos^2x-\sin^2x}{x^2\sin^2 x}\\ \vdots\\ &=\lim_{x\to0^+}\frac{-16\cos 2x+\ldots}{24\cos 2x+\ldots}\\ &=-\frac{2}{3} \end{align} $$