There are two points which you need to understand here.
First you need to observe that one of the hypotheses of L'Hospital's Rule is that the limit of $f'(x) /g'(x) $ exists as $x\to p$. However, this does not necessarily imply that the limits of $f'(x), g'(x) $ exist as $x\to p$. If these limits do exist and limit of $g'(x) $ is non-zero then quotient rule applies as indicated in your question.
But as a thumb rule while applying L'Hospital's Rule always try to think of the ratio $f'(x) /g'(x) $ as a single expression instead of a quotient and try to simplify it and evaluate its limit. The idea behind the rule is that the ratio of derivatives will be simpler in some manner than ratio of the original functions (this is most obvious when we differentiate polynomials and reduce the degree by one).
One must avoid repeated applications of the rule unless absolutely necessary. The typical view of L'Hospital's Rule is differentiate and plug, but in reality it should be differentiate, simplify and evaluate limit.
The second point is more subtle and often overlooked. In order that $\lim_{x\to p}f'(x) $ makes sense a prerequisite is that $f$ must be differentiable in a deleted neighborhood of $p$. If this prerequisite is met then we know that $$f'(x) =\lim_{h\to 0}\frac{f(x+h)-f(x)}{h}$$ and thus $$\lim_{x\to p} f'(x) =\lim_{x\to p} \lim_{h\to 0}\frac{f(x+h)-f(x)}{h}$$ The expression on right side in above equation is what one calls an iterated limit and the order of limit operations matters here.
Assuming that we can change the order of limit operation we get $$\lim_{h\to 0}\lim_{x\to p} \frac{f(x+h) - f(x)} {h} $$ Further assuming continuity of $f$ at $p$ we can simplify the expression above as $$\lim_{h\to 0}\frac{f(p+h)-f(p)}{h}=f'(p)$$ provided $f$ is also differentiable at $p$.
So what you write in second part of your question obviously requires differentiability of $f$ at $p$, but more importantly it requires that the order of limit operations can be changed. Unfortunately this is difficult to guarantee.
It is quite possible that $f$ is differentiable at $p$ and yet $\lim_{x\to p} f'(x) $ does not exist. However there is some hope and surprise left due to the following result:
Theorem: If $f$ is continuous at $p$ and $\lim_{x\to p} f'(x) $ exists then $f$ is differentiable at $p$ and $\lim_{x\to p} f'(x) =f'(p) $.
Try to prove the above theorem using definition of derivative and mean value theorem.