Let $P$ be a finite nonabelian simple group. Let $G$ satisfy
$$ P\leqslant G \leqslant {\rm Aut}(P), $$
where $P$ is identified with $\rm{Inn}(P)$. I am trying to see if
$$ {\rm Aut}(G)\cong N_{{\rm Aut}(P)}(G) $$
Here is my attempt.
Firstly, since ${\rm Z}(G)=1$, we have $G\cong{\rm Inn}(G)$ sitting inside ${\rm Aut}(G)$. Now, $P$ is characteristic in $G$, which implies the existence of a homomorphism $\varphi: {\rm Aut}(G)\to {\rm Aut}(P)$. Clearly, $\varphi$ is injective iff $G$ has no proper automorphisms that act identically on $P$. Suppose that this is the case. Then ${\rm Aut}(G)\subseteq N_{{\rm Aut}(P)}(G)$. Conversely, every nontrivial element of ${\rm Aut}(P)$ that normalizes $G$ must induce a nontrivial automorphism on it, and we have the reverse inclusion.
If the above is correct, it remains to answer
Question. Is it true that $G$ has no nontrivial automorphisms that act identically on $P$?
Any thoughts on this would be appreciated.