I saw this question recently, which asks for a "geometric" example where a certain automorphism doesn't exist. Since some counterexamples are well known, I thought it should be a simple task to convert a counterexample into a "geometric" version by looking at cayley graphs.
After thinking about it for a little while, I wasn't able to come up with a relationship between the cayley graph $\Gamma(G)$ and the automorphism group $\text{Aut}(G)$. Since $G$ acts naturally on $\Gamma(G)$ and $\text{Aut}(G)$ acts naturally on $G$, I (perhaps naively) thought that there should be a kind of "higher order" relationship between $\Gamma(G)$ and $\text{Aut}(G)$. After all, once we fix an "origin" in $\Gamma(G)$, we can identify the vertices with $G$.
It seems there is some precedent for special cases of this question (here and here), but I can't seem to find any more general descriptions.
The question, then:
Is there a relationship between $\text{Aut}(G)$ and $\Gamma(G)$? Is there a more natural geometric object that $\text{Aut}(G)$ acts on than the obvious $\Gamma(\text{Aut}(G))$? I would be interested more broadly in ways of understanding $\text{Aut}(\text{Sym}(X))$ in terms of $X$ for any object $X$ in some category, not necessarily Cayley Graphs.
Thanks in advance!