Let $X$ be a finite set, i.e. that $|X| = n$, and let $G = \operatorname{Sym}(X)$ be the symmetric group on $X$. Let $Y \subseteq X$ be a subset of $X$ and define the subset $G_Y \subseteq G$ to be the set $G_Y = \{g \in G\mid \forall y \in Y:\ g(y) \in Y \ $and$\ g^{-1}(y) \in Y\ \}$, which is a subgroup of $G$.
I want to find the order of $G_Y$ as a function of $|X|=n$ and $|Y|$.
I have something but am not sure at all about it: We are looking for the number of bijections fixing $y \in Y$, thus, $|G_Y| = (|X|-1)!\cdot|Y|$.
Is this getting anywhere? Any help would be appreciated!