The examples $C_n, D_n, A_4, S_4, A_5$ are the first nice examples of groups to relate with 2-D and 3-D Euclidean geometry. These groups can be investigated by studying action on sphere as described in M. Artin's book on Algebra. Next, Fano plane is another nice object to relate the simple group of order 168 with (finite) geometry. Then, by considering the double cover $SU(2)$of $SO(3)$, we get few more finite groups (called double/binary groups). The good references to study these groups and geometry (as far as I saw) are
Geometries and Groups (Viacheslav, Shafarevich)
Groups: A path to Geometry (R. P. Burn)
Groups and Geometry (P.M. Neumann, etc.)
On Quaternions and Octonions (Conway, Smith).
Can one suggest more references (books, notes, articles) to see more finite groups with geometry?