Role of Group actions in Differential Geometry

This is a rather soft question, my hope is to bring some order into the stuff I would like to learn about differential geometry -- here it is:

I was told over and over again that Geometry has to do with angles, length of curves, curvature etc.

However, most graduate textbooks on Differential Geometry start with smooth manifolds and keep studying them without every mentioning the presence of a Riemannian metric. And then there are group actions acting on smooth manifolds -- here I see the use of the word "Geometry" as well when results are obtained regarding the basic structure of the manifold, such as the way orbits are arranged, whether there are special orbits and how orbits smoothly collapse, whether these are certain bundles and so on.

I guess my question is the following: Is the study of group actions on smooth manifolds "more fundamental" than Riemannian geometry, or can one reduce any group action on a manifold to the presence of a (unique?) Riemannian metric on $M$ and study that metric instead? If not, are there "geometric" aspects of a smooth manifold that one cannot frame in terms of a group action?

(Maybe I should add that this question is motivated in the context of real (as opposed to complex) smooth manifolds)

Riemannian geometry can be interpreted as the study of $O_n$-structures. A choice of Riemannian metric is equivalent to a choice of $O_n$-structure.