A hand-wavy answer to the question in the title could be "3D rotations".
But I would like to build a solid and intuitive geometric understanding of the $SO(3)$ manifold together with the Lie group and the Lie algebra of 3D rotations.
I read this article on Lie algebras for 2D and 3D rotations, but I am confused when it comes 3D rotations. I would like to build a similar intuition for $SO(3)$ as I have formed for $SO(2)$.
2D Rotations
The article says the following about $SO(2)$:
$SO(2)$ is a 1D manifold living in a 2D Euclidean space, e.g. moving around a circle.
I seem to understand this intuitively; with 2D rotations, there is just 1 degree of freedom and in my mind the $SO(2)$ manifold looks exactly like the unit circle in $\mathbb{R}^2$.
Each point $p \in \mathbb{R}^2$ on the unit circle has its $X$ and $Y$ coordinate. The $X$ coordinate is the cosine and the $Y$ coordinate is the sine of the angle between the $X$ axis of the coordinate system and the vector $p$.
Given an arbitrary point $p$ on the unit circle, I can easily compute the angle $\alpha$ it corresponds to by e.g. $\alpha = cos^{-1}(p_x)$, where $p_x$ is the $X$ coordinate of the point $p$.
3D Rotations
This is where I am confused. The article says the following about $SO(3)$:
There are only 3 degrees of freedom in describing a rotation. But this object doesn’t live in 3D space. It is a 3D manifold, embedded in a 4-D Euclidean space.
If the $SO(3)$ manifold lives in 4D space, then each point on its surface seems to be an $r \in \mathbb{R}^4$. But what does each of the 4 components $r_x, r_y, r_z, r_w$ of $r$ represent (in the 2D case, it was sine and cosine of the angle)?
I also found this image. I assume that if the $SO(3)$ manifold is embedded in 4D space, then it cannot be visualized as a 3D sphere.
Moreover, the tangent space in the image is "just a 2D plane". If my understanding is correct, then the purpose of the tangent space (Lie algebra) is mainly to allow expressing angle parameters manipulation in a (linear) vector space (convenient for optimization problems) instead of a movement on the manifold (difficult for optimization problems).
Given that 3D rotations have 3 degrees of freedom, it would make more sense to me if the tangent space was 3D volume (with 3 DoF) instead of 2D plane (with 2 DoF). Is the image just an analogue for the $SO(3)$ manifold embedded in 4D?
I think I am missing something obvious. What is your intuitive understanding of the $SO(3)$ manifold and how do you visualize it?