Why do you need tensors of rank $>2$? Question from someone just starting to study tensors (sorry if it's silly):
So I understand (maybe?) that tensors are basically about coordinate transformations (and things that are invariant under said transformations), and that in writing out a tensor, we use notation that represents functions that perform the coordinate transformations. 
But when I see a tensor of, say, rank 3 or 4 written out, it looks like we're jumping from one coordinate system to another to another, before we arrive from the original coordinate system to the final one. If you're only really starting at one coordinate system, and ending at another, why can't you treat each tensor as just a single coordinate transformation, i.e. a function that takes you directly from the original coordinate system to the final one? 
 A: Tensors of rank 2, that change coordinates, are only one particular type of tensors. Not all tensors do that!
In particular:


*

*Tensors of rank 0 are scalars;

*Tensors of rank 1 are vectors or differential forms;

*Tensors of rank 2 are quadratic forms, coordinate transformations, or any other linear object that can be represented by a single matrix;

*Tensors of higher rank are linear maps of higher rank. They are not changes of coordinates! 


By the way, in the physics literature, it is often said that the metric tensor is a change of coordinates (between covariant and contravariant).
This is mathematically incorrect. Covariant and contravariant vectors are mathematically distinct objects!
A: To add to what is written above, an early and well known application of higher order tensors was in the mechanics of deformable bodies (more particularly, in the linearized theory of elasticity), due to Valdemar Voigt (circa 1898)
For instance, $\sigma$, a stress tensor and $\epsilon$, a strain tensor, are related by the the tensor equation
$$
\mathbf{\sigma} = \mathbf{C \epsilon}
$$
Here $\sigma$ and $\epsilon$ are second order tensors and $C$ is a fourth-order tensor.
