# Mathematical properties of Rank-$N$ tensors where $N$>2

WARNING:

This question might not have all the necessary tags.

I asked about the uses of rank-$$N$$ tensors in physics on physics stackexchange, but for some reason it was closed saying that my question was not specific enough. Maybe that will also be the case here, but I am asking the question anyway.

For that reason, I have come here to ask about the mathematical meaning and properties of rank-$$N$$ tensors where $$N$$>2.

SO.....scalars(Rank-$$0$$ tensor), vectors(Rank-$$1$$ tensor), matrices(Rank-$$2$$ tensor) are all tensors of different ranks. But these are the only tensors I have seen in use. No one talks about tensors of rank-$$3$$ or higher.

I don't even know how to multiply high rank tensors and also what is the geometric meaning of tensors of rank-$$3$$ or higher.

So finally the question is that: What are the mathematical properties, uses and significance of tensors with rank-$$3$$ or higher?

• Tensors of any rank $N$ are elements of $V^{\otimes N}$, where $V$ is a vector space. Probably you refer to the case where $V$ is the vector representation of, e.g. for $\mathrm{SO}(3)$, and ask about some applications. E.g. totally antisymmetric rank-3 tensors for $\mathrm{SO}(3)$ are proportional to the Levi-Civita-tensor and give you a volume element. An example of a rank-4 tensor is the elasticity tensor. In case you have a canonical identification $V \cong V^*$, you can think of a rank $N$ tensor as a multilinear map. See, e.g. Wikipedia.
– S.K.
Dec 10, 2020 at 10:56
• @S.K., Hey S.K. , I have never heard of any examples of tensors with rank 3 or higher. But you gave me one example which is Levi-Civita-symbol. So can you please give me more examples so that I can learn about them. Dec 10, 2020 at 12:51
• The Wikipedia link has some examples here, e.g. the elasticity tensor, the Riemann tensor, monopole moments, etc.
– S.K.
Dec 10, 2020 at 14:16
• @S.K. , Thanks. Dec 13, 2020 at 11:29
• Take any tensor. $A$ of rank $k$. Then $\nabla^m A$ is a tensor of rank $m+k$. The rank can go as higher as you get. Dec 13, 2020 at 13:56

Tensors are a source of great conceptual confusion among many. The reason is that they are often introduced in a very different way to vectors and matrices. When we first learn about vectors and matrices, they are presented as nothing but a list or array of numbers. In some applications like computer science and programming, this is indeed all they are and all they need to be. But, as we know, there are much more enlightening and useful ways to think about these objects. For instance, we can actually think of a (column) vector $$\boldsymbol{v}$$ as a linear map that takes in one row (co) vector (hence order 1) and spits out a real number (or whatever other field you want to use). For instance, $$\begin{bmatrix} \omega_{1} & \omega_{2} \end{bmatrix}\begin{bmatrix} v^{1}\\ v^{2} \end{bmatrix} =v^{1} \omega_{1} +v^{2} \omega_{2}$$ And we can view covectors as linear maps that take in one vector (hence order 1) and spit out real numbers, if you simply reverse the way you see the multiplication above. We could write $$\boldsymbol{v}(\boldsymbol{\omega})=\boldsymbol{\omega}\boldsymbol{v}=\boldsymbol{\omega}(\boldsymbol{v})$$ And importantly, these maps are linear, eg $$\boldsymbol{v}(a\boldsymbol{\alpha}+b\beta)=a\boldsymbol{v}(\boldsymbol{\alpha})+b\boldsymbol{v}(\boldsymbol{\beta})$$ With $$a,b$$ scalars, $$\boldsymbol{\alpha},\boldsymbol{\beta}$$ covectors. The same is true for $$\boldsymbol{\omega}$$.

We can extend this idea to matrices. We can think of a matrix as a bilinear map that takes in one covector and one vector (two arguments total, hence order 2) and outputs a real number. I'll illustrate below: $$\begin{bmatrix} \omega_{1} & \omega_{2} \end{bmatrix}\begin{bmatrix} M^{1}{}_{1} & M^{1}{}_{2}\\ M^{2}{}_{1} & M^{2}{}_{2} \end{bmatrix}\begin{bmatrix} v^{1}\\ v^{2} \end{bmatrix} =\omega_{1} M^{1}{}_{1} v^{1} +\omega_{1} M^{1}{}_{2} v^{2} +\omega_{2} M^{2}{}_{1} v^{1} +\omega_{2} M^{2}{}_{2} v^{2}$$ Multiplication order is right to left. We could write this as $$\mathbf M(\boldsymbol{\omega},\boldsymbol{v})=\boldsymbol{\omega}~\mathbf M~ \boldsymbol v$$ REMARK: One can trivially think about a scalar in this way as well - a scalar is a zero order tensor that takes in zero arguments and spits out a real number.

We don't actually need to have numbers arranged in arrays to create similar constructions of the above. We can think of the column vectors as simply members of an arbitrary real vector space $$\mathcal{V}$$ and covectors as members of its dual space $$\mathcal{V}^*$$. Then instead of using the matrix multiplication illustrated above, we simply use the more abstract linear maps. In this setting, don't think of a matrix as a box of numbers - simply think of it as a bilinear map that takes in a covector and a vector and outputs a real number. Normally, when we think about the indices of a vector or whatever we are referring to the entries in its corresponding array. However, when we don't have the notion of an array in the general setting we instead have to use the basis of either the vector space or the dual space - $$v^i=\boldsymbol{v}(\boldsymbol{e}^i)~;~\omega_i=\boldsymbol{\omega}(\boldsymbol{e}_i)$$ Here, $$\boldsymbol{e}_1,...,\boldsymbol{e}_n$$ is the basis of the $$n$$ dimensional vector space and $$\boldsymbol{e}^1,...,\boldsymbol{e}^n$$ is the basis of the $$n$$ dimensional dual space. We can of course verify this in the usual array setting: $$v^1=\boldsymbol{v}(\boldsymbol{e}^1)=\begin{bmatrix} 1 & 0 \end{bmatrix}\begin{bmatrix} v^{1}\\ v^{2} \end{bmatrix} =v^{1}$$

This leads us to the most often used definition of a $$(r,s)$$ tensor. Given a real vector space $$\mathcal{V}$$ and its dual space $$\mathcal{V}^*$$ a $$(r,s)$$ tensor is a multilinear map: $$\mathbf{T}:(\mathcal{V}^*)^r\times \mathcal{V}^s\to\mathbb{R}$$ Where the power denotes Cartesian set product $$\times$$. This tensor has order $$r+s$$. If we have some notion of array multiplication like the above, we could write $$\mathbf{T}(\boldsymbol{\omega}^1,...,\boldsymbol{\omega}^r,\boldsymbol{v}_1,...,\boldsymbol{v}_s)=\boldsymbol{\omega}^1,...,\boldsymbol{\omega}^r~\mathbf{T}~\boldsymbol{v}_1,...,\boldsymbol{v}_s=t$$ Where $$t$$ is some scalar. The indices of a tensor are defined much in a similar way as to how we went about retrieving indices of vectors: $$T^{i_1\dots i_r}{}_{j_1\dots j_s}=\mathbf{T}(\boldsymbol{e}^{i_1},...,\boldsymbol{e}^{i_r},\boldsymbol{e}_{j_1},...,\boldsymbol{e}_{j_s})$$

Concerning the geometry, this is kind of hard to pin down. I'm sure there are some nice examples of visualizing the Ricci tensor, etc but its hard to talk intuitively about the geometry of these complex objects. But hopefully my answer does a good job connecting the notions of vectors, matrices, and tensors and you get some benefit out of it. As a final comment, the above only covers "square" tensors - that is the range of all of its indices is the same. We can actually define non-square tensors as maps over arbitrary vector and dual spaces: $$\mathbf{T}:\mathcal{W}_1^*\times ...\times \mathcal{W}_r^*\times \mathcal{V}_1\times...\times\mathcal{V}_s\to \mathbb{R}$$ But they don't have many applications so they are not talked about much.

BONUS - A nice notation for sets real tensors When talking about real tensors that we can view as arrays, I like to use the notation $${}^r_s\mathbb{R}^n$$ As the set of $$n$$ dimensional $$(r,s)$$ real square tensors. However if the tensor is non square we might write $${}^r_s\mathbb{R}^{m_1,...,m_r}_{m_1,...,m_s}$$ I think this is rather nice. More generally I use the notation $${}^r_s\mathcal{V}$$ to denote the set of $$(r,s)$$ tensors over a vector space $$\mathcal{V}$$.

• Its a map that takes in $r$ covectors and $s$ vectors. Basically it has $r$ up indices and $s$ down indices. Dec 16, 2020 at 16:14
• Yes. A tank $N$ tensor takes in $N$ arguments - some mixture of vectors and covectors. In my answer I illustrate the point that the components are in some sense defined as what you get when you act the tensor on a collection of basis vectors/covectors. We can also view them as elements in a multidimensional array, but we don't actually need this structure to talk about tensors, just like we don't need a list of numbers to talk about a vector, e.g, you can make vector spaces out of sets of continuous functions and whatnot. Jan 1, 2021 at 14:34