Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have the functional:

$$F=v^T\times A \times v$$

Where $A$ is a function of $v$. The non-linear system of equations necessary to find $v$ is obtained doing:

$$\frac{\partial F}{\partial v}=0$$

According to the differentiation rules this system could be written in matrix form as:

$$v^T \times A + (A \times v)^T + v^T \times \frac{\partial A}{\partial v} \times v =0 $$

How to calculate $\dfrac{\partial A}{\partial v}$?

Playing with the following example:

$$A=\begin{bmatrix} A_{11} & A_{12} \\ A_{21} & A_{22} \end{bmatrix}$$ $$A_{11}=a$$ $$A_{12}=ab$$ $$A_{21}=a^2b$$ $$A_{22}=ab^2$$

and: $$v^T=\begin{Bmatrix} a & b\end{Bmatrix}$$

What I tried is wrong, which consists on differentiating $A$ for each component in vector $v$ such that $\dfrac{\partial A}{\partial v}$ is a $2 \times 2 \times 2$ matrix:

$$\frac{\partial A}{\partial v}=\begin{bmatrix} \begin{bmatrix} A_{11,a} & A_{12,a} \\ A_{21,a} & A_{22,a} \end{bmatrix} \\ \begin{bmatrix} A_{11,b} & A_{12,b} \\ A_{21,b} & A_{22,b} \end{bmatrix}\end{bmatrix}$$

I believe the final shape is correct. Does anyone know where my mistake is?

share|cite|improve this question

You have that $F$ is a quadratic form. You can write, for any dimension

$$F= \sum_{i,j}A_{ij}v_iv_j.$$

So for your example you have:


So now, you just use chain rule ... right?

$$ \frac{\partial F}{\partial v}=\begin{bmatrix} \frac{\partial F}{\partial v_1}\\ \vdots \\ \frac{\partial F}{\partial v_n} \end{bmatrix}. $$

share|cite|improve this answer
this seems to be not correct. Since $F$ is a scalar and $v$ a vector, $\partial{F}/\partial{v}$ must be a vector with the same lenght of $v$... – Saullo Castro Oct 30 '13 at 14:55
My bad, you are completely right. I'll correct. – PepeToro Oct 30 '13 at 15:36

Everything looks fine to me. As for the part $\frac{\partial A}{\partial v}$, I don't think you need to write it explicitly, know its exact shape. Because all you want is to obtain a row vector $v^T\frac{\partial A}{\partial v}v$, whose $k$-th component can be computed as $$\sum_{i,j}\frac{\partial A_{ij}}{\partial v_k}v_iv_j$$ Particular in your example $$\begin{align}v^T\frac{\partial A}{\partial v}v&=\left(A_{11,1}v_1^2+(A_{12,1}+A_{21,1})v_1v_2+A_{22,1}v_2^2,A_{11,2}v_1^2+(A_{12,2}+A_{21,2})v_1v_2+A_{22,2}v_2^2\right)\\\end{align}$$

share|cite|improve this answer

@Saullo, you can do a formal calculus. Note that $\dfrac{∂v}{∂v_i}=e_i$, the $i^{th}$ vector of the canonical basis. Then $\dfrac{∂F}{∂v_i}=e_i^TAv+v^TAe_i+v^T\dfrac{∂A}{∂v_i}v=e_i^T(A+A^T)v+v^T\dfrac{∂A}{∂v_i}v$ where $\dfrac{∂A}{∂v_i}$ is the matrix $[\dfrac{∂A_{j,k}}{∂v_i}]_{j,k}$.

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.