Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It only takes a minute to sign up.
Sign up to join this community
$A$ is a nondegenerate $n \times n$ matrix with real-valued entries. If we interpret the rows of $A$ as points in $\mathbb{R}^n$, then $A$ defines a unique hyperplane that passes through each of these points (this hyperplane does not necessarily pass through the origin). Let $v$ be the normal vector to this hyperplane (to make $v$ unique, we can introduce the normalization that $\sum v_i = 1$).
How can I find an expression for $\frac{dv}{dA_{ij}}$?
I'm answering my own question (I hope that's within the M.SE etiquette) - I think I've found a partial solution.
Assuming $A$ is nonsingular, the normal vector is given by $v(A) = A^{-1}*1^T$ (I'm not sure why this is true, but I coded a quick simulation to test it and it checks out). We can normalize with $v(A) = \frac{A^{-1}*1^T}{1*A^{-1}*1^T}$, and then apply the standard rules of matrix calculus to get a solution from here:
$$\frac{dv}{dA_{ij}} = (\frac{d(1*A^{-1}*1^T)^{-1}}{dA_{ij}}) A^{-1}*1^T + (1*A^{-1}*1^T)^{-1}(\frac{d(A^{-1}*1^T)}{dA_{ij}})$$
$$ = (-\frac{d(1*A^{-1}*1^T)}{dA_{ij}})^{-2} A^{-1}*1^T + (1*A^{-1}*1^T)^{-1}(\frac{dA^{-1}}{dA_{ij}})*1^T$$
$$ = (-\frac{d(1*A^{-1}*1^T)}{dA_{ij}})^{-2} A^{-1}*1^T + (1*A^{-1}*1^T)^{-1}(\frac{dA^{-1}}{dA_{ij}})*1^T$$
$$ = (-1*\frac{dA^{-1}}{dA_{ij}}*1^T)^{-2} A^{-1}*1^T + (1*A^{-1}*1^T)^{-1}(\frac{dA^{-1}}{dA_{ij}})*1^T$$
$$ = (-1*\frac{dA^{-1}}{dA_{ij}}*1^T)^{-2} A^{-1}*1^T + (1*A^{-1}*1^T)^{-1}(\frac{dA^{-1}}{dA_{ij}})*1^T$$
$$ = (1*A^{-1}*\frac{dA}{dA_{ij}}*A^{-1}*1^T)^{-2} A^{-1}*1^T - (1*A^{-1}*1^T)^{-1}(A^{-1}*\frac{dA}{dA_{ij}}*A^{-1}*1^T)$$
Turns out that $A^{-1}*\frac{dA}{dA_{ij}}*A^{-1}*1^T = (\sum_{y=1}^n A^{-1}_{jy}) (A^{-1}_{*i})$.
$$ = (1*(\sum_{y=1}^n A^{-1}_{jy}) (A^{-1}_{*i}))^{-2} A^{-1}*1^T - (1*A^{-1}*1^T)^{-1}(\sum_{y=1}^n A^{-1}_{jy}) (A^{-1}_{*i})$$
$$ = ((\sum_{y=1}^n A^{-1}_{jy}) (\sum_{x=1}^n A^{-1}_{xi}))^{-2} A^{-1}*1^T - (\sum_{x=1}^n \sum_{y=1}^n A^{-1}_{xy})^{-1}(\sum_{y=1}^n A^{-1}_{jy}) (A^{-1}_{*i})$$
Alright, that's all the simplifying I'm going to do - I really hope my algebra went okay. Hopefully this is helpful to someone else.
This is not really a different answer but a couple of comments on your existing one. Also, I apologize for not adopting your row-vector convention, but I can only think in terms of column vectors... Hopefully it's not too annoying for you to translate mentally.
Let $P=A^T$ be the matrix whose columns are your points $p_1, \ldots, p_n$ in $\mathbb R^n$. Here is a proof that $A^{-1}1=P^{-T}1$ is indeed normal to the hyperplane defined by the $p_i$, where $1$ is a column vector with all ones. Observe that a vector $v$ is normal to said hyperplane if and only if it is normal to all $p_i-p_j$, that is, $v^T(p_i-p_j)=0$. Let $q=P^{-T}1$. We have $$q^T(p_i-p_j)=1^TP^{-1}(p_i-p_j)=1^T(e_i-e_j)=0,$$ where $e_i$ and $e_j$ are the basis unit vectors, because $1^Te_i=1^Te_j=1$ (the scalar $1$).
You would have an easier time differentiating if you did it in two steps. Let $q=A^{-1}1$ as before, and $n=q/(1^Tq)$. We already know that $$\frac{\partial q}{\partial A_{ij}}=\frac{\partial A^{-1}}{\partial A_{ij}}1=A^{-1}\frac{\partial A}{\partial A_{ij}}A^{-1}1=A^{-1}E_{ij}A^{-1}1,$$ where $E_{ij}$ is the matrix with $1$ in the $(i,j)$th entry and $0$ elsewhere. Now we want to find $\partial n/\partial A_{ij}$. To simplify things, let us denote differentiation by $A_{ij}$ with a prime ($'$). Then $$n'=\left(\frac q{1^Tq}\right)'=\frac{q'(1^Tq)-q(1^Tq)'}{(1^Tq)^2}=\frac{(1^Tq)q'-q1^Tq'}{(1^Tq)^2}=\left(I-\frac{q1^T}{1^Tq}\right)\frac{q'}{1^Tq}=\big(I-n1^T\big)\frac{q'}{1^Tq}.$$
