My question is regarding how to calculate the partial derivate of linear projection w.r.t. one of the terms.

For example, suppose we had a term such as:

$$Z = X\gamma + \beta$$

where $X \in \Bbb{R}^{a \times b}$, $\gamma \in \Bbb{R}^b$, and $\beta \in \Bbb{R}^a$.

What would be the partial derivative of $Z$ w.r.t. $X \gamma$? That is:

$$\frac{\partial Z}{\partial X\gamma}$$

Would it be a vector of 1's of shape $a$?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.