# Matrix inversion problem in ridge regression

The ridge estimator can be written in the following way, where the singular value decomposition of X is $X=UDV^{'}$.

I can't quite figure out how the last step (4th step) was obtained from the 3rd one. I think it is something about matrix inverse. Can anyone help me? Thank you.

• $(ABC)^{-1}=C^{-1}B^{-1}A^{-1}$ – AnyAD Jun 15 '18 at 14:57
• HI, i know that rule. But can i use that when there is a sum of matrices as well ? – student_R123 Jun 15 '18 at 15:04
• There is no sum, $B=D^2+\lambda I$ – AnyAD Jun 15 '18 at 15:06
• $A=V$ and $C=V^T$ – AnyAD Jun 15 '18 at 15:07
• I see. Then i have to use the orthogonal property of matrix V to obtain the desired result. isn't it ? – student_R123 Jun 15 '18 at 15:13

## 1 Answer

Since $V$ (and $U$) is a unitary matrix, i.e., $VV^T = I \Leftrightarrow V^{-T} = V$, and $V^TV = I \Leftrightarrow V^T = V^{-1}$, \begin{align} \beta(\lambda) &=\left(VD^2V^T + \lambda V V^T\right)^{-1} VDU^TY \\ &= \left(V\left(D^2 + \lambda I \right)V^T\right)^{-1} VDU^TY \\ &= V^{-T}\left(D^2 + \lambda I \right)^{-1} V^{-1} VDU^TY \\ &= V\left(D^2 + \lambda I \right)^{-1} V^T VDU^TY \\ \end{align}