Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am solving an overdetermined system of equations: $$Ax= b$$

Using QR factorization, we can solve this system easily by posing it as:

$$Rx= Q'b$$

I would like to regularize my estimate of $x$. I can use ridge regression with the normal equations being:


My question is, how can I directly transform $A$ to matrix $\Delta$ such that solving the system $\Delta x=b$ via QR factorization yields the regularized estimate for $x$.

share|cite|improve this question
What do you mean "directly transform $A$ to $\Delta$"? The relation is $\Delta=A'A+ \lambda \Gamma' \Gamma$. Do you mean how to obtain the QR factorization of $\Delta$ from that of $A$? – Manos Feb 10 '13 at 17:12
I voted you up here as you gave a name to my own personal "discovery" and can now study some literature on the subject. That being said, I am not sure that I understand your question. But I write an answer I think helps... – adam W Feb 10 '13 at 17:25
Yes I meant QR factorization of $\Delta$ from $A$. Poster Adam W has guided me in the correct direction. Thanks. – Atlas Feb 11 '13 at 7:42
up vote 4 down vote accepted

Try writing it as (using $\lambda = 1$ for display simplicity) $$B = \pmatrix{ A \\ \Gamma}$$ then you have for the equation $Bx = \pmatrix{b \\ 0}$

\begin{align} B'Bx &= B' \pmatrix{b \\ 0} \\ \pmatrix{ A' & \Gamma'}\pmatrix{ A \\ \Gamma}x &= \pmatrix{ A' & \Gamma'} \pmatrix{b \\ 0} \\ (A'A + \Gamma'\Gamma)x &= A'b \end{align}

Therefore in terms of the QR factorization, take the QR factors of $$B = \pmatrix{ A \\ \Gamma}$$

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.