Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Could someone point me to a reference on how to find $w$ as the minimizer of:

$$ \frac{1}{2}\sum_{i=1}^{d}q_i(w_i-m_i)^2+\sum_{j=1}^{n}log(1+\exp(-y_jw^Tx_j)) $$

where $q_i$ (initialized with $\lambda$) is a vector of regularization values for each parameter $w_i$ and $m_i$ (initialized with $0$) is the minimum values of $q_i$ found on the previous iteration of the regression.

The original algorithm can be found here: http://books.nips.cc/papers/files/nips24/NIPS2011_1232.pdf (Algorithm 3, page 6).

I don't seem to figure it out how to do it when $\lambda$ is not fixed but updated iteratively in $q_i$.


share|improve this question

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.