Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Let $y,\lambda\in\mathbb{R}^n$. I want to minimize the following with respect to $y$. $$ f(y)=||y|| + \lambda^Ty $$ where $||y||$ is the Euclidean norm. I first take the derivative of the function and get $$ \nabla f(y) = \frac{y}{||y||} + \lambda $$ Then I tried to get the Hessian matrix but I could not conclude anything. Is $f(y)$ is a convex function? If not how can I find the minimum of this function?

share|improve this question
    
It is convex, because it is the sum of two convex functions. –  Tomás Feb 2 '13 at 16:16
2  
Baby case: $n=1$. The minimum is $0$ if $-1\leq \lambda\leq 1$, and there is no minimum otherwise as the infimum is $-\infty$. –  1015 Feb 2 '13 at 16:19
add comment

2 Answers

up vote 2 down vote accepted

Note that $$\|y\|+\langle \lambda,y\rangle\geq \|y\|(1-\|\lambda\|) $$

From the last inequality we conclude that if $\|\lambda\|\in [0,1]$, then the minimum of $f$ is zero.

On the other hand, if $\|\lambda\|>1$, you can take $y=-t\lambda$, and make $t\rightarrow\infty$ to conclude that $f(-t\lambda)\rightarrow-\infty$.

share|improve this answer
    
From the last inequality if $||\lambda|| \in [0,1]$, then the minimum of the function in the right is zero. How can you conclude that $f$ is also zero? –  neticin Feb 2 '13 at 16:32
2  
Note that $f(0)=0$. –  1015 Feb 2 '13 at 16:35
add comment

If $y'$ is a minimum and is not 0, then let $c>0$,

Then $f(cy') = ||cy'|| + c\lambda^Ty'=c( ||y'|| + \lambda^Ty') $

This function is zero at zero, so you're not gonna get a minimum that is less than zero by this calculation.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.