Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Prove that if $p^T▽f(x_k)<0$, then $f(x_k+εp)<f(x_k)$ for $ε>0$ sufficiently small.

I think we can expand $f(x_k+εp)$ in a Taylor series about the point $x_k$ and look at $f(x_k+εp)-f(x_k)$, but what's then?

(Taylor series: $f(x_0+p)=f(x_0)+p^T▽f(x_0)+(1/2)p^T▽^2f(x_0)p+...$
=> here is what's $p$)

share|cite|improve this question
You may want a Taylor's series with remainder, of the form $f(x_0+p)=f(x_0)+p^T▽f(x_c)$ where $x_c$ is between (in some sense) $x_0$ and $x_0+p$. – marty cohen Feb 18 '13 at 6:04
@marty cohen: but we can't evaluate the value of $p^T▽f(x_c)$ – i_a_n Feb 18 '13 at 6:33
@marty cohen: Or we may write $f(x_k+\varepsilon p)=f(x_K)+(\varepsilon p)^T▽f(x_K)+(1/2)(\varepsilon p)^T▽^2f(x_C)(\varepsilon p)$ but we still can't evaluate $(1/2)(\varepsilon p)^T▽^2f(x_C)(\varepsilon p)$ – i_a_n Feb 18 '13 at 6:38

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.