3
$\begingroup$

Consider the following optimization problem: $$ \min_x \quad x^3 \quad \text{s.t.} \quad x\geq0 $$

We know that the objective function $x^3$ is not a convex function for $x\in\Re$. But we know that it is convex for $x\in\Re^+$

So my question is:

Can we define the above problem, a convex optimization problem?

To make it general:

Is it necessary for the objective function to be convex over its domain? or is it sufficient for the objective function to be convex only over the feasible set, in order to classify the problem as a convex optimization problem?

I have searched a lot for this question and everywhere,both on the textbooks and internet, the answer is that the objective function "MUST" be convex. But I think that we can consider these problems as convex.

$\endgroup$
3
  • 1
    $\begingroup$ The problem is certainly convex as you can redefine the objective to by $+\infty$ when $x$ is not in the feasible set. However, some algorithms may require the objective to be convex everywhere. $\endgroup$
    – copper.hat
    Nov 20, 2016 at 8:24
  • $\begingroup$ @copper.hat in this instance I'd prefer rewriting that objective as $\max\{x,0\}^3$, so you get monotonicity as well as convexity. $\endgroup$ Nov 25, 2016 at 19:59
  • $\begingroup$ @MichaelGrant: Yes, that would be a better approach here. $\endgroup$
    – copper.hat
    Nov 26, 2016 at 2:31

1 Answer 1

1
$\begingroup$

Few optimization algorithms only require the objective/constraint functions to be convex merely over the feasible set. Feasible interior point solvers (IPMs) are a good example. Most solvers however (like infeasible IPMs and SQPs), which btw are more efficient than feasible IPMs since they do not require a feasible starting point and can take longer Newton steps, require your functions to be convex everywhere (and finite valued, so "tricking" the solver by taking the value $+\infty$ outside the feasible region does not help).

However, most solvers satisfy box constraints (like $x\geq 0$) in all iterations, so the problem you pose will be solved by most convex optimization solvers.

$\endgroup$
10
  • $\begingroup$ Thanks for your help. But I just used that example to demonstrate what I mean. My real question is about the general case, e.g. when the other constraints like $g(x) \leq 0$ limit the feasible set to an area in which the objective function is convex. What happens if I use one of the "infeasible solvers" to solve such problems? $\endgroup$ Nov 20, 2016 at 12:23
  • $\begingroup$ Such solvers may not converge to a feasible point. If they do, and if the convergence is from outside the feasible region to the boundary, that point may not be optimal. $\endgroup$
    – LinAlg
    Nov 20, 2016 at 12:59
  • $\begingroup$ I am confused. Assuming that the objective function is convex over the feasible set, is it possible for a point to be inside the feasible set, satisfy first and second order conditions and still not be the optimal solution? $\endgroup$ Nov 20, 2016 at 14:08
  • $\begingroup$ A point that satisfies first and second order conditions but is not optimal could be on the boundary (but not in the interior). $\endgroup$
    – LinAlg
    Nov 20, 2016 at 14:35
  • 1
    $\begingroup$ @MichaelGrant As opposed to feasible or primal IPMs. Also E.D. Andersen (MOSEK) in this chapter: "The computationally most attractive IPM is an infeasible-primal-dual algorithm Indeed it has been implemented in all commercial software packages". $\endgroup$
    – LinAlg
    Nov 25, 2016 at 23:41

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .