Convex Optimization is a special case of mathematical optimization. It includes Linear Programming and least-squares.

learn more… | top users | synonyms

0
votes
3answers
62 views

Prove $||\lambda x_1 + (1-\lambda) x_2 - y|| \leq ||x_1 - y||$

Assume we have have $3$ points $x_1, x_2$ and $y$ and $||x_1-y||=||x_2-y||$. How do we prove that the distance between $y$ and the convex combination of $x_1$ and $x_2$ is smaller than that between ...
0
votes
1answer
34 views

Analysis of iterative optimization methods using lyapunov analysis

In analysis of iterative methods, is it possible that we have to use two time-lagged version of the time-varying system to analyze its convergence? (that is, we construct the evolution of x^k, ...
1
vote
1answer
114 views

Is there any way to make the following function convex?

I need to find optimal lagrangian multiplier vectors for a quadratic programming problem subject to three quadratic equality constraints and several other linear inequality constraints. I would like ...
5
votes
2answers
213 views

Proving $x^4$ is strictly convex

I'm not sure how to prove $f(x) = x^4$ is strictly convex using just the definition of strict convexity: $$f((1-t)x+ty) < (1-t)f(x)+tf(y)$$ for $0<t<1$. Is this just an algebra slog? If so, I ...
0
votes
0answers
45 views

How to prove $f(x_1,\ldots,x_n) = \sum x_i\ln x_i - (\sum x_i )\ln(\sum x_i)$ is convex on R++ [duplicate]

How can i prove $f(x_1,\ldots,x_n) = \sum x_i\ln x_i - (\sum x_i )\ln(\sum x_i)$ is convex on R++
0
votes
2answers
175 views

How to compute primal variable based on dual variables and their multipliers

I edited this question based on information I got from comments. Assume we have an optimization problem (primal problem). we solve it's dual using some kind of primal-dual interior point solver. So, ...
1
vote
0answers
49 views

tangent cone to the set

I'm supposed to solve this problem: Let us consider the set $M=\{(x, \sin{x}):x\in\mathbb{R}\}\cup\{\big(\cos(x)-1,x\big):x\in\mathbb{R}\}$ The question is to find the tangent cone to the set $M$ in ...
0
votes
0answers
93 views

Karush-Kuhn-Tucker conditions for non-linear optimalization

I have the following problem: solve the local conditions (KKT) and find ALL optimal solutions: $$\min f(x,y)$$ subject to $$g(x,y)\le 0$$ $$x\geq0, y\in\mathbb{R}$$ I have some questions to this ...
0
votes
1answer
38 views

Gradient of squared distance to a convex set

I have the following problem: Let $f:\mathbb{R}^n \rightarrow \mathbb{R}$, $f(x)=(\operatorname{dist}(x,D))^2$ where $D$ is a convex, close set in $\mathbb{R}^n$. Prove that $f$ is convex and ...
0
votes
1answer
20 views

Under what hypotheses is a solution to the Lagrangian multiplier equations automatically a global minimum?

Suppose we are minimizing a function $f(x_1,...,x_n)$ under the conditions $g_1(x_1,...,x_n) = g_2(x_1,...,x_n) = 0$. Under what hypotheses is a solution to the Lagrangian multiplier equations ...
1
vote
0answers
39 views

Optimization of sum of logs

I have an optimization problem of the form $$\operatorname*{argmax}_{\mathbf{w}} \sum_i \log(1 + \mathbf{w} \cdot \mathbf{k_i})$$ given some set of vectors, $\mathbf{ \{k_i\} }$. I have tried both ...
1
vote
1answer
171 views

How to project gradient vector to subspace defined by linear constraints

I have the following set of linear constraints: $$\begin {align}\textbf{y}^T\textbf {x} &= 0 \\ \textbf {0} &\leq\textbf {x} \leq C\cdot\textbf {1},\end {align}$$ where $\textbf {y} \in ...
0
votes
1answer
98 views

Is the normalized duality mapping symmetric?

In the area of functional analysis, nonlinear operator theory, the normalized duality mapping on a Banach space $X$ is a set valued map from $J:X\rightarrow 2^{X^*}$ given by \begin{align} ...
1
vote
1answer
95 views

Product of linear and convex function

More specific, how many maxima are there for product of these two functions: $ f(x) = ax + b $, and $ a > 0 $ $ g(x) $ is (strongly) decreasing convex function, $ \lim_{x\rightarrow\infty} g(x) = ...
0
votes
1answer
43 views

A maximization problem within the simplex

Let $\lambda_i$ be an ordered list of $N$ positive numbers, $\lambda_1<\lambda_2<\dots<\lambda_N$. I'm looking for the extrema of the function $$ f=\left(\sum_{i=1}^N p_i \lambda_i ...
0
votes
1answer
19 views

Example of convex subset (unbounded) with $\text {rec} (C) = {0}$

Example of convex subset (unbounded) with $\text {rec} (C) = {0}$ I've proved that for a bounded convex subset $C$ it always holds that $\text {rec} (C) = {0}$. However, now I'm looking for an ...
1
vote
1answer
37 views

How can a second-order cone problem be expressed as a conic problem?

I realize that a second-order cone is a cone, and thus an SOCP is a type of conic problem. However, to me it doesn't seem so apparent, looking at their equations. Could someone explain how one could ...
0
votes
1answer
27 views

Find the edges of a polyhedron P.

Given the polyhedron $P = \{v \in \mathbb R^2 \mid Av \le b\}$ with $A = \begin{bmatrix} -1 & -1 \\ 2 & -1 \\ -1 & 2 \\ 1 & 2 \end{bmatrix}$ and $b = \begin{bmatrix} 0 \\ 1 \\ 1 \\ 2 ...
0
votes
2answers
88 views

How to check if given polyhedron is empty

Consider a polyhedron specified as following set of equalities and inequalities $$ \begin{aligned} &\mathbf{A}\mathbf{x} = \mathbf{b},\\ &\mathbf{x} \geqslant \mathbf{0}. \end{aligned} $$ Are ...
1
vote
1answer
18 views

Is every optimization problem with a piece-wise affine objective function the dual of some differentiable problem?

It is well known that a problem can have a $C^1$ objective function and a convex feasible set, while the dual problem can be piece-wise $C^1$ only. So I'm wondering - if you have a piece-wise affine, ...
1
vote
1answer
95 views

Proximal Operator of $\ell_{\infty,1}$ norm of a matrix

How can I calculate the proximal operator of mixed norm $\ell_{\infty,1}$ for any general matrix, $X\in R^{m\times n}$ i.e., $X^* = \arg \min_X ||X||_{\infty,1} + \frac{1}{2\tau} ||X-Y||_F^2$ where ...
0
votes
1answer
24 views

Relaxing the elements of a matrix

I try to understand a specific part of the paper "Consistent shape maps via semidefinite programming", where a binary symmetric Input matrix $X^{in}$ is given with $X^{in} \in \{0,1\}^{nm \times nm}$ ...
1
vote
0answers
39 views

Do quasi-Newton methods check the second-order optimality condition?

I have a practical question about quasi-Newton methods. In quasi-Newton methods, Hessian matrix is approximated. It seems to be impossible for them to check the second optimality condition. In ...
0
votes
2answers
73 views

Weighted least squares with nuclear norm minimizaiton, how to optimize?

Nuclear norm minimization is very popularization and formulation is least squares term with nuclear norm term as following, $$\min\limits_{X} ...
2
votes
0answers
22 views

Sion Minmax theorem for integral operators

Suppose $f, g\in S=L^p([0,1],\Sigma,\mu,[0,1])$. The objective $L:S\times S\to R$ is given by $$L(f,g)= \int f (h-g) d\mu, $$ where $h\in S$ is fixed. Could we apply Sion Minmax theorem to conclude ...
2
votes
2answers
152 views

Why a convex cone cannot have more than one extreme point?

The way I define an extreme point is : A point which cannot be defined as a convex combination of two distinct points. I'm not able to extend this and show why a convex cone cannot have more than ...
3
votes
1answer
36 views

Convexity of |y-X'w|^2 given that inverse of X does not exist

Can we say anything about the convexity of the $|y-X^Tw|^2$ if we know that inverse of $X$ does not exist? Hessian is $2XX^T$. Given that X is not invertible, can we conclude that $XX^T$ is ...
0
votes
0answers
34 views

Convergence of backtracking and gradient descent.

I am thinking a bit about the following exercise: Let $f(x) = x_1^2 + x_2^2$ with dom $f = \{ (x_1,x_2):x_1 > 0 \}$. The optimal value of this problem is $p^* =1$, but it is never attained since ...
2
votes
1answer
122 views

Check if convex polygon is completely contained completely within another convex polygon.

How can I determine if a convex polygon is completely contained within another convex polygon where speed is critical? I've thought about doing this, which will only use inequalities: pcp = ...
0
votes
1answer
14 views

If a quadratic form $f$ takes the minimum on a triangle in a vertex, what can I say about min of $f$ on edges of a subdivision?

Let $f(x)=x^2+y^2$ be the Euclidean square-norm and $A,B,C\in\mathbb{R}^2$ be vertices of a triangle $\Delta$ such that $f$ takes the maximum on $\Delta$ in $C$, the minimum in $A$ and takes the ...
0
votes
0answers
42 views

Using semidefinite programming to solve the following problem

I am struggling with the following problem, and wonder is SDP can help: $$\mathrm{maximize\ } \alpha_{10}+\alpha_5+(\alpha_2+\alpha_8)/2 \mathrm{\ subjected\ to\ } \mathrm{T_1}\succeq0, ...
1
vote
1answer
23 views

Convex combination and convex set

From where does $tx + (1-t)x'$ originate from? I am selfstudying an economists book, and this is popping up all of a sudden. I get that it's a line between $x$ and $x'$, but why? And is $tx' + (1-t)x$ ...
0
votes
1answer
38 views

Solving Constrained Least-Squares

I need to solve a constrained least-squares (LS) problem as follows $min_X \text{ } ||Y-AX||_F^2$ $s.t. \text{ } {X\in \chi}$ where $A\in R^{n\times m}$, $(n\ge m)$ , $X\in R^{m\times k}$ and ...
1
vote
1answer
31 views

How can I compute fast the minimum of a linear plus Kulback-Leibler on the unit simplex?

Given $a, x^0 \in \mathbb{R}^n$ I wish to compute $$\min_{x \in \Delta_n} a^t x + \sum_{i=1}^n x_i\log(x_i/x^0_i) - x_i +x^0_i $$ where $\Delta_n$ is the unit simplex $\{x \in \mathbb{R}^n \mid ...
1
vote
1answer
44 views

For a non-convex function f, how to find a function g such that $g\circ f$ is strictly convex?

The following function $f(x)={1\over (1+e^{-x})}$ is non-convex but $\ln(f(x))$ is convex. Given a non-convex function $f$, can we find a function $g$ such that $g\circ f$ is strictly convex? If yes, ...
0
votes
0answers
32 views

How to convert the following optimization problem to quadratic program?

Given positive constants $C$ and $\epsilon$ and points $\{ (x^i,b_i)\} _{i=1}^I \subset \mathbb{R}^{n+1}$, how can we rewrite the following optimization problem as minimizing a convex quadratic ...
0
votes
0answers
24 views

Book on duallity and sensitivity in nonlinear optimization

I am looking for a recommended book on duallity and sensitivity in nonlinear optimization, as duallity and sensitivity is a well studied topic in LP , I am struggeling to find books in this subject ...
0
votes
0answers
21 views

Continuity of optimisation problem

Consider $$F(z)=\min ae^{-x}+b e^{-y} s.t. x\ge 0, y\ge 0\text{ and } x+y=z$$ I checked if this function is continuous, but it is not at $z=0$. $F(z)=2\sqrt{ab}e^{-z/2}$ when $z\ne 0$, and ...
1
vote
1answer
42 views

Convergence rate - Convex optimization

What is the best known algorithm in terms of convergence rate for unconstrained convex optimization and under what assumptions? $\min_{x} f(x)$ where $f(x)$ is a given twice differentiable convex ...
1
vote
1answer
80 views

Show the Gini Coefficient is Quasiconvex

The Gini-coefficient is defined as $$ G(x) = \sum_{i = 1}^n \frac{i}{n} - \sum_{j=1}^{i} \frac{x_{(j)}}{\mathbb{1}^{T}x}, $$ where $x_{i} $ is nonnegative numbers with positive sum. $x_{(j)}$ denotes ...
1
vote
1answer
149 views

Augmented Lagrangian Method for Inequality Constraints

Augmented Lagrangian Method can be used with inequality constraints. The question is how. One approach (according to Numerical Optimization Book by Nocedal and Wright; page 522), is linearly ...
0
votes
0answers
40 views

Formulate an optmization problem as a convex optmization problem

Let $P$ be a polyhedron, i.e. $P = \{ x \in \mathbb{R}^{n}\, |\,\, a_{i}^{T}x \leq b_{i} \}$. Define $R$ as the rectangle given by $\{ x \in \mathbb{R}^{n}\, \mid\, \, l \preceq x \preceq u \}$. Find ...
0
votes
1answer
80 views

intuition behind subspace of $R^n$

Hi: I've been reading an optimization text by Charles Byrne, "A First Course In Optimization". I'm currently going through the chapter where he explains things about convex sets and convex functions ...
0
votes
0answers
80 views

strong convex implies exp-concave

Prove that if f is strong convex (for some m>0) $\mbox(\nabla f(\mathbf{x})-\nabla f(\mathbf{y}))^{T}(\mathbf{x}-\mathbf{y})\geq m||\mathbf{x}-\mathbf{y}||_{2}^{2} $ then f is also ...
0
votes
1answer
39 views

proof that length of difference of projections implies equality of length of normals

Hi: I'm reading a book on optimization and there is an interesting stated theorem but I don't know how to prove it. Notation: Let $P_{c}(x)$ denote the projection of onto a convex set c which is a ...
3
votes
1answer
68 views

$\arg\max$ of an increasing function grows as the region grows.

$f_1,\dots,f_N:\mathbb{R}^+\rightarrow\mathbb{R}^+$ are strictly increasing, bounded functions whose derivatives monotonically decrease to $0$ as their argument increases. (Picture the shape of the ...
0
votes
0answers
54 views

How can I minimize a quadratic on the unit simplex?

How can I compute $$ \min_{x \in \Delta_n} \frac{1}{2}\lVert Bx\rVert^2 + x^tAy$$ with $x \in \mathbb{R}^n, y \in \mathbb{R}^m, A_{m \times n}$, $B_{n \times n}$ where $\Delta_n$ is the unit simplex ...
1
vote
0answers
79 views

Proximal operator of spectral norm of a matrix

How can I calculate the proximal operator of spectral norm for any general matrix, $X\in R^{m\times n}$ i.e., $X^* = \arg \min_X ||X||_2 + \frac{1}{2\tau} ||X-Y||_F^2$ I understand that the proximal ...
0
votes
0answers
24 views

How can I solve $\min \{ \langle A(x),y\rangle + f(y) \text{ s.t. } y \in S^n, \operatorname{tr}(y) =1, y \geq 0\}$?

I'm trying to solve the problem $$\min \{ \langle A(x),y\rangle + f(y) \mid y \in S^m, \operatorname{tr}(y) =1, y \geq 0\}$$ where $x \in \mathbb{R}^n$, $y \in S^M$, that is, it's a symmetric $m$ by ...
0
votes
0answers
39 views

Krein Milman Property

If a closed bounded (not compact) set $X$ in a Banach space $B$ (like $L^1$) has extreme point(s), must the max of a linear functional defined on $X$ occur at one of them? I suppose it depends on $B$. ...