0
votes
0answers
42 views

Convex optimization approximation

Consider the optimization problem $\mathcal{P}_0$ $$ \min_{x \in \mathbb{R}^2} \left\| x-p \right\|^2 $$ $$ \text{sub. to: } \ A x \leq b, \ \ x_1^2 + x_2^2 = 1 $$ where $p \in \mathbb{R}^2$ is a ...
0
votes
1answer
39 views

Model $\min \frac{1}{2} \parallel Ax-B \parallel_2 + \lambda_1 \parallel Cx \parallel_1 + \lambda_2 \parallel Dx \parallel_\infty $ into standard form

I need to solve the following convex optimization problem: $\min \frac{1}{2} \parallel Ax-B \parallel_2 + \lambda_1 \parallel Cx \parallel_1 + \lambda_2 \parallel Dx \parallel_\infty$ s.t $x ...
1
vote
1answer
29 views

Minimize $\ell_1$ norm subject to $\ell_2$ constraint

I am trying to solve the following optimization problem: $$\min_{\|Px\|_2=1} \|x\|_1$$ I know it is non-convex. But some non-convex problems are still solvable. Update $P$ is 2x3. $x$ is a ...
-1
votes
0answers
28 views

Nonlinear equations with boolean variables

Let $i = 1, \dots, v$, $j = 1, \dots, v$ and $n = 1, \dots, N$. $i$ and $j$ indicate origin and destination nodes in a graph, respectively. An individual is denoted by $n$. Also let $0 < \alpha, ...
2
votes
0answers
62 views

Finding optimal velocity profile using Dynamic Programming

This question has been asked on scicomp but I thought maybe it's more a mathematical problem of how Bellman's idea is to be applied here. The main problem for me is: How to introduce the time ...
0
votes
1answer
30 views

Evolutionary algorithm

Can someone provide me a good reference for the CMA-ES algorithm? I'm new in the world of optimization and just reading the author reference doesn't help me a lot. I know the basic idea of a genetic ...
3
votes
2answers
151 views

Maximizing “log det + log sum exp” function

I'm trying to find a numerical solution to the following optimization problem $$ \text{maximize } f(M) = \frac{1}{2} \log \det(M) + \log \sum_{i=1}^n \exp \left\{ - \frac{1}{2} x_i^T M x_i + a_i ...
1
vote
1answer
40 views

Optimization problems on the circle

Consider the optimization problem $$ \min_{x \in \mathbb{R}^2} x^{\top} P x + q^{\top} x$$ subject to: $$ A x = b, \ x \in X, \ x_1^2 + x_2^2 = 1$$ where $X$ is compact and convex. Then ...
-1
votes
0answers
36 views

Ellipsoid-Sphere Intersection [duplicate]

Suppose I have an Ellipsoid given as: $$\frac{(x-x_2)^2}{a^2} + \frac{(y-y_2)^2}{b^2} + \frac{(z-z_2)^2}{c^2} = 1$$ And a Sphere $$(x-x_1)^2 + (y-y_1)^2 + (z-z_1)^2 = R_1^2$$ If they intersect ...
0
votes
1answer
12 views

Armijo conditions vs Reduction Conditions in Non-Linear Line Search

Overview Line search typically consists of four stages: Direction: Search direction Initial Step Size: length to search along the line on the first sub-iteration Bracket: find an interval along the ...
0
votes
1answer
61 views

Finding Shortest distance between a Sphere and Ellipsoid?

Suppose that ,I have a Sphere and an ellipsoid as Sphere: $(x-x_1)^2 + (y-y_1)^2 + (z-z_1)^2 = R_1^2$ Ellipsoid: $\large\frac{(x-x_2)^2}{a^2} + \frac{(y-y_2)^2}{b^2} + \frac{(z-z_2)^2}{c^2} = 1$ ...
0
votes
1answer
19 views

squaring the equality constraints

When creating an unconstrained optimization problem from an equality constrained one, the usual way to build the Lagrangian, is by adding a term consisting of a multiplier, multiplied by the equality ...
1
vote
1answer
28 views

Quadratic Problen with 2 constraints

Could someone help me to solve the following: $\min x^Tx$ s.t. $x^T a=1$ $x^T b=0$ where $x$,$a$ and $b$ are $(N\times1)$ vectors and $1$ and $0$ scalars. Thank you!
1
vote
0answers
27 views

Gradient descent via polynomial approximation

It seems that most proofs of convergence for gradient descent algorithms rely on strong conditions on the first and second derivatives of the function, for instance that $$|f''(x)| \leq K$$ over the ...
0
votes
0answers
29 views

Determining initial values for optimization problem

I am trying to solve an optimization problem with a quadratic objective function and non-linear constraints, using SQP (Sequential Quadratic Programming). I am attempting at doing the implementation ...
1
vote
0answers
26 views

Can difference of the $log$ function be approximated?

I am currently trying to optimize a problem. $$\text{ArgMax}_x \log(1+f_1(x))-\log(1+f_2(x))$$ Due to the fact that $\log (x)$ is a monotonic increasing function, this is equivalent as to ...
0
votes
1answer
38 views

sum of logarithms of linear-fractional functions Optimization Problem

I am new to optimization theory and I am facing this optimization problem. \begin{equation} maximize \qquad f(x) = \sum_{i} ...
3
votes
0answers
38 views

Strong duality: When does the optimal primal variable coincide with the primal variable giving the dual function.

I'm considering the inequality-constrained optimization problem of finding $$ x^{\star} = \arg \min_{x} f(x) \;\; \text{s.t.} \;\; h(x) \le 0 $$ which is assumed to have a unique minimizer. The ...
0
votes
1answer
19 views

Goldstein test in nonlinear programming

I'm reading about nonlinear programming and the Goldstein test. Here is the definition from my book: A line search accuracy test that is frequently used is the Goldstein test. A value of ...
0
votes
1answer
26 views

Above what order of magnitude a pure cutting-plane algorithm must be forgotten in favour of branch-and-cut?

Crawling the web on the subject of the cutting-plane algorithm, I have seen everywhere that a pure cutting-plane method cannot be used for numerical instability reasons after some iterations. But do ...
1
vote
1answer
28 views

Can Gomory's cutting plane be used to solve Mixed Integer Linear Programs?

Do you know if Gomory's cut can be used to solve MILP problems ? I have read that Gomory's cut is useful when all variables are integer, but what if just some of them are integer ? Is is necessary ...
0
votes
0answers
20 views

Minimization problem with amplitude constraint

I have the following minimization problem: $$\left\| \bf{A}x - y\right\|^2 \to min $$ $$s.t. \left|x_i\right| < 1, \forall i,$$ where $\bf{A}$ is the complex matrix with size of $(n\times m)$, ...
0
votes
2answers
52 views

Nonlinear Optimization problem

Function $f(x) \in \mathbb{R}^n$, $(n\geq 1)$, depend on one parameter $x \in \mathbb{R}$. Performing a nonlinear transformation of $f(x)$, we obtain function $g(y) \in \mathbb{R}^n$. This ...
0
votes
2answers
59 views

Optimizing elementary symmetric polynomial on the unit sphere

I'd like to optimize $x_1 x_2 x_3 + x_1 x_2 x_4 + x_1 x_3 x_4 + x_2 x_3 x_4$ on the unit 4-sphere. I'm thinking I should do lagrangian optimization, but I'm having trouble solving the resulting ...
0
votes
2answers
31 views

optimization problem: finding an hyperplane separating one point from a set of pointy maximizing the distance

I have this problem: I have a set of n-dimensional points $P$. I have one more n-dimensional point $q$. The points in $P$ are linearly separable from $q$ (i.e. it always exists an hyperplane $n^t x ...
1
vote
2answers
68 views

Forbidden range for a linear programming variable

I would like to express a linear program having a variable that can only be greater or equal than a constant $c$ or equal to $0$. The range $]0; c[$ being unallowed. Do you know a way to express this ...
0
votes
0answers
33 views

How to characterise this non-linear optimisation (linear objective function, non-linear constraints)

I was wondering if someone may be able to help me characterise this optimisation problem as I am struggling to find a numerical library that will solve it and I suspect it is because I am using the ...
1
vote
0answers
24 views

How to solve Bellman's optimal equation from the first principle

How to solve the following set (finite) of equations $$ v_*(s) = \max_{a\in A(s)} \sum_{s'} p(s'|s,a) [r(s,a,s') + \gamma v_*(s')]$$ $p$ and $r$ functions are given.
2
votes
1answer
82 views

Linearization of a product of two decision variables

I am trying to solve a problem that involves constraints in which products of two decision variables appear. So far, I read that such products can be reformulated to a difference of two quadratic ...
0
votes
1answer
32 views

prove that a black-box multivariable problem is convex or concave

First of all I am not mathematician. I want to solve a very complex black box function with several constraints having to do with electrical power flows in electrical grids. At the moment I use the ...
1
vote
0answers
43 views

Maximize the expected values of a function with constrain

Consider $p_1,p_2,...p_N$ are probabilities arranged in ascending order. $n_1, n_2,...n_N$ are numbers which are arranged in geometric progression. I want to Maximize E= $\sum\limits_{i=1}^N p_i\cdot ...
1
vote
0answers
23 views

First order necessary conditions for nondifferentiable nonconvex minimization problem

I am interested in first order necessary conditions for the following minimization problem where the function $f$ is continuous, nondecreasing and concave, with $f(0)=0$, but not necessarily ...
2
votes
1answer
26 views

How to prevent a convex optimization from being unbounded?

I'm novice in optimization and have a convex optimization function of form $\sum_{i,k} p_{k,i}*\log{p_{k,i}} $ to minimize with the following constraints: $\forall i, a_i = \sum_{k=1}^{m} b_k. ...
1
vote
2answers
45 views

Why are the KKT conditions sufficient in this case?

I need to solve this problem: minimize $f(x,y)=5x-xy-50+10y$ subject to: $g_1(x,y)=18-xy\leq0$ $g_2(x,y)=x+y-11\leq0$ $x,y\geq0$ I found the optimal solution: $(x,y)=(6,3)$ But the Hessian ...
0
votes
1answer
41 views

Is the optimization of the following composite function even possible, and if so, how would I go about solving it?

Hi Guys, So when I formulate a problem I am trying to solve for work, the above (please see attached figure) optimization framework results. I am not too familiar with optimization techniques ...
0
votes
2answers
54 views

Regularization vs. Inequality Constraint

For what values of a regularization parameter $\alpha$, there is an equivalent inequality constraint in convex optimization? In particular, in the convex optimization problems below $$ \text{ Problem ...
0
votes
0answers
28 views

Finding a solution using the principle of maximum entropy?

I have set of linear constraints and would like to find an answer to its unknown variables, $p_i$'s. One of my options to find a solution for $p_i$'s using maximum entropy problem, $\max(\sum - p_i ...
0
votes
0answers
89 views

Maximize the maximum Eigenvalue under a diagonally constrained matrix

Suppose we have $N\times N$ Hermitian matrix $\mathbf{A}$ I want to find the real $N\times N$ diagonal matrix $\mathbf{D}$ that maximizes the sum of the maximum Eigenvalues : $\mathbf{D}=\arg\max ...
2
votes
2answers
81 views

How to maximize an entropy function?

I'm very novice in optimization and have a convex optimization function of form $\sum_{i,k} p_{k,i}*\log{p_{k,i}} $ to minimize with the following constraints: $\forall i, a_i = \sum_{k=1}^{m} b_k. ...
2
votes
1answer
49 views

Can this multidimensional non-linear equation with constraints be minimized analytically?

I wish to find the vector of real numbers, $\mathbf{w}$, that minimizes the function: $$f(\mathbf{w}\mid\mathbf{p},\mathbf{q})=\sum_{t=0}^T \left[\left(\sum_{i=0}^I w_ip_{ti}\right)-q_t\right]^2,$$ ...
3
votes
1answer
57 views

Are all non-convex problems created equal?

The distinction between convex and non-convex problems is usually dubbed as the distinction between easy and hard problems. While in the convex case you are golden (local optima are global optima; ...
0
votes
1answer
26 views

Can $\min f'x$ s.t. $(a'x - b)^2 \le d $ be written as a SOCP?

It does not appear to be significantly different from the form listed here: http://en.wikipedia.org/wiki/Second-order_cone_programming with (in article notation) $i = {1}$, $ A = a$, and $b$, $d$ as ...
0
votes
0answers
17 views

Monotonic transformation in numerical optimization

Taking the logarithm of the Cobb-Douglass utility function ($u = x_1^a * x_2^b$) yields a utility function whose argmin is somewhat easier to derive. Since the logarithm is monotonic for $u>0$, we ...
0
votes
1answer
47 views

Optimization problem with a minimization sub-problem as a constraint

I have a problem, for predefined $x_0,z\in\mathbb{R}$, which looks like $$\min_{\alpha,x} \sum_{i=1}^n \alpha_i f_i(x_i,z) $$ subject to \begin{align} \sum_{i=1}^n \alpha_i &= 1 \\ \sum_{i=1}^n ...
3
votes
1answer
36 views

How to reformulate this Set covering problem?

I am trying to solve the following implementation of the set covering problem of a crew rostering problem. Here constraint (19), meant to create a 12-hour break between the different shifts taken by ...
1
vote
0answers
17 views

Comparing the hardness of optimizing two similar, but different expressions

Suppose we have binary variables $y_1, ..., y_n$. To make the representation simple, we show the concatenated vector as $\mathbf{y} = (y_1, ..., y_n)$. Consider the two following functions: $$ ...
0
votes
0answers
28 views

minimizing sum of squares

Say i have the following optimization problem. min $\sum\limits_{i=1}^m \parallel r - (y_i - Rx_i) \parallel_2^2$. where we are optimizing over $r \in R^n$ and also $R \in R^{n, n}$ is given. Also, ...
1
vote
0answers
26 views

Inequality optimization, KKT condition.

So we have the problem: maximize $x^2+y^2$ subject to $x^2-y \leq3$ and $y\leq 1$. And I sorted out the KKT conditions for the problem (is here where the problem is?): $2x=\lambda _12x$, ...
5
votes
3answers
113 views

Find min of $\frac{\left( \sum kx_k \right) \left( \sum x^2_k \right)}{\left( \sum x_k \right)^3}$

With $n \ge 2$ and $x_1,\ x_2,\ \dots,\ x_n > 0$. Find the minimum of: $$ M = \frac{(x_1 + 2 x_2 + ...+ nx_n)( x^2_1 + x^2_2 +...+x^2_n)} {\left( x_1 + x_2 +...+ x_n \right)^3}$$ For specific ...
1
vote
3answers
112 views

Minimizing sum of squared distances from point to spheres

Given some spheres with known radius and known origin in three dimensional space, I want to find the point P that lies "closest" to all these spheres. The meassure of closeness, I guess, will be the ...