A non-linear optimization problem includes an objective function (to be minimized or maximized) and some number of equality and/or inequality constraints where the objective or some of the constraints are non-linear. Use this tag for questions related to the theory of solving such problems or for ...

learn more… | top users | synonyms

0
votes
0answers
31 views

Constrained optimization of $||S - ABA^T||$

Given asymmetric matrix $S_{n\times n}$ we want to decompose it into $A_{n\times k}$ and $B_{k\times k}$ such that $S\approx ABA^T$. (Constraints: columns of B sum up to one while all elements are ...
0
votes
1answer
59 views

Finding the value of coefficients of a equation using non-linear least square method.

I have the following data: x: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 y: 22 36 42 51 57 64 68 71 75 79 85 87 88 91 94 97 99 99 103 104 105 107 108 109 ...
3
votes
1answer
63 views

KKT conditions for a maximization problem

I have an optimization problem \begin{equation} \mathbf{w}^*= \text{argmax} ...
1
vote
0answers
34 views

Division of linear functions in convex polytope

I am a computer scientist, and find myself needing the following lemma: If f(x)=(g(x))/(h(x)), where g and h are linear and positive with domain the convex polytope d, then extrema of f occur at ...
0
votes
0answers
40 views

Sufficiency of KKT problem

I have a continuous, twice differentiable function $f:\mathbb{R}^2\rightarrow \mathbb{R}$. My objective is to maximise the function $f$ subject to quasiconcave function $g_i(x,y)\le 0,\, i\in\{1,2\}\, ...
1
vote
0answers
28 views

Optimization when the function is not known, how generally it is performed?

I've a question on optimization (it is a general question). I have a problem $P$ where basically i have the analytic expression of the objective function, which is a multivariate polynomial ...
3
votes
2answers
60 views

$g$ is coercive for $g(x)=x^TAx+b^Tx+c$

Suppose $A$ is a symmetric positive definite matrix $A\in \Bbb{R}^{n\times n}$, $b \in \Bbb{R}^n$, and c is a real number. Let $$g(x)=x^TAx + b^Tx + c$$ Show that $g$ is coercive. Because $A$ is ...
0
votes
1answer
42 views

Choose of the parameters related to the Wolfe-Powell conditions

Let $f\in C^1(\mathbb R^n)$ $x\in\mathbb R^n$ and $d\in\mathbb R^n$ with $$\langle\nabla f(x),d\rangle<0\tag{1}$$ Then, $t>0$ is said to satisfy the Wolfe-Powell conditions with parameters ...
0
votes
0answers
32 views

mathematical optimization via lagrange multipliers (or other method)

Let \begin{eqnarray} g_k(x_1,\ldots, x_K) = x_k - \log \sum_{j=1}^K \exp x_j. \end{eqnarray} Notice that, for $i\neq k$ \begin{eqnarray} \frac{\partial g_k}{\partial x_i} = -\frac{\exp ...
1
vote
0answers
17 views

Levenberg-Marquardt fitting with multiple $y$ for each $x$?

I am trying to implement LM for my research project. The functions is in the form of $f(x,params) = y$. The issue is that for each value of $x$, there are five values of $y$, even for same $params$. ...
1
vote
0answers
37 views

Computational methods to minimizing the norm of a matrix monomial.

Linear optimization solves the problem $$\min_{\bf x}\{\|{\bf Ax - b}\|_2^2\}$$ Edit: Some clarification Doing the derivation of the optimum, first expand the norm: $$\|{\bf Ax - b}\|_2^2 = ({\bf ...
2
votes
2answers
34 views

$f (x_1,x_2)=x_1^2+x_2^3 $ Finding if a local minimum exist

Why is $(0,0)$ not a local minimizer for $f (x_1,x_2)=x_1^2+x_2^3 $? Because $(0,0)$ is a critical point and Hessian matrix at $(0,0)$ is positive semi definite. Therefore isn't it a local minimum ...
0
votes
2answers
65 views

Finding global maximizers and minimizers

I want to find if global maximum or minimum exists in $ f(x,y)=e-^{(x^2+y^2)}$ I found that (0,0) is the only critical point. In the Hessian matrix $H_{(f)}(0,0)$ was negative definite and so ...
1
vote
2answers
101 views

How to determine Coercive functions

A continuous function $f(x)$ that is defined on $R^n$ is called coercive if $\lim\limits_{\Vert x \Vert \rightarrow \infty} f(x)=+ \infty$. I am finding it difficult to understand how the norm of ...
0
votes
0answers
9 views

Is s-energy, specifically logarithmic energy, based on function -log(d) or log(d) with distance d?

There was an earlier question about s-energy; I think I got the point. However, in various problem settings I see one is interested maximising pairwise distances between points and, there they say, ...
0
votes
0answers
19 views

Are the number of Employed bees and onlooker bees always the same in Artificial Bee Colony optimization?

I have been recently introduced to this Artificial Bee Colony algorithm. Lets consider the initial guess and assume that half of the bees are employed and the rest half are onlookers. Once the ...
4
votes
1answer
45 views

An optimization problem involving a probability density function

I have three time-series $\mathbf{x}_{1}, \mathbf{x}_{2}, \mathbf{x}_{3}$. I would like to find a linear combination of the time series, that is, some scalars $a_{1},a_{2},a_{3}$ such that the sum ...
0
votes
1answer
93 views

How can linearize the product of decision variables in ILP?

Here, we have something like this: R + (1-R)T + (1-R)(1-T)S + (1-R)(1-T)(1-S)Q = 1 where R, T, S, Q are binary decision variable How can I convert this ...
4
votes
1answer
59 views

Stuck on step in Lagrangian Problem

For $w,E$ column vectors, $i$ the vector of ones, and $\Sigma$ - an $n\times n$ positive definite symmetric matrix, I am trying to solve the following maximization problem: $$ \max_{\{ w\}} \left\{ ...
0
votes
1answer
16 views

Non-linear programming problem from a trapping region in a nonlinear ODE system?

I have the next function... wich describes a trapping region from a glycolysys model of Sel'kov... I need to minimize $z=h(u)=u^3(\frac{1}{A}-\frac{B}{A^2})+u^2(\frac{\epsilon ...
1
vote
1answer
24 views

Computationally inexpensive method to find a rotation which minimizes the norm of two tensor difference.

So I have two matrices ${\bf T}_1$ and ${\bf T}_2$, they are tensors in the sense that they can be built as $${\bf T} = \sum_{\forall i} a_i({\bf v_i}{\bf v_i}^T)$$ with positive real weights $a_i$ ...
0
votes
0answers
31 views

Global optimization methods where constraints are lipschitz functions

Is there any global optimization methods where objective function is nonlinear (not lipschitz) but constraints are lipschitz functions?
0
votes
1answer
25 views

About finding the common diagonalizing similarity transformation.

Say I have $2k$ matrices $M_{a_1b_1}$, $M_{a_2b_2}$,..,$M_{a_kb_k}$ and their negatives. Here $M_{a_ib_i}$ is such that it has $0$ everywhere except that it has $1$ at $(a_i,b_i)$ and $(b_i,a_i)$ ...
3
votes
1answer
39 views

Find the critical point and show it is not a global minimizer (using Hessian)

Consider the function $f(x,y) = x^3 + e^{3y}-3xe^y$. Show that $f$ has exactly one critical point and that this point is a local minimizer, but not a global minimizer. I have attempted this, but ...
0
votes
1answer
22 views

Is it possible to solve this 2D geolocation problem?

I have $N$ equations: $$R_i=\alpha_i\frac{T_i}{(x-x_i)^2+(y-y_i)^2}, i=1..N$$ $T_i>0$, $0 < \alpha_i < 1$ and so $R_i>0$. $R_i$, $x_i$ and $y_i$ are known quantities; $x$, $y$, $T_i$ ...
0
votes
0answers
58 views

Local global minimizers and maximizers

I want to find the local and global minimizers and maximizers of the following two functions. 1) $f(x)=x^2e^{-x^2}$ 2) $f(x)=x+ \sin x $ These are my answers. 1) $f(x)=x^2e^{-x^2}$ ...
0
votes
3answers
38 views

Global Optimization of a well-defined function with gradient information

I try to minimize the function $$ f(x_1, …x_n)=\sum\limits_{i}^n-a_icos(4(x_i-b_i)) +\sum\limits_{ij}^{edge}- cos(4(x_i-x_j)) $$ $$x_i,b_i\in (-\pi, \pi)$$ where $\sum\limits_{ij}^{edge}$ only sums ...
0
votes
0answers
108 views

Minimum of the sum of two functions

I want to show that trying to find the minimum of the sum of two or more functions of two different groups is a not convex problem. For example: $ \min\limits_{Y,Z} f(X,Y,Z)=...$. Moreover the values ...
0
votes
1answer
43 views

Is it linear or nonlinear, time-invariant or time-varying?

The equation of motion can be expressed as $M(t)\ddot{q}(t) + D(t)\dot{q}(t) + K(t)q(t) = f(t)$ where $q(t)$ is the defection, $M(t)$, $D(t)$, and $K(t)$ are the mass, damping, and stiffness ...
1
vote
1answer
44 views

Maximizing a convex function under constraints

Consider the following non-convex problem: \begin{equation*} \begin{aligned} & \text{maximize} & & f(X) \\ & \text{subject to} & & f(X)\le b\\ &&& A_kX = c_k, \ ...
0
votes
0answers
13 views

Distributing resource based on Efficiency

I am trying to form an optimization problem where I have $k$ nodes who transmits packets with rate $x_k$. The objective is to maximize the rate. $\hspace{28mm} \text{ Maximize } \sum_k \log x_k$ ...
0
votes
0answers
20 views

Sufficient conditions for an optimization problem

Given an optimization problem \begin{equation} \max{F(x)} \text{ subjected to }T(x)=u \end{equation} Where $F:\mathbb{R}^n \rightarrow \mathbb{R}$ is concave function and $T:\mathbb{R}^n ...
2
votes
0answers
24 views

variable transformation in optimization

I have an optimization problem with two sets of parameters, $x_i \in [0,1]$ and $y_k \in [-\frac{\pi}{2},\frac{\pi}{2}]$ where $i,k \in \{1...n\}$ are indices. One way to solve this problem is using ...
0
votes
0answers
38 views

Solving Nonlinear System for two variables

I have an optimization like below: $\text{ minimize } \sum_k - w_k\log_2 x_k $ $\text{subject to: } x_k \leq q , k =1,2, \cdots, N .$ $\hspace{20mm} 0 \leq w_k \leq 1$ I can form the Lagrange ...
4
votes
0answers
136 views

When is the Lagrangian dual function smooth?

Consider a nonlinear optimization problem of the form \begin{align} \min_{x}&\quad f(x)\\ \nonumber \text{subject to } \quad&h_i(x) = 0,\,i=1,\ldots,I\\ \nonumber \quad&g_j(x) \le ...
0
votes
1answer
51 views

Finding KKT conditions for nonlinear optimization problem.

I have an optimization like below: $\text{ minimize } \sum_k - \log_2 x_k $ $\text{subject to: } x_k \leq q , k =1,2, \cdots, N .$ I can form the Lagrange of the problem as below: $L(x, ...
0
votes
0answers
24 views

Solving Nonlinear system with logarithmic objective function

I have my objective function as : $\hspace{25mm} \text{Minimize} \sum_k- \alpha_k \log_2 W_k$ $\hspace{25mm} \text{subject to}: 0\leq W_k \leq q', 0 \leq \alpha_k \leq 1 $ $\hspace{25mm} k ...
0
votes
1answer
107 views

How can I solve a nonlinear optimization problem where constraint contains exponential term?

I have the optimization problem as below: $\hspace{10mm} \text{Maximize} \sum_{k} \alpha_k {R}_k $ $ \hspace{10mm}\text{subjcet to:} $ $ \hspace{10mm}\exp \left[ - (2^{{R}_k } -1) \left( ...
0
votes
0answers
21 views

Optimization problem: solving one implies solving the reverse?

I am looking to solve an optimazation problem $Maximize_{x} [A(x)]$ s.t. $B(x)\geq B_0$, where $B_0$ is a constant. If I solve this problem (i.e, finding the optimal $x^*$ that optmize while ...
1
vote
0answers
78 views

Who knows Krotov's Method in Optimal Control Theory

I'm finishing my PhD thesis about applications of optimal control theory in the field of energy harvesting. In the course of my PhD I dealt with different ways to compute optimal controls, and I found ...
0
votes
0answers
20 views

Finding maximum of a function represented by a back-propagation neural network

First, I train a standard feed-forward neural network over a training set of data points. I get an approximate function, say $F(x)$, represented implicitly by that neural network. Now I want to find ...
0
votes
1answer
34 views

Placing Circles Onto Lines For Optimality

Suppose you have a yet to be determined number of vertical lines with length 50 on which you'd like to place as many circles as you can. Each circle is 10 units in diameter and its outside edge must ...
0
votes
0answers
19 views

constrained optimization including sum of two upper incomplete gamma function in both fitness function and constraint

i'm trying to solve this constrained optimization problem the constraint is $$\zeta=\frac {\Gamma \left(M,\frac {\lambda}{\left |\sum_{i=1}^Nw_i*h_{ei} \right|^2 + \sum_{i=1}^N\left |w_i \right|^2} ...
4
votes
0answers
46 views

Solving non-linear equations in a chosen subspace

I'm trying to find the root $\mathbf{f(x)=0}$ to the following sets of equations $$ f_1(x,y,z) = x^\prime - \frac{x}{\sqrt{x^2+y^2+z^2}} = 0 \\ f_2(x,y,z) = y^\prime - \frac{y}{\sqrt{x^2+y^2+z^2}} = ...
0
votes
0answers
10 views

Non linear Optimization for resource allocation

I want to maximize the sum rate of a wireless system while maintaining fair allocation by using fairness constraint. $R_k$ is the rate for each user. I have set up my objective function as : Maximize ...
0
votes
0answers
34 views

How are the tolerances evaluated in fmincon? specific/complete mathematical formulations needed.

I'm currently studying the stopping criteria about fmincon using different algorithms and I'm wondering how are the tolerances are actually evaluated and compared in the built-in function fmincon. ...
1
vote
0answers
46 views

May be a trivial question regarding constrained optimization

Optimization problem is to find $x$>0 which $min \ \ L=\frac{A\left ( B(\frac{C}{Cx-B}+\frac{1}{x})+2C\log(\frac{B}{x}-C) \right )}{B^3}$ $s.t \ \ x\leq K $ Rewriting the objective ...
0
votes
0answers
45 views

Optimize $\max _{x_1,x_2,…,x_N} N , \text{ s.t.} \sum_{i=1}^N f(x_i) \le a$

$Is there general theory for solving optimization problem of the following kind \begin{align} &\max _{x_1,x_2,...,x_N} N \\ \text{ s.t.}& \sum_{i=1}^N f(x_i) \le a\\ &\sum_{i=1}^N g(x_i) ...
0
votes
0answers
48 views

How to find values of non linear equations / system and solve for given values

I'm trying to find the value for the variable phase in a equation / system if amp=0.5 and freq=2.5 (note: i'm looking for several different phase values given amp and freq but this is a small ...
5
votes
1answer
142 views

Duality theory and nonlinear optimization

I have been studying nonlinear optimization recently and have come across some results that I need clarification for. I will do my best to explain them in detail below, providing citations where ...