A non-linear optimization problem includes an objective function (to be minimized or maximized) and some number of equality and/or inequality constraints where the objective or some of the constraints are non-linear. Use this tag for questions related to the theory of solving such problems or for ...

learn more… | top users | synonyms

0
votes
0answers
21 views

Find $\min x^TAy+b^Tx+c^Ty$ subject to $1^Tx=1^Ty=1,x\ge 0,y\ge 0$

The problem seems to be easy but I can't find a solution :( Problem: Given $A\in\mathbb{R}^{m\times n}, A\ge 0, b\in\mathbb{R}^{m}, c\in\mathbb{R}^{n}$. Minimize $f(x,y) = x^TAy+b^Tx+c^Ty$ subject to ...
1
vote
1answer
24 views

how to find the solution of this cost function?

I have the following cost function. $J = \sum_{i=1}^N a\, Trace(W^TX_iW) - b\, Trace(W^TY_iW)$ Where $X_i$ and $Y_i$ are symmetric matrices, $a$ and $b$ are scalars. How can I find W?
-2
votes
0answers
7 views

Optimal values for nonlinear constrained problem

Consider the following problem. Let $t$ be the time variable. We are given a fixed time budget $T$. Cost function is $f(t)$. We may spend this time budget in one or more steps. Find infimum and ...
0
votes
1answer
37 views

Constraint minimization of sum of Non-symmetric matrices

I am trying to find closed form solution to following problem \begin{equation} \begin{array}{c} \text{min} \hspace{4mm} \big(\lambda_1\left( \mathbf{y}^T V^{(1)}\mathbf{x} \right)^2 + ...
1
vote
0answers
11 views

Local optimization with multiple starting values \approx global optimization?

I need to find the minimum/maximum of a nonlinear function but the constraints in the optimization problem make it tougher to solve (not a convex problem). I don't have a good global optimization ...
0
votes
0answers
3 views

Finite difference method hessian matrix

In the finite difference method, after every iteration, do you have to update the hessian matrix and the grad function?
2
votes
0answers
11 views

Determining active constraints in KKT

Suppose there is a constrained optimization problem having inequality constraints. We can solve it using Karush-Kuhn-Tucker conditions. My question is how do we determine which constraints are active ...
0
votes
0answers
15 views

maintaining monotonicity in an optimization problem

I have written a program for optimizing a set of generators. I have hourly price and cost data and need to figure out when a generator should run or just stay off. I describe the problem in more ...
1
vote
1answer
17 views

Problems with vector vector derivative in optimization

I have a loss function of the followoing form: $L(\mathbf{a}) = \|\mathbf{b} - \mathbf{a}\|_2^2$ Where, $\mathbf{a}$ and $\mathbf{b}$ are vectors of dimension $d\times 1$. I need to calculate ...
1
vote
0answers
23 views

Convexity over a line given a convex interval [duplicate]

Let $f : \mathbb{R}^n \to \mathbb{R}_∞$ be a function. I want to prove that $f$ is convex over the line $L_{v,x_0}$ iff $\psi : \mathbb{R} \to \mathbb{R}_∞$ $\psi(t) := f (x_0 + tv)$, is convex ...
1
vote
0answers
22 views

Name of method which includes Taylor linearization inside fixed point iteration

I read paper about Horn-Schunck multiscale method for computing optical flow Core part of this algorithm is minimizing some functional. One part of functional contains nonlinear term inside L2 norm. ...
0
votes
1answer
16 views

understanding a statement in Gill, Murray and Wright “Practical Optimization”

Hi: I'm reading the book "Practical Optimization" and there's a part in Chapter 3 that I can't prove to myself but I'm sure it's true. On page 64, they define the Taylor expansion of $F$ about ...
0
votes
0answers
14 views

Analytic minimization of linear algebraic expression with nonlinear constraint

I'm trying to solve the problem of minimizing $a x_1 + (1-a) x_2$ with constraint $b - b^2 \sqrt{(1-x_1)(1-x_2)} - \sqrt{x_1x_2}=0$ and where all variables lie in $(0,1)$. It comes out of a physics ...
1
vote
0answers
23 views

Efficient method for refining parameters in nonlinear curve fitting

I have time-series electrical current data $i(t)$ with transient steps in it which are convoluted with the hardware filter used in data acquisition. As a result, the real steps in current, which would ...
1
vote
1answer
23 views

fastest path between two points with current

This question is an extension of the following trivial problem: on a stationary body of water, a motorized device is 100m S and 10m E of a buoy. Given the device can move 5m/s in stationary water, ...
1
vote
0answers
13 views

Optimal design for constrained Bayesian slope intercept model

Here is a problem I've been stuck on for quite a while. Consider the model \begin{equation} \mathbf{y}=\mathbf{H}\pmb{ \theta }+\pmb{\epsilon }. \end{equation} The design matrix is given by: ...
0
votes
0answers
18 views

Quality of a Levenberg-Marquart fit [migrated]

I have data sets that I like to fit using the cminpack library that implements the Levenberg-Marquart fitting algorithm. Since I have two model that could explain my data sets, I have two different ...
1
vote
0answers
27 views

Is there any algorithm for finding the minimum distance to the complement of a convex set?

There have been some algorithms for finding the projection from a given point onto a convex set. This problem seems to be quit easy because of the convexity of the set. However, in the case of finding ...
0
votes
0answers
20 views

solver for non-convex matrix optimization with convex constraints

So here is the problem: $\max_{D} ~~ \|A+BD\|$ subject to $\|D\|<1$ (any norm you like) where matrices A and B are given. The cost function is evidently convex as well as the constraint, but ...
0
votes
0answers
42 views

Solution of a linearly constrained quadratic programming problem

What is the solution of the following optimization problem: \begin{align} &\min{\mathbf{p}^\mathrm{T} \mathbf{B} \mathbf{p}}\\ &\text{subject to}: \mathbf{0}\leq{\mathbf{p}}\leq \mathbf{1}. ...
0
votes
0answers
40 views

Maximizing a convex function outside a convex set?

I want to prove the following equality: \begin{equation*} \min_{x: x^2 \ge t - x} x^2 = \max_{0 \le \mu \le 1} \left( \mu t + \frac{\mu^2}{4 (\mu -1)} \right). \end{equation*} The objective function ...
1
vote
0answers
13 views

Nonlinear optimization with range constraint

I am trying to solve the following problem, but so far each time trying to program either one or more of the constraints are not satisfied (using Matlab). Phrasing the problem in two different ways, ...
2
votes
0answers
50 views

Is there any way to justify this approximation of the solution of a rather simple equation?

I am considering the problem of finding the root of equation $$f(x)=-x+\sum_{i=m}^{i=n} \sqrt{x+i}=0$$ where $m,n$ can both be from very small to very large integers. Since, in a single calculation, ...
0
votes
1answer
107 views

An Interesting Resource Allocation Problem

Here is the problem: \begin{array}{ll} \text{minimize} & \sum_{i=1}^N \frac{1}{1 + \textrm{exp}(C_i + x_i)}\\ \text{subject to} & \sum_{i=1}^N x_i \le R \\ & x_i \ge 0, ~ i = 1,2,...,N ...
10
votes
1answer
216 views

Bidding Tic Tac Toe

In regular tic tac toe, both the players get alternate chances. This is a variant of that. Player $A$ has $\$x$ amount and player $B$ has $\$y$ amount as initial balance. Assume that $y>x$. Both ...
0
votes
0answers
21 views

Nonlinear non-convex semi-infinite programming with norm equality constraint

In optimization theory, semi-infinite programming (SIP) is an optimization problem with a finite number of variables and an infinite number of constraints, or an infinite number of variables and a ...
0
votes
1answer
33 views

Optimization problem with an added quadratic inequality constraint

Consider the following (non-convex) optimization problem on the real variables $\lambda_\ell^\pm$ with $\ell=1,\ldots,n$ \begin{align} \mbox{maximize}&\quad ...
2
votes
1answer
44 views

What is the motivation behind the, convex and concave closures of submodular functions?

What is the motivation behind the , convex and concave closures of submodular functions? Also, my understanding is that the submodularity condition is somewhat like concavity which makes it counter ...
1
vote
1answer
72 views

Scale ellipsoid maximally within polyhedron

Given an ellipsoid around the origin with scaling parameter $e$ in the form $x^T E x \leq e$ and a polyhedron $P$ given by $A x \leq b$, how can we define an optimization problem that maximizes e such ...
1
vote
0answers
16 views

How to interpolate a function with a reproducing kernel

I am trying to interpolate a function that is noisy, but I know with a high amount of certainty about a third of the points in the series. I am trying to estimate the smooth mean of the signal via a ...
3
votes
0answers
26 views

Solving an inverse squared sum

How would I go about solving this sum for $x$? $$\sum_i\frac{a_i}{(x+b_i)^2}=C$$ Where $\mathbf{a}$ and $\mathbf{b}$ are vectors and $C$ is a constant, and $x$ is a single number. It's for an ...
1
vote
0answers
25 views

Gauss-Newton vs Gradient descent

I would like to ask first if the second order gradient descent method is the same as the Gauss-Newton method. There is something I didn't understand. I read that with the Newton's method the step we ...
1
vote
1answer
28 views

Finding sparsest solution of a linear system

I want to find the solution $x$ with most zeros in its components, to: $Ax=b$ for $A\in \mathbb{R}^{k \times n}, b \in \mathbb{R}^k$ ($k < n$), where $x \in \mathbb{R}^n$ has no additional ...
2
votes
0answers
81 views

Strong duality for nonconvex quadratic program (with multiple constraints)

Consider the following optimization \begin{eqnarray} P_1: \quad &\underset{x\in\mathbb{C}^N}{\mathrm{minimize}}&\; f_0(x) \\ &\mathrm{subject\;to}&\; f_i(x) \leq 0, i=1,\ldots,m \\ ...
2
votes
0answers
33 views

Structural / design / meta optimization - is there mathematical theory. Optimization over categories?

There is huge branch of mathematical optimization theory, but it mostly considers the finding optimal parameter values for the predefined structures. There are variational calculus and optimal control ...
2
votes
0answers
33 views

From constrained to unconstrained maximization problem

I have the following constrained maximization problem $$ \max_{X_1,X_2,...,X_i,...,X_N} \sum_{i=1}^{N}X_i f_i(X_1,...,X_N) \hspace{0.2 cm} \text{subject to} \sum_{i=1}^{N}X_i-B\leq 0 \text{ and } ...
2
votes
0answers
24 views

short-sale constraint with nonpositive-definite matrix in portfolio optimization

This question is about portfolio optimization in R. I have a nonpositive-definite matrix. I have handled with the singularity. Unfortunately, quadprog etc. optimization packages fail to solve the ...
0
votes
1answer
40 views

Minimizing a function in Mathematica

Edit: I simplified the function using $\textbf{Simplify[...]}$ How can I minimize this function of $x$, where $l$ is a positive constant? $$\frac{1}{2} \sqrt{\frac{x}{l}+\frac{l}{x}+4 x^2-2}$$ ...
0
votes
0answers
21 views

Solving nonlinear system of ODEs

I have the following system of differential equations: $$ \begin{cases} \frac{dx}{dt} = (1 - y) x - 0.4 xu \\ \frac{dy}{dt} = (x - 1)y - 0.2yu \\ \psi_1' = - \frac{dH}{dx} = (-1 + 0.4u)\psi_1 + y ...
0
votes
1answer
18 views

Constrained nonlinear optimizacion

I have encountered this optimization problem while trying to implement the method proposed in this very interesting paper: http://www.mae.cuhk.edu.hk/~cwang/pubs/JCISERealTimeSkeleton.pdf the ...
0
votes
0answers
29 views

What does coordinate descent actually do?

We've done a bunch of theoretical stuff in my optimization class, but basically no time for the actual implementation details. I'm trying to get an understanding of coordinate descent, which if I'm ...
0
votes
0answers
36 views

Linear optimization w/ linear and non-linear inequality constraints

Given dependent variables $Q_i$ and independent variables $x_i$, $y_i$, $z_i$ where $i=1,⋯, N $ which are related via the following system of N linear equations with parameters $P_1$, $P_2$ and ...
0
votes
4answers
59 views

If $2000 m^{2}$ of material is used to to construct a box…,then what is the largest possible volume of the box?

If $2000 m^{2}$ of material is used to to construct a rectangular box with a square base and an open top,then what is the largest possible volume of the box? I put an equation for the volume : $V = ...
1
vote
1answer
26 views

Removing a max function in the constraints

Can the following problem be transformed into a linear programming problem: Find $x_1,..,x_N$ which maximizes the objective function $$\sum_{i=1}^{N}x_{i}\sum_{j=1}^{n_{i}}c_{ij}$$ subject to the ...
0
votes
1answer
17 views

MINLP optimization with matlab reaching different solutions every run

I have written a program for optimizing a set of generators. I have hourly price and cost data and need to figure out when a generator should run or just stay off. I describe the problem in more ...
0
votes
1answer
23 views

matlab MINLP optimization with ga

I have written a program for optimizing a set of generators. I have hourly price and cost data and need to figure out when a generator should run or just stay off. There are additional constraints but ...
2
votes
0answers
19 views

discrete nonlinear convex optimization relaxation over a dense set

Be a discrete nonlinear convex optimization problem $P$ \begin{align} \underset{x\in \mathrm{C}^n}{\mathrm{min}} \ \ \ f(x) \\ Ax=b \\ c \leq x \leq d \end{align} $C$ is a dense in $F$. Is solving ...
1
vote
0answers
18 views

Optimal value of decision variable leads to inconsistency

$\epsilon$ is a random variable with support in $(0.8,0.95)$ and pdf $f(\epsilon)$. The following equation arises out of a business problem: $ENP=800*A*E(\epsilon)+ 9000 - ...
1
vote
0answers
29 views

Minimization using logarithmic barrier function

I'm thinking of the quadratic problem(QP) \begin{align} &\underset{x\in \mathrm{R}^n}{\mathrm{Minimize}}\ \ \ \frac{1}{2}x^\top{}Qx + f^\top{}x\\ &\mathrm{subject\ to}\ \ \ \ a_ix \leq b_i\ ...
1
vote
0answers
29 views

Point spectrum of a nonlinear operator on finite dimensional space

Given a nonlinear operator $T$ mapping $\mathbb R^n$ into itself, are there any known conditions on $T$ ensuring that the number of points in its point spectrum is upper bounded by the dimension $n$?