A non-linear optimization problem includes an objective function (to be minimized or maximized) and some number of equality and/or inequality constraints where the objective or some of the constraints are non-linear. Use this tag for questions related to the theory of solving such problems or for ...

learn more… | top users | synonyms

7
votes
0answers
157 views

Consider the problem minimize $f(x)= x^4 −1. $

I am studying for a test and I found this problem in the textbook that I'm using, there may be a conceptual problem that I'm coming across. My test is on unconstrained optimization (multi-variable) ...
6
votes
0answers
231 views

I need help about some compactness arguments

I need help to find some compact sets for my engineering problem. Through this page I learned quite much about it however since I have neither read a book yet nor have an experience I am not able to ...
5
votes
0answers
304 views

(easier version)What is a working example for finding the maximum of a algebraic function $f(a,b,c,d,e)$ with 4 equality …

edit 2: If you are founding an answer would be interesting to you, please upvote this question, because i may use those point in order to start a new bounty. Edit 3: Can somebody answer? Edit 4:I ...
4
votes
0answers
136 views

When is the Lagrangian dual function smooth?

Consider a nonlinear optimization problem of the form \begin{align} \min_{x}&\quad f(x)\\ \nonumber \text{subject to } \quad&h_i(x) = 0,\,i=1,\ldots,I\\ \nonumber \quad&g_j(x) \le ...
4
votes
0answers
46 views

Solving non-linear equations in a chosen subspace

I'm trying to find the root $\mathbf{f(x)=0}$ to the following sets of equations $$ f_1(x,y,z) = x^\prime - \frac{x}{\sqrt{x^2+y^2+z^2}} = 0 \\ f_2(x,y,z) = y^\prime - \frac{y}{\sqrt{x^2+y^2+z^2}} = ...
4
votes
0answers
36 views

Nonlinear optimisation of Expectation

I am preparing for my exams and I can't get my head around the following question. I know there exists a general method for solving these problems but I don't know where to start. I would greatly ...
4
votes
0answers
301 views

Optimizing non linear programs of two variables

The scenario is; We've got $n$ stationary 360$^{\circ}$ sensors in an confined area (each sensor is located at some arbitrary $\left(x,y\right) = \left(x_{n},y_{n}\right)$), once a unit $t$ enters ...
4
votes
0answers
188 views

Why Compactness is Necessary at Minimax Theorem

According to Von Neumann's minimax theorem, I have $$\max_{x\in X} \min_{y\in Y}f(x,y)=\min_{y\in Y} \max_{x\in X} f(x,y)$$ for some compact sets $X$ and $Y$ and a convex (in $y$), concave (in $x$) ...
3
votes
0answers
30 views

How to use the Karush–Kuhn–Tucker conditions?

From what I read, the Karush-Kuhn-Tucker conditions are a generalization of the Lagrange Multiplier Method. For the Lagrange Multiplier Method I have been able to find a serie of steps I must do to ...
3
votes
0answers
98 views

If this problem is not unbounded, what's wrong in this dual derivation?

In a paper with 100 citation, Robust Support Vector Machine Training via Convex outlier Ablation, a convex relaxation is used. In this paper, a form of robust svm proposed: \begin{align} \min_{0\leq ...
3
votes
0answers
64 views

[Levenberg-Marquardt]What is the link between positive-definiteness and well-conditioning?

Working on optimization problems through neural networks, I use the Levenberg-Marquardt algorithm. I have read this assertion that I do not understand : A positive definite diagonal matrix is ...
3
votes
0answers
149 views

Determining active constraints in KKT

Suppose there is a constrained optimization problem having inequality constraints. We can solve it using Karush-Kuhn-Tucker conditions. My question is how do we determine which constraints are active ...
3
votes
0answers
41 views

Solving an inverse squared sum

How would I go about solving this sum for $x$? $$\sum_i\frac{a_i}{(x+b_i)^2}=C$$ Where $\mathbf{a}$ and $\mathbf{b}$ are vectors and $C$ is a constant, and $x$ is a single number. It's for an ...
3
votes
0answers
60 views

Structural / design / meta optimization - is there mathematical theory. Optimization over categories?

There is huge branch of mathematical optimization theory, but it mostly considers the finding optimal parameter values for the predefined structures. There are variational calculus and optimal control ...
3
votes
0answers
194 views

Finding optimal velocity profile using Dynamic Programming

This question has been asked on scicomp but I thought maybe it's more a mathematical problem of how Bellman's idea is to be applied here. The main problem for me is: How to introduce the time ...
3
votes
0answers
42 views

Solve non-linear equation with Matrices

I'm looking more for hints than specific answers, although I would be extremely grateful if provided with one. The problem I have is as follows: $$ -\Sigma (A+\Lambda_1)+I=0 $$ Here A is a constant, ...
3
votes
0answers
28 views

How does this polar function behave?

I came across this question in my textbook for Nonlinear Optimisation and I don't know what to do: Consider the function: $$ f(x_1,x_2)=(r-1)^2-\frac{1}{2}(r-1)^2\cos \left( \frac{1}{r-1}-\phi ...
3
votes
0answers
92 views

Solver for sparse linearly-constrained non-linear least-squares

Reposted from stackoverflow on the advice of Nick Rosencrantz: Are there any algorithms or solvers for solving non-linear least-squares problems where the jacobian is known to always be sparse, and ...
3
votes
0answers
84 views

System of many non-linear (quadratic) first order O.D.E. (numerical strategy or simplification)

I have a large system (N>100) of equations $\frac{d\vec{P}}{dt}= A(t) + B(t) \vec{P} + \vec{P}^T C(t) \vec{P}$ where $\vec{P}$ is a vector of N functions of the variable t. What is the correct ...
3
votes
0answers
932 views

Convex minimization over the Unit Simplex

I have a simple (few variables), continuous, twice differentiable convex function that I wish to minimize over the unit simplex. In other words, $\min. f(\mathbf{x})$, $\text{s.t. } \mathbf{0} \preceq ...
2
votes
0answers
16 views

Fitting nonlinear differential equations to correspond a predefined solution

When modeling temporal dynamics of a biological process I stumbled upon a set of differential equations having the following matrix form: ...
2
votes
0answers
24 views

What is the logic behind the given optimization problem?

I am following a book which has a part on numerical optimization techniques. In order to elaborate Karush-Kuhn-Tucker theorem, they gave the following example: When the unconstrained solution $x=A^+ ...
2
votes
0answers
33 views

solving a collaborative filtering problem

I was reading this paper Bell RM, Koren Y. Scalable collaborative filtering with jointly derived neighborhood interpolation weights. Proc - IEEE Int Conf Data Mining, ICDM. 2007:43-52. ...
2
votes
0answers
18 views

Linear space transform transformation based on covariance?

I have a linear space of n dimensions with non-overlapping groups characterized by different variation (different covariance matrices). Is there a way to deform non-linearly the space according to an ...
2
votes
0answers
24 views

variable transformation in optimization

I have an optimization problem with two sets of parameters, $x_i \in [0,1]$ and $y_k \in [-\frac{\pi}{2},\frac{\pi}{2}]$ where $i,k \in \{1...n\}$ are indices. One way to solve this problem is using ...
2
votes
0answers
28 views

Closest line to point after non-linear map

I have a map on a vector space $M(\vec{r})$, defined as below. All components (vectors, matrices, everything) are reals in the unit range $[0,1]$. The map $M(\vec r)$ is defined as the sum of an ...
2
votes
0answers
68 views

Solve constrained system of linear equations from samples of a reference function

I have a system of $2n$ linear equations in $2n$ unknowns represented by the standard matrix equation: $$Ax = b$$ Where the solution vector $x = (p_1, ..., p_n, q_1, ..., q_n)$ represents real ...
2
votes
0answers
134 views

Jackson's theorem to optimize mean queue length of a traffic model

I am working on traffic signals for a city transport system. I modeled the city transport using a queuing network as shown in the following image Arrival rate of "A" cars from outside is S1 and ...
2
votes
0answers
41 views

Solving a nonlinear constrained optimization involving CDF and expectation of normal distribution

I would like to know if it is possible to solve the following nonlinear constrained optimization problem and find how the optimal solution varies with $C$ and $\beta$: $\max_{x,y}\beta ...
2
votes
0answers
65 views

Is there any way to justify this approximation of the solution of a rather simple equation?

I am considering the problem of finding the root of equation $$f(x)=-x+\sum_{i=m}^{i=n} \sqrt{x+i}=0$$ where $m,n$ can both be from very small to very large integers. Since, in a single calculation, ...
2
votes
0answers
99 views

Nonlinear non-convex semi-infinite programming with norm equality constraint

In optimization theory, semi-infinite programming (SIP) is an optimization problem with a finite number of variables and an infinite number of constraints, or an infinite number of variables and a ...
2
votes
0answers
136 views

Strong duality for nonconvex quadratic program (with multiple constraints)

Consider the following optimization \begin{eqnarray} P_1: \quad &\underset{x\in\mathbb{C}^N}{\mathrm{minimize}}&\; f_0(x) \\ &\mathrm{subject\;to}&\; f_i(x) \leq 0, i=1,\ldots,m \\ ...
2
votes
0answers
150 views

From constrained to unconstrained maximization problem

I have the following constrained maximization problem $$ \max_{X_1,X_2,...,X_i,...,X_N} \sum_{i=1}^{N}X_i f_i(X_1,...,X_N) \hspace{0.2 cm} \text{subject to} \sum_{i=1}^{N}X_i-B\leq 0 \text{ and } ...
2
votes
0answers
96 views

short-sale constraint with nonpositive-definite matrix in portfolio optimization

This question is about portfolio optimization in R. I have a nonpositive-definite matrix. I have handled with the singularity. Unfortunately, quadprog etc. optimization packages fail to solve the ...
2
votes
0answers
28 views

discrete nonlinear convex optimization relaxation over a dense set

Be a discrete nonlinear convex optimization problem $P$ \begin{align} \underset{x\in \mathrm{C}^n}{\mathrm{min}} \ \ \ f(x) \\ Ax=b \\ c \leq x \leq d \end{align} $C$ is a dense in $F$. Is solving ...
2
votes
0answers
300 views

Direct multiple shooting (numerical optimal control)

please, Iam currently implementing direct multiple shooting method* and I need one simple but fundamental concept answered: When I want to provide not only objective funtion value (result of ODE ...
2
votes
0answers
36 views

Exercice the converge $r$-superlinearly

Give $x_0 \in \mathbb{R}^*$. Show that $\{x_k\} \subset \mathbb{R}$ converge $r$-superlinearly for $x^∗=0$, where $x_k$ is defined by $x_{k+1}=(1−\beta_k)x_k$ and $\beta_k=1−2^{-k}$ if $k=i^2$ for ...
2
votes
0answers
102 views

Saddle point problem (KKT) with block-diagonal matrix

Consider the following saddle point problem originating from an interior-point method algorithm: $$ \begin{bmatrix}\mathbf{H} & \mathbf{A}^{T}\\ \mathbf{A} & \mathbf{0} ...
2
votes
0answers
100 views

Constrained non-linear Optimization using Newton's method - Portfolio optimization

I want to solve following constrained optimization problem from portfolio optimization: The solution is supposed to be a modified risk parity portfolio: The optimization problem is: \begin{align} ...
2
votes
0answers
115 views

Constrained Quadratic Optimization(Reproducing Kernel)

I am attempting to use a constrained quadratic optimization to find the coefficients of a reproducing kernel. The problem is as follows: $y(t)=\sum_{i=0}^J\alpha_iK(t, t_i)$ $Q(\alpha)= ...
2
votes
0answers
362 views

Levenberg's original article “A method for the solution of certain problems in least squares”

Does there exist any digital copy of the original article (or a transcript) K. Levenberg, A method for the solution of certain problems in least-squares, Quart. Appl. Math. 2 (1944): 164-168? It is ...
2
votes
0answers
168 views

Maximize a function subject to the constraint $x^2+y^2=R^2$

Please help me how to deal with maximization of function $$f(x,y)=1-e^{-\pi x}+e^{\pi x}\left[1-\cos(\pi y)+\sin(\pi y)\right]$$ subject to the constraint $x^2+y^2=R^2$. Using Lagrange ...
2
votes
0answers
42 views

Calculating second derivative of $g(\alpha) = f(\textbf{y}(\alpha))$

I'm having problems with the second derivative of the function $g(\alpha) = f(\textbf{y}(\alpha))$ (which I will define more precisely below). I tried calculating it myself, could anyone just simply ...
2
votes
0answers
103 views

the objective function $\|F\|_F^2$ is quasiconvex in the optimization?why?

I have read a paper, but I can not understand one optimization thoroughly.Generally, Frobenius norm of one matrix, $\|F\|_F^2$, as the objective function is convex, so we can resolve it not using the ...
2
votes
0answers
96 views

Steepest Descent/Newton

Suppose these over-determined system of equations: $$ |\mathbf{x}^T\mathbf{v_n}| = A, \qquad n = 1,2,\cdots,N-1 $$ $$ \mathbf{v_n}= [1 \quad w^n \quad w^{2n} \quad \cdots \quad w^{(N-1)n}]^T , ...
2
votes
0answers
92 views

Nonlinear optimization of constraint parameter - subdifferential?

Disclaimer: I discovered that the FAQ suggests to post research-level to mathoverflow instead of math.stackexchange. I "moved" the question accordingly, cp. post at mathoverflow. Sorry for the ...
2
votes
0answers
498 views

SDP relaxation of non-convex QCQP and duality gap

Short version Is there a duality gap between a QCQP problem and the SDP problem obtained through lagrangian relaxation? A paper I'm studying is using this fact, but I cannot achieve the authors' ...
2
votes
0answers
54 views

Linearization of a dynamic system, $\small 10 \frac{d^2 y}{dt^2} + \frac{d y}{dt} = u^2(t) $

I have a dynamic system, with in signal u and out signal y. The system is described with the following differential equation $$ 10 \frac{d^2 y}{dt^2} + \frac{d y}{dt} = u^2(t) $$ The task is to ...
2
votes
0answers
45 views

Convex formulation of a nearly convex optimization problem

The following problem has come up in my studies of logarithmic norms. I wish to find $\mu \in \mathbb{R}$ and a positive semidefinite $B$ so as to minimize the convex function $c \mu - \log\det(B)$ ...
2
votes
0answers
416 views

sufficient condition for KKT problems

For the Karush-Kuhn Tucker optimsation problem, Wikipedia notes that: "The necessary conditions are sufficient for optimality if the objective function f and the inequality constraints g_j are ...