A non-linear optimization problem includes an objective function (to be minimized or maximized) and some number of equality and/or inequality constraints where the objective or some of the constraints are non-linear. Use this tag for questions related to the theory of solving such problems or for ...

learn more… | top users | synonyms

7
votes
0answers
94 views

Consider the problem minimize $f(x)= x^4 −1. $

I am studying for a test and I found this problem in the textbook that I'm using, there may be a conceptual problem that I'm coming across. My test is on unconstrained optimization (multi-variable) ...
5
votes
0answers
208 views

I need help about some compactness arguments

I need help to find some compact sets for my engineering problem. Through this page I learned quite much about it however since I have neither read a book yet nor have an experience I am not able to ...
4
votes
0answers
32 views

Nonlinear optimisation of Expectation

I am preparing for my exams and I can't get my head around the following question. I know there exists a general method for solving these problems but I don't know where to start. I would greatly ...
4
votes
0answers
169 views

Why Compactness is Necessary at Minimax Theorem

According to Von Neumann's minimax theorem, I have $$\max_{x\in X} \min_{y\in Y}f(x,y)=\min_{y\in Y} \max_{x\in X} f(x,y)$$ for some compact sets $X$ and $Y$ and a convex (in $y$), concave (in $x$) ...
4
votes
0answers
297 views

(easier version)What is a working example for finding the maximum of a algebraic function $f(a,b,c,d,e)$ with 4 equality …

edit 2: If you are founding an answer would be interesting to you, please upvote this question, because i may use those point in order to start a new bounty. Edit 3: Can somebody answer? Edit 4:I ...
3
votes
0answers
29 views

Solving an inverse squared sum

How would I go about solving this sum for $x$? $$\sum_i\frac{a_i}{(x+b_i)^2}=C$$ Where $\mathbf{a}$ and $\mathbf{b}$ are vectors and $C$ is a constant, and $x$ is a single number. It's for an ...
3
votes
0answers
149 views

Finding optimal velocity profile using Dynamic Programming

This question has been asked on scicomp but I thought maybe it's more a mathematical problem of how Bellman's idea is to be applied here. The main problem for me is: How to introduce the time ...
3
votes
0answers
38 views

Solve non-linear equation with Matrices

I'm looking more for hints than specific answers, although I would be extremely grateful if provided with one. The problem I have is as follows: $$ -\Sigma (A+\Lambda_1)+I=0 $$ Here A is a constant, ...
3
votes
0answers
60 views

Strong duality: When does the optimal primal variable coincide with the primal variable giving the dual function.

I'm considering the inequality-constrained optimization problem of finding $$ x^{\star} = \arg \min_{x} f(x) \;\; \text{s.t.} \;\; h(x) \le 0 $$ which is assumed to have a unique minimizer. The ...
3
votes
0answers
25 views

How does this polar function behave?

I came across this question in my textbook for Nonlinear Optimisation and I don't know what to do: Consider the function: $$ f(x_1,x_2)=(r-1)^2-\frac{1}{2}(r-1)^2\cos \left( \frac{1}{r-1}-\phi ...
3
votes
0answers
85 views

Solver for sparse linearly-constrained non-linear least-squares

Reposted from stackoverflow on the advice of Nick Rosencrantz: Are there any algorithms or solvers for solving non-linear least-squares problems where the jacobian is known to always be sparse, and ...
3
votes
0answers
80 views

System of many non-linear (quadratic) first order O.D.E. (numerical strategy or simplification)

I have a large system (N>100) of equations $\frac{d\vec{P}}{dt}= A(t) + B(t) \vec{P} + \vec{P}^T C(t) \vec{P}$ where $\vec{P}$ is a vector of N functions of the variable t. What is the correct ...
3
votes
0answers
278 views

Optimizing non linear programs of two variables

The scenario is; We've got $n$ stationary 360$^{\circ}$ sensors in an confined area (each sensor is located at some arbitrary $\left(x,y\right) = \left(x_{n},y_{n}\right)$), once a unit $t$ enters ...
3
votes
0answers
748 views

Convex minimization over the Unit Simplex

I have a simple (few variables), continuous, twice differentiable convex function that I wish to minimize over the unit simplex. In other words, $\min. f(\mathbf{x})$, $\text{s.t. } \mathbf{0} \preceq ...
2
votes
0answers
23 views

Determining active constraints in KKT

Suppose there is a constrained optimization problem having inequality constraints. We can solve it using Karush-Kuhn-Tucker conditions. My question is how do we determine which constraints are active ...
2
votes
0answers
54 views

Is there any way to justify this approximation of the solution of a rather simple equation?

I am considering the problem of finding the root of equation $$f(x)=-x+\sum_{i=m}^{i=n} \sqrt{x+i}=0$$ where $m,n$ can both be from very small to very large integers. Since, in a single calculation, ...
2
votes
0answers
103 views

Strong duality for nonconvex quadratic program (with multiple constraints)

Consider the following optimization \begin{eqnarray} P_1: \quad &\underset{x\in\mathbb{C}^N}{\mathrm{minimize}}&\; f_0(x) \\ &\mathrm{subject\;to}&\; f_i(x) \leq 0, i=1,\ldots,m \\ ...
2
votes
0answers
37 views

Structural / design / meta optimization - is there mathematical theory. Optimization over categories?

There is huge branch of mathematical optimization theory, but it mostly considers the finding optimal parameter values for the predefined structures. There are variational calculus and optimal control ...
2
votes
0answers
51 views

From constrained to unconstrained maximization problem

I have the following constrained maximization problem $$ \max_{X_1,X_2,...,X_i,...,X_N} \sum_{i=1}^{N}X_i f_i(X_1,...,X_N) \hspace{0.2 cm} \text{subject to} \sum_{i=1}^{N}X_i-B\leq 0 \text{ and } ...
2
votes
0answers
46 views

short-sale constraint with nonpositive-definite matrix in portfolio optimization

This question is about portfolio optimization in R. I have a nonpositive-definite matrix. I have handled with the singularity. Unfortunately, quadprog etc. optimization packages fail to solve the ...
2
votes
0answers
21 views

discrete nonlinear convex optimization relaxation over a dense set

Be a discrete nonlinear convex optimization problem $P$ \begin{align} \underset{x\in \mathrm{C}^n}{\mathrm{min}} \ \ \ f(x) \\ Ax=b \\ c \leq x \leq d \end{align} $C$ is a dense in $F$. Is solving ...
2
votes
0answers
123 views

Direct multiple shooting (numerical optimal control)

please, Iam currently implementing direct multiple shooting method* and I need one simple but fundamental concept answered: When I want to provide not only objective funtion value (result of ODE ...
2
votes
0answers
34 views

Exercice the converge $r$-superlinearly

Give $x_0 \in \mathbb{R}^*$. Show that $\{x_k\} \subset \mathbb{R}$ converge $r$-superlinearly for $x^∗=0$, where $x_k$ is defined by $x_{k+1}=(1−\beta_k)x_k$ and $\beta_k=1−2^{-k}$ if $k=i^2$ for ...
2
votes
0answers
61 views

Constrained non-linear Optimization using Newton's method - Portfolio optimization

I want to solve following constrained optimization problem from portfolio optimization: The solution is supposed to be a modified risk parity portfolio: The optimization problem is: \begin{align} ...
2
votes
0answers
59 views

Constrained Quadratic Optimization(Reproducing Kernel)

I am attempting to use a constrained quadratic optimization to find the coefficients of a reproducing kernel. The problem is as follows: $y(t)=\sum_{i=0}^J\alpha_iK(t, t_i)$ $Q(\alpha)= ...
2
votes
0answers
154 views

Levenberg's original article “A method for the solution of certain problems in least squares”

Does there exist any digital copy of the original article (or a transcript) K. Levenberg, A method for the solution of certain problems in least-squares, Quart. Appl. Math. 2 (1944): 164-168? It is ...
2
votes
0answers
124 views

Maximize a function subject to the constraint $x^2+y^2=R^2$

Please help me how to deal with maximization of function $$f(x,y)=1-e^{-\pi x}+e^{\pi x}\left[1-\cos(\pi y)+\sin(\pi y)\right]$$ subject to the constraint $x^2+y^2=R^2$. Using Lagrange ...
2
votes
0answers
40 views

Calculating second derivative of $g(\alpha) = f(\textbf{y}(\alpha))$

I'm having problems with the second derivative of the function $g(\alpha) = f(\textbf{y}(\alpha))$ (which I will define more precisely below). I tried calculating it myself, could anyone just simply ...
2
votes
0answers
69 views

the objective function $\|F\|_F^2$ is quasiconvex in the optimization?why?

I have read a paper, but I can not understand one optimization thoroughly.Generally, Frobenius norm of one matrix, $\|F\|_F^2$, as the objective function is convex, so we can resolve it not using the ...
2
votes
0answers
81 views

Steepest Descent/Newton

Suppose these over-determined system of equations: $$ |\mathbf{x}^T\mathbf{v_n}| = A, \qquad n = 1,2,\cdots,N-1 $$ $$ \mathbf{v_n}= [1 \quad w^n \quad w^{2n} \quad \cdots \quad w^{(N-1)n}]^T , ...
2
votes
0answers
76 views

Nonlinear optimization of constraint parameter - subdifferential?

Disclaimer: I discovered that the FAQ suggests to post research-level to mathoverflow instead of math.stackexchange. I "moved" the question accordingly, cp. post at mathoverflow. Sorry for the ...
2
votes
0answers
380 views

SDP relaxation of non-convex QCQP and duality gap

Short version Is there a duality gap between a QCQP problem and the SDP problem obtained through lagrangian relaxation? A paper I'm studying is using this fact, but I cannot achieve the authors' ...
2
votes
0answers
54 views

Linearization of a dynamic system, $\small 10 \frac{d^2 y}{dt^2} + \frac{d y}{dt} = u^2(t) $

I have a dynamic system, with in signal u and out signal y. The system is described with the following differential equation $$ 10 \frac{d^2 y}{dt^2} + \frac{d y}{dt} = u^2(t) $$ The task is to ...
2
votes
0answers
41 views

Convex formulation of a nearly convex optimization problem

The following problem has come up in my studies of logarithmic norms. I wish to find $\mu \in \mathbb{R}$ and a positive semidefinite $B$ so as to minimize the convex function $c \mu - \log\det(B)$ ...
2
votes
0answers
297 views

sufficient condition for KKT problems

For the Karush-Kuhn Tucker optimsation problem, Wikipedia notes that: "The necessary conditions are sufficient for optimality if the objective function f and the inequality constraints g_j are ...
2
votes
0answers
257 views

Optimization over function spaces

There are many methods to solve optimization over standard spaces such as real and complex numbers or vector spaces of these. In my case I have a vector space of functions of a real value to find. ...
2
votes
0answers
65 views

equivalence between primitive and dual

I have a problem about the duality gap of the primitive problem and the dual problem. This problem comes from a probabilistic model named Lagrangian UVM. As this figure shows, this is a trinomial ...
1
vote
0answers
9 views

Gauss-Newton Non-Linear Squares Optimisation

I doubt this is solvable at all, but I thought I will give a try. Essentially I am trying to extend Gauss-Newton algorithm to 2nd Taylor term. ...
1
vote
0answers
26 views

How to prove a solution is indeed a constrained minimum?

I'm reading the following example on Heath's Scientific Computing (page 266, second edition if anyone has it). "Minimize $f(x_1,x_2)=2\pi x_1(x_1+x_2)$ subject to $g(x_1,x_2)=\pi x^2_1x_2-V$" ...
1
vote
0answers
17 views

Maximizing the frobenius norm subject to constraints $\underset{\mathbf{S}}{\text{maximize }} \|\mathbf{S}\|_F^2$

IF $\mathbf{X=AS}$ where $\mathbf{X} \in R_+^{n \times m}$, $\mathbf{A} \in R_+^{n \times r}$ are known variable and $\mathbf{S} \in R_+^{r \times m}$ is unknown variable, How to solve the below ...
1
vote
0answers
171 views

Global and local maxima in a weighted sum of logarithms of linear functionals?

Is is possible to describe, and locate efficiently, the maxima of the function below in the parameters $\mathbf{x}$ $$\sum_{i} p_i \log( N + \sum_j x_j[B_j +(A_j-B_j)\delta_{ij} + min(A_j,B_j) ]) ...
1
vote
0answers
32 views

Tucker's theorem from Farkas lemma

I am trying to understand the proof of Tucker's theorem using Farkas lemma but there are some points that are not clear to me. The proof I am following is in this paper at page 16. What I do not ...
1
vote
0answers
27 views

what is the good book to learn nonlinear programming

I would like to learn nonlinear programing. what is the best book to do so and I prefer if the solution manual of the book is available. thanks
1
vote
0answers
33 views

How to solve coupled nonlinear ODEs with a algebraic constraints?

Here is the problem I'm currently facing right now, I have set of ODEs which I can solve numerically given the initial condition. But I'm not sure how to go about giving algebraic solution with ...
1
vote
0answers
17 views

Basis pursuit denoising

The Lagrangian form of basis pursuit denoising $\min_{w} ||w||_{\ell_{1}} + \lambda ||Aw-x||_{\ell_{2}}^{2}$ can be solved using proximal gradient descent. Proximal methods also can be used to ...
1
vote
0answers
24 views

Minimum of the difference of two logarithms

I am trying to find an analytical expression of the minimum of $$ f_n(x) = \frac{2x}{n^2+n}\log(x) - \frac{2x+2}{n^2+3n+2}\log(x+1) $$ when $x\in [1;n]$ I used to think from graphing it that this ...
1
vote
0answers
135 views

Intuition for gradient descent with Nesterov momentum

A clear article on Nesterov’s Accelerated Gradient Descent (S. Bubeck, April 2013) says The intuition behind the algorithm is quite difficult to grasp, and unfortunately the analysis will not be ...
1
vote
0answers
23 views

Penalty methods in Unconstrained problems

Let me define $p : \mathbb{R}^n \to \mathbb{R}$ as a penalty function for the feasible set $\mathcal F$ of an equality and inequality constrained problem $(P)$ $$(P) : \text{min}\space f(x) \space ...
1
vote
0answers
17 views

Convexity Proof with constraints on the gradient

Consider a minimization problem $(P)$ : minimize $f(x)$ subject to $\delta_C(x) \leq 0$ Now assume that $\emptyset \neq C \subset \mathbb{R}^n$ is convex and let $f: \mathbb{R}^n \to \mathbb{R}$ be ...
1
vote
0answers
39 views

Difficulty in understanding a solution: Constraint minimization of sum of Non-symmetric matrices

I am trying to understand why there is significance difference in the performance of two proposed solutions. Original question (Constraint minimization of sum of Non-symmetric matrices) ...