A non-linear optimization problem includes an objective function (to be minimized or maximized) and some number of equality and/or inequality constraints where the objective or some of the constraints are non-linear. Use this tag for questions related to the theory of solving such problems or for ...

learn more… | top users | synonyms

1
vote
1answer
56 views

Help to understand the setting up of this Lagrangian

So..I understand up to step 4..but then there are these things I dont get, to start with , it says on (5) that the utility function depended only on the ratios p1/w p2/w ?? why does it say that? ...
1
vote
0answers
29 views

Nonlinear optimization using parallel input/output

I have a system that accepts a vector and returns a function value. The goal is to change the elements of the vector such that the function value is minimized using a derivative-free solver, eg. using ...
1
vote
0answers
51 views

Regression/compressive sensing with non-linear constrains where the coefficients are assumed to be integer or binary {0,1}

The following regression problem $$ \mathbf{y} = \mathbf{A}\mathbf{x} $$ where $\mathbf{y}$ is a $N\times 1$ column real vector, $\mathbf{A}$ is a $N\times M$ real matrix where each column ...
7
votes
1answer
204 views

$\max\min$ problem

Suppose there is a real valued function $f(x,y)$ where $x,y$ are vector variables $x\in\mathbb{R}^n$ $y\in\mathbb{R}^m$. Moreover $f$ is strictly/concave in $x$ and strictly/convex in $y$. $f$ is also ...
2
votes
1answer
210 views

Does the uniqueness of solutions to convex optimization with linear constraints hold in n>3 dimensions?

This is a repost of an earlier question, where I think I was not clear enough in what I was asking: I am examining the following optimization problem, for which I would like to know if, when a ...
2
votes
0answers
40 views

Calculating second derivative of $g(\alpha) = f(\textbf{y}(\alpha))$

I'm having problems with the second derivative of the function $g(\alpha) = f(\textbf{y}(\alpha))$ (which I will define more precisely below). I tried calculating it myself, could anyone just simply ...
1
vote
1answer
31 views

Non linear programming please HELP

Hey guys, I never do that but just found out that I have an assignment due in a few hours..thought it was for later, any help/solutions for this one?
2
votes
0answers
69 views

the objective function $\|F\|_F^2$ is quasiconvex in the optimization?why?

I have read a paper, but I can not understand one optimization thoroughly.Generally, Frobenius norm of one matrix, $\|F\|_F^2$, as the objective function is convex, so we can resolve it not using the ...
0
votes
1answer
159 views

How to get the closed form solution of a non-convex optimization problem?

I want to know if there is a closed form expression for the optimal objective function? How can I get it, if it does exist? Condition: $h,f\in \mathbb{C}^{N\times1}, \epsilon > 0 $. $\max \ \ ...
1
vote
0answers
42 views

how to minimize this convex function?

$x_i$ and $y_j$ are variables. I intend to minimize this function and obtain the optimal value of $x$ and $y$: $\begin{align} ...
0
votes
1answer
220 views

maximizing a function of a positive semi-definite matrix with bounded trace

I need to maximize a function $f(A)$ where $A$. With the constraints that $A$ is positive definite and has a trace $tr(A) \leq K$. $tr(A)=K$ will work for my problem too. I can differentiate towards ...
1
vote
0answers
38 views

On solving non-linear programming problem and the relevant software

I have a non-linear programming problem, in which all the inequality is linear and only the optimization goal is in a non-linear form. The problem is as following. $x_j$ is the variables and $a_{k,j}$ ...
1
vote
0answers
126 views

Distinction between linear and nonlinear model

[I have already asked this question on CrossValidated but until now received no answer] I have read some explanations about the properties of linear vs nonlinear models, but still I am sometimes not ...
0
votes
1answer
66 views

Approximating the optimal value of a function involving a Gaussian integral

Consider the following function $$ f(\lambda) = \alpha (1+\lambda^2) + (1-\alpha)2\int_\lambda^\infty (x-\lambda)^2 \phi(x) dx $$ where $\alpha \in (0,1)$ and $\phi$ is the standard normal probability ...
1
vote
0answers
81 views

Methods to minimise multilinear functions with trilinear, quad-linear and higher-linear terms?

My goal is to minimize functions such as $$f_1(\mathbf{p})=p_1p_3p_7+p_1p_4p_7+p_2p_3p_7+p_2p_4p_7-p_1p_3p_5p_6-p_1p_4p_5p_6-p_2p_3p_5p_6-p_2p_4p_5p_6$$ and ...
0
votes
1answer
50 views

how to solve this optimization problem with functions?

Suppose $\theta\in[0,1]$ and $s(\cdot)$ is strictly increasing in $\theta$ with $0\leq(0)<s(1)\leq1$ and $s(0)+s(1)>1$ How could I solve the program, $\max_{s(\cdot)\in ...
1
vote
0answers
60 views

Linear Complementarity Problem - multiple solutions, which one will it find?

If I have a inequality constrained system: w = Mz + q <= 0, z<=0, z^T w = 0 that for some given properties M and ...
1
vote
0answers
146 views

Dimension analysis and explaining the $\varepsilon$

Reference of this post (page no 6 from equation 39) The time averaged total energy, $\bar E$, has the following $\varepsilon$ expansion in $D$ dimension: \begin{equation} ...
0
votes
1answer
257 views

optimization of a non-differentiable, component-wise step function

I would like to estimate the (local) minimum of a function $c:R^N \mapsto R^+$ where: $c$ is only differentiable almost everywhere, there exists a component $j$, such that $\frac{\partial ...
2
votes
1answer
352 views

Optimizing trigonometric and nonlinear functions

First, Please, keep in mind that I'm a programmer not mathematician, and I have a fair mathematical background. I used optimization in Java to fit some observations to a trigonometric function, I ...
3
votes
2answers
151 views

Optimization for constrained problem

I'm reading about Lagrange multipliers from a Pattern recognition book appendix and on one point the following is stated: $\begin{align} ...
1
vote
0answers
270 views

iterative method to solve nonlinear equations

I'd like to know whether there are any methods like the Gauss-Seidel method to solve nonlinear equations. For example, I'd like to solve $f(\textbf x) = 0$, where $f(\textbf x)$ is a nonlinear ...
0
votes
1answer
52 views

Approaches to fitting noisy oscillatory data?

I have observations $\hat{f}$ from data at points $\mathbf{x}=\{x_1,\ldots,x_N\}$, that is modeled as a known oscillatory form $f(k\ x)$ (for example, the sinc function), where $k$ controls the ...
2
votes
2answers
1k views

Which optimization algorithm converges faster?

everyone. I'm having a large scale unconstrained optimization problem. If I treat the unconstrained problem as a constrained problem with infinity constraints, I should be able to use both the ...
0
votes
1answer
45 views

Directive on Dimensionality Reduction

I have a data set (24 data records) which is in $\mathbb{R}^{13}$ and I need to project it to a lower dimension (at least to $\mathbb{R}^{3}$). My objective of the dimensionality reduction is to ...
1
vote
1answer
66 views

A minimization problem

Define $$L(w,u)=\frac{1}{2}\|w-u\|^2+\beta \left\|\frac{w}{x}\right\|,~w,u\in \Bbb{R}^n$$ where $$\frac{w}{x}=\left(\frac{w_1}{x_1},\ldots, \frac{w_n}{x_n}\right)$$ $$\|x\|=\sqrt{x_1^2+\cdots+x_n^2}$$ ...
1
vote
1answer
48 views

A minimization problem [duplicate]

Define $$L(w,u)=\frac{1}{2}\|w-u\|^2+\beta \|\frac{w}{x}\|,~w,u\in R^n$$ where $$\frac{w}{x}=(\frac{w_1}{x_1},\dots, \frac{w_n}{x_n})$$ $$\|x\|=\sqrt{x_1^2+\cdots+x_n^2}$$ Given $u$, $x$ and $\beta$, ...
0
votes
1answer
909 views

Optimization of a function of two variables.

Suppose we have to minimize a function $f(\mathbf x,\mathbf y)$ where $\mathbf x$, $\mathbf y$ are vectors in Euclidean space. The function is convex in $\mathbf y$ when $\mathbf x$ is kept constant ...
2
votes
0answers
81 views

Steepest Descent/Newton

Suppose these over-determined system of equations: $$ |\mathbf{x}^T\mathbf{v_n}| = A, \qquad n = 1,2,\cdots,N-1 $$ $$ \mathbf{v_n}= [1 \quad w^n \quad w^{2n} \quad \cdots \quad w^{(N-1)n}]^T , ...
0
votes
0answers
634 views

An example of the Sequential Quadratic Programming (SQP)

Given an objective function $f(x,y)=(x+6)^2+(y-10)^2$, we want to minimize the function $f$ under a constrained condition $xy-5\leq0$. Obviously it is a constrained optimization, a good algorithm to ...
1
vote
1answer
128 views

Minimize a nonlinear sum subject to a quadratic constraint

Currently I am solving an optimization problem that could be written as follows: $$\min J= \sum_{i=1}^N {(q_i^H\Lambda q_i)}^{\frac{1}{3}} $$ subject to $\{q_i\}_{i\in [1..N]}$ forming an ...
3
votes
1answer
119 views

minimizing $\sum_{i=1}^n \max(|x_i - x|, |y_i - y|)$

Suppose there are $n$ points $(x_i, y_i)$ for $i = 1,\ldots,n$. Please find another point $(x, y)$ to minimize function: $$\sum_{i=1}^n \max(|x_i - x|, |y_i - y|)$$
3
votes
1answer
535 views

Solving a system of non-linear (trig) equations:

I am having trouble trying to solve the following equations: $\sin(\alpha)+\sin(\beta)=\dfrac {1000} A$ $\sin(\alpha)+\sin(\gamma)=\dfrac {800} A$ $\dfrac {20(1+\cos(\alpha-\beta))} {\cos(\beta)} ...
1
vote
0answers
192 views

Optimization: Minimizing Quadratic Vector Valued Functions

I have a vector valued function $F: \mathbf{R}^{n} \rightarrow \mathbf{R}^{m}$, which consists of quadratic taylor approximations. So one could say that function F consists of stacked approximations ...
0
votes
0answers
96 views

How to optimize a function with several variables

I need to develop code to optimize a set or variables based on the following conditions. I don't have the source of function. The function gets a point (x,y) and generate a mapped point (x',y') ...
1
vote
0answers
63 views

Formulating square packing as a form of optimization

I was looking at square packing problem which is defined as: Given a number N... Find the smallest square that can pack N unit squares Each square can be associated with a 3 dimensional point ...
1
vote
2answers
32 views

how do i find $\max\{x+z\}$ and $\max\{1+y^2\}$ where ?$x\ge0 $,$ y\ge0$,$ z\ge0$ and$xy+xz+yz=1 $

how compute $\max\{x+z\}$ and $\max\{1+y^2\}$? such that $x$,$y$,$z$ satisfied $$\begin{cases} xy+xz+yz=1 & \\ x\ge0 \\ y\ge0\\ z\ge0\\ \end{cases} $$ i face with this problem when i try ...
1
vote
1answer
146 views

Gradient descent/ nonlinear optimization intuition needed

all. I'm taking an introductory AI class, and we're using the gradient descent algorithm to find the optimized/ lowest cost of a set of thetas (variable coefficients) to best fit a regression line. In ...
3
votes
3answers
97 views

How do one solve a nonlinear combinatoric problem?

I am an undergraduate CS student and I am struggling with a problem. $Qx = b$ where $Q$ is a constant $m \times n$ matrix (with $m>n$), $x$ is a $n \times 1$ vector and $b$ is a $m\times 1$ ...
2
votes
2answers
913 views

How can I solve Lagrange multiplier equation with multi constraints?

This site is really awesome. :) I hope that we can share our ideas through this site! I have an equation as below, $$ min \ \ w^HRw \ \ subject \ \ to \ \ w^HR_aw=J_a, \ w^HR_bw=J_b$$ If there is ...
0
votes
2answers
140 views

Fastest Algorithm for NLP with linear constraints

I have an minimization problem of the following form: (Im not a mathematician, i come from the programming side, so excuse me if i have not the perfect standard of writing the formulas) $Z(x) = ...
1
vote
2answers
811 views

Solve the Lagrangian dual problem

Consider the (non-linear) optimization problem ($P$) $$max \quad3x_1 + 4x_2$$ $$s.t. \quad x_1^2 + x_2^2 \leq 25$$ $$ \quad x_1,x_2 \geq 0$$ Solve the Lagrangian dual problem. I ...
0
votes
0answers
76 views

Optimization problem - maximizing number of satisfied linear inequalities subject to quadratic constraint

I am wondering if anything is known about optimization problems of the following type. Our control $x$ is a unit vector in $\mathbb{R}^n$. We are given a finite number of linear inequalities $$A z ...
2
votes
1answer
77 views

Formulate the Langrangian function of a non-linear optimization problem and solve it for $y\geq0$

Consider the (non-linear) optimization problem ($P$) $$max \quad3x_1 + 4x_2$$ $$s.t. \quad x_1^2 + x_2^2 \leq 25$$ $$ \quad x_1,x_2 \geq 0$$ Formulate the Lagrangian function ...
6
votes
1answer
199 views

Is duality theory in optimization as useful as it seems?

I have been reading a lot about nonlinear optimization and duality, and it seems that duality theory is extremely useful. I feel that I am missing some of the negative aspects/difficulties associated ...
3
votes
0answers
84 views

Solver for sparse linearly-constrained non-linear least-squares

Reposted from stackoverflow on the advice of Nick Rosencrantz: Are there any algorithms or solvers for solving non-linear least-squares problems where the jacobian is known to always be sparse, and ...
0
votes
0answers
94 views

an upper semi-continuous semi-strictly quasi-concave function

May you help me? I was confused that why "an upper semi-continuous semi-strictly quasi-concave function is quasi-concave". If there is a picture,it may be better. I really need your help ~ Thank ...
1
vote
2answers
201 views

How to draw a fixed length curve?

Is it possible to draw a curve with some specified length between two points? I'm considering damped sines like WolframAlpha or Bezier curves.
1
vote
1answer
353 views

Cost minimization problem

The problem is as follows: A firm uses $k$ units of capital and $l$ units of labor to produce $(k^{\alpha}l^{1-\alpha})^{1/\beta}$ units of output, where $\alpha$ and $\beta$ satisfying $0 < ...
1
vote
2answers
399 views

Convex Optimization of quadratic function with inequality constraints

How would I solve the following problem? $$\min_{x\in\mathbb{R}^n} x^T A x$$ subject to the constraints $$x_i\geq 1,\,i=1,\dots,n,$$ where A is positive semidefinite and symmetric. Is it possible to ...