Optimization is the process of choosing the "best" value among possible values. They are often formulated as questions on the minimization/maximization of functions, with or without constraints.

learn more… | top users | synonyms (5)

0
votes
0answers
8 views

How to minimize $ \int (u(x) - v(x))^2 + \lambda|\rho(v(x))| dx $

I'm new in optimizations and i am trying to understand how to obtain $ v $ that minimizes $ \int_{\Omega} \frac1{ \theta} (u(x) - v(x))^2 + \lambda|\rho(v(x))| dx $ where $\rho(x)$ - continuous ...
0
votes
1answer
10 views

$F(x,y)=2x^4-3x^2y+y^2$. Show that $(0,0)$ is local minimum of the Reduction of F for every linear line that passes through $(0,0)$.

first of all i checked if (0,0) is critical point $Df(0,0)=(8x^3-6xy,-3x^3+2y)| = (0,0) $ now my idea was to replace $y$ with $xk$ because of the reduction of $F$ ,and find the hessian matrix to ...
0
votes
0answers
9 views

Find the equations that determine minimizing x for the following

I don't quite understand what the question is asking and how to approach it. I am given the following two equations: i. P=1/2 $x^T A^T AX- x^TA^Tb$ ii. E=$||Ax-b||^2$ I could use some pointers ...
0
votes
0answers
18 views

A question on quadratic optimization

I am sorry that I haven't taken any course on optimization, could anyone tell me how to solve the following problem? Thank you very much. Minimize $$x^T\left( \begin{array}{rr} 1 & -1 \\ -1 & ...
0
votes
1answer
12 views

Finding the minimum value of $1/2 (x_{1}^2+x_{2}^2)-x_{2}b_{2}$

I am trying to find the minimum value of the following: $1/2 (x_{1}^2+x_{2}^2)-x_{2}b_{2}$ I know this is equal to: $1/2 ([x_1 x_2] Id [x_1 x_2]^T )-[x_1 x_2] [0 b_2]^T$ To find minimum we have to ...
1
vote
1answer
25 views

Recover the inverse after interative solution of a linear system

I have solved the linear system $\mathbf{A} \mathbf{x} = \mathbf{b}$ with an iterative solver. The problem is well-posed ($\mathbf{A}$ is invertible, $\mathbf{b} \ne \mathbf{0}$, blah blah blah). ...
0
votes
0answers
21 views

Find $\min x^TAy+b^Tx+c^Ty$ subject to $1^Tx=1^Ty=1,x\ge 0,y\ge 0$

The problem seems to be easy but I can't find a solution :( Problem: Given $A\in\mathbb{R}^{m\times n}, A\ge 0, b\in\mathbb{R}^{m}, c\in\mathbb{R}^{n}$. Minimize $f(x,y) = x^TAy+b^Tx+c^Ty$ subject to ...
1
vote
1answer
24 views

minimizing linear combination of inner products

$\mathbf{x},\mathbf{y_1},\mathbf{y_2}\in \mathbb{R}^{m}$ and $\alpha_1,\alpha_2 \in \mathbb{R}$. Also $\|\mathbf{y_1}\|_2 = \|\mathbf{y_2}\|_2 = 1$ and $\alpha_1\geq\alpha_2\geq0$. How should we ...
0
votes
0answers
9 views

A good enough solution for the 0-1 multiple knapsack problem

Can you please explain, or point to an easy explanation of a good enough solution to the 0-1 multiple knapsack problem? This is a single constraint problem so only one-dimensional weights are to be ...
-1
votes
0answers
21 views

Multivariable Optimization

I'm struggling to figure out how to go about this question: You are to produce a concrete box with an open top with a volume of 1$m^3$, having a wall and base thickness of $2$cm, by pouring concrete ...
5
votes
2answers
115 views

Arc length contest! Minimize the arc length of $f(x)$ when given 3 conditions.

Contest: Give an example(s) of a continuous function $f$ that satisfies three conditions: $f(x) \geq 0$ on the interval $0\leq x\leq 1$; $f(0)=0$ and $f(1)=0$; the area bounded by the graph of $f$ ...
0
votes
1answer
20 views

Using Lagrangian multipliers to check the solution

suppose we have an objective function $f(x)$ that we want to maximize subject to constraint $g(x)=c$. What I do next is set up Lagrangian optimization as follows and take the derivative ...
1
vote
1answer
25 views

how to find the solution of this cost function?

I have the following cost function. $J = \sum_{i=1}^N a\, Trace(W^TX_iW) - b\, Trace(W^TY_iW)$ Where $X_i$ and $Y_i$ are symmetric matrices, $a$ and $b$ are scalars. How can I find W?
0
votes
0answers
14 views

Linear optimization with constraint on the sum on “consecutive” indexes

I am struggling with the following optimization problem. Given $\{\lambda_i\}_{i=1\ldots k} > 0$ consider $\max_{x_i \in A} \sum_{i=1}^k \lambda_i x_i$ where $A = \{x_i \in \mathbb{R} : ...
0
votes
1answer
29 views

Eigen value system? solution

I have the following system. $AW = \lambda B W$ Where $A,B,W$ are matrices and $\lambda$ is a scalar. The values of $A,B$ and $\lambda$ are known. $B$ is invertible. This is a solution to an ...
0
votes
0answers
4 views

Unique minimizer of $\|x\|_{\mathcal A}$ subject to $\Phi x=\Phi x_0$

I'm trying to understand the proof of Lemma 2.3 of the paper Simple bounds for recovering low-complexity models. The authors want to find bounds on the numbers of rows $m$ of $\Phi$ to ensure that ...
0
votes
0answers
3 views

How to know the rate of convergence of a majorization - minimization algorithm?

The basic idea of majorization-minimization (MM) principlein optimization is to convert a hard problem (for example, non-smooth) into a sequence of simpler ones (for example smooth). To minimize ...
0
votes
1answer
32 views

Founding maxima or minima to a function

$g(x)=e^{x-1}+x^{2}-3+2x$ How can I find when this function has maxima and minima? I found the derivative but I can't understand how find the solution when $g'(x)=0$. It's high school material.
0
votes
1answer
17 views

Network/graph theory -acyclic problem [on hold]

Consider an acyclic directed network of n vertices, labeled $i=1...n$, and suppose that the labels are assigned such that all edges run from vertices with higher labels to vertices with lower. Show ...
2
votes
1answer
30 views

Remove minimal number of elements

Given the numbers $ 1,2,..,2n + 1 $ , $ n > 0$ , remove as few numbers as possible so that among the remaining numbers no number is equal to the sum of two other numbers. After removal of first ...
1
vote
0answers
32 views

Maximizing sum of sign functions

I want to solve the following optimization problem: $$ \max_{{\bf u}} \sum_{i=1}^N \left(a_i \textrm{ sign}({\bf u \ . x_i}) \right), $$ where ${\bf u}$ and ${\bf x_i}$ are $p\times1$ vectors, $a_i ...
1
vote
0answers
55 views
+50

Analyze the variation of this function $f(x)=x \exp[a+b(x-1)] \, E_1[a+b (x-1)]$ w.r.t. $x$

Please, I need to analyse the variation of the following function w.r.t. $x$ : $f(x)=x \exp[a+b(x-1)] \, E_1[a+b (x-1)]$, where $E_1[a+b (x-1)]$ is the exponential integral, $b>a$, $a>0$, ...
0
votes
1answer
38 views

Constraint minimization of sum of Non-symmetric matrices

I am trying to find closed form solution to following problem \begin{equation} \begin{array}{c} \text{min} \hspace{4mm} \big(\lambda_1\left( \mathbf{y}^T V^{(1)}\mathbf{x} \right)^2 + ...
0
votes
0answers
9 views

Assessing the “Quality ” of a solution sobtained by using lagrangian multipliers

I have an ill-defined question. I work in machine learning and am trying to learn the parameters of a model, such that my problem amounts to constrained optimization. That is, I have some training ...
1
vote
0answers
11 views

Local optimization with multiple starting values \approx global optimization?

I need to find the minimum/maximum of a nonlinear function but the constraints in the optimization problem make it tougher to solve (not a convex problem). I don't have a good global optimization ...
-3
votes
1answer
42 views

How many additional crews should be brought in to minimize the cost of an oil spill?

An oil spill has fouled $200$ miles of Pacific shoreline. The oil company responsible has been given $14$ days to clean up, after which a fine will be $10000$ \$/day. The local cleanup crew cleans $5$ ...
1
vote
1answer
19 views

How do I set a lower bound to the solution's norm in a QP problem

I know that LASSO-regularization can be used to scale into an $L_1$ upper bound for a solution. But what if I want the norm to be within a specific range $[a,b]$? ie. I also want to set a lower bound? ...
0
votes
0answers
9 views

Wrong ILP solution with LPSolve (simple example)

I added the following example into LPSolve and found a strange issue. I don't want S1 and S2 to overlap within certain margins. ...
0
votes
1answer
19 views
+50

Reducing an I-optimal problem to a Pareto-optimal problem

Given a set $\textbf y\subset\mathbb R^2$, let $y = (y_1,y_2), y'=(y'_1,y'_2)\in\textbf y$ be elements of that set, let $\alpha_{min}\in\mathbb R$, $\alpha_{min}<1$, $\alpha_{max}\in\mathbb R$, ...
0
votes
0answers
12 views

Tangent cone to the graph and epigraph

Good morning! I am solving this example: Let $f: \mathbf{R} \rightarrow \mathbf{R}$ be a function given by $f(x) = \left\{ \begin{array}{rl} x \cdot sin(\frac{1}{x}) & \text{if } x > 0,\\ 0 ...
0
votes
1answer
12 views

Partition of fractional parts where each sum of them has to be at least 1

Let $ a_1,\ldots,a_t \in \mathbb{Q} \setminus \mathbb{Z} $ be with $ \sum_{i=1}^t \lbrace a_i \rbrace \in \left[k,k+1\right) $ for some $ k \in \mathbb{N} $ with $ k \ge 4 $. Here $ \lbrace x \rbrace ...
1
vote
0answers
23 views

Convexity of matrix inverse

If $$f\colon\mathbb{R}^n\times\mathbb{R}^n\to\mathbb{R}$$ where $$f(x,y)=y^T x^{-1}y$$ and dom$(f)=\{(x,y)\ |\ x+x^T\gt 0\}$, then is $f$ convex?
0
votes
0answers
15 views

Newton Raphson method to optimize two parameters using mathematica [on hold]

Am working on computational Thermal engg. work. For the optimization i have been using Mathematica Software. I got a expression "G" which I deduced in mathematica itself. But when I tried to find the ...
0
votes
0answers
9 views

Equivalence of the partial least square regresssion's iterative algorithm and its optimization problem

I am reading The Elements of Statistical Learning. This is a page from the partial least square section: The exercise asks to prove the equivalence between Algorithm 3.3 and Eq. (3.64). Here's my ...
1
vote
2answers
73 views

The area visible from two lighthouses with angle of vision 30 degrees, built at distance 10km from each other

The distance between 2 lighthouses is 10 km. What is the maximum area of the ocean in which both can be simultaneously visible if the angle of vision for each lighthouse is 30 degrees?But the minimum? ...
1
vote
0answers
29 views

Dimension of Polyhedra [on hold]

Can someone explain the question below? I'm pretty new in this area, and I did not understand anything. Question; Let $P$ be defined by the following $$\begin{align}x_1+x_2+x_3&\le ...
0
votes
1answer
66 views

Checking: finding extremals for a functional

I'm trying to find the extremals of the functional $$J[y] = \int_0^1 (y')^2 + y^2 + 4ye^x \, {\rm d}x,$$ imposed that $y(0) = 0$ and $y(1) = 1 $. I got that there can't be extremals, and that's weird ...
0
votes
1answer
12 views

Polygonal chain in a rectangular parallelepiped

Given a rectangular parallelepiped ABCDA1B1C1D1 with edges AD = 6, AB = 8, AA1 = 8. Points M and N are the middles of A1B1 and C1D1. Points E and F are chosen on the edges CC1 and DD1 so that C1E = 3, ...
3
votes
2answers
117 views

Find $\int_0^a{f(x)}\, dx$

SMT 2013 Calculus #8: The function $f(x)$ is defined for all $x\ge 0$ and is always nonnegative. It has the additional property that if any line is drawn from the origin with any positive slope $m$, ...
2
votes
0answers
11 views

Determining active constraints in KKT

Suppose there is a constrained optimization problem having inequality constraints. We can solve it using Karush-Kuhn-Tucker conditions. My question is how do we determine which constraints are active ...
1
vote
1answer
32 views

Is $f(x,y)=-xy$ neither concave nor convex?

Is $f(x,y)=-xy$ neither concave nor convex? I used the definition for first differentiable functions and determined it depends on the choice of points, hence it is neither.
3
votes
1answer
39 views

Finding the lowest upper bound of product of two number using Young's inequality

Young's inequality for product can be stated as follows: $ab \leq \frac{1}{p}a^p + \frac{1}{q}b^q$ where a and b are nonnegative real numbers and p and q are positive real numbers such that 1/p + 1/q ...
1
vote
2answers
32 views

Infimum of $\frac{||u'||^p_{L^p}}{||u||^p_{L^p}}$ for $u \in W^{1,p}_0((0,1))$

Good afternoon everyone! It is very easy to show that the infimum mentioned in the title is strictly positive, but it seems much more difficult to show that it is attained within the Sobolev space of ...
1
vote
0answers
11 views

refomulation of an optimization problem

I have written a program for optimizing a set of generators. And I need to reformulate this problem, to include additional generators and constraints. I have hourly price and cost data and need to ...
1
vote
1answer
28 views

Maximal Multiplication of All Possible Summands

I have recently got interested in the following problem: Give a decomposition of a natural number to natural summands whose multiplication is maximal. I have tried to solve this problem, and ...
-1
votes
0answers
16 views

second derivative fail, classify the nature of the critical point

f(x,y,z)= $\frac{(x+y)^2}{2}+z^3$ the critical point I calculated is span{(1,-1,0)} the eigenvalue of the Hessian of point (1,-1,0) are 0,0,2, which means that this point is degenerate and the ...
0
votes
1answer
17 views

Equality Constraints in Quadratic Programming

Now I am new to the world of primal-dual algorithms and I want to understand the SOCP-Code of Lobo/Vandenberghe/Boyd (primal dual interior point method). Currently I am working through Goldfarb and ...
3
votes
1answer
31 views

How to show $ \sup \inf g(x,y) \leq \inf \sup g(x,y)$?

Came across this little practice exercise, and I couldn't properly convince myself of this relation: Let $X,Y \subset \mathbb{R}^n$ and $g:X\times Y \rightarrow \mathbb{R}$. Show that $$\sup_{y \in ...
2
votes
2answers
38 views

How do i optimize a function with an integral in it?

I want to find the values of $t_1 t_2...t_n$ which would give the maximum value for the function below: $\int_a^b \{f_1(x-t_1)+f_1(x-t_2)+f_1(x-t_n)\} dx$ functions $f_1f_2....f_n$ are expected to ...
0
votes
0answers
17 views

Positive/Negative Definite Bordered Hessian?

I understand how to check a function for concavity and convexity using the Hessian matrix and the rules for the determinants of the leading principal minors. I understand if these rules are violated, ...