Optimization is the process of choosing the "best" value among possible values. They are often formulated as questions on the minimization/maximization of functions, with or without constraints.

learn more… | top users | synonyms (5)

1
vote
2answers
4k views

Solving a set of equations with Newton-Raphson

I want to solve this set of equations with Newton-Raphson. Can anybody help me? $$ \cos(x_1)+\cos(x_2)+\cos(x_3)= \frac{3}{5} $$ $$ \cos(3x_1)+\cos(3x_2)+\cos(3x_3)=0 $$ $$ ...
5
votes
2answers
316 views

How to find the shift that minimizes the difference between two vectors?

I am looking for a efficient way to find the value of k that minimizes $\sum(s_t - b_{t+k})^2$ where $s$ and $b$ are N-dimensional vectors and the values are wrapped around like this: $b_{t+k} := ...
5
votes
5answers
449 views

How to find the minimum of $a+b+\sqrt{a^2+b^2}$

let $a,b>0$, and such $$\dfrac{2}{a}+\dfrac{1}{b}=1$$ Find this minimum $$a+b+\sqrt{a^2+b^2}$$ My try: since $$2b+a=ab$$ so ...
4
votes
2answers
3k views

Show that Minimum Spanning Tree is unique

Show that MST is unique in case the edge weights are pairwise different $(w(e)\neq w(f) \text{ for } e\neq f)$. I thought that the proof can be done for example by contradiction, saying that we ...
3
votes
2answers
242 views

How is $L_{2}$ Minkowski norm different from $L^{2}$ norm?

I am reading the book Multidimensional Particle Swarm Optimization for Machine Learning and Pattern Recognition. They use $L_{2}$ Minkowski norm (Euclidean) as the distance metric in the feature space ...
2
votes
1answer
159 views

Positive semidefinite cone is generated by all rank one matrices.

The positive semidefinite cone is generated by all rank one matrices $xx^T$ . They form the extreme raysof the cone. The positive definite matrices lie in the interior of the cone. The positive ...
2
votes
3answers
107 views

Why does finding the $x$ that maximizes $\ln(f(x))$ is the same as finding the $x$ that maximizes $f(x)$?

I'm reading about maximum likelihood here. In the last paragraph of the first page, it says: Why does the value of $p$ that maximizes $\log L(p;3)$ is the same $p$ that maximizes $L(p;3)$. The ...
2
votes
1answer
140 views

Maximum of the sum of cube

(1) $-2\leq a_{i} \leq 2$ $~(i=1,2,3,4,5)$ (2) $\displaystyle\sum_{cyclic}a_{i}=0$ then, find the maximum value of $\displaystyle\sum_{cyclic}a_{i}^{3}$ also, can it be generalized as for ...
2
votes
0answers
235 views

Real approximation to the maximum using Laplace's method integral

The Laplace's Method states that under some conditions, it holds that: $ \sqrt{\frac{2\pi}{M(-g''(x_0))}} h(x_0) e^{M g(x_0)} \approx \int_a^b\! h(x) e^{M g(x)}\, dx \text { as } M\to\infty$ Where ...
2
votes
4answers
169 views

Three Variables-Inequality with $a+b+c=abc$

$a$,$b$,$c$ are positive numbers such that $~a+b+c=abc$ Find the maximum value of $~\dfrac{1}{\sqrt{1+a^{2}}}+\dfrac{1}{\sqrt{1+b^{2}}}+\dfrac{1}{\sqrt{1+c^{2}}}$
2
votes
3answers
1k views

How to interpret Hessian of a function

I know that gradient of a function gives the direction in which the directional derivative of the function is maximum. Is there any similar interpretation of Hessian ?
2
votes
2answers
141 views

Maxima and minima of multivariable function $f(x,y)=6x^3y^2-x^4y^2-x^3y^3$

$$f(x,y)=6x^3y^2-x^4y^2-x^3y^3$$ $$\frac{\delta f}{\delta x}=18x^2y^2-4x^3y^2-3x^2y^3$$ $$\frac{\delta f}{\delta y}=12x^3y-2x^4y-3x^3y^2$$ Points, in which partial derivatives ar equal to 0 are: ...
2
votes
1answer
88 views

Cubes, squares and minimal sums

I have trouble solving the following task: i need to find positive integers a and b such that 1) $a \neq b$ 2) $ \exists c \in \mathbb{N} : ~ a^2 + b^2 = c^3$ 3) $\exists d \in \mathbb{N}: ~ a^3 + ...
2
votes
2answers
838 views

satisfy the Euler-Lagrange equation

Two circles of unit radius, each normal to the line through their centers are a distance d apart. A soap film is formed between themas shown below; energetic considerations require the filem to ...
2
votes
1answer
267 views

Multiple solutions for both primal and dual

If matrix $A$ in an LP (or $A^T$ in its dual) has full row (column- in dual) rank, is it possible that both primal and dual have multiple solutions?
1
vote
3answers
280 views

How to solve $\min \limits_{\mathbf{x}} \| \mathbf{Ax}-\mathbf{b} \|^2$?

Let $\mathbf{x}=[x_1,\ldots,x_K]$. I have the following optimization problem: \begin{array}{rl} \min \limits_{\mathbf{x}} & \| \mathbf{Ax}-\mathbf{b} \|^2 \\ \mbox{s.t.} & x_k\ge 0, \forall ...
1
vote
2answers
105 views

Minimizing $f(x,y,z)=\dfrac{|x|+|y|+|z|}{xyz}$ on a sphere

I need to find the minimum of the function: $$f(x,y,z)=\dfrac{|x|+|y|+|z|}{xyz}$$ with the condition: $$x^2+y^2+z^2=r^2$$ Using numerical methods it's quite easy to solve the problem. How can I ...
1
vote
3answers
5k views

How to plot a phase portrait for this system of differential equations?

I beg your help.. I'd like the phase portrait for this system. I don't know how to use Mathematica/Matlab ... :( If anyone can make this portrait and post a print screen here, I would thank you ...
1
vote
0answers
188 views

Duality for Support Vector Machines

SVM classifier for two linearly separable classes is based on the following convex optimization problem: \begin{equation*} \frac{1}{2}\sum_{k=1}^{n}w_k^2 \rightarrow \min \end{equation*} ...
0
votes
2answers
57 views

minximum and maximum of $P=x+y+z$

Let $x,y,z \in R;x \ge 1,y \ge 2,z \ge 3$ and $$\sum\limits_{\large{\text{cyc}}} {\frac{{{x^2} - x + 1}}{{x + \sqrt {x - 1} }} = 12} $$ Search minximum and maximum of $P=x+y+z$
0
votes
2answers
91 views

Explain this statement $\bar 0 \in \partial f(x^*)$ where $\partial f(x^*)$ is subgradient

I haven't understood this theorem "$x^*$ is global minimum iff $\bar 0\in \partial f(x^*)$". What does it mean? Visually? P.s. Studying Nonlinear-optimization -course, 2.3139.
9
votes
5answers
506 views

Are derivatives defined at boundaries?

Given a differentiable function $f : [-5,5] \rightarrow \mathbb{R},$ I was under the impression that the derivative $f'$ has domain $(-5,5).$ However, according to Wikipedia ...a differentiable ...
8
votes
1answer
369 views

Simple question: the double supremum

Let $f:A\times B\to \mathbb R$. Is it always true that $$ f^* = \sup\limits_{a\in A,b\in B}f(a,b) = \sup\limits_{a\in A}\sup\limits_{b\in B}f(a,b). $$ I proved it by the $\varepsilon$-$\delta$ ...
6
votes
2answers
141 views

Find the minimum value of $A=\frac{2-a^3}{a}+\frac{2-b^3}{b}+\frac{2-c^3}{c}$

Let $a, b$ and $c$ three positive real numbers such that $a+b+c=3$. Find the minimum value of $$A=\frac{2-a^3}{a}+\frac{2-b^3}{b}+\frac{2-c^3}{c}.$$ Here is my attempt. By symmetry we can assume that ...
6
votes
1answer
836 views

Why is Dantzig's solution to the knapsack problem only approximate

For a bunch of items with values $v_i$ and weights $w_i$, and with a total weight $W$ that our bag can carry, how do we achieve maximum total value without breaking the bag? Dantzig proposed that we ...
5
votes
1answer
2k views

The composition of two convex functions is convex

Let $f$ be a convex function on a convex domain $\Omega$ and $g$ a convex non-decreasing function on $\mathbb{R}$. prove that the composition of $g(f)$ is convex on $\Omega$. Under what conditions is ...
4
votes
8answers
3k views

Maximizing the sum of two numbers, the sum of whose squares is constant

How could we prove that if the sum of the squares of two numbers is a constant, then the sum of the numbers would have its maximum value when the numbers are equal? This result is also true for ...
4
votes
2answers
1k views

Math notation for location of the maximum

My question is about notation. I have maximum of the function $f(x)$. This can be expressed as $\max(f)$ How can I express in compact form that $x_0$ is the location of that maximum.
3
votes
1answer
140 views

Extrema homework — maximizing the viewing angle of a picture on a wall

I have hit a problem in my homework and don't know how to solve it. Here it is: "A picture with height of 1.4 meters hangs on the wall, so that the bottom edge of the picture is 1.8 meters from the ...
3
votes
1answer
97 views

Simple optimization trick

Let $f,g:X\to\Bbb R$ be two functions where $X$ is any set. Then $$ \left|\sup_x f(x) - \sup_x g(x)\right|\leq \sup_x|f(x) - g(x)|. $$ This fact is fairly easy to prove, but it seems to be a ...
3
votes
1answer
2k views

Prove the supremum of the set of affine functions is convex

Let $\langle f_i \rangle _{i \in I}$ be a family of affine functions on a convex and compact set $\Omega \subset \mathbb{R^d}$ such that $f_i = a_i.x +b_i$ for $x \in \Omega$. Prove that f, defined by ...
2
votes
1answer
190 views

Optimisation Problem on Cone

The problem I've got here is to prove that semi vertical angle of a cone with maximum volume with total surface area constant is equal to $arcsin(\frac{1}{3})$ I am trying to do that by making some ...
1
vote
1answer
43 views

Computing $\sup_{\left \| u \right \|=1} d(u,F)$ in a closed subspace of a normed space.

I have come across with the following problem: Let $E$ be a normed space and $F$ a closed subspace of $E$. It's asking to compute $\sup\limits_{\left \| u \right \|=1} d(u,F)$. What I know it's ...
1
vote
1answer
69 views

Binomial Coefficient: monotonically decreasing in this range?

relating to this question, I'd like to ask a further one. Again we have $$f(x)={k-1 \choose x-1} p^x (1-p)^{k-x}$$ We know that this term is maximal for $x=kp$, before increasing, afterwards ...
1
vote
3answers
467 views

Ladder Optimization Problem

A fence 4 feet tall runs parallel to a tall building at a distance of 4 feet from the building. What is the length of the shortest ladder that will reach from the ground over the fence to the wall of ...
1
vote
0answers
40 views

Maximizing a given function?

I have a function as below, $f(\alpha) = \frac{{1 - \alpha }}{2}\ln \left( {1 + \frac{{AB}}{{B + \frac{{1 - \alpha }}{{C\alpha }}}}} \right)$, where $A$, $B$, $C$ are constant, and $0 < \alpha ...
1
vote
1answer
50 views

A non-linear optimization problem

I have the following optimization problem on the variables $a_1, ..., a_n$: $$ minimize \frac{\sum_{k=1}^{n}\max(k\cdot a_{k},1)}{\sum_{k=1}^{n}a_{k}} $$ $$ such\ that\ \ 0\leq a_k\leq 1\ \ \ (k=1, ...
1
vote
2answers
169 views

Applying the Lagrangian function to find critical points

So I have the following function $$ f(x,y) = x^2+y^2 $$ subject to $$ g(x,y) = x+y-1 = 0. $$ And I have to use the Lagrangian to find the critical points, and determine wether they are ...
1
vote
1answer
143 views

Find the minimum of this expression

This is a problem in my exam and I can't find the solution using elementary inequality knowledge. Can anyone here help me solve this. Thanks $a,b,c $ are positive real numbers which satisfy ...
0
votes
1answer
28 views

How to set up matrix to compute best coefficients

Suppose we're given a non-linear spring with the following relationship between the applied weight ($x$) and displacement ($y$): $y = ax + bx^3$. I've done a sequence of $m$ tests measuring the ...
0
votes
1answer
82 views

How to perform the optimization when gradient is a matrix $\mathbf{R}^{n\times n}$

I am trying to optimize this cost function by using Gauss-Newton method. $$f = \sum_{i = 1}^n Tr{(Z^TZ)}$$ where $Z$ is a $4\times4$ matrix and it is a function of real vector ...
0
votes
2answers
106 views

Constraint minimization of sum of Non-symmetric matrices

I am trying to find closed form solution to following problem \begin{equation} \begin{array}{c} \text{min} \hspace{4mm} \big(\lambda_1\left( \mathbf{y}^T V^{(1)}\mathbf{x} \right)^2 + ...
0
votes
1answer
1k views

How to find the speed that minimizes the total cost of a trip?

Here are some facts about semi-trucks and a trip between Chicago and New Orleans. (a) The trip is 750 miles. (b) Running at 50 mph, the truck gets around 4 miles per gallon. (c) For each mph ...
0
votes
0answers
73 views

Linear Programming - Tableau Condition

The following tableau corresponds to an iteration of the simplex method: ...
0
votes
1answer
148 views

Finding Shortest distance between a Sphere and Ellipsoid?

Suppose that ,I have a Sphere and an ellipsoid as Sphere: $(x-x_1)^2 + (y-y_1)^2 + (z-z_1)^2 = R_1^2$ Ellipsoid: $\large\frac{(x-x_2)^2}{a^2} + \frac{(y-y_2)^2}{b^2} + \frac{(z-z_2)^2}{c^2} = 1$ ...
0
votes
2answers
57 views

To prove the existing and uniqueness of a solution

Let function $f$ be differentiable and convex in $R^{n}$. How can it be proved that $\forall \lambda > 0$ solution of system equations $f'(x) = -\lambda x$ exists exclusively ($\exists \hspace{3mm} ...
0
votes
0answers
67 views

Distance metrics with kmeans

Context: I'm trying to derive some formulas for computing the "mean" in the K-means algorithm. So given an assignment of $m$ data points to $k$ clusters, find a formula to recompute the mean of the ...
0
votes
1answer
77 views

How to solve this optimization problem?

Suppose I have the following problem: Maximize: $\quad\quad x_1+x_2+x_3+x_4$ Subject to: $\quad\quad \dfrac{\gamma\;a_1\;x_1}{\gamma\;a_2\;x_4+1}\geq1$, $\quad\quad\quad\quad\;\;\quad\quad ...
0
votes
3answers
377 views

Lagrange multipliers - finding maximum/minimum

I have solved the question, and obtained the critical points, but don't know how to show its a maximum or minimum of a function. I don't understand other answers because symbols confuse me so much and ...
0
votes
1answer
104 views

How to minimize cost of group of items given that weights of item sums up to fixed value and atmost 'n' number of items are allowed?

Given that we have a set of items :- { (c1, w1) , (c2, w2), (c3, w3) , ... } where (ci, wi) are the respective cost and weight of the ith item. Its required to minimize total cost of items C such ...