Optimization is the process of choosing the "best" value among possible values. They are often formulated as questions on the minimization/maximization of functions, with or without constraints.

learn more… | top users | synonyms (5)

10
votes
2answers
569 views

Explain a surprisingly simple optimization result

The following optimization problem came to my attention as an idealization of the silly browser game Cookie Clicker, but is representative of a range of strategy games: You have an initial ...
7
votes
5answers
777 views

Arithmetic mean is less than geometric mean (Spivak Calculus 3rd Chapter 2 Problem 22)

If $a_1, \ldots, a_n \ge 0$, the arithmetic mean $$A_n={a_1 + \cdots + a_n \over n}$$ and the geometric mean $$G_n = \sqrt[n]{a_1 \cdots a_n}$$ satisfy $G_n \le A_n$. As a first step to prove this ...
3
votes
2answers
190 views

Find maximum of $P$

Let $$P = \frac{{{x^2}}}{{{x^2} + yz + x + 1}} + \frac{{y + z}}{{x + y + z + 1}} - \frac{{1 + yz}}{9}.$$ Find maximum of $P$ where $x, y,z$ are nonnegative real numbers such that ${x^2} + {y^2} + ...
1
vote
2answers
4k views

Solving a set of equations with Newton-Raphson

I want to solve this set of equations with Newton-Raphson. Can anybody help me? $$ \cos(x_1)+\cos(x_2)+\cos(x_3)= \frac{3}{5} $$ $$ \cos(3x_1)+\cos(3x_2)+\cos(3x_3)=0 $$ $$ ...
5
votes
2answers
325 views

How to find the shift that minimizes the difference between two vectors?

I am looking for a efficient way to find the value of k that minimizes $\sum(s_t - b_{t+k})^2$ where $s$ and $b$ are N-dimensional vectors and the values are wrapped around like this: $b_{t+k} := ...
5
votes
5answers
450 views

How to find the minimum of $a+b+\sqrt{a^2+b^2}$

let $a,b>0$, and such $$\dfrac{2}{a}+\dfrac{1}{b}=1$$ Find this minimum $$a+b+\sqrt{a^2+b^2}$$ My try: since $$2b+a=ab$$ so ...
3
votes
1answer
171 views

Positive semidefinite cone is generated by all rank one matrices.

The positive semidefinite cone is generated by all rank one matrices $xx^T$ . They form the extreme raysof the cone. The positive definite matrices lie in the interior of the cone. The positive ...
3
votes
2answers
244 views

How is $L_{2}$ Minkowski norm different from $L^{2}$ norm?

I am reading the book Multidimensional Particle Swarm Optimization for Machine Learning and Pattern Recognition. They use $L_{2}$ Minkowski norm (Euclidean) as the distance metric in the feature space ...
2
votes
1answer
52 views

Conjugacy relation in the primal and dual problem

The following is my derivation in the Conjugacy relation in the primal and dual problem. I am shaky in it; so hope for some advices. Consider the following problem, $f(x),g(x)$ are convex ...
2
votes
3answers
109 views

Why does finding the $x$ that maximizes $\ln(f(x))$ is the same as finding the $x$ that maximizes $f(x)$?

I'm reading about maximum likelihood here. In the last paragraph of the first page, it says: Why does the value of $p$ that maximizes $\log L(p;3)$ is the same $p$ that maximizes $L(p;3)$. The ...
2
votes
1answer
140 views

Maximum of the sum of cube

(1) $-2\leq a_{i} \leq 2$ $~(i=1,2,3,4,5)$ (2) $\displaystyle\sum_{cyclic}a_{i}=0$ then, find the maximum value of $\displaystyle\sum_{cyclic}a_{i}^{3}$ also, can it be generalized as for ...
2
votes
0answers
243 views

Real approximation to the maximum using Laplace's method integral

The Laplace's Method states that under some conditions, it holds that: $ \sqrt{\frac{2\pi}{M(-g''(x_0))}} h(x_0) e^{M g(x_0)} \approx \int_a^b\! h(x) e^{M g(x)}\, dx \text { as } M\to\infty$ Where ...
2
votes
4answers
170 views

Three Variables-Inequality with $a+b+c=abc$

$a$,$b$,$c$ are positive numbers such that $~a+b+c=abc$ Find the maximum value of $~\dfrac{1}{\sqrt{1+a^{2}}}+\dfrac{1}{\sqrt{1+b^{2}}}+\dfrac{1}{\sqrt{1+c^{2}}}$
2
votes
3answers
1k views

How to interpret Hessian of a function

I know that gradient of a function gives the direction in which the directional derivative of the function is maximum. Is there any similar interpretation of Hessian ?
2
votes
2answers
143 views

Maxima and minima of multivariable function $f(x,y)=6x^3y^2-x^4y^2-x^3y^3$

$$f(x,y)=6x^3y^2-x^4y^2-x^3y^3$$ $$\frac{\delta f}{\delta x}=18x^2y^2-4x^3y^2-3x^2y^3$$ $$\frac{\delta f}{\delta y}=12x^3y-2x^4y-3x^3y^2$$ Points, in which partial derivatives ar equal to 0 are: ...
2
votes
1answer
88 views

Cubes, squares and minimal sums

I have trouble solving the following task: i need to find positive integers a and b such that 1) $a \neq b$ 2) $ \exists c \in \mathbb{N} : ~ a^2 + b^2 = c^3$ 3) $\exists d \in \mathbb{N}: ~ a^3 + ...
2
votes
2answers
854 views

satisfy the Euler-Lagrange equation

Two circles of unit radius, each normal to the line through their centers are a distance d apart. A soap film is formed between themas shown below; energetic considerations require the filem to ...
2
votes
1answer
276 views

Multiple solutions for both primal and dual

If matrix $A$ in an LP (or $A^T$ in its dual) has full row (column- in dual) rank, is it possible that both primal and dual have multiple solutions?
1
vote
2answers
105 views

Minimizing $f(x,y,z)=\dfrac{|x|+|y|+|z|}{xyz}$ on a sphere

I need to find the minimum of the function: $$f(x,y,z)=\dfrac{|x|+|y|+|z|}{xyz}$$ with the condition: $$x^2+y^2+z^2=r^2$$ Using numerical methods it's quite easy to solve the problem. How can I ...
1
vote
3answers
5k views

How to plot a phase portrait for this system of differential equations?

I beg your help.. I'd like the phase portrait for this system. I don't know how to use Mathematica/Matlab ... :( If anyone can make this portrait and post a print screen here, I would thank you ...
1
vote
0answers
189 views

Duality for Support Vector Machines

SVM classifier for two linearly separable classes is based on the following convex optimization problem: \begin{equation*} \frac{1}{2}\sum_{k=1}^{n}w_k^2 \rightarrow \min \end{equation*} ...
0
votes
2answers
57 views

minximum and maximum of $P=x+y+z$

Let $x,y,z \in R;x \ge 1,y \ge 2,z \ge 3$ and $$\sum\limits_{\large{\text{cyc}}} {\frac{{{x^2} - x + 1}}{{x + \sqrt {x - 1} }} = 12} $$ Search minximum and maximum of $P=x+y+z$
0
votes
2answers
91 views

Explain this statement $\bar 0 \in \partial f(x^*)$ where $\partial f(x^*)$ is subgradient

I haven't understood this theorem "$x^*$ is global minimum iff $\bar 0\in \partial f(x^*)$". What does it mean? Visually? P.s. Studying Nonlinear-optimization -course, 2.3139.
9
votes
5answers
543 views

Are derivatives defined at boundaries?

Given a differentiable function $f : [-5,5] \rightarrow \mathbb{R},$ I was under the impression that the derivative $f'$ has domain $(-5,5).$ However, according to Wikipedia ...a differentiable ...
9
votes
1answer
378 views

Simple question: the double supremum

Let $f:A\times B\to \mathbb R$. Is it always true that $$ f^* = \sup\limits_{a\in A,b\in B}f(a,b) = \sup\limits_{a\in A}\sup\limits_{b\in B}f(a,b). $$ I proved it by the $\varepsilon$-$\delta$ ...
6
votes
2answers
141 views

Find the minimum value of $A=\frac{2-a^3}{a}+\frac{2-b^3}{b}+\frac{2-c^3}{c}$

Let $a, b$ and $c$ three positive real numbers such that $a+b+c=3$. Find the minimum value of $$A=\frac{2-a^3}{a}+\frac{2-b^3}{b}+\frac{2-c^3}{c}.$$ Here is my attempt. By symmetry we can assume that ...
6
votes
1answer
853 views

Why is Dantzig's solution to the knapsack problem only approximate

For a bunch of items with values $v_i$ and weights $w_i$, and with a total weight $W$ that our bag can carry, how do we achieve maximum total value without breaking the bag? Dantzig proposed that we ...
5
votes
1answer
3k views

The composition of two convex functions is convex

Let $f$ be a convex function on a convex domain $\Omega$ and $g$ a convex non-decreasing function on $\mathbb{R}$. prove that the composition of $g(f)$ is convex on $\Omega$. Under what conditions is ...
4
votes
8answers
3k views

Maximizing the sum of two numbers, the sum of whose squares is constant

How could we prove that if the sum of the squares of two numbers is a constant, then the sum of the numbers would have its maximum value when the numbers are equal? This result is also true for ...
4
votes
2answers
1k views

Math notation for location of the maximum

My question is about notation. I have maximum of the function $f(x)$. This can be expressed as $\max(f)$ How can I express in compact form that $x_0$ is the location of that maximum.
3
votes
1answer
148 views

Extrema homework — maximizing the viewing angle of a picture on a wall

I have hit a problem in my homework and don't know how to solve it. Here it is: "A picture with height of 1.4 meters hangs on the wall, so that the bottom edge of the picture is 1.8 meters from the ...
3
votes
1answer
97 views

Simple optimization trick

Let $f,g:X\to\Bbb R$ be two functions where $X$ is any set. Then $$ \left|\sup_x f(x) - \sup_x g(x)\right|\leq \sup_x|f(x) - g(x)|. $$ This fact is fairly easy to prove, but it seems to be a ...
3
votes
1answer
2k views

Prove the supremum of the set of affine functions is convex

Let $\langle f_i \rangle _{i \in I}$ be a family of affine functions on a convex and compact set $\Omega \subset \mathbb{R^d}$ such that $f_i = a_i.x +b_i$ for $x \in \Omega$. Prove that f, defined by ...
2
votes
1answer
202 views

Optimisation Problem on Cone

The problem I've got here is to prove that semi vertical angle of a cone with maximum volume with total surface area constant is equal to $arcsin(\frac{1}{3})$ I am trying to do that by making some ...
1
vote
0answers
20 views

Find the critical curves for the following functional with subsidiary conditions

Find the critical curves for the following functional : $$J[y,z]=\int_{0}^{1}\left(y'^2+z'^2-xyz'-yz\right)dx$$ with subsidiary conditions : $$\int_{0}^{1}\left(y'^2-xy'-z'^2\right)dx=2$$ ...
1
vote
1answer
43 views

Computing $\sup_{\left \| u \right \|=1} d(u,F)$ in a closed subspace of a normed space.

I have come across with the following problem: Let $E$ be a normed space and $F$ a closed subspace of $E$. It's asking to compute $\sup\limits_{\left \| u \right \|=1} d(u,F)$. What I know it's ...
1
vote
2answers
38 views

Global maxima/minima of $f(x,y,z) = x+y+z$ in $A$

Find the global maxima/minima of $f(x,y,z) = x+y+z$ for points inside of $A = \{ (x,y,z) \in \mathbb{R}^3: x^2-y^2 = 1 \wedge 2x+z = 1 \}$ I renamed the conditions of $A$ to a function $g(x,y,z) ...
1
vote
1answer
70 views

Binomial Coefficient: monotonically decreasing in this range?

relating to this question, I'd like to ask a further one. Again we have $$f(x)={k-1 \choose x-1} p^x (1-p)^{k-x}$$ We know that this term is maximal for $x=kp$, before increasing, afterwards ...
1
vote
3answers
476 views

Ladder Optimization Problem

A fence 4 feet tall runs parallel to a tall building at a distance of 4 feet from the building. What is the length of the shortest ladder that will reach from the ground over the fence to the wall of ...
1
vote
0answers
41 views

Maximizing a given function?

I have a function as below, $f(\alpha) = \frac{{1 - \alpha }}{2}\ln \left( {1 + \frac{{AB}}{{B + \frac{{1 - \alpha }}{{C\alpha }}}}} \right)$, where $A$, $B$, $C$ are constant, and $0 < \alpha ...
1
vote
1answer
51 views

A non-linear optimization problem

I have the following optimization problem on the variables $a_1, ..., a_n$: $$ minimize \frac{\sum_{k=1}^{n}\max(k\cdot a_{k},1)}{\sum_{k=1}^{n}a_{k}} $$ $$ such\ that\ \ 0\leq a_k\leq 1\ \ \ (k=1, ...
1
vote
2answers
179 views

Applying the Lagrangian function to find critical points

So I have the following function $$ f(x,y) = x^2+y^2 $$ subject to $$ g(x,y) = x+y-1 = 0. $$ And I have to use the Lagrangian to find the critical points, and determine wether they are ...
1
vote
1answer
144 views

Find the minimum of this expression

This is a problem in my exam and I can't find the solution using elementary inequality knowledge. Can anyone here help me solve this. Thanks $a,b,c $ are positive real numbers which satisfy ...
0
votes
1answer
28 views

How to set up matrix to compute best coefficients

Suppose we're given a non-linear spring with the following relationship between the applied weight ($x$) and displacement ($y$): $y = ax + bx^3$. I've done a sequence of $m$ tests measuring the ...
0
votes
1answer
83 views

How to perform the optimization when gradient is a matrix $\mathbf{R}^{n\times n}$

I am trying to optimize this cost function by using Gauss-Newton method. $$f = \sum_{i = 1}^n Tr{(Z^TZ)}$$ where $Z$ is a $4\times4$ matrix and it is a function of real vector ...
0
votes
2answers
107 views

Constraint minimization of sum of Non-symmetric matrices

I am trying to find closed form solution to following problem \begin{equation} \begin{array}{c} \text{min} \hspace{4mm} \big(\lambda_1\left( \mathbf{y}^T V^{(1)}\mathbf{x} \right)^2 + ...
0
votes
1answer
1k views

How to find the speed that minimizes the total cost of a trip?

Here are some facts about semi-trucks and a trip between Chicago and New Orleans. (a) The trip is 750 miles. (b) Running at 50 mph, the truck gets around 4 miles per gallon. (c) For each mph ...
0
votes
0answers
77 views

Linear Programming - Tableau Condition

The following tableau corresponds to an iteration of the simplex method: ...
0
votes
1answer
161 views

Finding Shortest distance between a Sphere and Ellipsoid?

Suppose that ,I have a Sphere and an ellipsoid as Sphere: $(x-x_1)^2 + (y-y_1)^2 + (z-z_1)^2 = R_1^2$ Ellipsoid: $\large\frac{(x-x_2)^2}{a^2} + \frac{(y-y_2)^2}{b^2} + \frac{(z-z_2)^2}{c^2} = 1$ ...
0
votes
2answers
57 views

To prove the existing and uniqueness of a solution

Let function $f$ be differentiable and convex in $R^{n}$. How can it be proved that $\forall \lambda > 0$ solution of system equations $f'(x) = -\lambda x$ exists exclusively ($\exists \hspace{3mm} ...