Optimization is the process of choosing the "best" value among possible values. They are often formulated as questions on the minimization/maximization of functions, with or without constraints.

learn more… | top users | synonyms (5)

2
votes
1answer
251 views

Extrema of $f:\mathbb{R}^n\rightarrow \mathbb{R}$

My question is about finding the extrema of a multidimensional function, $f:\mathbb{R}^n\rightarrow \mathbb{R}$. From lecture I know that $H_f(x_0) < 0 $ implies a isolated maximum $H_f(x_0) ...
2
votes
1answer
144 views

Minimizing the cost of a path in a dynamic system

So suppose I want a path from 0 to $c>0$ on the real line, and I am going to use the function $S(t)$ to get there in (discrete) time $T$. That is, my position at time 0 is 0, my position at time $T$ ...
1
vote
0answers
32 views

Finding the widest angle to shoot a soccer ball from the sideline using optimization!! [duplicate]

I'm trying to do an independent project for my Math class, but I was stuck and couldn't figure out how to use optimization to find position along the sideline that gives the widest angle to shoot. ...
1
vote
1answer
41 views

Confounding Lagrange multiplier problem

Optimize $f(x,y,z) = 4x^2 + 3y^2 + 5z^2$ over $g(x,y,z) = xy + 2yz + 3xz = 6$ According to the theorem the gradients must be parallell, $\nabla f = \lambda \nabla g$, so their cross product must ...
1
vote
2answers
35 views

Positivity of a function in $\mathbb{R}^{n}$

We place ourself in $\mathbb{R}^{n}$. We consider a given increasing function $$ g : \begin{aligned} &\mathbb{R}^{+} \to \mathbb{R} \\ &x \;\;\,\mapsto g(x) \end{aligned}$$ Finally, we ...
1
vote
3answers
147 views

Max perimeter of triangle inscribed in a circle

What is the maximum perimeter of a triangle inscibed in a circle of radius $1$? I can't seem to find a proper equation to calculate the derivative.
1
vote
2answers
155 views

Value minimizing mean absolute percentage error

What value for $c$ would minimize the formula: $$\frac{1}{n}\;\sum^{n}_{i=1}\left | \frac{y_i-c}{y_i}\right|$$ given the values $y_1, ..., y_n$. For example in the mean squared error we have the ...
1
vote
0answers
55 views

computing dual LP in graph matchings

I'm having a trouble converting the following LP to a dual LP. Help on some starting steps would be greatly appreciated!
1
vote
1answer
104 views

Local extrema of continous, non-differentiable function

Ok, so looking through some questions I've found this answer: http://math.stackexchange.com/a/1667/102636 containing proof, that there are either inifinitely or no local extrema of continous and ...
1
vote
1answer
52 views

Guessing Game Stochastic Optimization

This is part of another post I did, but I think it has interest in its own right: Let $Y =\{X_{1},X_{2}...X_{N}\}$ be a set of $N$ random quantities with assocated set of distributions ...
1
vote
2answers
115 views

Applying the Lagrangian function to find critical points

So I have the following function $$ f(x,y) = x^2+y^2 $$ subject to $$ g(x,y) = x+y-1 = 0. $$ And I have to use the Lagrangian to find the critical points, and determine wether they are ...
1
vote
1answer
154 views

Determine all the extrema of a function subject to a non-linear constraint.

QUESTION Determine all extrema of the function $$f(x,y) = x+ 2y $$ subject to $$x^2 + y^2 - 80 = 0$$ ATTEMPT I don't think I understand what I'm supposed to do. This was in a test and I ended up ...
1
vote
1answer
73 views

Simultaneous Maximization and Minimization

I have a function with two variables say $$g(x,y)=f(x)−h(x,y)\ $$ where $$ f(x)= ax-bx^2\ $$ and $$h(x,y)=(x+y)^2\ $$ and $$ y>=0, x+y>=0\ $$My purpose is to maximize g(x,y) for x, ...
1
vote
1answer
305 views

Using gradient descent and Newton's method combined

I have this function $f(\mathrm{X})$ where $\mathrm{X=A+B+C}$ where $\mathrm{A}$ is a diagonal element with variable $a$ on its diagonal. $\mathrm{B}$ is another diagonal matrix with variable $b$ on ...
1
vote
0answers
27 views

Minimization values for a function [duplicate]

I have got function - non linear(I thk), and a set of variable S=[(x1,y1),(x2,y2)...]. The objective is to find the value for ...
1
vote
1answer
64 views

A minimization problem

Define $$L(w,u)=\frac{1}{2}\|w-u\|^2+\beta \left\|\frac{w}{x}\right\|,~w,u\in \Bbb{R}^n$$ where $$\frac{w}{x}=\left(\frac{w_1}{x_1},\ldots, \frac{w_n}{x_n}\right)$$ $$\|x\|=\sqrt{x_1^2+\cdots+x_n^2}$$ ...
1
vote
1answer
132 views

the implication of zero mixed partial derivatives for multivariate function's minimization

Suppose $f(\textbf x)=f(x_1,x_2) $ has mixed partial derivatives $f''_{12}=f''_{21}=0$, so can I say: there exist $f_1(x_1)$ and $f_2(x_2)$ such that $\min_{\textbf x} f(\textbf x)\equiv ...
1
vote
2answers
103 views

Determine the points where $f$ is has a local minimum/maximum. Multivariable calculus question.

This is not homework, but it is in my book and I find it hard to solve: Determine the points where $f$ is has a local minimum/maximum. Determine if it strong/weak and absolute/relative and ...
1
vote
1answer
166 views

Are these convex optimization problems equivalent?

Consider the optimization problem $$ \mathcal{P}_1: \qquad \min_{x \in \mathbb{R}^n} c^\top x \quad \text{sub. to } \ g(x,y_i) \leq 0 \ \ \forall i = 1,2,...,M$$ where $c \in \mathbb{R}^n$, and ...
1
vote
0answers
158 views

Showing a dual LP solves a primal LP

I originally asked this question: Does solving the LP dual SOLVE the primal LP? It was answered using an example of how the primal and dual solve each other (because of knowledge from strong ...
1
vote
3answers
409 views

A constrained linear least Frobenius norm problem:$\min_{X} \|A-XB\|_F$ subject to $Xv=0$?

Assume we are given two matrices $A, B \in \mathbb R^{n \times m}$ and a vector $v \in \mathbb R^n$. $\|\cdot\|_F$ is the Frobenius norm of a matrix. How can we solve $$\min_{X \in \mathbb R^{n ...
1
vote
1answer
322 views

How would you solve a Tikhonov Regularized Least Squares problem with nonnegative constraints?

For a Tikhonov Regularized Least Squares problem with nonnegative constraints, what are some methods that solve it? Are methods solving a Least Squares problem with nonnegative constraints and the ...
1
vote
1answer
72 views

Is $ \sum_{1 \le k \le n} (y_k - a x_k^b + c x_k^d + e)^2 $ convex?

Over at How many points to find a polynomial? it was suggested to minimize $$ f(a,b,c,d,e) = \sum_{1 \le k \le n} (y_k - a x_k^b + c x_k^d + e)^2 .$$ However I don't know if it is possible to find ...
1
vote
4answers
2k views

Max distance between a line and a parabola

I am suppose to use calculus to find the max vertical distance between the line $y = x + 2$ and the parabola $y = x^2$ on the interval $x$ greater then or equal to $-1$ and less then or equal to $2$. ...
1
vote
2answers
333 views

Bilinear Optimization Problem

How could I solve the following optimization problem using MATLAB or an other way? Given ${E}^{1}, {A}^{21}, {A}^{22}, {C}^{1}, {A}^{12}$ $ \underset{{C}^{2}, {E}^{2}}{min} {\left \| {C}^{2}{E}^{1} ...
1
vote
1answer
150 views

Some properties of Yosida-Moreau transform

Let $f(x)$ be a continuous function on $\mathbb{R}^n$, $f(x) \geqslant 0$ for any $x$. Define $$ f_{\alpha}(x) = \inf\limits_{y}\left( f(y) +\frac{|x-y|^2}{2\alpha} \right) $$ where $\alpha > ...
1
vote
0answers
80 views

Minimial Tiling Problem on a sphere

This question is a revision of the math exchange post found here. Consider the following: A sphere, $S$, with radius $r_1$. N regions projected onto $S$, whose projections, $\left\lbrace E_i ...
1
vote
2answers
545 views

Sign restriction on the Lagrange multiplier? Why?

Say we are given a linear program where the goal is to minimize $c^Tx$ with the constraints $Ax\ge b$. Why is there a sign restriction on the Lagrange multiplier associated with the active constraints ...
1
vote
0answers
94 views

Set boundary for least-square calculation

When calculating least-squares we use the form $$Xw=y$$ This gives us an approximation, and it can happen that the resulting $w$ will be such that $Xw \lt y$ (entry-wise). Is there a way how to ...
1
vote
1answer
69 views

Upper bound of an expressions with many variables

Assume $0 < p_1 \le p_2 \le \dots \le p_{2k}$. I am looking for a (preferably tight) upper bound for the following expression: $$ \frac ...
1
vote
1answer
267 views

Sudoku mathematically, MILP?

My homework contains a word (freely-translated) "target-function" that I should generate somehow for 9x9 sudoku solver with some MILP problem. But I am bit lost what they mean. I have sofar described ...
1
vote
1answer
163 views

Voronoi diagram with different metric functions

Given a metric space $(X,d)$ and finite number of points $(x_i)_{i=1}^n$ the Voronoi diagram (or the Dirichlet cell) $C_i$ is given by $$ C_i = \{x\in X:d(x,x_i)<\min\limits_{j\neq i}d(x,x_j)\}. ...
1
vote
1answer
224 views

Questions about weak duality theorem

Following are some corollaries regarding the weak duality theorem. Consider a constrained problem, $\min_{x \in X} f(x),$ subject to $g(x) \leq 0$ and $h(x) =0$. Its dual problem is $\sup_{u \geq ...
1
vote
2answers
118 views

Minimum for this function

I thought of writing this question Minimum for this function in a different way, if it helps. I want to minimize $$\sum_{i=1}^n a_ix_i + \nu \sum_{i=1}^n b_i 2^{x_i} ,$$ where $a_i \in [0,1]$, ...
1
vote
2answers
155 views

Find the range of $x$, given $y_{min} \leq y(x) \leq y_{max}$, where $y(x) $ can be any function ( Updated)

I have a series of inequalities: $$y_{1min} \leq y_{1}(x) \leq y_{1max}$$ $$y_{2min} \leq y_{2}(x) \leq y_{2max}$$ $$..$$ $$y_{nmin} \leq y_{n}(x) \leq y_{nmax}$$ Note that $x\in\mathbb{R}$ The ...
0
votes
1answer
34 views

Using bordered Hessian matrix to determine non-degeneracy and type of constrained extremum

I have the following problem: $\def\f{f(x_1,x_2,x_3)}\def\1{x_1}\def\2{x_2}\def\3{x_3}\def\n{\nabla}\def\g{g(x_1,x_2,x_3)}\def\l{\lambda}\def\q{\begin{pmatrix}}\def\p{\end{pmatrix}}$ Find the ...
0
votes
0answers
17 views

Imaginary roots and Real values when using Newton-Raphson Values

I am studying Newton-Raphson Method but I am facing questions in my head. How do I know if I have an imaginary number or imaginary numbers? and What to do when I have them when using Newton Raphson ...
0
votes
1answer
24 views

monotonicity of binomial coefficient

I am interested in $$f(x):={k-1 \choose x-1} p^{x} (1-p)^{k-x}.$$ How do I find out in which Domain this function is monotonically increasing, in which it is monotonically decreasing? For which $x$ ...
0
votes
0answers
17 views

How to find iso function value points without exploring all points in 2D space

Consider a 2D graph with dim1 and dim2 represented as X and Y respectively. The range of X and Y are 1 to 100. Hence there are 10000 points in the 2D space. Each point in the space is some function of ...
0
votes
1answer
27 views

Maximum payoff for safe bet

I'm having a hard time choosing a good strategy for this problem: assume that you have $m$ money that you can bet on $n$ mutually exclusive outcomes, all with unknown probabilities, and that each ...
0
votes
1answer
48 views

Maximizing the volume of a box using Lagrange multipliers

We are given a box of surface area $64$. As such, I wish to maximize $f(x,y,z) = xyz$ subject to $g(x,y,z) = 2(xy+xz+yz) - 64$. If I have understood in correctly, I am to find the critical points of ...
0
votes
0answers
38 views

Minimizing a vector constrained to a set

Sorry if this is wordy or over-complicated, I'm not sure how to isolate the problem any more than I have below without losing important context: I'm trying to implement a coordinate block descent ...
0
votes
1answer
23 views

Are there known patterns among minimal expressions?

Let $R = F[z_1, z_2, \dots]$ be the finite-degree polynomials in a countable number of variables. Let $\mathcal{E}(R)$ be the set of all expressions of polynomials. Note that there could be an ...
0
votes
2answers
54 views

Minimize Function over Convex Subset

Suppose that C is a closed convex subset of $\mathbb R^n$ and $x \in \mathbb R^n$. The projection of $\mathbf x$ onto C is the closest point $\mathbf y \in C : \mathbf z = \mathbf y$ minimizes ...
0
votes
1answer
39 views

Evaluate smartly a function on a multiplication grid

I am asking myself the following question: Suppose one has a grid $G \in \mathbb{N}^{n\times n}$ where $g_{ij} = i\cdot j$, $i,j \leq n$. I would like to evaluate a function $f: G \to \mathbb{N}$. ...
0
votes
3answers
68 views

Use Lagrange Multipliers to find the absolute extrema

Use Lagrange Multipliers to find the absolute extrema (if any) of: $f(x,y) = 4x^2 + 9y^2$; subject to $2x +3y = 6$. Using Lagrange I end up with one point: $(\frac{3}{2}, 1)$ I'm just not sure how ...
0
votes
1answer
125 views

Calculus Optimization - Finding the minimum cost

In oil pipeline construction, the cost of pipe to go underwater is 60% more than the cost of pipe used in dry-land situations. A pipeline comes to a river that is 1 km wide at point A and must be ...
0
votes
1answer
61 views

What trick to calculate this Frechet derivative?

Let $u(t) \in L^{2}(0, 1)$. I need to calculate the first and second Frechet derivatives of $$J(u) = \int_0^1 \left(\int_0^{t^3}u(s)ds\right)^2dt$$ I am completely at a loss here: I know several ...
0
votes
0answers
17 views

Epi-convergence to indicator function

Let the indicator function be defined as $$I(x) \triangleq \begin{cases} 1, & \quad x \geq 0 \\ 0, & \quad x < 0 \end{cases}$$ and $I_{\nu}(x) \in [0,1]$ be a continuous approximation of ...
0
votes
2answers
74 views

Is the geometric-to-arithmetic function convex or concave?

Consider a vector $\mathbf{x} \in \mathbb{R}_{++}^N$. Also consider two functions, $g(\mathbf{x}): \mathbb{R}^N \rightarrow \mathbb{R}$, and $a(\mathbf{x}): \mathbb{R}^N \rightarrow \mathbb{R}$, ...