The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
0answers
27 views

How does this optimization problem satisfy Karush-Kuhn-Tucker Conditions?

I am following Andrew Ng's course notes on Support Vector Machines at: http://cs229.stanford.edu/notes/cs229-notes3.pdf There is something in these notes which I do not understand. SVM's basic ...
1
vote
2answers
33 views

Local optimality of a KKT point.

Consider the problem \begin{equation} \min_x f(x)~~~{\rm s.t.}~~~ g_i(x)\leq 0,~~i=1,\dots,I, \end{equation} where $x$ is the optimization parameter vector, $f(x)$ is the objective function and ...
1
vote
1answer
27 views

Optimization using Karush-Kuhn-Tucker conditions

min $y^Tx$ subject to $\|x\|^2 \le 1$ where y is a nonzero vector in $\mathbb R^n$ I rearrange the constraints so that the RHS is $0$. New constraint: $x_1^2 + \cdots + x_n^2 - 1 = \|x\|^2 - 1 \le ...
0
votes
0answers
16 views

Linear independence of equality constraint gradients in constraint qualifications

I'm, trying to get an intuitive feel for the various constraint qualifications for KKT points. Most of them seem to rely on the linear independence of $\nabla g_i(x^*)$ where $g_i$ are the equality ...
0
votes
0answers
30 views

Bordered Hessian for Kuhn-Tucker

With Lagragian problems, you are often asked to solve for a stationary point and use the bordered Hessian to determine whether it is a maximum or minimum. I have noticed with Karush-Kuhn-Tucker ...
1
vote
0answers
48 views

Kuhn-Tucker constraint qualification, overdetermined?

I have a question about the constraint qualification for KKT. As I've seen the theorem stated if $G(x^*)=(g_1(x^*),\dots,g_n(x^*))$ are the binding constraints at a local max $x^*$ then the jacobian ...
1
vote
1answer
32 views

Quadratic Problen with 2 constraints

Could someone help me to solve the following: $\min x^Tx$ s.t. $x^T a=1$ $x^T b=0$ where $x$,$a$ and $b$ are $(N\times1)$ vectors and $1$ and $0$ scalars. Thank you!
0
votes
0answers
20 views

Threshold in a maximisation problem (with KKT conditions)

I'm looking to maximise with respect to $x_i$ $$L = \sum_{i= 1}^n y_i \frac {x_i^{1 - \epsilon}}{1 - \epsilon}$$ subject to $ \sum_{i= 1}^n x_i = B $ and $x_i \ge 0$ for all $i$, where $y_i$, $B$ ...
0
votes
0answers
62 views

KKT Conditions and Convexity

min $x^2 -xy +y^2 -5x+6y$ subject to $1 \leq y$, $y^3 \leq 2x$, and $x \leq 8$ Write out the KKT conditions for this problem. Show that $(x,y) = (4,2)$ is a KKT point, and is therefore a global ...
0
votes
0answers
10 views

$\text{min}_{\{n_j\}_{j=1}^{J}} \sum_{j=1}^J n_j c_j$, subject to $\sum_{j=1}^J n_j(j-p)=0$, $n_j\geq 0 \quad \forall j$

So I'm apparently very rusty on this sort of thing... $\text{min}_{\{n_j\}_{j=1}^{J}} \sum_{j=1}^J n_j c_j$ subject to $\sum_{j=1}^J n_j(j-p)=0$ $n_j\geq 0 \quad \forall j$ Then my Lagrangian is ...
2
votes
1answer
179 views

Optimization Problem: Karush-Kuhn-Tucker Condition

I am working on the question displayed below. I know that the method of Lagrange Multipliers is used to find the solution for optimization problems constrained to one or more equalities and when our ...
0
votes
1answer
51 views

Kuhn-Tucker conditions: why does $\lambda$ $\dfrac{\partial L}{\partial \lambda}=0$?

Satifying Kuhn-Tucker conditions. Given $\lambda$ is a row, and $\dfrac{\partial L}{\partial \lambda}$ is a column, why does $\lambda$ $\dfrac{\partial L}{\partial \lambda}=0$ ?
1
vote
1answer
30 views

Non linear programming please HELP

Hey guys, I never do that but just found out that I have an assignment due in a few hours..thought it was for later, any help/solutions for this one?
3
votes
2answers
2k views

Simple explanation of lagrange multipliers with multiple constraints

I'm studying support vector machines and in the process I've bumped into lagrange multipliers with multiple constraints and Karush–Kuhn–Tucker conditions. I've been trying to study the subject, but ...
1
vote
2answers
112 views

Determine the points where $f$ is has a local minimum/maximum. Multivariable calculus question.

This is not homework, but it is in my book and I find it hard to solve: Determine the points where $f$ is has a local minimum/maximum. Determine if it strong/weak and absolute/relative and ...
0
votes
1answer
59 views

KKT formulation

How to reformulate the following problem $$min \frac{1}{2} (x_1-a_1)^2+ \frac{1}{2} (x_2-a_2)^2$$ $$s.t. \mathbf{1}^Tx=1$$ $$ ||x||_2\leq2$$ as the following system of KKT conditions: $$(1 + ...
1
vote
1answer
193 views

Check Kuhn-Tucker conditions

How to check if $(0,1)$ point is the solution of this optimization problem using Kuhn-Tucker Theorem. Find the min of $e^{x_1-x_2}-x_1-x_2$ where $x_1+x_2\le1,\ x_1\ge 0,\ x_2\ge0$ I am thinking ...
1
vote
0answers
72 views

KKT: Explain visually the optimality condition $F_0\cap G_0\cap H_0=\emptyset$

I am trying to understand visually what this condition actually mean. It is the optimality condition in KKT. It means something like that constraint -set, objective -set and hyperplane -set has no ...
1
vote
1answer
845 views

Linear least squares with non-negativity constraint

I am interested in the linear least squares problem: $$\min_x \|Ax-b\|^2$$ Without constraint, the problem can be directly solved. With an additional linear equality constraint, the problem can be ...
1
vote
2answers
229 views

How can I infer a result using primal feasibility, dual feasibility, and complementary slackness?

I am trying to find the minimum of $-x_1$ with restrictions $\bar g\leq\bar 0$ so that $$\bar g=\begin{pmatrix} (x_1+2)^2+(x_2-4)^2-20\\ (x_1+2)^2+x_2^2-20\\ -x_1\end{pmatrix}\leq ...
1
vote
2answers
187 views

What does the statement “Optimality condition for convex problem” mean? KKT or other condition?

I am stuck to the problem 4 here, course Mat-2.3139, the due day was yesterday. The hint is "Optimality-condition for a convex-problem". I have asked this now from 3 assistants and everyone with ...