Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have a system of the form $Ax = b$, and I want to obtain the best $x$ in the least squares sense. $A$ is $M \times N$, where $M \approx 2N$ (or $4N$ for another variation). Rows in $A$ have 2 nonzero columns, as my equations are effectively $x_i - x_j = b$.

I also have K modeling constraints, of the form: $x_i = c_i$, $K \ll M$.

My problem is with weighting. Everything has different importance, the constraints are generally much more important (some of utmost importance), and I don't know how to go about the scale and distribution of weights. Example questions.

1) Should the weights definitely add up to 1?

2) If I have weights adding up to one, is there a 'rule' of some sorts of distributing weights? e.g if $M = 100K$, is there an ideal weight percentage distributed over all $K$ constraints?

3) Is it a good idea to use really small weight values for loosely enforcing some constraints? e.g. $x_i = 0.001c_i$ : I want $x_i$ to be around, not necessarily at $c_i$

share|cite|improve this question
For 1: not necessarily, unless something in your application dictates that constraint. – J. M. May 2 '12 at 12:37

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.