Iterative methods, like Jabobi method or Gauss-Seidel method, are also called relaxation methods. I understand these methods converge to the true solution in under some condition, but I don't understand why it is "relaxation".
Could someone help explain what does this "relaxation" mean and in what way it is "relaxed"? And what are "non-relaxed" methods for solving linear system?
PS: I am familiar with the relation in optimization, in which the constraint is relaxed to a larger set to make the problem easier to solve.