By "compatible" I mean, if $R$ is my relation and $+$ my operation, then if $aRb$ and $cRd$, then $(a+c)R(b+d)$. For an congruence relation this is claimed, but also that $R$ must be an equivalence relation, but there are relations, like $<$ that fulfill the first statement, but are not equivalence relation's. Are there any terms for such relations and are they studied in mathematics?
Considering a functional relation $R$, the compatability says, in functional notation: $R(a+c)=R(a)+R(c)$. In other words, the function preserves that operation. Of course we study examples of such relations all the time whenever we are looking at homomorphisms!
If you're asking if relations in general are studied this way, then maybe so. While searhing I came across a paper by Saunders MacLane which looks like a relevant example: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC221322/
He talks about regarding a homomorphism of things in a category with an operation $S\rightarrow B/L$ instead as a "many valued function" from $S$ into $B$ (that is, every pre-image is related to the multiple things in the coset of the image). It remains "compatible", but is no longer a true function.