I am trying to come up with a way to find the transformation parameters between two sets of planes and would like to get a cost function
C which incorporates two functions
C1 = dot(n1,n2) C2 = dist(p1,p2)
n2 are normal vectors and
p2 are means of planes. However, I am not sure if
C = C1 + C2
can be used as a cost function to minimize the angle and distance together? If not, do I need to maximize them separately?