4
$\begingroup$

I have 2 pixels with size 1x3 called $A$ and $B$ and I have to compute the following equation:

$$ A^T *(\Sigma+ I_3*\lambda)^{-1}*B $$

where $\Sigma$ is the covariance matrix (3x3) between vectors $A$ and $B$.

$I_3$ is the 3x3 identity matrix.

$\lambda$ is a constant (therefore, the matrix is not singular).

At the moment, i'm computing the inverse of the $\Sigma +I_3*\lambda$ using the Gauss-Jordan elimination.

I wanna know if there is a trick to compute this equation without computing the inverse. I'm also limited in memory so the Gauss-Jordan elimination is not a really good solution. I also tried to compute straight the inverse using the rule of Sarrus but the result was not enought accurate.

My aim is to resolve this equation with the highest speed and the minimum memory space.

EDIT:

Anyone knows a fast and good way to inverse a 3x3 symmetric matrix ?

EDIT 2:

I'm thinking about making a Cholesky decomposition of my matrix but after that, I don't understand how to compute the inverse of $(\Sigma +I_3*\lambda)$ from Cholesky matrix.

$\endgroup$
9
  • $\begingroup$ Hmm, set aside the question of whether Gauss-Jordan elimination is a good method, are you saying that your memory is so limited that you cannot even store a $3\times3$ matrix? Also, I am not an expert in numerical linear algebra, but computer algorithms usually have space-time tradeoffs. That you need something "with the highest speed and the minimum memory space" is perhaps asking for too much .... Anyway, if those matrix algorithms seem too complicated to you, I think you may try the "conjugate gradient method", which is fairly efficient in terms of speed, storage and ease of implementation. $\endgroup$
    – user1551
    Nov 15, 2012 at 8:51
  • $\begingroup$ @user1551 If i'm limited in memory is because I'm using this in a kernel function in graphic card. But I guess you're right about the trade off, that's why I'm trying different methods. About the "conjugate gradient method", it is usefull for equation Ax=b right ? How can I apply it for my equation ? $\endgroup$
    – Seltymar
    Nov 15, 2012 at 9:09
  • $\begingroup$ $x=(\Sigma+ I_3*\lambda)^{-1}*B \Leftrightarrow (\Sigma+ I_3*\lambda)x=B$. $\endgroup$
    – user1551
    Nov 15, 2012 at 9:16
  • $\begingroup$ @user1551 it works quite well, faster and less memory. However, the precondioned version is slower because it can already be solved in a few iterations. I will maybe try also using Cholesky to solve the same equation. I don't know which one would be the more efficient for my problem. $\endgroup$
    – Seltymar
    Nov 16, 2012 at 7:10
  • $\begingroup$ Hmm, if numerical stability is a concern, Cholesky decomposition seems to be inferior to QR factorization. See pp.17-18 of these slides, for instance. If numerical stability is not your concern, actually you may just employ Cramer's rule. $\endgroup$
    – user1551
    Nov 16, 2012 at 10:08

1 Answer 1

Reset to default
4
$\begingroup$

Since the matrix is symmetric, its inverse is also symmetricת we'll use that and solve.

Let this be the matrix:

[m11  m12  m13]  
[m12  m22  m23]  
[m13  m23  m33]

Its determinant is:

D = m11 * (m33 * m22 - m23^2) - m21 * (m33 * m12 - m23 * m13) + m13 * (m23 * m12 - m22 * m13)

Assuming it is non zero.

The members of the inverse: 

a11 = m33 * m22 - m23^2  
a12 = m13 * m23 - m33 * m12  
a13 = m12 * m23 - m13 * m22  

a22 = m33 * m11 - m13^2  
a23 = m12 * m13 - m11 * m23

a33 = m11 * m22 - m12^2

Divide them all by the determinant which is now given by: 

D = (m11 * a11) + (m12 * a12) + (m13 * a13)

Pay attention my only assumption here is about the Matrix being symmetric and invertible. So it is more general then only working on PD (Positive Definite) / Covariance matrices.

$\endgroup$
2
  • 2
    $\begingroup$ m21 and a21 in the last D computation should presumably be m12 and a12 in the symmetrical notation. $\endgroup$
    – Jxtps
    Mar 12, 2018 at 20:48
  • $\begingroup$ @Jxtps, I made the solution consistent with your remark. Thank You. $\endgroup$
    – Royi
    Aug 14, 2019 at 18:47

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .