Set
$$
-C=(-c_{ij})_{3\times 3}=\begin{bmatrix} -1&5&3\\-2&1&2\\0&-4&-3\end{bmatrix}
$$
Solve the no linear sistem
\begin{cases}
2\cdot \Big( \sum_{k=1}^3x_{ik}\cdot x_{kj}\Big) +x_{ij}=-c_{ij} \quad i=1,2,3 \mbox{ and } j=1,2,3.
\end{cases}
or set
$$
A=\begin{pmatrix}
2 & 0 & 0 \\
0 & 2 & 0 \\
0 & 0 & 2 \\
\end{pmatrix}
\quad
B=\begin{pmatrix} 1 & 0 & 0 \\ 0 & 1 & 0\\ 0 & 0 & 1 \end{pmatrix} \quad
C=\begin{bmatrix} -1&5&3\\-2&1&2\\0&-4&-3\end{bmatrix}
$$
We have that $M_{3\times 3}(\mathbb{R})$ is a ring. Then
\begin{align}
0=AX^2+BX+C= &4A\big( AX^2+BX+C\big)\\
=& (2AX)^2+2B(2AX)+4AC \\
=& \big[ 2AX+B \big]^2 -B^2+4AC\\
\end{align}
implies
$$
\left[2AX+B\right]^2=B^2-4AC
$$
if $\Delta=B^2-4AC$ is no neqative and simetric exists $U\in M_{3\times 3}(\mathbb{R})$ such that $U^2=B^2-4AC$.
Then
$$
X=(2A)^{-1} \Big[ -B \pm U\Big]
$$
If $A,B,C$ and $X$ commute it's more easy.