Suppose we have an infinite-dimensional real vector $y=(y_1,...)$. Suppose we have an infinite-dimensional real matrix $C=(c_{ij})$, $i,j\in\mathbb{N}$. Let $C^k$ be a submatrix of $C$, $C^k=(c_{ij})_{i,j=1,k}$ and $y_k$ a subvector of $y$, $y^k=(y_1,...,y_k)$. Define
$$\theta^k=C_k^{-1}y^k$$
My question (which probably is too general) is what conditions should $C$ and $y$ satisfy so that pointwise limits
$$\lim_{k\to\infty}\theta^k_i$$
exist? I got a feeling that this could be easily solved by applying theory of linear operators, but I cannot figure out how to reformulate the problem.
To make this question less general we can assume that $y\in\ell_2$ and $C_k$ is symmetric positive-definite matrix for each $k$.
This question is related to this one I've asked on mathoverflow.
Update @fedja below produces a possible sketch of a proof. It requires though that $\|C_k^{-1}\|$ is bounded sequence (take the matrix norm $\|\|_2$). If we suppose that $C$ is a linear operator in $\ell_2$, does the property that each submatrix $C_k$ is positive-definite ensures that the sequence $\|C_k^{-1}\|$ is bounded?
This question can be further rephrased the following way. For symmetric positive-definite matrix $A$ denote its minimal and maximal eigen values by $\lambda_{\min}$ and $\lambda_{\max}$. Then $\|A\|_2=\lambda_{\max}$ and $\|A^{-1}\|_2=\lambda_{\min}^{-1}$. With this in mind the previous question is identical whether $\lambda_{min}(C_k)$ is bounded away from zero.