In my lecture, we gave a very sloppy (physics people ...) proof of the fact that the Lie algebra $\mathfrak{g}$ of a matrix Lie group $G$ is a subspace of $\text{Mat}_n(\mathbb{F})$. I am not satisfied and I would love to understand this fact in the language of differential geometry that I am learning right now.
What I know:
The Lie algebra $\mathfrak{g}$ of a matrix Lie group $G$ is the set of all left-invariant vector fields on $G$. This set is isomorphic to the tangent space at the identity of the Lie group $G$. The elements $v$ of the tangent space at the identity are according to my definition of the tangent space real-valued functions $$v:F(G)\to \mathbb{R}$$ where $F(M)$ is the set of all smooth-real valued functions on the manifold $G$. The tangent vectors are $\mathbb{R}$ linear and fulfil a Leibniz rule and the tangent space at $p$, namely $T_pG$ is simply the set of all these tangent vectors.
What I want to know
Given the above definitions, how can I formally understand that the members of the tangent space at the identity of a matrix Lie group are matrices?