More specifically, how do you define the square root of an $n\times n$ matrix A and express it in linear algebra terms? Does this have something to do with positive semi-definite matrices and diagonalization?
Square root of a matrix $A$ is another matrix $B$ such that $B^2 = A$. It might or might not exist and it might or might not be unique. See Wikipedia for more.