Try to work it out piecemeal, and then find a pattern and prove it in general.
What should the entry (1, 1) be? Logically, doing the first step of matrix multiplication with the matrix and its inverse (dot product of first row and first column), we see that the result has to be 1. The only way this can ever happen is if entry (1, 1) is $\frac12$.
What should all the other entries in the first row be? The result of dot products between the first row and all other columns of the inverse matrix should be 0, if we are to have the identity matrix as a result. This can only happen if all other such values are zero.
With this knowledge, proceed similarly for the next rows. You will have enough information to reason it out.
Now take this pattern and prove it for the general case.