The elements of your matrix appear to be independently and identically distributed random variables, all following a discrete Uniform distribution $a_{ij} \sim U(1,n)$. Then, at the theoretical level, all is nice and clear:
Any $n \times n$ determinant, $n>2$, is decomposed down to a sum (with varying signs of course) of $2 \times 2$ determinants, with multiplying terms in front of them.
One such term, typical in its structure, would be (neglecting the sign)
$$a_{11}\cdot a_{22}\cdot...a_{n-2,n-2} \cdot \left (a_{n-1,n-1} a_{nn} - a_{n-1,n}a_{n,n-1}\right)$$
and, due to independence
$$E\left[a_{11}\cdot a_{22}\cdot...a_{n-2,n-2} \cdot \left (a_{n-1,n-1} a_{nn} - a_{n-1,n}a_{n,n-1}\right)\right]$$
$$=E\left[a_{11}\cdot a_{22}\cdot...a_{n-2,n-2} \right]\cdot \left (E(a_{n-1,n-1}) E(a_{nn}) - E(a_{n-1,n})E(a_{n,n-1})\right)$$
But the variables are also identically distributed, so their expected value is the same. So
$$E(a_{n-1,n-1}) E(a_{nn}) - E(a_{n-1,n})E(a_{n,n-1}) =0$$
in all cases, and so all such terms are zero, and the expected value of the determinant will be zero.
Obviously, if the elements of the matrix are not independent r.v.'s, we cannot break the expected values and the zero result does not hold in general. So perhaps, the way you draw your random numbers makes the elements of the matrix non-independent? Perhaps for each row or column you draw "without replacement"?
But assume that we do draw correctly independent numbers/random variables, and we want to "see with our own eyes" that the "average value" does converge to zero. How do we go about it? For given $n$, the "sample analogue" of the expected value of the determinant is
$$\overline {\det(A)}= \frac 1m\sum_{i=1}^m\det(A_m)$$
where $m$ is the number of matrices generated in the same fashion...
...and the nice clean picture provided by the Expected Value operator and the i.i.d. assumption just vanished, because the sample mean of the determinants is not the average of a sum of independent r.v.'s: the components of each determinant is of course independent from the components of all other determinants, indeed. Each component of each determinant, is comprised of i.i.d r.v.'s indeed (it is a product of i.i.d discrete uniforms). But between certain components of each determinant, there will be dependence since they will have some r.v.'s in common. For example the determinant of the matrix
$$B=\begin{bmatrix}a&b&c\\d&e&f\\g&h&i\end{bmatrix}$$
is
$$|B|=aei+bfg+cdh-ceg-bdi-afh$$
and you can see the various stochastic dependencies. This makes the fate of simulations for $\overline {\det(A)}$ a rather more complicated issue to determine, get a sense of the rate of convergence, etc. In other words, your conjecture is correct -but seeing it materialize through computer simulation may be another matter.