If you want a maximum level of rigor, you can avoid the interchange of two limiting operator problem as follows:
As we observed,
$$ \left( 1 + \frac{1}{n} \right)^n = \sum_{j=0}^{n} \binom{n}{j}\frac{1}{n^j} = \sum_{j=0}^{n} \frac{1}{j!}\prod_{k=1}^{j} \left( 1 - \frac{k-1}{n} \right) $$
where the product is considered to yield $1$ if $j = 0$ by convention. Now, fix a positive integer $m$. Then by noting that each summand is non-negative, for any $n \geq m$ we have
\begin{align*}
\sum_{j=0}^{m} \frac{1}{j!}\prod_{k=1}^{j} \left( 1 - \frac{k-1}{n} \right)
&\leq \sum_{j=0}^{n} \frac{1}{j!}\prod_{k=1}^{j} \left( 1 - \frac{k-1}{n} \right)
\leq \sum_{j=0}^{n} \frac{1}{j!}.
\end{align*}
This inequality shows that
\begin{align*}
\liminf_{n\to\infty} \sum_{j=0}^{m} \frac{1}{j!}\prod_{k=1}^{j} \left( 1 - \frac{k-1}{n} \right)
&\leq \liminf_{n\to\infty} \left(1 + \frac{1}{n}\right)^{n} \\
&\leq \limsup_{n\to\infty} \left(1 + \frac{1}{n}\right)^{n}
\leq \limsup_{n\to\infty} \sum_{j=0}^{n} \frac{1}{j!}.
\end{align*}
But since
$$ \liminf_{n\to\infty} \sum_{j=0}^{m} \frac{1}{j!}\prod_{k=1}^{j} \left( 1 - \frac{k-1}{n} \right) = \sum_{j=0}^{m} \frac{1}{j!} $$
and
$$ \limsup_{n\to\infty} \sum_{j=0}^{n} \frac{1}{j!} = \sum_{j=0}^{\infty} \frac{1}{j!}, $$
it follows that
$$ \sum_{j=0}^{m} \frac{1}{j!}
\leq \liminf_{n\to\infty} \left(1 + \frac{1}{n}\right)^{n}
\leq \limsup_{n\to\infty} \left(1 + \frac{1}{n}\right)^{n}
\leq \sum_{j=0}^{\infty} \frac{1}{j!}. $$
Notice that this inequality holds for any $m$. Thus taking $m\to\infty$, we obtain the desired result.