I discern three aspects to your question: Why are exponential functions $b^x$ important? Why are logarithmic functions $\log_b x$ important? And assuming the first two, which base is best (in what sense?) and why is it $e$?
I assume your question is the last and the best reasons have to do with calculus. Any exponential function can be converted to any other base: $b^x = a^{x \log_a(b)}$. And any logarithmic function can be converted to any other base: $\log_b(x) = \log_a(x)/\log_a(b)$.
So why pick $b=e$?
@MichaelHardy points out that the derivative of $e^x$ is $e^x$. Similarly the derivative of a logarithmic function is a constant divided by $x$. For $\log_e(x)$ the constant is $1$, the simplest possible. (Thus, to be clear, the derivative of $\log_e(x)$ is $1/x$.) This makes the base $e$ convenient for both exponential and logarithmic functions.
Many other formulas for exponential and logarithmic functions are simplest when the base is $e$. You've already pointed out the limit
$$e=\lim_{n\rightarrow\infty}\left(1 + {1\over n}\right)^n\,$$
Compare the series for $2^x$ with the series for $e^x$:
$$e^x = \sum_{n=0}^\infty{x^n \over n!} = 1 + x + {x^2\over2!}+{x^3\over3!}+{x^4\over4!}+\cdots$$
Similarly,
$$\log_e(x)=\lim_{n\rightarrow\infty}n(x^{1/n}-1)$$
and compare the series for $\log_2 (1+x)$ with
$$\log_e(1+x) = \sum_{n=1}^\infty{(-1)^{n-1}x^n \over n}=x-{x^2\over2}+{x^3\over3}-{x^4\over4}+\cdots$$
Basically you could say that the importance of $e$ comes down the constant Michael Hardy refers to -- you could think of it as a "correction factor," I suppose, or better as a "nuisance factor" -- that constant is $1$ for the base $e$, which is very convenient when you are working things out.
The rest of its importance derives from the importance of exponential and logarithmic functions generally.
(If the teenager cannot appreciate calculus yet, well, perhaps he can appreciate the reason that it is easiest in the cases that matter the most. And if not, then perhaps advise patience --"You'll understand when you're older." :) It's not bad advice, really. The thing that bugs me is what was so important about $\log_{10}$? Well, it's the easiest log. to understand at the beginning, but it's not that important later.)