(Disclaimer: I'm a high school student, and my knowledge of mathematics extends only to some elementary high school calculus. I don't know if what I'm about to do is valid mathematics.)

I noticed something really neat the other day.

Suppose we define $L$ as a "left-shift operator" that takes a function $f(x)$ and returns $f(x+1)$. Clearly, $(LLL\ldots LLLf)(x)=f(x+(\text{number of $L$s}))$, so it would seem a natural extension to denote $(L^hf)(x)=f(x+h)$.

Now, by the definition of the Taylor series, $f(x+h)=\sum\limits_{k=0}^\infty \frac{1}{k!}\frac{d^kf}{dx^k}\bigg|_{x}h^k$. Let's rewrite this as $\sum\limits_{k=0}^\infty \left(\frac{\left(h\frac{d}{dx}\right)^k}{k!}f\right)(x)$. Now, we can make an interesting observation: $\sum\limits_{k=0}^\infty \frac{\left(h\frac{d}{dx}\right)^k}{k!}$ is simply the Taylor series for $e^u$ with $u=h\frac{d}{dx}$. Let's rewrite the previous sum as $\left(e^{h\frac{d}{dx}}f\right)(x)$. This would seem to imply that $(L^hf)(x)=\left(e^{h\frac{d}{dx}}f\right)(x)$, or equivalently, $L=e^\frac{d}{dx}$. We might even say that $\frac{d}{dx}=\ln L$.

My question is, does what I just did have any mathematical meaning? Is it valid? I mean, I've done a bit of creative number-shuffling, but how does one make sense of exponentiating or taking the logarithm of an operator? What, if any, significance does a statement like $\frac{d}{dx}=\ln L$ have?

  • $\begingroup$ Nice! However, natural logs of operators are found using Taylor seires :( $\endgroup$ – Abhimanyu Pallavi Sudhir Jun 24 '13 at 16:30
  • 22
    $\begingroup$ Wow. Congratulations kid, you're a natural. $\endgroup$ – David H Jun 25 '13 at 8:35
  • $\begingroup$ See also math.stackexchange.com/questions/2188070/…. $\endgroup$ – Tom Copeland Jun 21 '17 at 7:46
  • $\begingroup$ This might be of interest. The theorem in the post (discussed in slightly more detail in the podcast) is pretty much the derivation you show here. $\endgroup$ – Theoretical Economist Mar 17 '19 at 16:05

Well, it seems that you have just discovered a beautiful theory of (semi)group generators by yourself. To give some basics of it, let us consider a collection of "nice" functions on real values - e.g. bounded and having continuous derivatives. The action of operators $L^h$ on this space has a semigroup structure: $$ L^s(L^tf(x)) = L^sf(x+t) = f(x+s+t) = L^{s+t}f(x). \tag{1} $$ Also, you have that $L^0f(x) = f(x)$, so $L^0$ is the identity operator -it does not change its argument. You can see, that although there are a lot of operators in the collection $(L^h)_{h}$, they have to satisfy the semigroup property $L^{s+t} = L^sL^t$, and so there is no much freedom in choosing them. Even more, one can define the generator of the semigroup (also sometimes called the derivative of it) by $$ \mathscr Af(x):=\lim_{h\to 0}\frac{1}{h}(L^hf - f) $$ which in your case exactly coincides with the derivative of the function. However, if you would consider the semigroup $K^hf(x) = f(x + v\cdot h)$ for some constant $v$, you'll see that the generator will be a bit different. Anyways, under certain condition - if you don't know the semigroup $L$, but you're just given the generator $\mathscr A$, it is possible to reconstruct $L$ from $\mathscr A$ by the so-called exponential map, that is $$ L^h:=\mathrm e^{h\mathscr A} $$ where the definition of the exponent of the operator indeed is given by the Taylor series where e.g. $\mathscr A^2 f(x) = \mathscr A(\mathscr A f(x))$. As a result, you can indeed consider $\mathscr A$ to be a certain logarithm of $L^h$ and it comes as no surprise that it has a similar Taylor expansion. However, although the name "exponential map" from $\mathscr A$ to $L^h$ is commonly used, I haven't heard of the inverse being called the "logarithm". One rather uses the "generator" or "derivative." If you are further interested, I would suggest you reading the linked wikipedia article.

| cite | improve this answer | |
  • $\begingroup$ Thanks! This is some very cool stuff. Is this the kind of thing one would call "group theory"? $\endgroup$ – David Zhang Jun 24 '13 at 14:49
  • 3
    $\begingroup$ @DavidZhang: the whole group theory is very broad, and much of it concerns discrete groups, that do not have this structure we talked about. However, generators are used a lot in theory of special groups, called Lie groups, and in the semigroup approach to dynamical systems, especially in theory of Markov processes and related PDEs. $\endgroup$ – Ilya Jun 24 '13 at 14:55
  • $\begingroup$ Can you recommend an introductory textbook or any other further reading on this subject? $\endgroup$ – David Zhang Jun 25 '13 at 1:09
  • $\begingroup$ @DavidZhang as advised by Jonas Teuwen, you may want to check out this short course $\endgroup$ – Ilya Jun 25 '13 at 8:21
  • 1
    $\begingroup$ @DavidZhang: today I accidentally came by a wikipedia article that claims that apparently Lagrange was on of the first to notice the exponential-like dependence between shifts and derivatives. $\endgroup$ – Ilya Jul 1 '13 at 13:15

$$ \begin{align} e^{d/dx} x^n = {} & \left(1+\frac{d}{dx} + \frac{(d/dx)^2}{2}+ \frac{(d/dx)^3}{6}+\frac{(d/dx)^4}{24}+\cdots+\frac{(d/dx)^k}{k!}+\cdots\right) x^n \\[10pt] = {} & x^n + nx^{n-1} + \frac{n(n-1)}{2}x^{n-2} + \frac{n(n-1)(n-2)}{6}x^{n-3}+\cdots \\[10pt] & \cdots+\frac{n(n-1)\cdots(n-k+1)}{k!}x^{n-k}+\cdots+0+0+0+\cdots \\[10pt] = {} & \binom n0 x^n 1^0 + \binom n1 x^{n-1} 1^1 + \binom n2 x^{n-2} 1^2 + \cdots + \binom n n x^0 1^n \\[10pt] & \cdots+0+0+0+\cdots \\[10pt] = {} & (x+1)^n. \end{align} $$ So the binomial theorem entails that $e^{d/dx} = L$ at least as applied to polynomials.

If applied to functions other than polynomials, there are convergence issues to examine.

| cite | improve this answer | |
  • 3
    $\begingroup$ Hang on, shouldn't the terms in the expansion of $e^\frac{d}{dx}$ have increasing powers of $\frac{d}{dx}$? $\endgroup$ – David Zhang Jun 24 '13 at 14:56
  • $\begingroup$ Yes. Fixed. ${{{}}}$ $\endgroup$ – Michael Hardy Jun 24 '13 at 15:04

how does one make sense of exponentiating or taking the logarithm of an operator?

The operator is linear, and therefore so are its positive integer powers, hence any power series in that operator has a chance of making sense. At least the series is a limit of linear operators, and the series makes perfect sense without any limiting process when applied to polynomials, because almost all terms are zero.

In the 17-18th century, functions were believed to have power series representations, so that formal manipulations that were provably correct for polynomials ought to somehow justify the same calculation in general. This is not quite right but it works spectacularly as a heuristic.

What, if any, significance does a statement like d/dx=ln L have?

It adds precision to the analogy between calculus and the "calculus of finite differences". As you might guess, what is true for differentiation extends to integration. The corresponding relationship between finite sums and integrals is the Euler-Maclaurin summation formula and it is derived by taking the reciprocal of a power series equivalent to the one you wrote down.

| cite | improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.