# Runge Phenomena and Taylor Expansion

We contrast this to polynomial interpolation: this is a specific method for generating a sequence of polynomials that will approximate our data set. If our data set was just the outputs of some continuous function, we would hope that the sequence of polynomials would approximate it arbitrarily closely as we generate them of higher and higher degree. The Runge phenomenon says that this is too optimistic: approximating $\frac{1}{1+x^2}$ over $[−5,5]$ with equidistant nodes does not converge in the way we want.

How does this work with respect to Taylor expansions in which higher order polynomials result in smaller errors? I understand that a Taylor expansion is a sum of polynomials expanded around a point - do more terms in the expansion mean that the approximation range of the expansions increases?

The Taylor series of an analytic function $f(z)$ about $z=a$ has radius of convergence $r$ ($0 < r < \infty$) if and only if $r$ is the largest radius such that $f$ can be defined to be analytic in the open disk $\{z \in \mathbb C: |z - a| < r\}$. For example, since $1/(1 + x^2)$ has singularities at $x = \pm i$, the radius of convergence of its Taylor series around $0$ is $1$. The Taylor polynomials converge to $1/(1+x^2)$ for $|x| < 1$, but do not converge for $|x| > 1$. Thus higher-order Taylor polynomials do not produce smaller errors here. Indeed, the errors get spectacularly large.
In the most general sense, a Taylor series is not guaranteed to converge everywhere - try plotting the first few terms of a Taylor expansion of $\frac{1}x$ around $x=1$. If you only look in the interval $0<x<2$, you'll see that it keeps getting better and better, but if we look at $x>2$ we'll see that when we have an odd number of terms, the Taylor expansion spikes way below where it should be (as seen in the order 7 approximation):
$\hskip1in$
$\hskip1in$
As it happens, if we add enough terms, we'll end up with a good approximation in $(0,2)$, but beyond that, things will oscillate with increasing intensity.
We can say that all Taylor series have a radius of convergence, which measures how far away from the base point one can go before the approximation goes wonky. However, we get into trouble when we note that this radius might be $0$ (meaning it converges only at the base point - not very useful) or we might have a smooth, but not analytic function - meaning it converges, but it doesn't agree with the desired function. In the example of $\frac{1}x$, the radius of convergence is $1$ - so we can stray as far as one unit away from $x=1$ before things go bad. We can see examples like $\sin(x)$ or $e^x$ which have infinite radius of convergence - so as you add more terms, your approximation will get closer to the desired function (over any desired interval). We also get examples like $|x|$ which aren't infinitely differentiable and so don't even have a Taylor series.