# Taylor series

File:Sintay.png
As the degree of the Taylor series rises, it approaches the correct function. This image shows sin(x) and Taylor approximations, polynomials of degree 1, 3, 5, 7, 9, 11 and 13.

In mathematics, the Taylor series of an infinitely often differentiable real (or complex) function f defined on an open interval (ar, a + r) is the power series

$\displaystyle T(x) = \sum_{n=0}^{\infin} \frac{f^{(n)}(a)}{n!} (x-a)^{n}.$

Here, n! is the factorial of n and f (n)(a) denotes the nth derivative of f at the point a. If a = 0, the series is also called a Maclaurin series.

## History

Limited sets of series expansions for particular functions were known in India by Madhava in the fourteenth century. In the 17th century, James Gregory also worked in this area and published several Maclaurin series. It wasn't until 1715 that a general method for constructing these series for all functions for which they exist was finally provided by Brook Taylor, after whom the series are now named.

## Properties

If this series converges for every x in the interval (ar, a + r) and the sum is equal to f(x), then the function f(x) is called analytic. To check whether the series converges towards f(x), one normally uses estimates for the remainder term of Taylor's theorem. A function is analytic if and only if it can be represented as a power series; the coefficients in that power series are then necessarily the ones given in the above Taylor series formula.

The importance of such a power series representation is at least fourfold. First, differentiation and integration of power series can be performed term by term and is hence particularly easy. Second, an analytic function can be uniquely extended to a holomorphic function defined on an open disk in the complex plane, which makes the whole machinery of complex analysis available. Third, the (truncated) series can be used to compute function values approximately (often by recasting in the polynomial into the Chebyshev form and evaluating it with the Clenshaw algorithm). Fourth, algebraic operations can often be done much more readily on the power series representation; for instance the simplest proof of Euler's formula uses the Taylor series expansions for sine, cosine, and exponential functions. This result is of fundamental importance in such fields as harmonic analysis.

File:Expinvsq.png
The function e-1/x² is not analytic: the Taylor series is 0, although the function is not.

Note that there are examples of infinitely often differentiable functions f(x) whose Taylor series converge, but are not equal to f(x). For instance, for the function defined piecewise by saying that f(x) = exp(−1/x²) if x ≠ 0 and f(0) = 0, all the derivatives are zero at x = 0, so the Taylor series of f(x) is zero, and its radius of convergence is infinite, even though the function most definitely is not zero. This particular pathology does not afflict complex-valued functions of a complex variable. Notice that exp(−1/z²) does not approach 0 as z approaches 0 along the imaginary axis.

Some functions cannot be written as Taylor series because they have a singularity; in these cases, one can often still achieve a series expansion if one allows also negative powers of the variable x; see Laurent series. For example, f(x) = exp(−1/x²) can be written as a Laurent series.

The Parker-Sochacki theorem is a recent advance in finding Taylor series which are solutions to differential equations. This theorem is an expansion on the Picard iteration.

## Taylor series for several variables

The Taylor series may also be generalised to functions of more than one variable with

$\displaystyle T(x_1,\cdots,x_d) = \sum_{n_1=0}^{\infin} \cdots \sum_{n_d=0}^{\infin} \frac{\partial^{n_1}}{\partial x_1^{n_1}} \cdots \frac{\partial^{n_d}}{\partial x_d^{n_d}} \frac{f(a_1,\cdots,a_d)}{n_1!\cdots n_d!} (x_1-a_1)^{n_1}\cdots (x_d-a_d)^{n_d}$

A second-order Taylor series expansion of a scalar-valued function of more than one variable can be compactly written as

$\displaystyle T(\mathbf{x}) = f(\mathbf{a}) + \nabla f(\mathbf{a})^T (\mathbf{x} - \mathbf{a}) + \frac{1}{2} (\mathbf{x} - \mathbf{a})^T \nabla^2 f(\mathbf{a}) (\mathbf{x} - \mathbf{a})$

where $\displaystyle \nabla f(\mathbf{a})$ is the gradient and $\displaystyle \nabla^2 f(\mathbf{a})$ is the Hessian matrix. Applying the multi-index notation the Taylor series for several variables becomes

$\displaystyle T(\mathbf{x}) = \sum_{|\alpha| \ge 0}^{}{\frac{\mathrm{D}^{\alpha}f(\mathbf{a})}{\alpha !}(\mathbf{x}-\mathbf{a})^{\alpha}}$

in full analogy to the single variable case.

## List of Taylor series of some common functions

Several important Taylor/Maclaurin series expansions follow. All these expansions are also valid for complex arguments x.

$\displaystyle \mathrm{e}^{x} = \sum^{\infin}_{n=0} \frac{x^n}{n!}\quad\mbox{ for all } x$
$\displaystyle \ln(1+x) = \sum^{\infin}_{n=0} \frac{(-1)^n}{n+1} x^{n+1}\quad\mbox{ for } \left| x \right| < 1$
$\displaystyle \frac{x^m}{1-x} = \sum^{\infin}_{n=m} x^n\quad\mbox{ for } \left| x \right| < 1$
$\displaystyle (1+x)^\alpha = \sum^{\infin}_{n=0} {\alpha \choose n} x^n\quad\mbox{ for all } \left| x \right| < 1\quad\mbox{ and all complex } \alpha$
$\displaystyle \sin x = \sum^{\infin}_{n=0} \frac{(-1)^n}{(2n+1)!} x^{2n+1}\quad\mbox{ for all } x$
$\displaystyle \cos x = \sum^{\infin}_{n=0} \frac{(-1)^n}{(2n)!} x^{2n}\quad\mbox{ for all } x$
$\displaystyle \tan x = \sum^{\infin}_{n=1} \frac{B_{2n} (-4)^n (1-4^n)}{(2n)!} x^{2n-1}\quad\mbox{ for } \left| x \right| < \frac{\pi}{2}$
$\displaystyle \sec x = \sum^{\infin}_{n=0} \frac{(-1)^n E_{2n}}{(2n)!} x^{2n}\quad\mbox{ for } \left| x \right| < \frac{\pi}{2}$
$\displaystyle \arcsin x = \sum^{\infin}_{n=0} \frac{(2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1}\quad\mbox{ for } \left| x \right| < 1$
$\displaystyle \arctan x = \sum^{\infin}_{n=0} \frac{(-1)^n}{2n+1} x^{2n+1}\quad\mbox{ for } \left| x \right| < 1$
$\displaystyle \sinh \left(x\right) = \sum^{\infin}_{n=0} \frac{1}{(2n+1)!} x^{2n+1}\quad\mbox{ for all } x$
$\displaystyle \cosh \left(x\right) = \sum^{\infin}_{n=0} \frac{1}{(2n)!} x^{2n}\quad\mbox{ for all } x$
$\displaystyle \tanh\left(x\right) = \sum^{\infin}_{n=1} \frac{B_{2n} 4^n (4^n-1)}{(2n)!} x^{2n-1}\quad\mbox{ for } \left|x\right| < \frac{\pi}{2}$
$\displaystyle \mathrm{arcsinh} \left(x\right) = \sum^{\infin}_{n=0} \frac{(-1)^n (2n)!}{4^n (n!)^2 (2n+1)} x^{2n+1}\quad\mbox{ for } \left| x \right| < 1$
$\displaystyle \mathrm{arctanh} \left(x\right) = \sum^{\infin}_{n=0} \frac{1}{2n+1} x^{2n+1}\quad\mbox{ for } \left| x \right| < 1$
$\displaystyle W_0(x) = \sum^{\infin}_{n=1} \frac{(-n)^{n-1}}{n!} x^n\quad\mbox{ for } \left| x \right| < \frac{1}{\mathrm{e}}$

The numbers Bk appearing in the expansions of tan(x) and tanh(x) are the Bernoulli numbers. The binomial expansion uses binomial coefficients. The Ek in the expansion of sec(x) are Euler numbers.

## Calculation of Taylor series

Several methods exist for the calculation of Taylor series of a large number of functions. One can attempt to use the Taylor series as-is and generalize the form of the coefficients, or one can use manipulations such as substitution, multiplication or division, addition or subtraction of standard Taylor series to construct the Taylor series of a function, by virtue of Taylor series being power series. In some cases, one can also derive the Taylor series by repeatedly applying integration by parts.

For example, consider the function

$\displaystyle f(x)=\ln{(1+\cos{x})} \,$

for which we want a Taylor series about 0.

We have:

$\displaystyle \ln(1+x) = \sum^{\infin}_{n=1} \frac{(-1)^{n+1}}{n} x^n = x - {x^2\over 2}+{x^3 \over 3} - {x^4 \over 4} + \cdots \quad\mbox{ for } \left| x \right| < 1$
$\displaystyle \cos x = \sum^{\infin}_{n=0} \frac{(-1)^n}{(2n)!} x^{2n} = 1 -{x^2\over 2!}+{x^4\over 4!}\mp \cdots \quad\mbox{ for all } x$

We can simply substitute the second series into the first. Doing so,

$\displaystyle \left(1 -{x^2\over 2!}+{x^4\over 4!}+\cdots\right)-{1\over 2}\left(1 -{x^2\over 2!}+{x^4\over 4!}+\cdots\right)^2 +{1\over 3}\left(1 -{x^2\over 2!}+{x^4\over 4!}+\cdots\right)^3-{1\over 4}\left(1 -{x^2\over 2!}+{x^4\over 4!}+\cdots\right)^4+\cdots$

Expanding by using multinomial coefficients gives the requisite Taylor series.

Or, for example, consider

$\displaystyle g(x)={\mathrm{e}^x \over \sin{x}}$

We have

$\displaystyle \mathrm{e}^x = 1 + x + {x^2 \over 2!} + {x^3 \over 3!} + \cdots$
$\displaystyle \sin{x} = x - {x^3 \over 3!} + {x^5 \over 5!} \mp \cdots$

Then,

$\displaystyle {\mathrm{e}^x \over \sin{x}} = { 1 + x + {x^2 \over 2!} + {x^3 \over 3!} + \cdots \over x - {x^3 \over 3!} + {x^5 \over 5!} \mp \cdots}$

Assume the power series is

$\displaystyle c_0 + c_1 x + c_2 x^2 + c_3 x^3 + \cdots = {1 + x + {x^2 \over 2!} + {x^3 \over 3!} + \cdots \over x - {x^3 \over 3!} + {x^5 \over 5!} + \cdots}$

Then

$\displaystyle =\left(c_0 + c_1 x + c_2 x^2 + c_3 x^3 + \cdots\right)\left(x - {x^3 \over 3!} + {x^5 \over 5!} -+ \cdots\right) = 1 + x + {x^2 \over 2!} + {x^3 \over 3!} + \cdots$
$\displaystyle =c_0x - {c_0 \over 3!}x^3 + {c_0\over 5!}x^5 + c_1x^2 - {c_1 \over 3!}x^4 + {c_1\over 5!}x^6 + c_2 x^3 - {c_2 \over 3!} x^5 + {c_2 \over 5!} x^7 + c_3x^4-{c_3\over 3!}x^6 + \cdots$
$\displaystyle = 1 + x + {x^2 \over 2!} + {x^3 \over 3!} + \cdots$
$\displaystyle =c_0x + c_1x^2 + c_2 x^3 - {c_0 \over 3!}x^3 + c_3x^4- {c_1 \over 3!}x^4 + \cdots$
$\displaystyle =c_0x + c_1x^2 + \left(c_2 - {c_0 \over 3!}\right)x^3 + \left(c_3-{c_1 \over 3!}\right)x^4 + \cdots = 1 + x + {x^2 \over 2!} + {x^3 \over 3!} + \cdots$

Comparing coefficients yields the Taylor series for the function.