Many applications give rise to differential equations with solutions that can’t be expressed in terms of elementary functions such as polynomials, rational functions, exponential and logarithmic functions, and trigonometric functions. The solutions of some of the most important of these equations can be expressed in terms of power series. We’ll study such equations in this chapter. In this section we review relevant properties of power series. We’ll omit proofs, which can be found in any standard calculus text.
where \(x_0\) and \(a_0\), \(a_1,\) …, \(a_n,\) …are constants, is called a power series in \(x-x_0.\) We say that the power series Equation \ref{eq:7.1.1} converges for a given \(x\) if the limit
exists\(;\) otherwise, we say that the power series diverges for the given \(x.\)
A power series in \(x-x_0\) must converge if \(x=x_0\), since the positive powers of \(x-x_0\) are all zero in this case. This may be the only value of \(x\) for which the power series converges. However, the next theorem shows that if the power series converges for some \(x\ne x_0\) then the set of all values of \(x\) for which it converges forms an interval.
Theorem 7.2.2
For any power series
\[\sum_{n=0}^\infty a_n(x-x_0)^n, \nonumber \]
exactly one of the these statements is true:
The power series converges only for \(x=x_0.\)
The power series converges for all values of \(x.\)
There’s a positive number \(R\) such that the power series converges if \(|x-x_0|<R\) and diverges if \(|x-x_{0}|>R\).
In case (iii) we say that \(R\) is the radius of convergence of the power series. For convenience, we include the other two cases in this definition by defining \(R=0\) in case (i) and \(R=\infty\) in case (ii). We define the open interval of convergence of \(\sum_{n=0}^\infty a_n(x-x_0)^n\) to be
If \(R\) is finite, no general statement can be made concerning convergence at the endpoints \(x=x_0\pm R\) of the open interval of convergence; the series may converge at one or both points, or diverge at both.
Recall from calculus that a series of constants \(\sum_{n=0}^\infty\alpha_n\) is said to converge absolutely if the series of absolute values \(\sum_{n=0}^\infty|\alpha_n|\) converges. It can be shown that a power series \(\sum_{n=0}^\infty a_n(x-x_0)^n\) with a positive radius of convergence \(R\) converges absolutely in its open interval of convergence; that is, the series
\[\sum_{n=0}^\infty |a_n||x-x_0|^n \nonumber \]
of absolute values converges if \(|x-x_0| <R\). However, if \(R<\infty\), the series may fail to converge absolutely at an endpoint \(x_{0}\pm R\), even if it converges here.
The next theorem provides a useful method for determining the radius of convergence of a power series. It’s derived in calculus by applying the ratio test to the corresponding series of absolute values. For related theorems see Exercises 7.2.2 and 7.2.4.
Theorem 7.2.3
Suppose there’s an integer \(N\) such that \(a_n\ne0\) if \(n\ge N\) and
where \(0\le L\le\infty.\) Then the radius of convergence of \(\sum_{n=0}^\infty a_n(x-x_0)^n\) is \(R=1/ L,\) which should be interpreted to mean that \(R=0\) if \(L=\infty,\) or \(R=\infty\) if \(L=0\).
In the special case where \(x_0=0\), this series is also called the Maclaurin series of \(f\).
Taylor series for most of the common elementary functions converge to the functions on their open intervals of convergence. For example, you are probably familiar with the following Maclaurin series:
on its open interval of convergence. We say that the series represents \(f\) on the open interval of convergence. A function \(f\) represented by a power series may be a familiar elementary function as in Equations \ref{eq:7.1.2} - \ref{eq:7.1.5}; however, it often happens that \(f\) isn’t a familiar function, so the series actually defines \(f\).
The next theorem shows that a function represented by a power series has derivatives of all orders on the open interval of convergence of the power series, and provides power series representations of the derivatives.
with positive radius of convergence \(R\) has derivatives of all orders in its open interval of convergence, and successive derivatives can be obtained by repeatedly differentiating term by term\(;\) that is,
which is the series Equation \ref{eq:7.1.4} for \(\cos x\).
Uniqueness of Power Series
The next theorem shows that if \(f\) is defined by a power series in \(x-x_0\) with a positive radius of convergence, then the power series is the Taylor series of \(f\) about \(x_0\).
Except for notation, this is the same as Equation \ref{eq:7.1.9}.
The next theorem lists two important properties of power series that follow from Theorem 7.2.4
.
Theorem 7.2.6
If \[\sum_{n=0}^\infty a_n(x-x_0)^n=\sum_{n=0}^\infty b_n(x-x_0)^n\nonumber \] for all \(x\) in an open interval that contains \(x_0,\) then \(a_n=b_n\) for \(n=0\), \(1\), \(2\), ….
If \[\sum_{n=0}^\infty a_n(x-x_0)^n=0\nonumber \] for all \(x\) in an open interval that contains \(x_0,\) then \(a_n=0\) for \(n=0\), \(1\), \(2\), ….
To obtain (a) we observe that the two series represent the same function \(f\) on the open interval; hence, Theorem 7.2.4
implies that
where the power series has a positive radius of convergence, then the Taylor polynomials of \(f\) about \(x_0\) are given by
\[T_N(x)=\sum_{n=0}^N a_n(x-x_0)^n. \nonumber \]
In numerical applications, we use the Taylor polynomials to approximate \(f\) on subintervals of the open interval of convergence of the power series. For example, Equation \ref{eq:7.1.2} implies that the Taylor polynomial \(T_N\) of \(f(x)=e^x\) is
\[T_N(x)=\sum_{n=0}^N{x^n\over n!}. \nonumber \]
The solid curve in Figure 7.2.1
is the graph of \(y=e^x\) on the interval \([0,5]\). The dotted curves in Figure 7.2.1
are the graphs of the Taylor polynomials \(T_1\), …, \(T_6\) of \(y=e^x\) about \(x_0=0\). From this figure, we conclude that the accuracy of the approximation of \(y=e^x\) by its Taylor polynomial \(T_N\) improves as \(N\) increases.
Figure 7.2.1
: Approximation of \(y=e^x\) by Taylor polynomials about \(x=0\)
Shifting the Summation Index
In Definition 7.2.1
of a power series in \(x-x_0\), the \(n\)-th term is a constant multiple of \((x-x_0)^n\). This isn’t true in Equation \ref{eq:7.1.6}, Equation \ref{eq:7.1.7}, and Equation \ref{eq:7.1.8}, where the general terms are constant multiples of \((x-x_0)^{n-1}\), \((x-x_0)^{n-2}\), and \((x-x_0)^{n-k}\), respectively. However, these series can all be rewritten so that their \(n\)-th terms are constant multiples of \((x-x_0)^n\). For example, letting \(n=k+1\) in the series in Equation \ref{eq:7.1.6} yields
where we start the new summation index \(k\) from zero so that the first term in Equation \ref{eq:7.1.10} (obtained by setting \(k=0\)) is the same as the first term in Equation \ref{eq:7.1.6} (obtained by setting \(n=1\)). However, the sum of a series is independent of the symbol used to denote the summation index, just as the value of a definite integral is independent of the symbol used to denote the variable of integration. Therefore we can replace \(k\) by \(n\) in Equation \ref{eq:7.1.10} to obtain
where the general term is a constant multiple of \((x-x_0)^n\).
It isn’t really necessary to introduce the intermediate summation index \(k\). We can obtain Equation \ref{eq:7.1.11} directly from Equation \ref{eq:7.1.6} by replacing \(n\) by \(n+1\) in the general term of Equation \ref{eq:7.1.6} and subtracting 1 from the lower limit of Equation \ref{eq:7.1.6}. More generally, we use the following procedure for shifting indices.
Shifting the Summation Index in a Power Series
For any integer \(k\), the power series
\[\sum _ { n = n _ { 0 } } ^ { \infty } b _ { n } \left( x - x _ { 0 } \right) ^ { n - k } \nonumber \]
can be rewritten as
\[\sum _ { n = n _ { 0 } - k } ^ { \infty } b _ { n + k } \left( x - x _ { 0 } \right) ^ { n } \nonumber \]
that is, replacing \(n\) by \(n + k\) in the general term and subtracting k from the lower limit of summation leaves the series unchanged.
Example 7.2.3
Rewrite the following power series from Equation \ref{eq:7.1.7} and Equation \ref{eq:7.1.8} so that the general term in each is a constant multiple of \((x-x_0)^n\):
\[f(x)=\sum_{n=0}^\infty a_n(x-x_0)^n \quad\mbox{ and }\quad g(x)=\sum_{n=0}^\infty b_n(x-x_0)^n\nonumber \]
with positive radii of convergence can be added term by term at points common to their open intervals of convergence; thus, if the first series converges for \(|x-x_0|<R_{1}\) and the second converges for \(|x-x_{0}|<R_{2}\), then
for \(|x-x_0|<R\), where \(R\) is the smaller of \(R_{1}\) and \(R_{2}\). More generally, linear combinations of power series can be formed term by term; for example,
\[{1\over2}[1+(-1)^n]=\left\{\begin{array}{cl}1&\mbox{ if } n=2m,\mbox{ an even integer},\\[4pt] 0&\mbox{ if }n=2m+1,\mbox{ an odd integer}, \end{array}\right. \nonumber \]
we can rewrite Equation \ref{eq:7.1.12} more simply as
This result is valid on \((-\infty,\infty)\), since this is the open interval of convergence of the Maclaurin series for \(e^x\) and \(e^{-x}\).
Example 7.2.6
Suppose
\[y=\sum_{n=0}^\infty a_n x^n \nonumber \]
on an open interval \(I\) that contains the origin.
Express \[(2-x)y''+2y \nonumber \] as a power series in \(x\) on \(I\).
Use the result of (a) to find necessary and sufficient conditions on the coefficients \(\{a_n\}\) for \(y\) to be a solution of the homogeneous equation
where we added a zero term in the last series so that when we substitute from Equation \ref{eq:7.1.15} and Equation \ref{eq:7.1.16} into Equation \ref{eq:7.1.14} all three series will start with \(n=0\); thus,
Conversely, Theorem 7.2.5
b implies that if \(y=\sum_{n=0}^\infty a_nx^n\) satisfies Equation \ref{eq:7.1.13} on \(I\), then Equation \ref{eq:7.1.18} holds.
Example 7.2.7
Suppose
\[y=\sum_{n=0}^\infty a_n (x-1)^n \nonumber \]
on an open interval \(I\) that contains \(x_0=1\). Express the function
\[\label{eq:7.1.19} (1+x)y''+2(x-1)^2y'+3y \]
as a power series in \(x-1\) on \(I\).
Solution
Since we want a power series in \(x-1\), we rewrite the coefficient of \(y''\) in Equation \ref{eq:7.1.19} as \(1+x=2+(x-1)\), so Equation \ref{eq:7.1.19} becomes
\[2y''+(x-1)y''+2(x-1)^2y'+3y. \nonumber \]
From Equation \ref{eq:7.1.6} and Equation \ref{eq:7.1.7} with \(x_0=1\),
\[y'=\sum_{n=1}^\infty na_n(x-1)^{n-1}\quad\mbox{ and }\quad y ''=\sum_{n=2}^\infty n(n-1)a_n(x-1)^{n-2}. \nonumber \]
where we added initial zero terms to the series in Equation \ref{eq:7.1.21} and Equation \ref{eq:7.1.22}. Adding Equations \ref{eq:7.1.20}–\ref{eq:7.1.23} yields
The formula Equation \ref{eq:7.1.24} for \(b_0\) can’t be obtained by setting \(n=0\) in Equation \ref{eq:7.1.25}, since the summation in Equation \ref{eq:7.1.22} begins with \(n=1\), while those in Equation \ref{eq:7.1.20}, Equation \ref{eq:7.1.21}, and Equation \ref{eq:7.1.23} begin with \(n=0\).