Skip to main content
$$\newcommand{\id}{\mathrm{id}}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\kernel}{\mathrm{null}\,}$$ $$\newcommand{\range}{\mathrm{range}\,}$$ $$\newcommand{\RealPart}{\mathrm{Re}}$$ $$\newcommand{\ImaginaryPart}{\mathrm{Im}}$$ $$\newcommand{\Argument}{\mathrm{Arg}}$$ $$\newcommand{\norm}{\| #1 \|}$$ $$\newcommand{\inner}{\langle #1, #2 \rangle}$$ $$\newcommand{\Span}{\mathrm{span}}$$

# 13.8: Series

$$\newcommand{\vecs}{\overset { \rightharpoonup} {\mathbf{#1}} }$$ $$\newcommand{\vecd}{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}}$$$$\newcommand{\id}{\mathrm{id}}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\kernel}{\mathrm{null}\,}$$ $$\newcommand{\range}{\mathrm{range}\,}$$ $$\newcommand{\RealPart}{\mathrm{Re}}$$ $$\newcommand{\ImaginaryPart}{\mathrm{Im}}$$ $$\newcommand{\Argument}{\mathrm{Arg}}$$ $$\newcommand{\norm}{\| #1 \|}$$ $$\newcommand{\inner}{\langle #1, #2 \rangle}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\id}{\mathrm{id}}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\kernel}{\mathrm{null}\,}$$ $$\newcommand{\range}{\mathrm{range}\,}$$ $$\newcommand{\RealPart}{\mathrm{Re}}$$ $$\newcommand{\ImaginaryPart}{\mathrm{Im}}$$ $$\newcommand{\Argument}{\mathrm{Arg}}$$ $$\newcommand{\norm}{\| #1 \|}$$ $$\newcommand{\inner}{\langle #1, #2 \rangle}$$ $$\newcommand{\Span}{\mathrm{span}}$$

You may recall from your calculus course that there is a big difference between a sequence and a series.

A sequence is an infinite list $$a_{1}, a_{2}, a_{3}, a_{4}, a_{5}, a_{6}, \cdots$$.

But a series is an infinite sum $$a_{1}+a_{2}+a_{3}+a_{4}+a_{5}+a_{6}+\cdots$$.

We use the notation $$\{a_{n}\}$$ to denote the sequence $$a_{1}, a_{2}, a_{3}, a_{4}, \cdots$$, but we use sigma notation to denote a series:

$$\sum_{k=1}^{\infty} a_{k} = a_{1}+a_{2}+a_{3}+a_{4}+a_{5}+a_{6}+\cdots$$.

For example,

$$\sum_{k=1}^{\infty} \frac{1}{2^k} = \frac{1}{2}+\frac{1}{4}+\frac{1}{8}+\frac{1}{16}+\frac{1}{32}+\frac{1}{64}+\cdots$$.

You may have a sense that this series should sum to 1, whereas

$$\sum_{k=1}^{\infty} \frac{k+1}{k} = \frac{2}{1}+\frac{3}{2}+\frac{4}{3}+\frac{5}{4}+\frac{6}{5}+\frac{7}{6}+\cdots$$.

equals $$\infty$$ because every fraction in the infinite sum is greater than 1. Series are significant in calculus because many complex functions can be expressed as series involving terms built from simple algebraic operations. For example, your calculus course may have developed the Maclaurin series

for various functions, such as

$$cos(x) = \sum_{k=0}^{\infty} \frac{(-1)^{k}}{(2k)!}x^{2k} = 1-\frac{x^2}{2!}+\frac{x^4}{4!}-\frac{x^6}{6!}+\frac{x^8}{8!}-\frac{x^10}{10!}+\cdots$$

But before we make any progress with series, it is essential that we clearly specify what it means to add up infinitely many numbers. We need to understand the situations in which this does and does not make sense.

The key to codifying whether or not a series

$$\sum_{k=1}^{\infty} a_{k} = a_{1}+a_{2}+a_{3}+a_{4}+a_{5}+a_{6}+\cdots$$.

adds up to a finite number is to terminate it at an arbitrary nth term:

$$\sum_{k=1}^{n} a_{k} = a_{1}+a_{2}+a_{3}+a_{4}+a_{5}+a_{6}+\cdots+a_{n}$$.

This is sum called the nth partial sum of the series, and is denoted as $$s_{n}$$.

The series has a partial sum sn for each positive integer n:

$$s_{1} = a_{1}$$

$$s_{2} = a_{1}+a_{2}$$

$$s_{3} = a_{1}+a_{2}+a_{3}$$

$$s_{4} = a_{1}+a_{2}+a_{3}+a_{4}$$

$$s_{5} = a_{1}+a_{2}+a_{3}+a_{4}+a_{5}$$

$$\cdots$$

$$s_{n} = a_{1}+a_{2}+a_{3}+a_{4}+a_{5}+\cdots+a_{n} = \sum_{k=1}^{n} a_{k}$$.

$$\cdots$$

If indeed the infinite sum $$S = \sum_{k=1}^{\infty} a_{k}$$ makes sense, then we expect that the partial sum $$s_{n} = \sum_{k=1}^{n} a_{k}$$ is a very good approximation to S when n is large. Moreover, the larger n gets, the closer $$s_{n}$$ should be to S. In other words, the sequence $$s_{1}, s_{2}, s_{3}, s_{4}, s_{5}, \cdots$$ of partial sums should converge to S. This leads to our main definition. We say that an infinite series converges if its sequence of partial sums converges.

Definition 13.7

A series $$\sum_{k=1}^{\infty} a_{k}$$ converges to a real number S if its sequence of partial sums $$\{s_{n}\}$$ converges to S. In this case we say $$\sum_{k=1}^{\infty} a_{k} = S$$. We say $$\sum_{k=1}^{\infty} a_{k}$$ diverges if the sequence $$\{s_{n}\}$$ diverges. In this case $$S = \sum_{k=1}^{\infty} a_{k}$$ does not make sense as a sum or does not sum to a finite number.

Example 13.10

Prove that $$\sum_{k=1}^{\infty} \frac{1}{2^k} = 1$$.

proof. Consider the partial sum $$s_{n} = \frac{1}{2^1}+\frac{1}{2^2}+\frac{1}{2^3}+\cdots+\frac{1}{2^n}$$. We can get a neat formula for $$s_{n}$$ by noting $$s_{n} = 2s_{n}-s_{n}$$. Then simplify and cancel like terms:

$$s_{n} = 2s_{n}-s_{n} = 2(\frac{1}{2^1}+\frac{1}{2^2}+\frac{1}{2^3}+\cdots+\frac{1}{2^{n-1}}+\frac{1}{2^n})-(\frac{1}{2^1}+\frac{1}{2^2}+\frac{1}{2^3}+\cdots+\frac{1}{2^{n-1}}+\frac{1}{2^n})$$

$$= (\frac{2}{2^1}+\frac{2}{2^2}+\frac{2}{2^3}+\cdots+\frac{2}{2^{n-1}}+\frac{2}{2^n})-(\frac{1}{2^1}+\frac{1}{2^2}+\frac{1}{2^3}+\cdots+\frac{1}{2^{n-1}}+\frac{1}{2^n})$$

$$= (1+\frac{1}{2^1}+\frac{1}{2^2}+\cdots+\frac{1}{2^{n-2}}+\frac{1}{2^1})-(\frac{1}{2^1}+\frac{1}{2^2}+\frac{1}{2^3}+\cdots+\frac{1}{2^{n-1}}+\frac{1}{2^n})$$

$$= 1-\frac{1}{2^n}$$

Thus $$s_{n} = 1-\frac{1}{2^n}$$, so the sequence of partial sums is $$\{s_{n}\} = \{1-\frac{1}{2^n}\}$$, which converges to 1 by Exercise 13.7.4. Definition 13.7 yields $$\sum_{k=1}^{\infty} \frac{1}{2^k} = 1$$.

Despite the previous example, in practice definitions 13.7 and 13.5 are rarely used to prove that a particular sequence or series converges to a particular number. Instead we tend to use a multitude of convergence tests that are covered in a typical calculus course. Examples of such tests include the comparison test, the ratio test, the root test and the alternating series test. You learned how to use these tests and techniques in your calculus course, though that course may not have actually proved that the tests were valid. The point of our present discussion is that definitions 13.7 and 13.5 can be used to prove the tests. To underscore this point, this section’s exercises ask you to prove several convergence tests.

By way of illustration, we close with a proof of a theorem that leads to a test for divergence.

Theorem 13.11

If $$\sum_{k=1}^{\infty} a_{k}$$ converges, then the sequence $$\{a_{n}\}$$ converges to 0.

Proof. We use direct proof. Suppose $$\sum_{k=1}^{\infty} a_{k}$$ converges, and say $$\sum_{k=1}^{\infty} a_{k} = S$$. Then by Definition 13.7, the sequence of partial sums $$s_{n}$$ converges to S. From this, Definition 13.5 says that for any $$\epsilon > 0$$ there is an $$N \in \mathbb{N}$$ for which $$n > N$$ implies $$|s_{n}-S| < \epsilon$$. Thus also $$n-1 > N$$ implies $$|s_{n-1}-S|< \epsilon$$.

We need to show that $$\{a_{n}\}$$ converges to 0. So take $$\epsilon > 0$$. By the previous paragraph, there is an $$N' \in \mathbb{N}$$ for which $$n > N′$$ implies $$|s_{n}-S| < \frac{\epsilon}{2}$$ and $$|s_{n-1}-S| < \frac{\epsilon}{2}$$. Notice that $$a_{n} = s_{n}-s_{n-1}$$ for any $$n > 2$$. So if $$n>N$$ we have

$$|a_{n}-0| = |s_{n}-s_{n-1}| = |(s_{n}-S)-(s_{n-1}-S)| \le |s_{n}-S|+|s_{n-1}-S| < \frac{\epsilon}{2}+\frac{\epsilon}{2} = \epsilon$$.

Therefore, by Definition 13.5, the sequence $$\{a_{n}\}$$ converges to 0.

The contrapositive of this theorem is a convenient test for divergence:

Corollary 13.1 (Divergence test)

If $$\{a_{n}\}$$ diverges, or if it converges to a non-zero number, then $$\sum_{k=1}^{\infty} a_{k}$$ diverges.

For example, according to the divergence test, the series $$\sum_{k=1}^{\infty} (1-\frac{1}{k})$$ diverges, because the sequence $$\{1-\frac{1}{n}\}$$ converges to 1. Also,

$$\sum_{k=1}^{\infty} \frac{(-1)^{k+1}(k+1)}{k}$$ diverges because $$\frac{(-1)^{k+1}(k+1)}{k}$$ diverges. (See Example 13.9 on page 263.)

The divergence test gives only a criterion for deciding if a series diverges. It says nothing about convergence. If $$\{a_{n}\}$$ converges to 0, then $$\sum_{k=1}^{\infty} a_{k}$$ may or may not converge, depending on the particular series. Certainly if $$\sum_{k=1}^{\infty} a_{k}$$ converges, then $$\{a_{n}\}$$ converges to 0, by Theorem 13.11. But $$\{a_{n}\}$$ converging to 0 does not necessarily mean that $$\sum_{k=1}^{\infty} a_{k}$$ converges. A significant example of this is the so-called harmonic series:

$$\sum_{k=1}^{\infty} \frac{1}{k} = 1+\frac{1}{2}+\frac{1}{3}+\frac{1}{4}+\frac{1}{5}+\frac{1}{6}+\cdots$$.

According to Exercise 21 in Chapter 10, if we go out as far as $$2^n$$ terms, then the $$2^{n}$$th partial sum satisfies

$$s_{2^n} = \frac{1}{1}+\frac{1}{2}+\frac{1}{3}+\frac{1}{4}+\frac{1}{2^{n}-1}+\frac{1}{2^n} \ge 1+\frac{n}{2}$$.

Because $$1+\frac{n}{2}$$ grows arbitrarily large as n increases, the sequence of partial sums diverges to $$\infty$$. Consequently the harmonic series diverges.

## Exercise

Use Definition 13.7 (and Definition 13.5, as needed) to prove the following results. Solutions for these exercises are not included in the back of the book, for they can be found in most good calculus texts. In the exercises we abbreviate $$\sum_{k=1}^{\infty} a_{k}$$ as $$\sum a_{k}$$.

Exercise $$\PageIndex{1}$$

A geometric series is one having the form $$a+ar+ar^{2}+ar^{3}+\cdots$$, where $$a, r \in \mathbb{R}$$. (The first term in the sum is a, and beyond that, the kth term is r times the previous term.) Prove that if $$|r| < 1$$, then the series converges to $$\frac{a}{1-r}$$. Also, if $$a \ne 0$$ and $$|r| \ge 1$$, then the series diverges. (If you need guidance, you may draw inspiration from Example 13.10, which concerns a geometric series with $$a = r = \frac{1}{2}$$.)

Exercise $$\PageIndex{2}$$

Prove the comparison test: Suppose $$\sum a_{k}$$ and $$\sum b_{k}$$ are series. If $$0 \le a_{k} \le b_{k}$$ for each k, and $$\sum b_{k}$$ converges, then $$\sum a_{k}$$ converges. Also, if $$0 \le b_{k} \le a_{k}$$ for each k, and $$\sum b_{k}$$ diverges, then $$\sum a_{k}$$ diverges.

Exercise $$\PageIndex{3}$$

Prove the limit comparison test: Suppose $$\sum a_{k}$$ and $$\sum b_{k}$$ are series for which $$a_{k}, b_{k} > 0$$ for each k. If $$\lim_{n \rightarrow \infty} \frac{a_{k}}{b_{k}} = 0$$ and $$b_{k}$$ converges, then $$a_{k}$$ converges. (Your proof may use any of the above exercises.)

Exercise $$\PageIndex{4}$$

Prove the absolute convergence test: Let $$\sum a_{k}$$ be a series. If $$\sum |a_{k}|$$ converges, then $$\sum a_{k}$$ converges. (Your proof may use any of the above exercises.)

Exercise $$\PageIndex{5}$$

Prove the ratio test: Given a series $$\sum a_{k}$$ with each $$a_{k}$$ positive, if $$\lim_{n \rightarrow \infty} \frac{a_{k+1}}{a_{k}} = L < 1$$, then $$\sum a_{k}$$ converges. Also, if $$L > 1$$, then $$\sum a_{k}$$ diverges. (Your proof may use any of the above exercises.)