3.3: Global Optimization
- Page ID
- 107812
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)- What are the differences between finding relative extreme values and global extreme values of a function?
- How is the process of finding the global maximum or minimum of a function over the function's entire domain different from determining the global maximum or minimum on a restricted domain?
- For a function that is guaranteed to have both a global maximum and global minimum on a closed, bounded interval, what are the possible points at which these extreme values occur?
We have seen that we can use the first derivative of a function to determine where the function is increasing or decreasing, and the second derivative to know where the function is concave up or concave down. This information helps us determine the overall shape and behavior of the graph, as well as whether the function has relative extrema.
Remember the difference between a relative maximum and a global maximum: there is a relative maximum of \(f\) at \(x = p\) if \(f(p) \ge f(x)\) for all \(x\) near \(p\text{,}\) while there is a global maximum at \(p\) if \(f(p) \ge f(x)\) for all \(x\) in the domain of \(f\text{.}\)
For instance, in Figure \(\PageIndex{1}\), we see a function \(f\) that has a global maximum at \(x = c\) and a relative maximum at \(x = a\text{,}\) since \(f(c)\) is greater than \(f(x)\) for every value of \(x\text{,}\) while \(f(a)\) is only greater than the value of \(f(x)\) for \(x\) near \(a\text{.}\) Since the function appears to decrease without bound, \(f\) has no global minimum, though clearly \(f\) has a relative minimum at \(x = b\text{.}\)
Our emphasis in this section is on finding the global extreme values of a function (if they exist), either over its entire domain or on some restricted portion.
Let \(f(x) = 2 + \frac{3}{1+(x+1)^2}\text{.}\)
- Determine all of the critical numbers of \(f\text{.}\)
- Construct a first derivative sign chart for \(f\) and thus determine all intervals on which \(f\) is increasing or decreasing.
- Does \(f\) have a global maximum? If so, why, and what is its value and where is the maximum attained? If not, explain why.
- Determine \(\lim_{x \to \infty} f(x)\) and \(\lim_{x \to -\infty} f(x)\text{.}\)
- Explain why \(f(x) \gt 2\) for every value of \(x\text{.}\)
- Does \(f\) have a global minimum? If so, why, and what is its value and where is the minimum attained? If not, explain why.
Global Optimization
In Figure \(\PageIndex{1}\) and Preview Activity \(\PageIndex{1}\), we were interested in finding the global minimum and global maximum for \(f\) on its entire domain. At other times, we might focus on some restriction of the domain.
For example, rather than considering \(f(x) = 2 + \frac{3}{1+(x+1)^2}\) for every value of \(x\text{,}\) perhaps instead we are only interested in those \(x\) for which \(0 \le x \le 4\text{,}\) and we would like to know which values of \(x\) in the interval \([0,4]\) produce the largest possible and smallest possible values of \(f\text{.}\) We are accustomed to critical numbers playing a key role in determining the location of extreme values of a function; now, by restricting the domain to an interval, it makes sense that the endpoints of the interval will also be important to consider, as we see in the following activity. When limiting ourselves to a particular interval, we will often refer to the absolute maximum or minimum value, rather than the global maximum or minimum.
Let \(g(x) = \frac{1}{3}x^3 - 2x + 2\text{.}\)
- Find all critical numbers of \(g\) that lie in the interval \(-2 \le x \le 3\text{.}\)
- Use a graphing utility to construct the graph of \(g\) on the interval \(-2 \le x \le 3\text{.}\)
- From the graph, determine the \(x\)-values at which the absolute minimum and absolute maximum of \(g\) occur on the interval \([-2,3]\text{.}\)
- How do your answers change if we instead consider the interval \(-2 \le x \le 2\text{?}\)
- What if we instead consider the interval \(-2 \le x \le 1\text{?}\)
In Activity \(\PageIndex{2}\), we saw how the absolute maximum and absolute minimum of a function on a closed, bounded interval \([a,b]\text{,}\) depend not only on the critical numbers of the function, but also on the values of \(a\) and \(b\text{.}\) These observations demonstrate several important facts that hold more generally. First, we state an important result called the Extreme Value Theorem.
If \(f\) is a continuous function on a closed interval \([a,b]\text{,}\) then \(f\) attains both an absolute minimum and absolute maximum on \([a,b]\text{.}\) That is, for some value \(x_m\) such that \(a \le x_m \le b\text{,}\) it follows that \(f(x_m) \le f(x)\) for all \(x\) in \([a,b]\text{.}\) Similarly, there is a value \(x_M\) in \([a,b]\) such that \(f(x_M) \ge f(x)\) for all \(x\) in \([a,b]\text{.}\) Letting \(m = f(x_m)\) and \(M = f(x_M)\text{,}\) it follows that \(m \le f(x) \le M\) for all \(x\) in \([a,b]\text{.}\)
The Extreme Value Theorem tells us that on any closed interval \([a,b]\text{,}\) a continuous function has to achieve both an absolute minimum and an absolute maximum. The theorem does not tell us where these extreme values occur, but rather only that they must exist. As we saw in Activity \(\PageIndex{1}\).2, the only possible locations for relative extremes are at the endpoints of the interval or at a critical number.
Thus, we have the following approach to finding the absolute maximum and minimum of a continuous function \(f\) on the interval \([a,b]\text{:}\)
- find all critical numbers of \(f\) that lie in the interval;
- evaluate the function \(f\) at each critical number in the interval and at each endpoint of the interval;
- from among those function values, the smallest is the absolute minimum of \(f\) on the interval, while the largest is the absolute maximum.
Find the exact absolute maximum and minimum of each function on the stated interval.
- \(h(x) = xe^{-x}\text{,}\) \([0,3]\)
- \(p(t) = \sin(t) + \cos(t)\text{,}\) \([-\frac{\pi}{2}, \frac{\pi}{2}]\)
- \(q(x) = \frac{x^2}{x-2}\text{,}\) \([3,7]\)
- \(f(x) = 4 - e^{-(x-2)^2}\text{,}\) \((-\infty, \infty)\)
- \(h(x) = xe^{-ax}\text{,}\) \([0, \frac{2}{a}]\) (\(a \gt 0\))
- \(f(x) = b - e^{-(x-a)^2}\text{,}\) \((-\infty, \infty)\text{,}\) \(a, b \gt 0\)
The interval we choose has nearly the same influence on extreme values as the function under consideration. Consider, for instance, the function pictured in Figure \(\PageIndex{2}\).
In sequence, from left to right, the interval under consideration is changed from \([-2,3]\) to \([-2,2]\) to \([-2,1]\text{.}\)
- On the interval \([-2,3]\text{,}\) there are two critical numbers, with the absolute minimum at one critical number and the absolute maximum at the right endpoint.
- On the interval \([-2,2]\text{,}\) both critical numbers are in the interval, with the absolute minimum and maximum at the two critical numbers.
- On the interval \([-2,1]\text{,}\) just one critical number lies in the interval, with the absolute maximum at one critical number and the absolute minimum at one endpoint.
Remember to consider only the critical numbers that lie within the interval.
Moving toward applications
We conclude this section with an example of an applied optimization problem. It highlights the role that a closed, bounded domain can play in finding absolute extrema.
A 20 cm piece of wire is cut into two pieces. One piece is used to form a square and the other to form an equilateral triangle. How should the wire be cut to maximize the total area enclosed by the square and triangle? to minimize the area?
- Answer
-
We begin by sketching a picture that illustrates the situation. The variable in the problem is where we decide to cut the wire. We thus label the cut point at a distance \(x\) from one end of the wire, and note that the remaining portion of the wire then has length \(20-x\)
As shown in Figure \(\PageIndex{3}\), we see that the \(x\) cm of wire that is used to form the equilateral triangle with three sides of length \(\frac{x}{3}\text{.}\) For the remaining \(20-x\) cm of wire, the square that results will have each side of length \(\frac{20-x}{4}\text{.}\)
At this point, we note that there are obvious restrictions on \(x\text{:}\) in particular, \(0 \le x \le 20\text{.}\) In the extreme cases, all of the wire is being used to make just one figure. For instance, if \(x = 0\text{,}\) then all 20 cm of wire are used to make a square that is \(5 \times 5\text{.}\)
Now, our overall goal is to find the minimum and maximum areas that can be enclosed. Because the height of an equilateral triangle is \(\sqrt{3}\) times half the length of the base, the area of the triangle is
\[ A_{\Delta} = \frac{1}{2} bh = \frac{1}{2} \cdot \frac{x}{3} \cdot \frac{x\sqrt{3}}{6}\text{.} \nonumber \]
The area of the square is \(A_{\Box} = s^2 = \left( \frac{20-x}{4} \right)^2\text{.}\) Therefore, the total area function is
\[ A(x) = \frac{\sqrt{3}x^2}{36} + \left( \frac{20-x}{4} \right)^2\text{.} \nonumber \]Remember that we are considering this function only on the restricted domain \([0,20]\text{.}\)
Differentiating \(A(x)\text{,}\) we have
\[ A'(x) = \frac{\sqrt{3}x}{18} + 2\left( \frac{20-x}{4} \right)\left( -\frac{1}{4} \right) = \frac{\sqrt{3}}{18} x + \frac{1}{8}x - \frac{5}{2}\text{.} \nonumber \]When we set \(A'(x) = 0\text{,}\) we find that \(x = \frac{180}{4\sqrt{3}+9} \approx 11.3007\) is the only critical number of \(A\) in the interval \([0,20]\text{.}\)
Evaluating \(A\) at the critical number and endpoints, we see that
\(\displaystyle A\left(\frac{180}{4\sqrt{3}+9}\right) = \frac{\sqrt{3}(\frac{180}{4\sqrt{3}+9})^2}{4} + \left( \frac{20-\frac{180}{4\sqrt{3}+9}}{4} \right)^2 \approx 10.8741\) \(\displaystyle A(0) = 25\) \(\displaystyle A(20) = \frac{\sqrt{3}}{36}(400) = \frac{100}{9} \sqrt{3} \approx 19.2450\)Thus, the absolute minimum occurs when \(x \approx 11.3007\) and results in the minimum area of approximately \(10.8741\) square centimeters. The absolute maximum occurs when we invest all of the wire in the square (and none in the triangle), resulting in 25 square centimeters of area. These results are confirmed by a plot of \(y = A(x)\) on the interval \([0,20]\text{,}\) as shown in Figure \(\PageIndex{4}\).
A piece of cardboard that is \(10 \times 15\) (each measured in inches) is being made into a box without a top. To do so, squares are cut from each corner of the box and the remaining sides are folded up. If the box needs to be at least 1 inch deep and no more than 3 inches deep, what is the maximum possible volume of the box? what is the minimum volume? Justify your answers using calculus.
- Draw a labeled diagram that shows the given information. What variable should we introduce to represent the choice we make in creating the box? Label the diagram appropriately with the variable, and write a sentence to state what the variable represents.
- Determine a formula for the function \(V\) (that depends on the variable in (a)) that tells us the volume of the box.
- What is the domain of the function \(V\text{?}\) That is, what values of \(x\) make sense for input? Are there additional restrictions provided in the problem?
- Determine all critical numbers of the function \(V\text{.}\)
- Evaluate \(V\) at each of the endpoints of the domain and at any critical numbers that lie in the domain.
- What is the maximum possible volume of the box? the minimum?
Example \(\PageIndex{1}\) and Activity \(\PageIndex{4}\) illustrate standard steps that we undertake in almost every applied optimization problem: we draw a picture to demonstrate the situation, introduce one or more variables to represent quantities that are changing, find a function that models the quantity to be optimized, and then decide on an appropriate domain for that function. Once that is done, we are in the familiar situation of finding the absolute minimum and maximum of a function over a particular domain, so we apply the calculus ideas that we have been studying to this point in Chapter 3.
Summary
- To find relative extreme values of a function, we use a first derivative sign chart and classify all of the function's critical numbers. If instead we are interested in absolute extreme values, we first decide whether we are considering the entire domain of the function or a particular interval.
- In the case of finding global extremes over the function's entire domain, we again use a first or second derivative sign chart. If we are working to find absolute extremes on a restricted interval, then we first identify all critical numbers of the function that lie in the interval.
- For a continuous function on a closed, bounded interval, the only possible points at which absolute extreme values occur are the critical numbers and the endpoints. Thus, we simply evaluate the function at each endpoint and each critical number in the interval, and compare the results to decide which is largest (the absolute maximum) and which is smallest (the absolute minimum).