1.6: Precision and GPE
- Page ID
- 153110
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)7
Precision and GPE
Morgan Chase
When someone is selling a used car, its mileage might be listed as 80,000 miles or 82,000 miles because a buyer will want to know the approximate mileage but doesn’t need an exact value. If you buy the car, however, you’ll need to know the mileage to the nearest mile when you’re completing the registration paperwork.
Precision
The precision of a number is the place value of the rightmost significant figure. For example, \(82,000\) is precise to the thousands place, \(81,999\) is precise to the ones place, and something like \(81,999.2\) would be precise to the tenths place.
Identify the precision (i.e., the place value of the rightmost significant figure) of each number.
- \(29,000\)
- \(29,\overline{0}00\)
- \(29,030\)
- \(0.037\)
- \(0.0307\)
- \(0.03070\)
Precision-Based Rounding
In Module 3, we used precision-based rounding because we were rounding to a specified place value; for example, rounding to the nearest tenth. Let’s practice this with overbars and trailing zeros.
Precision-based rounding:
- Locate the rounding digit in the place to which you are rounding.
- Look at the test digit directly to the right of the rounding digit.
- If the test digit is 5 or greater, increase the rounding digit by 1 and drop all digits to its right. If the test digit is less than 5, keep the rounding digit the same and drop all digits to its right.
Remember, when the rounding digit of a whole number is a \(9\) that gets rounded up to a \(0\), we must write an overbar above that \(0\).
Also, when the rounding digit of a decimal number is a \(9\) that gets rounded up to a \(0\), we must include the \(0\) in that decimal place.
Round each number to the indicated place value. Be sure to include an overbar or trailing zeros if necessary.
- \(81,999\) (thousands)
- \(81,999\) (hundreds)
- \(81,999\) (tens)
- \(0.5996\) (tenths)
- \(0.5996\) (hundredths)
- \(0.5996\) (thousandths)
Precision when Adding and Subtracting
Suppose the attendance at a large event is estimated at \(25,000\) people, but then you see \(3\) people leave. Is the new estimate \(24,997\)? No, because the original estimate was precise only to the nearest thousand. We can’t start with an imprecise number and finish with a more precise number. If we estimated that \(1,000\) people had left, then we could revise our attendance estimate to \(24,000\) because this estimate maintains the same level of precision as our original estimate.
When adding or subtracting numbers with different levels of precision, the answer must be rounded to the same precision as the least precise of the original numbers.Don’t round off the original numbers; do the necessary calculations first, then round the answer as your last step.
Add or subtract as indicated. Round to the appropriate level of precision.
- Find the combined weight of four packages with the following weights: \(9.7\) lb, \(13.0\) lb, \(10.5\) lb, \(6.1\) lb.
- Find the combined weight of four packages with the following weights: \(9.7\) lb, \(13\) lb, \(10.5\) lb, \(6.1\) lb.
- While purchasing renter’s insurance, Chandra estimates the value of her insurable possessions at \($10,200\). After selling some items valued at \($375\), what would be the revised estimate?
- Chandra knows that she has roughly \($840\) in her checking account. After using her debit card to make two purchases of \($25.95\) and \($16.38\), how much would she have left in her account?
Before we move on, let’s circle back to multiplication and division again. If you are multiplying by an exact number, you can consider this a repeated addition. For example, suppose you measure the weight of an object to be \(4.37\) ounces and you want to know the weight of three of these objects; multiplying \(4.37\) times \(3\) is the same as adding \(4.37 + 4.37 + 4.37 = 13.11\) ounces. The answer is still precise to the hundredths place. When working with an exact number, we can assume that it has infinitely many significant figures. (Treat exact numbers like royalty; their accuracy is perfect and it would be an insult to even question it.)
Greatest Possible Measurement Error (GPE)
Suppose you are weighing a dog with a scale that displays the weight rounded to the nearest pound. If the scale says Sir Barks-A-Lot weighs \(23\) pounds, he could weigh anywhere from \(22.5\) pounds to almost \(23.5\) pounds. The true weight could be as much as \(0.5\) pounds above or below the measured weight, which we could write as \(23\pm0.5\).
Now suppose you are weighing Sir Barks-A-Lot with a scale that displays the weight rounded to the nearest tenth of a pound. If the scale says Sir Barks-A-Lot weighs \(23.0\) pounds, we now know that he could weigh anywhere from \(22.95\) pounds to almost \(23.05\) pounds. The true weight could be as much as \(0.05\) pounds above or below the measured weight, which we could write as \(23.0\pm0.05\).
As we increase the level of precision in our measurement, we decrease the greatest possible measurement error or GPE. The GPE is always one half the precision; if the precision is to the nearest tenth, \(0.1\), the GPE is half of one tenth, or five hundredths, \(0.05\). The GPE will always be a \(5\) in the place to the right of the place value of the number’s precision.
Another way to think about the GPE is that it gives the range of values that would round off to the number in question. \(23\pm0.5\) tells us a lower value and an upper value. \(23-0.5=22.5\) is the lowest weight that would round up to \(23\), and \(23+0.5=23.5\) is the upper limit of the weights that would round down to \(23\). (Yes, 23.5 technically would round up to 24, but it is easier to just say \(23.5\) instead of \(23.49\).) Using inequalities, we could represent \(23\pm0.5\) as the range of values \(22.5\leq\text{weight}<23.5\).
The attendance at a Portland Thorns match is estimated to be \(14,000\) people.
- What is the precision of this estimate?
- What is the greatest possible error in this estimate?
A roll of plastic sheeting is \(0.00031\) inches thick.
- What is the precision of this measurement?
- What is the greatest possible error in this measurement?
Plastic sheeting \(0.00031\) inches thick is referred to as \(0.31\) mil.
- What is the precision of this measurement, in mils?
- What is the greatest possible measurement error, in mils?
Summary of Accuracy, Precision, GPE
Here is a summary of the important terms from Modules 5 & 6. It is easy to get them mixed up, but remembering that “precision” and “place value” both start with “p” can be helpful.
Summary of Terms
Significant figures: the digits in a number that we trust to be correct
Accuracy: the number of significant figures
When multiplying or dividing, we use the accuracy to round the result.
Precision: the place value of the rightmost significant digit
Greatest possible measurement error (GPE): one half the precision
When adding or subtracting, we use the precision to round the result.
Google Maps says that the driving distance from CCC’s main campus to the Canadian border, rounded to the nearest mile, is \(300\) miles.
- Write the distance with an overbar showing the correct precision.
- What is the precision?
- What is the GPE?
Google Maps says that the driving time, rounded to the nearest minute, is \(5\) hours and \(34\) minutes.
- What is the precision of this estimate?
- What is the GPE of this estimate?
Of course, the traffic conditions will change during the trip, making the estimate of \(5\) hours and \(34\) minutes unrealistically precise. Let’s assume that the drive will take 5.5 hours.
- What is the accuracy of this estimate?
- What is the accuracy of the distance?
- Calculate the average speed of the vehicle, rounded appropriately.
- Why did we need to consider the accuracy instead of the precision for this calculation?
Exercise Answers