7.9: Conditional Probability and the Multiplication Rule
Learning Objectives
After completing this section, you should be able to:
- Calculate conditional probabilities.
- Apply the Multiplication Rule for Probability to compute probabilities.
Back in Example
, we constructed the following table (Figure 7.38) to help us find the probabilities associated with rolling two standard 6-sided dice:For example, 3 of these 36 equally likely outcomes correspond to rolling a sum of 10, so the probability of rolling a 10 is . However, if you choose to roll the dice one at a time, the probability of rolling a 10 will change after the first die comes to rest. For example, if the first die shows a 5, then the probability of rolling a sum of 10 has jumped to —the event will occur if the second die also shows a 5, which is 1 of 6 equally likely outcomes for the second die. If instead the first die shows a 3, then the probability of rolling a sum of 10 drops to 0—there are no outcomes for the second die that will give us a sum of 10.
Understanding how probabilities can shift as we learn new information is critical in the analysis of our second type of compound events: those built with “and.” This section will explain how to compute probabilities of those compound events.
Conditional Probabilities
When we analyze experiments with multiple stages, we often update the probabilities of the possible final outcomes or the later stages of the experiment based on the results of one or more of the initial stages. These updated probabilities are called conditional probabilities .
In other words, if is a possible outcome of the first stage in a multistage experiment, then the probability of an event conditional on (denoted , read “the probability of given ”) is the updated probability of under the assumption that occurred.
In the example that opened this section, we might consider rolling two dice as a multistage experiment: rolling one, then the other. If we define to be the event “roll a sum of 10,” to be the event “first die shows 5,” and to be the event “first die shows 3,” then we computed , , and .
- April is playing a coin-flipping game with Ben. She will flip a coin 3 times. If the coin lands on heads more than tails, April wins; if it lands on tails more than heads, Ben wins. Let be the event “April wins,” be “first flip is heads,” and be “first flip is tails.” Compute , , and .
- You are about to draw 2 cards without replacement from a deck containing only these 10 cards: , , , , , , , , , . We’ll define the following events: is “both cards are the same rank,” is “first card is an ace,” and is “first card is a king.” Compute and .
- Jim’s sock drawer contains 5 black socks and 3 blue socks. To avoid waking his partner, Jim doesn’t want to turn the lights on, so he puts on 2 socks at random. Let be the event “Jim’s 2 socks match,” let be the event “the sock on Jim’s left foot is black,” and let be the event “the sock on Jim’s left foot is blue.” Compute , , and .
- Answer
-
-
Step 1.
The sample space is {HHH, HHT, HTH, THH, HTT, THT, TTH, TTT}. The event
consists of the first 4 of those outcomes: HHH, HHT, HTH, and THH. Thus,
.
Step 2. Now, let’s compute . We are assuming the result of the first flip is heads. That leaves us with 4 possible outcomes: HHH, HHT, HTH, and HTT. Of those, April wins 3 (HHH, HHT, HTH) and loses one (HTT). So, .
Step 3. If the result of the first flip is instead tails, the 4 possible outcomes are THH, THT, TTH, and TTT. Of those, April wins 1 (THH) and loses 3 (THT, TTH, TTT). So, .
-
Step 1.
If the event
happens, then 1 of the 4 aces is drawn first; the remaining cards in the deck are 3 aces, 2 kings, 2 queens, and 2 jacks. In order for the event
to occur, the second card drawn has to be an ace. Since there are 3 aces among the remaining 9 cards,
.
Step 2. If the event happens instead, then the first card drawn is a king. That leaves 4 aces, 1 king, 2 queens, and 2 jacks in the deck. Under the assumption that the first card is a king, the event will occur only if the second card is also a king. Since only one of the remaining 9 cards is a king, we have .
-
Step 1.
We can view the event
as a compound event using “or”: both socks are blue or both socks are black. Let’s compute the probability that both socks are blue using combinations. We’re choosing 2 socks from a group of 8; 3 of the 8 are blue. So,
. Similarly,
. Therefore, since these events are mutually exclusive, we can use the Addition Rule:
.
Step 2. If the sock on Jim’s left foot is black (i.e., occurred), then there are 4 remaining black socks of the 7 in the drawer. So, .
Step 3. If the sock on Jim’s left foot is blue ( occurred), then there are 2 blue socks among the 7 remaining in the drawer. So, .
-
Step 1.
The sample space is {HHH, HHT, HTH, THH, HTT, THT, TTH, TTT}. The event
consists of the first 4 of those outcomes: HHH, HHT, HTH, and THH. Thus,
.
You are about to roll a special 6-sided die that has both a colored letter and a colored number on each face. The faces are labeled with: a red 1 and a blue A, a red 1 and a green A, an orange 1 and a green B, an orange 2 and a red C, a purple 3 and a brown D, an orange 4 and a blue E. Find the given conditional probabilities:
\(P({\text{the letter is a vowel}}{|}{\text{the number is orange}})\)
\(P\,({\text{the number is 1}}{|}{\text{the number is red}})\)
\(P\,({\text{the number is red}}{|}{\text{the number is 1}})\)
In Tree Diagrams, Tables, and Outcomes, we introduced the concept of dependence between stages of a multistage experiment. We stated at the time that two stages were dependent if the result of one stage affects the other stage. We explained that dependence in terms of the sample space, but sometimes that dependence can be a little more subtle; it’s more properly understood in terms of conditional probabilities. Two stages of an experiment are dependent if for some outcome of the second stage and outcome of the first stage .
In his book How Not to Be Wrong , Jordan Ellenberg recounts this anecdote: During World War II, the American military wanted to add additional armor plating to bomber aircraft, in order to reduce the chances that they get shot down. So, they collected data on planes after returning from missions. The data showed that the fuselage, wings, and fuel system had many more bullet holes (per unit area) than the engine compartments, so the military brass wanted to add additional armor to the parts of the plane that were hit most often. Luckily, before they added the armor to the planes, they asked for a second opinion. Abraham Wald, a Jewish mathematician who had fled the rising Nazi regime, pointed out that it was far more important that the armor plating be added to areas where there were fewer bullet holes. Why? The planes they were studying had already completed their missions, so the military was essentially looking at conditional probabilities: the probability of suffering a bullet strike, given that the plane made it back safely. More bullet holes in an area on the plane indicated that was a region that wasn’t as important for the plane’s survival!
Compound Events Using “And” and the Multiplication Rule
For multistage experiments, the outcomes of the experiment as a whole are often stated in terms of the outcomes of the individual stages. Commonly, those statements are joined with “and.” For example, in the sock drawer example just above, one outcome might be “the left sock is black and the right sock is blue.” As with “or” compound events, these probabilities can be computed with basic arithmetic.
Multiplication Rule for Probability: If and are events associated with the first and second stages of an experiment, then .
In The Addition Rule for Probability, we considered probabilities of events connected with “and” in the statement of the Inclusion/Exclusion Principle. These two scenarios are different; in the statement of the Inclusion/Exclusion Principle, the events connected with “and” are both events associated with the same single-stage experiment (or the same stage of a multistage experiment). In the Multiplication Rule, we’re looking at events associated with different stages of a multistage experiment.
You are president of a club with 10 members: 4 seniors, 3 juniors, 2 sophomores, and 1 first-year. You need to choose 2 members to represent the club on 2 college committees. The first person selected will be on the Club Awards Committee and the second will be on the New Club Orientation Committee. The same person cannot be selected for both. You decide to select these representatives at random.
- What is the probability that a senior is chosen for both positions?
- What is the probability that a junior is chosen first and a sophomore is chosen second?
- What is the probability that a sophomore is chosen first and a senior is chosen second?
- Answer
-
- We need the probability that a senior is chosen first and a senior is chosen second. These are two stages of a multistage experiment, so we’ll apply the Multiplication Rule for Probability: Since there are 4 seniors among the 10 members, . Next, assuming a senior is chosen first, there are 3 seniors among the 9 remaining members. So, . Putting this all together, we get .
- There are 3 juniors among the 10 members, so . Assuming a junior is chosen first, there are 2 sophomores among the remaining 9 members, so . Thus, using the Multiplication Rule for Probability, we have .
- The probability that a sophomore is chosen first is , and the probability that a senior is chosen second given that a sophomore was chosen first is . Thus, using the Multiplication Rule for Probability, we have: .
You’re drawing 2 cards in order from a deck containing only the cards \({\text{A}}♡\), \({\text{A}}♣\), \({\text{K}}♠\), \(10♡\), \(9♡\), \(9♠\), \(9\diamondsuit\), and \(6♣\). Compute the following:
\(P({\text{draw}}\,{\text{a}}\,{\text{♡}}\,{\text{first}}\,{\text{and a}}\,{\text{♠}}\,{\text{second}})\)
\(P({\text{draw}}\,{\text{a}}\,{\text{9}}\,{\text{first}}\,{\text{and}}\,{\text{a}}\,{\text{6}}\,{\text{second}})\)
\(P({\text{draw}}\,{\text{two}}\,{\text{hearts}})\)
One of the most famous problems in probability theory is the Birthday Problem, which has to do with shared birthdays in a large group. To make the analysis easier, we’ll ignore leap days, and assume that the probability of being born on any given date is . Now, if you have 366 people in a room, we’re guaranteed to have at least one pair of people who share a single birthday. Imagine filling the room by first admitting someone born on January 1, then someone born on January 2, and so on… The 365th person admitted would be born on December 31. If you add one more person to the room, that person’s birthday would have to match someone else’s.
Let’s look at the other end of the spectrum. If you choose two people at random, what is the probability that they share a birthday? As with many probability questions, this is best addressed by find out the probability that they do not share a birthday. The first person’s birthday can be anything (probability 1), and the second person’s birthday can be anything other than the first person’s birthday (probability ). The probability that they have different birthdays is . So, the probability that they share a birthday is .
What if we have three people? The probability that they all have different birthdays can be obtained by extending our previous calculation: The probability that two people have different birthdays is , so if we add a third to the mix, the probability that they have a different birthday from the other two is . So, the probability that all three have different birthdays is , and thus the probability that there’s a shared birthday in the group is .
The big question is this: How many people do we need in the room to have the probability of a shared birthday greater than ? Make a guess, then with a partner keep adding hypothetical people to the group and computing probabilities until you get there!
It is often useful to combine the rules we’ve seen so far with the techniques we used for finding sample spaces. In particular, trees can be helpful when we want to identify the probabilities of every possible outcome in a multistage experiment. The next example will illustrate this.
The board game Clue uses a deck of 21 cards: 6 suspects, 6 weapons, and 9 rooms. Suppose you are about to draw 2 cards from this deck. There are 6 possible outcomes for the draw: 2 suspects, 2 weapons, 2 rooms, 1 suspect and 1 weapon, 1 suspect and 1 room, or 1 weapon and 1 room. What are the probabilities for each of these outcomes?
- Answer
-
Step 1: Let’s start by building a tree diagram that illustrates both stages of this experiment. Let’s use S, W, and R to indicate drawing a suspect, weapon, and room, respectively (Figure
).
Step 2: We want to start computing probabilities, starting with the first stage. The probability that the first card is a suspect is . The probability that the first card is a weapon is the same: . Finally, the probability that the first card is a room is .
Step 3: Let’s incorporate those probabilities into our tree: label the edges going into each of the nodes representing the first-stage outcomes with the corresponding probabilities (Figure
).Note that the sum of the probabilities coming out of the initial node is 1; this should always be the case for the probabilities coming out of any node!
Step 4: Let’s look at the case where the first card is a suspect. There are 3 edges emanating from that node (leading to the outcomes SS, SW, and SR). We’ll label those edges with the appropriate conditional probabilities, under the assumption that the first card is a suspect. First, there are 5 remaining suspect cards among the 20 left in the deck, so . Using similar reasoning, we can compute and .
Step 5: Checking our work, we see that the sum of these 3 probabilities is again equal to 1. Let’s add those to our tree (Figure
).Step 6: Let’s continue filling in the conditional probabilities at the other nodes, always checking to make sure the sum of the probabilities coming out of any node is equal to 1 (Figure
).Step 7: We can compute the probability of landing on any final node by multiplying the probabilities along the path we would take to get there. For example, the probability of drawing a suspect first and a weapon second (i.e., ending up on the node labeled “SW”) is
Step 8: Let’s fill in the rest of the probabilities (Figure
).
Step 9:
A helpful feature of tree diagrams is that the final outcomes are always mutually exclusive, so the Addition Rule can be directly applied. For example, the probability of drawing one suspect and one room (in any order) would be
| Outcome | Probability |
|---|---|
| 2 suspects | |
| 2 weapons | |
| 2 rooms | |
| 1 suspect and 1 weapon | |
| 1 suspect and 1 room | |
| 1 weapon and 1 room |
Checking once again, the sum of these 6 probabilities is 1, as expected.
You are about to perform the following two-stage experiment. First, you will flip a coin. If the result is heads, roll a standard 6-sided die. If the result of the coin flip is tails, roll a modified 6-sided die with faces labeled 1, 1, 1, 2, 2, 3. Use a tree diagram to find the probability of rolling each of the numbers from 1 to 6.
On the original version of the game show Let’s Make a Deal , originally hosted by Monty Hall and now hosted by Wayne Brady, one contestant was chosen to play a game for the grand prize of the day (often a car). Here’s how it worked: On the stage were three areas concealed by numbered curtains. The car was hidden behind one of the curtains; the other two curtains hid worthless prizes (called “Zonks” on the show). The contestant would guess which curtain concealed the car. To build tension, Monty would then reveal what was behind one of the other curtains, which was always one of the Zonks (Since Monty knew where the car was hidden, he always had at least one Zonk curtain that hadn’t been chosen that he could reveal). Monty then turned to the contestant and asked: “Do you want to stick with your original choice, or do you want to switch your choice to the other curtain?” What should the contestant do? Does it matter?
With a partner or in a small group, simulate this game. You can do that with a small candy (the prize) hidden under one of three cups, or with three playing cards (just decide ahead of time which card represents the “Grand Prize”). One person plays the host, who knows where the prize is hidden. Another person plays the contestant and tries to guess where the prize is hidden. After the guess is made, the host should reveal a losing option that wasn’t chosen by the contestant. The contestant then has the option to stick with the original choice or switch to the other, unrevealed option. Play about 20 rounds, taking turns in each role and making sure that both contestant strategies (stick or switch) are used equally often. After each round, make a note of whether the contestant chose “stick” or “switch” and whether the contestant won or lost. Find the empirical probability of winning under each strategy. Then, see if you can use tree diagrams to verify your findings.
Check Your Understanding
For the following exercises, you are rolling two 6-sided dice, each of which has 3 orange faces, 2 green faces, and 1 blue face.
- What is the probability of rolling 2 orange faces?
- What is the probability of rolling 2 green faces?
- What is the probability of rolling 1 orange and 1 green face (in any order)?
- For the following exercises, you are about to draw 2 cards at random (without replacement) from a deck containing only these 10 cards: \({\text{A}}♡\), \({\text{A}}♠\), \({\text{A}}♣\), \({\text{A}}\diamondsuit\), \({\text{K}}♠\), \({\text{K}}♣\), \({\text{Q}}♡\), \({\text{Q}}♠\), \({\text{J}}♡\), \({\text{J}}♠\).
- What is the probability of drawing 2 aces?
- What is the probability of drawing an ace first and a king second?
- What is the probability of drawing a \(\clubsuit\) and a \(\spadesuit\) (in any order)?