Skip to main content
SECTION 10.5 PROBLEM SET: CHAPTER REVIEW
-
Is the matrix given below a transition matrix for a Markov chain? Explain.
-
\(\left[\begin{array}{ccc}
.1 & .4 & .5 \\
.5 & -.3 & .8 \\
.3 & .4 & .3
\end{array}\right]\)
-
\(\left[\begin{array}{ccc}
.2 & .6 & .2 \\
0 & 0 & 0 \\
.3 & .4 & .5
\end{array}\right]\)
-
A survey of computer buyers indicates that if a person buys an Apple computer, there is an 80% chance that their next purchase will be an Apple, while owners of a Windows computer will buy an Windows computer again with a probability of .70. The buying habits of these consumers are represented in the transition matrix below.
-
Find the probability that a present owner of an Apple computer will buy a Windows computer as his next computer.
-
Find the probability that a present owner of an Apple computer will buy a Windows computer as his third computer.
-
Find the probability that a present owner of a Windows computer will buy a Windows computer as his fourth computer.
-
Professor Trayer either teaches Finite Math or Statistics each quarter. She never teaches Finite Math two consecutive quarters, but if she teaches Statistics one quarter, then the next quarter she will teach Statistics with a 1/3 probability.
-
Write a transition matrix for this problem.
-
If Professor Trayer teaches Finite Math in the Fall quarter, what is the probability that she will teach Statistics in the Winter quarter.
-
If Professor Trayer teaches Finite Math in the Fall quarter, what is the probability that she will teach Statistics in the Spring quarter.
-
Determine whether the following matrices are regular Markov chains.
-
\(\left[\begin{array}{ll}
1 & 0 \\
.3 & .7
\end{array}\right]\)
-
\(\left[\begin{array}{lll}
.2 & .4 & .4 \\
.6 & .4 & 0 \\
.3 & .2 & .5
\end{array}\right]\)
-
The transition matrix for switching academic majors each quarter by students at a university is given below, where Science, Business, and Liberal Arts majors are denoted by S, B, and A, respectively.
-
Find the probability of a science major switching to a business major during their first quarter.
-
Find the probability of a business major switching to a Liberal Arts during their second quarter.
-
Find the probability of a science major switching to Liberal Artsr during their third quarter.
-
John Elway, the football quarterback for the Denver Broncos, called his own plays. At every play he had to decide to either pass the ball or hand it off. The transition matrix for his plays is given in the following table, where P represents a pass and H a handoff.
-
If John Elway threw a pass on the initial play, what is the probability that he handed handoff on the two plays later?
-
Determine the long term play distribution.
-
Company I, Company II, and Company III compete against each other, and the transition matrix for people switching from company to company each year is given below.
-
If the initial market share is 20% for Company I, 30% for Company II and 50% for Company III, what will the market share be after the next year?
-
If this trend continues, what is the long range expectation for the market?
-
Given the following absorbing Markov chain.
-
Identify the absorbing states.
-
Write the solution matrix.
-
Starting from state 4, what is the probability of eventual absorption in state 1?
-
Starting from state 3, what is the probability of eventual absorption in state 2?
-
A mouse placed in the maze moves from room to room randomly. From any room, the mouse will choose a door to the next room with equal probabilities. Once it reaches room 1, it finds food and never leaves that room. And when it reaches room 6, it is trapped and cannot leave that room. What is the probability that the mouse will end up in room 1 if it was initially placed in room 3?
-
What is the probability that the mouse will end up in room 6 if it was initially in room 2?