Linear Programming Assignment 5: 1 Chapter 17 (Section 17.2)
Linear Programming Assignment 5: 1 Chapter 17 (Section 17.2)
1.1.1 Solution
The transition probability matrix for this situation is:
0 1 2
0 0 0 1
1 0 1/3 2/3
2 1/9 4/9 4/9
2.1.1 Solution
(a) The transition probability matrix for this situation is:
U S R
U rban 0.80 0.15 0.05
P = Suburban 0.06 0.90 0.04
Rural 0.04 0.06 0.90
U S R
U rban .651 .258 .091
P 2 = P × P = Suburban .104 .821 .075
Rural .072 .114 .814
1
If a family now lives in an urban location then,
the probability that it will live in an urban area two years from now is 0.651.
the probability that it will live in an suburban area two years from now is 0.258.
the probability that it will live in an rural area two years from now is 0.091.
3.1.1 Solution
The transition probability matrix for this situation is:
good f air broken
good 0.85 0.10 0.05
P = f air 0.00 0.70 0.30
broken 0.85 0.10 0.05
3.2 Exercise 7
Consider two stocks. Stock 1 always sells for $10 or $20. If stock 1 is selling for $10 today, there is a .80 chance that
it will sell for $10 tomorrow. If it is selling for $20 today, there is a .90 chance that it will sell for $20 tomorrow. Stock
2 always sells for $10 or $25. If stock 2 sells today for $10, there is a .90 chance that it will sell tomorrow for $10. If
it sells today for $25, there is a .85 chance that it will sell tomorrow for $25. On the average, which stock will sell for
a higher price? Find and interpret all mean first passage times
3.2.1 Solution
For Stock 1: The transition probability matrix for this situation is:
10 20
10 0.80 0.20
P =
20 0.10 0.90
2
1 2
We find the values of π, π1 = 3 π2 = 3
For Stock 2: The transition probability matrix for this situation is:
10 25
10 0.90 0.10
P =
25 0.15 0.85
Each students state is observed at the beginning of each fall semester. For example, if a student is a junior at the
beginning of the current fall semester, there is an 80% chance that he will be a senior at the beginning of the next fall
semester, a 15% chance that he will still be a junior, and a 5% chance that he will have quit. (We assume that once a
student quits, he never reenrolls.)
a If a student enters State College as a freshman, how many years can he expect to spend as a student at State?
b What is the probability that a freshman graduates?
4.2 Solution
(a) Here,
0.1 0.8 0 0
0 0.1 0.85 0
Q= 0
0 0.15 0.8
0 0 0 0.1
3
0.1 0
0.05 0
and R =
0.05
0
0.05 0.85
0.9 −0.8 0 0
0 0.9 −0.85 0
Now, (I − Q) =
0 0 0.85 −0.8
0 0 0 0.9
1.11 0.99 0.99 0.88
0 1.11 1.11 0.99
(I − Q)−1
0
0 1.18 1.05
0 0 0 1.11
If a student enters State College as a freshman, the can he expect to spend as a student at State in years = 1.11 +
0.99 + 0.99 + 0/88 = 3.97 years
(b)
Q G
F 0.25 0.75
So
0.16 0.84
(I − Q)−1 ∗ R =
J 0.11 0.89
Sen 0.06 0.094
From the above matrix,we can say that the probability that a freshman graduates is 0.75 years