(Solved):   2. Given a four-state Markov chain: state 1: an individual is free of a particular disease ...

 

2. Given a four-state Markov chain: state 1: an individual is free of a particular disease state 2: an individual has the disease state 3: death as a result of the disease state 4: death from other causes During an annual cycle, we assume that the transition matrix is (in the order of the states), 1 1 0 1 8 1 T= 4 0 2 0 0 0 0 1 = . (i)According to the above T = (Pij), please explain what is the meaning of P12 and P32 (ii) At the beginning, Tom suffered from this particular disease. One year later, Two years later, what is the probability that Tom will recover (12).