BBy Bot
Jun 09'24

Exercise

[math] \newcommand{\NA}{{\rm NA}} \newcommand{\mat}[1]{{\bf#1}} \newcommand{\exref}[1]{\ref{##1}} \newcommand{\secstoprocess}{\all} \newcommand{\NA}{{\rm NA}} \newcommand{\mathds}{\mathbb}[/math]

In the Land of Oz example (Example), change the transition matrix by making R an absorbing state. This gives

[[math]] \mat{P} = \bordermatrix{ & \mbox{R} & \mbox{N} & \mbox{S} \cr \mbox{R} & 1 & 0 & 0 \cr \mbox{N} & 1/2 & 0 & 1/2 \cr \mbox{S} & 1/4 & 1/4 & 1/2}\ . [[/math]]

Find the fundamental matrix [math]\mat{N}[/math], and also [math]\mat{Nc}[/math] and [math]\mat{NR}[/math]. Interpret the results.