Skip to content
Q122Section III (Statistics)122 of 180

First-return decomposition for a periodic chain

Suppose fij(n)f_{ij}^{(n)} denotes the probability of the first visit to jj from ii in nn steps, and the Markov chain is periodic with period 22. Consider:

(I) fii(2)=pii(2)−pii(1)fii(1)f_{ii}^{(2)}=p_{ii}^{(2)}-p_{ii}^{(1)}f_{ii}^{(1)}
(II) fii(4)=pii(4)−pii(2)fii(2)f_{ii}^{(4)}=p_{ii}^{(4)}-p_{ii}^{(2)}f_{ii}^{(2)}
(III) fii(7)=0f_{ii}^{(7)}=0

Options

Pick an option to check your answer.