8 k=1 Show that | Ajk = {X0 = i,X₁ = j i.o.} Hint: show set inclusion both ways. Show that Pi(Ajk) = fij fjjk-¹.
8 k=1 Show that | Ajk = {X0 = i,X₁ = j i.o.} Hint: show set inclusion both ways. Show that Pi(Ajk) = fij fjjk-¹.
Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter7: Distance And Approximation
Section7.4: The Singular Value Decomposition
Problem 53EQ
Question
Visiting a state infinitely often. Suppose that X0 = i and consider the
Ajk defined as the event that the chain visits state j at least k times. Note that if
Ajk occurs, then it must be true that the chain must have made a visit from i to j
and then revisited j at least k − 1 times. Realizing the Pi probability that the chain
visits state j from state i is fij and the Pi probability that the chain visits state j
from state j (k − 1) times is f k−1
jj , we conclude that Pi(Ajk) ≤ fij f k−1
jj . On the other
hand, if the chain happens to visit j from i and also revisit j at least k − 1 times,
then we would know that the event Ajk has occurred.
Expert Solution
This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
Step by step
Solved in 2 steps
Recommended textbooks for you
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Elements Of Modern Algebra
Algebra
ISBN:
9781285463230
Author:
Gilbert, Linda, Jimmie
Publisher:
Cengage Learning,
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Elements Of Modern Algebra
Algebra
ISBN:
9781285463230
Author:
Gilbert, Linda, Jimmie
Publisher:
Cengage Learning,
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage