Hostname: page-component-7b7567c8c-fvjsw Total loading time: 0 Render date: 2026-11-17T16:37:19.743Z Has data issue: false hasContentIssue false

Approximating the stationary distribution of an infinite stochastic matrix

Published online by Cambridge University Press:  14 July 2016

Daniel P. Heyman*
Affiliation:
Bellcore
*
∗ Postal address: Bellcore, Room 3D-308, 331 Newman Springs Road, Red Bank, NJ 07701, USA.

Abstract

We are given a Markov chain with states 0, 1, 2, ···. We want to get a numerical approximation of the steady-state balance equations. To do this, we truncate the chain, keeping the first n states, make the resulting matrix stochastic in some convenient way, and solve the finite system. The purpose of this paper is to provide some sufficient conditions that imply that as n tends to infinity, the stationary distributions of the truncated chains converge to the stationary distribution of the given chain. Our approach is completely probabilistic, and our conditions are given in probabilistic terms. We illustrate how to verify these conditions with five examples.

Information

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 1991 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable