Hostname: page-component-7b7567c8c-7pwfn Total loading time: 0 Render date: 2026-11-16T02:14:45.060Z Has data issue: false hasContentIssue false

Computing approximate stationary distributions for discrete Markov processes with banded infinitesimal generators

Published online by Cambridge University Press:  14 July 2016

Carlos F. Borges*
Affiliation:
Naval Postgraduate School, Monterey
Craig S. Peters*
Affiliation:
General Electric Co., New York
*
∗ Postal address: Code MA/BC, Naval Postgraduate School, Monterey, CA 93943, USA. Email address: borges@nps.navy.mil
∗∗ Postal address: General Electric Co., Building K1, SC1D, One Research Circle, Niskayina, NY 12309, USA.

Abstract

We develop an algorithm for computing approximations to the stationary distribution of a discrete birth-and-death process, provided that the infinitesimal generator is a banded matrix. We begin by computing stationary distributions for processes whose infinitesimal generators are Hessenberg. Our derivation in this special case is different from the classical case but it leads to the same result. We then show how to extend these ideas to processes where the infinitesimal generator is banded (or half-banded) and to quasi-birth–death processes. Finally, we give an example of the application of this method to a nearly completely decomposable Markov chain to demonstrate the general applicability of the technique.

Information

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 1999 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable