Hostname: page-component-6898cfcb55-th4rj Total loading time: 0 Render date: 2026-11-11T15:39:01.113Z Has data issue: false hasContentIssue false
  • English
  • Français

Uniqueness criteria for continuous-time Markov chains with general transition structures

Part of:Markov processes

Published online by Cambridge University Press:  01 July 2016

Anyue Chen,
Phil Pollett,
Hanjun Zhang and
Ben Cairns
Anyue Chen*
Affiliation:
University of Greenwich and the University of Hong Kong
Phil Pollett*
Affiliation:
The University of Queensland
Hanjun Zhang*
Affiliation:
The University of Queensland
Ben Cairns*
Affiliation:
The University of Queensland
*
∗ Current address: Department of Statistics and Actuarial Science, The University of Hong Kong, Pokfulam Road, Hong Kong. Email address: a.chen@hknstasc.hku.hk
∗∗ Postal address: Department of Mathematics, The University of Queensland, Qld 4072, Australia.
∗∗ Postal address: Department of Mathematics, The University of Queensland, Qld 4072, Australia.
∗∗∗∗∗ Current address: School of Biological Sciences, University of Bristol, Woodland Road, Clifton, Bristol BS8 1UG, UK. Email address: Ben.Cairns@bristol.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

We derive necessary and sufficient conditions for the existence of bounded or summable solutions to systems of linear equations associated with Markov chains. This substantially extends a famous result of G. E. H. Reuter, which provides a convenient means of checking various uniqueness criteria for birth-death processes. Our result allows chains with much more general transition structures to be accommodated. One application is to give a new proof of an important result of M. F. Chen concerning upwardly skip-free processes. We then use our generalization of Reuter's lemma to prove new results for downwardly skip-free chains, such as the Markov branching process and several of its many generalizations. This permits us to establish uniqueness criteria for several models, including the general birth, death, and catastrophe process, extended branching processes, and asymptotic birth-death processes, the latter being neither upwardly skip-free nor downwardly skip-free.

Keywords

Upwardly skip-free processdownwardly skip-free processMarkov branching processbirth-death process

MSC classification

Primary:60J27: Continuous-time Markov processes on discrete state spaces
Secondary:60J35: Transition functions, generators and resolvents

Information

Type
General Applied Probability
Information
Advances in Applied Probability , Volume 37 , Issue 4 , December 2005, pp. 1056 - 1074
Copyright
Copyright © Applied Probability Trust 2005 

References

Anderson, W. J. (1991). Continuous-Time Markov Chains: An Applications-Oriented Approach. Springer, New York.CrossRefGoogle Scholar
Brockwell, P. J. (1985). The extinction time of a birth, death and catastrophe process and of a related diffusion model. Adv. Appl. Prob. 17, 42–52.CrossRefGoogle Scholar
Brockwell, P. J. (1986). The extinction time of a general birth and death process with catastrophes. J. Appl. Prob. 23, 851–858.CrossRefGoogle Scholar
Brockwell, P. J., Gani, J. and Resnick, S. I. (1982). Birth, immigration and catastrophe processes. Adv. Appl. Prob. 14, 709–731.CrossRefGoogle Scholar
Chen, A. Y. (2002). Uniqueness and extinction properties of generalized Markov branching processes. J. Math. Anal. Appl. 274, 482–494.CrossRefGoogle Scholar
Chen, A. Y. and Renshaw, E. (1990). Markov branching processes with instantaneous immigration. Prob. Theory Relat. Fields 87, 204–240.CrossRefGoogle Scholar
Chen, A. Y. and Renshaw, E. (1993). Existence and uniqueness criteria for conservative uni-instantaneous denumerable Markov processes. Prob. Theory Relat. Fields 94, 427–456.CrossRefGoogle Scholar
Chen, M. F. (1992). From Markov Chains to Nonequilibrium Particle Systems. World Scientific, Singapore.CrossRefGoogle Scholar
Chen, M. F. (1999). Single birth processes. Chinese Ann. Math. Ser. A 20, 77–82.CrossRefGoogle Scholar
Chen, M. F. and Zheng, X. G. (1983). Uniqueness criterion for q-processes. Sci. Sinica Ser. A 26, 11–24.Google Scholar
Chen, R. R. (1997). An extended class of time-continuous branching processes. J. Appl. Prob. 34, 14–23.CrossRefGoogle Scholar
Feller, W. (1940). On the integro-differential equations of purely discontinuous Markoff processes. Trans. Amer. Math. Soc. 48, 488–515.CrossRefGoogle Scholar
Hart, A. G. and Pollett, P. K. (1996). Direct analytical methods for determining quasistationary distributions for continuous-time Markov chains. In Athens Conf. on Applied Probability and Time Series Analysis, Vol. 1 (Lecture Notes Statist. 114), eds Heyde, C. C. et al., Springer, New York, pp. 116–126.Google Scholar
Hart, A. G. and Pollett, P. K. (2000). New methods for determining quasi-stationary distributions for Markov chains. Math. Comput. Modelling 31, 143–150.CrossRefGoogle Scholar
Hou, C. T. (1974). The criterion for uniqueness of a Q-process. Sci. Sinica 17, 141–159.Google Scholar
Hou, Z. T. and Guo, Q. F. (1988). Homogeneous Denumerable Markov Processes. Springer, Berlin.Google Scholar
Pakes, A. G. (1986). The Markov branching-catastrophe process. Stoch. Process. Appl. 23, 1–33.CrossRefGoogle Scholar
Pollett, P. K. (1991). Invariant measures for Q-processes when Q is not regular. Adv. Appl. Prob. 23, 277–292.CrossRefGoogle Scholar
Pollett, P. K. (2001). Quasi-stationarity in populations that are subject to large-scale mortality or emigration. Environ. Internat. 27, 231–236.CrossRefGoogle ScholarPubMed
Pollett, P. K. and Taylor, P. G. (1993). On the problem of establishing the existence of stationary distributions for continuous-time Markov chains. Prob. Eng. Inf. Sci. 7, 529–543.CrossRefGoogle Scholar
Reuter, G. E. H. (1957). Denumerable Markov processes and the associated contraction semigroups on l . Acta Math. 97, 1–46.CrossRefGoogle Scholar
Reuter, G. E. H. (1976). Denumerable Markov processes. IV. On C. T. Hou's uniqueness theorem for Q-semigroups. Z. Wahrscheinlichkeitsth. 33, 309–315.CrossRefGoogle Scholar
Yan, S. J. and Chen, M. F. (1986). Multidimensional Q-processes. Chinese Ann. Math. Ser. A 7, 90–110.Google Scholar
Zhang, J. K. (1984). Generalized birth–death processes. Acta Math. Sinica 46, 241–259 (in Chinese).Google Scholar
Zhang, Y. H. (2001). Strong ergodicity for single-birth processes. J. Appl. Prob. 38, 270–277.CrossRefGoogle Scholar