Hostname: page-component-7b7567c8c-tnkh4 Total loading time: 0 Render date: 2026-11-18T14:31:28.416Z Has data issue: false hasContentIssue false

Reversibility of Markov chains with applications to storage models

Published online by Cambridge University Press:  14 July 2016

Hideo Ōsawa*
Affiliation:
University of Electro-Communications, Tokyo
*
∗ Postal address: Department of Mathematical Statistics, The University of Electro-Communications, 1–5–1 Chofugaoka, Chofu-shi, Tokyo 182, Japan.

Abstract

This paper studies the reversibility conditions of stationary Markov chains (discrete-time Markov processes) with general state space. In particular, we investigate the Markov chains having atomic points in the state space. Such processes are often seen in storage models, for example waiting time in a queue, insurance risk reserve, dam content and so on. The necessary and sufficient conditions for reversibility of these processes are obtained. Further, we apply these conditions to some storage models and present some interesting results for single-server queues and a finite insurance risk model.

Information

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 1985 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable