Hostname: page-component-7b7567c8c-7pwfn Total loading time: 0 Render date: 2026-11-15T15:37:08.468Z Has data issue: false hasContentIssue false

Denumerable state continuous time Markov decision processes with unbounded cost and transition rates under average criterion

Published online by Cambridge University Press:  17 February 2009

Xianping Guo
Affiliation:
Department of Mathematics, Zhongshan University, P. R. China
Weiping Zhu
Affiliation:
School of Computer Science, ADFA, The University of New South Wales, Canberra, ACT 2600, Australia; e-mail: weiping@cs.adfa.edu.au
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

In this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission control queue model and controlled birth and death processes.

Information

Type
Research Article
Copyright
Copyright © Australian Mathematical Society 2002