Hostname: page-component-7b7567c8c-7pwfn Total loading time: 0 Render date: 2026-11-17T18:19:58.043Z Has data issue: false hasContentIssue false

Bias and Overtaking Optimality for Continuous-Time Jump Markov Decision Processes in Polish Spaces

Published online by Cambridge University Press:  14 July 2016

Quanxin Zhu*
Affiliation:
South China Normal University
Tomás Prieto-Rumeau*
Affiliation:
Universidad Nacional de Educación a Distancia
*
∗ . Research partially supported by the Natural Science Foundation of China (10626021), the Natural Science Foundationof Guangdong Province (06300957), and CONACYT grant 45693-F.
∗ . Research partially supported by the Natural Science Foundation of China (10626021), the Natural Science Foundationof Guangdong Province (06300957), and CONACYT grant 45693-F.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

In this paper we study the bias and the overtaking optimality criteria for continuous-time jump Markov decision processes in general state and action spaces. The corresponding transition rates are allowed to be unbounded, and the reward rates may have neither upper nor lower bounds. Under appropriate hypotheses, we prove the existence of solutions to the bias optimality equations, the existence of bias optimal policies, and an equivalence relation between bias and overtaking optimality.

Information

Type
Research Article
Copyright
Copyright © Applied Probability Trust 2008