Hostname: page-component-7b7567c8c-2n9c9 Total loading time: 0 Render date: 2026-11-18T16:36:45.845Z Has data issue: false hasContentIssue false

On the total reward variance for continuous-time Markov reward chains

Published online by Cambridge University Press:  14 July 2016

Nico M. Van Dijk*
Affiliation:
University of Amsterdam
Karel Sladký*
Affiliation:
Institute of Information Theory and Automation, Prague
*
∗ Postal address: Department of Economic Sciences and Econometrics, University of Amsterdam, Roetersstraat 11, 1018 WB Amsterdam, The Netherlands. Email address: nivd@fee.uva.nl
∗∗ Postal address: Institute of Information Theory and Automation, Academy of Sciences of the Czech Republic, PO Box 18, Pod Vodárenskou věží 4, 182 08 Prague 8, Czech Republic. Email address: sladky@utia.cas.cz
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

As an extension of the discrete-time case, this note investigates the variance of the total cumulative reward for continuous-time Markov reward chains with finite state spaces. The results correspond to discrete-time results. In particular, the variance growth rate is shown to be asymptotically linear in time. Expressions are provided to compute this growth rate.

Information

Type
Research Papers
Copyright
© Applied Probability Trust 2006