Hostname: page-component-7b7567c8c-m6dxt Total loading time: 0 Render date: 2026-11-18T21:56:19.163Z Has data issue: false hasContentIssue false

Markovian bounds on functions of finite Markov chains

Published online by Cambridge University Press:  01 July 2016

James Ledoux*
Affiliation:
Institut National des Sciences Appliquées, Rennes
Laurent Truffet*
Affiliation:
Institut de Recherche en Communications et Cybernetique de Nantes
*
∗ Postal address: INSA, 20 avenue des Buttes de Coesmes, 35043 Rennes Cedex, France. Email address: james.ledoux@insa.rennes.fr
∗∗ Postal address: Ecole des Mines de Nantes, Département Automatique–Productique, 4 rue Alfred Kastler BP 20722, 44307 Nantes Cedex 3, France.

Abstract

In this paper, we obtain Markovian bounds on a function of a homogeneous discrete time Markov chain. For deriving such bounds, we use well-known results on stochastic majorization of Markov chains and the Rogers–Pitman lumpability criterion. The proposed method of comparison between functions of Markov chains is not equivalent to generalized coupling method of Markov chains, although we obtain same kind of majorization. We derive necessary and sufficient conditions for existence of our Markovian bounds. We also discuss the choice of the geometric invariant related to the lumpability condition that we use.

Information

Type
General Applied Probability
Copyright
Copyright © Applied Probability Trust 2001 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable