Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-17T02:20:04.631Z Has data issue: false hasContentIssue false

The stationary probability density of a class of bounded Markov processes

Published online by Cambridge University Press:  01 July 2016

Muhamad Azfar Ramli*
Affiliation:
National University of Singapore
Gerard Leng*
Affiliation:
National University of Singapore
*
∗ Postal address: Cooperative Systems Lab E1-03-06, Department of Mechanical Engineering, National University of Singapore, 1 Engineering Drive 2, Singapore 117576.
∗ Postal address: Cooperative Systems Lab E1-03-06, Department of Mechanical Engineering, National University of Singapore, 1 Engineering Drive 2, Singapore 117576.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

In this paper we generalize a bounded Markov process, described by Stoyanov and Pacheco-González for a class of transition probability functions. A recursive integral equation for the probability density of these bounded Markov processes is derived and the stationary probability density is obtained by solving an equivalent differential equation. Examples of stationary densities for different transition probability functions are given and an application for designing a robotic coverage algorithm with specific emphasis on particular regions is discussed.

Information

Type
General Applied Probability
Copyright
Copyright © Applied Probability Trust 2010