Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-15T22:26:27.596Z Has data issue: false hasContentIssue false

Viscosity Solutions of the Bellman Equation for Exit Time Optimal Control Problems with Non-Lipschitz Dynamics

Published online by Cambridge University Press:  15 August 2002

Michael Malisoff*
Affiliation:
Department of Systems Science and Mathematics, Washington University in Saint Louis, One Brookings Drive, Campus Box 1040, Saint Louis, MO 63130-4899, U.S.A.; malisoff@zach.wustl.edu.
Get access

Abstract

We study the Bellman equation for undiscounted exit time optimalcontrol problems with fully nonlinear Lagrangians and fullynonlinear dynamics using the dynamic programming approach. Weallow problems whose non-Lipschitz dynamics admit more than onesolution trajectory for some choices of open loop controls andinitial positions. We prove a uniqueness theorem which characterizes thevalue functions of these problems as the unique viscositysolutions of the correspondingBellman equations that satisfyappropriate boundary conditions. We deduce that the valuefunction forSussmann's Reflected Brachystochrone Problem foran arbitrary singleton target is the unique viscosity solution ofthe corresponding Bellman equation in the class of functions whichare continuous in the plane, null at the target, and boundedbelow. Our results also apply to degenerate eikonal equations, and to problems whose targets can beunbounded and whose Lagrangians vanish for some points in thestate space which are outside the target, including Fuller'sExample.

Information

Type
Research Article
Copyright
© EDP Sciences, SMAI, 2001

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable