Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-16T19:08:46.858Z Has data issue: false hasContentIssue false

Autonomous Vehicular Landings on the Deck of an Unmanned Surface Vehicle using Deep Reinforcement Learning

Published online by Cambridge University Press:  08 April 2019

Riccardo Polvara*
Affiliation:
Lincoln Centre for Autonomous Systems Research, School of Computer Science, College of Science, University of Lincoln, Brayford Pool, Lincoln LN6 7TS, UK
Sanjay Sharma
Affiliation:
Autonomous Marine Systems Research Group, School of Engineering, Faculty of Science and Engineering, University of Plymouth, Drake Circus, Plymouth PL4 8AA, UK E-mails: sanjay.sharma@plymouth.ac.uk, jian.wan@plymouth.ac.uk, a.manning@plymouth.ac.uk, r.sutton@plymouth.ac.uk
Jian Wan
Affiliation:
Autonomous Marine Systems Research Group, School of Engineering, Faculty of Science and Engineering, University of Plymouth, Drake Circus, Plymouth PL4 8AA, UK E-mails: sanjay.sharma@plymouth.ac.uk, jian.wan@plymouth.ac.uk, a.manning@plymouth.ac.uk, r.sutton@plymouth.ac.uk
Andrew Manning
Affiliation:
Autonomous Marine Systems Research Group, School of Engineering, Faculty of Science and Engineering, University of Plymouth, Drake Circus, Plymouth PL4 8AA, UK E-mails: sanjay.sharma@plymouth.ac.uk, jian.wan@plymouth.ac.uk, a.manning@plymouth.ac.uk, r.sutton@plymouth.ac.uk
Robert Sutton
Affiliation:
Autonomous Marine Systems Research Group, School of Engineering, Faculty of Science and Engineering, University of Plymouth, Drake Circus, Plymouth PL4 8AA, UK E-mails: sanjay.sharma@plymouth.ac.uk, jian.wan@plymouth.ac.uk, a.manning@plymouth.ac.uk, r.sutton@plymouth.ac.uk
*
*Corresponding author. E-mail: rpolvara@lincoln.ac.uk
Rights & Permissions [Opens in a new window]

Summary

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

Autonomous landing on the deck of a boat or an unmanned surface vehicle (USV) is the minimum requirement for increasing the autonomy of water monitoring missions. This paper introduces an end-to-end control technique based on deep reinforcement learning for landing an unmanned aerial vehicle on a visual marker located on the deck of a USV. The solution proposed consists of a hierarchy of Deep Q-Networks (DQNs) used as high-level navigation policies that address the two phases of the flight: the marker detection and the descending manoeuvre. Few technical improvements have been proposed to stabilize the learning process, such as the combination of vanilla and double DQNs, and a partitioned buffer replay. Simulated studies proved the robustness of the proposed algorithm against different perturbations acting on the marine vessel. The performances obtained are comparable with a state-of-the-art method based on template matching.

Information

Type
Articles
Copyright
© Cambridge University Press 2019