Towards safe deep reinforcement learning for autonomous airborne collision avoidance systems

Simple item page
dc.contributor.authorPanoutsakopoulos, Christos
dc.contributor.authorYuksek, Burak
dc.contributor.authorInalhan, Gokhan
dc.contributor.authorTsourdos, Antonios
dc.date.accessioned2022-01-26T15:26:37Z
dc.date.available2022-01-26T15:26:37Z
dc.date.issued2021-12-29
dc.description.abstractIn this paper we consider the application of Safe Deep Reinforcement Learning in the context of a trustworthy autonomous Airborne Collision Avoidance System. A simple 2D airspace model is defined, in which a hypothetical air vehicle attempts to fly to a given waypoint while autonomously avoiding Near Mid-Air collisions (NMACs) with non-cooperative traffic. We use Proximal Policy Optimisation for our learning agent, and we propose a reward engineering approach based on a combination of sparse terminal rewards at natural termination points and dense step rewards providing the agent with continuous feedback on its actions, based on relative geometry and motion attributes of its trajectory with respect to the traffic and the target waypoint. The performance of our trained agent is evaluated through Monte-Carlo simulations, and it is demonstrated that it achieves to master the collision avoidance task with respect to safety for a reasonable trade-off in mission performance.en_UK
dc.identifier.citationPanoutsakopoulos C, Yuksek B, Inalhan G & Tsourdos A (2021) Towards safe deep reinforcement learning for autonomous airborne collision avoidance systems. In: AIAA SciTech 2022 Forum, 3-7 January 2022, San Diego, CA, USA and Virtual Eventen_UK
dc.identifier.urihttps://doi.org/10.2514/6.2022-2102.vid
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/17504
dc.language.isoenen_UK
dc.publisherAIAAen_UK
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.titleTowards safe deep reinforcement learning for autonomous airborne collision avoidance systemsen_UK
dc.typeConference paperen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
autonomous_airborne_collision_avoidance_systems-2021.pdf
Size:
670.55 KB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Staff publications (SATM)