CERESResearch Repository

Recognising emotions in air-ground communications with deep learning

Loading...
Thumbnail Image

Date published

Free to read from

2026-07-27

Supervisor/s

Industry supervisor/s

Journal Title

Journal ISSN

Volume Title

Department

Course name

ISSN

Format

Citation

Yiu CY, Li W-C. (2026) Recognising emotions in air-ground communications with deep learning. In: Proceedings of the 2026 IEEE International Conference on Human-Machine Systems (ICHMS), 1-3 Jul 2026, Singapore, Singapore, pp. 77-82

Abstract

Decision-making in air traffic operations often requires a stable emotional state to ensure the decision quality. To ensure aeronautical decisions are free from emotional impacts, this research presents a novel dataset and deep learning model to identify the emotions of stakeholders, including pilots and air traffic controllers (ATCOs). We recorded 30 utterances in seven different emotions from 20 participants who are pilots or ATCOs. Features were extracted from the utterance recordings for emotion recognition. A long short-term memory (LSTM) model was constructed to perform emotion recognition. The proposed model yielded a test accuracy at 64.29 %. The model demonstrates the potential in identifying emotions of pilots and ATCOs via their communications.

Description

Software description

Software language

Git repository

Keywords

46 Information and Computing Sciences, 4608 Human-Centred Computing, Basic Behavioral and Social Science, Mental Health, Behavioral and Social Science, Machine Learning and Artificial Intelligence

DOI

Rights

Attribution 4.0 International

Funder/s

The research is supported by Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Hong Kong SAR (RLPA, YWFR) and Safety and Accident Investigation Centre, Cranfield University, United Kingdom. Cho Yin Yiu is a recipient of the Hong Kong PhD Fellowship (Reference number: PF21-62058).

Grant number

Relationships

Relationships

Resources