Detecting emotions and stress in drone operators

February 12, 2021

Multimodal detection of emotions and stress in drone operators using deep learning

Operators of drones and remotely piloted aircraft have a demanding job, with many challenges.

As UAVs ( unmanned aerial vehicles) become increasingly autonomous, the number of personnel at the controls during missions is reduced. But this also poses safety challenges, as control and supervision periods become increasingly long.

CRIM’s project, carried out via the National Defense IDEeS program, aims to assess the state of operators non-intrusively using AI and computer vision. The new technique uses facial emotion analysis to assess a person’s emotional state using a deep learning model.

The development of a reliable, non-intrusive technique would make it easy to monitor the psychological state of individual operators, and avoid mental overload that could lead to incidents.

Additional information: AI detects emotional state of drone operators – CScience.ca – March 3, 2021

Mohamed Dahmane, a computer vision researcher at CRIM, will offer a master class on the subject:
Human factors in autonomous system operators: AI in the loop.
As part of CRIAQ’s RDV Forum on February 19, 2021 at 1:30pm. Register here

CRIM Masterclass

Scientific publication about the project :
M. Dahmane, J. Alam, P. St-Charles, M. Lalonde, K. Heffner and S. Foucher, “A Multimodal Non-Intrusive Stress Monitoring from the Pleasure-Arousal Emotional Dimensions” in IEEE Transactions on Affective Computing, April 20, 2020.

Keywords

Share on your social medias

button upCreated with Sketch.

Abonnez-vous à notre infolettre

*Champs requis

This field is hidden when viewing the form

Subscribe to our newsletter

*Required fields

This field is hidden when viewing the form