Citation

Jin L, Ren Q, Mitchell V, May A. Ergonomics 2023; ePub(ePub): ePub.

Copyright

(Copyright © 2023, Informa - Taylor and Francis Group)

DOI

10.1080/00140139.2023.2223784

PMID

37306555

Abstract

In safety-critical automatic systems, safety can be compromised if operators lack engagement. Effective detection of undesirable engagement states can inform the design of interventions for enhancing engagement. However, the existing engagement measurement methods suffer from several limitations which damage their effectiveness in the work environment. A novel engagement evaluation methodology, which adopts Artificial Intelligence (AI) technologies, has been proposed. It was developed using motorway control room operators as subjects. Openpose and Open Source Computer Vision Library (OpenCV) were used to estimate the body postures of operators, then a Support Vector Machine (SVM) was utilized to build the engagement evaluation model based on discrete states of operator engagement. The average accuracy of the evaluation results reached 0.89 and the weighted average precision, recall and f1-score were all above 0.84. This study emphasizes the importance of specific data labelling when measuring typical engagement states, forming the basis for potential control room improvements.

Language: en

Keywords

Artificial Intelligence; Body posture estimation; Control room; Engagement evaluation; User experience