Virtual Reality (VR) technology provides a safe yet realistic environment which allows operators to undergo training on tasks that are difficult or dangerous to perform in reality. Leveraging on eye tracking technology provided by the HTC VIVE Pro Eye VR device, Fraunhofer developed an innovative real-time stress and fatigue monitoring algorithms as an additional layer of evaluation, utilizing novel machine learning algorithms in VR application.
Human factors evaluation in this fashion enables identification of areas of the task that are demanding for the operator, which can be further reviewed for optimization of procedures to compensate for any abnormal change in stress and fatigue, thus contributing to overall safety in actual operations.
The monitoring algorithms have been implemented in VR-based training simulator for shunting of engineering trains (VR-TSST). They can provide on the fly monitoring of stress and fatigue. In addition, overall trainee stress and fatigue by tasks and different time intervals can be provided by the simulator.