Detecting Experts Using a MiniRocket: Gaze Direction Time Series Classification of Real-Life Experts Playing the Sustainable Port

This study aimed to identify real-life experts working for a port authority and lay people (students) who played The Sustainable Port, a serious game aiming to simulate the dynamics occurring in a port area. To achieve this goal, we analyzed eye gaze data collected noninvasively using low-grade webcams from 28 participants working for the port authority of the Port of Rotterdam and 66 students. Such data were used for a classification task implemented using a MiniRocket classifier, an algorithm used for time-series classification. The classifier reached an F1 score of 0.75 (SD = 0.07), a PR AUC of 0.73 (SD = 0.14), and an ROC AUC of 0.75 (SD = 0.15) providing evidence that it is possible to identify real-life experts about maritime port management using data that can be obtained from a webcam. We speculate that the gaze direction used to train the MiniRocket may contain relevant information about the cognitive processes and decisions occurring throughout the gameplay. We suggest that the methods here presented not only can be used to detect experts playing simulations, such as serious games, but also to identify experts tackling screen-presented tasks.