In this paper, we report on the development of The Sustainable Port video game, which aims to simulate the complex dynamics and decisions occurring in the present and future development of a port area considering environmental aspects (CO2 emissions) and profit. To evaluate if this game fulfills its purpose, we asked 75 students and 34 employees at the Port of Rotterdam (PoR) to play The Sustainable Port. Our results show that PoR employees score higher than students suggesting a transfer between (...) real-life experience of being an employee in the port and performance in the game. Furthermore, port participants reported that The Sustainable Port can be successfully used to start discussions about the future of the Port of Rotterdam and to raise awareness about the complexity characterizing the decision-making processes occurring in a port environment. Our results, taken together, provide evidence of the effectiveness of The Sustainable Port in simulating dynamics occurring in port development and give us optimism about future applications. (shrink)

In this paper, we report on an experiment with The Walking Dead (TWD), which is a narrative-driven adventure game with morally charged decisions set in a post-apocalyptic world filled with zombies. This study aimed to identify physiological markers of moral decisions and non-moral decisions using infrared thermal imaging (ITI). ITI is a non-invasive tool used to capture thermal variations due to blood flow in specific body regions that might be caused by sympathetic activity. Results show that moral decisions seem to (...) elicit a significant decrease in temperature in the chin region 20 seconds after participants are presented with a moral decision. However, given the small sample involved, and the lack of significance in other regions, future studies might be needed to confirm the results obtained in this work. (shrink)

This study aimed to evaluate if eye blinks can be used to discriminate players with different performance in a session of Nintendo Entertainment System (NES) Tetris. To that end, we developed a state-of-the-art method for blink extraction from EAR measures, which is robust enough to be used with data collected by a low-grade webcam such as the ones widely available on laptop computers. Our results show a significant decrease in blink rate per minute (blinks/m) during the first minute of playing (...) Tetris. After having defined 3 groups of proficiency based on in-game performance (Novices, Intermediates, and Experts) we found out that expert players display a significantly lower decrease in blinks/m compared to novices during the first minute of gameplay, which shows that Tetris players' proficiency can be detected by looking at eye blinks/m variations during the early phase of a game session. This difference in blinks/m is observed throughout the entire game session, which supports the general conclusion that proficient Tetris players have a lower decrease in blinks/m, even when playing more difficult levels. Finally, we offer some interpretations of this effect and the relationship that our results may have with the visual cognitive workload experienced during the gameplay. (shrink)

Serious games are an effective method of reproducing aspects of the complex interplay between environments and stakeholders in business situations. In the game we describe here, The Sustainable Port, players experience what it is like to make decisions in such a complex environment. Their aim in the game is to grow the Port of Rotterdam while keeping economic growth in balance with sustainability goals. In this study, we assessed whether experienced Port of Rotterdam employees (PoR employees) show different psychophysiological patterns, (...) and more specifically EAR-derived features, compared to students. We did this on the assumption that physiological patterns will tell us something about how people who are familiar with the environment of the Port of Rotterdam, more specifically Port of Rotterdam employees, make decisions compared to those lacking such familiarity.Our sample consisted of 28 PoR employees and 65 students, all of whom played The Sustainable Port game and had their faces recorded with a camera. The Eye Aspect Ratio was extracted from these recordings and then from those we extracted EAR-derived features. Our results show that Port of Rotterdam employees perform better than students and that the two groups are characterized by different physiological variations in their EAR-derived features. A logistic regression model used to identify PoR employees and students obtained an F1 score of 0.62, a PR AUC score of 0.64, and a ROC AUC score of 0.70. performing significantly above baseline suggesting the effectiveness of using EAR-derived features for this task. Our interpretation was further confirmed by a pseudo-R2 score used to evaluate the goodness of fit of a logistic regression model on the entire dataset. We found that Port of Rotterdam employees had a lower variation in blink rate per minute (blinks/m) and higher variation in the root mean square difference of successive difference in blinks (RMSSD), the consecutive difference between two continuous blinks. Moreover, this study shows that our methods were robust enough to negate the effects of confounders, such as biological sex and age that affect some other studies that analyze blinks. (shrink)

In this study, we predict the different levels of performance in a Nintendo Entertainment System (NES) Tetris session based on the score and the number of matches played by the players. Using the first 45 seconds of gameplay, a Random Forest Classifier was trained on the five keys used in the game obtaining a ROC_AUC score of 0.80. Further analysis revealed that the number of down keys (forced drop) and the number of left keys (left translation) are the most relevant (...) keys in this task, showing that by merely including the data from these two keys our Random Forest Classifier reached a ROC_AUC score of 0.83.We conclude that the keylogger data during the early phases of a game session can be successfully used to predict performance in longer sessions of Tetris. (shrink)

This study aimed to identify real-life experts working for a port authority and lay people (students) who played The Sustainable Port, a serious game aiming to simulate the dynamics occurring in a port area. To achieve this goal, we analyzed eye gaze data collected noninvasively using low-grade webcams from 28 participants working for the port authority of the Port of Rotterdam and 66 students. Such data were used for a classification task implemented using a MiniRocket classifier, an algorithm used for (...) time-series classification. The classifier reached an F1 score of 0.75 (SD = 0.07), a PR AUC of 0.73 (SD = 0.14), and an ROC AUC of 0.75 (SD = 0.15) providing evidence that it is possible to identify real-life experts about maritime port management using data that can be obtained from a webcam. We speculate that the gaze direction used to train the MiniRocket may contain relevant information about the cognitive processes and decisions occurring throughout the gameplay. We suggest that the methods here presented not only can be used to detect experts playing simulations, such as serious games, but also to identify experts tackling screen-presented tasks. (shrink)

In this study, we extracted facial action units (AUs) data during a Hearthstone tournament to investigate behavioural differences between expert, intermediate, and novice players. Our aim was to obtain insights into the nature of expertise and how it may be tracked using non-invasive methods such as AUs. These insights may shed light on the endogenous responses in the player and at the same time may provide information to the opponents during a competition. Our results show that player expertise may be (...) characterised by specific patterns in facial expressions. More specifically, AU17 (chin raiser), AU25 (lips apart), and AU26 (jaws drop) intensity responses during gameplay may vary according to players' expertise. Such results were obtained by training a random forest classifier to test whether we can use these three AUs alone to accurately detect players' expertise. The classifier reached 0.75 accuracy on 5-fold cross-validation, after balancing the class weights, and 0.85 after having applied the Synthetic Minority Over-sampling Technique (SMOTE) function. These results suggest that AUs can be effectively used to discriminate different levels of expertise in competitive video game players. (shrink)

In this study, we analyzed the blinking behavior of players in a video game tournament. Our aim was to test whether spontaneous blink patterns differ across levels of expertise. We used blink rate, blink duration, blink frequency, and eyelid movements represented by the Eye Aspect Ratio (EAR) to train a machine learning classifier to discriminate between different levels of expertise. Classifier performance was highly influenced by features such as the mean, standard deviation and median EAR. Moreover, further analysis suggests that (...) blinking rate and blink duration are likely to increase along with the level of expertise. We speculate this may be indicative of a reduction in cognitive load and lowered stress of expert players. In general, our results suggest that EAR and blink patterns can be used to identify different levels of expertise of video game players. (shrink)