Examining Joy of Use and Usability During Mobile Phone Interactions within a Multimodal Methods Approach

M.Sc. Katharina Lingelbach, Nektaria Tagalidou, Patrick S. Markey, Bettina Föll, Matthias Peissner, Mathias Vukelic
September, 2022
PDF Cite DOI

Abstract

We investigate experienced joy of use (JoU) and usability using a multimodal methods approach by systematically varying mobile phone interactions. We combined subjective and objective measures to investigate whether positive emotional experiences and moments of joy during the interaction can be distinguished from neutral and negative emotional experiences. In a study with 30 participants, electroencephalography (EEG), electrocardiography (ECG), electrodermal activity (EDA), facial emotion recognition, and questionnaires were used.The multimodal methods approach reveals great potential to investigate JoU and usability in naturalistic scenarios. The developed framework provides a groundwork to evaluate and improve interactions with technology. Thereby, users and their emotional experiences are placed at the centre when designing user interfaces. By detecting moments of joy, this approach can support a better understanding of how technology can be purposefully designed for joyful experiences.

Type
Conference paper
Publication
MuC 2022: Proceedings of Mensch und Computer 2022
User Experience Affective Computing Multimodal Measures Electroencephalography Electrocardiography Electrodermal activity Facial Expression Decoding Joy of Use Human-Machine Interaction
M.Sc. Katharina Lingelbach
M.Sc. Katharina Lingelbach
PhD student, Neuroscientist, and Psychologist (she/her/hers)

My research focuses on interacting and shared neuronal dynamics of emotional and cognitive processes investigated with M/EEG, Eye-tracking, and fNIRS