title: “Temporal Decoding of Emotion and Workload from Fixation-Related EEG Recordings”

Authors

authors:

admin
Daniela Piechnik
Anne-Marie Brouwer
Ivo Stuldreher
Mathias Vukelić

Author notes (optional)

author_notes: []

date: “2021-07-01T00:00:00Z”

Schedule page publish date (NOT publication’s date)

publishDate: “2021-07-01T00:00:00Z”

Publication type

publication_types: [‘1’]

Publication name and optional abbreviated publication name

publication: “3rd Neuroergonomics Conference 2021, Munich” publication_short: “NEC ‘21”

abstract: > Electroencephalographic (EEG) recordings allow capturing temporal activation patterns associated with the current level of workload or emotional states. Decoding mental states from these activation patterns and reacting to them accordingly can increase performance, safety, and user experience during human-machine interactions, e.g., in medical surgery or autonomous driving. In such naturalistic environments, it is particularly important to integrate context information and identify the current locus of attention to achieve robust mental state decoding. When combining EEG signals with information regarding the eye movements acquired via eye-tracking, the analysis of neuronal temporal dynamics can be related to the fixation on or saccade towards a stimulus. Multivariate pattern analysis (MVPA) receives increasing attention since it allows distinguishing subtle differences in temporal dynamics between conditions. MVPA has mainly been applied to distinguish different sensory processes with rather low-level neuronal representation, especially in functional magnetic resonance imaging (fMRI). However, because of their high temporal resolution, magnetoencephalography (MEG) and EEG are particularly suited to unravel fine-grained temporal dynamics. In a recent MEG study on elementary arithmetic, Pinheiro-Chagas and colleagues used MVPA to successfully distinguish between successive additions vs. subtraction. Few studies examined temporal dynamics associated with emotional processing. To the best of our knowledge, no study combined eye-tracking with EEG to investigate a fixation-related temporal decoding of higher cognitive processes. Therefore, we here investigate spatio-temporal dynamics of different emotional states and workload levels within a MVPA approach on fixation-related EEG recordings. We are interested whether we can distinguish between (a) emotional states when processing images with positive, neutral, and negative valence and (b) low and high workload.

Summary (optional shortened abstract)

summary: > A study on fixation-related spatio-temporal EEG decoding of emotional states and workload using multivariate pattern analysis.

tags:

Electroencephalography
EEG
Eye Tracking
Fixation-Locked Analysis
Machine Learning
Time Decoding
Affective and Cognitive Neuroscience
Working Memory Load
Emotional Processing

featured: false

Custom links (optional)

url_pdf: “lingelbach-timedecoding-2021.pdf” url_poster: “poster.pdf” url_video: “https://youtu.be/GzrqpPcZclY" url_code: "” url_dataset: "" url_project: ""

Featured image

image: caption: “Poster on the NEC 21” focal_point: "" preview_only: false

Associated Projects (optional)

projects: []

Slides (optional)

slides: ""