Mari, Tyler, Ali, S Hasan, Pacinotti, Lucrezia, Powsey, Sarah and Fallon, Nicholas 
ORCID: 0000-0003-1451-6983
(2025)
Machine learning classification of active viewing of pain and non-pain images using EEG does not exceed chance in external validation samples
Cognitive, Affective, & Behavioral Neuroscience, 25 (3).
pp. 814-831.
ISSN 1530-7026, 1531-135X
Abstract
Abstract Previous research has demonstrated that machine learning (ML) could not effectively decode passive observation of neutral versus pain photographs by using electroencephalogram (EEG) data. Consequently, the present study explored whether active viewing, i.e., requiring participant engagement in a task, of neutral and pain stimuli improves ML performance. Random forest (RF) models were trained on cortical event-related potentials (ERPs) during a two-alternative forced choice paradigm, whereby participants determined the presence or absence of pain in photographs of facial expressions and action scenes. Sixty-two participants were recruited for the model development sample. Moreover, a within-subject temporal validation sample was collected, consisting of 27 subjects. In line with our previous research, three RF models were developed to classify images into faces and scenes, neutral and pain scenes, and neutral and pain expressions. The results demonstrated that the RF successfully classified discrete categories of visual stimuli (faces and scenes) with accuracies of 78% and 66% on cross-validation and external validation, respectively. However, despite promising cross-validation results of 61% and 67% for the classification of neutral and pain scenes and neutral and pain faces, respectively, the RF models failed to exceed chance performance on the external validation dataset on both empathy classification attempts. These results align with previous research, highlighting the challenges of classifying complex states, such as pain empathy using ERPs. Moreover, the results suggest that active observation fails to enhance ML performance beyond previous passive studies. Future research should prioritise improving model performance to obtain levels exceeding chance, which would demonstrate increased utility.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Empathy, Electroencephalography, Event-related potential, Random forest, Faces |
| Divisions: | Faculty of Health & Life Sciences Faculty of Health & Life Sciences > Inst. Population Health |
| Depositing User: | Symplectic Admin |
| Date Deposited: | 21 Feb 2025 16:49 |
| Last Modified: | 16 Jun 2026 19:51 |
| DOI: | 10.3758/s13415-025-01268-2 |
| Open Access URL: | https://doi.org/10.3758/s13415-025-01268-2 |
| Related Websites: | |
| URI: | https://livrepository.liverpool.ac.uk/id/eprint/3190475 |
| Disclaimer: | The University of Liverpool is not responsible for content contained on other websites from links within repository metadata. Please contact us if you notice anything that appears incorrect or inappropriate. |
Altmetric
Altmetric