Decoding speech information from EEG data with 4-, 7- and 11-month-old infants: Using convolutional neural network, mutual information-based and backward linear models.


Keshavarzi, Mahmoud, Choisdealbha, Áine Ní, Attaheri, Adam, Rocha, Sinead, Brusini, Perrine ORCID: 0000-0003-0703-7765, Gibbon, Samuel, Boutris, Panagiotis, Mead, Natasha, Olawole-Scott, Helen, Ahmed, Henna et al (show 3 more authors) (2023) Decoding speech information from EEG data with 4-, 7- and 11-month-old infants: Using convolutional neural network, mutual information-based and backward linear models. Journal of neuroscience methods, 403. p. 110036.

[img] Text
Mahmoud_DecodingSpeechInformation_2023_Natmetho.pdf - Open Access published version
Download (817kB) | Preview

Abstract

<h4>Background</h4>Computational models that successfully decode neural activity into speech are increasing in the adult literature, with convolutional neural networks (CNNs), backward linear models, and mutual information (MI) models all being applied to neural data in relation to speech input. This is not the case in the infant literature.<h4>New method</h4>Three different computational models, two novel for infants, were applied to decode low-frequency speech envelope information. Previously-employed backward linear models were compared to novel CNN and MI-based models. Fifty infants provided EEG recordings when aged 4, 7, and 11 months, while listening passively to natural speech (sung or chanted nursery rhymes) presented by video with a female singer.<h4>Results</h4>Each model computed speech information for these nursery rhymes in two different low-frequency bands, delta and theta, thought to provide different types of linguistic information. All three models demonstrated significant levels of performance for delta-band neural activity from 4 months of age, with two of three models also showing significant performance for theta-band activity. All models also demonstrated higher accuracy for the delta-band neural responses. None of the models showed developmental (age-related) effects.<h4>Comparisons with existing methods</h4>The data demonstrate that the choice of algorithm used to decode speech envelope information from neural activity in the infant brain determines the developmental conclusions that can be drawn.<h4>Conclusions</h4>The modelling shows that better understanding of the strengths and weaknesses of each modelling approach is fundamental to improving our understanding of how the human brain builds a language system.

Item Type: Article
Uncontrolled Keywords: Brain, Humans, Electroencephalography, Linear Models, Speech, Speech Perception, Adult, Infant, Female, Neural Networks, Computer
Divisions: Faculty of Health and Life Sciences
Faculty of Health and Life Sciences > Institute of Population Health
Depositing User: Symplectic Admin
Date Deposited: 09 Jan 2024 11:50
Last Modified: 10 Feb 2024 01:41
DOI: 10.1016/j.jneumeth.2023.110036
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3177713
Dimensions
Altmetric
CORE (COnnecting REpositories)