Connecting Subspace Learning and Extreme Learning Machine in Speech Emotion Recognition

Xu, Xinzhou, Deng, Jung, Coutinho, E ORCID: 0000-0001-5234-1497, Wu, Chen, Zhao, Li and Schuller, Bjoern W (2019) Connecting Subspace Learning and Extreme Learning Machine in Speech Emotion Recognition. IEEE Transactions on Multimedia, 21 (3). pp. 795-808.

Text Xu18-CSL_Final Version.pdf - Author Accepted Manuscript Download (11MB)

Abstract

Speech Emotion Recognition (SER) is a powerful tool for endowing computers with the capacity to process information about the affective states of users in human-machine interactions. Recent research has shown the effectiveness of graph embedding based subspace learning and extreme learning machine applied to SER, but there are still various drawbacks in these two techniques that limit their application. Regarding subspace learning, the change from linearity to nonlinearity is usually achieved through kernelisation, while extreme learning machines only take label information into consideration at the output layer. In order to overcome these drawbacks, this paper leverages extreme learning machine for dimensionality reduction and proposes a novel framework to combine spectral regression based subspace learning and extreme learning machine. The proposed framework contains three stages - data mapping, graph decomposition, and regression. At the data mapping stage, various mapping strategies provide different views of the samples. At the graph decomposition stage, specifically designed embedding graphs provide a possibility to better represent the structure of data, through generating virtual coordinates. Finally, at the regression stage, dimension-reduced mappings are achieved by connecting the virtual coordinates and data mapping. Using this framework, we propose several novel dimensionality reduction algorithms, apply them to SER tasks, and compare their performance to relevant state-of-the-art methods. Our results on several paralinguistic corpora show that our proposed techniques lead to significant improvements.

Item Type:	Article
Uncontrolled Keywords:	Speech emotion recognition, extreme learning machine, subspace learning, graph embedding, spectral regression
Depositing User:	Symplectic Admin
Date Deposited:	29 Aug 2018 09:06
Last Modified:	19 Jan 2023 01:26
DOI:	10.1109/TMM.2018.2865834
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3025633