The multiple voices of musical emotions: source separation for improving music emotion recognition models and their interpretability


de Berardinis, Jacopo, Cangelosi, Angelo and Coutinho, Eduardo ORCID: 0000-0001-5234-1497 (2020) The multiple voices of musical emotions: source separation for improving music emotion recognition models and their interpretability. In: 21st International Society for Music Information Retrieval Conference, 2020-10-11 - 2020-10-17, Online.

[img] Text
308.pdf - Published version
Download (487kB) | Preview

Abstract

Despite the manifold developments in music emotion recognition and related areas, estimating the emotional impact of music still poses many challenges. These are often associated to the complexity of the acoustic codes to emotion and the lack of large amounts of data with robust golden standards. In this paper, we propose a new computational model (EmoMucs) that considers the role of different musical voices in the prediction of the emotions induced by music. We combine source separation algorithms for breaking up music signals into independent song elements (vocals, bass, drums, other) and end-to-end state-of-the-art machine learning techniques for feature extraction and emotion modelling (valence and arousal regression). Through a series of computational experiments on a benchmark dataset using source-specialised models trained independently and different fusion strategies, we demonstrate that EmoMucs outperforms state-of-the-art approaches with the advantage of providing insights into the relative contribution of different musical elements to the emotions perceived by listeners.

Item Type: Conference or Workshop Item (Unspecified)
Additional Information: Video presentation: https://youtu.be/Bj4RAaFqqLo.
Uncontrolled Keywords: Musical features and properties, Musical affect, emotion, and mood, Domain knowledge, Machine learning/Artificial intelligence for music, MIR tasks, Sound source separation
Depositing User: Symplectic Admin
Date Deposited: 26 Oct 2020 10:05
Last Modified: 18 Jan 2023 23:26
URI: https://livrepository.liverpool.ac.uk/id/eprint/3105085
CORE (COnnecting REpositories)