Solving Feature Sparseness in Text Classification using Core-Periphery Decomposition



Cui, Xia ORCID: 0000-0002-1726-3814, Kojaku, Sadamori, Masuda, Naoki and Bollegala, Danushka ORCID: 0000-0003-4476-7003
(2018) Solving Feature Sparseness in Text Classification using Core-Periphery Decomposition. In: Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics, 2018-6 - 2018-6, New Orleans, USA.

[img] Text
solving-feature-sparseness.pdf - Author Accepted Manuscript

Download (466kB)

Abstract

Feature sparseness is a problem common to cross-domain and short-text classification tasks. To overcome this feature sparseness problem, we propose a novel method based on graph decomposition to find candidate features for expanding feature vectors. Specifically, we first create a feature-relatedness graph, which is subsequently decomposed into core-periphery (CP) pairs and use the peripheries as the expansion candidates of the cores. We expand both training and test instances using the computed related features and use them to train a text classifier. We observe that prioritising features that are common to both training and test instances as cores during the CP decomposition to further improve the accuracy of text classification. We evaluate the proposed CP-decomposition-based feature expansion method on benchmark datasets for cross-domain sentiment classification and short-text classification. Our experimental results show that the proposed method consistently outperforms all baselines on short-text classification tasks, and perform competitively with pivot-based cross-domain sentiment classification methods.

Item Type: Conference or Workshop Item (Unspecified)
Depositing User: Symplectic Admin
Date Deposited: 18 Apr 2018 14:47
Last Modified: 15 Mar 2024 02:26
DOI: 10.18653/v1/s18-2030
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3020274