Self-Tuned Descriptive Document Clustering Using a Predictive Network

Brockmeier, Austin J ORCID: 0000-0002-7293-8140, Mu, Tingting ORCID: 0000-0001-6315-3432, Ananiadou, Sophia ORCID: 0000-0002-4097-9191 and Goulermas, John Y ORCID: 0000-0003-0381-124X (2018) Self-Tuned Descriptive Document Clustering Using a Predictive Network. IEEE Transactions on Knowledge and Data Engineering, 30 (10). pp. 1929-1942.

Text 77_TKDE descr-clust (pre-print).pdf - Author Accepted Manuscript Download (2MB)

Abstract

Descriptive clustering consists of automatically organizing data instances into clusters and generating a descriptive summary for each cluster. The description should inform a user about the contents of each cluster without further examination of the specific instances, enabling a user to rapidly scan for relevant clusters. Selection of descriptions often relies on heuristic criteria. We model descriptive clustering as an auto-encoder network that predicts features from cluster assignments and predicts cluster assignments from a subset of features. The subset of features used for predicting a cluster serves as its description. For text documents, the occurrence or count of words, phrases, or other attributes provides a sparse feature representation with interpretable feature labels. In the proposed network, cluster predictions are made using logistic regression models, and feature predictions rely on logistic or multinomial regression models. Optimizing these models leads to a completely self-tuned descriptive clustering approach that automatically selects the number of clusters and the number of features for each cluster. We applied the methodology to a variety of short text documents and showed that the selected clustering, as evidenced by the selected feature subsets, are associated with a meaningful topical organization.

Item Type:	Article
Uncontrolled Keywords:	Bioengineering
Depositing User:	Symplectic Admin
Date Deposited:	04 Dec 2017 09:01
Last Modified:	16 Mar 2024 20:18
DOI:	10.1109/tkde.2017.2781721
Related URLs:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3013429