Exploring Spatial-Temporal Representation via Star Graph for mmWave Radar-based Human Activity Recognition



Gao, Senhao, Zhang, Junqing ORCID: 0000-0002-3502-2926, Mei, Luoyu, Wang, Shuai and Wang, Xuyu
(2025) Exploring Spatial-Temporal Representation via Star Graph for mmWave Radar-based Human Activity Recognition IEEE Transactions on Mobile Computing, PP (99). pp. 1-16. ISSN 1536-1233, 1558-0660

[thumbnail of manuscript.pdf] Text
manuscript.pdf - Author Accepted Manuscript
Available under License Creative Commons Attribution.

Download (5MB) | Preview

Abstract

Human activity recognition (HAR) requires extracting accurate spatial-temporal features with human movements. A mmWave radar point cloud-based HAR system suffers from sparsity and variable-size problems due to the physical features of the mmWave signal. Existing works usually borrow the preprocessing algorithms for the vision-based systems with dense point clouds, which may not be optimal for mmWave radar systems. In this work, we proposed a graph representation with a discrete dynamic graph neural network (DDGNN) to explore the spatial-temporal representation of human movement-related features. Specifically, we designed a star graph to describe the high-dimensional relative relationship between a manually added static center point and the dynamic mmWave radar points in the same and consecutive frames. We then adopted DDGNN to learn the features residing in the star graph with variable sizes. Experimental results demonstrated that our approach outperformed other baseline methods using real-world HAR datasets. Our system achieved an overall classification accuracy of 94.27%, which gets the near-optimal performance with a vision based skeleton data accuracy of 97.25%. We also conducted an inference test on Raspberry Pi 4 to demonstrate its effectiveness on resource-constraint platforms. We provided a comprehensive ablation study for variable DDGNN structures to validate our model design. Our system also outperformed three recent radar specific methods without requiring resampling or frame aggregators.

Item Type: Article
Uncontrolled Keywords: 4605 Data Management and Data Science, 46 Information and Computing Sciences, 40 Engineering, 4611 Machine Learning
Divisions: Faculty of Science & Engineering
Faculty of Science & Engineering > School of Computer Science & Informatics
Faculty of Science & Engineering > School of Computer Science & Informatics > Trustworthy Computing
Depositing User: Symplectic Admin
Date Deposited: 12 Nov 2025 08:10
Last Modified: 13 Dec 2025 17:09
DOI: 10.1109/tmc.2025.3634221
Related Websites:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3195325
Disclaimer: The University of Liverpool is not responsible for content contained on other websites from links within repository metadata. Please contact us if you notice anything that appears incorrect or inappropriate.