Attributes and action recognition based on convolutional neural networks and spatial pyramid VLAD encoding

Yan, S, Smith, JS ORCID: 0000-0002-0212-2365 and Zhang, B (2017) Attributes and action recognition based on convolutional neural networks and spatial pyramid VLAD encoding. In: 2016 Asian Conference on Computer Vision - Workshop, 2016-11-24 - 2016-11-24, Taipei, Taiwan.

Access the full-text of this item by clicking on the Open Access link.

Text
accv2016finalpaper.pdf - Author Accepted Manuscript
Download (3MB)

Official URL: http://dx.doi.org/10.1007/978-3-319-54526-4_37

Abstract

© Springer International Publishing AG 2017.Determination of human attributes and recognition of actions in still images are two related and challenging tasks in computer vision, which often appear in fine-grained domains where the distinctions between the different categories are very small. Deep Convolutional Neural Network (CNN) models have demonstrated their remarkable representational learning capability through various examples. However, the successes are very limited for attributes and action recognition as the potential of CNNs to acquire both of the global and local information of an image remains largely unexplored. This paper proposes to tackle the problem with an encoding of a spatial pyramid Vector of Locally Aggregated Descriptors (VLAD) on top of CNN features. With region proposals generated by Edgeboxes, a compact and efficient representation of an image is thus produced for subsequent prediction of attributes and classification of actions. The proposed scheme is validated with competitive results on two benchmark datasets: 90.4% mean Average Precision (mAP) on the Berkeley Attributes of People dataset and 88.5% mAP on the Stanford 40 action dataset.

Item Type:	Conference or Workshop Item (Unspecified)
Uncontrolled Keywords:	1.2 Psychological and socioeconomic processes, 1 Underpinning research
Depositing User:	Symplectic Admin
Date Deposited:	07 Apr 2017 09:59
Last Modified:	15 Mar 2024 00:56
DOI:	10.1007/978-3-319-54526-4_37
Open Access URL:	http://link.springer.com/chapter/10.1007/978-3-319...
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3006845