3D Dense Face Alignment with Fused Features by Aggregating CNNs and GCNs

Meng, Yanda ORCID: 0000-0001-7344-2174, Chen, Xu, Gao, Dongxu, Zhao, Yitian, Yang, Xiaoyun, Qiao, Yihong, Huang, Xiaowei and Zheng, Yalin ORCID: 0000-0002-7873-0922 (2022) 3D Dense Face Alignment with Fused Features by Aggregating CNNs and GCNs. [Preprint]

Access the full-text of this item by clicking on the Open Access link.

Abstract

In this paper, we propose a novel multi-level aggregation network to regress the coordinates of the vertices of a 3D face from a single 2D image in an end-to-end manner. This is achieved by seamlessly combining standard convolutional neural networks (CNNs) with Graph Convolution Networks (GCNs). By iteratively and hierarchically fusing the features across different layers and stages of the CNNs and GCNs, our approach can provide a dense face alignment and 3D face reconstruction simultaneously for the benefit of direct feature learning of 3D face mesh. Experiments on several challenging datasets demonstrate that our method outperforms state-of-the-art approaches on both 2D and 3D face alignment tasks.

Item Type:	Preprint
Uncontrolled Keywords:	cs.CV, cs.CV
Divisions:	Faculty of Health and Life Sciences Faculty of Health and Life Sciences > Institute of Life Courses and Medical Sciences
Depositing User:	Symplectic Admin
Date Deposited:	25 Apr 2022 13:23
Last Modified:	18 Jan 2023 21:04
Open Access URL:	https://arxiv.org/pdf/2203.04643.pdf
Related URLs:	Author
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3153761