Deng, Furong, Zhou, Yu, Song, Sifan 
ORCID: 0000-0002-7940-650X, Jiang, Zijian, Chen, Lifu, Su, Jionglong, Sun, Zhenglong and Zhang, Jiaming
(2021)
Say What You Are Looking At: An Attention-Based Interactive System for Autistic Children.
APPLIED SCIENCES-BASEL, 11 (16).
p. 7426.
|
Text
Autistic Children Attention System.pdf - Open Access published version Download (4MB) | Preview |
Abstract
<jats:p>Gaze-following is an effective way for intention understanding in human–robot interaction, which aims to follow the gaze of humans to estimate what object is being observed. Most of the existing methods require people and objects to appear in the same image. Due to the limitation in the view of the camera, these methods are not applicable in practice. To address this problem, we propose a method of gaze following that utilizes a geometric map for better estimation. With the help of the map, this method is competitive for cross-frame estimation. On the basis of this method, we propose a novel gaze-based image caption system, which has been studied for the first time. Our experiments demonstrate that the system follows the gaze and describes objects accurately. We believe that this system is competent for autistic children’s rehabilitation training, pension service robots, and other applications.</jats:p>
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | human-robot interaction, image caption, simultaneous localization and mapping, visual attention |
| Divisions: | Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science |
| Depositing User: | Symplectic Admin |
| Date Deposited: | 02 Nov 2023 10:17 |
| Last Modified: | 15 Mar 2024 12:21 |
| DOI: | 10.3390/app11167426 |
| Related URLs: | |
| URI: | https://livrepository.liverpool.ac.uk/id/eprint/3176577 |
Dimensions
Dimensions
