Vision-Guided Active Tactile Perception for Crack Detection and Reconstruction



Jiang, Jiaqi, Cao, Guanqun, Gomes, Daniel Fernandes and Luo, Shan ORCID: 0000-0003-4760-0372
(2021) Vision-Guided Active Tactile Perception for Crack Detection and Reconstruction. In: 2021 29th Mediterranean Conference on Control and Automation (MED), 2021-6-22 - 2021-6-25, Bari, Italy & Virtual.

[img] Text
MED2021.pdf - Author Accepted Manuscript

Download (2MB) | Preview

Abstract

Crack detection is of great significance for monitoring the integrity and well-being of the infrastructure such as bridges and underground pipelines, which are harsh environments for people to access. In recent years, computer vision techniques have been applied in detecting cracks in concrete structures. However, they suffer from variances in light conditions and shadows, lacking robustness and resulting in many false positives. To address the uncertainty in vision, human inspectors actively touch the surface of the structures, guided by vision, which has not been explored in autonomous crack detection. In this paper, we propose a novel approach to detect and reconstruct cracks in concrete structures using vision-guided active tactile perception. Given an RGB-D image of a structure, the rough profile of the crack in the structure surface will first be segmented with a fine-tuned Deep Convolutional Neural Networks, and a set of contact points are generated to guide the collection of tactile images by a camera-based optical tactile sensor. When contacts are made, a pixel-wise mask of the crack can be obtained from the tactile images and therefore the profile of the crack can be refined by aligning the RGB-D image and the tactile images. Extensive experiment results have shown that the proposed method improves the effectiveness and robustness of crack detection and reconstruction significantly, compared to crack detection with vision only, and has the potential to enable robots to help humans with the inspection and repair of the concrete infrastructure.

Item Type: Conference or Workshop Item (Unspecified)
Uncontrolled Keywords: Bioengineering, Neurosciences, 9 Industry, Innovation and Infrastructure
Divisions: Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User: Symplectic Admin
Date Deposited: 13 May 2021 07:38
Last Modified: 15 Mar 2024 14:41
DOI: 10.1109/med51440.2021.9480274
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3122513