Automatic Pavement Defect Detection and Classification Using RGB-Thermal Images Based on Hierarchical Residual Attention Network

Chen, Cheng, Chandra, Sindhu and Seo, Hyungjoon (2022) Automatic Pavement Defect Detection and Classification Using RGB-Thermal Images Based on Hierarchical Residual Attention Network. SENSORS, 22 (15). 5781-.

Access the full-text of this item by clicking on the Open Access link.

Official URL: http://dx.doi.org/10.3390/s22155781

Abstract

A convolutional neural network based on an improved residual structure is proposed to implement a lightweight classification model for the recognition of complex pavement conditions, which uses RGB-thermal as input and embeds an attention module to adjust the spatial, as well as channel, information of the images. The best prediction accuracy of the proposed model is 98.88%, while the RGB-thermal is used as input and an attention mechanism is used. The attention mechanism increases the attention to detail of the image and regulates the use of image channels, which enhances the final performance of the model. It is also compared with state-of-the-art (SOTA) deep learning models, indicating our model has fewer parameters, shorter training time, and higher recognition accuracy compared to existing image classification models. A visualization method incorporating gradient-weighted class activation mapping (Grad-CAM) is proposed to analyze the classification results, comparing the data the model learns from the images under different input data.

Item Type:	Article
Uncontrolled Keywords:	attention mechanism, deep learning, hierarchical residual attention network, pavement defect classification, visual interpretation
Depositing User:	Symplectic Admin
Date Deposited:	05 Oct 2022 06:32
Last Modified:	18 Jan 2023 20:40
DOI:	10.3390/s22155781
Open Access URL:	https://doi.org/10.3390/s22155781
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3165152