Deep Learning-Based Thermal Image Analysis for Pavement Defect Detection and Classification Considering Complex Pavement Conditions



Chen, Cheng, Chandra, Sindhu, Han, Yufan and Seo, Hyungjoon
(2022) Deep Learning-Based Thermal Image Analysis for Pavement Defect Detection and Classification Considering Complex Pavement Conditions. REMOTE SENSING, 14 (1). p. 106.

Access the full-text of this item by clicking on the Open Access link.

Abstract

<jats:p>Automatic damage detection using deep learning warrants an extensive data source that captures complex pavement conditions. This paper proposes a thermal-RGB fusion image-based pavement damage detection model, wherein the fused RGB-thermal image is formed through multi-source sensor information to achieve fast and accurate defect detection including complex pavement conditions. The proposed method uses pre-trained EfficientNet B4 as the backbone architecture and generates an argument dataset (containing non-uniform illumination, camera noise, and scales of thermal images too) to achieve high pavement damage detection accuracy. This paper tests separately the performance of different input data (RGB, thermal, MSX, and fused image) to test the influence of input data and network on the detection results. The results proved that the fused image’s damage detection accuracy can be as high as 98.34% and by using the dataset after augmentation, the detection model deems to be more stable to achieve 98.35% precision, 98.34% recall, and 98.34% F1-score.</jats:p>

Item Type: Article
Uncontrolled Keywords: pavement defect detection, machine learning, thermal analysis, multichannel image fusion
Divisions: Faculty of Science and Engineering > School of Engineering
Depositing User: Symplectic Admin
Date Deposited: 10 Jan 2022 14:43
Last Modified: 15 Mar 2024 14:56
DOI: 10.3390/rs14010106
Open Access URL: https://doi.org/10.3390/rs14010106
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3146137