Development and external validation of a mixed-effects deep learning model to diagnose COVID-19 from CT imaging.



Bridge, Joshua, Meng, Yanda ORCID: 0000-0001-7344-2174, Zhu, Wenyue, Fitzmaurice, Thomas ORCID: 0000-0002-9334-486X, McCann, Caroline, Addison, Cliff, Wang, Manhui, Merritt, Cristin, Franks, Stu, Mackey, Maria
et al (show 4 more authors) (2023) Development and external validation of a mixed-effects deep learning model to diagnose COVID-19 from CT imaging. Frontiers in medicine, 10. p. 1113030.

Access the full-text of this item by clicking on the Open Access link.

Abstract

<h4>Background</h4>The automatic analysis of medical images has the potential improve diagnostic accuracy while reducing the strain on clinicians. Current methods analyzing 3D-like imaging data, such as computerized tomography imaging, often treat each image slice as individual slices. This may not be able to appropriately model the relationship between slices.<h4>Methods</h4>Our proposed method utilizes a mixed-effects model within the deep learning framework to model the relationship between slices. We externally validated this method on a data set taken from a different country and compared our results against other proposed methods. We evaluated the discrimination, calibration, and clinical usefulness of our model using a range of measures. Finally, we carried out a sensitivity analysis to demonstrate our methods robustness to noise and missing data.<h4>Results</h4>In the external geographic validation set our model showed excellent performance with an AUROC of 0.930 (95%CI: 0.914, 0.947), with a sensitivity and specificity, PPV, and NPV of 0.778 (0.720, 0.828), 0.882 (0.853, 0.908), 0.744 (0.686, 0.797), and 0.900 (0.872, 0.924) at the 0.5 probability cut-off point. Our model also maintained good calibration in the external validation dataset, while other methods showed poor calibration.<h4>Conclusion</h4>Deep learning can reduce stress on healthcare systems by automatically screening CT imaging for COVID-19. Our method showed improved generalizability in external validation compared to previous published methods. However, deep learning models must be robustly assessed using various performance measures and externally validated in each setting. In addition, best practice guidelines for developing and reporting predictive models are vital for the safe adoption of such models.

Item Type: Article
Uncontrolled Keywords: COVID-19, CT, deep learning, diagnosis, imaging
Divisions: Faculty of Health and Life Sciences
Faculty of Health and Life Sciences > Institute of Life Courses and Medical Sciences
Faculty of Health and Life Sciences > Institute of Life Courses and Medical Sciences > School of Medicine
Depositing User: Symplectic Admin
Date Deposited: 19 Sep 2023 07:25
Last Modified: 19 Sep 2023 07:26
DOI: 10.3389/fmed.2023.1113030
Open Access URL: https://www.frontiersin.org/articles/10.3389/fmed....
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3172872