Sun, Youcheng, Huang, Xiaowei 
ORCID: 0000-0001-6267-0366, Kroening, Daniel, Sharp, James, Hill, Matthew and Ashmore, Rob
(2019)
Structural Test Coverage Criteria for Deep Neural Networks.
2019 IEEE/ACM 41ST INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: COMPANION PROCEEDINGS (ICSE-COMPANION 2019).
pp. 320-321.
|
Text
main.pdf - Author Accepted Manuscript Download (1MB) | Preview |
Abstract
Deep Neural Networks (DNNs) have a wide range of applications, and software employing them must be thoroughly tested, especially in safety-critical domains. However, traditional software test coverage metrics cannot be applied directly to DNNs. In this paper, inspired by the MC/DC coverage criterion, we propose four novel test criteria that are tailored to structural features of DNNs and their semantics. We validate the criteria by demonstrating that the generated test inputs, guided by our coverage criteria, are able to capture undesirable behaviours in DNNs. Test cases are generated using both a symbolic approach and a gradient-based heuristic. Our experiments are conducted on state-of-the-art DNNs, obtained using the MNIST and ImageNet datasets.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Neurosciences |
| Depositing User: | Symplectic Admin |
| Date Deposited: | 10 Sep 2019 10:35 |
| Last Modified: | 15 Mar 2024 13:59 |
| DOI: | 10.1109/ICSE-Companion.2019.00134 |
| Related URLs: | |
| URI: | https://livrepository.liverpool.ac.uk/id/eprint/3050535 |
Dimensions
Dimensions
