A probabilistic metric for the validation of computational models



Dvurecenska, K, Graham, Steve, Patelli, Edoardo ORCID: 0000-0002-5007-7247 and Patterson, Eann ORCID: 0000-0003-4397-2160
(2020) A probabilistic metric for the validation of computational models. Royal Society Open Science, 5 (11). 180687-.

This is the latest version of this item.

[img] Text
A Quantitative Approach_accepted version 011018.pdf - Author Accepted Manuscript

Download (1MB)
[img] Text
rsos.180687.pdf - Published version

Download (1MB)

Abstract

A new validation metric is proposed that combines the use of a threshold based on the uncertainty in the measurement data with a normalized relative error, and that is robust in the presence of large variations in the data. The outcome from the metric is the probability that a model's predictions are representative of the real world based on the specific conditions and confidence level pertaining to the experiment from which the measurements were acquired. Relative error metrics are traditionally designed for use with a series of data values, but orthogonal decomposition has been employed to reduce the dimensionality of data matrices to feature vectors so that the metric can be applied to fields of data. Three previously published case studies are employed to demonstrate the efficacy of this quantitative approach to the validation process in the discipline of structural analysis, for which historical data were available; however, the concept could be applied to a wide range of disciplines and sectors where modelling and simulation play a pivotal role.

Item Type: Article
Uncontrolled Keywords: model validation, relative error, computational modelling, orthogonal decomposition
Depositing User: Symplectic Admin
Date Deposited: 12 Dec 2018 16:38
Last Modified: 19 Jan 2023 01:09
DOI: 10.1098/rsos.180687
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3029875

Available Versions of this Item