Coverage Probability Fails to Ensure Reliable Inference

Balch, Michael, Martin, Ryan and Ferson, Scott ORCID: 0000-0002-2613-0650 (2019) Coverage Probability Fails to Ensure Reliable Inference. Proceedings of the Royal Society of London. Mathematical, Physical and Engineering Sciences, 475 (2227). p. 20180565.

Text
1706.08565v5.pdf - Submitted version
Download (1MB) | Preview

Official URL: http://dx.doi.org/10.1098/rspa.2018.0565

Abstract

Satellite conjunction analysis is the assessment of collision risk during a close encounter between a satellite and another object in orbit. A counterintuitive phenomenon has emerged in the conjunction analysis literature, namely, probability dilution, in which lower quality data paradoxically appear to reduce the risk of collision. We show that probability dilution is a symptom of a fundamental deficiency in probabilistic representations of statistical inference, in which there are propositions that will consistently be assigned a high degree of belief, regardless of whether or not they are true. We call this deficiency false confidence. In satellite conjunction analysis, it results in a severe and persistent underestimate of collision risk exposure. We introduce the Martin--Liu validity criterion as a benchmark by which to identify statistical methods that are free from false confidence. Such inferences will necessarily be non-probabilistic. In satellite conjunction analysis, we show that uncertainty ellipsoids satisfy the validity criterion. Performing collision avoidance maneuvers based on ellipsoid overlap will ensure that collision risk is capped at the user-specified level. Further, this investigation into satellite conjunction analysis provides a template for recognizing and resolving false confidence issues as they occur in other problems of statistical inference.

Item Type:	Article
Additional Information:	18 pages, 3 figures
Uncontrolled Keywords:	belief functions, filter estimates, space situational awareness, statistical theory and methods
Depositing User:	Symplectic Admin
Date Deposited:	18 Oct 2019 07:55
Last Modified:	19 Jan 2023 00:22
DOI:	10.1098/rspa.2018.0565
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3058489