Self-evaluation vs. objective performance measures: evaluation of fidelity, presence and training transfer in two helicopter simulator tasks

Wong, Li Ting Self-evaluation vs. objective performance measures: evaluation of fidelity, presence and training transfer in two helicopter simulator tasks. Master of Philosophy thesis, University of Liverpool.

Text WongLiT_Sep2014_2008671.pdf - Unspecified Available under License Creative Commons Attribution. Download (1MB)

Abstract

Simulations are widely used in aviation, medical and military training. Simulation fidelity is an important element of simulation training development. This study explores the reliability of self-evaluation of fidelity and training transfer in comparison to objective performance measures in two experiments. In Experiment 1, fifteen participants (aged 20-32, mean= 23.1) completed a target-tracking task in the HELIFLIGHT simulator at the University of Liverpool. They then underwent training on a desktop-based helicopter simulator with basic visuals and a realistic turbine rotor noise as their only motion cues before being re-tested in HELIFLIGHT. Motion cue fidelity was manipulated to explore effects on subjective post-training ratings of fidelity and self-performance. In Experiment 2, eleven participants (aged 22-27, mean= 24.2) performed a hover task in HELIFLIGHT. As in Experiment 1, they then trained on a desktop-simulator before being retested in HELIFLIGHT. Again, cue fidelity was manipulated to explore effects on ratings of fidelity and self-performance, but also on sensation of presence. In both experiments, subjective post-trial ratings were compared with continuously-sampled objective measures. Both experiments showed that participants benefited from transferrable training from desktop simulator to full flight simulator. However, participants could not always reliably evaluate their own performance (Experiment 1). Additionally, participants could not always reliably judge cue fidelity (Experiment 1), and fidelity judgements did not always correspond with objective performance measures (Experiments 1 and 2). Self-evaluation of training also did not reflect objective measures of performance (Experiments 1 and 2), but participants did report greater subjective presence with multisensory motion cues compared to without. These findings contribute to the exploration of suitable metrics for fidelity, presence and performance evaluation.

Item Type:	Thesis (Master of Philosophy)
Additional Information:	Date: 2014-09-02 (completed)
Subjects:	?? BF ?? ?? Q1 ?? ?? T1 ?? ?? U1 ??
Depositing User:	Symplectic Admin
Date Deposited:	05 Aug 2015 08:34
Last Modified:	17 Dec 2022 00:50
DOI:	10.17638/02008671
URI:	https://livrepository.liverpool.ac.uk/id/eprint/2008671