Understanding and developing procedures for video-based assessment in medical education



Yeates, Peter, Moult, Alice, Lefroy, Janet, Walsh-House, Jacqualyn, Clews, Lorraine, McKinley, Robert and Fuller, Richard ORCID: 0000-0001-7965-4864
(2020) Understanding and developing procedures for video-based assessment in medical education. Medical Teacher, 42 (11). pp. 1250-1260.

Access the full-text of this item by clicking on the Open Access link.
[img] Text
Understanding and developing procedures for video based assessment in medical education.pdf - Published version

Download (1MB) | Preview

Abstract

Introduction Novel uses of video aim to enhance assessment in health-professionals education. Whilst these uses presume equivalence between video and live scoring, some research suggests that poorly understood variations could challenge validity. We aimed to understand examiners’ and students’ interaction with video whilst developing procedures to promote its optimal use. Methods Using design-based research we developed theory and procedures for video use in assessment, iteratively adapting conditions across simulated OSCE stations. We explored examiners’ and students’ perceptions using think-aloud, interviews and focus group. Data were analysed using constructivist grounded-theory methods. Results Video-based assessment produced detachment and reduced volitional control for examiners. Examiners ability to make valid video-based judgements was mediated by the interaction of station content and specifically selected filming parameters. Examiners displayed several judgemental tendencies which helped them manage videos’ limitations but could also bias judgements in some circumstances. Students rarely found carefully-placed cameras intrusive and considered filming acceptable if adequately justified. Discussion Successful use of video-based assessment relies on balancing the need to ensure station-specific information adequacy; avoiding disruptive intrusion; and the degree of justification provided by video’s educational purpose. Video has the potential to enhance assessment validity and students’ learning when an appropriate balance is achieved.

Item Type: Article
Uncontrolled Keywords: Objective Structured Clinical Examinations (OSCEs), performance assessment, video-based assessment, assessor cognition, validity
Depositing User: Symplectic Admin
Date Deposited: 11 Sep 2020 10:25
Last Modified: 18 Jan 2023 23:33
DOI: 10.1080/0142159X.2020.1801997
Open Access URL: https://doi.org/10.1080/0142159X.2020.1801997
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3100799