A randomized trial comparing three Delphi feedback strategies found no evidence of a difference in a setting with high initial agreement

MacLennan, Steven, Kirkham, Jamie ORCID: 0000-0003-2579-9325, Lam, Thomas BL and Williamson, Paula R ORCID: 0000-0001-9802-6636 (2018) A randomized trial comparing three Delphi feedback strategies found no evidence of a difference in a setting with high initial agreement. JOURNAL OF CLINICAL EPIDEMIOLOGY, 93. pp. 1-8.

	Text C:\Users\jjk\Desktop\MacLennan-2017-Delphi feedback strategies.pdf - Submitted version Download (1MB)
	Text C:\Users\jjk\Desktop\MANUSCRIPT_Maclennan et al_Delphi Feedback RCT_RESUBMIT_V2.docx - Author Accepted Manuscript Download (49kB)

Abstract

<h4>Objectives</h4>The objective of the study was to explore the impact of different feedback strategies on (1) subsequent agreement and (2) variability in Delphi studies.<h4>Study design and setting</h4>A two-round Delphi survey, with a list of outcomes generated from the results of a systematic review and interviews, was undertaken while developing a core outcomes set for prostate cancer including two stakeholder groups (health professionals and patients). Seventy-nine outcomes were scored on a scale of one (not important) to nine (critically important). Participants were randomized in round 2 to receive round 1 feedback from peers only, multiple stakeholders separately, or multiple stakeholders combined.<h4>Results</h4>Agreement on outcomes retained for all feedback groups was high (peer: 92%, multiple separate: 90%, multiple combined: 84%). There were no statistically significant reduction in variability for peer vs. multiple separate (0.016 [-0.035, 0.067]; P = 0.529), or multiple separate vs. multiple combined feedback (0.063 [-0.003, 0.129]; P = 0.062). Peer feedback statistically significantly reduced variability compared with multiple combined feedback (0.079 [0.001, 0.157]; P = 0.046).<h4>Conclusions</h4>We found no evidence of a difference between different feedback strategies in terms of the number of outcomes retained or reduction in variability of opinion. However, this may be explained by the high level of existing agreement in round 1. Further methodological studies nested within Delphi surveys will help clarify the best strategy.

Item Type:	Article
Uncontrolled Keywords:	Consensus methods, Core outcome set development, Delphi study, RCT, Stakeholders, Feedback strategies
Depositing User:	Symplectic Admin
Date Deposited:	22 Jan 2018 09:01
Last Modified:	19 Jan 2023 06:43
DOI:	10.1016/j.jclinepi.2017.09.024
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3016569

Available Versions of this Item

• A randomized trial comparing three Delphi feedback strategies found no evidence of a difference in a setting with high initial agreement. (deposited 07 Nov 2017 08:09)
  • A randomized trial comparing three Delphi feedback strategies found no evidence of a difference in a setting with high initial agreement. (deposited 22 Jan 2018 09:01) [Currently Displayed]