Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi.



Gooding, Kate ORCID: 0000-0003-4926-0287, Makwinja, Regina, Nyirenda, Deborah ORCID: 0000-0002-5867-4687, Vincent, Robin and Sambakunsi, Rodrick
(2018) Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi. Wellcome open research, 3. 8-.

Access the full-text of this item by clicking on the Open Access link.
[img] Text
Using theories of change to design monitoring and evaluation of community engagement in research experiences from a research.pdf - Author Accepted Manuscript

Download (2MB) | Preview

Abstract

<b>Background:</b> Evaluation of community and public engagement in research is important to deepen understanding of how engagement works and to enhance its effectiveness. Theories of change have been recommended for evaluating community engagement, for their ability to make explicit intended outcomes and understandings of how engagement activities contribute to these outcomes. However, there are few documented examples of using theories of change for evaluation of engagement. This article reports experience of using theories of change to develop a framework for evaluating community engagement in research at a clinical research organisation in Malawi. We describe the steps used to develop theories of change, and the way theories of change were used to design data collection plans. Based on our experience, we reflect on the advantages and challenges of the theory of change approach. <b>Methods:</b> The theories of change and evaluation framework were developed through a series of workshops and meetings between engagement practitioners, monitoring and evaluation staff, and researchers. We first identified goals for engagement, then used 'so that' chains to clarify pathways and intermediate outcomes between engagement activities and goals. Further meetings were held to refine initial theories of change, identify priority information needs, and define feasible evaluation methods. <b>Results:</b> The theory of change approach had several benefits. In particular, it helped to construct an evaluation framework focused on relevant outcomes and not just activities. The process of reflecting on intended goals and pathways also helped staff to review the design of engagement activities. Challenges included practical considerations around time to consider evaluation plans among practitioners (a challenge for evaluation more generally regardless of method), and more fundamental difficulties related to identifying feasible and agreed outcomes. <b>Conclusions:</b> These experiences from Malawi provide lessons for other research organisations considering use of theories of change to support evaluation of community engagement.

Item Type: Article
Uncontrolled Keywords: community engagement, evaluation, public engagement, theory of change
Divisions: Faculty of Health and Life Sciences
Faculty of Health and Life Sciences > Institute of Infection, Veterinary and Ecological Sciences
Depositing User: Symplectic Admin
Date Deposited: 17 Jun 2021 13:28
Last Modified: 18 Jan 2023 22:50
DOI: 10.12688/wellcomeopenres.13790.1
Open Access URL: https://wellcomeopenresearch.org/articles/3-8/v1
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3120712