Record Details

Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations

CGSpace

View Archive Info
 
 
Field Value
 
Title Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations
 
Creator Belcher, B.
Hughes, K.
 
Subject impact assessment
evaluation
research
innovation
development policies
 
Description Researchers and research organizations are under increasing pressure to demonstrate that their work contributes to positive change and helps solve pressing societal challenges. There is a simultaneous trend towards more engaged transdisciplinary research that is complexity-aware and appreciates that change happens through systems transformation, not only through technological innovation. Appropriate evaluation approaches are needed to evidence research impact and generate learning for continual improvement. This is challenging in any research field, but especially for research that crosses disciplinary boundaries and intervenes in complex systems. Moreover, evaluation challenges at the project scale are compounded at the programme scale. The Forest, Trees and Agroforestry (FTA) research programme serves as an example of this evolution in research approach and the resulting evaluation challenges. FTA research is responding to the demand for greater impact with more engaged research following multiple pathways. However, research impact assessment in the CGIAR (Consultative Group on International Agricultural Research) was developed in a technology-centric context where counterfactual approaches of causal inference (experimental and quasi-experimental) predominate. Relying solely on such approaches is inappropriate for evaluating research contributions that target policy and institutional change and systems transformation. Instead, we propose a multifaceted, multi-scale, theory-based evaluation approach. This includes nested project- and programme-scale theories of change (ToCs); research quality assessment; theory-based outcome evaluations to empirically test ToCs and assess policy, institutional, and practice influence; experimental and quasi-experimental impact of FTA-informed ‘large n’ innovations; ex ante impact assessment to estimate potential impacts at scale; and logically and plausibly linking programme-level outcomes to secondary data on development and conservation status.
 
Date 2021-10-19
2021-03-08T08:14:49Z
2021-03-08T08:14:49Z
 
Type Journal Article
 
Identifier Belcher, B.M. and Hughes, K., 2020. Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations. Research Evaluation. https://doi.org/10.1093/reseval/rvaa024
0958-2029
1471-5449
https://hdl.handle.net/10568/111879
https://www.cifor.org/library/7851
https://doi.org/10.1093/reseval/rvaa024
 
Language en
 
Rights CC-BY-NC-4.0
Open Access
 
Publisher Oxford University Press (OUP)