This module will focus on how to evaluate the impact of a translational science effort in a healthcare setting. It will include a theoretical introduction to evaluation, including a critical consideration of ‘logic model’ approaches to monitoring and evaluating projects, which address the question; “what were we trying to achieve and to what extent did we achieve it?”.
The module will also cover more theory-driven (critical-interpretivist and realist) approaches to evaluation, which address questions such as;
- whose interests does and should the evaluation serve?
- whose voices are seldom heard and how can we bring these voices to the table?
- how can we evaluate emergent outcomes that shift the focus away from the original programme goals?
Specific approaches, including realist evaluation and utilisation-focused evaluation will be described with illustrative examples.
The module will include hands-on practical advice on how to plan and undertake small-scale evaluations of local translational projects, and also sessions on the critical appraisal of academic and grey literature evaluations of larger (e.g. national-level) translational initiatives. At a more abstract level, the module will also consider how to evaluate the impact of research at a macro level (e.g. in research excellence assessment).
The last date for receipt of complete applications is 5pm Friday 20th December 2024. Regrettably, late applications cannot be accepted.
Course Aims
On completion of this module, we expect our students to be able to:
- Give a critical account of the philosophical assumptions underpinning different approaches to evaluation;
- Explain how qualitative and quantitative research techniques can be adapted and harnessed for evaluation;
- Give examples of how seldom heard voices can be brought into an evaluation;
- Plan an evaluation of a local knowledge translation project, justifying the approach used;
- Critique a published evaluation of a major regional, national or international translational science initiative;
- Critically analyse how the research process and research impact are evaluated
Evaluation methods and techniques to be taught in this module
- Stakeholder mapping
- Logic models and driver diagrams
- Staff and patient surveys (quantitative)
- Ethnography (qualitative)
- Interviews (qualitative)
- Mixed-methods case study
- Use of metrics to evaluate the impact of research
Examples of case studies to be discussed in this module
- Evaluating the distribution and use of pulse oximeters in the community during Covid-19
- Evaluating an intervention to reduce vaccine hesitancy in minority ethnic groups
- Evaluating the capacity of public health organisations to assimilate and use research
- Comparison of UK Applied Research Collaborations (ARCs) with Australian Academic Health Centres (AHCs)
- The UK Research Excellence Framework and similar schemes internationally