Most significant change approach: A guide to assess the programmatic effects.

Abstract

There are many different methods or approaches that can be applied to the evaluation of complex programmes. This paper describes the use of the Most Significant Change (MSC) participatory technique to monitor and evaluate programmatic effects. The MSC is a form of monitoring because it occurs throughout the programme cycle and provides information to manage it. Further, MSC is an evaluation because it provides stories from which programmes’ overall impact can be assessed. However, MSC, a participatory evaluation technique using qualitative approaches, is neglected by many researchers. We hope this study will convince relevant funders and evaluators of the value of the MSC technique and application. This paper offered step-by-step guidelines on how to use the MSC technique when evaluating a large-scale intervention covering perspectives of different beneficiaries within a limited period. The MSC process involves purposively selecting the beneficiaries, collecting the Most Significant (MS) stories, which are then systematically analysed by designated stakeholders and or implemented partners, selected through internal vetting, and external process by involving beneficiaries and stakeholders. The central question focuses on changes in the form of stories such as ‘Who did what?’; ‘When did the change occur?’; and ‘What was the process?’ Additionally, it seeks feedback to explain why particular a story was selected as MS and how the selection process was organised. The MSC technique further attempts to verify the validity, significant, relevant, sustainability of the change, and impact on marginalized or Gender Equality and Social Inclusion (GESI) groups brought by the programme. Furthermore, the technique seeks verification of the MS story by triangulating comprehensive notes and recordings.