The Most Significant Change Technique: Story-Based Course Evaluation That Surfaces What Students Actually Value

In brief. The Most Significant Change (MSC) technique, developed by Rick Davies and Jess Dart, is a participatory, story-based evaluation method: you invite students to describe the most significant change in their learning and why it matters to them, then panels of staff and stakeholders read batches of stories and collectively choose the most significant, documenting why they chose it. MSC is not a replacement for a Likert form — it captures unanticipated, hard-to-quantify, transformative outcomes that rating scales miss, and its selection process forces staff to make explicit what they actually value in teaching. Use it at programme, capstone or work-integrated-learning level, as a supplement to numeric evaluation, not instead of it.

What ratings cannot see

A five-point scale is good at answering questions you already knew to ask. It tells you the mean rating for "assessment was fair" and lets you benchmark it against last year. What it cannot do is tell you that a placement module quietly changed a student's sense of whether they belonged in the profession, or that a single seminar shifted how a cohort thinks about evidence. Those outcomes are unanticipated, individual and narrative — precisely the things a fixed questionnaire is designed to exclude. And because closing the feedback loop depends on knowing what genuinely mattered to students, an evaluation system that only measures pre-specified dimensions can systematically miss its most important effects.

The Most Significant Change technique exists to capture exactly that class of outcome.

What the research says

MSC was created in the mid-1990s and codified in the widely cited guide by Davies and Dart (2005), The "Most Significant Change" (MSC) Technique: A Guide to Its Use. The guide describes MSC as a participatory method of collecting and analysing stories of significant change from the field, best suited to large, open-ended, complex programmes whose impacts are difficult to monitor with conventional quantitative methods. It represents a deliberate shift away from expert-driven, indicator-based evaluation toward a participant-driven, qualitative approach focused on human impact.

Mechanically, MSC runs through roughly ten steps, but the heart of it is simple. First, participants (here, students) answer an open, deliberately unconstrained prompt — something like: "Looking back over this module, what do you think was the most significant change in you as a learner, and why is that change significant to you?" Second, the resulting stories are read by panels arranged in a hierarchy — a course team, then a programme committee, for example. At each level the panel reads a batch, discusses them, and selects the single most significant story, recording the reasons for the choice. The stories that rise through the hierarchy, and the documented reasons for selecting them, become the evaluation output.

Two features make this more than "collecting testimonials." One, the selection dialogue is itself the point: when a course team argues about which change is most significant, they are forced to articulate and negotiate their implicit criteria for what good teaching and valuable learning are. That conversation is a form of staff development and value-clarification that no average can produce. Two, MSC is designed to surface the unexpected — outcomes nobody thought to put on the questionnaire.

The method has been examined critically and refined. Willetts and Crawford (2007), in The most significant lessons about the Most Significant Change technique (Development in Practice, 17(3), 367–379), report from a pilot evaluation that MSC faces real challenges at every stage — story collection, analysis, and the selection process — and is more demanding to run well than its simple description suggests. More recently, Sharma, Khanal and van Teijlingen (2024), in Most Significant Change Approach: A Guide to Assess the Programmatic Effects (International Journal of Qualitative Methods, 23), provide an up-to-date methodological guide and reaffirm MSC's value for capturing programmatic effects that quantitative indicators overlook, while underlining that it works best as one component of a mixed-method system. Across sectors — MSC has been used in agriculture, health and education — the consistent finding is that it complements rather than replaces measurement.

Why it matters for course evaluation in practice

1. It captures transformative and unanticipated learning. Capstones, placements, service-learning, research projects and other high-impact experiences produce outcomes — identity change, confidence, a shift in professional values — that Likert dimensions were never designed to detect. MSC gives those outcomes a channel.

2. The selection process aligns a programme team around what it values. The panel discussion turns evaluation into a shared act of judgement about educational purpose, which is far more likely to drive genuine improvement than a table of means. It is quality culture, not just quality assurance.

3. It closes the loop with authentic, motivating evidence. A concrete student story of significant change, with the panel's reasons attached, is more persuasive to a committee — and more actionable — than a decimal shift in a mean. It tells staff not just that something changed but what and why it mattered.

4. It complements, and cross-checks, numeric data. Where a scale score and the significant-change stories point in different directions, that tension is diagnostic. Triangulating the two is more informative than either alone.

Limitations and honest caveats

• It is not representative and not generalizable. MSC deliberately selects the most significant stories, which are by design atypical. It tells you what can happen and what people value, not how often something happens or how large an effect is across the cohort. Never report MSC output as if it were a prevalence estimate.
• Selection bias toward the dramatic and the positive. Vivid, uplifting stories tend to win selection; quiet, negative or diffuse changes are under-represented. Facilitators must actively invite stories of negative or absent change to counter this.
• It is labour-intensive and skill-dependent. As Willetts and Crawford document, running MSC well — collecting good stories, facilitating fair panels, managing the hierarchy — is demanding. It is disproportionate for routine, every-course evaluation and belongs where the stakes and complexity justify it.
• Power dynamics shape which stories rise. The panel composition determines what counts as "significant." Without students in the selection process, MSC can quietly encode staff preferences as if they were shared values — which is why pairing it with a students-as-partners approach matters.
• Rich stories threaten anonymity. A detailed narrative about a specific placement or a small cohort can identify its author, raising GDPR and safeguarding concerns that a Likert response never does. Consent, anonymisation and careful handling are essential.

How Koji incorporates this

MSC's central act — eliciting a story of significant change and then understanding why it is significant — is exactly what a conversational interview does well, which makes Koji a natural fit for running MSC at scale without losing its participatory character.

• Narrative elicitation with intelligent probing. Koji's AI-moderated interviews can open with an MSC-style prompt (an open_ended question) and then follow up, asking the student to explain why the change matters, what caused it, and what it means for them — producing the rich, reasoned stories MSC depends on, rather than a one-line comment.
• Scaling story collection without exhausting staff. The most labour-intensive part of MSC is gathering enough good stories. Koji collects and structures them across an entire cohort automatically, so staff effort can concentrate on the high-value part: the selection dialogue.
• Thematic clustering to support, not replace, the panel. Automatic thematic analysis groups stories by the kind of change described, giving a selection panel an organised starting point while leaving the human judgement about significance where it belongs — with the people.
• Triangulation with numeric dimensions. Because Koji collects scale items alongside narrative, it can place significant-change stories next to the quantitative picture, surfacing where the two agree or conflict — the cross-check the research recommends.
• Privacy-aware handling. Koji is designed to manage open-text feedback with anonymity and data-protection in mind, mitigating the re-identification risk that rich, specific stories create.

The same conversational engine powers Koji's core research platform at koji.so, where product and customer-research teams use exactly this pattern — eliciting stories of significant change and probing why they matter — to understand impact that survey scales cannot reach.

FAQ

Can MSC replace our Likert course-evaluation form? No. MSC is a supplement, not a substitute. It captures unanticipated, transformative outcomes and clarifies values, but it is not representative and cannot estimate how common or how large an effect is. Run it alongside numeric evaluation.

What question do you actually ask students? An open, unconstrained prompt about the most significant change in their learning and why it is significant to them — for example, "Looking back over this module, what was the most significant change in you as a learner, and why does it matter?" The lack of pre-set categories is deliberate.

Where does MSC add the most value? In complex, open-ended, high-impact contexts — capstones, placements, service-learning, research projects, transformative programmes — where the important outcomes are individual and narrative and where a fixed questionnaire is most likely to miss them.

Isn't selecting the "most significant" story just cherry-picking? The selection is the method, and its value lies in the documented reasoning behind each choice, which makes staff values explicit. The risk of bias toward dramatic, positive stories is real and must be managed by inviting negative and quiet changes and by including students on panels.

What are the privacy risks? Detailed stories can identify their authors, especially in small cohorts or specific placements, raising GDPR and safeguarding issues. Obtain consent, anonymise carefully, and handle the narratives as potentially sensitive data.

Related Resources

• Critical incident technique for course feedback
• Appreciative inquiry: strengths-based course evaluation
• Framework analysis of open-text course feedback
• Illuminative evaluation and the learning milieu
• Responsive evaluation: stakeholder issues in course review
• Students as partners in co-designing course evaluation

References

• Davies, R., & Dart, J. (2005). The "Most Significant Change" (MSC) Technique: A Guide to Its Use. https://www.mande.co.uk/wp-content/uploads/2005/MSCGuide.pdf
• Willetts, J., & Crawford, P. (2007). The most significant lessons about the Most Significant Change technique. Development in Practice, 17(3), 367–379. https://doi.org/10.1080/09614520701336907
• Sharma, M. K., Khanal, S. P., & van Teijlingen, E. (2024). Most Significant Change approach: A guide to assess the programmatic effects. International Journal of Qualitative Methods, 23. https://doi.org/10.1177/16094069241272143