Your Course Evaluation Measures Satisfaction. Professional Programmes Produce an Identity.

The short answer: In the professional disciplines — medicine, nursing, teaching, law, social work, engineering — the deepest outcome of a programme is not a list of competencies but a professional identity: the point at which a student begins to "think, act, and feel like" a member of the profession. This process, professional identity formation (PIF), was theorised in medical education by Richard and Sylvia Cruess and colleagues, who describe it as the socialisation of the individual into a community of practice, integrating personal and professional selves. A five-point satisfaction scale cannot detect it. For professional programmes, that is not a minor blind spot — it is a failure to measure the thing the programme exists to produce.

Satisfaction is the wrong outcome for a professional degree

Course evaluation was designed around a transactional model: the student is a learner receiving instruction, and we ask whether the instruction was clear, well-paced, and well-assessed. That model is not wrong, but it is thin, and it is thinnest exactly where the stakes are highest. When a medical school, a teacher-training route, or an engineering programme succeeds, its graduates do not merely know more — they have undergone what the literature calls a transformation of identity. They begin to hold the profession's values, tolerate its uncertainties, accept its responsibilities, and recognise themselves as belonging to it.

The Cruess framework describes PIF as "an adaptive developmental process that happens simultaneously at two levels: the psychological development of the person, and the socialisation of the person into appropriate roles" — drawing explicitly on communities-of-practice and situated-learning theory. A student becomes a nurse not only by passing pharmacology but by being inducted, through placements and role models and the small corrections of clinical practice, into what nurses value and how they carry themselves. Ask that student to rate "the clarity of lecture slides" and you have measured something real but peripheral to the actual outcome.

What the satisfaction survey cannot see

This is a construct-underrepresentation problem — the validity threat we describe in Construct Underrepresentation: the instrument samples a narrow slice of the outcome and silently treats it as the whole. Professional identity formation is invisible to a standard evaluation for three reasons.

First, it is longitudinal. Identity forms across years and placements, not within a twelve-week module, so an end-of-module survey catches it at no meaningful point. Second, it is relational and tacit. It is shaped by role models, near-peers, the "hidden curriculum," and moments of belonging or exclusion that a Likert grid has no question for. Third, it can move in directions satisfaction cannot register: a placement that felt hard and uncomfortable — and would score low on satisfaction — may be precisely the experience that consolidated a student's professional identity, while a comfortable, well-liked module may have done nothing for it. Satisfaction and formation can point in opposite directions, which is why optimising for the former can quietly starve the latter. This is the same tension we describe in the active-learning penalty, sharpened to the level of who a student is becoming.

Can it be measured at all? — the honest counterargument

A rigorous reader will object that identity is precisely the kind of soft, subjective construct that resists measurement, and that trying to quantify it invites exactly the pseudo-precision this blog usually warns against. The objection is fair and has two parts.

"Identity is too diffuse to assess." Not entirely. Medical education has developed validated instruments — for example the Professional Identity Formation - Developing Scale (PIF-DS), a self-administered questionnaire designed to gauge the degree of identity maturation and socialisation. Qualitative traditions (reflective portfolios, critical-incident narratives, guided reflection) have an even longer track record. The claim is not that PIF is easy to measure, but that it is not unmeasurable — and that measuring it imperfectly is better than substituting satisfaction and pretending the substitution is free.

"Formalising identity assessment risks surveilling students' inner lives." This is the deeper worry, and it should temper any enthusiasm. Professional identity is personal; turning it into a scored metric could pressure students to perform the "right" identity rather than develop an authentic one, and could feed the dual-purpose problem if formation data were ever used for ranking. The responsible position is that PIF evidence belongs to formative, developmental evaluation — held for the programme's improvement and the student's own reflection — and should never be reduced to a comparative score. Measured to inform, not to sort.

A further limitation: PIF theory originates in the health professions, and its transfer to, say, engineering or law is plausible but not perfectly established. The mechanisms of socialisation differ across fields, and evaluators should treat the framework as a lens to adapt, not a template to impose.

What professional-programme evaluation should ask instead

If the outcome is formation, the evaluation should probe the experiences known to drive it: exposure to role models and whether they were positive or corrosive; moments of legitimate participation where the student was trusted with real professional work — the terrain of work-integrated learning evaluation; experiences of belonging or exclusion within the professional community, echoing our work on measuring belonging; and the student's own developing sense of agency and self-conception as a future practitioner, which connects to career adaptability. These are narrative, relational questions. They cannot be answered by a number, and they are wasted on a checkbox.

Where Koji fits

Professional identity formation is a narrative construct, and narratives are exactly what a five-point scale destroys and what a conversation preserves. Koji for Education uses AI-moderated conversational interviews that can ask a student to describe a moment on placement when they felt like a real member of the profession — or when they felt they did not — and probe what made the difference. Its thematic analysis reads those narratives at scale, surfacing the patterns of role-modelling, belonging, and legitimate participation that drive formation, without a committee hand-coding hundreds of transcripts. Because the moderation is standardised and bias-aware, every student is prompted consistently; because collection can be formative and mid-cycle, it can follow identity across a programme rather than snapshotting it at the end; and because data handling is GDPR/AVG-compliant and EU-appropriate, sensitive reflective material is treated with the care such a personal construct demands.

Used this way, Koji does not "score" a student's identity — it gives programme teams a longitudinal, thematic read on whether the professional formation they intend is actually happening, and where it breaks down. The same conversational interview engine supports narrative, identity-adjacent research on the main Koji platform, wherever the outcome that matters is a story rather than a rating.

The hidden curriculum is where identity is made

Much of professional identity forms in places no survey question points at — what educators call the hidden curriculum. A student learns what the profession really values less from the stated learning outcomes than from what gets rewarded and punished in practice: the consultant who models unhurried listening, or the one who models contempt for patients who ask too many questions; the placement mentor who trusts a student with real responsibility, or the one who treats them as unpaid help. These near-peer and role-model interactions, and the small moments of being trusted or dismissed, do more to shape whether a student comes to belong to the profession than any lecture. A satisfaction survey never asks about them, because it was built to evaluate teaching delivery, not socialisation. Evaluation that takes formation seriously has to ask students to narrate those moments — the exemplary and the corrosive alike — because that is where the profession is quietly teaching them who to become, for better or worse. Surfacing the corrosive cases matters most: a single normalised bad example can undo a term of intended formation.

The takeaway

For a professional programme, "were you satisfied?" is a question about the packaging. The product is a person who has become a clinician, a teacher, an engineer — who thinks, acts, and feels like one. Professional identity formation names that outcome, decades of research make it assessable, and conversational evaluation makes it visible at scale. If your evaluation of a professional programme cannot tell you whether your students are becoming professionals, it is measuring the wrong thing well.