A Satisfaction Mean Can't See the Lab: Evaluating Sport and Exercise Science Programmes

Bottom line up front: Sport and exercise science is taught in three places at once — the lecture hall, the physiology, biomechanics and psychology laboratory, and the applied placement — but a generic "rate this module 1–5" survey only ever sees the first. The professional body that endorses these degrees, now the Chartered Association of Sport and Exercise Sciences (CASES), judges a programme on whether it develops the knowledge, skills and competencies needed to practise safely — a standard you cannot infer from a cohort's average enjoyment score. If your evaluation instrument is built for lectures, it is structurally blind to the two settings where a sport scientist is actually made.

The professional standard is competency, not satisfaction

In May 2024 the British Association of Sport and Exercise Sciences was granted a Royal Charter by King Charles III, and on 1 April 2025 it was incorporated as the Chartered Association of Sport and Exercise Sciences (CASES) — the pre-eminent professional body for the discipline in the UK. That charter matters for evaluation because it anchors the discipline to defined professional standards rather than to consumer satisfaction.

Two CASES mechanisms set the bar. The Undergraduate Endorsement Scheme endorses courses that give undergraduates the opportunity to develop the knowledge and skills the Association "considers essential to enter into the profession," requiring coverage of the three sub-disciplines — physiology, biomechanics and psychology — in sufficient depth, plus interdisciplinary approaches. And the flagship Sport and Exercise Scientist Accreditation is a professional standard awarded to practitioners judged to have "demonstrated the knowledge, skills and understanding necessary to practise safely, effectively and independently." Getting there runs through Supervised Experience, a programme of supervised practice that CASES notes takes two to six years, with candidates averaging three to four (CASES accreditation guidance).

Read those requirements and one thing is obvious: the outcomes are demonstrated competences observed in labs and applied settings over years — not attitudes captured in a five-minute end-of-semester form. A degree that scores 4.6/5 on satisfaction but leaves graduates unable to run a valid VO2 max protocol or interpret force-plate data has failed on exactly the axis the professional body cares about.

Three settings, one blind instrument

The core problem is a mismatch between where learning happens and where the survey looks.

The laboratory is where competence is built and where it fails silently. Practical skills — gas analysis, isokinetic dynamometry, motion capture, ECG interpretation, psychometric administration — are learned by doing, under supervision, with feedback in the moment. A student can enjoy a module (high satisfaction) while never gaining confident, independent lab competence, and can gain that competence in a demanding lab they found stressful (low satisfaction). A single mean cannot separate these, which is the same failure we describe for lab, studio and clinical signature pedagogies: the pedagogy is hands-on and cumulative, the instrument is retrospective and global.

The placement is half the programme and gets a fraction of the attention. Applied sport and exercise science degrees increasingly embed work-based learning with clubs, clinics, NHS services and performance environments. The quality of that experience varies enormously between placement providers — supervision, autonomy granted, breadth of cases — and that between-placement variance is the real quality risk. A programme-level satisfaction mean averages it into invisibility. This is the placement blind spot we have documented for physiotherapy and allied-health programmes and work-integrated learning more broadly.

Satisfaction and competence pull in different directions. As with any rigorous practical discipline, the modules that build professional readiness are often the ones students find hardest. Optimise the mean and you drift toward the comfortable; optimise for competence and you sometimes accept lower satisfaction. Confusing the two is precisely the error behind why averaging Likert scores misleads.

But aren't practical skills already assessed — so why survey at all?

The strongest objection is that lab competence and placement performance are directly assessed through practicals, competency logs and supervisor sign-off — these are direct measures of learning, the gold standard — so student evaluation adds nothing.

Direct assessment is indeed superior for certifying whether a student can do the thing. But it is silent on the conditions that produced the result: Was lab time sufficient or rationed across too many students per instrument? Was placement supervision present or nominal? Did feedback arrive in time to act on? Was the sequence coherent, so biomechanics built on the physiology that preceded it? Students are the only continuous observers of those conditions. They cannot certify their own competence — self-assessment is unreliable — but they are the sole witnesses to the learning environment that competence depends on. That is the same complementary logic that makes student voice valuable alongside direct assessment in nursing and midwifery placements. Direct assessment grades the output; evaluation explains the process — and only one of them tells you what to fix.

To be precise about the claim: student evaluation does not measure competence and should not be used to certify it. It surfaces the environmental and design factors — lab access, supervision quality, sequencing, feedback timeliness — that either enable or undermine the competence your practicals then assess.

Where Koji fits

Koji for Education is built for exactly this three-setting problem. Instead of one flat survey, it runs an AI-moderated conversational interview that adapts to what a student describes:

It can separate the settings. When a student mentions the lab, the interview can probe instrument access, supervision and confidence built; when they mention placement, it can probe supervision quality and breadth of experience — producing setting-specific evidence a single mean destroys.
It surfaces between-placement variance. Automatic thematic analysis across a cohort reveals which placement providers consistently deliver strong supervision and which do not — the actionable signal for a placement lead, aligned with measuring skills beyond satisfaction.
Formative, mid-module and mid-placement collection catches a struggling lab rotation or a weak placement while there is still time to intervene.
Programme-level reporting aggregates across the physiology/biomechanics/psychology cluster and the placement portfolio, matching how CASES actually looks at a course rather than how a survey tool happens to be structured.
Standardised, bias-aware AI moderation and GDPR-compliant, EU-appropriate data handling keep the evidence defensible for endorsement review.

Departments that also run participant research, athlete studies or wider stakeholder work can use the same AI interview engine on the main Koji platform, keeping their evidence base consistent.

Koji will not observe a VO2 max test or sign off Supervised Experience — that is the assessor's and CASES's job. What it does is make the lab and the placement visible in your evaluation, so the settings where sport scientists are actually made stop being the ones your data can't see.

Frequently asked questions

Is it BASES or CASES now? Both names refer to the same body. The British Association of Sport and Exercise Sciences (BASES) was granted a Royal Charter in May 2024 and incorporated as the Chartered Association of Sport and Exercise Sciences (CASES) on 1 April 2025. Its endorsement and accreditation schemes continue under the CASES name.

Can student evaluation measure whether a student is competent in the lab? No, and it should not try. Competence is certified through direct assessment — practicals, competency logs, supervisor sign-off. Evaluation measures the conditions around that competence: lab access, supervision, sequencing and feedback. The two are complementary evidence, not substitutes.

Why does a programme-level satisfaction mean fail sport and exercise science specifically? Because the discipline is taught across the lecture hall, the lab and the placement, and a mean averages three very different experiences into one number. It hides the between-placement variance and the lab-access problems that are the real quality risks.

How does Koji handle placements with different providers? The AI interview probes placement-specific experiences, and automatic thematic analysis aggregates them by provider and theme, so a placement lead can see which settings consistently deliver strong supervision and which need intervention.

Does using AI to analyse feedback create bias in sport and exercise science evaluation? Koji uses standardised, bias-aware AI moderation, which removes the inconsistency of different human moderators and applies the same probing logic to every student. It mitigates and surfaces bias rather than claiming to eliminate it, and all analysis remains auditable and GDPR-compliant.

Want evaluation that can actually see the lab and the placement? Explore Koji for Education — AI-moderated interviews and thematic analysis designed for practice-heavy programmes, not lecture halls.