Beyond the Lecturer: What the Course Experience Questionnaire (CEQ) Measures and Why It Predicts Learning

In brief: The Course Experience Questionnaire (CEQ), developed by Paul Ramsden in 1991, is one of the few course-evaluation instruments whose scales were explicitly designed to be theoretically linked to student learning rather than to instructor likeability. Its scales — Good Teaching, Clear Goals and Standards, Appropriate Assessment, Appropriate Workload, and Generic Skills — measure students' perceptions of the learning environment. Decades of validation evidence show these perceptions predict whether students adopt a deep or surface approach to study, and in turn predict academic and skill outcomes. For a quality-assurance office, the CEQ's lesson is that what you ask about determines what you can act on: ask about teaching personality and you get a popularity contest; ask about goals, workload, and assessment and you get an actionable diagnosis.

What the research says

The CEQ originates in Paul Ramsden's 1991 paper, A performance indicator of teaching quality in higher education: The Course Experience Questionnaire (Ramsden, 1991, Studies in Higher Education). Ramsden's argument was deliberately different from the dominant Student Evaluation of Teaching (SET) tradition. Rather than ask students to rate the instructor ("Was the lecturer enthusiastic?"), the CEQ asks students to characterise their experience of the course as a learning environment: whether goals and standards were clear, whether the workload was reasonable, whether assessment rewarded understanding rather than memorisation, and whether the teaching helped them learn. The theoretical engine underneath is the Students' Approaches to Learning (SAL) tradition associated with Marton, Säljö, Entwistle and Ramsden himself: students who perceive their environment as supporting understanding are more likely to take a deep approach (seeking meaning, relating ideas), while those who perceive heavy workload, unclear goals, and assessment that rewards reproduction are pushed toward a surface approach (memorising, reproducing).

The instrument was refined and validated at scale by Wilson, Lizzio and Ramsden (1997), The development, validation and application of the Course Experience Questionnaire (Studies in Higher Education, 22(1), 33–53). Using exploratory and confirmatory factor analyses on large, multidisciplinary samples of students and graduates across several universities, they established the reliability and validity of both full and short forms and identified a coherent higher-order structure. The CEQ subsequently became the backbone of Australia's national Graduate Survey, administered to virtually all graduates of Australian higher education — making it one of the most heavily fielded teaching-quality instruments in the world and, importantly, one whose psychometric properties have been tested on enormous samples.

Crucially, the CEQ's scales are not just internally reliable; they are predictively meaningful. Lizzio, Wilson and Simons (2002), University students' perceptions of the learning environment and academic outcomes (Studies in Higher Education, 27(1), 27–52), analysed a large cross-disciplinary undergraduate sample with higher-order path and regression models. They found that CEQ-style perceptions of the learning environment influenced both "hard" outcomes (academic achievement) and "soft" outcomes (satisfaction, development of generic skills) — partly directly, and partly mediated through students' approaches to study. Perceptions of appropriate workload and good teaching were associated with deeper approaches and better outcomes; perceptions of heavy workload were associated with surface approaches. This corroborates the earlier experimental and correlational work of Trigwell and Prosser (1991), Improving the quality of student learning (Higher Education, 22(3), 251–266), which demonstrated that the learning context as perceived by the student shapes the approach to learning, which in turn shapes the quality of learning outcomes.

Put together, the CEQ literature makes a claim that most personality-based SET instruments cannot: scores on these scales are connected, through a defensible causal chain, to how and how well students actually learn.

Why it matters for course evaluation in practice

For a quality-assurance officer, institutional researcher, or programme director, the CEQ tradition delivers three practical lessons.

1. Measure the environment, not the entertainer. A large body of bias research (Dr Fox effects, fluency illusions, attractiveness and warmth halos) shows that global "rate the lecturer" items are contaminated by instructor charisma. The CEQ sidesteps much of this by asking about features of the course a programme can change: clarity of goals, alignment of assessment, calibration of workload. These are levers, not verdicts.

2. Actionability is built in. Because each scale maps to a design decision, a low "Clear Goals and Standards" score points directly at intended-learning-outcome statements and rubrics; a problematic "Appropriate Assessment" score points at whether exams reward memorisation; a high "Appropriate Workload" complaint points at credit-hour calibration. Compare this with a low "overall satisfaction" number, which tells you something is wrong but not what to do.

3. It connects evaluation to a theory of learning. Accreditation frameworks (ESG/ENQA, NVAO, the various national agencies) increasingly want evidence that evaluation feeds genuine enhancement. An instrument grounded in constructive alignment and approaches-to-learning theory lets you argue, with citations, that you are measuring conditions known to support learning — not merely collecting satisfaction.

Limitations and honest caveats

A critical reader should not treat the CEQ as a solved problem.

• Perceptions are not direct measures of learning. The CEQ measures students' perceptions of the environment, not the environment itself, and certainly not learning gains. The predictive links to outcomes are correlational and partly self-reported; common-method variance (the same student reporting both perceptions and self-rated outcomes) can inflate associations. The strongest claims require objective outcome data.

• Dimensionality and cross-context stability are debated. While the higher-order structure replicates well in Australian and UK samples, factor structures can shift across disciplines, cultures, and languages. Discipline-specific factor analyses sometimes find that items load differently in, say, fine arts versus engineering. Measurement invariance cannot be assumed when comparing CEQ scores across very different programmes or national systems.

• The deep/surface framework itself has critics. Approaches to learning are partly responses to context rather than stable traits, and some researchers question whether the deep/surface dichotomy is too coarse. The CEQ inherits these theoretical debates.

• Programme-level, not lecturer-level. The CEQ was designed to evaluate programmes and courses, typically retrospectively (often of graduates). It is not a clean instrument for high-stakes individual personnel decisions, and using it that way repeats the misclassification problems documented for SET more broadly.

• Workload is double-edged. "Appropriate workload" items are sometimes interpreted by students as "less work is better," which can create perverse pressure toward leniency if scores are used naively. The scale measures perceived appropriateness, and that perception interacts with grading and difficulty.

Acknowledging these limits is what separates a credible evaluation programme from a marketing claim: the CEQ is a better question set, not a bias-free oracle.

How Koji incorporates this

Koji for Education is built around the same core insight as the CEQ: what you ask determines what you can act on. Several Koji mechanisms operationalise the learning-environment philosophy rather than the personality-rating one.

• Environment-focused, design-aligned question banks. Koji's structured question types — open_ended, scale, single_choice, multiple_choice, ranking, and yes_no — let an institution build evaluations around CEQ-style constructs (clear goals, appropriate assessment, workload calibration, generic-skills development) instead of defaulting to "rate the lecturer." Scale items capture the perception; open-ended and ranking items capture why and which aspects matter most.

• AI-moderated conversational interviews that probe the construct. A CEQ scale item gives you a number; it cannot tell you what about the assessment felt misaligned. Koji's AI-moderated interview follows up a low "assessment rewarded understanding" rating with adaptive, neutral probes ("Which assessment, and what made it feel like it rewarded memorisation?"). This is designed to recover the diagnostic detail that a fixed CEQ form leaves on the table — moving from "students perceive assessment as poorly aligned" to "the week-10 multiple-choice midterm is the locus."

• Automatic thematic analysis mapped to environment dimensions. Koji's thematic analysis of open text is configured to surface themes against learning-environment categories (goals, feedback, workload, alignment), so qualitative comments reinforce — or contradict — the quantitative scale scores rather than sitting in an unread free-text column.

• Triangulation and bias-aware reporting. Because the CEQ's predictive validity is correlational and vulnerable to common-method bias, Koji is designed to triangulate students' perceptions across cohorts and over time, and to flag when a single noisy cohort is driving a result, rather than presenting one mean as truth.

• Closing the loop. The CEQ tradition is explicitly an enhancement instrument; Koji's action-tracking is designed to record what a programme changed in response to a low workload or goals score and to test whether the next cohort's perceptions shift — making the evaluation a cycle, not a verdict.

We frame these as mechanisms designed to mitigate the gap between a perception score and an actionable diagnosis; no instrument eliminates the limitations above. Koji's core research platform at koji.so applies the same AI-moderated interview engine to product and customer research, where the same principle holds: a well-constructed question about the experience beats a global rating of the person delivering it.

Related Resources

• What Do Student Evaluations Actually Measure? Marsh, the SEEQ, and Multidimensional Feedback
• Is Student Evaluation of Teaching Valid? The State-of-the-Art Review
• Why "I Learned a Lot" Can't Be Compared Across Courses: Reference Bias
• One Number or Many? The Dimensionality Debate
• Do Student Evaluations Measure Learning? The Uttl Meta-Analysis
• Stop Asking "Was the Lecturer Clear?": Low-Inference Teaching-Behaviour Items

References

1. Ramsden, P. (1991). A performance indicator of teaching quality in higher education: The Course Experience Questionnaire. Studies in Higher Education, 16(2), 129–150. https://doi.org/10.1080/03075079112331382944
2. Wilson, K. L., Lizzio, A., & Ramsden, P. (1997). The development, validation and application of the Course Experience Questionnaire. Studies in Higher Education, 22(1), 33–53. https://doi.org/10.1080/03075079712331381121
3. Lizzio, A., Wilson, K., & Simons, R. (2002). University students' perceptions of the learning environment and academic outcomes: implications for theory and practice. Studies in Higher Education, 27(1), 27–52. https://doi.org/10.1080/03075070120099359
4. Trigwell, K., & Prosser, M. (1991). Improving the quality of student learning: the influence of learning context and student approaches to learning on learning outcomes. Higher Education, 22(3), 251–266. https://doi.org/10.1007/BF00132290