Course Evaluation Evidence for E-xcellence & Online/Distance Learning QA (EADTU)

Online, blended and distance programmes are held to the same European standards as campus programmes — but they raise quality questions a traditional end-of-term survey struggles to answer. Did the digital learning design actually support the student? Was the online interaction meaningful? Were flexibility and accessibility real, or nominal? This guide maps the EADTU E-xcellence benchmarks for online and distance education to the course-evaluation evidence a QA team needs to demonstrate them — and shows how AI-moderated student interviews produce that evidence in a standardized, audit-ready form.

It is written for QA directors, heads of digital and blended learning, and institutional-research leads at European universities who run — or are scaling — online, open and flexible (OOF) provision.

What E-xcellence is (and is not)

E-xcellence is a quality benchmarking instrument for e-learning developed by the European Association of Distance Teaching Universities (EADTU). It emerged from a series of EU-funded projects (2005–2012) and is maintained through the E-xcellence manual and the associated review process. Its purpose, in EADTU's own words, is to provide "a set of benchmarks, quality criteria and notes for guidance against which blended and online education programmes and their support systems may be judged."

Two things to be clear about for procurement and committee audiences:

1. E-xcellence is a benchmarking and enhancement tool, not a national accreditation agency. It complements — it does not replace — your national QA regime (for example NVAO, QAA/TEF, ANECA, or the Standards and Guidelines for the ESG). Many institutions use E-xcellence to strengthen the digital dimension of evidence they then submit into their national or ESG-aligned processes.
2. Integrating the benchmarks into your internal quality system is the route to recognition. EADTU offers an "E-xcellence Associate in Quality Label"; a requirement for it is that the E-xcellence benchmarks are embedded in your institution's own internal quality assurance. In other words, this is about ongoing evidence, not a one-off inspection.

E-xcellence organises its improvement focus around four priority elements of progressive higher education: accessibility, flexibility, interactiveness, and personalisation. These four are exactly where generic Likert-scale course surveys tend to go quiet — and where richer student evidence is most valuable.

Why traditional surveys underperform for online provision

A standard student evaluation of teaching (SET) instrument was designed for a lecture-hall course. Applied to an online or blended module, it tends to miss the things that determine online quality:

• "The platform was fine (agree/disagree)" tells you nothing about which interactions worked, where learners got stuck, or why the flexible pathway did or did not fit their circumstances.
• Open-text boxes are thin — and for distance learners, who may be part-time or working, they are often left blank.
• No probing means when a student says the online tutorials "didn't really help," you never learn whether the problem was pacing, feedback latency, accessibility, or interaction design.

For a benchmark framework built around accessibility, flexibility, interactiveness and personalisation, that is a poor evidence base. You need feedback that can go deep on the digital learning experience, consistently, across a distributed cohort.

Mapping E-xcellence themes to Koji evidence

Koji collects course feedback through AI-moderated interviews: each student has a short, adaptive conversation with an AI interviewer that asks a consistent core set of questions and probes follow-ups based on what the student actually says. The output is standardized, automatically themed qualitative evidence. Here is how that maps to E-xcellence's concerns.

E-xcellence theme	Quality question it asks	Koji course-evaluation output
Accessibility	Could all learners access and engage with materials and activities?	Probed interview evidence on access barriers, assistive-tech friction, and where accessibility was nominal vs real
Flexibility	Did flexible pathways genuinely fit learners' circumstances?	Themed accounts of how pacing, deadlines and modularity worked for working/part-time students
Interactiveness	Was online interaction meaningful (peer, tutor, content)?	Standardized findings on tutor responsiveness, feedback latency, and interaction design that worked or failed
Personalisation	Did the design adapt to learner needs?	Evidence on where personalisation helped, plus cohort-level patterns of unmet need
Programme/institutional level	Is there systematic, longitudinal evidence?	Longitudinal cohort reporting comparable term-over-term across modules and programmes
Closing the loop	Are improvements acted on and documented?	Built-in action tracking linking findings to documented changes

The value for an E-xcellence review — or any digital-learning quality audit — is that this evidence is standardized (same moderation logic for every student), themed automatically (no manual coding bottleneck across a distributed cohort), and longitudinal (comparable over time).

Turning student feedback into E-xcellence-ready evidence: a workflow

1. Instrument the four priority elements. Configure your Koji interview so its core questions deliberately cover accessibility, flexibility, interactiveness and personalisation, alongside standard learning-outcome and workload questions. Because the AI probes, you get depth on each without a 40-item questionnaire.
2. Collect formatively, not just at term end. Run a mid-module interview so issues with the online design surface while the module can still be fixed — enhancement, not just measurement. Distance learners especially benefit from being asked before it is too late to help them.
3. Theme automatically and standardize. Let Koji cluster responses into themes per module and per programme. Standardized moderation means the evidence is comparable across tutors and cohorts — important when a reviewer asks whether a finding is systemic or a one-off.
4. Document the loop. Record the actions taken in response (redesigned assessment, faster feedback SLA, new accessibility fix) and track them. E-xcellence and the ESG both expect evidence that feedback leads to change — the "closing the loop" that auditors look for.
5. Report longitudinally for the review. Present term-over-term cohort reporting that shows both the evidence and the trajectory of improvement, at module, faculty and institutional level.

Where E-xcellence (and a specialist route) may fit better than a general approach

To be balanced: E-xcellence is not always the right primary instrument, and no software replaces the framework itself.

• If your provision is entirely campus-based, E-xcellence adds little; your national/ESG process is the main event.
• If you need a formal accreditation decision (not enhancement), your national agency or a discipline-specific accreditor is the authority — E-xcellence complements them.
• Some institutions prefer their own internal digital-learning rubric or a national digital-QA scheme; E-xcellence is one credible option among several. Its strength is being pan-European, benchmarking-oriented, and specifically built for online/blended provision.

Whatever framework you adopt, the underlying need is the same: rich, standardized, longitudinal student evidence about the digital learning experience. That is a data-collection and analysis problem, and it is exactly what an AI-moderated approach is designed to solve.

The shared engine behind the evidence

Koji's education product uses the same AI interview engine that powers the main Koji platform (koji.so) for customer and user research. The methodological point matters for a PhD-literate committee: conversational, probed, standardized interviewing is a recognised way to gather deeper qualitative data than fixed questionnaires — and automating its analysis is what makes it viable at the scale of a distributed online cohort.

Common reviewer questions — and the evidence that answers them

An E-xcellence review, like any digital-learning quality audit, tends to press on a predictable set of questions. Preparing standardized student evidence in advance means you answer them with data rather than assertion:

• "How do you know the online interaction was meaningful, not just present?" A tick-box asking whether a forum existed proves nothing. Probed interview evidence on whether students actually used tutor feedback, and how quickly it arrived, does.
• "Is this finding systemic or anecdotal?" Because Koji applies the same moderation logic to every student, a theme that recurs across a cohort is defensible as systemic — not a loud minority. Reviewers respond to that distinction.
• "Did the flexible design fit real learners?" Distance and part-time learners have circumstances a campus survey never captures. Themed accounts of how pacing, deadlines and modularity worked for working students speak directly to the flexibility benchmark.
• "Where is your evidence that feedback changed anything?" This is the closing-the-loop test, and it is where many submissions are thin. Action tracking that links a specific finding to a documented change — and shows the next cohort's response — is the strongest possible answer.
• "Can you show a trajectory, not a snapshot?" Longitudinal, term-over-term cohort reporting demonstrates enhancement over time, which is what benchmarking frameworks reward.

A practical tip: keep a short evidence map that lists each E-xcellence priority element, the interview question(s) that address it, and the report where the finding lives. Reviewers value being able to trace a claim to its source quickly, and a PhD-literate panel will notice when that chain is missing.

Related Resources

• Course Evaluation Evidence for Microcredential Quality Assurance
• Course Evaluation Evidence for NVAO Accreditation
• Student Feedback as ESG Accreditation Evidence
• Course Evaluation Evidence for UK TEF & QAA
• Writing a Self-Evaluation Report with Course Evaluation Evidence
• Course Evaluation Evidence for Programme Review & Revalidation

Ready to build digital-learning evidence that stands up to review?

If you run online, blended or distance provision and want student evidence that maps cleanly to E-xcellence's four priority elements — accessibility, flexibility, interactiveness, personalisation — Koji produces it in a standardized, themed, longitudinal, closing-the-loop form. Start by instrumenting one online module this term and comparing the depth of evidence to your current survey.