Course Evaluation Evidence for Irish Accreditation (QQI, CINNTE & the Annual Quality Report)

Short answer: In the Irish system, course and module evaluation is not a box-ticking exercise — it is primary evidence that your internal quality system actually works. Quality and Qualifications Ireland (QQI) expects institutions to gather learner feedback, involve learners in analysing it, and demonstrate follow-up action. That evidence surfaces in two places: the CINNTE cyclical institutional review (with its Institutional Self-Evaluation Report) and the Annual Quality Report (AQR) that every higher education institution submits to QQI each year. This guide maps those expectations to concrete evaluation outputs, and shows where a modern, AI-native tool like Koji produces standardized, closing-the-loop evidence — while being honest about where your existing processes may already be enough.

It is written for QA directors, deans, heads of teaching and learning, and quality officers in Irish HEIs preparing for review or strengthening their annual reporting.

The Irish quality-assurance landscape, briefly

QQI is the statutory body established under the Qualifications and Quality Assurance (Education and Training) Act 2012. Rather than dictating a single national questionnaire, QQI takes a guidelines-and-review approach:

• Core Statutory Quality Assurance Guidelines. QQI's Core Guidelines (first developed in 2016) set out what an effective internal QA system looks like. Institutions develop their own QA procedures consistent with these guidelines and with the European Standards and Guidelines (ESG 2015). The Core Guidelines are supplemented by sector-specific and topic-specific guidelines (for example, for blended and fully online programmes).
• CINNTE institutional review. CINNTE — Irish for "certain" or "definite" — is QQI's current cycle of institutional reviews. It evaluates the effectiveness of an institution's internal QA system in compliance with the ESG and QQI guidelines. Following the internationally recognised model (Parts 2 and 3 of the ESG 2015), it runs on published terms of reference, an Institutional Self-Evaluation Report (ISER), an external assessment and site visit, a published review report with findings and recommendations, and a follow-up procedure. The cycle operates on a roughly seven-year basis.
• Annual Quality Report (AQR). The AQR — formerly the Annual Institutional Quality Assurance Report (AIQR) — is each HEI's yearly documentary account of how its internal quality system is developing and being implemented. It is explicitly aligned with QQI's Core, sector, and topic-specific guidelines and with the ESG 2015 (the template includes an ESG-to-Core-Guidelines mapping). Each AQR is published in full on QQI's website, and the submission deadline falls in February each year following a call issued the previous November.

The throughline is the same one that runs through every ESG-aligned system: collect learner feedback, involve learners in analysing it and planning follow-up, act on it, and document the loop. Course and module evaluation is the most granular, highest-volume source of that evidence.

Mapping QQI / ESG expectations to evaluation outputs

The table below maps the key expectations a CINNTE team and the AQR template will probe to the concrete outputs an evaluation process should produce. The right-hand column shows where Koji's outputs map directly.

QQI / ESG expectation	What reviewers look for	Concrete evaluation output	Koji output
Ongoing monitoring & periodic review of programmes (ESG 1.9)	Student feedback systematically informs programme review	Standardized per-module evaluation feeding programme review	Standardized interview-based evaluation, themed and aggregated to programme level
Learner-centred design & the learner voice (ESG 1.1, QQI learner involvement)	Learners provide and help analyse information; learner representation	Rich learner feedback, not just ratings; learner-readable summaries	AI-moderated interviews capture the "why"; automatic thematic summaries learners and reps can engage with
Acting on feedback / closing the loop	Evidence that feedback led to documented action	"You said / we did" records linked to specific feedback	Built-in action tracking linking themes to follow-up actions
Self-evaluation (ISER) & AQR narrative	Credible, evidence-backed account of QA in practice	Exportable, consistent reports across modules and years	Longitudinal cohort reporting and exportable standardized evidence
Public information (ESG 1.8)	Transparent, aggregate information on quality	Aggregated, shareable summaries	Aggregate thematic and trend reporting suitable for publication
Consistency & fairness of process	Comparable, bias-aware data collection	Standardized instrument applied consistently	Bias-aware, standardized AI moderation across all courses

Turning evaluation into CINNTE and AQR evidence

1. Make the learner voice analysable, not just collected. QQI is explicit that learners should be involved in providing and analysing information and planning follow-up. A wall of unread free-text comments does not meet that bar. Koji's automatic thematic analysis converts hundreds of open responses into a small set of named themes that staff and student representatives can actually discuss — which is exactly the kind of learner-partnership evidence a review team values. (For the methodology behind this, see closing the feedback loop and our ESG/ENQA evidence guide.)

2. Document the loop, not just the listening. The weakest point in most self-evaluation reports is the jump from "we gathered feedback" to "quality improved." Reviewers want the connective tissue: this theme emerged, this action followed, this is what changed next cohort. Koji's action tracking captures that chain so it can be cited verbatim in the ISER or AQR.

3. Show longitudinal improvement. A seven-year CINNTE cycle and an annual AQR both reward trend evidence. Cohort-over-cohort thematic reporting lets you demonstrate that a problem flagged in one year was addressed and improved in the next — far more persuasive than a single year's satisfaction score.

4. Standardize for fairness and comparability. Because CINNTE assesses the system, consistency matters. A standardized, bias-aware interview applied across modules produces comparable evidence and pre-empts the criticism that feedback was collected inconsistently. (On the underlying validity questions, see how strong the evidence is that student evaluations are biased.)

Where your existing process may already be enough (an honest note)

Not every institution needs new software to satisfy QQI. If your current course-evaluation process already produces consistent data, your committees genuinely read and act on it, and you can evidence the closing of the loop in your AQR, you may simply need to document that more clearly rather than re-tool. Small providers with low module counts can often manage qualitative analysis by hand, and a well-run institutional survey on an existing platform can be perfectly defensible in a CINNTE review.

The places where a tool like Koji changes the equation are specific: when comment volume already exceeds what staff can read; when free-text feedback is collected but rarely analysed; when you struggle to evidence action (not just collection); or when you want comparable, longitudinal evidence across a large programme portfolio without a heavy manual coding effort. If those describe you, the gap is real. If they do not, be honest with yourself and your review team — over-engineering the evidence is its own risk.

A practical preparation checklist

When a CINNTE self-evaluation or an Annual Quality Report is approaching, course-evaluation evidence is one of the first things a thorough team will stress-test. A useful internal checklist:

• Coverage. Can you show that evaluation runs consistently across modules and programmes, not just where individual lecturers opt in? Patchy coverage is a common review finding.
• Analysis, not accumulation. Can you demonstrate that open-text feedback is actually analysed and synthesised — with named themes — rather than stored and forgotten? QQI's emphasis on learners helping to analyse information makes this central.
• The closed loop. For at least a handful of concrete examples, can you trace the full chain: feedback theme to committee discussion to decided action to the change students saw next cohort? This narrative is what separates a strong ISER from a weak one.
• Learner partnership. Are learner representatives engaging with evaluation findings in a form they can actually read and discuss, not just receiving raw exports?
• Trend evidence. Can you show movement over time on issues you previously flagged? A single snapshot rarely persuades a review team that a system is effective.
• Data protection. Is your handling of evaluation data — anonymity, retention, lawful basis — documented and defensible, given the public scrutiny each AQR receives?

Gaps in any of these rows are precisely where evaluation tooling, process change, or simply better documentation pays off before a review.

How Koji fits the Irish context

Koji is a purpose-built, EU-hosted, AI-native course-evaluation platform. It replaces the static questionnaire with a short, standardized, AI-moderated interview that probes vague answers, then themes the results automatically and tracks the resulting actions. For Irish HEIs that means:

• ISER and AQR evidence that is standardized, exportable, and longitudinal;
• Learner-voice analysis that learners and their representatives can engage with, supporting the partnership expectation;
• Closing-the-loop documentation that turns "we listened" into "we acted, and here is the result";
• EU/GDPR data handling, with Koji acting as a processor under a data processing agreement.

Koji runs on the same AI interview engine that powers the main Koji platform at koji.so for customer and user research, so the conversational, automatically-analysed approach is proven well beyond education.

Related Resources

• Turning Student Feedback into ESG / ENQA Accreditation Evidence
• Course Evaluation Evidence for the UK TEF and QAA Quality Review
• Turning Course Evaluations into NVAO Accreditation Evidence (Netherlands & Flanders)
• Course Evaluation Evidence for AACSB & EQUIS Business-School Accreditation
• Course Evaluation Evidence for German Accreditation

Preparing for a CINNTE review or strengthening your next Annual Quality Report? Explore Koji for Education to see how standardized, closing-the-loop evaluation evidence comes together.