Evaluating Translation and Interpreting Programmes: Beyond the Satisfaction Survey

Answer up front: European master's programmes in translation and conference interpreting operate under two of the most concrete quality frameworks in higher education: the European Master's in Translation (EMT) label, run by the Commission's Directorate-General for Translation, and the European Masters in Conference Interpreting (EMCI) consortium, supported by the EU institutions' interpreting services. Both define success in terms of demonstrable, professional competence — not student contentment. That makes the generic five-point end-of-term survey a poor fit. Evaluating these programmes well means asking about competence acquisition, service-provision readiness and the intense skills-lab pedagogy that defines them.

Two EU quality labels, one shared logic

The EMT is a network and quality label: only member programmes may use the EMT name and logo, and membership is competitive and time-limited. For the 2019–2024 selection round, 81 master's programmes from 22 countries were admitted — including programmes from outside the EU — up from 34 universities in the network's founding cohort in 2009. Membership is anchored in the EMT Competence Framework, updated in 2022 and covering 2023–2028, whose explicit aim is to "consolidate and enhance the employability of graduates of master's degrees in translation throughout Europe." It defines competence across five areas: language and culture, translation, technology, personal and interpersonal, and service provision.

The EMCI is the interpreting counterpart. Launched in 1997 by the European Commission's DG-SCIC and the European Parliament's interpreting service, it is a consortium of universities sharing a common core curriculum and a set of Quality Assurance Standards. A typical EMCI programme runs several hundred hours of consecutive and simultaneous interpreting practice under professional interpreters, with a common policy on student recruitment and assessment and internship opportunities in the EU institutions.

Both frameworks share a logic that should shape evaluation: the goal is a graduate who can perform to professional standard, and the curriculum is built around intensive, feedback-dense skills practice. Neither is well served by asking students, once a semester, whether "the module was well organised."

What generic surveys miss in these programmes

Three features of translation and interpreting education make the standard instrument inadequate.

First, the pedagogy is a signature practice, not a lecture. Interpreting training in particular is a studio-and-lab signature pedagogy: repeated live performance, immediate expert critique, booth work, peer feedback. The learning happens in the correction, the retake, the debrief. A survey administered weeks later, asking for a global rating, cannot capture whether that formative feedback loop is working — which is the single most important thing to know about a skills programme.

Second, the outcomes are competences, not topics. The EMT's five competence areas and the EMCI's assessment standards are the real curriculum. Evaluation that asks about satisfaction with "content" and "assessment" in the abstract never touches whether students feel their technological competence (CAT tools, machine-translation post-editing, increasingly AI) or their service-provision competence (client management, quoting, professional ethics) is developing. Yet service provision and technology are exactly where employability is won or lost, and exactly what the 2022 framework foregrounds. This is a vertical case of the general truth that outcome-referenced evaluation beats generic satisfaction.

Third, placements and authentic work are integral. EMT programmes are expected to connect students with the profession; EMCI offers institutional internships. Evaluating work-integrated learning requires hearing about the quality of supervision, the authenticity of the tasks and the bridge to professional practice — none of which a course-satisfaction form is designed to elicit.

There is also an irony worth naming: programmes that teach students to handle meaning across languages often evaluate themselves with a monolingual, one-size instrument. In cohorts that are linguistically diverse by definition, a rigid survey risks the same language and cultural bias these programmes exist to overcome.

What good evaluation looks like here

An evaluation designed for translation and interpreting programmes would do four things. It would collect formative, mid-cycle feedback on the practice loop itself — is the critique specific, timely and actionable? — while there is still time to adjust. It would map questions to the competence frameworks, asking students to reflect on their development across the EMT's five areas or the EMCI's skill set, rather than rating generic "content." It would treat open, probing dialogue as central, because a student's account of why a booth exercise did or did not build their confidence carries more diagnostic weight than any mean. And it would evaluate at programme level, since interpreting and translation competence is cumulative across a whole master's, not delivered module by module.

"But these programmes already have rigorous assessment — why add more evaluation?"

The obvious objection: translation and interpreting programmes are among the most heavily assessed in the academy, with juries, live exams and professional panels. Isn't student evaluation redundant, even an imposition, on top of that?

It is a fair challenge, and the answer is that assessment and evaluation answer different questions. Assessment judges whether the student has met the standard. Evaluation judges whether the programme — its teaching, feedback, sequencing and support — is helping students get there efficiently and equitably. A student can pass a rigorous interpreting exam despite a poorly sequenced curriculum, through sheer effort or prior talent; the exam will not reveal the friction. Nor will a jury tell you that the CAT-tools teaching lags the market, or that international students find the feedback style hard to act on. Course evaluation is the instrument for the programme's own improvement, and for the quality-assurance evidence that EMT re-selection and institutional review require. The point is not to bolt a generic satisfaction survey onto a rigorous programme — that genuinely would add little. It is to make the evaluation as competence-focused as the assessment already is.

A second objection is scale: these are often small cohorts, and small-sample evaluation is statistically fragile. True — which is another reason to lean on rich qualitative feedback rather than precarious averages. With ten interpreting students, one thoughtful conversation each tells you more than a mean of ten Likert scores ever could.

Where Koji fits

The mismatch between what these programmes need to know and what a static form can capture is exactly the gap Koji for Education is built for. Its AI-moderated conversational interviews probe beyond a rating: when a student mentions the simultaneous-interpreting lab, the AI can follow up on whether the feedback was specific enough to act on, or how their post-editing confidence has shifted — surfacing competence-level detail a Likert item erases. Six structured question types let a programme track development against the EMT's five competence areas or the EMCI standards with comparable data, while automatic thematic analysis aggregates open-text feedback across a small cohort without the sample-size fragility of averages. Standardised, bias-aware moderation is a natural fit for linguistically diverse cohorts, and formative, mid-cycle collection means feedback arrives while the practice loop can still be tuned. Because the same AI interview engine also powers professional and stakeholder research on the main Koji platform, programmes can gather employer and language-industry feedback with the same method — informing the service-provision competence the EMT explicitly prizes.

Koji will not sit an interpreting exam or certify a translation. What it does is give programme directors competence-level, cohort-scale evidence of whether the teaching is building what the EMT and EMCI actually ask for — in students' own words, while it still matters.

The bottom line

Translation and interpreting programmes are defined by competence frameworks and signature skills pedagogy. Evaluating them with a generic satisfaction survey measures the wrong construct at the wrong time. Aligning evaluation with the EMT and EMCI logic — competence, service provision, the feedback loop — turns student voice from a compliance ritual into evidence a programme can act on and defend at re-selection.

Frequently asked questions

What is the EMT quality label?

The European Master's in Translation is a quality label and network run by the European Commission's Directorate-General for Translation. Only selected member programmes may use the EMT name and logo, membership is competitive and time-limited, and it is anchored in the EMT Competence Framework, updated in 2022 to cover 2023–2028.

How is EMCI different from EMT?

EMCI — the European Masters in Conference Interpreting — is a consortium of universities, launched in 1997 with the EU institutions' interpreting services, that share a common core curriculum and quality-assurance standards for training conference interpreters. EMT covers translation; EMCI covers conference interpreting.

Why isn't a standard course-satisfaction survey enough for these programmes?

Because their outcomes are professional competences and their teaching is a feedback-dense skills practice. A generic survey measures global satisfaction weeks after the fact, missing whether the formative feedback loop works and whether specific competences — technology, service provision — are developing.

What should translation and interpreting evaluation actually measure?

The quality and timeliness of practice feedback, students' development across the EMT competence areas or EMCI standards, the authenticity of placements and internships, and programme-level competence growth — captured formatively while adjustments are still possible.

Does course evaluation duplicate the rigorous assessment these programmes already have?

No. Assessment judges whether the student has met the standard; evaluation judges whether the programme is helping students get there. A student can pass a rigorous exam despite a poorly sequenced or outdated curriculum, and only evaluation surfaces that.