Closing the Employer Feedback Loop in Programme Evaluation

Bottom line up front: Course evaluation that stops at student satisfaction answers the question "did students enjoy and value this?" — but not "does this programme produce graduates with the competencies the labour market needs?" Those are different questions, and the European evidence on skills mismatch shows the second one matters enormously. Triangulating student feedback with structured employer and graduate-outcome feedback closes a loop most institutions leave open — and the European Standards and Guidelines arguably already expect it.

The question student satisfaction cannot answer

Student evaluations are necessary. They capture the lived experience of teaching, surface problems early, and give students a voice. But there is a category of question they are structurally unable to answer: whether the programme actually built the durable, transferable competencies graduates will need years later. Students rate what they can perceive now — clarity, organisation, workload, engagement. They cannot reliably judge whether the curriculum equipped them for a labour market they have not yet entered. That judgement requires data from after graduation and from those who employ graduates.

The European evidence on why this matters

The scale of the mismatch problem makes this more than a theoretical gap. Cedefop's European Skills and Jobs Survey and related analyses paint a sobering picture:

• Around 25% of highly qualified young adults in the EU are overqualified for their jobs, and those graduating after the 2008 crisis are roughly twice as likely to be overqualified in their first job as those who graduated in the 1990s (Cedefop, European Skills and Jobs Survey).
• On the demand side, roughly four in ten EU firms report difficulty finding people with the right skills, concentrated in sectors like ICT, manufacturing, and health care (Cedefop).
• Cedefop also finds a large share of EU employees are overskilled and trapped in jobs that under-use their abilities, indicating mismatch runs in both directions.

A system that produces a quarter of its young graduates into overqualification, while four in ten employers cannot find the skills they need, has a feedback problem. Programmes are optimising — partly via student satisfaction — for something other than the competencies the labour market signals it wants. Importantly, work-based learning helps: Cedefop finds graduates whose studies involved work-based learning move into skill-intensive jobs faster — a clue about where employer engagement pays off.

This is not a fringe idea — the ESG point toward it

European quality assurance already gestures at this. The Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG 2015) define stakeholders to include external actors such as employers, and Standard 1.9 (on-going monitoring and periodic review of programmes) expects institutions to review programmes against "the changing needs of society" and the employability of graduates — not student satisfaction alone. The ESG revision underway for 2027, with a first complete draft published in November 2025, keeps stakeholder engagement central. Closing the employer loop is not gold-plating; it is a reasonable reading of what the ESG already ask.

But isn't this just turning universities into vocational training?

This is the objection that matters most to a sceptical academic audience, and it deserves a serious answer rather than a brush-off. The fear is legitimate: if employers set the curriculum, universities risk narrowing to short-term, job-specific training at the expense of critical thinking, disciplinary depth, and the public good of education. Three distinctions defuse it.

First, employer feedback is one triangulated source, not the master signal. The methodologically sound move is to weigh employer input alongside student evaluation, peer review, graduate-tracer data, and academic judgement — never to let any single voice dictate. Triangulation is the whole point; employers simply fill the blind spot students cannot.

Second, what good employer feedback asks about is durable competencies, not narrow tasks. Employers consistently report wanting communication, problem-solving, teamwork, adaptability, and the ability to learn — precisely the transferable capacities a strong academic programme already aims to build, as European university bodies have documented in work on employers' expectations of graduate competencies. Listening to employers and defending a liberal education are not in tension when you ask the right questions.

Third, the alternative to structured employer feedback is not academic purity — it is anecdote. Programmes already respond to employer signals; they just do it informally, through whichever alumnus or advisory-board member happens to be loudest. Structured, representative feedback is more rigorous and less captureable by any single interest than the status quo.

What closing the loop looks like in practice

A programme that genuinely closes the employer loop tends to:

• Run graduate-tracer studies at 6, 12, and 36 months to capture outcomes and retrospective judgements of preparedness.
• Collect structured employer feedback — from placement hosts, advisory boards, and graduate employers — on observed competencies, not job titles.
• Triangulate all of it with student evaluation and peer review at the programme level, where curriculum decisions actually get made.
• Feed conclusions back into periodic review and tell students and staff what changed.

The barrier is rarely willingness; it is logistics. Employers will not fill in long Likert grids, and tracer surveys decay into low response rates. The data you most need is the hardest to collect by traditional survey.

Start small: three questions worth asking employers

Institutions often stall on employer feedback because they imagine an elaborate apparatus. It can begin with three questions, asked of placement hosts and graduate employers in a short conversation rather than a long form:

• "Which competencies did our graduate arrive with that you relied on?" — this surfaces what the programme is getting right, in the employer's own language, and protects it from being cut.
• "Where did you have to fill a gap in the first six months?" — this is the actionable signal: the difference between what the curriculum certifies and what the workplace needs, named concretely rather than abstractly.
• "What will this role require in three years that it does not today?" — this turns employer feedback from a rear-view mirror into a forward-looking input, the part programmes most often miss.

Keep it to competencies and observations, not curriculum prescriptions — employers are excellent witnesses to outcomes and poor designers of syllabi. Ask a representative handful rather than chasing a census, triangulate what they say with graduate-tracer data and student evaluation, and feed it into periodic review. The apparatus can grow later; the loop closes the moment you start listening on purpose.

The graduate is the missing witness

Employers see the destination; graduates see the journey in hindsight. A few months into work, a graduate can tell you what the programme prepared them for and what it quietly assumed they would pick up later — a judgement they simply could not make as a final-year student rating a module. This is why graduate-tracer feedback and employer feedback are complements, not substitutes: one is the inside view of preparedness, the other the outside view of competence on the job, and together they triangulate. Collected and read against in-course student evaluation, they convert "did students like the teaching?" into "did the teaching build what graduates and their employers needed?" — a far more demanding and far more useful question. The institutions that answer it well are rarely the ones with the fanciest dashboards; they are the ones that ask, listen across all three voices, and visibly act.

Where Koji fits

This is precisely the collection problem Koji is built for. Koji for Education provides programme- and institution-level reporting that aggregates evaluation evidence where curriculum decisions are made, rather than trapping it at the single-module level. Its AI-moderated conversational interviews are well suited to graduates and employers, who will give a five-minute conversation the depth they would never give a form — surfacing which competencies landed and which gaps showed up at work. Automatic thematic analysis turns open-ended employer and graduate commentary into structured themes, and closing-the-loop action tracking records what the programme changed in response.

Because the same conversational interview engine powers general stakeholder and customer research on the main Koji platform, institutions can run employer, alumni, and student research through one consistent, GDPR-aware method — and finally triangulate the voices that a satisfaction survey leaves out.

Student satisfaction is half the picture. The other half lives with graduates and the people who hire them. Explore Koji for Education to close the loop you have been leaving open.