The Employer Voice Is Not Ground Truth: How to Read Skills-Gap Feedback Critically

Bottom line up front: As universities are pushed to prove employability, employer feedback is increasingly treated as the objective ground truth that student satisfaction is not. It is a valuable signal — but it is not neutral. Employer surveys and advisory panels carry their own selection, recency, survivorship and social-desirability biases, and the "skills gap" they most loudly report is contested in the economics literature. Employer feedback belongs in programme evaluation as one triangulated source among several, read critically — not as the yardstick that settles every curriculum argument.

Why employer feedback got promoted to "objective"

The logic is seductive. Student evaluations are dismissed as subjective satisfaction; graduate-outcome statistics arrive years too late; so curriculum committees reach for the party that hires the graduates and ask, in effect, are our students good enough? The employer answer feels like it comes from the real world, unclouded by the biases that plague student ratings.

That framing is exactly the problem. Employer feedback is a survey like any other, collected from a self-selected group with its own interests and its own perceptual distortions. Treating it as bias-free simply moves the measurement error somewhere less scrutinised.

The "skills gap" is more contested than committees assume

Start with the headline claim employer feedback most often delivers: graduates lack the skills we need. This is usually taken at face value. It should not be.

In the most-cited critical review of the evidence, Peter Cappelli examined a large body of employer-organisation reports, government sources and academic studies and concluded that there is remarkably little evidence consistent with the widespread complaints about skills shortages — and a good deal of evidence against them (Cappelli, 2015, ILR Review / NBER Working Paper 20382). His core economic test: a genuine shortage of a skill should push its wages up, yet the expected wage signals were largely absent. Cappelli also noted that employer reports frequently contained contradictory evidence — sizeable shares of employers, pressed on the source of their hiring difficulty, pointed to their own unwillingness to pay competitively, to a failure to provide training, or to an inability to forecast their needs. In many cases the "skills gap" turned out to describe attitude and experience expectations, or plain over-education, rather than a deficit in what universities teach.

None of this means employers are wrong to want work-ready graduates. It means the specific inference curriculum committees draw — our teaching is failing because employers report a gap — is not warranted by the employer report alone. The complaint is real; its cause is frequently misattributed.

Four biases every employer survey carries

Beyond the contested headline, employer feedback inherits the ordinary pathologies of survey data — often in sharper form than student evaluations, because employer response rates are typically far lower and the respondent pool far more self-selected.

1. Selection bias. The employers who respond to your survey or sit on your advisory board are not a random sample. They are disproportionately the ones with a grievance, an existing relationship, or a recruiting interest — each of which skews what they report. The quiet majority who hire your graduates uneventfully rarely fill in the form.

2. Recency bias. An employer's verdict on "your graduates" is often anchored to their most recent or most memorable hire — one salient individual generalised to a cohort of hundreds. This is the same peak-end and recency distortion that afflicts student ratings, transposed to the employer.

3. Survivorship bias. Employer feedback comes only from organisations that hire your graduates at all — and often only about the graduates who were hired and stayed. The students who never entered that employer's pipeline, or left it, are invisible. You are sampling the survivors of a selection process and treating their employers' views as representative of the programme.

4. Social-desirability and agenda effects. Employers respond within a relationship. Some soften criticism to preserve a recruiting partnership; others amplify a "skills gap" narrative that supports lobbying for public training subsidies or more graduate supply to hold wages down. Either way, the answer is shaped by the interest behind it, not only by the graduates in front of it.

"But surely employers know what the job needs better than academics?"

This is the strongest counterargument and it is partly right. Employers have genuine, hard-won knowledge of current workplace demands that a curriculum committee lacks, and ignoring them produces exactly the ivory-tower irrelevance critics rightly attack. The student–employer perception gap is real, and employers often see it more clearly.

But "employers know the job" and "employer feedback is an unbiased measure of programme quality" are different claims. Two qualifications keep the first from collapsing into the second. First, employers know current, local, firm-specific demand; a degree programme is accountable for durable capability across a whole career and labour market, and the two routinely diverge — the signalling-versus-human-capital tension we have written about. Optimising a curriculum to this quarter's employer wish-list can actively harm graduates a decade out. Second, the right response to valuable-but-biased evidence is not to elevate it to ground truth, nor to dismiss it, but to triangulate it — the same discipline good evaluation applies to student ratings.

What to do instead: triangulate and structure the employer signal

Employer feedback earns its place in programme evaluation when it is treated as one corner of a triangle — read alongside student experience, direct evidence of learning, and hard labour-market intelligence drawn from actual job postings rather than anecdote. Concretely:

• Structure the question. Replace "are our graduates good enough?" with specific, behaviourally anchored questions about observed tasks, so you collect evidence rather than sentiment.
• Probe the "gap." When an employer reports a deficit, ask for a specific example and whether it reflects the degree, the hiring process, onboarding, or pay. Cappelli's findings predict many "gaps" will not survive this question.
• Widen the sample. Deliberately reach employers beyond your advisory board and existing partners to counter selection bias.
• Triangulate before acting. Change the curriculum when the employer signal converges with independent evidence — not on the employer report alone.

A worked example makes the discipline concrete. Suppose an advisory-board employer reports that your computing graduates "can't communicate." Read as ground truth, that triggers a curriculum overhaul. Read critically, it prompts questions: which graduates, how many, in what roles, compared with whom? Often the complaint traces to one junior hire, a mismatch between the role and the degree, or onboarding the employer never provided — none of which a communication module fixes. Now triangulate: do your own exit interviews, alumni tracer data, and job-posting analysis show the same signal? If graduate destinations are strong and other employers do not report it, the responsible conclusion is to log the comment, not to rebuild the programme around it.

Where Koji fits

Koji for Education is built to make employer feedback a structured, probing evidence source rather than an unexamined verdict. Its AI-moderated conversational interviews apply the same rigour to employers as to students — following up on a reported "skills gap" with neutral probes for concrete examples and asking whether the cause lies in the degree, recruitment, or onboarding, exactly the interrogation Cappelli's work implies is needed. Six structured question types let you anchor employer questions to observed tasks instead of vague satisfaction, and automatic thematic analysis aggregates responses across many employers into structured themes, dampening the loud-minority and recency effects that distort a handful of advisory-board voices. Programme- and institution-level reporting places the employer signal next to student and outcome evidence so you can triangulate rather than over-react, all under GDPR-compliant, EU-appropriate data handling.

Institutions that also run wider stakeholder and customer research can use the same conversational interview engine on the main Koji platform, keeping one consistent, bias-aware methodology across employer panels and other studies.

Koji cannot make employer feedback objective — no tool can strip an employer of their interests or their memory. What it can do is surface and structure the employer voice well enough that you can weigh it honestly, alongside everything else, instead of mistaking it for the last word.

Want employer feedback you can actually triangulate? See how Koji for Education turns employer panels into structured, probing evidence for programme evaluation.