The Action Gap: Why Collecting Course Feedback Is the Easy 20%

The hard part of course evaluation is not collecting the data. It is doing something with it — and being seen to. Most institutions have this exactly backwards. They invest in survey platforms, reminder campaigns, and response-rate dashboards, then let the results pool in a committee folder where they inform, at best, a line in an annual report nobody reads. Collection is the easy 20%. Acting on feedback and closing the loop — actually changing something and telling students what changed — is the 80% where quality assurance lives or dies. And the cost of getting it wrong is not abstract: when students conclude their feedback goes nowhere, they stop giving it.

The standard already requires the whole cycle

This is not a matter of best-practice preference. For any institution operating in the European Higher Education Area, the Standards and Guidelines for Quality Assurance (ESG 2015) make the full cycle an explicit expectation. Standard 1.9, "On-going monitoring and periodic review of programmes," states that institutions should monitor and periodically review their programmes "to ensure that they achieve the objectives set for them and respond to the needs of students and society," that these reviews "should lead to continuous improvement of the programme," and — critically — that "any action planned or taken as a result should be communicated to all those concerned" (ENQA, the ESG).

Read that last clause carefully. The standard does not ask you to collect feedback. It asks you to act on it and to communicate the action back to those concerned — students, staff, society. Collection is assumed; the standard is about the loop. An institution with a 70% response rate and no visible action is less compliant with the spirit of 1.9 than one with a 45% response rate that demonstrably changes courses and tells students about it.

This maps onto the oldest idea in quality management: the Plan–Do–Check–Act cycle. Course evaluation is the "Check." On its own it improves nothing. The value is created in the "Act" — the curriculum tweak, the reweighted assessment, the new feedback turnaround target — and in feeding that back into the next "Plan." Universities are, in the main, excellent at Check and poor at Act.

The action gap has a measurable cost

Here is the part that should worry any quality office: the action gap is self-reinforcing, and you can see it in your response rates. The reason students give for not completing evaluations, again and again in the research, is the belief that nothing comes of them. As one synthesis of the participation literature puts it, students "have grown tired of all these course evaluations and don't think their feedback makes any difference anyway," and the perception "that their feedback does not lead to tangible changes... diminishes their willingness to participate" (Faculty Focus, improving response rates).

The numbers bear this out in both directions. Response rates have already fallen sharply with the move online — one large US public university saw participation drop from 73% on paper in 2006 to a low of 43% after moving online — and feedback fatigue compounds the decline year on year. But the same literature shows the cure is closing the loop: faculty who explicitly explained how previous results had changed their teaching lifted response rates (in one case to 57%), because students participate when they believe their input is valued and used. Declining response rates, in other words, are often not a logistics problem to be solved with more reminder emails. They are a trust signal — a referendum on whether students think you act. Chasing the rate while ignoring the action treats the symptom and feeds the disease.

Closing the loop, concretely

Closing the loop is more than a "you said, we did" poster, though that visible communication matters. A functioning action cycle has four moving parts:

• Triage to action, fast. Distinguish what can change now (a confusing rubric, a broken reading link) from what needs the next validation cycle (a redesigned module). Mid-cycle feedback exists precisely so the current cohort benefits, not only the next one (see formative vs summative evaluation).
• Assign ownership. Every theme that warrants action gets a named owner and a date. Feedback that belongs to "the committee" belongs to no one.
• Communicate the action — including the "no." Tell students what changed and what did not, and why. "We heard you want fewer group projects; here is the pedagogical reason we are keeping them" is closing the loop just as much as a change is. Students respect a reasoned no; they resent silence.
• Feed it into the next Plan. Actions and their outcomes become evidence in the next programme review — which is exactly the documented, longitudinal trail that accreditation under the ESG looks for.

But isn't the real problem just low response rates? And doesn't acting on feedback risk pandering?

Two serious objections. The first: surely if we fixed response rates, representativeness would improve and the rest would follow — so isn't collection still the priority? The answer is that the causation mostly runs the other way. Low response rates are substantially caused by the action gap; students disengage because nothing visibly changes. Pouring effort into collection while the loop stays open is bailing a boat without plugging the hole. Fix the action cycle and response rates tend to recover as a by-product.

The second objection is sharper: doesn't "acting on student feedback" risk turning courses into a popularity contest — dropping hard content because students complained, chasing satisfaction at the expense of rigour? This is a real danger and the reason the action cycle needs judgement, not automation. Closing the loop does not mean doing whatever the feedback says. It means responding to it — sometimes by changing the course, sometimes by explaining why the difficult thing stays. The evidence that students rate effortful, high-learning courses lower (the active-learning penalty) is precisely why "act on feedback" must mean "interpret and respond," not "comply." A reasoned "no, and here is why" is a legitimate — often the best — way to close the loop.

A fair limitation: acting visibly on feedback is resource-intensive, and not every institution has the staff to triage, assign, and communicate at scale. That constraint is real — and it is exactly where the analysis burden, rather than the collection, is the bottleneck worth automating.

Where Koji fits

If the action cycle is the hard 80%, the question is what makes acting feasible — and the honest answer is that the bottleneck is usually turning raw feedback into a clear, owned set of actions fast enough to matter. Koji for Education is built around the loop, not just the survey. Its automatic thematic analysis turns thousands of open responses into the ranked, recurring themes a committee can actually assign and act on — collapsing the weeks of manual coding that usually stall the "Act" phase. AI-moderated conversational interviews capture the specific, actionable detail ("the rubric was unclear here") that a Likert mean never surfaces, with formative/mid-cycle collection so you can act while the current cohort still benefits. Closing-the-loop action tracking gives each theme an owner and a status, and programme- and institution-level reporting produces the documented, longitudinal improvement trail that ESG Standard 1.9 and accreditation reviews expect. None of this removes the human judgement at the centre of the cycle — deciding what to change and what to defend is, and should remain, an academic decision. What it removes is the analysis bottleneck that lets feedback die in a folder. The same engine powers the main koji.so platform, where the discipline is identical: insight is worthless until someone acts on it and closes the loop.

The bottom line

Collecting course feedback is the easy part, and most institutions over-invest in it while the loop stays open. The ESG already require the whole cycle — monitor, improve, and communicate the action taken. The action gap is not a minor governance failing; it is the thing your falling response rates are quietly measuring. Plug the hole. Triage to action, assign ownership, communicate what changed and what did not, and feed it into the next plan. Do that, and you will not have to fight so hard for the response rate — students answer people who listen.