Public 'Rate My Professor' Reviews Are Now EU-Regulated. That Still Doesn't Make Them Representative.
Since February 2024 the public review platforms your department nervously monitors are governed by the EU Digital Services Act. But the DSA regulates illegal content and transparency — not whether a review is accurate or representative. No legal regime makes public rating data a valid quality signal.
Koji Education Team
Product · August 10, 2026
Since 17 February 2024, the public "rate my professor" and course-review platforms that many departments quietly monitor have been governed by the EU Digital Services Act. That sounds reassuring — regulation implies reliability. It does not. The DSA governs illegal content, procedural due process, and, for the largest platforms, systemic risk and transparency. It says nothing about whether an individual review is accurate, fair, or representative of a cohort. Even the consumer-protection laws that tackle fake reviews target commercial deception, not genuine-but-skewed student ratings. The upshot for quality assurance: no legal regime makes public review data a valid measure of course quality — and treating it as one is a methodological error the law will not save you from.
What the DSA actually does to a review platform
The Digital Services Act — Regulation (EU) 2022/2065 — entered into force on 16 November 2022 and became fully applicable to all in-scope services on 17 February 2024. A site that stores and publicly displays user-submitted reviews is an "online platform" within the meaning of Article 3(i): a hosting service that "stores and disseminates information to the public." So a public lecturer- or course-rating site sits squarely inside the DSA.
What the DSA then requires of that platform is, in essence, good process around content:
- Notice-and-action mechanisms so anyone can flag allegedly illegal content (Article 16), with a statement of reasons when content is removed or restricted (Article 17).
- An internal complaint-handling system for users who dispute those decisions (Article 20), plus trusted flagger channels (Article 22) and measures against misuse by people who repeatedly post illegal content or abusive notices (Article 23).
- No general monitoring obligation (Article 8): the platform is not required to proactively police everything users say.
- Transparency reporting (Articles 15 and 24), and for Very Large Online Platforms — those with at least 45 million average monthly active users in the EU (Article 33) — additional systemic-risk duties. Fines can reach 6% of worldwide annual turnover (Article 74).
Read that list carefully. Every obligation is about legality and due process, not truth or representativeness. Nothing in the DSA requires a review platform to ensure that its ratings reflect a lecturer's actual quality, or that the handful of students who posted are representative of the class. A defamatory or illegal review can be flagged and removed; an unrepresentative but perfectly legal one stays up, and the DSA is entirely indifferent to it.
Fake-review law doesn't close the gap either
You might assume consumer-protection law fills the hole. It does not — it addresses a different problem. In the EU, the Unfair Commercial Practices Directive (2005/29/EC), as amended by the Omnibus Directive (EU) 2019/2161 (applicable since 28 May 2022), bans submitting or commissioning fake consumer reviews and requires traders to take reasonable, proportionate steps to verify that reviews are genuine. In the UK, the Digital Markets, Competition and Consumers Act 2024 brought in a fake-reviews ban in force from 6 April 2025, enforced directly by the CMA with fines up to £300,000 or 10% of global turnover.
But these regimes target commercial deception — traders faking or incentivising reviews of their own products. They do not make a genuine student's genuine-but-unrepresentative rating unlawful. A cohort of 200 in which the six angriest students post is producing entirely lawful reviews under every one of these regimes. The law polices fakery and illegality; it has nothing to say about sampling. Which is precisely the problem for anyone tempted to read the public rating as a verdict on the course.
Why public ratings are structurally unrepresentative
The methodological objection to public rating platforms is old and well evidenced. They are self-selected: people with strong feelings — often strongly negative or, in the "easy A" pattern, strongly transactional — are far more likely to post than the quiet middle. Legg and Wilson, comparing RateMyProfessors ratings against in-class institutional evaluations, concluded that "conclusions drawn from RMP are suspect and indeed may offer a biased view of professors" because of that self-selection (Assessment & Evaluation in Higher Education, 2012); Otto and colleagues reached similar conclusions about RMP's validity in the same journal (2008). The scale of the thin-sample problem is stark: in one large analysis of millions of RMP ratings, only around 190,006 US professors had even 20 ratings to their name — a floor an institutional evaluation clears in a single class.
This is the same family of error we have written about repeatedly: self-selection and non-response bias mean the people who answer are not the people you need to hear from, and when the missing responses are systematically different from the ones you got, the visible average is not just noisy — it is biased in an unknown direction. A public platform is that bias in its most extreme form, with none of the sampling controls, response-rate transparency, or demographic weighting a well-run internal survey can apply. Repurposing it as a quality signal repeats, at the level of a single lecturer, exactly the category error we described when satisfaction data gets turned into public league tables.
But aren't public reviews more candid — and now more trustworthy?
The honest counterargument has two parts. First, public reviews are unfiltered and can catch things a bland internal survey misses — a genuinely toxic module, a safety issue, a pattern the institution is motivated not to see. That candour is real, and dismissing it entirely is complacent. Second, now that the platforms are DSA-regulated, aren't the reviews more trustworthy?
The candour point is worth conceding — and then answering on the merits: candour is not the same as representativeness, and you can engineer candour into a representative instrument. A well-designed anonymous internal evaluation, especially one that lets students speak in their own words, captures the same unfiltered signal without the self-selection. The trustworthiness point is where the confusion lies. DSA regulation improves how a platform handles illegal content and user disputes; it does nothing to fix who chose to post. A platform can be fully DSA-compliant and still be a wildly unrepresentative sample. Regulation of process is not validation of data.
Where Koji fits
If the reason you watch public review sites is that you want the candid, in-their-own-words signal they sometimes carry, the fix is to get that signal representatively from your own students. Koji for Education runs AI-moderated conversational interviews that ask open questions and follow up — the unfiltered "what would you actually change" texture of a public review, but from the whole cohort rather than the self-selected few. Its automatic thematic analysis turns those responses into ranked themes with traceable quotes, so you can read open text at scale without collapsing it to a sentiment score. Because collection is invited from the full class, you can see and report your response rate and act on non-response instead of guessing at a public sample of unknown provenance — and because it is GDPR/AVG-compliant and runs on infrastructure you control, the data is defensible in a way scraped public reviews never are. Institutions that also monitor their broader reputation and run brand or customer research use the same conversational interview engine on the main Koji platform to get representative voice there too.
Public platforms are now regulated, and that is a genuine improvement for users. It is not a reason to treat them as evidence about your courses. The representative, governed, actionable signal is the one you collect yourself.
Frequently asked questions
Does the Digital Services Act apply to "rate my professor" style platforms? Yes. Since 17 February 2024 the DSA (Regulation (EU) 2022/2065) applies in full, and a site that stores and publicly displays user reviews is an "online platform" under Article 3(i). Such platforms must provide notice-and-action mechanisms, statements of reasons, internal complaint handling and transparency reporting.
Does the DSA make online reviews accurate or representative? No. The DSA governs illegal content, procedural due process and, for very large platforms, systemic-risk and transparency obligations. It imposes no requirement that ordinary user reviews be accurate, fair or representative of a cohort. A perfectly legal but unrepresentative review is untouched by it.
What law covers fake reviews then? Consumer-protection law. In the EU the Unfair Commercial Practices Directive as amended by the Omnibus Directive (EU) 2019/2161 bans fake and commissioned reviews and requires verification steps; in the UK the Digital Markets, Competition and Consumers Act 2024 introduced a fake-reviews ban from April 2025. These target commercial deception, not genuine-but-unrepresentative student ratings.
Why are public rating platforms unrepresentative? Because posting is self-selected: students with strong positive or negative feelings post far more than the quiet majority, and most entries rest on very few ratings. Research on RateMyProfessors (Legg & Wilson, 2012; Otto et al., 2008) finds the resulting picture is biased and its validity suspect compared with whole-class institutional evaluation.
Should universities ignore public reviews entirely? Not entirely — they can occasionally surface real issues an internal survey misses. But they should never be treated as a measure of course quality. The candid signal they sometimes carry is better obtained representatively through a well-designed internal evaluation that captures the whole cohort in students' own words.
Want the candour of a public review without the self-selection? See how Koji for Education captures open, in-their-own-words feedback from your whole cohort — representative, governed, and ready to act on.