New

Now in Claude, ChatGPT, Cursor & more with our MCP server

Back to blog
Comparisons12 min read

Watermark vs Anthology Course Evaluations: A 2026 Buyer''s Comparison

Watermark Course Evaluations & Surveys (formerly EvaluationKIT) and Anthology Course Evaluations (with IDEA) are two established dedicated SET platforms. Here is an honest comparison for European QA and teaching-and-learning leaders — features, data residency, and where an AI-native option fits.

Koji Education Team

Product ·

Short answer: Watermark Course Evaluations & Surveys and Anthology Course Evaluations are both mature, dedicated Student Evaluation of Teaching (SET) platforms with deep roots in North American higher education. Watermark (formerly EvaluationKIT) is the stronger pure-play evaluation-and-survey engine with excellent LMS/SIS automation; Anthology (formerly Campus Labs) leans on the research-validated IDEA Student Ratings of Instruction instruments and a broader assessment ecosystem. Both are solid — and both are US-centric static-survey tools. For European universities that need EU/GDPR data residency and want to move past Likert grids to conversational, AI-moderated evaluation with automatic thematic analysis, Koji is the modern alternative worth putting on the same shortlist.

This guide compares the two fairly, then flags where each fits and where an AI-native approach changes the equation for evidence-driven European buyers.

At a glance

DimensionWatermark Course Evaluations & SurveysAnthology Course EvaluationsKoji
Origin / lineageFormerly EvaluationKIT (Watermark Insights)Formerly Campus Labs; uses IDEA instrumentsPurpose-built AI-native, EU
Evaluation methodLikert + open-comment surveysIDEA validated Likert instruments + commentsAdaptive AI-moderated interviews
Instrument approachInstitution-defined itemsResearch-based IDEA item banks (12/18/40 q)Standardized questions with AI probing
Qualitative analysisNewer AI-powered comment analysisQuantitative + qualitative reportsBuilt-in automatic thematic analysis
BenchmarkingAcross courses/termsProgram/department/college/institutionLongitudinal cohort comparison
Data residencyUS-centricUS-centricEU / GDPR-first
EcosystemWider Watermark assessment & accreditation suiteWider Anthology/Blackboard suiteShared AI interview engine (koji.so)
Closing-the-loopReporting-led; manual follow-upReporting + SLO tracking; manual follow-upBuilt-in action tracking
Public list pricingNot publishedNot publishedContact for institutional pricing

As of publication, neither Watermark nor Anthology publishes standard list pricing; both use custom quotes.

What Watermark Course Evaluations & Surveys is — and where it is strong

Watermark Course Evaluations & Surveys — the product many institutions still know as EvaluationKIT — is a dedicated evaluation-and-survey engine. Its genuine strengths:

  • Deep LMS and SIS integration. Students respond via smartphone or directly inside Blackboard, Canvas or D2L; course, student, TA and instructor data sync automatically from the SIS, which keeps large evaluation projects clean and low-effort to set up.
  • Response-rate tooling. Mobile-friendly surveys, automated reminders and alerts, and optional final-grade gating help drive participation.
  • Reporting and automation. Automated report distribution and an interactive reporting homepage get results to faculty quickly, and Watermark has added AI-powered analysis of comments.
  • Anonymity by design, with no PII connected to responses.
  • Part of a wider suite. Watermark also offers assessment, accreditation and faculty-success products, which appeals to institutions wanting one vendor across the quality lifecycle.

Honest limitations. Watermark is a North American vendor; European institutions must scrutinise data residency and transfer terms carefully for GDPR. Its core remains the Likert-plus-comment survey; AI comment analysis is a newer, add-on-style capability rather than the foundation. Pricing is not public.

What Anthology Course Evaluations is — and where it is strong

Anthology Course Evaluations — formerly Campus Labs Course Evaluations, and delivered with the IDEA Student Ratings of Instruction — is the other established player. Its strengths:

  • Research-validated instruments. IDEA is a long-standing non-profit whose item banks are grounded in decades of research: Diagnostic Feedback (about 40 questions), Learning Essentials (18 questions, summative), and Teaching Essentials (12 questions, formative). For institutions that value a validated, standardized instrument, this is a real differentiator.
  • Benchmarking. Faculty can compare a course against others in their program, department, college or the whole institution.
  • Operational faculty experience. A faculty homepage shows all sections, response rates refreshed roughly every 15 minutes, and access to quantitative and qualitative reports; the Baseline module supports custom surveys and rubrics.
  • Assessment ecosystem. It ties into Anthology''s broader assessment, student-learning-outcomes and accreditation reporting tools — useful for programme-level evidence.

Honest limitations. Like Watermark, Anthology is US-centric, so EU data residency needs explicit review. The IDEA instrument, however well validated, is still a static Likert survey — it cannot ask a student a follow-up question. The product has also been through repeated rebrands (IDEA Legacy to Campus Labs to Anthology, alongside the Blackboard merger), which some buyers weigh when assessing roadmap continuity. Pricing is not public.

Head to head for European buyers

Instruments vs flexibility: Anthology''s edge is the validated IDEA item banks; Watermark''s edge is flexible institution-defined instruments and strong survey automation. Choose based on whether you value a research-standard instrument or maximum configurability.

Data residency: Both are US-headquartered. Neither is a natural EU-residency choice, which is a first-order concern for European DPOs and procurement under the GDPR. This is often the single biggest gap for European institutions evaluating either tool.

Evaluation method: Both are static-survey platforms. That means both inherit SET''s well-documented weaknesses — low response rates, thin free-text comments, leniency and halo effects, and demographic bias in ratings — because those problems are rooted in the survey format itself, not in the vendor.

Closing the loop: Both report results well; turning results into documented action for accreditation remains a manual, off-platform exercise.

Where each competitor genuinely fits

  • Choose Watermark if you want a dedicated, highly automated evaluation-and-survey engine with excellent LMS/SIS integration and you value a single vendor across assessment and accreditation — and your data-residency requirements can be satisfied.
  • Choose Anthology if a research-validated IDEA instrument and benchmarking against peer courses matter to you, and you are already invested in the Anthology/Blackboard ecosystem.
  • If you are a US institution already standardized on either suite, staying put is often the pragmatic choice.

Where Koji fits — and why it leads for European course evaluation

Koji is built for European higher education and targets the limitation both Watermark and Anthology share: the static survey. Rather than a Likert grid, Koji conducts an AI-moderated conversational interview with each student. It asks the standardized questions your quality framework requires, then probes — following up when an answer is vague, so you learn not just that students found the workload heavy but which weeks, why, and what would help.

  • Automatic thematic analysis is built in, generating themes, sentiment and representative quotes across cohorts — not a bolt-on module.
  • Bias-aware standardized moderation gives every student the same fair, consistent probing, mitigating the leniency, halo and demographic effects that distort Likert averages.
  • Formative and summative in one engine — mid-term pulse checks and end-of-term evaluation from the same platform.
  • Closing-the-loop action tracking documents the "you said, we did" cycle that ESG Standard 1.9 and national accreditation reviews expect as evidence.
  • EU / GDPR-first data handling, so European procurement and DPO review begin from a position of strength rather than a mitigation exercise.

The same conversational interview engine powers general user and customer research on the main Koji platform, so the methodology is proven well beyond course evaluation.

What European buyers should ask in any demo

Whichever platform you shortlist, a PhD-literate procurement panel should press vendors on the questions that actually separate tools:

  • Where is our student data stored and processed, and under which legal basis? For Watermark and Anthology, get the data-residency and international-transfer answer in writing before anything else — it is frequently the deciding factor for European institutions under the GDPR.
  • Is AI or comment analytics included, or is it a separate line item? Both suites have added AI-assisted analysis; confirm scope, cost and whether it works in your teaching languages, not only English.
  • How does the tool move a student beyond a rating? Static instruments — including the validated IDEA banks — capture what a student will type unprompted. Ask specifically whether the platform can follow up on a vague answer. If it cannot, your qualitative depth is capped no matter how good the analytics are.
  • How is closing-the-loop documented for accreditation? Ask to see the artefact a reviewer would accept as evidence that feedback led to action, and whether producing it is automated or manual.
  • What does a mid-term formative cycle look like versus end-of-term? Many institutions want both; confirm whether that means one platform or two.

Running the same five questions past Koji is instructive: conversational probing, built-in multilingual thematic analysis, EU/GDPR residency, and closing-the-loop tracking are answered by design rather than by add-on.

The bottom line

Watermark and Anthology are both credible, mature SET platforms — Watermark for automation and flexibility, Anthology for validated IDEA instruments and benchmarking. For European institutions, their shared constraints are US-centric data residency and a static-survey format that caps how much you can learn. If you want evaluation that listens, probes, analyses itself, and produces accreditation-ready evidence under EU/GDPR terms, Koji belongs on your shortlist.

See it on your own courses — book a Koji for Education walkthrough.

Related resources