The Portfolio Is the Real Exam: Evaluating Journalism and Media Programmes

Bottom line up front: Journalism education is judged by an industry-set standard and by a body of published, deadline-produced work — not by how satisfied students felt at the end of a module. The NCTJ Diploma in Journalism certifies news writing, media law, ethics, an e-portfolio and — for the "gold standard" — shorthand at 100 words per minute, while the BJTC accredits degrees on production-readiness. A generic "rate this module 1–5" survey misreads a discipline whose signature pedagogy is the newsroom simulation, the live brief and the portfolio critique. If your evaluation instrument was designed for lectures, it cannot see where journalists are actually trained.

The industry, not the mean, sets the bar

The NCTJ Diploma in Journalism is explicit about what a competent trainee must demonstrate. Its mandatory modules are Essential Journalism (22 credits), the Essential Journalism E-portfolio (12 credits), Essential Media Law and Regulation (10 credits) and Essential Journalism Ethics and Regulation (3 credits), with broadcast students adding Broadcast Regulation. The e-portfolio requires students to submit ten pieces of published or broadcast-ready work across mandatory categories. Shorthand is the classic dividing line: a pass may be recorded from 60 wpm, but the industry gold standard diploma requires 100 wpm and A–C grades across modules. The NCTJ, in its own framing, works closely with employers to keep qualifications aligned to what newsrooms need.

The BJTC plays a different role: it does not award its own regulated qualification but accredits existing degrees, with a stronger emphasis on multi-platform production. Between them, the message to a programme is consistent — you will be judged on whether graduates can operate to professional standards in a newsroom, produce a portfolio, and understand the law and ethics that govern publication. None of that is a satisfaction question. The University of Sunderland's summary of the benefits puts it bluntly: an accredited qualification signals that a graduate "can operate to professional standards" and is more appealing to employers for it.

Why the standard survey misreads journalism

Journalism's core learning happens through practice — live news days, mock newsrooms, real published work, and the editorial critique that follows. Three features of that pedagogy defeat a global satisfaction mean.

The productive discomfort problem. A well-run news day is stressful by design: hard deadlines, real sources, an editor sending copy back. Rigorous editorial feedback — the mechanism by which writing actually improves — is often experienced as harsh in the moment. As with the crit in practice-based arts education, the pedagogy that produces the most learning can generate the lowest comfort ratings. Optimise the satisfaction mean and you sand off the deadline pressure and blunt the feedback that employability depends on — a textbook case of why averaging Likert scores misleads.

The portfolio is the outcome, and a survey can't grade it. What matters is whether a student built a body of publishable work — the ten-piece e-portfolio, the clips, the broadcast package. That is a direct measure of capability; "I enjoyed the module" is an indirect proxy that can move in the opposite direction. The distinction between direct and indirect measures of learning is nowhere sharper than in a discipline built on a portfolio.

Placements and newsroom simulations vary, and the mean hides it. Work experience, mentoring by working journalists, and the realism of the mock newsroom differ widely across a cohort. That variance — who got a genuine newsroom placement, whose mentor engaged, whose live brief mirrored real conditions — is the actionable signal, and it is exactly what a single programme mean averages away, the same blind spot we describe for work-integrated learning.

There is also a live sector reason to care. Journalism graduates enter a labour market reshaped by AI, platform decline and shifting skills demand — the kind of skills-gap dynamics we cover for graduate employability. Programmes need evidence about whether their teaching is keeping pace with the newsroom, and a satisfaction average tells them nothing about it.

But isn't accreditation the evaluation — so why survey students?

The strongest counterargument is that NCTJ and BJTC accreditation, plus external examiners and the portfolio itself, already interrogate whether a journalism programme works — so student course evaluation is redundant box-ticking.

Accreditation and the portfolio are indispensable, but they answer a different question. They certify whether the standard was met at the point of assessment; they say little about how the teaching produced it or where it is quietly failing. Accreditation panels visit periodically; portfolios are graded at the end. Neither tells a programme director, mid-semester, that the media-law teaching is losing half the cohort, that one placement provider is warehousing students on the news desk, or that the newsroom simulation feels nothing like a real one. Student evaluation is the leading, mechanistic signal between accreditation cycles — it is a complement in a triangulated evidence base, not a rival to the exam. And it earns its place only if it asks about the practice, the feedback and the placement — not about generic satisfaction.

We keep the claim modest. Evaluation does not certify journalistic competence and does not replace the portfolio or the accreditor. It surfaces the teaching and placement conditions that determine whether the portfolio and the accreditation come good.

Where Koji fits

Koji for Education swaps the static form for an AI-moderated conversational interview that adapts to what each student describes — a far better match for a practice-based discipline:

It probes the practice, not the mood. When a student mentions the news day, the interview can follow up on deadline realism, source access and editorial feedback; when they mention a placement, it can probe supervision and the breadth of real work — the setting-specific detail a mean erases.
Automatic thematic analysis turns hundreds of open-text comments into structured, quality-scored themes, so a programme lead sees the "media law moved too fast" or "placement X gave me no real stories" pattern as evidence, not anecdote. See what AI can and cannot do with open-text feedback.
Formative, mid-module collection catches a failing simulation or a weak placement while there is still time to act.
Programme-level reporting aggregates across the news-writing, law, ethics and portfolio strands the way an accreditor reads a course.
Standardised, bias-aware AI moderation and GDPR/AVG-compliant handling keep the evidence defensible for NCTJ or BJTC review.

Media schools that also run audience research or industry-partner studies can use the same AI interview engine on the main Koji platform. And because Koji's design points toward conversational rather than tick-box feedback, it fits the way journalists themselves gather a story: by asking, then following up.

Koji will not mark a portfolio or grant accreditation. It makes the newsroom, the live brief and the placement visible in your evaluation — so the parts of a journalism degree that actually make journalists stop being the parts your data ignores.

Frequently asked questions

What is the difference between NCTJ and BJTC accreditation? The NCTJ sets and awards its own qualification, the Diploma in Journalism, with standardised assessments across accredited courses. The BJTC does not award its own regulated qualification; it accredits existing degrees with a stronger production and multi-platform emphasis. Many programmes seek one or both.

Can course evaluation measure whether a student can do journalism? No — that is what the portfolio, the e-portfolio and professional assessment are for. Evaluation measures the teaching and placement conditions around those outcomes: feedback quality, deadline realism, placement supervision and sequencing. It is complementary evidence, not a competence test.

Why does a satisfaction mean misread journalism programmes? Because the signature pedagogy — news days, live briefs, editorial critique — is deliberately demanding, so the most valuable teaching often scores lowest on comfort. A mean also hides the wide variance in placement and simulation quality that is the real actionable signal.

How does Koji handle the practical, portfolio-heavy nature of journalism? Its AI interview probes specific practice settings — newsroom simulations, placements, editorial feedback — and thematic analysis aggregates the results into evidence a programme lead and an accreditor can act on, rather than a single number detached from the practice.

Is AI-analysed feedback appropriate for a journalism school wary of automation? Koji uses standardised, bias-aware moderation and keeps analysis auditable and GDPR-compliant. It surfaces and mitigates inconsistency rather than claiming to eliminate bias, and every theme traces back to what students actually said.

Want evaluation that can see the news day and the portfolio, not just the lecture? Explore Koji for Education — AI-moderated interviews and thematic analysis built for practice-based programmes.