You have 0 free articles left this month.

Compared with whom? The question missing from ‘Research shows…’

The next time a headline announces a revolutionary breakthrough, a miracle treatment, or a definitive answer to a complex human problem, pause before accepting the conclusion. Ask what any competent lawyer would ask before relying on an authority: Where did this come from, what are its limits, and does it apply here? writes Rebecca Ward, MBA.

November 17, 2026 • By Rebecca Ward, MBA
Share this article on:
expand image

‘Research shows…’

Few phrases carry more authority in modern society. Research shows coffee prevents disease. Research shows coffee causes disease. Research shows artificial intelligence will transform the workplace. Research shows Ozempic slows ageing. The problem is not that these statements are necessarily false. The problem is that they are often incomplete.

 
 

Lawyers instinctively understand something that many public discussions forget: context matters. Imagine a junior lawyer walking into chambers and announcing, “The court has already decided this issue.”

Any competent senior counsel would immediately ask several questions: Which court? Which jurisdiction? What were the facts? Was it appealed? Is it binding authority or merely persuasive?

No lawyer would accept the proposition at face value because legal conclusions do not exist in a vacuum. A decision of the Supreme Court of Liberia may be entirely correct. It may also be entirely irrelevant to a Queensland negligence claim. A civil judgment may be perfectly sound authority for a civil dispute while being meaningless in a criminal prosecution. Context determines relevance. Yet when scientific findings appear in headlines, we often abandon exactly the same discipline.

Science has jurisdiction too

Research has jurisdiction. Every study is confined by the people selected, the question asked, the comparison chosen, the method used, and the conditions under which the result appeared. Cross any of those borders carelessly and a valid finding can become an invalid conclusion. The question is not simply, “Is the research correct?” It is, “Correct for whom?”

When Ozempic became an anti-ageing drug

In May 2026, researchers reported that semaglutide, the active ingredient in Ozempic and Wegovy, reduced several measures of epigenetic ageing. Predictably, the finding escaped the journal and put on its party clothes. Before long, the public message was simpler and considerably sexier: “Ozempic slows ageing.”

The difficulty is that one of the most important details disappeared almost immediately. The analysis involved 84 adults living with HIV-associated lipohypertrophy, followed for 32 weeks. It was a post hoc exploratory analysis, and epigenetic ageing was not the original trial’s primary outcome. Those qualifications are not methodological confetti. They are the study.

Researchers observed reductions across several DNA-methylation measures after semaglutide treatment. That is genuinely interesting. It is also very different from proving that Ozempic slows ageing in the general population, reverses birthdays, or belongs beside the moisturiser in every bathroom cabinet.

Somewhere between the research paper and the headline, the scientific equivalent of jurisdiction disappeared.

Psychopathy and the population problem

Consider psychopathy, a term now thrown around with the abandon once reserved for “toxic” and “gaslighting”. Much of the psychopathy literature was historically built around highly specific populations, particularly incarcerated men. That does not invalidate the work. It does, however, limit how confidently its findings can be extended to women, adolescents, corporate executives, Australian populations or people who have never entered the criminal justice system.

Again, the question is not whether the research was correct. The question is whether it applies. A psychological measure developed in one cultural setting may not function identically in another. A risk-assessment instrument validated on one offender population may perform differently when transported across sex, age, ethnicity, jurisdiction or base rate. A medical intervention that benefits one patient group may have little relevance to another. Evidence can be rigorous within its boundaries and reckless outside them.

The legal profession understands this intuitively. A proposition can be completely correct and completely irrelevant at the same time. Science deserves the same disciplined reading we give legislation and precedent.

The witness is not the average

This matters because lawyers routinely encounter research disguised as an answer about an individual. Expert reports draw upon psychology, psychiatry, medicine, forensic science, economics and, increasingly, artificial intelligence. A population-level association is then asked to explain the person standing before the court.

But the witness is not the average. Neither is the accused, the plaintiff, the injured worker, or the parent in a family law dispute. A group tendency may inform an opinion; it does not automatically determine an individual fact.

The critical questions are therefore not ornamental. Who was studied? Who was excluded? Compared with whom? How large was the effect? Was the finding replicated? What assumptions underpin it? What alternative explanations remain plausible? Most importantly, does the evidence actually apply to this person, in this jurisdiction, for this legal question? These are not anti-science questions. They are how good lawyers stop science from being overclaimed.

Why ‘Research shows’ sells

We are human, time-poor and seduced by certainty. We prefer “Research shows…” to “Research suggests, within a specific population, under particular conditions, compared with a defined reference group, and subject to several limitations”. The second version is more honest. It is also a terrible headline.

Perhaps this is why lawyers often sound frustratingly cautious. Clients want certainty. Journalists want certainty. Sometimes, even courts want certainty. Instead, lawyers respond with the two words nobody enjoys hearing: “It depends.”

The phrase sounds evasive. In reality, it is intellectual hygiene. It depends on the facts, the evidence, the population, the comparison, and the purpose for which the conclusion is being offered. A caveat is not always an inconvenience attached to the answer. Sometimes, it is the answer.

Compared with whom?

The next time a headline announces a revolutionary breakthrough, a miracle treatment, or a definitive answer to a complex human problem, pause before accepting the conclusion. Ask what any competent lawyer would ask before relying on an authority: Where did this come from, what are its limits, and does it apply here? “Research shows” may begin the conversation. It should never end it. The headline offers certainty. The lawyer asks the better question: compared with whom?

Rebecca Ward is an MBA-qualified management consultant with a focus on mental health. She is the managing director of Barristers’ Health, which supports the legal profession through management consulting and psychotherapy. Barristers’ Health was founded in memory of her brother, Steven Ward, LLB.

Want to see more stories from trusted news sources?
Make Lawyers Weekly a preferred news source on Google.
Click here to add Lawyers Weekly as a preferred news source.