Read Original Story

Guardian jumps to conclusions about an Alzheimer’s study that hasn’t even begun


1 Star


Virtual reality to help detect early risk of Alzheimer’s

Our Review Summary

The story focuses on a forthcoming study that aims to evaluate if virtual reality technology can be used to identify people who will eventually develop Alzheimer’s disease.

The story’s headline states: “Virtual reality to help detect early risk of Alzheimer’s.” That is misleading. The researchers haven’t even recruited study participants yet, much less conducted the study or analyzed the results. The story also fails to describe how potential diagnosis might work, what the technique may cost, or what risks are involved. It’s also not clear whether any of the researchers have a potential conflict of interest. In short, the story raises far more questions than it answers. That’s problematic.


Why This Matters

Alzheimer’s disease affects around 5 million Americans — and that number is expected to double by 2060. The disease adversely affects the quality of life for both patients and their loved ones, and it is the sixth leading cause of death in the United States. In short, Alzheimer’s disease is a big deal, and any new advances in risk assessment or diagnosis are newsworthy.

However, because this is a subject that many people are passionate about, it is especially important to approach new research responsibly. In this instance, the study has not even taken place yet, and the story fails to answer most of the major questions one might have regarding Alzheimer’s research.

We can understand that a research institution may want to raise awareness of a forthcoming study in order to recruit study participants. We are less clear on why a major news outlet would write about the research — which hasn’t even taken place yet — as if it is already newsworthy and generating data that clinical decisions can be based upon.


Does the story adequately discuss the costs of the intervention?

Not Satisfactory

Cost is not discussed. And there are multiple costs to consider here: the cost of the virtual reality (VR) hardware itself, the cost of whatever software the study participants would be using, and the cost of training professionals to interpret the data generated by study participants using the virtual reality technology. (Note: we say “study participants” because there are no patients yet, but — ultimately — the cost to patients is what we’d be interested in.)

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Applicable

This is tricky. The study has not yet taken place, so there are no benefits to discuss — which makes it difficult to ding the story for failing to quantify the benefits. As such, we’ll rate this as not applicable. However, our reasons for rating it N/A highlight a critical problem with the story, which we address in Quality of Evidence and Availability, below.

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

The big risk here, as with any screening test, is incorrect results. Even if the study hasn’t happened yet, and important data sets like sensitivity and specificity can’t yet be quantified, they should be addressed in the story. What are sensitivity and specificity? Sensitivity measures how often a test correctly generates a positive result for people who have the condition that’s being tested for. Specificity measures a test’s ability to correctly generate a negative result for people who don’t have the condition that’s being tested for. In other words, there are two possible harms inherent in diagnostic and risk assessment tools: the failure to identify someone who has Alzheimer’s; and the “false positive” misdiagnosis of people who do not have Alzheimer’s. Either mistake can have significant costs — financial and personal — for patients.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The story offers a rough overview of the size of the forthcoming study. But it fails to address key points about the study. How will the study assess a patient’s navigation skills (which the point of using a VR device)? How will it distinguish between people whose navigation skills are poor because of early neural degeneration, versus people who have never been good at navigating? Is this a longitudinal study, with patients participating in the study over the course of years, coupled with long-term follow-up to determine if and when patients develop Alzheimer’s or other, related conditions? Those are all good questions, and they are not answered here.

Does the story commit disease-mongering?


No disease mongering here.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

The story notes that the forthcoming study has received funding from the Alzheimer’s Society. However, the only source cited in the story is one of the researchers who will be conducting the study. Input from an independent expert about the viability of such a study would have been very welcome.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

There is no discussion of other approaches that are used to identify people who have Alzheimer’s disease among high-risk groups. There is also no acknowledgement of the fact that there is no definitive way to diagnose Alzheimer’s disease in patients while they are still alive (the only definitive diagnostic technique involves an autopsy). That’s a heck of an oversight.

Does the story establish the availability of the treatment/test/product/procedure?

Not Satisfactory

On the one hand, the story does tell readers that there will be a forthcoming study to evaluate whether VR technology can be used to test people’s navigation ability in order to determine whether it is an effective technique for diagnosing Alzheimer’s. (In other words, they don’t even know if this is something that will work yet.)

On the other hand, earlier in the story, readers run across sentences like: “Virtual reality to help detect early risk of Alzheimer’s” and “Those who do worse in the tests will be the ones most likely to succumb to Alzheimer’s later in life, scientists now believe.” That makes it sound like this is already a useful tool, and availability could be right around the corner. Ultimately, the story never explicitly tells readers that any possible VR tool is years away, at best. That tips the scales for us, and we lean in the direction of “not satisfactory” on this criterion. One wonders how many people read this story and contacted their general practitioner about taking a VR test to assess their Alzheimer’s risk.

Does the story establish the true novelty of the approach?

Not Satisfactory

The story does note that previous work has been done determining that navigational skills are an early indicator of Alzheimer’s risk. However, the story makes it seem like the use of VR technology is what’s new here. That’s not true. We found studies using VR to assess issues related to navigation ability and Alzheimer’s dating back to at least 2008 and 2009. So, what sets the forthcoming study apart? We wish the story had made that clear.

Does the story appear to rely solely or largely on a news release?

Not Applicable

We couldn’t find a related news release, so we’ll rate this N/A.

Total Score: 1 of 8 Satisfactory


Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.