New system for flagging retracted papers finds scores of them in Cochrane reviews

Cochrane has implemented a new system for checking whether any of its thousands of published reviews include retracted studies in their analyses, the organization announced today. The effort already has turned up dozens of reviews that do and will now get closer scrutiny to ensure their results and recommendations hold up.

Cochrane publishes systematic reviews on health-related topics that evaluate the strength of evidence on particular treatments and interventions. Professional organizations and policymakers use the more than 9,500 reviews when developing recommendations. Recently a study of anesthesia clinical trials found a high rate of the studies with faked or flawed data, and another revealed that retracted studies included in systematic reviews — 17% of which were Cochrane reviews — had a large impact on clinical guidelines derived from them. 

Last year, Cochrane rolled out a feature in its database of reports of clinical trials, called CENTRAL, to flag retracted studies. The publisher pulls data on retracted papers from the Retraction Watch Database, via CrossRef. Now, they have extended the process to routinely identify systematic reviews that rely on retracted papers.

Continue reading New system for flagging retracted papers finds scores of them in Cochrane reviews

Cochrane withdraws criticized alcohol misuse report for “major errors”

Cochrane_LogoThe Cochrane Library has withdrawn a criticized 2014 meta-analysis about a technique to help young people avoid alcohol abuse, because of “major errors.” 

The review found that motivational interviewing, a form of counseling to help people change behaviors, showed some effects but had “no substantive, meaningful benefits” in preventing alcohol abuse among people 25 and younger. However, other researchers in the field, including some whose studies were included in the analysis, soon raised concerns about the review’s methods and data calculation, and the authors withdrew it. 

Here’s the brief notice for “Motivational interviewing for alcohol misuse in young adults:”

Continue reading Cochrane withdraws criticized alcohol misuse report for “major errors”

Cochrane withdraws review on zinc for colds for data concerns

Cochrane_LogoThe Cochrane Library has withdrawn a 2013 systematic review on zinc’s ability to fight the common cold.

Cochrane often marks reviews “withdrawn” once new evidence emerges that renders them out of date — but in this case, the review was flagged while the editors investigate issues “regarding the calculation and analysis of data.”

Here’s the notice.

Continue reading Cochrane withdraws review on zinc for colds for data concerns

Authors’ pharma ties cause Cochrane to withdraw two diabetes reviews

Cochrane_LogoThe Cochrane Library has withdrawn two reviews evaluating the effectiveness of diabetes treatments because some of the papers’ authors work with pharmaceutical companies.

Bianca Hemmingsen, first author on both reviews, told us the Cochrane Library asked the authors to remove the researchers with ties to pharma, but after one “refused to withdraw,” both papers were pulled entirely.

However, Hemmingsen insists that their employment had no impact on either paper.

This breaks the typical mold for Cochrane withdrawals, which are usually only pulled to indicate updates and show that older reviews no longer represent the best evidence.

Continue reading Authors’ pharma ties cause Cochrane to withdraw two diabetes reviews

Progressive: How the Cochrane Library handles updates-in-progress

Over the summer, while searching for some studies and evidence for various treatments, my wife, a television writer and producer, noticed something she thought unusual enough to flag for me. The titles of a number of Cochrane Library reviews started with “WITHDRAWN.”

The Cochrane Library is the world’s leading publisher of systematic reviews, which gather all of the high-quality evidence on a given subject and offer a rigorous analysis of whether a given test or treatment works. It’s an invaluable resource. (Shameless plug: Join the Association of Health Care Journalists, where I’m treasurer, and access to the $285-per-year Cochrane subscription is included.)

Retraction Watch was curious about what “WITHDRAWN” meant, since “withdrawal” is often used synonymously with retraction. Cochrane updates its reviews regularly, as new evidence surfaces, of course. But these abstracts didn’t say anything about new reviews.

We asked Jen Beal, who handles media relations for Wiley, the Cochrane Library’s publisher. She responded: Continue reading Progressive: How the Cochrane Library handles updates-in-progress