Category: erroneous data

How should journals update papers when new findings come out?

NEJM Logo

When authors get new data that revise a previous report, what should they do?

In the case of a 2015 lung cancer drug study in the New England Journal of Medicine (NEJM), the journal published a letter to the editor with the updated findings.

Shortly after the paper was published, a pharmaceutical company released new data showing the drug wasn’t quite as effective as it had seemed. Once the authors included the new data in their analysis, they adjusted their original response rate of 59%  — hailed as one of a few “encouraging results” in an NEJM editorial at the time of publication — to 45%, as they write in the letter. One of the authors told us they published the 2015 paper using less “mature” data because the drug’s benefits appeared so promising, raising questions about when to publish “exciting but still evolving data.”

It’s not a correction, as the original paper has not been changed; it doesn’t even contain a flag that it’s been updated. But among the online letters about the paper is one from the authors, “Update to Rociletinib Data with the RECIST Confirmed Response Rate,” which provides the new data and backstory:

Continue reading How should journals update papers when new findings come out?

Structural biology corrections highlight best of the scientific process

Nature_latest-coverIf you need evidence of the value of transparency in science, check out a pair of recent corrections in the structural biology literature.

This past August, researchers led by Qiu-Xing Jiang at the University of Texas Southwestern Medical Center corrected their study, first published in February 2014 in eLife, of prion-like protein aggregates called MAVS filaments, to which they had ascribed the incorrect “helical symmetry.” In March, Richard Blumberg of Harvard Medical School, and colleagues corrected their 2014 Nature study of a protein complex called CEACAM1/TIM-3, whose structure they had attempted to solve using x-ray crystallography.

In both cases, external researchers were able to download and reanalyze the authors’ own data from public data repositories, making it quickly apparent what had gone wrong and how it needed to be fixed — highlighting the very best of a scientific process that is supposed to be self-correcting and collaborative. Continue reading Structural biology corrections highlight best of the scientific process

Retractions aren’t enough: Why science has bigger problems

Andrew Gelman
Andrew Gelman

Scientific fraud isn’t what keeps Andrew Gelman, a professor of statistics at Columbia University in New York, up at night. Rather, it’s the sheer number of unreliable studies — uncorrected, unretracted — that have littered the literature. He tells us more, below.

Whatever the vast majority of retractions are, they’re a tiny fraction of the number of papers that are just wrong — by which I mean they present no good empirical evidence for their claims.

I’ve personally had to correct two of my published articles.   Continue reading Retractions aren’t enough: Why science has bigger problems

Doing the right thing: Authors share data, retract when colleague finds error

no spine minimum. full size. Editor: Holly JEM: Leslie RTP: Karen Geist ancac3

A pair of chemical engineers has retracted a paper after another researcher was unable to replicate their work, in a case that we consider an example of doing the right thing.

Dennis Prieve, at Carnegie Mellon University, was interested in applying the paper — on how systems of molecules known as “reverse micelles” conduct electrical charge — to his own work, but was having trouble repeating the calculations. So Prieve contacted the authors — John Berg and his PhD student Edward Michor, based at the University of Washington — who supplied him with their original data.

It took several weeks of back and forth to figure out the problem, Michor told us, as the paper was published in 2012, so he had to decipher his old notes. When they found that several incorrect values were used in the paper, the authors issued a retraction notice, published in March:

Continue reading Doing the right thing: Authors share data, retract when colleague finds error

Duke pulmonary researcher up to 14 retractions, putting her on our leaderboard

PLOS OneA pair of Duke researchers who each have more than 10 retractions have earned some more.

Both of the newly retracted papers — originally published in 2012 by PLOS ONE — list Erin Potts-Kant as a co-author; one includes her former supervisor, Michael Foster, as lead author. The pair has since left Duke (Potts-Kant was arrested for using school credit cards to shop at the likes of Target, and Foster retired). The reason provided for these retractions will be familiar to anyone who’s been following their case — there were “concerns about the reliability” of the data.

By our count, Potts-Kant now has 14 retractions, making her one of the few women to hold a position on our leaderboard.

Here’s the retraction notice for “Iron Supplementation Decreases Severity of Allergic Inflammation in Murine Lung,” a paper that lists both Foster and Potts-Kant as authors:

Continue reading Duke pulmonary researcher up to 14 retractions, putting her on our leaderboard

Physics journal pulls two papers for data shortcuts

New Journal of PhysicsA publisher is retracting two papers today by a team of physicists who took a short cut in reporting their data.

The papers present a method for imaging very small things — like biological processes on a molecular scale — that could be an alternative to electron microscopy, as the authors explain in a video. But after the papers were published in the New Journal of Physics, last author Ulf Leonhardt, now based at the Weizmann Institute of Science, found out that some of the data

 were pixel-by-pixel mirror-symmetric, which is impossible for genuine experimental data.

One of the researchers co-authored a subsequent paper that acknowledges one of the papers incorrectly assumed the data were symmetrical, and could therefore be extrapolated from one side to the other. A representative of the publisher told us they have not seen any signs of misconduct, and the problem seemed to result from a “series of apparent miscommunications between the authors.”

Here’s the retraction notice for “Evidence for subwavelength imaging with positive refraction:” Continue reading Physics journal pulls two papers for data shortcuts

Ecologists pull paper on how climate change affects moths after model mixup

science advancesEcologists have retracted a paper published only months ago in Science Advances, after realizing that they had misinterpreted a climate model.

The October paper examined the effects of climate change on populations of 155 species of British moths and butterflies. According to a press release from the authors’ institution, the University of York:

Using data collected by thousands of volunteers through ‘citizen science’ schemes, responses to recent climate change were seen to vary greatly from species to species.

But the authors quickly realized that the variation they had measured was not due to climate change alone, according to the retraction notice they issued for the paper last week:

Continue reading Ecologists pull paper on how climate change affects moths after model mixup

Biologist critiques own paper, journal retracts it — against her wishes

Evolution Cover ImageThe journal Evolution has retracted a 2007 paper about the roles of the different sexes in searching for mates, after the same author critiqued the work in a later paper. 

The case raises important questions about when retractions are appropriate, and whether they can have a chilling effect on scientific discourse. Although Hanna Kokko of the University of Zurich, Switzerland — who co-authored both papers — agreed that the academic literature needed to be corrected, she didn’t want to retract the earlier paper; the journal imposed that course of action, said Kokko. 

Let’s take a look at the retraction note: Continue reading Biologist critiques own paper, journal retracts it — against her wishes

Authors correct highly cited biology paper due to “genuine mistake”

Journal of Cell ScienceAuthors of a highly cited biology paper in the Journal of Cell Science (JCS) have corrected the data underlying one of the figures.

The 2003 paper, “The transcription factor Slug represses E-cadherin expression and induces epithelial to mesenchymal transitions: a comparison with Snail and E47 repressors,” has been cited 566 times, according to Thomson Reuters Web of Science. One of the authors is the last author on a recent high profile retraction from Nature Genetics, which cost the first author a grant from the European Molecular Biology Organisation.

The correction note tells us a bit more: Continue reading Authors correct highly cited biology paper due to “genuine mistake”

Raw files help fix 2003 figure by heart researcher accused of fraud

7.cover

A researcher accused of misconduct by an anonymous Japanese blogger has corrected a 2003 paper in Circulation Research, after providing a university investigation with the original source files.

Allegations of fraud have dogged Shokei Kim-Mitsuyama for years, and even caused him to step down from his position as editor in chief at another journal. However, Kim-Mitsuyama and his colleagues call the latest correction a “mistake,” which didn’t affect any of the paper’s conclusions.

We’ve unearthed a total of five publications co-authored by Kim-Mitsuyama that have earned corrections, the latest of which cites an investigation by the university:

Continue reading Raw files help fix 2003 figure by heart researcher accused of fraud