Nature has added an “editor’s note” to a high-profile August paper alerting readers to the fact that the article has been subject to criticism.
Journals often flag papers that are being debated — what’s unusual here is that the journal doesn’t label the notice as an official “Expression of Concern,” which are indexed by PubMed. Yet the Nature notice reads just like an expression of concern.
Statisticians are mounting a challenge to a much-publicized study suggesting that human lifespan has a limit of approximately 115 years — 125, tops.
Published last October in Nature, the study from scientists at Albert Einstein College of Medicine in New York was the eleventh most talked-about piece of research in 2016, according to Altmetric. The paper is not yet indexed in Clarivate Analytics’ Web of Science.
But now, multiple research teams have described what they see as flaws in either the statistical methods or underlying reasoning of the study. Today, Nature published five peer-reviewed rebuttals, in response to the study. Another scientist described his concerns about the paper in April in F1000 Research.
The five papers in Nature are published as Brief Communications Arising, the journal’s way of flagging an important debate over a paper. The short papers provide new data to challenge a central part of a paper’s conclusions. The study’s authors, however, have responded to all five, defending their methods, especially their controversial decision to rely in part upon a visual inspection of mortality data in concluding there is a limit to human lifespan. Senior author Jan Vijg, a geneticist, told Retraction Watch:
Recently, a biostatistician sent an open letter to editors of 10 major science journals, urging them to pay more attention to common statistical problems with papers. Specifically, Romain-Daniel Gosselin, Founder and CEO of Biotelligences, which trains researchers in biostatistics, counted how many of 10 recent papers in each of the 10 journals contained two common problems: omitting the sample size used in experiments, as well as the tests used as part of the statistical analyses. (Short answer: Too many.) Below, we have reproduced his letter.
Despite taking some serious hits, a 2006 letter in Nature isn’t going anywhere.
Years ago, a university committee determined that two figures in the letter had been falsified. The journal chose to correct the paper, rather than retract it — and then, the next year, published a correction of that correction due to “an error in the production process.” To round it out, in June of last year, Naturepublished a rebuttal from a separate research group, who had failed to replicate the letter’s results.
Still, the first author told us there are no plans to retract the paper, since the follow up experiments published in the corrections confirmed the paper’s conclusions.
In 2011, authors of a Nature letter caught some flak for issuing a lengthy correction to a neuroscience paper that had raised eyebrows within days of publication — including some suggestions it should be retracted.
The correction notice, published months after the original letter, cited errors in image choice and labeling, but asserted the conclusions remained valid.
Now, those conclusions appear up for debate. In a recent Nature Brief Communications Arising (BCA) article, a team that raised concerns about the paper five years ago says they are unable to reproduce the results. But the authors of the original paper aren’t convinced: They argue that the BCA fails to cite important evidence, has a “complete absence or low quality of analysis,” and the scientists disregard some of their data.
A prominent pancreatic cancer researcher has lost a meeting abstract and corrected a Nature paper following an institutional investigation.
Queen Mary University of London determined that, in an abstract by Thorsten Hagemann, “elements of the study summarised by this abstract are not reliable.” Hagemann has recently issued a correction to a 2014 Nature paper he co-authored, which also cited the Queen Mary University of London (QMUL) investigation, noting there was “reason to question the provenance of the data.”
Authors have retracted a Nature paper which identified neurons that render flies sensitive to a potent insect repellent, after losing confidence in the findings. The first author, however, said she does not agree with the retraction, noting that she continues to believe the data are correct.
According to the notice, the remaining authors say they no longer support the claim that certain neurons in the antennae of fruit flies are repelled by DEET, the active ingredient in many insect repellents. The last author told us some of the paper’s results are not in doubt; nevertheless, he added, the paper would not have been published in Nature without the key conclusion, so he and most of his co-authors have pulled the paper in its entirety.
Alongside the retraction, the journal has also published a Brief Communications Arising article by scientists who were unable to reproduce the paper’s findings.