A group of researchers from Mexico has been forced to retract their July 2012 paper in the International Journal of Radiation Oncology *Biology*Physics after a reader noticed cracks in the data that proved to be signs of fatal instability.
Here’s the retraction notice for the article, titled, “Randomized Clinical Trial to Assess the Efficacy of Radiotherapy in Primary Mediastinal Large B-Lymphoma”:
This article has been retracted at the request of the Editor-in-Chief and Author.
We regret to announce that we must retract this article because errors have been identified in the publication involving several parts of the study including extraction of data, statistical analyses, and interpretation of results. Unfortunately, such extensive changes cannot be addressed in a corrigendum and would warrant a new manuscript. It is important to note that this is not considered to be the result of scientific misconduct, but rather honest errors by the authors. We regret any problems that this article may have caused and retract it from the literature.
Anthony Zietman, Editor-in-Chief on behalf of the Journal.
Augustin Aviles, Corresponding author on behalf of the authors.
The study has yet to be cited, according to Thomson Scientific’s Web of Knowledge.
Zietman provided us with more information about what went awry here:
This paper was very thoroughly reviewed by three senior figures prior to acceptance and multiple revisions made although few related to the statistics. Shortly after publication I was contacted by a reader, also a senior clinician, who felt that some of the numbers did not add up….inconsistencies between numbers in tables, text, and figures, and more. He felt these were so numerous and elementary that they undermined the credibility of the entire paper. I asked two local statisticians to take a look at the paper and both agreed. When I then challenged the authors they, without contest, recognized and accepted the errors and then a fuller story unfolded. This randomized trial was sponsored by the Mexican government. The funding dried up and the statistical analysis ultimately had to be performed by the investigators themselves with limited software packages (and probably limited statistical sophistication). They could not rerun and correct the analyses because the raw data was held elsewhere and there was no funding to pay for a statistician anyway. Thus a corrigendum was impossible and a retraction inevitable. The authors did not protest, they simply expressed their disappointment. …
I did check with the Mexican department of health that the trial had actually taken place and that interim analyses had been performed. It had!
Zietman, who took over the editor’s chair of the journal last January, said the case taught him a couple of valuable lessons.
1. even senior reviewers can miss elementary errors
2. statistical review of large and important randomized trials is probably always necessary especially when the work is not from a major, recognized, international trials group (e.g. one of the NCI co-operative groups) and especially when a statistician is not in the author line. The problem is the shortage of available clinical statisticians
Since taking over the journal Zietman has brought in
an additional editorial layer “of eyes” to try and catch such papers before they go into print and hope to act quickly in the future when they are identified.
How does that work in practice? Zietman explains:
Previously the Editor found the reviewers himself, and considered the reviews as they came in to reach a decision. This worked just fine for many years when the journal had just 500 submissions per year but the it has grown exponentially over the last decade and, with now 2000 manuscripts per year, it had become very difficult to give deep editorial thought to the quality of each review and decision.
I completely restructured the process and now have a working (and to some partial and token degree, paid) editorial board that is divided by expertise into 9 separate groups (cancer of the breast, cancer of the lung etc). Each editorial group has five experts ( a senior editor and 4 slightly more junior associates) and each group handles a manageable 200-300 manuscripts per year. They read the manuscript, carefully select reviewers, read and assess the quality of the reviews, and then further discuss the paper regarding its quality, its priority, and its credibility. By the time a paper is accepted it has been passed under many sets of eyes thus increasing the chance that errors will be detected before print. We really feel that this process is going to weed out the bad science and, in some (hopefully rare) cases, protect us against the bad actors.
Zietman said that after having no retractions in its first 38 years of existence, the journal is now working on its second:
The next one is also an unsophisticated analysis of complex data and, I think, represents another example of honest error over malfeasance.