The Importance of Being Reproducible: Keith Baggerly tells the Anil Potti story

For those Retraction Watch readers who have been following the case of Anil Potti — who has now retracted four papers — Keith Baggerly’s name will likely be familiar. Baggerly is the bioinformatician at M.D. Anderson in Houston who has been publicly questioning, in letters, papers, and The Cancer Letter, work by Potti et. al.

Yesterday, Baggerly gave a keynote at the Council of Science Editors meeting in Baltimore. It was a fascinating — and riveting — walk through how, after a group at M.D. Anderson asked him and his team to evaluate the Potti group’s tools for predicting whether given patients would respond to different chemotherapies, Baggerly’s group unraveled the Potti research.

In his talk, Baggerly demonstrated all of the mislabeling and other easily recognized errors his team found when they sifted through the raw data. And yet there were a number of wince-inducing moments in which Baggerly described the cool reception he had from several journals.

There have been a lot of calls recently that journals should require that authors deposit their data.  There’s none more powerful than when they come at the end of a talk showing how that could have stopped a faulty clinical trial from ever starting.

Baggerly told Retraction Watch he just wants this story to get the widest attention possible, so he was glad to allow us to post his slides. They get appropriately technical, given the crowd, but it’s worth it. You can follow a very unofficial and rough transcript at this Twitter search, since Ivan live-tweeted the talk. Or just click over to the slideshow here.

Roundup: A new record? And paper retracts story about Canadian Paxil researcher-turned pol Kutcher

We’ve both been at conferences — Adam at the Society of Cardiovascular Anesthesiologists in Savannah, and Ivan at the Council of Science Editors in Baltimore, where he’ll be on a panel today about finding fraud — so we haven’t had a lot of time to run down retractions. But there were a few retraction-related developments in the past few days that we wanted to highlight for Retraction Watch readers:

First, another great investigation by The Cancer Letter and The New York Times, this one into the International Early Lung Cancer Action Program (I-ELCAP) run by Claudia Henschke and David Yankelevitz. The design and conclusions of that trial has been criticized by other pulmonologists.

The new investigation, however, reveals that an October 2008 review of the study found that the researchers couldn’t find 90 percent of the subjects’ consent forms. That, The Cancer Letter notes, could mean a huge number of retractions that could displace Joachim Boldt as the current record holder: Continue reading Roundup: A new record? And paper retracts story about Canadian Paxil researcher-turned pol Kutcher

Feminism & Psychology study of UK birthing classes draws ire, winds up retracted

The debate — in entrenched medical circles, anyway — over whether it’s safe to give birth at home can be fierce. Just last month, for example, Nature reported that a review of the subject in the American Journal of Obstetrics & Gynecology that found home births more dangerous than those in the hospital generated so much controversy that it forced an investigation. Outside reviewers found problems, but the journal didn’t think they rose to the level of a retraction. Critics disagreed.

The same fraught subject came up in a paper published in Feminism & Psychology last year by Mary Horton-Salway and Abigail Locke. The original paper had concluded:

Our analysis suggests that the normativity of medical interventions in labour and childbirth is discursively reproduced in ante-natal classes whilst parental choice is limited by a powerful ‘rhetoric of risk’.

In other words, NCT classes were scaring women into choosing hospital births. But it turns out that conclusion wasn’t actually supported by the findings, which were based on a review of National Childbirth Trust’s classes. That led to a retraction: Continue reading Feminism & Psychology study of UK birthing classes draws ire, winds up retracted

Science publishes replication of Marc Hauser study, says results hold up

There has been some news over the past few weeks about Marc Hauser, the Harvard psychologist found guilty of misconduct by the university last year. First, because Harvard had listed him in a course catalog, The Crimson said that he might be teaching again, following a ban. But that turned out not to be the case, as The Boston Globe reported.

Today, Science lifted the embargo on a paper by Hauser and Justin Wood, now of the University of Southern California, showing that results published in the journal in 2007 — and later questioned — have held up. The abstract: Continue reading Science publishes replication of Marc Hauser study, says results hold up

Forget chocolate on Valentine’s Day, try semen, says Surgery News editor. Retraction, resignation follow

We have a bizarre tale to relate involving the journal Surgery News, which recently lost its editor-in-chief over a rather strange editorial he wrote in the February issue of the magazine.

The ill-fated — and, we’ll stipulate, ill-advised — commentary has led to a de facto retraction of the entire publication — meaning that although no retraction notice exists that we’re aware of, neither does the issue exist in the publication’s archives.

But first, some important background. Surgery News is a trade magazine with a complicated structure. The publication, which describes itself as “the official newspaper of the American College of Surgeons [ACS],” is published by Elsevier, which supplies medical news through its International Medical News Group division. The society provides its own news, as well as the lead editor, a surgeon, who until recently was Lazar Greenfield. Greenfield, of the University of Michigan, also happens to be the president-elect of the ACS, twin responsibilities that put him at the pinnacle of influence for his specialty.

Now back to the offending editorial, which we’ll bring you in its entirety since 1) we think given the events that you should read the whole thing, and 2) because the ACS has taken the entire February issue off its website we can’t link to it even if we wanted to (more on that later). Under the heading “Gut Feelings,” Greenfield wrote (we added links): Continue reading Forget chocolate on Valentine’s Day, try semen, says Surgery News editor. Retraction, resignation follow

Where did I park my car? Psychological Science retracts working memory study

In what might be considered a model for how retraction notices should look, Psychological Science has retracted a 2008 paper, “Gaining control: Executive training and far transfer of the ability to resolve interference.” According to the notice — which includes two tables: Continue reading Where did I park my car? Psychological Science retracts working memory study

Unfortunate timing: Journal retracts cover image, citing tsunami in Japan

It’s an unusual move: Pediatric Allergy and Immunology has switched out the cover image in the online versions of its March issue, after realizing that likening allergies to a tsunami while Japan is struggling with the devastating effects of a real-life disaster could be “open to misinterpretation.” From an editor’s note: Continue reading Unfortunate timing: Journal retracts cover image, citing tsunami in Japan

Another retraction of Spirocor research

Remember Spirocor, the Israeli company that closed down a clinical trial involving its “respiratory stress” test for coronary artery disease because the data underpinning the validity of the method proved unreliable? The problem led to the retraction of two articles, about which we’ve previously reported. But we also found a study by some of the same researchers, who include scientists in Israel and the United States, that had been presented at the 2010 meeting of the American Heart Association and published in the journal Circulation.

That abstract, No. 14426 “Accuracy and Usefulness of Finger Pulse Wave Analysis during Brief Deep Breathing Exercise (Respiratory Stress Response) as a Marker of Significant Coronary Artery Disease,” has now been retracted — making, to our knowledge, the entire body of published research on the Spirocor product an editorial memory.

Here’s the notice, which appears within the text of the abstract: Continue reading Another retraction of Spirocor research

As last of 12 promised Bulfone-Paus retractions appears, a (disappointing) report card on journal transparency

The final two retractions by Silvia Bulfone-Paus and colleagues, among the 12 promised by Research Centre Borstel following an investigation into scientific misconduct, have appeared. Both are in the Journal of Biological Chemistry (JBC), and read as follows:

This article has been withdrawn by the authors.

We find that near-complete lack of information frustrating, not to mention useless to the scientific community. Unfortunately, it’s par for the course when it comes to the JBC and Bulfone-Paus retractions. The other three said exactly the same thing.

With that in mind, we thought it would be worth looking at all 12 retraction notices, as a sort of case series in journals’ transparency. We often look at particular retractions in a vacuum, but here was a chance to look at 12 papers, all retracted for the same reason, to see how each journal reported the withdrawal.

Here are the 12, in rough order, worst to best, based on how useful they are to scientists coming across them: Continue reading As last of 12 promised Bulfone-Paus retractions appears, a (disappointing) report card on journal transparency

Tenth Bulfone-Paus retraction notice appears, in Journal of Biological Chemistry

The tenth of 12 promised retractions by Silvia Bulfone-Paus and colleagues has appeared, in the Journal of Biological Chemistry (JBC).

The paper, “Reverse signaling through membrane-bound Interleukin-15,” was published in 2004 and has been cited 31 times, according to Thomson Scientific’s Web of Knowledge. The retraction notice, just like the other one for the team’s work that appeared in the JBC, was completely uninformative: Continue reading Tenth Bulfone-Paus retraction notice appears, in Journal of Biological Chemistry