Reviewers may rate papers differently when blinded to authors’ identities, new study says

Kanu Okike
Kanu Okike

Although previous research has suggested peer reviewers are not influenced by knowing the authors’ identity and affiliation, a new Research Letter published today in JAMA suggests otherwise. In “Single-blind vs Double-blind Peer Review in the Setting of Author Prestige,” Kanu Okike at Kaiser Moanalua Medical Center in Hawaii and his colleagues created a fake manuscript submitted to Clinical Orthopaedics and Related Research (CORR), which described a prospective study about communication and safety during surgery, and included five “subtle errors.” Sixty-two experts reviewed the paper under the typical “single-blind” system, where they are told the authors’ identities and affiliations, but remain anonymous to the authors. Fifty-seven reviewers vetted the same paper under the “double-blind” system, in which they did not know who co-authored the research. We spoke with Okike about some of his unexpected results.

Retraction Watch: You found that reviewers were more likely to accept papers when they could see they were written by well-known scientists at prestigious institutions. But the difference was relatively small. Did anything about this surprise you? Continue reading Reviewers may rate papers differently when blinded to authors’ identities, new study says

What publishers and countries do most retractions for fake peer review come from?

1092-coverA new analysis — which included scanning Retraction Watch posts — has identified some trends in papers pulled for fake peer review, a subject we’ve covered at length.

For those who aren’t familiar, fake reviews arise when researchers associated with the paper in question (most often authors) create email addresses for reviewers, enabling them to write their own positive reviews.

The article — released September 23 by the Postgraduate Medical Journal — found the vast majority of papers were retracted from journals with impact factors below 5, and most included co-authors based in China.

As described in the paper, “Characteristics of retractions related to faked peer reviews: an overview,” the authors searched Retraction Watch as well as various databases such as PubMed and Google Scholar, along with other media reports, and found 250 retractions for fake peer review.  (Since the authors concluded their analysis, the number of retractions due to faked reviews has continued to pile up; our latest tally is now 324.)

Here are the authors’ main findings: Continue reading What publishers and countries do most retractions for fake peer review come from?

Yes, “power pose” study is flawed, but shouldn’t be retracted, says one author

psychological-scienceAfter the first author of a debated study about the benefits of positioning your body in an assertive ways — the so-called “power pose” — posted her concerns about the research, she has told us she does not believe the paper should be retracted.

As reported by New York magazine, late last night, the first author of a 2010 paper in Psychological Science posted a statement saying she no longer believes the effects of the “power pose” are real.

We contacted Dana Carney, now based at the University of California, Berkeley, to ask if she thought the next step would be to retract the paper. She told us: Continue reading Yes, “power pose” study is flawed, but shouldn’t be retracted, says one author

BMJ won’t retract controversial dietary guidelines article, says author

bmjThe BMJ is not going to retract a 2015 article criticizing the expert report underlying the U.S. dietary guidelines, despite heavy backlash from readers, according to the author of the article.

As Politico reported today, the publication told journalist Nina Teicholz it wouldn’t retract the article, first published one year ago today.

Teicholz confirmed to us the journal emailed her in April to say the article would not be retracted: Continue reading BMJ won’t retract controversial dietary guidelines article, says author

Author asks to retract nearly 20-year old paper over figure questions, lack of data

journal-of-biological-chemistryThe last author of a 1999 paper has asked the journal to retract it less than one month after a user raised questions about images on PubPeer.

Yesterday, last author Jim Woodgett posted a note on the site saying the author who generated the figures in question could not find the original data, and since he agreed the images appeared “suspicious,” he had contacted the journal to retract the paper.

Here’s the note from Woodgett, based at Lunenfeld-Tanenbaum
Research Institute at Mount Sinai Hospital in Toronto: Continue reading Author asks to retract nearly 20-year old paper over figure questions, lack of data

Inquiry finds no evidence of misconduct in high-profile Science paper flagged by allegations

scienceAn expert group at Uppsala University has recommended not proceeding with a full investigation into allegations of misconduct in a high-profile Science paper showing how human pollution may be harming fish.

The June paper — which caught the media’s attention for suggesting fish larvae are eating small particles of plastic rather than their natural prey — became the focus of scrutiny soon after it was published when a group of researchers raised allegations of misconduct. Earlier this year, Science told us it was considering issuing an Expression of Concern (EOC) for the paper, and Uppsala said it was conducting an inquiry, the first step in determining whether to launch a formal investigation.

The expert group who conducted the preliminary investigation has ultimately recommended against an investigation of the paper, according to an Uppsala spokesperson: Continue reading Inquiry finds no evidence of misconduct in high-profile Science paper flagged by allegations

What if scientists funded each other?

Johan Bollen
Johan Bollen

We were struck recently by a paper in Scientometrics that proposed a unique way to fund scientists: Distribute money equally, but require that each scientist donate a portion to others – turning the federal funding system into a crowd-sourcing venture that funds people instead of projects. The proposal could save the inordinate amount of time scientists currently spend writing (and re-writing) grants, but would it actually work? First author Johan Bollen, of Indiana University, explains.

Retraction Watch: You propose something quite unique: Fund everyone equally, but ask them to give a fraction of their funding to someone else. Is the idea that scientists most respected by their peers will “earn” a higher percentage of funding, and everyone is just acting as reviewers? Continue reading What if scientists funded each other?

Is it dangerous to set quotas for research output?

roosy
Roosy Aulakh

Yes, argues Roosy Aulakh, an associate professor in the Department of Pediatrics in the Government Medical College and Hospital in Chandigarh, India. In last week’s BMJ, she argues that recent measures to force researchers in India to produce a minimum number of publications to obtain promotions could set the stage for many problems, including fraud.

Retraction Watch: You cite a recent paper that showed more than 50% of Indian medical institutions and hospitals didn’t publish a single paper between 2005 and 2014. Did that finding surprise you?

Roosy Aulakh: Well definitely yes! With over 400 medical colleges in India producing more than 50,000 doctors an year, such poor research output surely came as a surprise.

RW: In response, the Medical Council of India (MCI) is now requiring researchers to publish at least four articles to become an associate professor, and eight to become a professor. Does that concern you? Continue reading Is it dangerous to set quotas for research output?

Correction cites “unreliable” data in paper by researchers at center of Duke lawsuit

Journal of Biological ChemistryA researcher charged with embezzlement — and now the subject of a multi-million dollar lawsuit — has earned another correction, again citing “unreliable” data.

But this doesn’t appear to be a run-of-the-mill correction notice.

Firstly, it affects a paper co-authored by Erin Potts-Kant and William Foster, former Duke employees now being sued (along with Duke) for including fraudulent data in $200 million worth of federal grants. Secondly, the notice in the Journal of Biological Chemistry is four paragraphs long, and includes six figures — it would normally be considered a “mega-correction.” But lastly, even though the notice is labeled a “correction,” it’s not immediately apparent which aspects of the paper are being changed.

Here are some excerpts from the newest notice: Continue reading Correction cites “unreliable” data in paper by researchers at center of Duke lawsuit