Category: not reproducible

Context matters when replicating experiments, argues study

PNASBackground factors such as culture, location, population, or time of day affect the success rates of replication experiments, a new study suggests.

The study, published today in the Proceedings of the National Academy of Sciences, used data from the psychology replication project, which found only 39 out of 100 experiments live up to their original claims. The authors conclude that more “contextually sensitive” papers — those whose background factors are more likely to affect their replicability — are slightly less likely to be reproduced successfully.

They summarize their results in the paper:

Continue reading Context matters when replicating experiments, argues study

Authors retract non-reproducible Cell paper

CellAuthors have retracted a paper from Cell after they were unable to reproduce data in two figures, compromising their confidence in some of the findings.

The authors revisited their experiments after another lab was unable to replicate their data, about proteins that may play a role in lung cancer.

The first author told Nature News in 2013 that the paper may have helped her secure her current position at the Novartis Institutes for Biomedical Research in Massachusetts.

Pulling “Cytohesins are cytoplasmic ErbB receptor activators” appears to be a case of doing the right thing, given the detailed retraction notice:

Continue reading Authors retract non-reproducible Cell paper

Structural biology corrections highlight best of the scientific process

Nature_latest-coverIf you need evidence of the value of transparency in science, check out a pair of recent corrections in the structural biology literature.

This past August, researchers led by Qiu-Xing Jiang at the University of Texas Southwestern Medical Center corrected their study, first published in February 2014 in eLife, of prion-like protein aggregates called MAVS filaments, to which they had ascribed the incorrect “helical symmetry.” In March, Richard Blumberg of Harvard Medical School, and colleagues corrected their 2014 Nature study of a protein complex called CEACAM1/TIM-3, whose structure they had attempted to solve using x-ray crystallography.

In both cases, external researchers were able to download and reanalyze the authors’ own data from public data repositories, making it quickly apparent what had gone wrong and how it needed to be fixed — highlighting the very best of a scientific process that is supposed to be self-correcting and collaborative. Continue reading Structural biology corrections highlight best of the scientific process

Doing the right thing: Authors share data, retract when colleague finds error

no spine minimum. full size. Editor: Holly JEM: Leslie RTP: Karen Geist ancac3

A pair of chemical engineers has retracted a paper after another researcher was unable to replicate their work, in a case that we consider an example of doing the right thing.

Dennis Prieve, at Carnegie Mellon University, was interested in applying the paper — on how systems of molecules known as “reverse micelles” conduct electrical charge — to his own work, but was having trouble repeating the calculations. So Prieve contacted the authors — John Berg and his PhD student Edward Michor, based at the University of Washington — who supplied him with their original data.

It took several weeks of back and forth to figure out the problem, Michor told us, as the paper was published in 2012, so he had to decipher his old notes. When they found that several incorrect values were used in the paper, the authors issued a retraction notice, published in March:

Continue reading Doing the right thing: Authors share data, retract when colleague finds error

Dev Cell paper retracted after author admits to doctoring data

Developmental CellThe authors of a Developmental Cell paper have retracted it after the first author admitted to manipulating and falsifying data and reagents.

The problems came to light after the authors couldn’t reproduce the findings, about a mechanism underlying meiosis. When questioned about the matter, the first author of the paper, Saurav Malhotra, admitted to doctoring data and materials. 

Here’s the retraction notice to the paper, “The Anaphase-Promoting Complex/Cyclosome Is Essential for Entry into Meiotic M-Phase:” Continue reading Dev Cell paper retracted after author admits to doctoring data

“I shared:” Can tagging papers that share data boost the practice?

Psychological Science

After a journal began tagging papers that adopted open science practices — such as sharing data and materials — a few other scientists may have been nudged into doing the same.

In January 2014, Psychological Science began rewarding digital badges to authors who committed to open science practices such as sharing the data and materials. A study published today in PLOS Biology looks at whether publicizing such behavior helps encourage others to follow their leads. 

The authors summarize their main findings in the paper:
Continue reading “I shared:” Can tagging papers that share data boost the practice?

The standard in transparency? Editor praises author honesty that led to retraction in anesthesia journal

a&Amay16

Sometimes, a junior member of the team sees things an editor-in-chief misses.

Regular readers know that we’re always delighted when we get a chance to commend researchers and journals for doing the right thing. Here’s an example that sets the standard.

Anesthesia & Analgesia (A&A) is retracting a 2015 paper which purportedly found important differences in patient outcomes based on the quality of their anesthesiologists. The trouble with the article: Continue reading The standard in transparency? Editor praises author honesty that led to retraction in anesthesia journal

JACS imaging paper “under editorial review” has been replicated, says author

JACS The author of a paper “under editorial review” at the Journal of the American Chemical Society has told us the results the paper have been replicated, contrary to claims made by a former member of her lab.

What’s more, the author said she has submitted a correction to the paper, which is currently flagged with an expression of concern, to provide uncropped images.

We originally reported on the case in February from the perspective of Roger Wong, a former chemist at Hong Kong University who said he hasn’t been able to replicate the findings out of the lab of Dan Yang, a current chemistry professor at HKU (who is female, despite the fact that “Dan” is frequently used as a male name in English). We unfortunately failed to reach Yang in February because of an email glitch; once we contacted Yang, she told us she does not believe Wong’s side of the story:

Continue reading JACS imaging paper “under editorial review” has been replicated, says author

Physicists retract Nature paper on Earth’s core after findings aren’t reproducible

cover_naturePhysicists have retracted a highly cited paper from Nature on the behavior of electrons at the center of the Earth after other researchers could not reproduce their findings.

The 2015 paper earned coverage in Science News and Live Science, where co-author Ronald Cohen explained:

There was a big problem in how you generate a magnetic field, and now, because of our results, that problem has basically gone away.

Here are more details about what the original paper claimed, courtesy of a press release from The Carnegie Institution for Science, where co-authors Peng Zhang and Cohen work: Continue reading Physicists retract Nature paper on Earth’s core after findings aren’t reproducible

Five more notices for Duke pulmonary pair brings retraction tally into double digits

Two retractions and three corrections have appeared for a group of Duke researchers that already have 10+ retractions under their belts.

The reasoning behind them echoes that which we’ve seen before in notices for Michael Foster and Erin Potts-Kant: Following an inquiry from the university, the journals were informed that some of the data or results weren’t reliable, and not all of the experiments could be repeated.

A colleague aware of the case said that researchers are still working to repeat experiments from papers by Potts-Kant and Foster. It is not known how many more papers might be corrected or retracted. Duke University is fully supporting the validation of these experiments, the source told us.

Foster has retired from Duke, a spokesperson for the university confirmed. Continue reading Five more notices for Duke pulmonary pair brings retraction tally into double digits