Category: methodological problems

“Some experiments were not performed appropriately:” Florida researchers lose two papers

Two molecular biologists have withdrawn two 2015 papers published in the same journal, citing image duplication and manipulation, among other issues.

One notice — published in June — explains that, after further investigation, the Journal of Biological Chemistry (JBC) found certain experiments “were not performed appropriately.” The other notice cites “missing data” and notes that certain data “did not accurately represent experimental conditions.”

The authors of the papers—Daniel L. Kaplan, associate professor at Florida State University who heads a genomics lab, and Irina Bruck, assistant scholar scientist in Kaplan’s lab—also received a correction in JBC this month, which cites image duplication.

The three notices, all published this month in JBC, may reveal a pattern, but there’s still a lot we don’t know. One of the two papers was questioned on PubPeer. Several commenters flagged duplicated images and had questions about the antibody used.

Here’s one retraction notice, published this month: Continue reading “Some experiments were not performed appropriately:” Florida researchers lose two papers

Instead of retracting a flawed study, a journal let authors re-do it. It got retracted anyway.

When a journal discovers elementary design flaws in a paper, what should it do? Should it retract immediately, or are there times when it makes sense to give the researchers time to perform a “do-over?”

These are questions the editors at Scientific Reports recently faced with a somewhat controversial 2016 paper, which reported that microRNAs from broccoli could make their way into the nuclei of human cells — suggesting that the food we eat could affect our gene expression.

After the paper appeared, researcher Kenneth Witwer at Johns Hopkins — who was not a co-author — posted comments on PubMed Commons and the paper itself, noting that the authors hadn’t properly designed the experiment, making it impossible for them to detect broccoli microRNAs. 

But instead of retracting the paper, the journal decided to give the authors time to do the experiments again, this time with correctly designed molecular biology tools. When that failed, they retracted it — and as part of the notice, reported the exact opposite conclusion of the original.

Witwer said the authors did a “tremendous job” with the follow-up study, but he still thinks the journal should have retracted the paper immediately. Letting the authors redo it is “a dangerous precedent to set,” he told us:   

Continue reading Instead of retracting a flawed study, a journal let authors re-do it. It got retracted anyway.

Journal alerts readers to “technical criticism” of CRISPR study

A Nature journal has posted a editor’s note to a recent letter on potential unintended consequences of CRISPR gene editing, after an executive at a company trying to commercialize the technology said the paper should be retracted.

The original article, published on May 30 as a correspondence in Nature Methods, suggested that using CRISPR in mice can lead to unexpected mutations. But last week, the journal added an “Editorial note” online. Nature Methods says the notice is not an expression of concern, which would be a stronger suggestion that the paper is problematic; it simply wants to alert readers to the fact that, as the note states:

Continue reading Journal alerts readers to “technical criticism” of CRISPR study

Rutgers prof announces retraction on his blog

A Rutgers computer scientist is retracting conference proceedings via an unusual channel: his personal blog.

On April 7, Anand Sarwate wrote that he was retracting a mathematical proof from the proceedings from the 2016 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), after discovering errors that invalidated the result.

He explains in the blog post why the mistake occurred:

Continue reading Rutgers prof announces retraction on his blog

Authors retract much-debated blockchain paper from F1000

The authors of a popular — and heavily debated — F1000Research paper proposing a method to prevent scientific misconduct have decided to retract it.

The paper was initially criticized for allegedly plagiarizing from a graduate student’s blog — and revised to try to “rectify the overlap.” But according to F1000, it is now being retracted after an additional expert identified problems with the methodology.

Today, F1000 added this editorial note to the paper:

Continue reading Authors retract much-debated blockchain paper from F1000

Author retracts nanotechnology paper over doubts about key results

The corresponding author of a 2015 nanotechnology paper has penned a lengthy — and revealing — retraction notice, explaining why he is not certain about the findings.

In the notice, Chang Ming Li from the Institute for Clean Energy & Advanced Materials (ICEAM) at Southwest University in China, states that there is “insufficient evidence to conclusively” identify the composition of the nanowire array described in the article, which “severely undermines the validity of the reported conclusions.”

The 2015 paper has been considered “highly cited” by Clarivate Analytics’ Web of Science, formerly part of Thomson Reuters, meaning it has received a disproportionate amount of cites given its field and publication year.

Li also said that the paper — which appeared in Physical Chemistry, Chemical Physics — was “submitted and published without my knowledge or permission.” He has not responded to our request to explain how that could have happened, given that he was the corresponding author. Continue reading Author retracts nanotechnology paper over doubts about key results

“Strange. Very strange:” Retracted nutrition study reappears in new journal

In an unusual turn of events, a nutrition paper has come back to life a year after being pulled from its original publication.

After the paper was retracted from the journal Obesity, the authors revised it and republished it in another journal, Pediatric Obesity. Both journals are published by Wiley. The second version of the paper doesn’t mention the previous retraction. Indeed, the journal editor told us he didn’t know the paper had been retracted. Still, he stood by his decision to publish it.

The authors told us the paper was retracted after editors at Obesity raised concerns over the authors’ methodology. The authors revised the paper, adding some analysis and explanation of their methodological approach, and said the new version was accepted by peer reviewers before being published in Pediatric Obesity.

However, an outside expert who reviewed both papers for us said he thinks the authors didn’t change enough. According to Patrick McKnight, head of the Measurement, Research methodology, Evaluation, and Statistics group at George Mason University and a Statistical Advisory Board member of STATS.org:

Continue reading “Strange. Very strange:” Retracted nutrition study reappears in new journal

Physics paper’s results off by factor of 100

Researchers from China have retracted a physics paper after realizing an error led them to report results that were nearly 100 times too large.

What’s more, the authors omitted key findings that would enable others to reproduce their experiments.

According to the notice, the authors used a value to calculate a feature of electrons—called mobility—that “was approximately 100 times too small,” which led to results that were “100 times too large.” The notice also details several gaps in the presentation of experimental results, which preclude others from duplicating the experiments.

Here’s the retraction notice for “Bulk- and layer-heterojunction phototransistors based on poly[2-methoxy-5-(2′-ethylhexyloxy-p-phenylenevinylene)] and PbS quantum dot hybrids:” Continue reading Physics paper’s results off by factor of 100

When does animal research become unnecessary and cruel? A paper’s methods give a biologist pause

Elies Bik

Microbiologist Elies Bik is well-known for applying a close eye to studies, and has spent years anonymously submitting reports on plagiarism and image duplication to journal editors. Last year, she published an analysis of work, with troubling results – that 1 in 25 biomedical papers contains inappropriate duplications in images. She’s never stopped reading papers closely, and recently flagged one on Twitter for concerns about its methodology. Although Bik is not against animal research, she said the treatments rats faced in the paper made her queasy – and didn’t seem justified. She explains her reasoning below.

Continue reading When does animal research become unnecessary and cruel? A paper’s methods give a biologist pause

“I placed too much faith in underpowered studies:” Nobel Prize winner admits mistakes

Daniel Kahneman

Although it’s the right thing to do, it’s never easy to admit error — particularly when you’re an extremely high-profile scientist whose work is being dissected publicly. So while it’s not a retraction, we thought this was worth noting: A Nobel Prize-winning researcher has admitted on a blog that he relied on weak studies in a chapter of his bestselling book.

The blog — by Ulrich Schimmack, Moritz Heene, and Kamini Kesavan — critiqued the citations included in a book by Daniel Kahneman, a psychologist whose research has illuminated our understanding of how humans form judgments and make decisions and earned him half of the 2002 Nobel Prize in Economics.

According to the Schimmack et al blog, Continue reading “I placed too much faith in underpowered studies:” Nobel Prize winner admits mistakes