Category: not reproducible

Publishing needs more science, fewer stories: Q&A with founders of ScienceMatters

rajendran460
Lawrence Rajendran

Ever wish you could just publish an exciting result, without having to wait for the entire string of data that follows in order to tell an entire story, which then gets held up for months by peer review at traditional journals? So do a lot of other researchers, who are working on ways to sidestep those barriers. One new project: ScienceMatters, a publishing platform where scientists can submit single, robust results for relatively quick peer review. We spoke with co-founders Lawrence Rajendran and Mirko Bischofberger about how this new next-generation journal platform works, and why it’s important.

Retraction Watch: You accept “only single observations, properly conducted and robustly validated.” Why did you want to restrict your publications to something so specific, and relatively narrow? Continue reading Publishing needs more science, fewer stories: Q&A with founders of ScienceMatters

Trump vs. trump: Does the candidate affect the use of trump cards in Bridge?

Jonathan
Jonathan Falk
Andrew Gelman
Andrew Gelman

Did that headline make sense? It isn’t really supposed to – it’s a sum-up of a recent satirical paper by Columbia statistician Andrew Gelman and Jonathan Falk of NERA Economic Consulting, entitled “NO TRUMP!: A statistical exercise in priming.” The paper – which they are presenting today during the International Conference on Machine Learning in New York City – estimates the effect of the Donald Trump candidacy on the use of no wild cards (known as trump cards) in the game of bridge. But, as they told us in an interview, the paper is about more than just that.

Retraction Watch: You have a remarkable hypothesis: “Many studies have demonstrated that people can be unconsciously goaded into different behavior through subtle psychological priming. We investigate the effect of the prospect of a Donald Trump presidency on the behavior of the top level of American bridge players.” Can you briefly explain your methodology, results and conclusions?  Continue reading Trump vs. trump: Does the candidate affect the use of trump cards in Bridge?

Authors pull Nature paper about DEET and flies

Nature CoverAuthors have retracted a Nature paper which identified neurons that render flies sensitive to a potent insect repellent, after losing confidence in the findings. The first author, however, said she does not agree with the retraction, noting that she continues to believe the data are correct.

According to the notice, the remaining authors say they no longer support the claim that certain neurons in the antennae of fruit flies are repelled by DEET, the active ingredient in many insect repellents. The last author told us some of the paper’s results are not in doubt; nevertheless, he added, the paper would not have been published in Nature without the key conclusion, so he and most of his co-authors have pulled the paper in its entirety.

Alongside the retraction, the journal has also published a Brief Communications Arising article by scientists who were unable to reproduce the paper’s findings.

Here’s the retraction notice, published today:
Continue reading Authors pull Nature paper about DEET and flies

JAMA authors retract (and replace) paper about moves and kids’ mental health

JAMAJAMA authors have retracted — and replaced — a 2014 paper about the mental health effects of household moves on kids, after they found errors while completing an additional analysis.

The original paper concluded that in “families who moved out of high-poverty neighborhoods, boys experienced an increase and girls a decrease in rates of depression and conduct disorder,” according to a press release issued by the journal along with the paper (which also got some press attention from Reuters). But part of that conclusion is wrong.

The authors write in a notice for “Associations of Housing Mobility Interventions for Children in High-Poverty Neighborhoods With Subsequent Mental Disorders During Adolescence” that:

Continue reading JAMA authors retract (and replace) paper about moves and kids’ mental health

How does Jeremy Berg plan to address reproducibility in Science?

Jeremy Berg
Jeremy Berg, via AAAS

The former director of the National Institute of General Medical Sciences at the U.S. National Institutes of Health has a new job. On July 1st, biochemist Jeremy Berg will take the helm as the editor-in-chief of Science. He’s currently the associate senior vice chancellor for science strategy and planning in the health sciences at the University of Pittsburgh. We spoke to him about challenges he’ll be facing in his new role: treating science’s replication problem, boosting transparency, and making papers as widely available as possible.  

You told us in an earlier conversation that diagnosing and treating science’s replication problem is major issue in publishing. Can you give us some specifics about how you plan to address it at Science? Continue reading How does Jeremy Berg plan to address reproducibility in Science?

Misidentified cell line fells cancer paper

Screen Shot 2016-04-15 at 2.52.06 PMResearchers have retracted a paper about a new molecular target for cancer after realizing they had mistaken the identity of their cell line.

It’s all too easy to mix up cell lines, so we see plenty of retractions for that reason — and, according to an expert in the area, many more cases lurk uncorrected in the literature.

The retraction notice for “Knockdown of tumor protein D52-like 2 induces cell growth inhibition and apoptosis in oral squamous cell carcinoma” in Cell Biology International explains the authors’ perspective on this case:

Continue reading Misidentified cell line fells cancer paper

Environmental group alleges scientific fraud in disputed methane studies

icn-logoNote: We are reprinting below an article originally published at InsideClimate News.

The inspector general of the U.S. Environmental Protection Agency has been asked to examine whether a significant recent study of greenhouse gas emissions from oil and gas fields was technically flawed—and whether researchers brushed aside concerns that methane pollution was being understated.

The emission of methane, a much more potent greenhouse gas in the short term than carbon dioxide, has proven difficult to measure. The latest complaint is a volley in a long-running skirmish among academics, advocacy groups and regulators over how tightly methane should be regulated.

On Wednesday, a North Carolina environmental advocacy group, NC Warn, alleged that this dispute has risen to the level of fraud. Continue reading Environmental group alleges scientific fraud in disputed methane studies

What does “reproducibility” mean? New paper seeks to standardize the lexicon

Science Translational MedicineWhat is the difference between “reproducible” and “replicable”? And how does each relate to results that are “generalizable” and “robust”?

Researchers are using these terms interchangeably, creating confusion over what exactly is needed to confirm a scientific result, argues a new paper published today in Science Translational Medicine.

Here’s how the US National Science Foundation (NSF) defines “reproducibility,” according to the authors: Continue reading What does “reproducibility” mean? New paper seeks to standardize the lexicon

JACS corrects, removes author from previously flagged paper

JACSA paper at the center of a high-profile case of alleged misconduct in Hong Kong has earned a correction notice.

The correction replaces an expression of concern on the Journal of the American Chemical Society (JACS) paper, which followed allegations of data manipulation. It provides some un-cropped images, and removes a co-author from the paper. However, it does not appear to address previous allegations of misconduct, nor a recent ruling from an investigation at Hong Kong University (HKU), which found that some of the data were “invalid.”

Here is the correction notice for “Molecular Imaging of Peroxynitrite with HKGreen-4 in Live Cells and Tissues:”

Continue reading JACS corrects, removes author from previously flagged paper

How should journals update papers when new findings come out?

NEJM Logo

When authors get new data that revise a previous report, what should they do?

In the case of a 2015 lung cancer drug study in the New England Journal of Medicine (NEJM), the journal published a letter to the editor with the updated findings.

Shortly after the paper was published, a pharmaceutical company released new data showing the drug wasn’t quite as effective as it had seemed. Once the authors included the new data in their analysis, they adjusted their original response rate of 59%  — hailed as one of a few “encouraging results” in an NEJM editorial at the time of publication — to 45%, as they write in the letter. One of the authors told us they published the 2015 paper using less “mature” data because the drug’s benefits appeared so promising, raising questions about when to publish “exciting but still evolving data.”

It’s not a correction, as the original paper has not been changed; it doesn’t even contain a flag that it’s been updated. But among the online letters about the paper is one from the authors, “Update to Rociletinib Data with the RECIST Confirmed Response Rate,” which provides the new data and backstory:

Continue reading How should journals update papers when new findings come out?