Archive for the ‘not reproducible’ Category
Nearly five years ago, researchers suggested that the vast majority of preclinical cancer research wouldn’t hold up to follow-up experiments, delaying much needed treatments for patients. In a series of articles publishing tomorrow morning, eLife has released the results of the first five attempts to replicate experiments in cancer biology — and the results are decidedly mixed.
As our co-founders Adam Marcus and Ivan Oransky write in STAT, the overall take-home message was that two studies generated findings similar to the original, one did not replicate the original, and two others were inconclusive.
They quote Brian Nosek, a psychologist at the University of Virginia, in Charlottesville, who runs the Center for Open Science, who has been leading the replication effort in his own field:
The move prompted the journal to also retract an associated News & Views article.
An ecologist in Australia realized a database he was using to spot trends in extinction patterns was problematic, affecting two papers. One journal issued an expression of concern, which has since turned into a retraction. So far, the other journal has left the paper untouched.
The now-retracted paper concluded that medium-sized species on islands tend to go extinct more often than large or small mammalian species. But a little over a year ago, Biology Letters flagged the paper with an expression of concern (EOC), noting “concerns regarding the validity of some of the data and methods used in the analysis.”
After the first author of a debated study about the benefits of positioning your body in an assertive ways — the so-called “power pose” — posted her concerns about the research, she has told us she does not believe the paper should be retracted.
As reported by New York magazine, late last night, the first author of a 2010 paper in Psychological Science posted a statement saying she no longer believes the effects of the “power pose” are real.
The last author of a 1999 paper has asked the journal to retract it less than one month after a user raised questions about images on PubPeer.
Yesterday, last author Jim Woodgett posted a note on the site saying the author who generated the figures in question could not find the original data, and since he agreed the images appeared “suspicious,” he had contacted the journal to retract the paper.
Although the retraction notice itself contains relatively little information, we’ve obtained a letter from the last author — Jun-Li Luo of The Scripps Research Institute in Jupiter, Florida — to the editor-in-chief of Cell Death and Differentiation that says a bit more.
According to the letter, after receiving the anonymous email, Luo conducted an investigation, contacting co-authors who contributed each of the figures in question. Although Luo writes that he has no reason to suspect fraud, the researchers were not able to provide some of the original data.
PubPeer commenters have questioned figures 1, 3, 4, 5, 6 and 7 in the study, “IKKα-mediated biogenesis of miR-196a through interaction with Drosha regulates the sensitivity of cancer cells to radiotherapy.”
In the letter, Luo tells Gerry Melino, co-editor-in-chief of the journal from the University of Leicester, UK, that figures 3D and 3E were provided by the study’s first author, Xing Fang, adding: Read the rest of this entry »
By all accounts, science is facing a crisis: Too many preclinical studies aren’t reproducible, leading to wasted time and effort by researchers around the world. Today in Cell Metabolism, Daniel Drucker at the Lunenfeld-Tanenbaum Research Institute of Mount Sinai Hospital in Toronto details numerous ways to make this early research more robust. His most important advice: more transparent reporting of all results (not just the positive findings), along with quantifying, reporting, tracking, and rewarding reproducibility, for both scientists and journals and universities/research institutes.
Retraction Watch: Which of your recommendations will researchers most object to, and why? Read the rest of this entry »
The retraction is part of a large initiative on the part of nutrition researcher David Allison and colleagues to clean up the literature, which we’ve previously covered. Regarding this paper, he told us:
When we looked at the study…it was very clear that the statistical methods used were not correct. These are not matters of debate or opinion, these are just…verifiably incorrect.
The Nutrition Journal published the paper in January 2015, and retracted it in June 2016, one day after publishing a letter by Allison and a colleague critiquing the paper.
Ever wish you could just publish an exciting result, without having to wait for the entire string of data that follows in order to tell an entire story, which then gets held up for months by peer review at traditional journals? So do a lot of other researchers, who are working on ways to sidestep those barriers. One new project: ScienceMatters, a publishing platform where scientists can submit single, robust results for relatively quick peer review. We spoke with co-founders Lawrence Rajendran and Mirko Bischofberger about how this new next-generation journal platform works, and why it’s important.
Retraction Watch: You accept “only single observations, properly conducted and robustly validated.” Why did you want to restrict your publications to something so specific, and relatively narrow? Read the rest of this entry »
Did that headline make sense? It isn’t really supposed to – it’s a sum-up of a recent satirical paper by Columbia statistician Andrew Gelman and Jonathan Falk of NERA Economic Consulting, entitled “NO TRUMP!: A statistical exercise in priming.” The paper – which they are presenting today during the International Conference on Machine Learning in New York City – estimates the effect of the Donald Trump candidacy on the use of no wild cards (known as trump cards) in the game of bridge. But, as they told us in an interview, the paper is about more than just that.
Retraction Watch: You have a remarkable hypothesis: “Many studies have demonstrated that people can be unconsciously goaded into different behavior through subtle psychological priming. We investigate the effect of the prospect of a Donald Trump presidency on the behavior of the top level of American bridge players.” Can you briefly explain your methodology, results and conclusions? Read the rest of this entry »