Why traditional statistics are often “counterproductive to research the human sciences”

Andrew Gelman

Doing research is hard. Getting statistically significant results is hard. Making sure the results you obtain reflect reality is even harder. In this week’s Science, Eric Loken at the University of Connecticut and Andrew Gelman at Columbia University debunk some common myths about the use of statistics in research — and argue that, in many cases, the use of traditional statistics does more harm than good in human sciences research. 

Retraction Watch: Your article focuses on the “noise” that’s present in research studies. What is “noise” and how is it created during an experiment?

Continue reading Why traditional statistics are often “counterproductive to research the human sciences”

Study about words’ effect on mood to be retracted after investigation finds evidence of data manipulation

A study examining whether the verb tense you use to describe a positive or negative experience influences your current mood will be retracted after a university investigation found the data had been manipulated.

By whom is the question — the notice cites an unnamed graduate student as the source of the manipulation, and says the only author, William Hart, was unaware of what had occurred.

We spoke with Hart, based at the University of Alabama, who declined to identify the student, nor say whether he or she was still working at the university. He did say the experience has been trying:

Continue reading Study about words’ effect on mood to be retracted after investigation finds evidence of data manipulation

Cancer researcher logs 6 retractions, bringing total to 10

Anil Jaiswal

A journal has retracted six papers by a cancer researcher at the University of Maryland in Baltimore, bringing his total to 10.

The retractions cite an investigation by the university, and detail problems ranging from duplicated images, to tweaking an image to conceal particular bands, to including unreliable data.

Three of the papers had already been flagged by the journal with expressions of concern. The last author on all the papers is Anil Jaiswal, a professor in the pharmacology department. He has issued four previous retractions.

Bruce Jarrell, the Chief Academic and Research Officer and Senior Vice President at the University of Maryland, told us at least two more retractions are forthcoming:

Continue reading Cancer researcher logs 6 retractions, bringing total to 10

Whistleblower gets court backing in defamation case — but at a cost

It’s been a long and winding road for a whistleblower at Indiana University, South Bend.

After Mark Fox, a professor of management and entrepreneurship accused two business professors of plagiarism in 2012, a university investigation found one of the two men — Douglas Agbetsiafa, the former chair of the economics department — guilty of plagiarism, and terminated him in January 2014. The other professor was cleared of any wrongdoing — then sued Fox for defamation in June, 2014.

Fox won the case, but it dragged on. More than two years later, in December 2016, the Indiana Supreme Court declined to hear an appeal.

Fox told us:

Continue reading Whistleblower gets court backing in defamation case — but at a cost

Columbia University probe prompts retraction of cardiovascular paper

A journal has retracted a 2011 study at the request of Columbia University.

According to Jeanine D’Armiento, the study’s last author, the newly retracted paper in Clinical Science contained a figure from a Journal of Hypertension paper published by the same authors earlier that year. 

First and corresponding author Joseph George told Retraction Watch the error was unintentional. A Columbia spokesperson sent us this statement: Continue reading Columbia University probe prompts retraction of cardiovascular paper

Backlash prompts prominent nutrition researcher to reanalyze multiple papers

Brian Wansink

To Brian Wansink of Cornell University, a blog post he wrote in November, 2016, was a meant as a lesson in productivity: A graduate student who was willing to embrace every research opportunity submitted five papers within six months of arriving to his lab, while a postdoc who declined two chances to analyze a data set left after one year with a small fraction of the grad student’s publications.

But two months and nearly 50 comments on the post later, Wansink — known for so much high-profile nutrition research he’s been dubbed the “Sherlock Holmes of food” — has announced he’s now reanalyzing the data in the papers, and will correct any issues that arise. In the meantime, he had to decline requests to share his raw data, citing its proprietary nature.

As Wansink writes in the second addendum to the November blog post, “The Grad Student Who Never Said ‘No’:”

Continue reading Backlash prompts prominent nutrition researcher to reanalyze multiple papers

High-profile book on North Korea earns 52 corrections

The author of a high-profile book about the history of North Korea is issuing 52 corrections to the next edition, scheduled to appear this spring. The changes follow heavy criticism of the book, alleging it contained material not supported by the list of references.

Last month, author Charles Armstrong, a professor at Columbia University, announced on his website that he was issuing the changes after reviewing the book in detail, especially the footnotes. He writes:

Continue reading High-profile book on North Korea earns 52 corrections

If you use this research tool without permission, you’ll hear about it

Sometimes, a seemingly run-of-the-mill retraction notice turns out to be much less straightforward.

Such was the case with a recent retraction of a 2016 paper in a journal published by the U.S. Centers for Disease Control and Prevention, apparently over permission to use an evaluation scale designed to test whether patients take their medications as prescribed. But when we looked into this story, we learned this retraction was only the tip of the iceberg – a representative of the evaluation scale (titled “Chief Investigator”) told us he has contacted hundreds of so-called “infringers” over the last year who used the scale without permission. The authors must then apply retroactively and show they’ve used it correctly, and may even have to pay fees. Or, in the case of the retraction we saw (and at least one other in 2016), pull the paper.

According to the chief investigator, Steve Trubow, who oversees licensing and use of the scale worldwide, for some uses, there is no fee – but depending on what the researchers are using the Morisky Medication Adherence Scale (MMAS-8) for, it can cost up to $100,000. Once they’ve used it without permission, there are fees for that, too, Trubow told us:

Continue reading If you use this research tool without permission, you’ll hear about it

Why don’t women peer review as often as men? Fewer invites and RSVPs, researchers say

Brooks Hanson
Jory Lerback. Image courtesy of the University of Utah

Women don’t peer review papers as often as men, even taking into account the skewed sex ratio in science – but why? In a new Comment in today’s Nature, Jory Lerback at the University of Utah and Brooks Hanson at the American Geophysical Union (AGU) confirmed the same trend in AGU journals, which they argue serve as a good proxy for STEM demographics in the U.S. What’s more, they found the gender discrepancies stemmed from women – of all levels of seniority — receiving fewer invitations to review (both from male and female authors). And when women get their invites, they say “no” more often. We spoke with Lerback and Hanson about what might underlie this trend, and how the scientific community should address it.

Retraction Watch: What made you decide to undertake this project?

Continue reading Why don’t women peer review as often as men? Fewer invites and RSVPs, researchers say

Dangerous chemo mistake retracted by journal after two years

An oncology journal has retracted a 2014 paper that contained a potentially fatal mistake.

Specifically, the paper suggested that a chemotherapy drug be injected intrathecally — i.e., in the spine. But according to the retraction notice, the medical literature has unequivocally shown that that form of treatment is “uniformly fatal.”

The retraction comes approximately 18 months after the journal published a letter to the editor alerting readers to the risky wording in the 2014 paper.

Here’s the notice, issued by Hematological Oncology:

Continue reading Dangerous chemo mistake retracted by journal after two years