Category: methodological problems

Environmental group alleges scientific fraud in disputed methane studies

icn-logoNote: We are reprinting below an article originally published at InsideClimate News.

The inspector general of the U.S. Environmental Protection Agency has been asked to examine whether a significant recent study of greenhouse gas emissions from oil and gas fields was technically flawed—and whether researchers brushed aside concerns that methane pollution was being understated.

The emission of methane, a much more potent greenhouse gas in the short term than carbon dioxide, has proven difficult to measure. The latest complaint is a volley in a long-running skirmish among academics, advocacy groups and regulators over how tightly methane should be regulated.

On Wednesday, a North Carolina environmental advocacy group, NC Warn, alleged that this dispute has risen to the level of fraud. Continue reading Environmental group alleges scientific fraud in disputed methane studies

Conservative political beliefs not linked to psychotic traits, as study claimed

American Journal of Political Science

Researchers have fixed a number of papers after mistakenly reporting that people who hold conservative political beliefs are more likely to exhibit traits associated with psychoticism, such as authoritarianism and tough-mindedness.

As one of the notices specifies, now it appears that liberal political beliefs are linked with psychoticism. That paper also swapped ideologies when reporting on people higher in neuroticism and social desirability (falsely claiming that you have socially desirable qualities); the original paper said those traits are linked with liberal beliefs, but they are more common among people with conservative values.

We’re not clear how much the corrections should inform our thinking about politics and personality traits, however, because it’s not clear from the paper how strongly those two are linked. The authors claim that the strength of the links are not important, as they do not affect the main conclusions of the papers — although some personality traits appear to correlate with political beliefs, one doesn’t cause the other, nor vice versa.

In total, three papers have been corrected by authors, and a correction has been submitted on one more.

We’ll start with an erratum that explains the backstory of the error in detail. It appears on “Correlation not Causation: The Relationship between Personality Traits and Political Ideologies,” published by the American Journal of Political Science: Continue reading Conservative political beliefs not linked to psychotic traits, as study claimed

Paper reports data from PET/CT scan, years before it arrived

MedicineAuthors have retracted a study just three months after publishing it, upon realizing they made “several critical errors.”

For one, the authors didn’t actually collect the data they claim to in the title of the paper, which reported on methods to screen patients for recurrence of lung cancer. The authors included data from positron emission tomography/computed tomography (PET/CT), collected from 2003 to 2007 — but their institution didn’t have a PET/CT scanner until 2009. Instead, the authors had mistakenly reported the results of PET scans alone, which may not find tumors as effectively as PET/CT.

Here’s the retraction notice in Medicine, which explains the nature of the error in more detail. (Note: One of the authors supplied some missing text, in brackets.)

Continue reading Paper reports data from PET/CT scan, years before it arrived

Epilepsy researcher gets retraction, correction after former colleague flags work

EpilipsiaEpilepsy researcher Toni Schneider has received a retraction and a correction in quick succession, after a former colleague raised red flags about the work. 

The retraction for Schneider, based at the University of Köln in Germany, is for “unintentional inclusion of erroneous data” due to limitations of the recording system used in the paper, according to the notice. 

Marco Weiergräber, a former colleague of Schneider’s, has claimed that the authors of the paper did not use the test properly. The journal editor, however, told us he believes the original analysis is an “honest mistake,” and there is “no evidence” to suggest that the authors intentionally published incorrect analyses.

Here’s the retraction notice, issued by the journal in March 2016: Continue reading Epilepsy researcher gets retraction, correction after former colleague flags work

Retractions aren’t enough: Why science has bigger problems

Andrew Gelman
Andrew Gelman

Scientific fraud isn’t what keeps Andrew Gelman, a professor of statistics at Columbia University in New York, up at night. Rather, it’s the sheer number of unreliable studies — uncorrected, unretracted — that have littered the literature. He tells us more, below.

Whatever the vast majority of retractions are, they’re a tiny fraction of the number of papers that are just wrong — by which I mean they present no good empirical evidence for their claims.

I’ve personally had to correct two of my published articles.   Continue reading Retractions aren’t enough: Why science has bigger problems

In major shift, medical journal to publish protocols along with clinical trials

AIMA major medical journal has updated its instructions to authors, now requiring that they publish protocols of clinical trials, along with any changes made along the way.

We learned of this change via the COMPare project, which has been tracking trial protocol changes in major medical journals — and been critical of the Annals of Internal Medicine‘s response to those changes. However, Darren Taichman, the executive deputy editor of the journal, told us the journal’s decision to publish trial protocols was a long time coming: Continue reading In major shift, medical journal to publish protocols along with clinical trials

Premature adaptation leads to withdrawal of sexual function paper

jsexmartherAhem.

The Journal of Sex & Marital Therapy has retracted a 2012 paper by a pair of authors in Spain who failed to obtain approval to adapt the model of sexual function they used in their study.

The article indicates that the work was based on previous research. But that declaration wasn’t enough to satisfy the creators of the model involved.

As the retraction notice states: Continue reading Premature adaptation leads to withdrawal of sexual function paper

Biologist critiques own paper, journal retracts it — against her wishes

Evolution Cover ImageThe journal Evolution has retracted a 2007 paper about the roles of the different sexes in searching for mates, after the same author critiqued the work in a later paper. 

The case raises important questions about when retractions are appropriate, and whether they can have a chilling effect on scientific discourse. Although Hanna Kokko of the University of Zurich, Switzerland — who co-authored both papers — agreed that the academic literature needed to be corrected, she didn’t want to retract the earlier paper; the journal imposed that course of action, said Kokko. 

Let’s take a look at the retraction note: Continue reading Biologist critiques own paper, journal retracts it — against her wishes

Economics paper retracted due to “extensive changes”

727710An article has been retracted from a proceedings of an economics conference after the publisher identified errors in several parts of the study.

The retraction follows criticism from a Romanian blogger, who contacted the journal about several issues, and posted communications she received about the paper, “Sustainability of Social Enterprises: A Discourse Analysis.” It was part of a volume of Procedia Economics and Finance from a 2014 conference, “Economic Scientific Research – Theoretical, Empirical and Practical Approaches,” also known as ESPERA 2014.

According to the paper, peer review was

under responsibility of the Scientific Committee of ESPERA 2014.

Apparently, the peer review process missed a few errors. The retraction note explains:

Continue reading Economics paper retracted due to “extensive changes”

Authors retract, replace highly cited JAMA Psych paper for “pervasive errors”

JAMA PsychiatryAuthors have retracted a highly cited JAMA Psychiatry study about depression after failing to account for some patient recoveries, among other mistakes.

It’s a somewhat unusual notice — it explains that the paper has been retracted and replaced with a new, corrected version.

The study, which included 452 adults with major depressive disorder, concluded that cognitive therapy plus medication works better to treat depression than pills alone. But after it was published, a reader pointed out that some of the numbers in a table were incorrect. The authors reviewed the data and redid their analysis, and discovered “a number of pervasive errors.”

The notice (termed “notice of retraction and replacement”) explains the consequences of those errors:

Continue reading Authors retract, replace highly cited JAMA Psych paper for “pervasive errors”