Making error detection easier – and more automated: A guest post from the co-developer of “statcheck”

Michèle B. Nuijten
Michèle B. Nuijten

We’re pleased to present a guest post from Michèle B. Nuijten, a PhD student at Tilburg University who helped develop a program called “statcheck,” which automatically spots statistical mistakes in psychology papers, making it significantly easier to find flaws. Nuijten writes about how such a program came about, and its implications for other fields.

Readers of Retraction Watch know that the literature contains way too many errors – to a great extent, as some research suggests, in my field of psychology. And there is evidence that problem is only likely to get worse.

To reliably investigate these claims, we wanted to study reporting inconsistencies at a large scale. However, extracting statistical results from papers and recalculating the p-values is not only very tedious, it also takes a LOT of time.

So we created a program known as “statcheck” to do the checking for us, by automatically extracting statistics from papers and recalculating p-values. Unfortunately, we recently found that our suspicions were correct: Half of the papers in psychology contain at least one statistical reporting inconsistency, and one in eight papers contain an inconsistency that might have affected the statistical conclusion.

The origins of statcheck began in 2011, Continue reading Making error detection easier – and more automated: A guest post from the co-developer of “statcheck”

Plagiarism detected in two papers on improving detection of cancer by mammograms

8 (1)

A group of computer scientists has a pair of retractions for duplicating “substantial parts” of other articles written by different authors. Both papers, published in Neural Computing and Applications, are on ways to screen for breast cancer more effectively.

According to the abstract of  “An improved data mining technique for classification and detection of breast cancer from mammograms,” computers make the process of identifying cancer in lesions detected by mammograms faster and more accurate:

Although general rules for the differentiation between benign and malignant breast lesion exist, only 15–30% of masses referred for surgical biopsy are actually malignant. Physician experience of detecting breast cancer can be assisted by using some computerized feature extraction and classification algorithms. Computer-aided classification system was used to help in diagnosing abnormalities faster than traditional screening program without the drawback attribute to human factors.

The article has been cited four times, according to Thomson Scientific’s Web of Knowledge.  The retraction note reveals where “substantial parts” of the article came from:

Continue reading Plagiarism detected in two papers on improving detection of cancer by mammograms

Chronic fatigue syndrome-XMRV researcher scheduled to head to court today, alleging conspiracy

Judy Mikovits
Judy Mikovits

Chronic fatigue syndrome researcher Judy Mikovits was scheduled to head is heading to court today, where a California judge will would decide whether or not to dismiss her lawsuit against fourteen people and two Nevada corporations.

(Note: This story has been updated. See below.)

Among the defendants: the Whittemore Peterson Institute  in Reno, Nevada where Mikovits used to work; the institute’s cofounders, Annette and Harvey Whittemore; a colleague with whom she shares a retracted Science paper; and several members of California and Nevada law enforcement.

The complaint does not check the box next to “Money Demanded in Complaint”, but also lists $750,000 in the associated field:

Screen Shot 2015-11-16 at 11.28.23 AM

In 2006, Mikovits began working for the Whittmores at the WPI; her job was to search for a biological cause of chronic fatigue, a vexing, mysterious disease afflicting their daughter. Part of her research focused on a potential link between chronic fatigue syndrome and a virus known as XMRV. But after others — and Mikovits herself — couldn’t replicate results published in Science and the paper was retracted, she was fired from her position in 2011. Mikovits alleges that Continue reading Chronic fatigue syndrome-XMRV researcher scheduled to head to court today, alleging conspiracy

Nutritionist group pulls position statement on vegetarian diets for “inaccuracies and omissions”

Screen Shot 2015-10-16 at 11.57.38 AMWhat are the specific health benefits to skipping out on meat? We’re not totally sure, after the largest organization for nutrition professionals pulled its 2015 position statement on this issue only weeks after publishing it in the Journal of the Academy of Nutrition and Dietetics.

The “Position of the Academy of Nutrition and Dietetics: Vegetarian Diets” was removed earlier this year for “inaccuracies and omissions critical to the paper” — and the first author wasn’t told what they were. A “major revision” is forthcoming.

Here’s the removal note from the journal for the 2015 version:

Continue reading Nutritionist group pulls position statement on vegetarian diets for “inaccuracies and omissions”

Heart researcher who faked patient data gets 4th retraction

XLargeThumb.00004872-201512000-00000.CVA heart researcher who fabricated patient records for her studies on the blood pressure medication ramipril has earned her fourth retraction, and more are apparently on the way.

For readers who are new to this case: Things first unraveled for Anna Ahimastos when a subanalysis of a JAMA clinical trial revealed “anomalies,” triggering an investigation. After Ahimastos admitted to fabricating patient data, that JAMA paper and two others — including a small trial in Annals of Internal Medicine — were pulled. A spokesperson for her former employer, Baker IDI Heart & Diabetes Institute, told us last week that they have requested more retractions:

Five papers and one letter are in the process of being retracted.

The Annals and this latest paper are included in the five papers, so we expect to see Continue reading Heart researcher who faked patient data gets 4th retraction

A bacterium may be anti-fungal, but it’s not anti-retraction

6

The authors of a paper on an anti-fungal bacterium couldn’t ward off a very common problem: plagiarism. The people credited on the paper, published in Applied Microbiology and Biotechnology, apparently weren’t the original authors, according to the retraction note.

We’re not sure who the original authors are. The retraction note doesn’t elaborate much:

Continue reading A bacterium may be anti-fungal, but it’s not anti-retraction

Psychologist Jens Forster settles case by agreeing to 2 retractions

forster-j-a
Jens Förster

Following questions about the veracity of multiple papers by his former employer, high-profile social psychologist Jens Förster has agreed to retract two papers as part of a deal with the German Society for Psychology (DGPs).

Last year, Förster had a paper retracted at the request of his former employer, the University of Amsterdam (UvA). In May, an investigation commissioned by UvA found that many of his experiments looked “too good to be true,” and eight papers showed strong signs of “low veracity.”

Just two of those papers are acknowledged in the settlement of a case by the DGPs against Förster, who currently works at Ruhr University Bochum. Here’s a translation of a notice from the DGPs from One Hour Translation:

Continue reading Psychologist Jens Forster settles case by agreeing to 2 retractions

When a paper is retracted, so is its previous correction–sometimes

1-s2.0-S0968089612X0018X-cov150hSometimes, the path to correcting the scientific record takes a few turns. In the case of a paper about a new cancer compound, authorship issues led to a correction and, ultimately, a retraction — along with a double-back to retract the earlier correction.

We reported on the first part of the story back in January: A 2011 paper that described a novel compound that could work as a drug for the side effects of chemotherapy was corrected in 2012 to add additional authors. But once the authors realized their supposedly novel compound had actually been synthesized by another author, they decided to retract the paper from Bioorganic and Medicinal Chemistry earlier this year, concluding “these facts made the paper inappropriate and unfaithful.”

Apparently, around the same time, the authors decided to retract the earlier correction, as well:

Continue reading When a paper is retracted, so is its previous correction–sometimes

Intellectual property issues sink cancer paper in JACS

176 spine minimum. full size. Editor: Lingling JEM: Leslie RTP: Michael ReidThe authors of a paper on a mechanism for potential cancer therapies are retracting it after realizing they published some proprietary findings “without permission and agreement from St. Jude Children’s Research Hospital.”

According to the retraction note in Journal of the American Chemical Society, the authors included an X-ray crystal structure and data that were gathered at St. Jude’s and considered the hospital’s intellectual property. On the paper, the last author, Zhengding Su, listed an affiliation at St. Jude and Hubei University of Technology in China, along with Amersino Biodevelop Inc., based in Waterloo, Canada.

Here’s the note for “Efficient Reactivation of p53 in Cancer Cells by a Dual MdmX/Mdm2 Inhibitor:”  Continue reading Intellectual property issues sink cancer paper in JACS

Food article pulled when authors can’t serve up data

homeHeaderLogoImage_en_USAn article about a dietary plan to help people lose weight has been retracted after other researchers raised concerns, and the authors failed to provide the data that supported their findings.

The retraction is accompanied by a Letter to the Editor by a group of outside researchers — including David Allison at the University of Alabama at Birmingham — who noticed “several substantial issues with data and calculations.” For instance, before the experiment even started, the two groups had very different weights: The control group averaged 96.5 kg, and the test group 91 kg. According to the letter, that difference is striking: Continue reading Food article pulled when authors can’t serve up data