After reading too many papers that either are not reproducible or contain statistical errors (or both), the American Statistical Association (ASA) has been roused to action. Today the group released six principles for the use and interpretation of p values. P-values are used to search for differences between groups or treatments, to evaluate relationships between variables of interest, and for many other purposes. But the ASA says they are widely misused. Here are the six principles from the ASA statement: Continue reading We’re using a common statistical test all wrong. Statisticians want to fix that.
Category: united states
More than half of top-tier economics papers are replicable, study finds
Approximately six out of 10 economics studies published in the field’s most reputable journals — American Economic Review and the Quarterly Journal of Economics — are replicable, according to a study published today in Science.
The authors repeated the results of 18 papers published between 2011 and 2014 and found 11 — approximately 61% — lived up to their claims. But the study found the replicated effect to be on average only 66% of that reported in the earlier studies, which suggests that authors of the original papers may have exaggerated the trends they reported.
Colin Camerer, a behavioral economist at the California Institute of Technology in Pasadena, who co-authored the study, “Evaluating replicability of laboratory experiments in economics,” told us: Continue reading More than half of top-tier economics papers are replicable, study finds
Author with seven retractions makes Thomson Reuters list of top scientists — plus another twist
A cancer researcher who recently retired from MD Anderson Cancer Center — and also recently lost seven papers from one journal following a multi-year investigation — is one of the world’s top scientists, according to a new ranking.
In Thomson Reuters Web of Science’s 2015 list of The World’s Most Influential Scientific Minds, Bharat Aggarwal’s name tops the section for Pharmacology and Toxicology (see p. 89). In all fairness, the list is presented in alphabetical order, and seven of Aggarwal’s papers have each been cited at least 1,000 times. But in addition to his recent seven retractions, he has has six corrections, two unexplained withdrawals, and two Expressions of Concern.
We contacted Thomson Reuters Web of Science to inquire, and a spokesperson told us: Continue reading Author with seven retractions makes Thomson Reuters list of top scientists — plus another twist
High-profile critic slams Nature letters about dinosaur growth following corrections
Authors of a pair of letters in Nature that concluded dinosaurs reached their full size surprisingly quickly are standing by their conclusions, despite challenges from a high-profile critic.
In the letters, researchers led by first author Gregory M. Erickson, a paleobiologist at The Florida State University, concluded that massive dinos grew fast — for example, a 5.5 ton T-Rex could reach skeletal maturity in just two decades. However, when Nathan Myhrvold tried to reanalyze the data, he couldn’t replicate the results. The authors have issued corrections to address the small mistakes unearthed by Myhrvold’s analysis, but argue he couldn’t replicate their results because they hadn’t fully explained their methodology.
After Myhrvold attempted to replicate the findings of maximum size and growth rate for several papers, he found issues in many, including the two Nature letters, according to a press release on Myhrvold’s website: Continue reading High-profile critic slams Nature letters about dinosaur growth following corrections
Journals flag 6 papers, request investigation of New Jersey university biologists
Two journals have published six expressions of concern for a pair of biologists at Rowan University, and are asking the university to undertake an investigation.
We contacted the editors of the two journals — Journal of Cell Science and Biology Open — who both said they decided to flag the papers after a reader raised concerns about potential re-use of blot images. The six papers are co-authored by John G. Pastorino, a molecular biologist at Rowan University in New Jersey and Nataly Shulga, whose LinkedIn identifies her as a research specialist at the same institution. According to the nearly identical notes, the journals (which share a publisher) undertook a review of the original data, but “felt unable to resolve this matter.”
The expressions of concern — five from the Journal of Cell Science and one from Biology Open — include pretty much the same text. Here’s the note that appeared in JCS:
Continue reading Journals flag 6 papers, request investigation of New Jersey university biologists
Reporter fired by WIRED had been dismissed by newspaper for missing deadlines
We have learned that Nic Cavell, who was dismissed last week from WIRED for plagiarizing in several stories for the publication’s website, was fired from another publication for missing deadlines.
Before Cavell was selected to be a 2016 reporting fellow at WIRED magazine — a paid six-month position for promising young reporters — he wrote on the crime beat for The Riverdale Press, a Bronx paper. His 20 bylines span February 2015 to June 2015. We have learned from a source who wished to remain anonymous that he was let go after he had trouble handing in those stories on time.
Riverdale Press editor Shant Shahrigian, who declined to comment on the reasons for Cavell’s departure, told us that he had not encountered plagiarism in the reporter’s work: Continue reading Reporter fired by WIRED had been dismissed by newspaper for missing deadlines
Al Jazeera America pulls satire hours after posting, calling it “not appropriate”
About 13 hours after posting a satirical piece it posted at 2:00 AM today listing six hot media startups to watch in 2016, Al Jazeera America has retracted it.
The satire? Al Jazeera itself is listed as #6, even though the channel is scheduled to close down in April.
In its place is the following message: Continue reading Al Jazeera America pulls satire hours after posting, calling it “not appropriate”
“That was a really bad Friday for us:” WIRED warns four stories were plagiarized
Last Friday, WIRED editor Adam Rogers got a direct message on Twitter that no journalist wants to see. Christina Larson, a freelance writer in China, told him she had seen overlap with her own work in a few WIRED stories, and included links to the relevant pieces.
“She was gracious, just asking for a link back in the future, said she loved WIRED,” Rogers told Retraction Watch by phone this afternoon. It was early morning in San Francisco, so Rogers thanked her for bringing the issue to his attention, and said he’d look at it more closely when he arrived at his desk some 45 minutes later.
It was the start of an episode that would lead to the dismissal of a WIRED reporter, and the addition of warning notes to four of the publication’s stories.
Continue reading “That was a really bad Friday for us:” WIRED warns four stories were plagiarized
“We are living in hell:” Authors retract 2nd paper due to missing raw data
A 2006 paper investigating the effects of docosahexaenoic acid (DHA) and celecoxib on prostate cancer cells has been retracted because it appears to contain panels that were duplicated, and the authors could not provide the raw data to show otherwise.
This is the second paper the authors have lost because they couldn’t furnish the original data to defend their work against allegations of image manipulation. The reason: the Institute for Cancer Prevention in New York, where the authors did the work, shut its doors abruptly in 2004, co-author Bhagavathi A. Narayanan told us. (The institute closed thanks to $5.7 million in grant that was misspent, the New York Post reported at the time.)
Recently, some of Narayanan’s papers have been questioned on PubPeer; her work has been the subject of an investigation at New York University, where Narayanan is now based.
Narayanan told us that the criticism of their work has deeply affected her and her co-authors:
Continue reading “We are living in hell:” Authors retract 2nd paper due to missing raw data
Former accounting prof adds his 33rd retraction
Former accounting professor James Hunton has added a 33rd retraction to his total, solidifying his position at #10 on our leaderboard.
Hunton’s official total is 33.5, since one journal retracted only one section of a paper, making it a “partial” retraction. Most of those retractions came last year, the fallout from an investigation at Bentley University which concluded that the accounting researcher had committed misconduct. Hunton resigned from the university in 2012 after his first retraction, citing family matters.
After the Bentley University investigation, the journal Contemporary Accounting Research conducted its own review of the paper, and found “no credible evidence exists to support the validity of the data in the study,” according to the retraction note for “Decision Aid Reliance: A Longitudinal Field Study Involving Professional Buy-Side Financial Analysts.”
Here’s the entire retraction note:
Continue reading Former accounting prof adds his 33rd retraction