Has reproducibility improved? Introducing the Transparency and Rigor Index

Anita Bandrowski

Some Retraction Watch readers may recall that back in 2012, we called, in The Scientist, for the creation of a Transparency Index. Over the years, we’ve had occasional interest from others in that concept, and some good critiques, but we noted at the time that we did not have the bandwidth to create it ourselves. We hoped that it would plant seeds for others, whether directly or indirectly. 

With that in mind, we present a guest post from Anita Bandrowski, who among other things leads an initiative designed to help researchers identify their reagents correctly and has written for Retraction Watch before. She and colleagues have just posted a preprint titled “Rigor and Transparency Index, a new metric of quality for assessing biological and medical science methods” in which they describe “an automated tool developed to review the methods sections of manuscripts for the presence of criteria associated with the NIH and other reporting guidelines.” 

Science seems to publish many things that may be true or interesting — but perhaps not both. Ideally all of science should be both true and interesting, and if we were to choose one, my hope would be to choose true over interesting. 

Continue reading Has reproducibility improved? Introducing the Transparency and Rigor Index

How a typo in a catalog number led to the correction of a scientific paper — and what we can learn from that

Anita Bandrowski

Papers are corrected for lots of different reasons. In this guest post, Anita Bandrowski, who leads an initiative designed to help researchers identify their reagents correctly, describes one unusual reason for a correction — and explains what researchers can learn from the episode.

Last December, Tianyi Wang and her colleagues published a very interesting paper in Cell Metabolism on the potential link between a gene called JAK/STAT3 and breast cancer. It turns out that breast cancers become resistant to chemotherapy via a pathway that involves JAK/STAT3, and blocking this pathway can re-sensitize the tumor to chemotherapy.

But six months later, they corrected the paper — because of typos in the catalog numbers they’d used. Continue reading How a typo in a catalog number led to the correction of a scientific paper — and what we can learn from that