A preprint about millipedes that was written using OpenAI’s chatbot ChatGPT is back online after being withdrawn for including made-up references, Retraction Watch has learned.
The paper, fake references and all, is also under review by a journal specializing in tropical insects.
“This undermines trust in the scientific literature,” said Henrik Enghoff, a millipede researcher at the Natural History Museum of Denmark, in Copenhagen, who first spotted problems with the preprint, as we reported last month.
He and others said the case had caused a stir among researchers studying millipedes and centipedes, collectively known as myriapods.
“The myriapodological community is alert and closely following this matter,” said Carlos Martínez, a centipede taxonomist and a research associate at Senckenberg Society for Nature Research, in Frankfurt, Germany. “I have also taken a personal interest in stopping this spurious manuscript from polluting the scientific record.”
The paper first appeared on Preprints.org in June. It came to Enghoff’s attention after he received an email from ResearchGate notifying him that his work had been cited. The citations were botched, he found, and some papers he was supposed to have written didn’t exist.
“This was so obvious that it had to be caught,” Enghoff told Retraction Watch. “But there could be subtler cases where something is published that is completely fictitious but won’t be detected.”
After learning of the fake references, staff at the preprint server, suspecting the involvement of a chatbot, pulled down the article and blacklisted its authors.
The manuscript had also been submitted to MDPI’s journal Insects, but had been rejected, Enghoff said a colleague told him.
According to a Danish newspaper following up on Retraction Watch’s reporting, the preprint’s corresponding author, Kahsay Tadesse Mawcha of Aksum University in Ethiopia, admitted to using ChatGPT to produce the manuscript.
Mawcha reportedly explained that he wasn’t “good at using AI” and had since realized that ChatGPT was “not recommended” for writing scientific articles.
Then on August 25, Mawcha posted an updated version of the paper to the preprint server Research Square. Two days later, an email appeared in Enghoff’s inbox alerting him that his work had been cited. It was déjà vu: Mawcha, who now appeared as the sole author of the manuscript, had deleted the made-up papers by Enghoff in the reference list, but the Danish researcher’s work again was being cited for something off-topic, Enghoff said.
What’s more, the revised preprint’s reference list still mostly consisted of fictitious papers, according to Leif Moritz, who has studied myriapods at the Leibniz Institute for the Analysis of Biodiversity Change, in Bonn, Germany.
“What I personally find most worrying is that many of these made-up references suggest that millipedes have a more negative effect as pests on crops than is actually true,” Moritz told Retraction Watch. “This in turn might not only lead to a negative perception of these animals in the public but also to misguided decisions by policy makers.”
Mawcha did not respond to a request for comments.
Asked if Research Square was aware of the manuscript’s troubled history, Mark Brewin, an editorial specialist at the company, told us:
Our retraction alert feature is currently in for repairs, so meanwhile we’re endeavoring to catch these manually. Under the circumstances, our editorial team will look into this case and take appropriate action on the preprint.
On August 30, the preprint website said Mawcha’s paper, titled “From Beneficial Arthropods to Soil-Dwelling Organisms: A Review on Millipedes in Africa,” was being reviewed by the International Journal of Tropical Insect Science. But the following day, after we contacted Research Square, all mention of the journal had disappeared from the website.
Ritter Atoundem Guimapi, an editor at the journal, told Retraction Watch he and his colleagues were aware of the issues related to the manuscript and were “handling the case accordingly.”
Meanwhile, Martínez, the centipede expert at Senckenberg Society for Nature Research, said he had emailed Mawcha and asked him to stop trying to publish “his AI-generated manuscript.” He also contacted the International Journal of Tropical Insect Science, he said, as well as the African Association of Insect Scientists and Ethiopia’s embassy in Germany.
Note: The interview with Enghoff was conducted in Danish and translated by the writer, a native speaker.
Like Retraction Watch? You can make a tax-deductible contribution to support our work, follow us on Twitter, like us on Facebook, add us to your RSS reader, or subscribe to our daily digest. If you find a retraction that’s not in our database, you can let us know here. For comments or feedback, email us at [email protected].
“This undermines trust in the scientific literature….”
Only this?
Scientific literature is dependable information. Always building upon the confirmed works that came before. A team will publish a paper. Other teams and scholars will review that paper, perhaps even try to replicate the experiments detailed within the paper, in order to confirm or reject the viability of the findings presented. It’s a very rigorous process.
So, yeah, when AI craps all over that, it undermines the trust. The only thing worse undermining the trust in scientific research, are the mobs of untrained critics who embrace unsound science, and claim to have done their “research” and will tell others to ” do your research ” where by research they mean, perform a Google search and read only the things that confirm the alternative theories. That mockery is REALLY what’s undermining trust in science.
I’d call that independent scrutiny.
I’m good at using CHATGPT but there’s no way it can write an article that any person in the field would see as legitimate. You’d have to know a lot about the field in order to use it to make a fake paper, and at that point you may as well just fabricate the paper on your own because it’d be so much work to get it to spit out data and sentences that are things you wouldn’t already put down if you were just faking it manually.
But the point is a layman could never use this to mess with any rigorous field. It can’t come up with things you’re not kind of suggesting to it, and even if you feed it a bunch of papers as a template the conclusions that it comes to won’t make any sense and a lot of it will be plagiarized directly.
What’s the global statute/convention for revoking degrees? Surely getting caught twice completely wrecks your academic career right? Great article except why not reach out to the university?
Yes, I agree. This guy needs to be blacklisted from all scientific research paper submissions.
Surely getting caught twice completely wrecks your academic career right?
Great article except why not reach out to the university?
100%. This just can’t stand.
Surely getting caught twice completely wrecks your academic career right? Great article except why not reach out to the university?
Three straight comments with exact same phrasing?
Sounds like some Chat Butt going on
This Mawcha guy needs to be stripped of his credentials. He shouldn’t be allowed anywhere near a specific publication ever again.
This is happening a Ross the scientific spectrum. As a hobbyist forager, there are fake AI generated books on the subject of mycology and wild edible foraging.
I have to thoroughly research authors and sources to be sure that I won’t poison myself. This is a problem.