A paper about the effects of generative AI use on confidence in work tasks is under investigation after critics raised questions about the study design, data analysis and ethics approval for the research.
The study, published in April in Technology, Mind, and Behavior, included 1,923 adults recruited online from the United States and Canada to perform a battery of work-like tasks assisted by AI. It garnered a press release from the American Psychological Association, which publishes the journal, and coverage in Time and Futurism.
Sandra Grinschgl of the University of Bern in Switzerland, who studies technology-driven cognitive offloading, got an alert about the study shortly after it came out. She told Retraction Watch she was initially puzzled by the vague descriptions of data collection from online participants in the study. When she looked closer at one of the bar charts, she noticed the lengths of the bars didn’t match the actual value of the labels.
Continue reading Journal investigating paper on cognitive impact of generative AI