Last month, we reported on a 2012 paper in Interface whose authors had the journal issue an expression of concern about it because of “some of the data and methods.” At the time, The Royal Veterinary College at the University of London was conducting an investigation into the research.
Today, that expression of concern was upgraded to a retraction. Here’s the notice:
Subsequent to publication of ‘What makes an accurate and reliable subject-specific finite element model? A case study of an elephant femur. J. R Soc. Interface 9, 351–361 (7 February 2012; Published online 13 July 2011, doi:10.1098/rsif.2011.0323)’, the authors (O. Panagiotopoulou, S. D. Wilshin, E. J. Rayfield, S. J. Shefelbine and J. R. Hutchinson) uncovered problems with the methods used in the paper and therefore some of the final data presented therein.
In the analysis presented in this paper, finite element model nodes other than those shown in the electronic supplementary material, figure S4, in the paper were used to select data from for comparison to the experimental (laser speckle interferometry) data. While that model itself appears to be valid, the data taken from it are therefore invalid, as they do not match the location of the region that was experimentally sampled.
Furthermore, the difficult process (due to differences in model versus experiment resolution, for example) of comparing the finite element data to average ‘nodes’ from regions of the experimental data was conducted in a subjective way that resulted in an inappropriate match of the experimental data to the model’s data. This subjective procedure was not noted in the Methods (p. 355), and on reflection and discussion among the authors after realizing its usage, we agreed that it was invalid as it biased the analysis to favour the conclusion that the model and experiment matched well, sometimes within 5–7%. This original conclusion did not seem implausible to us, as we conducted a detailed characterization of femoral material properties, but on intense scrutiny of the methods after becoming aware of potential flaws well after publication, we now see that it was unjustified.
Considering these problems with the selection of the data from the models and experiments, we judge that the analysis in the paper is flawed and the major conclusions about the accuracy of the model versus experiment (and homo- versus heterogeneous models) are not reliable in the form presented in the paper. We therefore recommend to the editors and journal that the paper is retracted, while we re-design and re-execute the analysis more appropriately for a new paper that lacks these problems. We apologize to the journal, reviewers and readers for this serious oversight.
The paper’s last author, John Hutchinson, tells Retraction Watch:
Between April and July 2014 the Royal Veterinary College held an investigation regarding the paper: J. R. Soc. Interface (2012) 9, 351–361, following a receipt of a complaint. This investigation included the involvement of an external expert to review all raw data and analysis, and an interview panel held with the authors on 15th July. The investigation found that the methods used to validate the theoretical models though experimental measurements were scientifically invalid, thus making the conclusions of the paper flawed. The panel recommended that this paper should therefore be retracted, a conclusion also reached by the authors of the paper after reviewing the findings from the external expert. The journal was kept informed throughout the process and the authors asked the journal editors to retract the paper, which has been done on 20 August 2014.
The paper, which has been cited seven times, according to Thomson Scientific’s Web of Knowledge, was one of two by first author Olga Panagiotopoulou subject to an Expression of Concern.
There are actually three papers, not two, subject to an expression of concern (well now, one retracted and two with expression of concern…)
This is from the website of dr Panagiotopoulou herself (which shows that she is not trying to hide it…).
Panagiotopoulou O,, Curtis N, O’ Higgins P, Cobb SN. (2010). Modelling subcortical bone in finite element analyses: a validation and sensitivity study in the macaque mandible. Journal of Biomechanics 43 (8) 1063-1611. (An error has been found on the conversions at the validation analysis and an expression of concern has been issued).
Panagiotopoulou O., Kupczik K., Cobb, S.N. (2011). The mechanical function of the periodontal ligament in the macaque mandible: a validation and sensitivity study using finite element analysis. Journal of Anatomy 218 (1) 75-86. (An expression of concern has been issued in collaboration with the Journal Editors and the Authors. An error has been found on the validation analysis conducted in the Panagiotopoulou et al. 2010 Journal of Biomechanics Paper and also referenced here)
Panagiotopoulou O, Pataky TC, Hill Z, Hutchinson JR (2012). Statistical parametric mapping of the regional distribution and ontogenetic scaling of foot pressures during walking in Asian elephants (Elephas maximus). Journal of Experimental Biology 215 1584-1593. (The authors have raised an Expression of Concern regarding the validity of the DIC analysis in this study)
Interesting. Neither the J Biomechanics nor the J Exp Biol paper has an Expression of Concern listed though:
http://www.sciencedirect.com/science/article/pii/S0021929010000710
http://jeb.biologists.org/content/215/9/1584.full
Are those only referenced on her page?
So, there are a total of 3 papers with problems: one retracted, one with an expression of concern, and one with errors and supposedly also an expression of concern. These are more than half of Dr Panagiotopoulou’s first author papers. I wonder if she would have gotten the position as lecturer at UQ if this had already surfaced in 2013 (when she started her work there). Looking further at her publication record, it seems that she first wrote about the use of the application of Finite Element Models in morphology in 2009. As all three papers seem to have problems originating from the use and validation of FEs, perhaps there is a fundamental problem in her research?