The author of “The Economic Effects of Climate Change,” Richard Tol, a professor of economics at the University of Sussex, blamed earlier problems with the paper on “gremlins.” In a notice posted last year, Tol wrote that “minus signs were dropped”; he also added a pair of “overlooked estimates” and several recently published studies.
After the first correction was published, several people contacted the JEP to point out more issues with the paper. Editors worked with Tol and outside researchers to update the paper again.
Here’s some text from the newest correction notice:
In the Spring 2009 issue, this journal published “The Economic Effects of Climate Change” by Richard S. J. Tol (vol. 23, no. 2, pp. 29–51). The paper included a figure summarizing the results of a number of studies, showing their estimates of how the economic costs of climate change varied with the predicted change in global temperatures. In early 2014, the editors received a complaint pointing out errors in the paper: specifically, several estimates had not been accurately transferred from the original studies. In the Spring 2014 issue, we published a “Correction and Update: The Economic Effects of Climate Change” (vol. 28, no. 2, pp. 221–26) by Richard Tol. However, this version also contained errors that were soon pointed out by various researchers. The editors discussed the situation with Richard Tol and with outside reviewers at some length.
The paper’s central figure was replaced with one from a chapter in the 2014 IPCC report that Tol helped assemble. (He later withdrew his name from the summary document for policymakers when early drafts carried a message that “does not support the political agenda for greenhouse gas emission reduction,” he said in a 2014 blog post.)
This correction offers a final revision and update to the figure in question. This figure is republished from the most recent report of the International Panel on Climate Change (IPCC), in Chapter 10 of the volume Climate Change 2014: Impacts, Adaptation, and Vulnerability. Richard Tol is one of the two “Coordinating Lead Authors” of this chapter, along with Douglas J. Arent, but the chapter also draws on efforts by a group of other lead authors, contributing authors, and review editors. Figure 1 reproduces Figure 10-1 from p. 690 of the IPCC report. The IPCC discussion of this figure offers some useful cautions about interpretation:
Estimates agree on the size of the impact (small relative to economic growth), and 17 of the 20 impact estimates shown in Figure 10-1 are negative. Losses accelerate with greater warming, and estimates diverge.
The new estimates have slightly widened the uncertainty about the economic impacts of climate. Welfare impacts have been estimated with different methods, ranging from expert elicitation to econometric studies and simulation models. Different studies include different aspects of the impacts of climate change, but no estimate is complete; most experts speculate that excluded impacts are on balance negative. Estimates across the studies reflect different assumptions about inter-sectoral, inter-regional, and inter-temporal interactions, about adaptation, and about the monetary values of impacts. Aggregate estimates of costs mask significant differences in impacts across sectors, regions, countries, and populations. Relative to their income, economic impacts are higher for poorer people.
The original figure in the 2009 JEP article estimated a best-fit line passing through the points on this kind of figure, along with confidence intervals for that estimate. Given the differences across the studies as mentioned in the IPCC report, several outside reviewers involved in our editorial process expressed a concern that such estimates were not meaningful. As shown, the figure in the IPCC report does not seek to estimate a best-fit line or confidence intervals, but only offers a summary of the results from existing studies. Tol offers further discussion of the curve-fitting issues with this kind of data in “Bootstraps for Meta-Analysis with an Application to the Impact of Climate Change,” forthcoming in Computational Economics(doi: 10.1007/s10614-014-9448-5).
The journal’s managing editor, Timothy Taylor, declined to discuss details of the second correction but explained that using the IPCC figure was a choice made in the spirit of the journal.
I’m not comfortable offering details about our internal conversations with author, editors, reviewers, and other commenters. But perhaps this general background is useful.
The Journal of Economic Perspectives isn’t a standard research journal. For a sense of what we do, you can check the JEP website at <https://www.aeaweb.org/jep/
submissions.php>. As it says there: “The focus of JEP articles should be on understanding the central economic ideas of a question, what is fundamentally at issue, why the question is particularly important, what the latest advances are, and what facets remain to be examined.”
Authors of JEP articles often refer to a range of studies on a given subject. Referring to the IPCC figure–that is, a calculation from a mainstream consensus document–is the kind of reference that would be standard in our pages. From our point of view, it’s like a JEP author citing estimates from the IMF or the Congressional Budget Office. We know that there are critiques of those estimates, too. However, for a JEP essay, pointing out credible mainstream sources that the author finds important will suffice. Those who want details on these calculations would then need to turn to the research literature or working papers or other reports.
Tol’s contribution to the 2014 IPCC report was also the subject of controversy: In 2014, Bob Ward of The London School of Economics and Political Science raised concerns of calculation errors in Tol’s 2013 article, “Targets for global climate policy: An overview,” that were subsequently used in the IPCC report. According to Ward, the final report also omitted a late-inserted statement, based on Tol’s research, that climate change “may be beneficial for moderate climate change.”
The Journal of Economic Developments and Control posted a correction for the 2013 article last year.
The latest correction probably wouldn’t be the end of the argument. In the final section of the latest correction, the JEP has provided an index of methods and materials in anticipation of further debate:
For a list of studies that were included, what methods were used in these studies, what economic sectors were covered, and the like, we would point interested readers to the “Supplementary Material” table for Chapter 10. The full report, Chapter 10, and the Supplementary Material are all available at http://www.ipcc.ch/report/ar5/wg2/. Controversy over these estimates seems likely to continue. We recommend that readers interested in these questions use the figure and data from the IPCC report as their starting point.
When asked for a statement on the latest correction, Tol offered a brief response.
I am grateful to the editors for their constructive attitude in a painful episode.
Readers may also want to look at the latest assessment here: https://ideas.repec.org/p/sus/susewp/7515.html
The paper has been cited 133 times, according to Thomson Scientific’s Web of Knowledge.
We’ve reached out to the publisher, the American Economic Association, and we’ll update with any reply.
Like Retraction Watch? Consider supporting our growth. You can also follow us on Twitter, like us on Facebook, add us to your RSS reader, and sign up on our homepage for an email every time there’s a new post. Click here to review our Comments Policy.