In 2007, the Intergovernmental Panel on Climate Change's Working Group One, a panel of experts established by the World Meteorological Organization and the United Nations Environment Programme, issued its Fourth Assessment Report. The Report included predictions of dramatic increases in average world temperatures over the next 92 years and serious harm resulting from the predicted temperature increases. Using forecasting principles as our guide we asked: Are these forecasts a good basis for developing public policy? Our answer is “no”.
To provide forecasts of climate change that are useful for policy-making, one would need to forecast (1) global temperature, (2) the effects of any temperature changes, and (3) the effects of feasible alternative policies. Proper forecasts of all three are necessary for rational policy making.
The IPCC WG1 Report was regarded as providing the most credible long-term forecasts of global average temperatures by 31 of the 51 scientists and others involved in forecasting climate change who responded to our survey. We found no references in the 1056-page Report to the primary sources of information on forecasting methods despite the fact these are conveniently available in books, articles, and websites. We audited the forecasting processes described in Chapter 8 of the IPCC's WG1 Report to assess the extent to which they complied with forecasting principles. We found enough information to make judgments on 89 out of a total of 140 forecasting principles. The forecasting procedures that were described violated 72 principles. Many of the violations were, by themselves, critical.
The forecasts in the Report were not the outcome of scientific procedures. In effect, they were the opinions of scientists transformed by mathematics and obscured by complex writing. Research on forecasting has shown that experts' predictions are not useful in situations involving uncertainly and complexity. We have been unable to identify any scientific forecasts of global warming. Claims that the Earth will get warmer have no more credence than saying that it will get colder.
AllenP.G. and FildesR. (2001). Econometric Forecasting in ArmstrongJ.S. ed. Principles of Forecasting: A Handbook for Researchers and Practitioners. Norwell, MA: Kluwer.
ArmstrongJ.S. (1980). The Seer-Sucker theory: The value of experts in forecasting. Technology Review, 83 (June-July), 16–24.
4.
ArmstrongJ.S. (1978; 1985). Long-Range Forecasting: From Crystal Ball to Computer. New York: Wiley-Interscience.
5.
ArmstrongJ.S. (1999). Forecasting for environmental decision-making, in DaleV.H. and EnglishM.E. eds., Tools to Aid Environmental Decision Making. New York: Springer-Verlag, 192–225.
6.
ArmstrongJ.S. (2001). Principles of Forecasting: A Handbook for Researchers and Practitioners. Kluwer Academic Publishers.
7.
ArmstrongJ.S. (2006). Findings from evidence-based forecasting: Methods for reducing forecast error. International Journal of Forecasting, 22, 583–598.
8.
AscherW. (1978). Forecasting: An Appraisal for Policy Makers and Planners. Baltimore: Johns Hopkins University Press.
9.
BallingR. C. (2005). Observational surface temperature records versus model predictions, In MichaelsP. J. ed. Shattered Consensus: The True State of Global Warming. Lanham, MD: Rowman & Littlefield, 50–71.
10.
BastJ. and TaylorJ.M. (2007). Scientific consensus on global warming. The Heartland Institute: Chicago, Illinois. Available at http://downloads.heartland.org/20861.pdf. [The responses to all questions in the 1996 and 2003 surveys by Bray and von Storch are included as an appendix.]
11.
BellamyD. and BarrettJ. (2007). Climate stability: An inconvenient proof. Proceedings of the Institution of Civil Engineers – Civil Engineering, 160, 66–72.
12.
BrysonR.A. (1993). Environment, environmentalists, and global change: A skeptic's evaluation, New Literary History, 24, 783–795.
CarterR.M.de FreitasC.R.GoklanyI.M.HollandD. and LinzenR.S. (2006). The Stern review: A dual critique: Part 1. World Economics, 7, 167–198.
15.
CerfC. and NavaskyV. (1998). The Experts Speak. New York: Pantheon. Baltimore, MD: Johns Hopkins University Press.
16.
ChristyJ. (2005). Temperature Changes in the Bulk Atmosphere: Beyond the IPCC, In MichaelsP. J. ed. Shattered Consensus: The True State of Global Warming. Lanham, MD: Rowman & Littlefield, 72–105.
17.
CraigP.P.GadgilA., and KoomeyJ.G. (2002). What can history teach us? A retrospective examination of long-term energy forecasts for the United States. Annual Review of Energy and the Environment, 27, 83–118.
DuncanG. T.GorrW. L. and SzczypulaJ. (2001). Forecasting Analogous Time Series, in ArmstrongJ. S. ed. Principles of Forecasting: A Handbook for Researchers and Practitioners. Norwell, MA: Kluwer.
EssexC. and McKitrickR. (2002). Taken by Storm. The Troubled Science, Policy & Politics of Global Warming, Toronto: Key Porter Books.
23.
FrauenfeldO.W. (2005). Predictive Skill of the El Nino-Southern Oscillation and Related Atmospheric Teleconnections, In MichaelsP.J. ed. Shattered Consensus: The True State of Global Warming. Lanham, MD: Rowman & Littlefield, 149–182.
24.
HendersonD. (2007). Governments and climate change issues: The case for rethinking. World Economics, 8, 183–228.
25.
HalideH. and RiddP. (2007). Complicated ENSO models do not significantly outperform very simple ENSO models. International Journal of Climatology, in press.
26.
HegerlG.C.ZwiersF.W.BraconnotP.GillettN.P.LuoY.OrsiniMarengo J.A.NichollsN.PennerJ.E. and StottP.A. (2007). Understanding and Attributing Climate Change, in SolomonS.QinD.ManningM.ChenZ.MarquisM.AverytK.B.TignorM. and MillerH.L. (eds.), Climate Change 2007: The Physical Science Basis. Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge, United Kingdom and New York, NY, USA: Cambridge University Press.
27.
KeepinB. and WynneB. (1984). Technical analysis of IIASA energy scenarios. Nature, 312, 691–695.
28.
Le TreutH.SomervilleR.CubaschU.DingY.MauritzenC.MokssitA.PetersonT. and PratherM. (2007). Historical Overview of Climate Change, in SolomonS.QinD.ManningM.ChenZ.MarquisM.AverytK.B.TignorM. and MillerH.L. (eds.), Climate Change 2007: The Physical Science Basis. Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge, United Kingdom and New York, NY, USA: Cambridge University Press.
29.
MakridakisS.WheelwrightS.C., and HyndmanR.J. (1998). Forecasting: Methods and Applications (3rd ed.), Hoboken, NJ: John Wiley.
30.
NDU (1978). Climate Change to the Year 2000. Washington, D.C.: National Defense University.
PilkeyO.H. and Pilkey-JarvisL. (2007). Useless Arithmetic Why Environmental Scientists Can't predict the Future. New York: Columbia University Press.
33.
PosmentierE. S. and SoonW. (2005). Limitations of Computer Predictions of the Effects of Carbon Dioxide on Global Temperature, In MichaelsP. J. ed. Shattered Consensus: The True State of Global Warming. Lanham, MD: Rowman & Littlefield, 241–281.
34.
RandallD.A.WoodR.A.BonyS.ColmanR.FichefetT.FyfeJ.KattsovV.PitmanA.ShuklaJ.SrinivasanJ.StoufferR. J.SumiA. and TaylorK.E. (2007). Climate Models and Their Evaluation, in SolomonS.QinD.ManningM.ChenZ.MarquisM.AverytK.B.TignorM. and MillerH.L. eds., Climate Change 2007: The Physical Science Basis. Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge, UK and New York, NY, USA: Cambridge University Press.
35.
SchnaarsS.P. and BavusoR.J. (1986). Extrapolation models on very short-term forecasts. Journal of Business Research, 14, 27–36.
36.
SoonW. (2007). Implications of the secondary role of carbon dioxide and methane forcing in climate change: Past, present and future. Physical Geography, in press.
37.
StainforthD.A.AinaT.ChristensenC.CollinsM.FaullN.FrameD.J.KettleboroughJ.A.KnightS.MartinA.MurphyJ.M.PianiC.SextonD.SmithLASpicerR.A.ThorpeA.J. and AllenM.R. (2005). Uncertainty in predictions of the climate response to rising levels of greenhouse gases, Nature, 433, 403–406.
StewartT.R. and GlantzM.H. (1985). Expert judgment and climate forecasting: A methodological critique of ‘Climate Change to the Year 2000’. Climate Change, 7, 159–183.
40.
StottP.A. and KettleboroughJ.A. (2002). Origins and estimates of uncertainty in predictions of twenty-first century temperature rise, Nature, 416, 723–726.
VizardA.L.AndersonG.A., and BuckleyD.J. (2005). Verification and value of the Australian Bureau of Meteorology township seasonal rainfall forecasts in Australia, 1997–2005. Meteorological Applications, 12, 343–355.
45.
WittinkD., and BergestuenT. (2001). Forecasting with Conjoint Analysis, in ArmstrongJ.S. ed. Principles of Forecasting: A Handbook for Researchers and Practitioners. Norwell, MA: Kluwer.
