One of the most striking things about forecasters is their lack of historical perspective. They rarely do retrospectives, even though looking back at past work can both illuminate the reasons for its success or failure, and improve the methodologies of current and future forecasts. One of the best and most famous retrospectives is that by Hans Landsberg, which investigates work conducted by Landsberg, Sam Schurr, and others. In this article, written mainly for model users, we highlight Landsberg’s retrospective as a uniquely valuable contribution to improving forecasting methodologies. We also encourage model users to support such retrospectives more frequently. Finally, we give the current generation of analysts the kind of guidance we believe Landsberg and Sam Schurr would have offered about how to do retrospectives well.
AdamsR. C.BelzerD.B.FangJ.M.ImhoffK.L.LaxD.H.MoeR.J.RoopJ.M.WusterbarthA.R. (1985). A Retrospective Analysis of Energy Use and Conservation Trends: 1972-1982. Richland, WA: Pacific Northwest National Laboratory. PNL-5026. June.
2.
Armstrong ScottJ. (1978). Long Range Forecasting: From Crystal Ball to Computer. Chichester: Wiley-Interscience.
3.
ScottArmstrong J., ed. (2001). Principles of Forecasting: A Handbook for Researchers and Practitioners. Norwell, MA: Kluwer Academic Publishers.
4.
AscherWilliam (1978). Forecasting: An Appraisal for Policy Makers and Planners. Baltimore, MD: Johns Hopkins University Press.
5.
BohiDouglas R. (1989). Energy Price Shocks and Macroeconomic Performance. Washington, DC: Resources for the Future.
6.
BroeckerWallace S. (1997). “Thermohaline circulation, the Achilles heel of our climate system: Will man-made CO2 upset the current balance?” Science 278: 15921588.
7.
ClarkJames S.CarpenterS.R.BarberM.CollinsS.DobsonA.FoleyJ.A.LodgeD.M.PascualM.PielkeR.JrPizerW.PringleC.ReidW.V.RoseK.A.SalaO.SchlesingerW.H.WallD.H.WearD. (2001). “Ecological Forecasts: An Emerging Imperative.” Science293(657): 657-660.
8.
RichardCohen E.DuMondJesse M. (1965). “Our Knowledge of the Fundamental Constants of Physics and Chemistry in 1965.” Review of Modern Physics37(4): 537-594.
9.
CraigPaulGadgilAshokKoomeyJonathan (2002). “What Can History Teach Us?: A Retrospective Analysis of Long-term Energy Forecasts for the U.S.” In Annual Review of Energy and the Environment 2002. Edited by SocolowR. H.AndersonD.HarteJ.. Palo Alto, CA: Annual Reviews, Inc. (also LBNL-50498).
10.
DavisW. BartSanstadAlan H.KoomeyJonathan G. (2002). “Contributions of Weather and Fuel Mix to Recent Declines in U.S. Energy and Carbon Intensity.” Energy Economics (also LBNL-42054) 25(4): 375-396.
11.
DeCanioStephen J. (2003). Economic Models of Climate Change: A Critique. Basingstoke, UK: Palgrave-Macmillan (forthcoming).
12.
DominguezKathryn M.FairRay C.ShapiroMatthew D. (1988). “Forecasting the Depression: Harvard Versus Yale.” American Economic Review78(4): 595612.
13.
TaghiFarvar M.Miltonand John P., ed. (1972). The careless technology: ecology and international development (Conference on the Ecological Aspects of International Development ). Garden City, N.Y.: Natural History Press.
GreenbergerMartinCrensonMatthew A.CrisseyBrian L. (1976). Models in the Policy Process: Public Decision Making in the Computer Era. New York: Russell Sage Foundation: distributed by Basic Books.
16.
GreenbergerMartinRichelsRichard (1979). “Assessing Energy Policy Models: Current State and Future Directions.” Annual Review of Energy4: 467-500.
17.
Hinze (1975). Turbulence. New York, NY: McGraw Hill.
18.
HodgesJames S.DewarJames A. (1992). Is it you or your model talking? A framework for model validation. Santa Monica, CA: RAND. ISBN 0-8330-1223-1. Huntington, Hillard G. (1994). “Oil Price Forecasting in the 1980s: What Went Wrong?” The Energy Journal15(2): 1-22.
19.
HuntingtonHillard G.WeyantJohn P.SweeneyJames L. (1982). “Modeling for Insights, Not Numbers: The Experiences of the Energy Modeling Forum.” Omega: The International Journal of Management Science10(5): 449-462.
20.
HussWilliam R. (1985a). “Can Electric Utilities Improve Their Forecast Accuracy? The Historical Perspective.” In Public Utilities Fortnightly. Dec.26, 1985: 3-8.
21.
HussWilliam R. (1985b). “Comparative Analysis of Company Forecasts and Advanced Time Series Techniques Using Annual Electric Utility Energy Sales Data.” International Journal of Forecasting1: 217-239.
22.
HussWilliam R. (1985c). “What Makes a Good Load Forecast?” In Public Utilities Fortnightly. Nov. 28, 1985: 3-11.
23.
IPCC (2001). Climate Change 2001--Impacts, Adaptation, and Vulnerability. Contribution of Working Group II to the Third Assessment Report to the Intergovernmental Panel on Climate Change. New York, NY: Intergovernmental Panel on Climate Change (IPCC). Cambridge University Press, UK.
24.
JoskowPaul L. (2003). “Energy Policies and Their Consequences After 25 Years.” The Energy Journal24(4): 17-49.
25.
KoomeyJonathan (2001). Turning Numbers into Knowledge: Mastering the Art of Problem Solving. Oakland, CA: Analytics Press. Available from World Wide Web: (http://www.numbersintoknowledge.com)
26.
LaitnerJohn A. “Skip”, Stephen J. DeCanio, Jonathan G. Koomey, and Alan H. Sanstad (2003). “Room for Improvement: Increasing the Value of Energy Modeling for Policy Analysis.” Utilities Policy (also LBNL-50627) 11: 87-94.
27.
LandsbergHans H. (1985). “Energy in Transition: A View from 1960.” The Energy Journal6(2): 1-18.
28.
LandsbergHans H.FischmanLeonard L.FisherJoseph L. (1963). Resources in America's Future: Patterns of Requirements and Availabilities 1960-2000. Baltimore: Johns Hopkins Press for Resources for the Future.
29.
LyonsLouis (1998). A Practical Guide to Data Analysis for Physical Science Students.Cambridge, UK: Cambridge University Press.
30.
McCloskeyDeirdre N. (2000). “How to be Scientific in Economics.” Eastern Economic Journal26(2): 241-246.
31.
MohrP. J.TaylorB. N. (2000). “CODATA Recommended Values of the Fundamental Constants: 1998.” Review of Modern Physics72(2): 351-496.
32.
NelsonCharles R.PeckStephen C. (1985). “The NERC Fan, A Retrospective Analysis of the NERC Summary Forecasts.” Journal of Business and Economic Statistics.3(3): 179-187.
33.
NelsonCharles R.PeckStephen C.UhlerRobert G. (1989). “The NERC Fan in Retrospect and Lessons for the Future.” The Energy Journal10(2): 91-107
34.
RoachePatrick J. (1998). Verification and Validation in Computational Science and Engineering. Albuquerque, NM: Hermosa Publishers.
35.
SanstadAlan H.KoomeyJonathan G.LaitnerSkip (2003). “Back to the Future: A Note on Long-Range Energy Price and Quantity Projections in Retrospect.” Submitted to Contemporary Economic Policy (also LBNL-48107).
36.
SchipperLee J.MurtishawScottUnanderFritjof (2001). “International Comparisons of Sectoral Carbon Dioxide Emissions Using A Cross-Country Decomposition Technique.” The Energy Journal (also LBNL-48783) 22(2): 35-75.
37.
SchnaarsSteven (1989). Megamistakes: Forecasting and the Myth of Rapid Technological Change. New York, NY: Free Press.
38.
SchurrSam HDarmstadterJoelPerryHarryRamsayWilliamRussellMilton (1979). Energy in America's Future: The Choices Before Us. Baltimore, MD: Johns Hopkins University Press for Resources for the Future.
39.
SchurrSam H.NetschertBruce C.EliasbergVera F.LernerJosephLandsbergHans H. (1960). Energy in the American Economy 1850-1975. Baltimore, MD: Johns Hopkins Press for Resources for the Future.
40.
SchurrSam H.NetschertBruce C.EliasbergVera F.LernerJosephLandsbergHans H. (1977). Energy in the American Economy 1850-1975. Westport, CT: Greenwood Press.
41.
ShlyakhterAlexander I.KammenDaniel M.BroidoClaire L.WilsonRichard (1994). “Quantifying the credibility of energy projections from trends in past data: The US Energy Sector.” Energy Policy22(2): 119-130.
42.
TaylorKendrick (1999). “Rapid Climate Change.” American Scientist87(4): 320-28.
43.
US DOE (1995). Energy Efficiency in the US Economy (Report 3)--Energy Conservation Trends: Understanding the Factors Affecting Energy Conservation Gains and Their Implications for Policy Development. Washington, DC: US Department of Energy, Office of Policy. DOE/PO-0034. April.
44.
US DOE (1999). Issues in Midterm Analysis and Forecasting 1999. Washington, DC: Energy Information Administration, U.S. Department of Energy. DOE/EIA-0607(99). August.
