In this article, we review methodologies to fix the size distortions of tests for forecast evaluation in the presence of instabilities. The methodologies implement tests for relative and absolute forecast evaluation that are robust to instabilities. We also introduce the giacross and rosssekh commands, which implement these procedures in Stata.
AndrewsD. W. K.1993. Tests for parameter instability and structural change with unknown change point. Econometrica61: 821–856.
2.
AndrewsD. W. K., and PlobergerW.1994. Optimal tests when a nuisance parameter is present only under the alternative. Econometrica62: 1383–1414.
3.
BaumC.2003. dmariano: Stata module to calculate Diebold–Mariano comparison of forecast accuracy. Statistical Software Components S433001, Department of Economics, Boston College. http://econpapers.repec.org/software/bocbocode/s433001.htm.
4.
ClarkT. E., and McCrackenM. W.2001. Tests of equal forecast accuracy and encompassing for nested models. Journal of Econometrics105: 85–110.
5.
DieboldF. X., and MarianoR. S.1995. Comparing predictive accuracy. Journal of Business and Economic Statistics13: 253–263.
6.
GiacominiR., and RossiB.2010. Forecast comparisons in unstable environments. Journal of Applied Econometrics25: 595–620.
7.
GiacominiR., and WhiteH.2006. Tests of conditional predictive ability. Econometrica74: 1545–1578.
8.
MincerJ., and ZarnowitzV.1969. The evaluation of economic forecasts. In Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, ed. MincerJ., 3–46. New York: National Bureau of Economic Research.
9.
NeweyW. K., and WestK. D.1987. A simple, positive semi-definite, heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica55: 703–708.
10.
NgS., and WrightJ. H.2013. Facts and challenges from the Great Recession for forecasting and macroeconomic modeling. Journal of Economic Literature51: 1120–1154.
11.
NyblomJ.1989. Testing for the constancy of parameters over time. Journal of the American Statistical Association84: 223–230.
12.
PlobergerW., and KrämerW.1992. The CUSUM test with OLS residuals. Econometrica60: 271–285.
13.
QuandtR. E.1960. Tests of the hypothesis that a linear regression system obeys two separate regimes. Journal of the American Statistical Association55: 324–330.
14.
RossiB.2013a. Advances in forecasting under instability. In Handbook of Economic Forecasting, vol. 2B, ed. ElliottG., and TimmermannA., 1203–1324. Amsterdam: Elsevier.
15.
RossiB.2013b. Exchange rate predictability. Journal of Economic Literature51: 1063–1119.
16.
RossiB., and SekhposyanT.2016. Forecast rationality tests in the presence of instabilities, with applications to federal reserve and survey forecasts. Journal of Applied Econometrics31: 507–532.
17.
SchwertG. W.1987. Effects of model specification on tests for unit roots in macroeconomic data. Journal of Monetary Economics20: 73–103.
18.
StockJ. H., and WatsonM. W.1996. Evidence on structural instability in macroeconomic time series relations. Journal of Business and Economic Statistics14: 11–30.
19.
WestK. D.1996. Asymptotic inference about predictive ability. Econometrica64: 1067–1084.
20.
WestK. D., and McCrackenM. W.1998. Regression-based tests of predictive ability. International Economic Review39: 817–840.
