In this article, we review methodologies to fix the size distortions of tests for
forecast evaluation in the presence of instabilities. The methodologies
implement tests for relative and absolute forecast evaluation that are robust to
instabilities. We also introduce the giacross and
rosssekh commands, which implement these procedures
in Stata.
AndrewsD. W. K.1993. Tests for parameter instability and structural
change with unknown change point.
Econometrica61: 821–856.
2.
AndrewsD. W. K., and
PlobergerW.1994. Optimal tests when a nuisance parameter is
present only under the alternative.
Econometrica62: 1383–1414.
3.
BaumC.2003. dmariano: Stata module to calculate Diebold–Mariano
comparison of forecast accuracy. Statistical Software Components
S433001, Department of Economics, Boston
College. http://econpapers.repec.org/software/bocbocode/s433001.htm.
4.
ClarkT. E., and
McCrackenM. W.2001. Tests of equal forecast accuracy and
encompassing for nested models. Journal of
Econometrics105: 85–110.
5.
DieboldF. X., and
MarianoR. S.1995. Comparing predictive accuracy.
Journal of Business and Economic Statistics13: 253–263.
6.
GiacominiR., and RossiB.2010. Forecast comparisons in unstable
environments. Journal of Applied
Econometrics25: 595–620.
7.
GiacominiR., and WhiteH.2006. Tests of conditional predictive
ability. Econometrica74: 1545–1578.
8.
MincerJ., and ZarnowitzV.1969. The evaluation of economic
forecasts. In Economic Forecasts and Expectations:
Analysis of Forecasting Behavior and Performance, ed.
MincerJ., 3–46.
New York: National Bureau of
Economic Research.
9.
NeweyW. K., and WestK. D.1987. A simple, positive semi-definite,
heteroskedasticity and autocorrelation consistent covariance
matrix. Econometrica55: 703–708.
10.
NgS., and WrightJ. H.2013. Facts and challenges from the Great Recession
for forecasting and macroeconomic modeling. Journal
of Economic Literature51: 1120–1154.
11.
NyblomJ.1989. Testing for the constancy of parameters over
time. Journal of the American Statistical
Association84: 223–230.
12.
PlobergerW., and KrämerW.1992. The CUSUM test with OLS
residuals. Econometrica60: 271–285.
13.
QuandtR. E.1960. Tests of the hypothesis that a linear
regression system obeys two separate regimes.
Journal of the American Statistical Association55: 324–330.
14.
RossiB.2013a. Advances in forecasting under
instability. In Handbook of Economic Forecasting,
vol. 2B, ed. ElliottG., and
TimmermannA.,
1203–1324.
Amsterdam:
Elsevier.
15.
RossiB.2013b. Exchange rate predictability.
Journal of Economic Literature51: 1063–1119.
16.
RossiB., and
SekhposyanT.2016. Forecast rationality tests in the presence of
instabilities, with applications to federal reserve and survey
forecasts. Journal of Applied Econometrics31: 507–532.
17.
SchwertG. W.1987. Effects of model specification on tests for
unit roots in macroeconomic data. Journal of
Monetary Economics20: 73–103.
18.
StockJ. H., and WatsonM. W.1996. Evidence on structural instability in
macroeconomic time series relations. Journal of
Business and Economic Statistics14: 11–30.
19.
WestK. D.1996. Asymptotic inference about predictive
ability. Econometrica64: 1067–1084.
20.
WestK. D., and
McCrackenM. W.1998. Regression-based tests of predictive
ability. International Economic Review39: 817–840.
