We consider the problem of choosing between rival statistical models that are non-nested in terms of their functional forms. We assess the ability of two tests, one parametric and one distribution-free, to discriminate between such models. Our Monte Carlo simulations demonstrate that both tests are, to varying degrees, able to discriminate between strategic and non-strategic discrete choice models. The distribution-free test appears to have greater relative power in small samples.
Get full access to this article
View all access options for this article.
References
1.
AkaikeH. (1973) ‘Information Theory and an Extension of the Likelihood Ratio Principle’, in PetrovB. N.CsakiF. (eds), Second International Symposium of Information Theory. Minnesota Studies in the Philosophy of Science. Budapest: Akademinai Kiado, pp. 267–81.
2.
BennettD. S.StamA. C. (1996) ‘The Duration of Interstate Wars, 1816–1985’, American Political Science Review, 90 (2), 239–57.
3.
BenoitK. (1996) ‘Democracies Really Are More Pacific (in General): Re-examining RegimeType andWar Involvement’, Journal of Conflict Resolution, 40 (4), 636–57.
4.
BradleyJ. V. (1968) Distribution-Free Statistical Tests. Englewood Cliffs, NJ: Prentice-Hall.
5.
ClarkeK. A. (2001) ‘Testing Nonnested Models of International Relations: Re-evaluating Realism’, American Journal of Political Science, 45 (3), 724–44.
6.
ClarkeK. A. (2003) ‘Nonparametric Model Discrimination in International Relations’, Journal of Conflict Resolution, 41 (1), 72–93.
7.
ClarkeK. A. (2007) ‘A Simple Distribution-Free Test for Nonnested Hypotheses’, Political Analysis, 15 (3), 347–63.
8.
DeGrootM. H. (1989) Probability and Statistics, second edition. Reading MA: Addison-Wesley.
9.
FraserD. A. S. (1957) Nonparametric Methods in Statistics. New York: John Wiley and Sons.
10.
GibbonsJ. D.ChakrabortiS. (1992) Nonparametric Statistical Inference, third edition. New York: Marcel Dekker, Inc.
11.
GreeneW H. (2003) Econometric Analysis, fifth edition. Upper Saddle River, NJ: Prentice Hall.
12.
HollanderM.WolfeD. A. (1999) Nonparametric Statistical Methods, second edition. New York: John Wiley and Sons.
13.
HuthP. K. (1988) Extended Deterrence and the Prevention of War. New Haven CT: Yale University Press.
14.
HuthP.ChristopherG.BennettD. S. (1993) ‘The Escalation of Great Power Militarized Disputes: Testing Rational Deterrence Theory and Structural Realism’, American Political Science Review, 87 (3), 609–23.
15.
JudgeG. G.GriffithsW E.HillR. C.LutkepohlH.LeeT.-C. (1985) The Theory and Practice of Econometrics, second edition. NewYork: John Wiley and Sons.
16.
KullbackS.LeiblerR. A. (1951) ‘On Information and Sufficiency’, Annals of Mathematical Statistics, 22 (1), 79–86.
17.
LehmannE. L. (1951) ‘Consistencyand Unbiasedness ofCertain NonparametricTests’, Annals of Mathematical Statistics, 22 (2), 165–79.
18.
LehmannE. L. (1986) Testing Statistical Hypotheses, second edition. New York: John Wiley.
19.
McKelveyR. D.PalfreyT. R. (1998) ‘Quantal Response Equilibria for Extensive Form Games’, Experimental Economics, 1 (1), 9–41.
20.
MortonR.B. (1999) Methods and Models: A Guide to the Empirical Analysis of Formal Models in Political Science. Cambridge: Cambridge University Press.
21.
PollinsB. M. (1996) ‘Global Political Order, Economic Change, and Armed Conflict: Coevolving Systems and the Use of Force’, American Political Science Review, 90 (1), 103–17.
22.
RandlesR. H.WolfeD. A. (1979) Introduction to the Theory of Nonparametric Statistics. New York: John Wiley and Sons.
23.
ReedW. (2000) ‘A Unified Statistical Model of Conflict Onset and Escalation’, American Journal of Political Science, 44 (1), 84–93.
24.
ReiterD.StamA. (1998) ‘Democracy, War Initiation, and Victory’, American Political Science Review, 92 (2), 377–89.
25.
SchwarzG. (1978) ‘Estimating the Dimension of a Model’, Annals of Statistics, 6 (2), 461–4.
26.
SignorinoC. S. (1999) ‘Strategic Interaction and the Statistical Analysis of International Conflict’, American Political Science Review, 93 (2), 411–33.
27.
SignorinoC. S. (2002) ‘Strategy and Selection in International Relations’, International Interactions, 28 (1), 93–115.
28.
SignorinoC. S. (2003) ‘Structure and Uncertainty in Discrete Choice Models’, Political Analysis, 11 (4), 316–44.
29.
SignorinoC. S.TararA. (2006) ‘A Unified Theory and Test of Extended Immediate Deterrence’, American Journal of Political Science, 50 (3), 586–605.
30.
SignorinoC. S.YilmazK. (2003) ‘Strategic Misspecification in Regression Models’, American Journal of Political Science, 47 (3), 551–66.
31.
VuongQ. (1989) ‘Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses’, Econometrica, 57 (2), 307–33.
