Researchers seeking to estimate the classification accuracy of linear discriminant functions in a more than two-population setting have had little guidance as to the most appropriate technique. The authors review the available techniques and present an additional alternative which combines features of the U-method and the recently developed posterior probability estimator. The new alternative is compared with other methods by Monté Carlo simulation.
Get full access to this article
View all access options for this article.
References
1.
BarrAnthony J. (1979), SAS User's Guide, 1979 Edition.Raleigh, NC: SAS Institute Inc.
2.
CoverJ. M., and HartP. E. (1967), “Nearest Neighbor Pattern Classification,”IEEE Transactions on Information Theory, 13(January), 21–7.
3.
CraskMelvin R., and PerreaultWilliam D.Jr. (1977), “Validation of Discriminant Analysis in Marketing Research,”Journal of Marketing Research, 14(February), 60–8.
4.
DillonWilliam R. (1979), “The Performance of the Linear Discriminant in Nonoptimal Situations and the Estimation of Classification Error Rates: A Review of Recent Findings,”Journal of Marketing Research, 26(August), 370–81.
5.
DixonW. J., and BrownM. B. (1977), Biomedical computer programs P-Series.Los Angeles: University of California Press.
6.
FrankRonald, MassyWilliam F., and MorrisonDonald G. (1965), “Bias in Multiple Discriminant Analysis,”Journal of Marketing Research, 2(August), 250–8.
7.
FukunagaKeinosuke, and KessellDavid L. (1973), “Non-parametric Bayes Error Estimation Using Unclassified Samples,”IEEE Transactions on Information Theory, 4(July), 434–40.
8.
GlickNed (1978), “Additive Estimators for Probabilities of Correct Classification,”Pattern Recognition, 10, 211–22.
9.
HawkinsDouglas M. (1981), “A New Test for Multivariate Normality and Homoscedasticity,”Technometrics, 23(February), 105–10.
10.
LachenbruchPeter A. (1975), Discriminant Analysis.New York: Hafner Press.
11.
LachenbruchPeter A., and MickeyM. R. (1968), “Estimation of Error Rates in Discriminant Analysis,”Technometrics, 10(February), 1–10.
12.
MooreDavid S., WhitsellStephen J., and LundgrebeDavid A. (1976), “Variance Comparisons for Unbiased Estimators of Probability of Correct Classification,”IEEE Transactions on Information Theory, 22(January), 102–5.
13.
MorrisonDonald (1969), “On Interpretation in Discriminant Analysis,”Journal of Marketing Research, 6(May), 155–63.
14.
NieNorman H. (1975), SPSS: Statistical Package for the Social Sciences.New York: McGraw-Hill Book Company.
15.
ParzenE. (1962), “On Estimation of a Probability Density Function and Mode,”Annals of Mathematical Statistics, 33, 1065–76.