With the availability of powerful, inexpensive computer hardware and software, computer-intensive statistical methods are becoming more commonly applied in the social sciences. These methods frequently offer a number of advantages over traditional parametric procedures. This article briefly reviews four computer-intensive methods (permutation/randomization tests, bootstrapping, the jack knife, and cross-validation), discusses some of the strengths and weaknesses of these approaches, provides example applications, and discusses five commercially available software packages that may be used to implement these methods.
Aczel, A.D., & Josephy, N.H. (1992). Using the bootstrap for improved ARIMA model identificationJournal of Forecasting, 11, 71-80.
2.
Barnes, G.M., Welte, J.W., & Dintcheff, B. (1991). Drinking among subgroups in the adult population of New York State: A classification analysis using CARTJournal of Studies on Alcohol, 52, 338-344.
Campbell, B., & Ghysels, E. (1995). Federal budget projections: Anonparametric assessment of bias and efficiencyReview of Economics and Statistics , 77, 17-31.
5.
Chant, D., & Dagleish, L. (1992). A SAS macro for jackknifing the results of discriminant analysisMultivariate Behavioral Research , 27, 323-333.
6.
Chen, W.J., Faraone, S.V., Biederman, J., & Tsuang, M.T. (1994). Diagnostic accuracy of the Child Behavior Checklist scales for attention-deficit disorder: A receiver-operating characteristic analysisJournal of Consulting and Clinical Psychology , 62, 1017-1025.
7.
Chung, J.H., & Fraser, D.A.S. (1958). Randomization tests for a multivariate two-sample problemJournal of the American Statistical Association, 53 , 729-735.
8.
Cirincione, C., Darling, T., & O'Rourke, T. (1996, August). Race and congressional redistricting: A computer-intensive evaluation of the 1992 North Carolina planPaper presented at the annual meeting of the American Political Science Association, San Francisco.
9.
Crowley, P.H. (1992). Resampling methods for computation-intensive data analysis in ecology and evolution In D. G. Fautin, D. J. Futuyma, & F. C. James (Eds.), Annual review of ecology and systematics (Vol. 23, pp. 405-448). Palo Alto, CA: Annual Reviews, Inc.
10.
Dixon, P.M. (1993). The bootstrap and the jackknife: Describing the precision of ecological indices In S. M. Scheiner & J. Gurevitch (Eds.), Design and analysis of ecological experiments (pp. 290-318). London: Chapman & Hall.
11.
Dwass, M. (1957). Modified randomization tests for nonparametric hypothesesAnnals of Mathematical Statistics , 28, 181-187.
12.
Edgington, E. (1995). Randomization testsNew York , Marcel Dekker.
13.
Efron, B. (1982). The jackknife, the bootstrap, and other resampling plansPhiladelphia: Society for Industrial and Applied Mathematics.
14.
Efron, B., & Tibshirani, R. (1993). Introduction to the bootstrapLondon: Chapman & Hall.
15.
Engstrom, R.L., & Wildgen, J.K. (1977). Pruning thorns from the thicket: An empirical test of the existence of racial gerrymanderingLegislative Studies Quarterly, 11, 465-478.
16.
Ferron, J., & Ware, W. (1994). Using randomization tests with responsive single-case designsBehavior Research and Therapy , 32, 787-791.
17.
Ferron, J., & Ware, W. (1995). Using randomization tests with responsive single-case designs: ErratumBehavior Research and Therapy , 33, 241.
18.
Fisher, R.A. (1935). Design of experimentsEdinburgh, Scotland: Oliver & Boyd.
19.
Good, P. (1994). Permutation tests: A practical guide to resampling methods for testing hypothesesNew York: Springer-Verlag.
20.
Goolkasian, P. (1996). TestimateSocial Science Computer Review, 14, 230-231.
21.
Gustman, A.L., & Steinmeier, T.L. (1991). Changing the social security rules for work after 65Industrial and Labor Relations Review, 44, 733-745.
Horowitz, J.K., & Carson, R.T. (1991). A classification tree for predicting consumer preferences for risk reductionAmerican Journal of Agricultural Economics, 73 , 1416-1421.
24.
Kallam, M. (1994). TestimateSocial Science Computer Review, 12, 149-152.
25.
Kempthorne, O. (1986). Randomization II In S. Kotz & N. L. Johnson (Eds.), Encyclopedia of statistical sciences (Vol. 7, pp. 519-524). New York: John Wiley.
26.
Kempthome, O., & Doerfler, T.E. (1969). The behaviour of some significance tests under experimental randomization. Biometrika , 56, 231-248.
27.
Kling, C.L., & Sexton, R.J. (1990). Bootstrapping in applied welfare analysisAmerican Journal of Agricultural Economics, 72, 406-418.
28.
Kromrey, J.D., & Hines, C.V. (1995). Use of empirical estimates of shrinkage in multiple regression: A cautionEducational and Psychological Measurement, 55, 901-925.
29.
LePage, R., & Billard, L. (1992). Exploring the limits of bootstrapNew York: John Wiley.
30.
Manly, B. (1992). Randomization and Monte Carlo methods in biologyLondon: Chapman & Hall.
31.
Manly, B.F.J. (1995a). On comparing sample means by randomization, with unequal variancesPaper presented at A. C. Aitken Centenary Conference, Dunedin, New Zealand.
32.
Manly, B.F.J. (1995b). Randomization tests to compare means with unequal variationSnkhya: The Indian Journal of Statistics , 57(Series B, Part 2), 200-222.
33.
Manly, B.F.J., & Gonzalez, L. (1996). On randomization tests for variance differences Unpublished manuscript, Department of Mathematics and Statistics, University of Otago, New Zealand.
34.
Matyas, T.A., & Greenwood, K.M. (1991). Problems in the estimation of autocorrelation in brief time series and some implications for behavioral dataBehavioral Assessment, 13, 137-157.
35.
Mittenberg, W., Azrin, R., Millsaps, C., & Heilbronner, R. (1993). Identification of malingered head injury on the Wechsler Memory Scale-RevisedPsychological Assessment, 5 , 34-40.
36.
Mooney, C.Z., & Duval, R.D. (1993). Bootstrapping: A nonparametric approach to statistical inferenceNewbury Park, CA: Sage .
37.
Noreen, E. (1989). Computer-intensive methods for testing hypothesesNew York: John Wiley.
38.
O'Loughlin, J. (1982). The identification and evaluation of racial gerrymanderingAnnals of the Association of American Geographers , 70, 353-370.
39.
Ord, K., & Lowe, S. (1996). Automatic forecastingThe American Statistician, 50 , 88-94.
40.
Pitman, E.J.G. (1937a). Significance tests which may be applied to samples from any populationsJournal of Royal Statistical Society B, 4 , 119-130.
41.
Pitman, E.J.G. (1937b). Significance tests which may be applied to samples from any populations: II. The correlation coefficientJournal of the Royal Statistical Society B, 4, 225-232.
42.
Pitman, E.J.G. (1938). Significance tests which may be applied to samples from any populations: III. The analysis of variance testBiometrika, 29, 322-335.
43.
Simon, J.L. (1992). Resampling: The new statisticsArlington, VA: Resampling Stats, Inc.
44.
Steinberg, D., & Colla, P. (1992). CART: A supplementary module for SYSTATEvanston, IL: SYSTAT, Inc.
45.
Thompson, B. (1994). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample resultsJournal of Personality, 62, 157-176.
46.
Tremblay, C.H., & Tremblay, V.J. (1995). The impact of cigarette advertising on consumer surplus, profit, and social welfareContemporary Economic Policy, 13 , 113-124.
47.
Tronstad, R., & Gum, R. (1994). Cow culling decisions adapted for management with CARTAmerican Journal of Agricultural Economics , 76, 237-249.
48.
Verboon, P. (1993). Robust nonlinear regression analysisBritish Journal of Mathematical and Statistical Psychology , 46, 77-94.
49.
Walsh, J.F., & Reznikoff, M. (1990). Bootstrapping: A tool for clinical researchJournal of Clinical Psychology, 46, 928-930.
