Bootstrap analysis, both for nonparametric statistical inference and for describing sample results stability and replicability, has been gaining prominence among quantitative researchers in educational and psychological research. Procedurally, however, it is often quite a challenge to implement bootstrap analysis because it is typically not an automated program option in statistical software programs. This article uses a few heuristic analytical examples to show how bootstrap analysis can be accomplished through the use of some commonly available statistical software programs (AMOS, EQS, SAS). Until bootstrap analysis becomes an automated program option in standard statistical software programs (e.g., SPSS, SAS), quantitative researchers may have to make do with these or other creative approaches to accomplish bootstrap analysis in their research.
Get full access to this article
View all access options for this article.
References
1.
Arbuckle, J. L., & Wothke, W. (1999). Amos 4.0 user’s guide. Chicago: Smallwaters Corporation.
2.
Bagozzi, R. P., Fornell, C., & Larcker, D. F. (1981). Canonical correlation analysis as a special case of structural relations model. Multivariate Behavioral Research, 16, 437-454.
3.
Bentler, P. M. (1992). EQS structural equations program manual. Los Angeles: BMDP Statistical Software.
4.
Bentler, P. M. (1994). Forward. In B. M. Byrne (Ed.), Structural equation modeling with EQS and EQS/Windows. Thousand Oaks, CA: Sage.
5.
Bentler, P. M., & Dudgeon, P. (1996). Covariance structure analysis: Statistical practice, theory, and directions. Annual Review of Psychology, 47, 563-592.
6.
Bollen, K. A., & Long, J. S. (1993). Introduction. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 1-9). Newbury Park, CA: Sage.
7.
Bollen, K. A., & Stine, R. (1993). Bootstrapping goodness-of-fit measures in structural equation models. In K. A. Bollen & J. S. Long, (Eds.), Testing structural equation models (pp. 111-135). Newbury Park, CA: Sage.
8.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage.
9.
Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
10.
Cohen, J. (1968). Multiple regression as a general data-analytic system. Psychological Bulletin, 70, 426-443.
11.
Crocker, L., & Algina, J. (1986). Introduction to classical & modern test theory. Fort Worth, TX: Holt, Rinehart & Winston.
12.
Dalgleish, L. I. (1994). Discriminant analysis: Statistical inference using the jackknife and bootstrap procedures. Psychological Bulletin, 116, 498-508.
13.
Diaconis, P., & Efron, B. (1983, May). Computer-intensive methods in statistics. Scientific American, 116-130.
14.
Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7, 1-26.
15.
Efron, B. (1985). Bootstrap confidence intervals for a class of parametric problems. Biometrika, 72, 45-48.
16.
Efron, B. (1995, April). Computers, bootstraps, and statistics. Invited address presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
17.
Fan, X. (1996). Structural equation modeling and canonical correlation analysis: What do they have in common? Structural Equation Modeling: A Multidisciplinary Journal, 4, 64-78.
18.
Fan, X., & Jacoby, W. R. (1995). BOOTSREG: A SAS matrix language program for bootstrapping linear regression models. Educational and Psychological Measurement, 55, 764-768.
19.
Fan, X., & Mathews, T. A. (1994, April). Using bootstrap procedures to assess the issue of predictive bias in college GPA prediction for ethnic groups. Paper presented at the annual meeting of the American Educational Research Association, New Orleans. (ERIC Document Reproduction Service No. ED 372 117)
20.
Fan, X., & Wang, L. (1996). Comparability of jackknife and bootstrap results: An investigation for a case of canonical analysis. Journal of Experimental Education, 64, 173-189.
21.
Harris, D. J., & Kolen, M. J. (1989). Examining the stability of Angoff’s delta item bias statistic using bootstrap. Educational and Psychological Measurement, 49, 81-87.
22.
Jöreskog, K. G., & Sörbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago: SPSS Inc.
23.
Knapp, T. R. (1978). Canonical correlation analysis: A general parametric significance testing system. Psychological Bulletin, 85, 410-416.
24.
Kotz, S., & Johnson, N. L. (1992). Breakthroughs in statistics: Volumes 1 and 2. New York: Springer-Verlag.
25.
Lambert, Z. V., Wildt, A. R., & Durand, R. M. (1991). Approximating confidence interval for factor loadings. Multivariate Behavioral Research, 26, 421-434.
26.
Loehlin, J. C. (1992). Latent variable models: An introduction to factor, path, and structural analysis. Hillsdale, NJ: Lawrence Erlbaum.
27.
Lunneborg, C. E. (2000). Data analysis by resampling: Concepts and applications. Pacific Grove, CA: Duxbury.
28.
Mendoza, J. L., Hart, D. E., & Powell, A. (1991). A bootstrap confidence interval based on a correlation corrected for range restriction. Multivariate Behavioral Research, 26, 255-269.
29.
Mooney, C. Z., & Duval, R. D. (1993). Bootstrapping: A nonparametric approach to statistical inference. Newbury Park, CA: Sage.
30.
Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). Fort Worth, TX: Harcourt Brace.
31.
Rasmussen, J. L. (1987). Estimating the correlation coefficients: Bootstrap and parametric approaches. Psychological Bulletin, 101, 136-139.
32.
Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21, 173-184.
33.
Raykov, T. (1998). Amethod of obtaining standard errors and confidence intervals of composite reliability for congeneric items. Applied Psychological Measurement, 22, 369-374.
34.
Shaver, J. P. (1993). What significance testing is, and what it isn’t. Journal of Experimental Education, 61, 293-316.
35.
Stine, R. A. (1989). An introduction to bootstrap methods: Examples and ideas. Sociological Methods and Research, 8, 243-291.
36.
Thompson, B. (1988). Program FACSTRAP: A program that computes bootstrap estimates of factor structure. Educational and Psychological Measurement, 48, 681-686.
37.
Thompson, B. (1992). DISCSTRA: A computer program that computes bootstrap resampling estimates of descriptive discriminant analysis function structure coefficients and group centroids. Educational and Psychological Measurement, 52, 905-911.
38.
Thompson, B. (1993). The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61, 361-377.
39.
Thompson, B. (1995). Exploring the replicability of a study’s results: Bootstrap statistics for the multivariate case. Educational and Psychological Measurement, 55, 84-94.
40.
Thompson, B. (1999, April). Common methodology mistakes in educational research, revisited, along with a primer on both effect sizes and the bootstrap. Invited address presented at the annual meeting of the American Educational Research Association, Montreal, Canada. (ERIC Document Reproduction Service No. ED 429 110)
41.
Thompson, B. (2000). Ten commandments of structural equation modeling. In L. Grimm & P. Yarnold (Eds.), Reading and understanding more multivariate statistics (pp. 261-284). Washington, DC: American Psychological Association.
42.
Yung, Y., & Bentler, P. M. (1996). Bootstrapping techniques in analysis of mean and covariance structures. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 195-226). Mahwah, NJ: Lawrence Erlbaum.
