A revised and improved version of Aguinis, Pierce, and Stone-Romero's (1994) program for estimating the statistical power of moderated multiple regression to detect dichotomous moderator variables is described. The Quick BASIC program runs on IBM and IBM-compatible personal computers and estimates power based on user-provided values for (a) total sample size, (b) sample sizes across the two moderator-based subgroups, (c) correlation coefficients between the predictor and criterion for each of the two moderator-based subgroups, (d) correlation coefficient between the predictor and hypothesized moderator, and (e) sample and population standard deviations for the predictor. Program-generated power estimates for typical research situations in education, psychology, and management indicate that hypothesis tests of moderating effects are typically conducted at insufficient levels of statistical power.
Get full access to this article
View all access options for this article.
References
1.
Aguinis, H. (1995). Statistical power problems with moderated multiple regression in management research. Journal of Management, 21, 1141-1158.
2.
Aguinis, H. , Bommer, W. H., & Pierce, C. A. (1996). Improving the estimation of moderating effects by using computer-administered questionnaires. Educational and Psychological Measurement, 56, 1043-1047.
3.
Aguinis, H. , & Pierce, C. A. (1998). Heterogeneity of error variance and the assessment of moderating effects of categorical variables: A conceptual review. Organizational Research Methods1, 296-314.
4.
Aguinis, H. , & Pierce, C. A. (in press). Testing moderator variable hypotheses meta-analytically. Journal of Management.
5.
Aguinis, H. , Pierce, C. A., & Stone-Romero, E. F. (1994). Estimating the power to detect dichotomous moderators with moderated multiple regression. Educational and Psychological Measurement, 54, 690-692.
6.
Aguinis, H. , & Stone-Romero, E. F. (1997). Methodological artifacts in moderated multiple regression and their effects on statistical power. Journal of Applied Psychology, 82, 192-206.
7.
Aguinis, H. , & Whitehead, R. (1997). Sampling variance in the correlation coefficient under indirect range restriction: Implications for validity generalization. Journal of Applied Psychology, 82, 528-538.
8.
Aiken, L. S. , & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
9.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
10.
Cohen, J. , & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
11.
Cronbach, L. J. (1987). Statistical tests for moderator variables: Flaws in analyses recently proposed. Psychological Bulletin, 102, 414-417.
12.
Hattrup, K. , & Schmitt, N. (1990). Prediction of trades apprentices' performance on job sample criteria. Personnel Psychology, 43, 453-466.
13.
Kemery, E. R. , Dunlap, W. P., & Griffeth, R. W. (1988). Correction for variance restriction in point-biserial correlations. Journal of Applied Psychology, 73, 688-691.
14.
MacCallum, R. C. , & Mar, C. M. (1995). Distinguishing between moderator and quadratic effects in multiple regression. Psychological Bulletin, 118, 405-421.
15.
McClelland, G. H. , & Judd, C. M. (1993). Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin, 114, 376-390.
16.
Russell, C. J. , Settoon, R. P., McGrath, R. N., Blanton, A. E., Kidwell, R. E., Lohrke, F. T., Scifres, E. L., & Danforth, G. W. (1994). Investigator characteristics as moderators of personnel selection research: A meta-analysis. Journal of Applied Psychology, 79, 163-170.
17.
Sackett, P. R. , & Wilk, S. L. (1994). Within-group norming and other forms of source adjustment in pre-employment testing. American Psychologist, 49, 929-954.
18.
Sagie, A. , & Koslowsky, M. (1993). Detecting moderator variables with meta-analysis: An evaluation and comparison of techniques. Personnel Psychology, 46, 629-640.
19.
Saunders, D. R. (1956). Moderator variables in prediction. Educational and Psychological Measurement, 16, 209-222.
20.
Stone, E. F. (1988). Moderator variables in research: A review and analysis of conceptual and methodological issues. In G. R. Ferris & K. M. Rowland (Eds.), Research in personnel and human resources management (Vol. 6, pp. 191-229). Greenwich, CT: JAI.
21.
Stone-Romero, E. F. , Alliger, G. M., & Aguinis, H. (1994). Type II error problems in the use of moderated multiple regression for the detection of moderating effects for dichotomous variables. Journal of Management, 20, 167-178.
22.
Trattner, M. H. , & O'Leary, B. S. (1980). Sample sizes for specified statistical power in testing for differential validity. Journal of Applied Psychology, 65, 127-134.
23.
Westennann, R. , & Hager, W. (1986). Error probabilities in educational and psychological research. Journal of Educational Statistics, 11, 117-146.
24.
Winer, B. J. , Brown, D. R., & Michels, K. M. (1991). Statistical principles in experimental design (3rd ed.). New York: McGraw-Hill.
25.
Zedeck, S. (1971). Problems with the use of "moderator" variables. Psychological Bulletin, 76, 295-310.
