The statistical power of a test of significance for the difference among means is dependent upon a number of factors, among them the presence of a covariate, which often serves to increase power, as well as measurement error, which reduces power. Formulas are provided for adjusting Cohen's (1977) f value for these two sources of variability. These adjusted f values can then be used with Cohen's power tables. An example of the use of these formulas in the planning stage of a study is given, followed by a description of the complex nature of the relationship between power and covariance and measurement error.
Get full access to this article
View all access options for this article.
References
1.
Brewer, J. K. (1972). On the power of statistical tests. American Educational Research Journal, 9, 391-401.
2.
Clearly, T. A. and Linn, R. L. (1969). Error of measurement and the power of a statistical test. The British Journal of Mathematical and Statistical Psychology, 22 (Part 1), 49-55.
3.
Cochran, W. G. (1968). Errors of measurement in statistics. Technometrics, 10, 637-666.
4.
Cochran, W. G. (1970). Some effects of errors of measurement on multiple correlation. Journal of the American Statistical Association, 65, 22-34.
5.
Cohen, J. (1977). Statistical power analysis for the behavioral sciences (rev. ed.). New York: Academic Press.
6.
Cohen, S. A. and Hyman, J. S. (1979). How come so many hypotheses in educational research are supported? (A modest proposal). Educational Researcher, 8(11), 12-16.
7.
Edwards, A. L. (1972). Experimental design in psychological research (4th ed.). New York: Holt, Rinehart and Winston.
8.
Fleiss, J. L. (1976). Comment on Overall and Woodward's asserted paradox concerning the measurement of change. Psychological Bulletin, 83, 774-775.
9.
Forsyth, R. A. (1978). A note on "Planning an experiment in the company of measurement error" by Levin and Subkoviak. Applied Psychological Measurement, 2, 377-381.
10.
Glass, G. V and Hopkins, K. D. (1984). Statistical methods in education and psychology (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
11.
Gulliksen, H. (1950). Theory of mental tests. New York: John Wiley & Sons.
12.
Hopkins, K. D. (1973). Preventing the number-one misinterpretation of behavioral research, or how to increase statistical power. Journal of Special Education, 7, 103-107.
13.
Hopkins, K. D. , Coulter, D. K., and Hopkins, B. R. (1981). Tables for quick power estimates when comparing means. Journal of Special Education, 15, 389-394.
14.
Hopkins, K. D. and Hopkins, B. R. (1979). The effect of the reliability of the dependent variable on power. Journal of Special Education, 13, 463-466.
15.
Kirk, R. E. (1982). Experimental design (2nd ed.). Belmont, CA: Wadsworth.
16.
Laubscher, N. F. (1960). Normalizing the noncentral t and F distributions. Annals of Mathematical Statistics, 31, 1105-1112.
17.
Levin, J. R. and Subkoviak, M. J. (1977). Planning an experiment in the company of measurement error. Applied Psychological Measurement, 1, 331-338.
18.
Levin, J. R. and Subkoviak, M. J. (1978). Correcting "Planning an experiment in the company of measurement error. Applied Psychological Measurement, 2, 382-385.
19.
Lord, F. M. and Novick, M. R. (1968). Statistical theories of mental test scores. (With contributions by A. Birnbaum.) Reading, MA: Addison-Wesley.
20.
McFatter, R. M. and Gollob, H. F. (1986). The power of hypothesis tests for comparisons. Educational And Psychological Measurement, 46, 883-886.
21.
Nicewander, W. A. and Price, J. M. (1978). Dependent variable reliability and the power of significance tests. Psychological Bulletin, 85, 405-409.
22.
Overall, J. E. and Woodward, J. A. (1975). Unreliability of difference scores: A paradox for measurement of change. Psychological Bulletin, 82, 85-86.
23.
Overall, J. E. and Woodward, J. A. (1976). Reassertion of the paradoxical power of tests of significance based on unreliable difference scores. Psychological Bulletin, 83, 776-777.
24.
Sutcliffe, J. P. (1958). Error of measurement and the sensitivity of a test of significance. Psychometrika, 23, 9-17.
25.
Sutcliffe, J. P. (1980). On the relationship of reliability to statistical power. Psychological Bulletin, 88, 509-515.
26.
Winer, B. J. (1971). Statistical principles in experimental design (2nd ed.). New York: McGraw Hill.
