When limited resources are available, determining the optimal number of observations to use in multivariate measurement design is not a simple task. This paper presents a method for determining the optimal number of conditions to use in measurement designs when resource constraints are imposed. The method is illustrated using a multivariate two-facet design, and extensions to other designs are discussed.
Get full access to this article
View all access options for this article.
References
1.
Blum, M. L. and Naylor, J. C. (1968). Industrial Psychology-its theoretical and social foundations, New York: Harper and Row.
2.
Cronbach, L. J. , Gleser, G. C., Nanda, H. and Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles, New York: Wiley.
3.
Goldstein, Z. and Marcoulides, G. A. (1991). Maximizing the Coefficient of Generalizability in Decision Studies. Educational and Psychological Measurement, 51, 79-88.
4.
Joe, G. W. and Woodward, J. A. (1976). Some developments in multivariate generalizability. Psychometrika, 41, 205-217.
5.
Marcoulides, G. A. (1989a). The application of generalizability theory to observational studies. Quality and Quantity: The International Journal of Methodology, 23(2), 115-127.
6.
Marcoulides, G. A. (1989b). From hands-on measurement to job performance: issues of dependability. Journal of Business and Society, 1(2), 1-20.
7.
Marcoulides, G. A. and Goldstein, Z. (1990). The optimization of reliability under resource constraints: application to generalizability theory. Educational and Psychological Measurement, 50, 761-768.
8.
Shavelson, R. J. , and Webb, N. M. (1981). Generalizability theory: 1973-1980. British Journal of Mathematical and Statistical Psychology, 34, 133-165.
9.
Shavelson, R. J. , Webb, N. M. and Burstein, L. (1986). Measurement of Teaching. In M. C. Wittrock (Ed.) Handbook of research on teaching. New York: Macmillan.
10.
Shavelson, R. J. , Webb, N. M. and Rowley, G. L. (1989). Generalizability theory. American Psychologist, 44(6), 922-932.
11.
Short, L. , Webb, N. M., and Shavelson, R. J. (1986, April). Issues in multivariate generalizability: Weighting schemes and dimensionality. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, California.
12.
Terman, L. M. and Merrill, M. A. (1973). Stanford-Binet Intelligence Scale. Chicago: Riverside Publishing.
13.
Srinivasan, V. , and Shocker, A. D. (1973). Estimating the weights for multiple attributes in a composite criterion using pairwise judgements. Psychometrika, 38(4), 473-493.
14.
Webb, N. M. , Shavelson, R. J., and Maddahian, E. (1983). Multivariate Generalizability Theory. In L. J. Fyans, Jr. (Ed.). Generalizability theory: Inferences and practical applications. San Francisco: Jossey-Bass.
15.
Webb, N. M. , Rowley, G. L., and Shavelson, R. J. (1988). Using generalizability theory in counseling and development. Measurement and Evaluation in Counseling and Development21, 81-90.
16.
Woodward, J. A. and Joe, G. W. (1973). Maximizing the coefficient of generalizability in multi-facet decision studies. Psychometrika, 38(2), 173-181.
