Sage Journals: Discover world-class research

Abstract

The ecological fallacy involves interpreting results based on ecological entities, such as environmental settings, as applying to individuals. A less familiar error, the individual differences fallacy, involves interpreting results based on individuals as applying to settings. Although this second error has been quite common, little is known about the empirical consequences of using different units of analysis. This study examined the psychometrics of environmental scales when the units were individuals, observed settings, and "artificial" or random settings. Results confirm that settings rather than individuals are the appropriate units of analysis. However, methodological changes will be required beyond use of settings as units. In this study, standard reliability estimates based on settings were equivocal and only a special environmental index, the split-sample correlation, appeared adequate. Thus techniques specific to the problems of environmental research are needed.

Get full access to this article

View all access options for this article.

References

Astin, A. W. (1968). The college environment. Washington, DC: American Council on Education.

Astin, A. W. , & Holland, J. L. (1961). The environmental assessment technique: Away to measure college environments. Journal of Educational Psychology, 52, 308-316.

Barker, R. (1968). Ecological psychology. Stanford, CA: Stanford University Press.

Campbell, D. T. , & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.

Cohen, J. (1977). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Academic Press.

Craik, K. H. , & Feimer, N. R. (1987). Environmental assessment. In D. Stokols & I. Altman (Eds.), Handbook of environmental psychology (Vol. 2, pp. 891-918). New York: Wiley.

Cronbach, L. J. , Gleser, G. C. , Nanda, H. , & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.

Frisbie, W. P. (1984). Data and methods in human ecology. In M. Micklin & H. M. Choldin (Eds.), Sociological human ecology: Contemporary issues and applications. Boulder, CO: Westview.

Gerst, M. S. , & Moos, R. H. (1972). Social ecology of university student residences. Journal of Educational Psychology, 63, 513-525.

10.

Gottfredson, D. C. (1987). An evaluation of an organization development approach to reducing school disorder. Evaluation Review, 11, 739-763.

11.

Gottfredson, D. C. , Hybl, L. G. , Gottfredson, G. D. , & Casteneda, R. P. (1987). School climate assessment instruments: A review. In H. J. Freiberg , A. Driscoll , & S. Knight (Eds.) School climate. Bloomington, IN: Phi Delta Kappa.

12.

Gottfredson, D. C., Karweit, N. L., & Gottfredson, G. D. (1989). Reducing disorderly behavior in middle schools (Research Report No. 37). Baltimore, MD: Johns Hopkins University, Center for Research on Elementary & Secondary Schools.

13.

Gulliksen, H. (1950). Theory of mental tests. New York: Wiley.

14.

Holland, J. L. (1985). Making vocational choices: A theory of vocational personalities and work environments. Englewood Cliffs, NJ: Prentice Hall.

15.

Lemke, S. , & Moos, R. H. (1987). Measuring the social climate of congregate residences for older people: Sheltered Care Environment Scale. Psychology and Aging, 2, 20-29.

16.

Moos, R. H. (1974). The social climate scales: A user's guide. Palo Alto, CA: Consulting Psychologists Press.

17.

Moos, R. H. , & Trickett, E. J. (1987). Classroom Environment scale manual. Palo Alto, CA: Consulting Psychologists Press.

18.

Pace, C. R. (1969). Technical manual: College and university environment scales. Princeton, NJ: Educational Testing Service.

19.

Richards, J. M., Jr. , (1978). Review of The Social Climate Scales. In O. K. Buros (Ed.), Eighth mental measurements yearbook (Vol. 1, Review No. 681). Highland Park, NJ: Gryphon.

20.

Richards, J. M., Jr. (1987a). Psychosocial Environments of black colleges: A theory-based assessment. Population and Environment, 9, 41-53.

21.

Richards, J. M., Jr. (1987b). The social ecology of U.S. law schools. Research in Higher Education, 26, 389-400.

22.

Richards, J. M., Jr. (1990). Units of analysis and the individual differences fallacy in environmental assessment. Environment and Behavior, 22, 307-319.

23.

Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351-357.

24.

SPSS . (1990). SPSS reference guide. Chicago: Author.

Units of Analysis and the Psychometrics of Environmental Assessment Scales

Abstract

Get full access to this article

References