The ecological fallacy is the error of interpreting variation among ecological entities as though it applies to individuals. It also is an error to interpret variation among individuals as though it applies to ecological entitles, and the theoretical and empirical ramifications of the latter error have been explored in a series of articles. A recent article by Levine commented extensively on this series and criticized some of its conclusions. The present article argues that Levine's article is incomplete in its application of measurement theory and that it overemphasizes an example that makes an inappropriate postulation about the distribution of universe scores. However, these disagreements are less important than areas of agreement. A substantial consensus exists about choice of units of analysis, usefulness of generalizability theory, and procedures for estimating the reliability of environmental measures.
Get full access to this article
View all access options for this article.
References
1.
Aitkin, M. , & Longford, N. (1986). Statistical modeling issues in school effectiveness studies. Journal of the Royal Statistical Society, Series A, 149, 1-43.
2.
Astin, A. W. (1962). An empirical characterization of higher educational institutions. Journal of Educational Psychology, 58, 224-235.
3.
Barker, R. (1968). Ecological psychology. Stanford, CA: Stanford University Press.
4.
Bartko, J. J. (1976). On various intraclass correlation confidents. Psychological Bulletin, 83, 762-765.
5.
Cain, P. S. , & Green, B. F., Jr. (1983). Reliabilities of selected ratings available from the Dictionary of Occupational Titles. Journal of Appled Psychology, 68, 155-165.
6.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
7.
Craik, K. H. , & Feiner, N. R. (1987). Environmental assessment. In D. Stokols & I. Altman (Eds.), Handbook of environmental psychology (Vol. 2, pp. 891-918). New York: John Wiley.
8.
Cronbach, L. J. , Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability of scores and profiles. New York: John Wiley.
9.
Cronbach, L. J. , Ikeda, H., & Avner, R. A. (1964). Intraclass correlation as an approximation to the coefficient of generalizability. Psychological Reports, 15, 727-736.
10.
Ebel, R. C. (1951). Estimation of the reliability of ratings. Psychometrical, 16, 407-424.
11.
Frisbie, W. P. (1984). Data and methods in human ecology. In M. Micidin & H. M. Choldin (Eds.), Socdological human ecology: Contemporary issues and applications (pp.125-178). Boulder, CO: Westview.
12.
Gerst, M. S. , & Moos, R. H. (1972). Social ecology of university student residences. Journal of Educational Psychology, 63, 513-525.
13.
Gottfredson, D. C. , Hybl, L. G., Gottfredson, G. D., & Casteneda, R. P. (1987). School climate assessment instruments: A review. In H. J. Freiberg, A. Driscoll, & S. Knight (Eds.), School climate. Bloomington, IN: Phi Delta Kappa.
14.
Gottfredson, D. C. , Karweit, N. L., & Gottfredson, G. D. (1989). Reducing disordedy behavior in middle schools. (Research Report No. 37). Baltimore, MD: The Johns Hopkins University, Center for Research on Elementary and Secondary Schools.
15.
Gottfredson, G. D. , & Holland, J. L. (1991). User's manual for the position classification index. Odessa, FL: Psychological Assessment Resources.
16.
Gulliksen, H. (1950). Theory of mental tests. New York: John Wiley.
17.
Holland, J. L. (1985). Making vocational choices: A theory of vocational personalities and work environments. Englewood Cliffs, NJ: Prenfice Hall.
18.
Lemke, S. , & Moos, R. H. (1987). Measuring the social climate of congregate residences for older people: Sheltered Care Environment Scale. Psychology of Aging, 2, 20-29.
19.
Levine, D. W. (1994). True scores, error, reliability, and units of analysis in environment and behavior research. Environment and Behavior, 26, 261-293.
20.
McConnell, T. R. (1968). What college for whom?Contemporary Psychology, 13, 99-101.
21.
Moos, R. H. (1974). The Social Climate Scales: Auser'sguide. Palo Alto, CA: Consulting Psychologists Press.
22.
Moos, R. H. , & Trickett, E. J. (1987) Classroom Environment Scale manual. Palo Alto, CA: Consulting Psychologists Press.
23.
O'Brien, R. M. (1990). Estimating the reliability of aggregate-level variables based on individual-level characteristics. Sociology Methods and Research, 18, 473-504.
24.
Pace, C. R. (1969). Technical manual: College and university environment scales. Princeton, NJ: Educational Testing Service.
25.
Richards, J. M., Jr. (1978). Review of the social dimate scales. In O. K. Buros (Ed.), Eighth mental measurements yearbook (Vol. 1, Review No. 681). Highland Park, NJ: Gryphon.
26.
Richards, J. M., Jr. (1990). Units of analysis and the individual differences fallacy in environmental research. Environment and Behavior, 22, 307-319.
27.
Richards, J. M., Jr. , Gottfredson, D. C., & Gottfredson, G. D. (1990). Units of analysis and item statistics for environmental assessment scales. Current Psychology: Research and Reviews, 9, 407-413.
28.
Richards, J. M., Jr. , Gottfredson, D. C., & Gottfredson, G. D. (1991). Units of analysis and the psychometrics of environmental assessment scales. Environment and Behavior, 23, 423-437.
29.
Riley, M. W. (1963). Sociological research: A case approach. New YorkHarcourt Brace and World.
30.
Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351-357.
31.
Scheuch, E. K. (1969). Social context and individual behavior. In M. Dogan & S. Rokkan (Eds.), Quantitative ecological analyses in the social sciences (pp. 133-155). Cambridge, MA: MIT Press.
32.
Stern, G. (1970). People in context. New YorkJohn Wiley.
33.
Tannenbaum, A. S. , & Bachman, J. G. (1964). Structural versus individual effects. American Journal of Sociology, 69, 585-595.
34.
Tinsley, H. E. , & Weiss, D. J. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358-376.
35.
Yonge, G. D. (1965). Students. Review of Educational Research, 34, 253-263.
