This paper pracides a checklist for evaluating the methodology of a cross-
cultural correlation study. An integral scoring system permits an overall
measure of rigor for each study and a means of rating groups of studies.
The checklist can be used by a cross-cultural researcher to avoid errors
and omissions. Several methodological steps are introduced which have
not yet been used in published studies. Some common deficiencies in study
presentation are discussed. (Ethnology; methodology; quality control; re
search design; surveys, cross-cultural.)
Get full access to this article
View all access options for this article.
References
1.
Anderson, Theodore R., and Morris Zelditch1968A basic course in statistics, 2d ed., New York, Holt, Rinehart and Winston.
2.
Arkin, Herbert, and Raymond R. Colton1963Tables for statisticians, 2d ed., New York, Bames & Noble.
3.
Ayres, Barbara1967 "Pregnancy magic: a study of food taboos and sex avoidances ," in Clellan S. Ford, ed., Cross-Cultural Approaches, New Haven, HRAF Press: 111-25.
4.
Barry, Herbert III, Margaret K. Bacon, and Irvin L. Child1967 "Definitions, ratings and bibliographic sources for child-training practices of 110 cultures," in Clellan S. Ford, ed., Cross-Cultural Approaches, New Haven, HRAF Press: 293-331.
5.
Barry, Herbert III, Irvin L.Child, and Margaret K. Bacon 1959 "Relation of child training to subsistence economy,"American Anthropologist61: 51-63. (Reprinted in Clellan S. Ford, ed., Cross-Cultural Approaches, New Haven, HRAF Press, 1967: 246-58. )
6.
Blalock, Hubert M., Jr. 1960 "Correlational analysis and causal inferences ," American Anthropologist62: 624-53.
7.
1964Causal inferences in nonexperimental research, Chapel Hill, University of North Carolina Press.
8.
Boudon, Raymond1967L'Analyse mathématique des faits sociaux, Paris, Plon.
9.
1970 "A method of linear causal analysis—dependence analysis ," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 99-108.
10.
Campbell, Donald T., and D.W. Fiske1959 "Convergent and discriminant validation by the multitraitmultimethod matrix," Psychological Bulletin56: 81-105.
11.
Cameiro, Robert L.1970 "Scale analysis, evolutionary sequences, and the rating of cultures," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 834-71.
12.
Chaney, Richard P., and Rogelio Ruiz Revilla1969 "Sampling methods and interpretation of correlation: a comparative analysis of seven cross-cultural samples," American Anthropologist71: 597-633.
13.
Cohen, Ronald, and Raoul Naroll1970 "Method in cultural anthropology," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 3-24.
14.
Cohen, Yehudi A.1968 "Macroethnology: large-scale comparative studies ," in James A. Clifton, ed., Introduction to Cultural Anthropology, New York, Houghton Mifflin: 402-49.
15.
Driver, Harold E.1956 "An integration of functional, evolutionary and historical theory by means of correlations," Indiana University Publications in Anthropology and Linguistics12: 1-36. (Revised and reprinted in Clellan S. Ford, ed., Cross-Cultural Approaches, New Haven, HRAF Press , 1967: 259-89.)
16.
1966 "Introduction to statistics for comparative research," in Frank W. Moore, ed., Readings in Cross-Cultural Methodology, 2d printing, reset, New Haven, HRAF Press: 310-38.
17.
Driver, Harold E., and Richard P. Chaney1970 "Cross-cultural sampling and Galton's problem," in Raoul Naroll and Ronald Cohen, eds. ; A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 990-1003.
18.
Driver, Harold E., and Karl F. Schuessler1967 "Correlational analysis of Murdock's 1957 ethnographic sample," American Anthropologist69: 332-52.
19.
Ember, Melvin1970 "Taxonomy in comparative studies," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 697-706.
20.
Ford, Clellan S.1967Cross-cultural approaches: readings in comparative research , New Haven, HRAF Press.
21.
Goodenough, Ward H.1970Description and comparison in cultural anthropology, Chicago , Aldine.
22.
Helm, June, ed. 1968Essays on the problem of tribe, Proceedings of the 1967 Annual Spring Meeting of the American Ethnological Society, Seattle , University of Washington Press.
23.
Human Relations Area Files 1967 "The HRAF Quality Control Sample Universe ," Behavior Science Notes2: 81-103.
24.
Janda, Kenneth1970 " Data quality control and library research on political parties," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 962-73.
25.
Köbben, André J. F.1952 "New ways of presenting an old idea: the statistical method in social anthropology," Journal of the Royal Anthropological Institute82: 129-46.
26.
1967 "Why exceptions? The logic of cross-cultural analysis," Current Anthropology8: 3-34.
27.
1970 "Cause and intention," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 89-98.
28.
LeBar, Frank M.1970 "Coding ethnographic materials," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 707-20.
29.
Lewis, Oscar1956 "Comparisons in cultural anthropology," in William L. Thomas, ed., Current Anthropology: A Supplement to Anthropology Today, Chicago , University of Chicago Press: 259-92.
30.
McEwen, William J.1963 "Forms and problems of validation in social anthropology ," Current Anthropology4: 155-83.
31.
McNett, Charles W.1970 "A settlement pattern scale of cultural complexity ," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology , Garden City, Natural History Press : 872-86.
32.
Moore, Frank W.1969 "Codes and coding," Behavior Science Notes4: 247-66.
33.
Murdock, George Peter1957 "World ethnographic sample," American Anthropologist59: 664-87.
34.
1967 "Ethnographic atlas: a summary," Ethnology6: 109-236.
35.
Murdock, George Peter, and Douglas R. White1969 "Standard cross-cultural sample ," Ethnology8: 329-69.
36.
Murdock, George Peter, et al. 1963 "Ethnographic atlas," Ethnology2: 249-68.
37.
Naroll, Raoul1961 "Two solutions to Galton's problem," Philosophy of Science28: 16-39.
38.
1962 a Data quality control: a new research technique, New York, Free Press.
39.
1962b "Floor area and settlement population," American Antiquity27: 587-89.
40.
1964 "On ethnic unit classification," Current Anthropology5: 283-312.
41.
1967 "The proposed HRAF Probability Sample," Behavior Science Notes2: 70-80.
42.
1969 "Cultural determinants and the concept of the sick society ," in Stanley C. Plog and Robert B. Edgerton, eds., Changing Perspectives in Mental Illness, New York, Holt, Rinehart and Winston: 128-55.
43.
1970a "What have we learned from cross-cultural surveys?" American Anthropologist72: 1227-88.
44.
1970 b "Influence analysis—an appendix," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 108-10.
45.
1970 c "The culture-bearing unit in cross-cultural surveys," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology , Garden City, Natural History Press : 721-65.
46.
1970 d "Cross-cultural sampling," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 889-926.
47.
1970 f "Galton's problem," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City , Natural History Press: 974-89.
48.
1970 g "Cross-cultural sampling," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 889-926.
49.
1970 h "Data quality control in cross-cultural surveys," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology , Garden City, Natural History Press : 927-45.
50.
1970i "Chaney and Ruiz Revilla: a comment," American Anthropologist72: 1450-53.
51.
Naroll, Raoul, Winston Alnot, Janice Caplan, Judith F. Hansen, Jeanne Maxant , and Nancy Schmidt1970 "Standard ethnographic sample," Current Anthropology11: 235-48.
52.
Naroll, Raoul, and Roy D'Andrade1963 "Two further solutions to Galton's problem," American Anthropologist63: 1053-67.
53.
Naroll, Raoul, and Richard Grey Sipes n.d. "A standard ethnographic sample, second edition," Current Anthropology (in press).
54.
O'Leary, Timothy J.1970 "Ethnographic bibliographies," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 128-46.
55.
Otterbein, Keith F.1969 "Basic steps in conducting a cross-cultural study ," Behavior Science Notes4: 221-36.
56.
Pelto, Pertti J.1970Anthropological research: the structure of inquiry, New York, Harper and Row.
57.
Roberts, John M.1965 "Oaths, autonomic ordeals, and power," American Anthropologist67: 186-212. (Reprinted in Clellan S. Ford, ed., Cross-Cultural Approaches , New Haven, HRAF Press, 1967: 169-95.)
58.
Rohner, Ronald P., and Leonard Katz1970 "Testing for validity and reliability in cross-cultural research," American Anthropologist72: 1068-73.
59.
Rosenthal, Robert1966Experimenter effects in behavioral research, New York, Apple-ton-Century-Crofts.
60.
Rozelle, R.M., and Donald T. Campbell1969 "More plausible rival hypotheses in the cross-lagged panel correlation," Psychological Bulletin72: 74-80.
61.
Rummel, Rudolph J.1970 "Dimensions of error in cross-national data," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology , Garden City, Natural History Press: 946-61.
62.
Sawyer, Jack, and Robert LeVine1966 "Cultural dimensions: a factor analysis of the world ethnographic sample," American Anthropologist63: 708-31.
63.
Schaefer, James M.1969 "Linked pair alignments for the HRAF Quality Control Sample Universe," Behavior Science Notes4: 299-320.
64.
Schapera, Isaac1953 "Some comments on comparative method in social anthropology ," American Anthropologist55: 353-61.
65.
Siegel, Sidney1956Nonparametric statistics for the behavioral sciences , New York, McGraw-Hill.
66.
Simmons, Leo W.1937 "Statistical correlations in the science of society ," in George P. Murdock, ed., Studies in the Science of Society, Yale University Press : 495-517. (Reprinted in Clellan S. Ford, ed., Cross-Cultural Approaches , New Haven, HRAF Press, 1967: 221-45.
67.
Sipes, Richard G. n.d. "The ability to change life styles and sociocultural evolution: a cross-cultural correlation study" (unpublished research report).
68.
Spiro, Melford E., and Roy G. D'Andrade1958 "A cross-cultural study of some supernatural beliefs," American Anthropologist60: 456-66. (Reprinted in Clellan S. Ford , ed., Cross-Cultural Approaches, New Haven, HRAF Press, 1967: 196-207. )
69.
Stephens, William N.1961 "A cross-cultural study of menstrual taboos," Genetic Psychology Monographs64: 385-416. (Reprinted in Clellan S. Ford, ed., Cross-Cultural Approaches , New Haven, HRAF Press, 1967: 67-94.)
70.
Tanter, Raymond1970 "Toward a theory of political development," in Raoul Naroll and Ronald Cohen , eds., A Handbook of Method in Cultural Anthropology , Garden City, Natural History Press: 111-27.
71.
Tatje, Terrence A., and Raoul Naroll1970 "Two measures of societal complexity: an empirical cross-cultural comparison," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City , Natural History Press: 766-833.
72.
Tatje, Terrence A., Raoul Naroll, and Robert B. Textor1970 "The methodological findings of the cross-cultural summary," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City , Natural History Press: 649-75.
73.
Textor, Robert B.1967A cross-cultural summary, New Haven , HRAF Press.
74.
Vansina, Jan 1970 "Cultures through time," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City , Natural History Press: 165-79.
75.
Voegelin, Carl F., and Florence M. Voegelin1966 "Index to languages of the world," Anthropological Linguistics8, nos. 6-7.
76.
Webb, Eugene J., Donald T. Campbell, Richard D. Schwartz, and Lee Sechrest1966Unobtrusive measures: nonreactive research in the social sciences, Chicago, Rand McNally .
77.
White, Douglas R.1970 "Societal research archives system: retrieval, quality control and analysis of comparative data," in Raoul Naroll and Ronald Cohen, eds., A Handbook of Method in Cultural Anthropology, Garden City, Natural History Press: 676-87.
78.
Whiting, John W. M.1954 "The cross-cultural method," in Gardner Lindzey, ed., Handbook of Social Psychology , vol. 1, Cambridge, Mass., Addison-Wesley: 523-31.
79.
1959 "Sorcery, sin and the superego: a cross-cultural study of some mechanisms of social control," in Marshall R. Jones, ed., Nebraska Symposium on Motivation 1959, Lincoln, University of Nebraska Press: 174-95. (Reprinted in Clellan S. Ford , ed., Cross-Cultural Approaches, New Haven, HRAF Press, 1967: 147-68.)
80.
1968 "Method and problems in cross-cultural research," in Gardner Lindzey and Elliot Aronson, eds., Handbook of Social Psychology, 2d cd., vol. 2, Reading, Mass., Addison-Wesley: 693-728.
81.
Winch, Robert F., and Donald T. Campbell1969 "Proof? No. Evidence? Yes. The significance of tests of significance," American Sociologist4: 140-43.
82.
Young, Frank W., and Albert S. Bacdayan1965 "Menstrual taboos and social rigidity," Ethnology4: 225-40. (Reprinted in Clellan S. Ford, ed., Cross-Cultural Approaches , New Haven, HRAF Press, 1967: 95-110.)
83.
Zelditch, Morris1959A basic course in sociological statisticsNew York, Henry Holt.
