The author describes a method for constructing incomplete designs for paired comparisons data, using cyclic designs that place each item in the same number of pairings. He tests the reliability of the method using judged similarity data on twenty-one animal names and finds that designs that use 30% of the data have an acceptable level of reliability. The method has great potential value in field research as a means of reducing the number of questions required.
Get full access to this article
View all access options for this article.
References
1.
Behrens, C. A. 1986. Shipibo food categorization and preference: Relationships between indigenous and Western dietary concepts. American Anthropologist88:647-658.
2.
Borgatti, S. P. 1992. ANTHROPAC version 4.91. Columbia, SC: Analytic Technologies.
3.
Bradley, R. A. 1982. Paired comparisons. In Encyclopedia of statistical sciences, Vol. 6, edited by S. Kotz and N. L. Johnson, 555-560. New York: John Wiley.
4.
Bradley, R. A., and M. E. Terry. 1952. The rank analysis of incomplete block designs. I: The method of paired comparisons. Biometrika41:502-537.
5.
Burton, M. L. 1972. Semantic dimensions of occupation names. In Multidimensional scaling, Vol. 2, edited by A. K. Romney, R. N. Shepard, and S. B. Nerlove, 55-71. New York: Seminar Press.
6.
Burton, M. L. 1999. Constructing a scale of female contributions to agriculture: Methods for imputing missing data. Cross-Cultural Research30:3-23.
7.
Burton, M. L., and S. B. Nerlove. 1976. Balanced designs for triads tests. Social Science Research5:247-267.
8.
David, H. A. 1963. The method of paired comparisons. New York: Hafner.
9.
David, H. A. 1982. Cyclic designs. In Encyclopedia of statistical sciences, Vol. 2, edited by S. Kotz and N. L. Johnson, 256-260. New York: John Wiley.
10.
Davidson, R. R., and P. H. Farquhar. 1976. A bibliography on the method of paired comparisons. Biometrics32:241-252.
11.
Gulliksen, H. 1956. A least squares solution for paired comparisons with incomplete data. Psychometrika21:125-134.
12.
Hubert, L. J. 1987. Assignment methods in combinatorial data. New York: Marcel Dekker.
13.
John, P. W. M. 1980. Incomplete block designs. New York: Marcel Dekker.
14.
McCormick, E. J., and J. A. Bachus. 1952. Paired comparison ratings I: The effect on ratings of reductions in the number of pairs. Journal of Applied Psychology36:123-127.
15.
McCormick, E. J., and W. K. Roberts. 1952. Paired comparison ratings II: The reliability of ratings based on partial pairings. Journal of Applied Psychology36:188-192.
16.
Romney, A. K., W. H. Batchelder, and T. Brazill. 1995. Scaling semantic domains. In Geometric representations of perceptual phenomena: Essays in honor of Tarow Indow, edited by R. D. Luce, M. D'Zmura, D. Hoffman, G. Iverson, and A. K. Romney, 267-294. Mahwah, NJ: Lawrence Erlbaum.
17.
Romney, A. K., C. C. Moore, W. H. Batchelder, and T. L. Hsia. 2000. Statistical methods for characterizing similarities and differences between semantic structures. Proceedings of the National Academy of Sciences97 (1): 518-523.
18.
Spence, I. 1982. Incomplete experimental designs for multidimensional scaling. In Proximity and preference, edited by R. G. Golledge and J. N. Raynor, 29-46. Minneapolis: University of Minnesota Press.
19.
Spence, I., and D. W. Domoney. 1974. Single subject incomplete designs for nonmetric multidimensional scaling. Psychometrika39:469-490.
20.
Thurstone, L. L. 1927. The method of paired comparisons for social values. Journal of Abnormal Social Psychology21:384-400.
21.
Torgersen, W. S. 1958. Theory and methods of scaling. New York: John Wiley.
22.
Treiman, D. J. 1977. Occupational prestige in comparative perspective. New York: Academic Press.
23.
Weller, S. C., and A. K. Romney. 1990. Metric scaling: Correspondence analysis. Quantitative Applications in the Social Sciences number 75. Newbury Park, CA: Sage.
