Effects of Item Characteristics on Psychometric Properties of Forced Choice Scales

Abstract

Two studies examined the effects of indeterminate frequency modifiers, item length, and statement direction on response to forced choice scale items. A pilot study established relative intensities of nine adverbial modifiers. Study 1 (N = 320) showed no effect on item variances due to the treatments. Differences were found between mean responses of short and long items as well as between positively and negatively stated items. Study 2 (N = 110) investigated effects on scale reliability and validity related to different intensity levels of modifiers. It is concluded that differential responses to items may not reflect differences in the behavior referenced by the items but rather observed differences in individual responses may be due to the mechanical, grammatical or delimitive characteristics of the items.

Get full access to this article

View all access options for this article.

References

Altemeyer, R. A. Adverbs and intervals: A study of Likert scales. Proceedings of the 78th Annual Convention of the American Psychological Association, 1970, 5, 397 -398.

Buros, O. K. (Ed.) The seventh mental measurements yearbook. Highland Park, N. J.: Gryphon Press, 1972.

Cramer, W. The positive or negative effect of the form of the question upon college students' answers. Journal of Educational Research, 1951, 44 , 303-307.

Cronbach, L. J. Essentials of psychological testing. New York: Harper and Bros. , 1949.

Ebel, R. L. Essentials of educational measurement . Englewood Cliffs, N.J.: Prentice-Hall , 1972.

Edwards, A. L. Techniques of attitude scale construction. New York: Appleton-Century-Crofts , 1957.

Halderson, J. S. and Glasnapp, D. R. Generalized rules for calculating the magnitude of an effect in factorial and repeated measures ANOVA designs. American Educational Research Journal, 1972, 9 , 301-310.

Hays, W. L. Statistics for the social sciences (2nd Ed.). New York : Holt, Rinehart and Winston, 1973 .

Payne, D. A. The assessment of learning: Cognitive and affective. Lexington, Mass.: D. C. Heath, 1974.

10.

Pratt, K. C. Indeterminate number concepts II: Application to children to determine number groups. Journal of Genetic Psychology, 1948, 73 , 209-236.

11.

Robinson, J. P. , Rush, J. G. , and Head, K. B. Measures of political attitudes. Ann Arbor, Michigan : Survey Research Center, 1968 .

12.

Robinson, J. P. and Shaver, R. R. Measures of social psychological attitudes. Institute for Social Research, University of Michigan, 1969, 143-147 .

13.

Simpson, R. H. The specific meanings of certain terms indicating differing degrees of frequency. The Quarterly Journal of Speech, 1944, 30, 328-330.

14.

Whipple, J. W. A study of the extent to which positive or negative phrasing affects answers in a true-false test. Journal of Educational Research, 1957, 51, 59-63 .