Thirty-five files of multiple-choice test items were examined for evidence of biases in the correct answers. Of seven types of biases, the most frequently occurring (24 cases) was the "All of the above" bias in which that answer was correct significantly more than 25% of the time. Another common bias (17 cases) was a tendency for the longest answer to be correct too frequently. Ten cases were also found in which answers of the form "Both A and B" were correct too frequently. Finally, the ABCD bias, in which the probability of each of the four response choices being correct differs from .25, was present in seven files. Three other biases occurred only a few times. It was concluded that authors should take precautions to prevent biases in future item files.
Get full access to this article
View all access options for this article.
References
1.
Aiken, L. R.Psychological testing and assessment (3rd ed.). Boston: Allyn & Bacon, Inc., 1979.
2.
Coon, D.Introduction to psychology: Exploration and application (2nd ed.). St. Paul: West Publ. Co., 1980. (Item file "with special assistance of" William Dwyer.)
3.
Cronbach, L.Response sets in objective tests . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1946, 6, 475-494.
4.
Davidoff, L. L.Introduction to psychology (2nd ed.). New York: McGraw-Hill, 1980. (Item file by Ardizzone, J., Lerner, M., Perry, S., Taylor, S., and Whitehurst, R.)
5.
Developmental psychology today (2nd ed.). New York: CRM/Randon House, 1975. (Item file by J. F. Calhoun.)
6.
Engle, T. L. and Snellgrove, L.Psychology: its principles and applications (7th ed.). New York: Harcourt, Brace & Jovanovich, 1979.
7.
Freedman, J. L.Introductory psychology. Reading, Mass.: Addison-Wesley Pub. Co., 1978. (Item file by R. Kendis.)
8.
Hilgard, E. R. , Atkinson, R. L., and Atkinson, R. C.Introduction to psychology (7th ed.). New York: Harcourt, Brace & Jovanovich, 1979.
9.
Holland, M. K.Psychology: An introduction to human behavior (2nd ed.). Lexington, Mass.: D. C. Heath & Co., 1978. (Item file by R. Kendis.)
10.
Kagan, J. and Havemann, E.Psychology: An introduction (3rd ed.). New York: Harcourt, Brace & Jovanovich, 1976. (Item file series 1 by Kreitzberg, V. S. and Kreitzberg, C. B., 1976; file series 2 by Havemann, E. and Swartzendruber, L., 1977; file series 3 by G. Von Maluski, 1978.)
11.
Kagan, J. and Havemann, E.Psychology: An introduction (4th ed.). New York: Harcourt, Brace & Jovanovich, 1980. (Item file by M. J. Moore.)
12.
Kalish, R. A.The psychology of human behavior (4th ed.). Monterey, Calif.: Brooks/Cole Pub. Co.1977. (Item file by Johnson, A. I. and Kalish, R. A.)
13.
Kasschau, R. A. and Maxwell, C. B.Psychology: Exploring behavior. Englewood Cliffs, N. J.: Prentice-Hall, 1980.
14.
Lindzey, G. , Hall, C., and Thompson, R. F.Psychology (2nd ed.). New York: Worth Publ. Inc., 1978. (Item file by Wollen, K. A. and Wright, J. W.)
15.
Lowman, K. D.Directory of introductory psychology texts in print: 1979 . Teaching of Psychology, 1979, 6, 49-54.
16.
McClelland, L.Psychology: Its principles and meanings (2nd ed.). New York: Harcourt, Brace & Jovanovich, 1976.
17.
McConnell, J. V.Understanding human behavior. New York: Holt, Rinehart & Winston, Inc., 1974. (Item file 1 by Siebert, A and Walter, T.; file 2 by Siebert, A. and Walter, T., 1975.)
18.
McConnell, J. V.Understanding human behavior (2nd ed.). New York: Holt, Rinehart & Winston, Inc., 1977. (Item file 1 by McConnell, J. V. and Flagg, T. L.; file 3 by Block, R. A., 1978.)
19.
Metfessel, N. S. and Sax, G.Systematic biases in the keying of correct responses on certain standardized tests. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1958, 18, 787-790.
20.
Mindess, H. and Munford, P.Psychology: The study of people. Santa Monica, Calif.: Goodyear, 1980. (Item file by J. Turek.)
21.
Morgan, C. T. , King, R. A., and Robinson, N. M.Introduction to psychology (6th ed.). New York: McGraw-Hill, 1979. (Item file by R. A. King.)
22.
Morris, C. G.Psychology: An introduction (3rd ed.). Englewood Cliffs, N. J.: Prentice-Hall, Inc., 1979. (Item files 1 and 2 by C. G. Morris.)
23.
Munn, N. L. , Fernald, L. D., Jr., and Fernald, P. S.Basic psychology (3rd ed.). Boston: Houghton-Mifflin Co., 1974.
24.
Mussen, P. , Rosenzweig, M. R., Geiwitz, J.Aronson, E., Elkind, D., Feshbach, S., Glickman, S. E., Murdock, B. B., Jr., Wertheimer, M., and Harvey, L. O., Jr.Psychology: An introduction (2nd ed.). Lexington, Mass.: D. C. Heath & Co., 1977.
25.
Ryckman, R. M.Theories of personality. New York: D. Van Nostrand, 1978.
26.
Schultz, D. P.Psychology and industry today (2nd ed.). New York: MacMillan Pub. Co., Inc., 1978.
27.
Silverman, R. E.Psychology (3rd ed.). Englewood Cliffs, N. J.: Prentice-Hall, 1978.
28.
Smith, R. E. , Sarason, I. G., and Sarason, B. R.Psychology: The frontiers of behavior. New York: Harper & Row, 1978. (Item files 1 and 2 by J. M. Siegel.)
29.
Suinn, R. N.Fundamentals of behavior pathology. New York: John Wiley & Sons, Inc., 1970.
30.
Suinn, R. N.Fundamentals of behavior pathology (2nd ed.). New York: John Wiley & Sons, Inc., 1975.
31.
Weiner, B. , Runquist, W., Raven, B. H., Meyer, W. J., Leiman, A., Kutscher, C. L., Kleinmuntz, B. K., and Haber, R. N.Discovering psychology. Chicago: Science Research Associates, 1977.
32.
Wheeler, L. , Goodale, R., and Deese, J.General psychology. Boston: Allyn & Bacon, Inc., 1975. (Item file by R. Goodale.)
33.
Yates, F.Contingency tables involving small numbers and the χ2 test . Journal of the Royal Statistical Society Supplement, 1934, 1, 217-235.
