The distinction between "objective" and "subjective" measurement is neither meaningful nor useful in human performance studies. All measurement in science and technology is necessarily filled with subjective elements, whether in selecting measures or in collecting, analyzing, or interpreting data. Empirical examples taken from several domains related to human factors show instances in which self-report (subjective) measures may be essential. Amodel process is suggested for selecting performance measures.
Get full access to this article
View all access options for this article.
References
1.
Angel, R., and Gronfein, W. (1988). The use of subjective information in statistical analysis. American Sociological Review, 53, 464–473.
2.
Austin, S. V., and Hemsley, D. R. (1978). Objective and subjective measures of distractability. Bulletin of the psychonomic Society, 12, 182–184.
3.
Ayer, A. J. (1952). Language, truth, and logic.New York: Dover.
4.
Berger, J. O., and Berry, D. A. (1988). Statistical analysis and the illusion of objectivity. American Scientist, 76, 159–165.
5.
Blalock, H. M., Jr. (1982). Conceptualization and measurement in the social sciences.Beverly Hills, CA: Sage.
6.
Blass, T. (1974). The measurement of objectivity-subjectivity: Effects of tolerance for imbalance and grades on evaluations of teachers. Psychological Reports, 34, 1199–1213.
7.
Campbell, D. T. (1958). Systematic error on the part of human links in communication systems. Information and Control, 1, 334–369.
8.
Campbell, S. S., and Webb, W. B. (1981). The perception of wakefulness within sleep. Sleep, 4, 177–183.
9.
Chapanis, A. (1959). Research techniques in human engineering.Baltimore, MD: Johns Hopkins University Press.
10.
Cole, K. C. (1985, September). Is there such a thing as scientific objectivity?Discover, pp. 98–99.
11.
Cox, D., Hallam, R., O'Connor, K., and Rachman, S. (1983). An experimental analysis of fearlessness and courage. British Journal of Psychology, 74, 107–117.
12.
Danford, S., and Willems, E. P. (1975). Subjective responses to architectural displays: A question of validity. Environment and Behavior, 7, 486–515.
13.
Derrick, W. L. (1988). Dimensions of operator workload. Human Factors, 30, 95–110.
14.
Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7, 117–140.
15.
Friedman, N. (1967). The social nature of psychological research: The psychological experiment as a social interaction.New York: Basic Books.
16.
Gopher, D., and Braune, R. (1984). On the psychophysics of workload: Why bother with subjective measures?. Human Factors, 26, 519–532.
17.
Gorenflo, D. W., and Crano, W. D. (1989). Judgmental subjectivity/objectivity and locus of choice in social comparison. Journal of Personality and Social Psychology, 57, 605–614.
18.
Hammond, K. R., and Householder, J. E. (1962). Introduction to the statistical method.New York: Knopf.
19.
Hartley, C., Brecht, M., Pagerey, P., Weeks, G., Chapanis, A., and Hoecker, D. (1977). Subjective time estimates of work tasks by office workers. Journal of Occupational Psychology, 50, 23–36.
20.
Hoch, C. C., Reynolds, C. F., Kupfer, D. J., Berman, S. R., Houck, P. R., and Stack, J. A. (1987). Empirical note: Self-report versus recorded sleep in healthy seniors. Psychophysiology, 24, 293–299.
21.
Klein, H. A. (1974). The world of measurements.New York: Simon and Schuster.
22.
Kosso, P. (1989). Science and objectivity. Journal of Philosophy, 86, 245–257.
23.
Kuhn, T. S. (1961). The function of measurement in modern physical science. In H. Woolf (Ed.), Quantification: A history of the meaning of measurement in the natural and social sciences (pp. 31–63). Indianapolis, IN: Bobbs-Merrill.
24.
Lucker, G. W., Beane, W. E., and Guire, K. (1981). The idiographic approach to physical attractiveness research. Journal of Psychology, 107, 57–67.
25.
Mallamad, S. M., Levine, J. M., and Fleishman, E. A. (1980). Identifying ability requirements by decision flow diagrams. Human Factors, 22, 57–68.
26.
Meister, D. (1985). Behavioral analysis and measurement methods.New York: Wiley.
27.
Meister, D. (1986). Human factors testing and evaluation.Amsterdam: Elsevier.
28.
Meister, D. (1988). Development of subjective data for performance prediction. In Proceedings of the Human Factors Society 32nd Annual Meeting (pp. 943–947). Santa Monica, CA: Human Factors Society.
29.
Muckler, F. A. (1977). Selecting performance measures: “Objective” versus “subjective” measurement. In L. T. Pope and D. Meister (Eds.), Productivity enhancement: Personnel performance assessment in navy systems (pp. 169–178). San Diego, CA: Navy Personnel Research and Development Center.
30.
Muckler, F. A. (1982). Evaluating productivity. In M. D. Dunnette and E. A. Fleishman (Eds.), Human performance and productivity: Human capability assessment (pp. 13–47). Hillsdale, NJ: Erlbaum.
31.
Mulaik, S. A. (1991). Factor analysis, information-transforming instruments, and objectivity: A reply and discussion. British Journal of the Philosophy of Science, 42, 87–100.
32.
Nontasak, T. (1978). The nature of quality of life: A comparison of subjective and objective measures. Dissertation Abstracts International, 39(3-A): 1852.
33.
Olson, J. M., Ellis, R. J., and Zanna, M. P. (1983). Validating objective versus subjective judgments: Interest in social comparison and consistency information. Personality and Social Psychology Bulletin, 9, 427–436.
34.
Rehmann, J. T., Stein, E. S., and Rosenberg, B. L. (1983). Subjective pilot workload assessment. Human Factors, 25, 297–301.
35.
Rosenthal, R. (1976). Experimenter effects in behavioral research (enlarged ed.). New York: Irvington.
36.
Russell, B. (1945). A history of Western philosophy.New York: Simon and Schuster.
37.
Scheffler, I. (1967). Science and subjectivity.Indianapolis, IN: Bobbs-Merrill.
38.
Shuller, D. Y., and McNamara, J. R. (1976). Expectancy factors in behavioral observation. Behavior Therapy, 7, 519–527.
39.
Siegel, A. I. (1954). The checklist as a criterion of proficiency. Journal of Applied Psychology, 38, 93–95.
40.
Solomon, Z., Mikulincer, M., and Hobfoll, S. E. (1987). Objective versus subjective measurement of stress and social support: Combat-related reactions. Journal of Consulting and Clinical Psychology, 55, 577–583.
41.
Soper, W. B. (1980). Relationships between subjectively and statistically determined contributions to life satisfaction for male university faculty. Psychological Reports, 46, 731–734.
42.
Stone, A. A. (1982). The objectivity and subjectivity of life events. Journal of Clinical Psychology, 38, 333–340.
43.
Thornton, G. C., III, and Zorich, S. (1980). Training to improve observer accuracy. Journal of Applied Psychology, 65, 351–354.
44.
Turkington, D., and Drummond, D. C. (1989). How should opiate withdrawal be measured?. Drug and Alcohol Dependence, 24, 151–153.
45.
Vreuls, D., and Obermayer, R. W. (1985). Human-system performance measurement in training simulators. Human Factors, 27, 241–250.
46.
Walker, H. M., and Lev, J. (1969). Elementary statistical methods (3rd ed.). New York: Holt, Rinehart & Winston.
47.
Webb, E. J., Campbell, D. T., Schwartz, R. D., and Sechrest, L. (1966). Unobtrusive measures: Nonreactive research in the social sciences.Chicago: Rand-McNally.
48.
Webb, W. B., and Schneider-Helmert, D. (1984). Awakenings: Subjective and objective relations. Perceptual and Motor Skills, 59, 63–70.
49.
Wierwille, W. W., Rahimi, M., and Casali, J. G. (1985). Evaluation of 16 measures of mental workload using a simulated flight test emphasizing mediational activity. Human Factors, 27, 489–502.
50.
Yeh, Y.-Y., and Wickens, C. D. (1988). Dissociation of performance and subjective measures of workload. Human Factors, 30, 111–120.
