Self-reports figure prominently in organizational and management research, but there are several problems associated with their use. This article identifies six categories of self-reports and discusses such problems as common method variance, the consistency motif, and social desirability. Statistical and post hoc remedies and some procedural methods for dealing with artifactual bias are presented and evaluated. Recommendations for future research are also offered.
Get full access to this article
View all access options for this article.
References
1.
Arnold, H.J., & Feldman, D.C. (1981). Social desirability response bias in self-report choice situations. Academy of Management Journal, 24, 377-385.
2.
Berman, J.S., & Kenny, D.A. (1976). Correlational bias in observer ratings. Journal of Personality and Social Psychology, 34, 263-273.
3.
Birnbaum, PH., Farh, J.L., & Wong, G.Y.Y. (1986). The job characteristics model in Hong Kong. Journal of Applied Psychology, 71, 598-605.
4.
Buchwald, A.M. (1959). Verbal utterances as data. In H. Feigl & G. Maxwell (Eds.), Current issues in the philosophy of science (pp. 461-473). New York: Holt.
5.
Campbell, D.T., & Fiske, D.W (1959). Convergent and discriminant validation by the multitraitmultimethod matrix. Psychological Bulletin, 56, 81-105.
6.
Campbell, J.P (1977). The cutting edge of leadership: An overview. In J.G. Hunt & L.L. Larson (Eds.), Leadership: The cutting edge (pp. 221-233). Carbondale, IL: Southern Illinois University Press.
7.
Chapman, L.J., & Chapman, J.P. (1967). Genesis of popular but erroneous psychodiagnostic observations. Journal of Abnormal Psychology, 73, 193-204.
8.
Chapman, L.J., & Chapman, J.R (1969). Illusory correlations as an obstacle to the use of valid psychodiagnostic signs. Journal of Abnormal Psychology, 74, 271-280.
9.
Crowne, D., & Marlowe, D. (1964). The approval motive: Studies in evaluative dependence. New York: Wiley.
10.
Danserau, F, Jr., Alutto, J.A., Markham, S.E., & Dumas, M. (1982). Multiplexed supervision and leadership: An application of within and between analysis. In J.G. Hunt, U. Sekaran, & C.A. Schriesheim (Eds.), Leadership: Beyond establishment views (pp. 81-103). Carbondale, IL: Southern Illinois University Press.
11.
Dipboye, R.L., & Flanagan, M.F (1979). Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory?American Psychologist, 34, 141-150.
12.
Eden, D., & Leviatin, V (1975). Implicit leadership theory as a determinant of the factor structure underlying supervisory behavior scales. Journal of Applied Psychology, 60, 736-740.
13.
Edwards, A.L. (1970). The measurement ofpersonality traits by scales and inventories. New York: Holt, Rinehart, & Winston.
14.
Fiske, D. W (1982). Convergent-discriminant validation in measurements and research strategies. In D. Brinberg & L. Kidder (Eds.), New directions for methodology of social and behavioral science: Forms of validity in research (No. 12, pp. 77-92). San Francisco: Jossey-Bass.
15.
Ganster, D.C., Hennessey, H.W, & Luthans, F (1983). Social desirability response effects: Three alternative models. Academy of Management Journal, 26, 321-331.
16.
Glick, WH., Jenkins, G.D., Jr., & Gupta, N. (1986). Method versus substance: How strong are underlying relationships between job characteristics and attitudinal outcomes?Academy of Management Journal, 29, 441-464.
17.
Greene, C.N., & Organ, D.W (1973). An evaluation of causal models linking the received role with job satisfaction. Administrative Science Quarterly, 18, 95-103.
18.
Gupta, N., & Beehr, T.A. (1982) A test of the correspondence between self-reports and alternative data sources about work organizations. Journal of Vocational Behavior, 20, 1-13.
19.
Howard, G.S., Maxwell, S.E., Wiener, R.L., Boynton, K.S., & Rooney, W.M. (1980). Is a behavioral measure the best estimate of behavioral parameters? Perhaps not. Applied Psychological Measurement, 4, 293-311.
20.
Ilgen, D.R., Mitchell, T.R., & Fredrickson, J.W (1981). Poor performers: Supervisors' and subordinates' responses. Organizational Behavior and Human Performance, 27, 386-410.
21.
Jenkins, H.M., & Ward, W.C. (1965). Judgement of contingency between responses and outcomes. Psychological Monographs: General and Applied, 79 (Whole No. 594).
22.
Joreskog, K.G., & Sorbom, D. (1981). LISREL: Analysis of linear structural relationships by the method of maximum likelihood. Chicago: National Educational Resources, Inc.
23.
Kemery, E.R., & Dunlap, W.P. (1986). Partialling factor scores does not control method variance: A rejoinder to Podsakoff and Todor. Journal of Management, 12, 525-530.
24.
Lord, R.G., Binning, J.E, Rush, M.C., & Thomas, J.C. (1978). The effect of performance cues and leader behavior on questionnaire ratings of leadership behavior. Organizational Behavior and Human Performance, 21, 27-39.
25.
Mitchell, T.R. (1985). An evaluation of the validity of correlational research conducted in organizations. Academy of Management Review, 10, 192-205.
26.
Mitchell, TR., Green, S.G., & Wood, R. (1981). An attributional model of leadership and the poor performing subordinate. In L.L. Cummings & B.M. Staw (Eds.), Research in organizational behavior (Vol. 3, pp. 197-234). Greenwich, CT: JAI Press.
27.
Organ, D.W, & Greene, C.N. (1981). The effects of formalization on professional involvement: A compensatory process approach. Administrative Science Quarterly, 26, 237-252.
28.
Phillips, J.S., & Lord, R.G. (1986). Notes on the practical and theoretical consequences of implicit leadership theories for the future of leadership measurement. Journal of Management, 12, 31-41.
29.
Podsakoff, P.M. (1982). Determinants of a supervisor's use of rewards and punishments: A literature review and suggestions for future research. Organizational Behavior and Human Performance, 29, 58-83.
30.
Podsakoff, P.M., & Todor, W D. (1985). Relationships between leader reward and punishment behavior and group processes and productivity. Journal of Management, 11, 55-73.
31.
Podsakoff, P.M., Todor, WD., Grover, R.A., & Huber, V.L. (1984). Situational moderators of leader reward and punishment behaviors: Fact or fiction?Organizational Behavior and Human Performance, 34, 21-63.
32.
Salancik, G.R., & Pfeffer, J. (1977). An examination of need-satisfaction models of job attitudes. Administrative Science Quarterly, 22, 427-456.
Schriesheim, C.A. (1979). The similarity of individual-directed and group-directed leader behavior description. Academy of Management Journal, 22, 345-355.
35.
Schriesheim, J.F. (1980). The social context of leader-subordinate relations: An investigation of the effects of group cohesiveness. Journal of Applied Psychology, 65, 183-194.
36.
Schwab, D.P. (1980). Construct validity in organizational behavior. In L.L. Cummings & B.M. Staw (Eds.), Research in organizational behavior (Vol. 2, pp. 3-43). Greenwich, CT: JAI Press.
37.
Sims, H.P., Jr. (1979). Limitations and extensions to questionnaires in leadership research. In J.G. Hunt & L.L. Larson (Eds.), Crosscurrents in leadership (pp. 202-221). Carbondale, IL: Southern Illinois University Press.
38.
Smith, C.A., Organ, D.W, & Near, J.P. (1983). Organizational citizenship behavior: Its nature and antecedents. Journal of Applied Psychology, 68, 653-663.
39.
Staw, B.J. (1975). Attribution of the 'causes' of performance: A new alternative interpretation of cross-sectional research in organizations. Organizational Behavior and Human Performance, 13, 414-432.
40.
Taylor, J.B. (1961). What do attitude scales measure: The problem of social desirability. Journal of Abnormal and Social Psychology, 62, 386-390.
41.
Thomas, K.W, & Kilmann, R.H. (1975). The social desirability variable in organizational research: An alternative explanation for reported findings. Academy of Management Journal, 18, 741-752.
