A Multitrait-Multimethod(MTMM) matrix was used to evaluate the effect of item wording (i.e., comfort versus stress-worded) on measures of role conflict and role ambiguity. The results indicated that wording factors explained a significant amount of item variance. Moreover, several substantive correlations between role conflict, role ambiguity, and other constructs (e.g., role overload) were reduced when wording factors were taken into account. These findings point to the need to more fully consider and understand item wording. Future research should determine the cause of wording factors, which may be due to cognitive influences (e.g., carelessness), or may represent unmeasured substantive constructs, such as negative affectivity (NA) or social desirability.
Get full access to this article
View all access options for this article.
References
1.
Bagozzi, R. & Yi, Y. (1990). Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology, 75: 547-560.
2.
Bedeian, A.G. & Armenakis, A.A. (1981). A path-analytic study of the consequences of role conflict and ambiguity. Academy of Management Journal, 24: 417-424.
3.
Beehr, T.A., Walsh, J.T. & Taber, T.D. (1976). Relationship of stress to individually and organizationally valued states: Higher order needs as a moderator. Journal of Applied Psychology, 61: 41-47.
4.
Brayfield, A.H. & Rothe, H.F. (1951). An index of job satisfaction. Journal of Applied Psychology, 35: 307-311.
5.
Breaugh, J.A. & Colihan, J.P. (1994). Measuring job ambiguity facets: Construct validity evidence. Journal of Applied Psychology, 79: 191-202.
6.
Burke, M.J., Brief, A.P. & George, J.M. (1993). The role of negative affectivity in understanding relations between self-reports of stressors and strains: A comment on the applied psychology literature. Journal of Applied Psychology, 78: 402-412.
7.
Campbell, D.T., Siegman, C.R. & Rees, M.B. (1967). Direction-of-wording effects in the relationships between scales. Psychological Bulletin, 68: 293-303.
8.
Chen, P. & Spector, P.E. (1991). Negative affectivity as the underlying cause of correlations between stressors and strains. Journal of Applied Psychology, 76: 398-407.
9.
Crampton, S.M. & Wagner, J.A. (1994). Percept-percept inflation in microorganizational research: An investigation of prevalence and effect. Journal of Applied Psychology, 79: 67-76.
10.
Cudeck, R. (1989). Analysis of correlation matrices using covariance structure models. Psychological Bulletin, 105: 317-327.
11.
Fisher, CD. & Gitelson, R. (1983). A meta-analysis of the correlates of role conflict and ambiguity. Journal of Applied Psychology, 68: 320-333.
12.
Glick, W.H., Jenkins, G.D. & Gupta, N. (1986). Method versus substance: How strong are underlying relationships between job characteristics and attitudinal outcomes?Academy of Management Journal, 29: 441-464.
13.
Harris, M.M. (1991). Role conflict and role ambiguity as substance versus artifact: A confirmatory factor analysis of House, Schuler, and Levanoni’s (1983) scales. Journal of Applied Psychology, 76: 122-126.
14.
Harris, M.M. & Schaubroeck, J. (1990). Confirmatory modeling in organizational behavior/human resource management: Issues and applications. Journal of Management, 16: 337-360.
15.
Harrison, D.A. & McLaughlin, M.E. (1993). Cognitive processes in self-report responses: Tests of item context effects in work attitude measures. Journal of Applied Psychology, 78: 129-140.
16.
House, R.J. & Rizzo, J.R. (1972). Role conflict and ambiguity as critical variables in a model of organizational behavior. Organizational Behavior and Human Performance, 7: 467-505.
17.
House, R.J., Schuler, R.S. & Levanoni, E. (1983). Role conflict and role ambiguity scales: Reality or artifacts?Journal of Applied Psychology, 68: 334-337.
18.
Howell, R.D., Wilcox, J.B., Bellenger, D.N. & Chonko, L.B. (1988). An assessment of the role conflict and role ambiguity scales. Pp. 314-319 in G. Frazier, C. Ingene, D. Aaker, A. Ghosh, T. Kinnear, S. Levy, R. Staelin & J. Summers (eds.), AMA educators proceedings. San Francisco, CA: American Marketing Association.
19.
Idaszak, J.R. & Drasgow, F. (1987). A revision of the job diagnostic survey: Elimination of a measurement artifact. Journal of Applied Psychology, 72: 69-74.
20.
Ilgen, D.R. & Hollenbeck, J.R. (1991). The structure of work: Job design and roles. Pp. 165-207 in M.D. Dunnette & L.M. Hough (eds.), Handbook of industrial and organizational psychology, Vol. 2. Palo Alto, CA: Consulting Psychologists Press.
21.
Jackson, S.E. (1983). Participation in decision-making as a strategy for reducing job-related strain. Journal of Applied Psychology, 68: 3-19.
22.
Jackson, S.E. & Schuler, R.S. (1985). A meta-analysis and conceptual critique of research on role ambiguity and role conflict in work settings. Organizational Behavior and Human Decision Processes, 36: 16-78.
Kelloway, E.K. & Barling, J. (1990). Item conflict versus item wording: Disentangling role conflict and role ambiguity. Journal of Applied Psychology, 75: 738-742.
25.
Kemery, E.R., Bedeian, A.G., Mossholder, K.W. & Touliatos, J. (1985). Outcomes of role stress: A multisample constructive replication. Academy of Management Journal, 28: 363-375.
26.
King, L.A. & King, D.W. (1990). Role conflict and role ambiguity: A critical assessment of construct validity. Psychological Bulletin, 107: 48-64.
27.
Marsh, H.W. & Hocevar, D. (1988). A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of&Plied Psychology, 73: 107-117.
28.
McGee, G.W., Ferguson, C.E. & Seers, A. (1989). Role conflict and role ambiguity: Do the scales measure these two constructs?Journal of Applied Psychology, 74: 815-818.
29.
Netemeyer, R.G., Johnston, M.W. & Burton, S. (1990). Analysis of role conflict and role ambiguity in a structural equations framework. Journal of Applied Psychology, 75: 148-157.
30.
Rindskopf, D. (1984). Structural equation models: Empirical identification, Heywood cases, and related problems. Sociological Methods and Research, 13: 109-119.
31.
Rizzo, J.R., House, R.J. & L&man, S.I. (1970). Role conflict and ambiguity in complex organizations. Administrative Science Quarterly, 15: 150-163.
32.
Sawyer, J.E. (1992). Goal and process clarity: Specification of multiple constructs of role ambiguity and a structural equation model of their antecedents and consequences. Journal of Applied Psychology, 77: 130-142.
33.
Schmitt, N. (1978). Path analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 2: 157-173.
34.
Schmitt, N. & Stults, D.M. (1986). Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10: 1-22.
35.
Seashore, S.E., Lawler, E.E., Mirvis, P. & Cammann, C. (1982). Observing and measuring organizational change: A guide to field practice. NY: John Wiley.
36.
Smith, C.S., Tisak, J. & Schmieder, R.A. (1993). The measurement properties of the role conflict and role ambiguity scales: A review and extension of the empirical research. Journal of Organizational Behavior, 14: 37-48.
37.
Spector, P. (1992). A consideration of the validity and meaning of self-report measures of job conditions. Pp. 123-151 in C.L. Cooper & LT. Robertson (eds.), International review of industrial and organizational psychology, Vol. 7. New York: Wiley.
38.
Tracy, L. & Johnson, T.W. (1981). What do the role conflict and role ambiguity scales measure?Journal of Applied Psychology, 66: 464-469.
Williams, L., Anderson, S. & Williams, M. (1992). A comparison of two approaches to reverse coding effecfs with role stress measures. Unpublished paper.
41.
Williams. L. & Brown. B.K. (1994). Method variance in organizational behavior and human resources, research: Effects on correlations, path coefficients, and hypothesis testing. Organizational Behavior and Human Decision Processes, 57: 185-209.
42.
Williams, L.J., Cote, J.A. & Buckley, M.R. (1989). Lack of method variance in self-reported affect and perceptions at work: Reality or artifact?Journal of Applied Psychology, 74: 462-468.
43.
Williams, L.J. & James, L.R. (In Press). Causal models in organizational behavior research: From path analysis to LISREL and beyond. In J. Greenberg (ed.), Organizational behavior: T’he state of thescience. Hillsdale, NJ: Lawrence Erlbaum Associates.
44.
Zerbe, W.J. & Paulhus, D.L. (1987). Socially desirable responding in organizational behavior: A reconception. Academy of Management Review, 12: 250-264.
