Common methods variance that can result when two or more constructs are measured by a single rater or source was examined using Within and Between Analysis (WABA). Levels of analysis effects were assessed for single-source leadership and outcome ratings obtained using surveys completed by the followers of managers employed by a multidivisional Fortune 500 high technology organization. The alignment of singleand multiple-source effects with the analytic procedures, a critique of recommended procedures for addressing problems with single-source variance, an alternative conceptual framework, and strategies to address problems with research involving questionnaire! survey self-report measures are discussed.
Bass, B.M.1985. Leadership and performance beyond expectations. New York: Free Press.
3.
Bass, B.M., & Avolio, B.J.1989. Potential biases in leadership measures: How prototypes, leniency, and general satisfaction relate to ratings and rankings of transformational and transactional leadership constructs. Educational and Psychological Measurement, 49: 509-527.
Bass, B.M., Cascio, W.F., & O'Connor, E.1974. Magnitude estimations of frequency and amount. Journal of Applied Psychology, 59: 313-320.
6.
Brief, A.P., Burke, M.J., George, J.M., Robinson, B.S., & Webster, J.1988. Should negative affectivity remain an unmeasured variable in the study of job stress. Journal of Applied Psychology, 73: 193-198.
7.
Campbell, D.T., & Fiske, D.W.1959. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56: 81-105.
8.
Chapman, L.J., & Chapman, J.P.1967. Genesis of popular but erroneous psychodiagnostic observations. Journal of Abnormal Psychology, 73: 193-204.
9.
Chapman, L.J., & Chapman, J.P.1969. Illusory correlations as an obstacle to the use of valid psychodiagnostic signs. Journal of Abnormal Psychology, 74: 271-280.
10.
Dansereau, F., Alutto, J.A., & Yammarino, F.J.1984. Theory testing in organizational behavior: The varient approach. Englewood Cliffs, NJ: Prentice Hall.
11.
Dipboye, R.L., & Flanagan, M.F.1979. Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory?American Psychologist, 34: 141-150.
12.
Doty, D.H., & Glick, W.H. 1988. Method variance in I/O research: Major effect or mythical beast? Paper presented at the Society for Industrial and Organizational Psychology Conference, Dallas.
13.
Eden, D., & Leviatan, U.1975. Implicit leadership theory as a determinant of the factor structure underlying supervisory behavior scales. Journal of Applied Psychology, 60: 736-741.
14.
Feldman, J.M., & Lynch, J.G.1988. Self-generated validity and other effects of measurement in belief, attitude, intention, and behavior. Journal of Applied Psychology, 73: 421-435.
Glick, W.H., Jenkins, G.D., & Gupta, N.1986. Method versus substance: How strong are underlying relationships between job characteristics and attitudinal outcomes?Academy of Management Journal, 29: 441-464.
17.
Hater, J., & Bass, B.M.1988. Superiors' evaluations and subordinates' perceptions of transformational and transactional leadership. Journal of Applied Psychology, 73: 695-702.
18.
Lord, R.G., Foti, R.J., & Devader, C.1984. A test of leadership categorization theory: Internal structure, information processing and leadership perceptions. Organizational Behavioral and Human Performance, 34: 343-378.
19.
Lord, R.G., & Foti, R.J.1986. Schema theories, information processing and organizational behavior. In H.P. Sims, Jr., & D.A. Gioa (Eds.), The thinking organization: 20-48. San Francisco: Jossey-Bass.
20.
Lord, R.G., & Maher, K.J.1990. Alternative information processing models and their implications for theory, research and practices. Academy of Management Review, 15: 9-28.
21.
Markham, S.E.1988. Pay-for-performance dilemma revisited: Empirical example of the importance of group effects. Journal of Applied Psychology, 73: 172-180.
22.
Mitchell, T.R.1985. An evaluation of the validity of correlational research conducted in organizations. Academy of Management Review, 10: 192-205.
23.
Organ, D.W., & Podsakoff, P.M. 1988. Self-report confounds in organizational research: Felony or misdemeanor? Paper presented at the Society for Industrial and Organizational Psychology Conference, Dallas.
24.
Phillips, J.S., & Lord, R.G.1986. Notes on the practical and theoretical consequences of implicit leadership theories for the future of leadership measurement. Journal of Management, 12: 31-41.
25.
Podsakoff, P.M., & Organ, D.W.1986. Self-reports in organizational research: Problems and prospects. Journal of Management, 12: 531-544.
26.
Salancik, G.R., & Pfeffer, J.1977. An examination of need-satisfaction models of job attitudes. Administrative Science Quarterly, 22: 427-456.
27.
Salancik, G.R., & Pfeffer, J.1978. A social information processing approach to job attitudes and task design. Administrative Science Quarterly, 23: 224-253.
28.
Spangler, W.D.1988. A strategy for evaluating rater bias. Working Paper No. 88-20, School of Management, State University of New York at Binghamton.
29.
Spector, PE.1987. Method variance as an artifact in self-report affect and perceptions at work: Myth or significant problem?Journal of Applied Psychology, 72: 438-444.
30.
Spector, P.E., Dwyer, D.J., & Jex, S.J.1988. Relation of job stressors to affective, health, and performance outcomes: A comparison of multiple data sources. Journal of Applied Psychology, 73: 11-19.
31.
Watson, D.1988. The vicissitudes of mood measurement: Effects of varying descriptors, time frames and response formats on measures of positive and negative affect. Journal of Personality and Social Psychology, 55: 128-141.
32.
Williams, L.J., Cote, J.A., & Buckley, M.R., 1989. Lack of method variance in self-reported affect and perceptions at work: Reality or artifact?Journal of Applied Psychology, 74: 462-468.
33.
Yammarino, FJ., & Dubinsky, A.J.1990. Salesperson performance and managerially controllable factors: An investigation of individual and work group effects. Journal of Management, 16: 87-106.
34.
Yammarino, EJ., & Naughton, T.J.1988. Time spent communicating: A multiple levels of analysis approach. Human Relations, 41: 655-676.
