Restricted accessResearch articleFirst published online 1999-10
The Development of an Individual-Level Teamwork Expectations Measure and the Application of a Within-Group Agreement Statistic to Assess Shared Expectations for Teamwork
Two studies were conducted to develop a measurement system for assessing individual-level and shared team-level expectations for teamwork. Study 1 provided initial reliability and validity evidence using traditional scale development techniques and demonstrated how the individual-level measure could be applied to the team level using a within-group agreement statistic. Study 2 used intact teams and provided additional validity evidence by replicating the measure’s factor structure and demonstrating the relationship between the individual- and team-level construct and several team-related variables. Implications for future research and methods for studying teams are discussed.
Get full access to this article
View all access options for this article.
References
1.
Acton, W. H.
, Johnson, P. J., & Goldsmith, T. E. (1994). Structural knowledge assessment: Comparison of referent structures. Journal of Educational Psychology, 86, 303-311.
2.
Baker, D. P.
, & Salas, E. (1992). Principles for measuring teamwork skills. Human Factors, 34, 469-475.
3.
Bettenhausen, K. L.
(1991). Five years of groups research: What we have learned and what needs to be addressed. Journal of Management, 17, 345-381.
4.
Bliese, P. D.
, & Halverson, R. R. (1998). Group consensus and psychological well-being: A large field study. Journal of Applied Social Psychology, 28, 563-580.
5.
Brown, K. G.
, & Kozlowski, S. J. (1999, April). Dispersion theory: Moving beyond dichotomous conceptualizations of emergent organizational phenomena. Paper presented at the annual meeting of the Society of Industrial and Organizational Psychology, Atlanta, GA.
6.
Button, S. B.
, Mathieu, J. E., & Zajac, D. M. (1996). Goal orientation in organizational research: A conceptual and empirical foundation. Organizational Behavior and Human Decision Processes, 67, 26-48.
7.
Campion, M. A.
, Medsker, G. J., & Higgs, A. C. (1993). Relations between work group characteristics and effectiveness: Implications for designing effective work groups. Personnel Psychology, 46, 823-850.
8.
Campion, M. A.
, Papper, E. M., & Medsker, G. J. (1996). Relations between work team characteristics and effectiveness: A replication and extension. Personnel Psychology, 49, 429-452.
9.
Cannon-Bowers, J. A.
, & Salas, E. (1990, April). Cognitive psychology and team training: Shared mental models in complex systems. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Miami Beach, FL.
10.
Cannon-Bowers, J. A.
, Salas, E., & Converse, S. (1993). Shared mental models in expert team decision making. In N. J. Castellan (Ed.), Individual and group decision making (pp. 221-246). Hillsdale, NJ: Lawrence Erlbaum.
11.
Cannon-Bowers, J. A.
, Tannenbaum, S. I., Salas, E., & Volpe, C. E. (1995). Defining team competencies: Implications for training requirements and strategies. In R. Guzzo, E. Salas, & Associates (Eds.), Team effectiveness and decision making in organizations (pp. 333-380). San Francisco: Jossey-Bass.
12.
Carmines, E. G.
, & McIver, J. (1981). Analyzing models with unobserved variables: Analysis of covariance structures. In G. Bohrnstedt & E. Borgatta (Eds.), Social measurement: Current issues. Beverly Hills, CA: Sage.
13.
Chan, D.
(1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
14.
Cohen, S. G.
(1990). Hilltop hospital top management group. In J. R. Hackman (Ed.), Groups that work (and those that don’t) (pp. 56-77). San Francisco: Jossey-Bass.
15.
Costa, P. T., Jr.
, & McCrae, R. R. (1992). NEO PI-R: Professional manual. Odessa, FL: Psychological Assessment Resources.
16.
Cronbach, L. J.
, & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
17.
Davis-Sacks, M. L.
(1990). Credit analysis team. In J. R. Hackman (Ed.), Groups that work (and those that don’t) (pp. 309-329). San Francisco: Jossey-Bass.
18.
DeCarlo, L. T.
(1997). On the meaning and use of kurtosis. Psychological Methods, 2, 292-307.
19.
Dickinson, T. L.
, & McIntyre, R. M. (1997). A conceptual framework for teamwork measurement. In M. T. Brannick, E. Salas, & C. Prince (Eds.), Team performance assessment and measurement (pp. 19-43). Mahwah, NJ: Lawrence Erlbaum.
20.
Eisenstat, R. A.
(1990). Compressor team start-up. In J. R. Hackman (Ed.), Groups that work (and those that don’t) (pp. 411-426). San Francisco: Jossey-Bass.
21.
Fleishman, E. A.
, & Zaccaro, S. J. (1992). Toward a taxonomy of team performance functions. In R. W. Sweezey & E. Salas (Eds.), Teams: Their training and performance (pp. 31-56). Norwood, NJ: Ablex.
22.
George, J.
, Perkins, M., Sundstrom, E., & Meyers, S. (1990, September). Work team context development and effect in a manufacturing organization. Paper presented at the International Conference on Self-Managed Work Teams, Denton, TX.
23.
Gladstein, D. L.
(1984). Groups in context: A model of task group effectiveness. Administrative Science Quarterly, 29, 499-517.
24.
Goldsmith, T. E.
, Johnson, P. J., & Acton, W. H. (1991). Assessing structural knowledge. Journal of Educational Psychology, 83, 88-96.
25.
Hackman, J. R.
(Ed.). (1990). Groups that work (and those that don’t). San Francisco: Jossey-Bass.
26.
Hackman, J. R.
, & Morris, C. G. (1975). Group tasks, group interaction process, and group performance effectiveness: A review and proposed integration. Advances in Experimental Social Psychology, 8, 45-99.
27.
Hinkin, T. R.
(1995). A review of scale development practices in the study of organization. Journal of Management, 21, 967-988.
28.
Hinkin, T. R.
(1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104-121.
29.
Jackson, J.
(1965). Social stratification, social norms, and roles. In I. D. Steiner & M. Fishbein (Eds.), Current studies in social psychology (pp. 301-309). New York: Holt, Rinehart.
30.
James, L. A.
, & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning. Journal of Applied Psychology, 74, 739-751.
31.
James, L. R.
, Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
32.
Janz, B. D.
, Colquitt, J. A., & Noe, R. A. (1997). Knowledge worker team effectiveness: The role of autonomy, interdependence, team development, and contextual support variables. Personnel Psychology, 50, 877-904.
33.
Jöreskog, K. G.
, & Sörbom, D. (1998). LISREL 8. Chicago: Scientific Software.
34.
Keppel, G.
, & Zedeck, S. (1989). Data analysis for research designs. New York: W. H. Freeman.
35.
Klimoski, R.
, & Mohammed, S. (1994). Team mental model: Construct or metaphor?Journal of Management, 20, 403-437.
36.
Kraiger, K.
, Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78, 311-328.
37.
Kraiger, K.
, & Wenzel, L. H. (1997). Conceptual development and empirical evaluation of measures of shared mental models as indicators of team effectiveness. In M. T. Brannick, E. Salas, & C. Prince (Eds.), Team performance assessment and measurement (pp. 63-84). Mahwah, NJ: Lawrence Erlbaum.
38.
Lindell, M. K.
, & Brandt, C. J. (1997). Measuring interrater agreement for ratings of a single target. Applied Psychological Measurement, 21, 271-278.
39.
Lindell, M. K.
, Brandt, C. J., & Whitney, D. J. (1999). A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement, 23, 127-135.
40.
Mathieu, J. E.
, & Farr, J. L. (1991). Further evidence for the discriminant validity of measures of organizational commitment, job involvement, and job satisfaction. Journal of Applied Psychology, 76, 127-133.
41.
McIntyre, R. M.
, & Salas, E. (1995). Measuring and managing for team performance: Lessons from complex environments. In R. A. Guzzo, E. Salas, & Associates (Eds.), Team effectiveness and decision making in organizations (pp. 9-45). San Francisco: Jossey-Bass.
42.
Medsker, G. J.
, Williams, L. J., & Holahan, P. J. (1994). A review of current practices of evaluating causal models in organizational behavior and human resources management research. Journal of Management, 20, 439-464.
43.
Mischel, W.
(1981). Introduction to personality. New York: CBS College Publishing.
44.
Nivea, V. F.
, Fleishman, E. A., & Rieck, A. M. (1978). Team dimensions: Their identity, their measurement, and their relationships. Washington, DC: ARRO.
45.
Nunnally, J. C.
(1978). Psychometric theory. New York: McGraw-Hill.
46.
Pearce, J. L.
, & Gregersen H. B. (1991). Task interdependence and extrarole behavior: A test of the mediating effects of felt responsibility. Journal of Applied Psychology, 76, 838-844.
47.
Perkins, A. L.
, & Abramis, D. J. (1990). Midwest federal correctional institution. In J. R. Hackman (Ed.), Groups that work (and those that don’t) (pp. 309-329). San Francisco: Jossey-Bass.
48.
Porter, L. W.
, & Lawler, E. E. (1968). Managerial attitudes and performance. Homewood, IL: Irwin.
49.
Rentsch, J. R.
, & Hall, R. J. (1994). Members of great teams think alike: A model of team effectiveness and schema similarity among team members. Advances in the Interdisciplinary Studies of Work Teams, 1, 223-261.
50.
Rentsch, J. R.
, Heffner, T. S., & Duffy, L. T. (1994). What you know is what you get from experience. Group and Organization Management, 19, 450-474.
51.
Rotter, J. B.
(1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs, 80, 1-28.
52.
Saaverda, R.
(1990). Beer sales and delivery teams. In J. R. Hackman (Ed.), Groups that work (and those that don’t) (pp. 361-381). San Francisco: Jossey-Bass.
53.
Salas, E.
, Montero, R. C., Glickman, A. S., & Morgan, B. V. (1988, August). Group development, teamwork skills, and training. Paper presented at the meeting of the American Psychological Association, Atlanta, GA.
54.
SAS Institute
. (1985). SAS user’s guide: Basics. Cary, NC: Author.
55.
Seers, A.
(1989). Team-member exchange quality: A new construct for role-making research. Organizational Behavior and Human Decision Processes, 48, 118-135.
56.
Stevens, M. J.
, & Campion, M. A. (1994). The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management, 20, 503-530.
57.
Sundstrom, E. S.
, DeMeuse, K. P., & Futrell, D. (1990). Work teams: Application and effectiveness. American Psychologist, 45, 120-133.
58.
Walsh, J. P.
, Henderson, C. M., & Deighton, J. (1988). Negotiated belief structures and decision performance: An empirical investigation. Organizational Behavior and Human Decision Processes, 42, 194-216.
59.
Watson, D.
, Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 1063-1070.
60.
Whetten, D. A.
, & Cameron, K. S. (1995). Developing management skills. New York: Harper-Collins.
61.
Wickens, C. D.
(1984). Engineering psychology and human performance. Columbus, OH: Merrill.
