The authors reviewed recently published research on small groups and teams to understand how within-team nonresponse is reported and handled. They used Monte Carlo simulation to investigate how data-handling choices affect measurement reliability and hypothesis testing under conditions of random and systematic nonresponse. More complete reporting of nonresponse is recommended by the authors, and they propose guidelines for analyzing team-level constructs using data from teams without full response.
Studies included in the literature review are noted with an asterisk.
2.
*Adams, S.J., Roch, S.G., & Ayman, R. ( 2005). Communication medium and member familiarity: The effects on decision time, accuracy, and satisfaction. Small Group Research, 36, 321-353.
3.
Allen, N.J., Williams, H., Stanley, D.J., & Ross, S.J. ( 2007). Assessing dissimilarity relations under missing data conditions: Evidence from computer simulations. Journal of Applied Psychology, 92, 1414-1426.
4.
*Ayoko, O.B., Callan, V.J., & Hãrtel, C.E.J. (2008). The influence of team emotional intelligence climate on conflict and team members’ reactions to conflict. Small Group Research, 39, 121-149.
5.
*Baker, D.F. ( 2001). The development of collective efficacy in small task groups. Small Group Research, 32, 451-474.
6.
*Barrick, M.R., Bradley, B.H., Kristof-Brown, A.L., & Colbert, A.E. ( 2007). The moderating role of top management team interdependence: Implications for real teams and working groups. Academy of Management Journal, 50, 544-557.
7.
Beal, D.J., Cohen, R.R., Burke, M.J., & McLendon, C.L. (2003). Cohesion and performance in groups: A meta-analytic clarification of construct relations. Journal of Applied Psychology, 88, 989-1004.
8.
*Behfar, K.J., Peterson, R.S., Mannix, E.A., & Trochim, W.M.K. (2008). The critical role of conflict resolution in teams: A close look at the links between conflict type, conflict management strategies, and team outcomes. Journal of Applied Psychology, 93, 170-188.
9.
Bliese, P.D. ( 2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.
10.
*Bunderson, J.S., & Sutcliffe, K.M. (2002). Comparing alternative conceptualizations of functional diversity in management teams: Process and performance effects . Academy of Management Journal, 45, 875-893.
11.
*Bunderson, J.S., & Sutcliffe, K.M. (2003). Management team learning orientation and business unit performance. Journal of Applied Psychology, 88, 552-560.
12.
*Carson, J.B., Tesluk, P.E., & Marrone, J.A. ( 2007). Shared leadership in teams: An investigation of antecedent conditions and performance. Academy of Management Journal , 50, 1217-1234.
13.
Chan, D. ( 1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
14.
*Chansler, P.A., Swamidass, P.M., & Cammann, C. ( 2003). Self-managing work teams: An empirical study of group cohesiveness in "natural work groups" at a Harley-Davidson motor company plant . Small Group Research, 34, 101-120.
15.
*Chen, G. ( 2005). Newcomer adaptation in teams: Multilevel antecedents and outcomes. Academy of Management Journal, 48, 101-116.
16.
*Chen, Z., Lam, W., & Zhong, J.A. ( 2007). Leader-member exchange and member performance: A new look at individual-level negative feedback-seeking behavior and team-level empowerment climate. Journal of Applied Psychology, 92, 202-212.
17.
*Cummings, J.N. ( 2004). Work groups, structural diversity, and knowledge sharing in a global organization. Management Science, 50, 352-364.
18.
*De Dreu, C.K.W. ( 2007). Cooperative outcome interdependence, task reflexivity, and team effectiveness: A motivated information processing perspective. Journal of Applied Psychology, 92, 628-638.
19.
Edmondson, A. ( 1999). Psychological safety and learning behavior in work teams . Administrative Science Quarterly, 44, 350-383.
20.
*Eisenbeiss, S.A., van Knippenberg, D., & Boerner, S. ( 2008). Transformational leadership and team innovation: Integrating team climate principles. Journal of Applied Psychology, 93, 1438-1446.
21.
*Faraj, S., & Sproull, L. ( 2000). Coordinating expertise in software development teams . Management Science, 46, 1554-1568.
22.
*Gastil, J., Burkhalter, S., & Black, L.W. ( 2007). Do juries deliberate?Small Group Research , 38, 337-359.
23.
*Gibson, C.B. ( 2003). Quality of team service. Small Group Research, 34, 619-646.
24.
*Gibson, C.B., & Vermeulen, F. ( 2003). A healthy divide: Subgroups as a stimulus for team learning behavior. Administrative Science Quarterly, 48, 202-239.
25.
*Gilson, L.L., Mathieu, J.E., Shalley, C.E., & Ruddy, T.M. ( 2005). Creativity and standardization: Complementary or conflicting drivers of team effectiveness? Academy of Management Journal , 48, 521-531.
26.
*Glomb, T.M., & Liao, H. ( 2003). Interpersonal aggression in work groups: Social influence, reciprocal, and individual effects. Academy of Management Journal, 46, 486-496.
27.
*Hardin, A.M., Fuller, M.A., & Valacich, J.S. (2006). Measuring group efficacy in virtual teams: New questions in an old debate. Small Group Research, 37, 65-85.
28.
*Hirschfeld, R.R., & Bernerth, J.B. (2008). Mental efficacy and physical efficacy at the team level: Inputs and outcomes among newly formed action teams. Journal of Applied Psychology, 93, 1429-1437.
29.
*Hirschfeld, R.R., Jordan, M.H., Feild, H.S., Giles, W.F., & Armenakis, A.A. (2005). Teams’ female representation and perceived potency as inputs to team outcomes in a predominantly male field setting. Personnel Psychology, 58, 893-924.
30.
Jehn, K.A., Northcraft, G.B., & Neale, M.A. ( 1999). Why differences make a difference: A field study of diversity, conflict, and performance in workgroups. Administrative Science Quarterly, 44, 741-763.
31.
*Jordan, M.H., Feild, H.S., & Armenakis, A.A. (2002). The relationship of group process variables and team performance: A team-level analysis in a field setting . Small Group Research, 33, 121-150.
32.
*Jung, D.I., & Sosik, J.J. ( 2002). Transformational leadership in work groups: The role of empowerment, cohesiveness, and collective-efficacy on perceived group performance . Small Group Research, 33, 313-336.
33.
*Kennedy, F.A., Loughry, M.L., Klammer, T.P., & Beyerlein, M.M. (2009). Effects of organizational support on potency in work teams. Small Group Research, 40, 72-93.
34.
*Kirkman, B.L., Rosen, B., Tesluk, P.E., & Gibson, C.B. ( 2004). The impact of team empowerment on virtual team performance: The moderating role of face-to-face interaction. Academy of Management Journal, 47, 175-192.
35.
*Kirkman, B.L., Tesluk, P.E., & Rosen, B. ( 2001). Assessing the incremental validity of team consensus ratings over aggregation of individual-level data in predicting team effectiveness . Personnel Psychology, 54, 645-667.
36.
Kozlowski, S.W.J., & Klein, K.J. ( 2000). A multilevel approach to theory and research in organizations: Contextual, temporal and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 3-90). San Francisco: Jossey-Bass.
37.
Lance, C.E., Butts, M.M., & Michels, L.C. ( 2006). The sources of four commonly reported cutoff criteria: What did they really say? Organizational Research Methods , 9, 202-220.
38.
*Langfred, C.W. ( 2000). Work-group design and autonomy. Small Group Research, 31, 54-70.
39.
*Langfred, C.W. ( 2004). Too much of a good thing? Negative effects of high trust and individual autonomy in self-managing teams. Academy of Management Journal, 47, 385-399.
40.
*Langfred, C.W. ( 2007). The downside of self-management: A longitudinal study of the effects of conflict on trust, autonomy, and task interdependence in self-managing teams. Academy of Management Journal, 50, 885-900.
41.
Lepine, J.A., Piccolo, R.F., Jackson, C.L., Mathieu, J.E., & Saul, J.R. ( 2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personnel Psychology, 61, 273-307.
42.
*Lewis, K. ( 2004). Knowledge and performance in knowledge-worker teams: A longitudinal study of transactive memory systems. Management Science, 50, 1519-1533.
43.
*Li, J., & Hambrick, D.C. (2005). Factional groups: A new vantage on demographic faultlines, conflict, and disintegration in work teams . Academy of Management Journal, 48, 794-813.
44.
*Lim, B.-C., & Ployhart, R.E. (2004). Transformational leadership: Relations to the five-factor model and team performance in typical and maximum contexts. Journal of Applied Psychology, 89, 610-621.
45.
Marks, M.A., Mathieu, J.E., & Zaccaro, S.J. ( 2001). A temporally based framework and taxonomy of team processes . Academy of Management Review, 26, 356-376.
46.
*Marrone, J.A., Tesluk, P.E., & Carson, J.B. ( 2007). A multilevel investigation of antecedents and consequences of team member boundary-spanning behavior. Academy of Management Journal, 50, 1423-1439.
47.
*Mason, C.M. ( 2006). Exploring the processes underlying within-group homogeneity . Small Group Research, 37, 233-270.
48.
*Mason, C.M., & Griffin, M.A. ( 2003). Identifying group task satisfaction at work. Small Group Research, 34, 413-442.
49.
*Mathieu, J.E., & Schulze, W. ( 2006). The influence of team knowledge and formal plans on episodic team process-performance relationships. Academy of Management Journal, 49, 605-619.
50.
*Meglino, B.M., Lester, S.W., & Korsgaard, M.A. (2002). The antecedents and consequences of group potency: A longitudinal investigation of newly formed work groups . Academy of Management Journal, 45, 352-368.
51.
*Naumann, S.E., & Bennett, N. ( 2002). The effects of procedural justice climate on work group performance. Small Group Research, 33, 361-377.
52.
*Neal, A., & Griffin, M.A. ( 2006). A study of the lagged relationships among safety climate, safety motivation, safety behavior, and accidents at the individual and group levels. Journal of Applied Psychology, 91, 946-953.
53.
Newman, D.A. ( 2003). Longitudinal modeling with randomly and systematically missing data: A simulation of ad hoc, maximum likelihood, and multiple imputation techniques. Organizational Research Methods, 6, 328-362.
54.
Newman, D.A. ( 2009). Missing data techniques and low response rates: The role of systematic nonresponse parameters. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 7-36). New York: Routledge.
55.
Newman, D.A., & Sin, H. P. (2009). How do missing data bias estimates of within-group agreement? Organizational Research Methods, 12, 113-147.
56.
*Paletz, S.B.F., Peng, K., Erez, M., & Maslach, C. ( 2004). Ethnic composition and its differential impact on group processes in diverse teams. Small Group Research, 35, 128-157.
57.
*Pescosolido, A.T. ( 2003). Group efficacy and group effectiveness: The effects of group efficacy over time on group performance and development. Small Group Research, 34, 20-42.
58.
*Polzer, J.T., Crisp, C.B., Jarvenpaa, S.L., & Kim, J.W. ( 2006). Extending the faultline model to geographically dispersed teams: How colocated subgroups can impair group functioning. Academy of Management Journal, 49, 679-692.
59.
*Price, K.H., Harrison, D.A., Gavin, J.H., & Florey, A.T. ( 2002). Time, teams, and task performance: Changing effects of surface- and deep-level diversity on group functioning. Academy of Management Journal, 45, 1029-1045.
60.
*Raver, J.L., & Gelfand, M.J. ( 2005). Beyond the individual victim: Linking sexual harassment, team processes, and team performance. Academy of Management Journal, 48, 387-400.
61.
Rogelberg, S.G., Convey, J.M., Sederburg, M.E., Spitzmuller, C., Aziz, S., & Knight, W.E. ( 2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88, 1104-1114.
62.
Rogelberg, S.G., & Stanton, J.M. ( 2007). Introduction understanding and dealing with organizational survey nonresponse. Organizational Research Methods, 10, 195-209.
63.
Roth, P.L., & BeVier, C.A. (1998). Response rates in HRM/OB survey research: Norms and correlates, 1990-1994. Journal of Management, 24, 97-117.
64.
*Schaubroeck, J., Lam, S.S.K., & Cha, S.E. ( 2007). Embracing transformational leadership: Team values and the impact of leader behavior on team performance. Journal of Applied Psychology, 92, 1020-1030.
65.
*Schneider, B., Ehrhart, M.G., Mayer, D.M., Saltz, J.L., & Niles-Jolly, K. (2005). Understanding organization-customer links in service settings. Academy of Management Journal, 48, 1017-1032.
66.
*Spink, K.S., Nickel, D., Wilson, K., & Odnokon, P. ( 2005). Using a multilevel approach to examine the relationship between task cohesion and team task satisfaction in elite ice hockey players . Small Group Research, 36, 539-554.
67.
*Srivastava, A., Bartol, K.M., & Locke, E.A. ( 2006). Empowering leadership in management teams: Effects on knowledge sharing, efficacy, and performance. Academy of Management Journal, 49, 1239-1251.
68.
*Stewart, G.L., & Barrick, M.R. ( 2000). Team structure and performance: Assessing the mediating role of intrateam process and the moderating role of task type. Academy of Management Journal, 43, 135-148.
69.
*Van den Bossche, P., Gijselaers, W.H., Segers, M., & Kirschner, P.A. , (2006). Social and cognitive factors driving teamwork in collaborative learning environments: Team learning beliefs and behaviors. Small Group Research, 37, 490-521.
70.
* Van Der Vegt, G.S., & Bunderson, J.S. (2005). Learning and performance in multidisciplinary teams: The importance of collective team identification . Academy of Management Journal, 48, 532-547.
71.
*Van Der Vegt, G.S., Bunderson, J.S., & Oosterhof, A. ( 2006). Expertness diversity and interpersonal helping in teams: Why those who need the most help end up getting the least. Academy of Management Journal, 49, 877-893.
72.
*Van Der Vegt, G.S., Van De Vliert, E., & Oosterhof, A.A.D. (2003). Informational dissimilarity and organizational citizenship behavior: The role of intrateam interdependence and team identification. Academy of Management Journal, 46, 715-727.
73.
*Wageman, R. ( 2001). How leaders foster self-managing team effectiveness: Design choices versus hands-on coaching. Organization Science , 12, 559-577.
74.
*Webber, S.S. ( 2008). Development of cognitive and affective trust in teams . Small Group Research, 39, 746-769.
75.
*Wong, S.-S. ( 2004). Distal and local group learning: Performance trade-offs and tensions. Organization Science, 15, 645-656.
76.
*Yang, J., Mossholder, K.W., & Peng, T.K. ( 2007). Procedural justice climate and group power distance: An examination of cross-level interaction effects. Journal of Applied Psychology, 92, 681-692.
77.
*Zellmer-Bruhn, M. ( 2003). Interruptive events and team knowledge acquisition. Management Science, 49, 514-528.
78.
*Zellmer-Bruhn, M., & Gibson, C. ( 2006). Multinational organization context: Implications for team learning and performance. Academy of Management Journal , 49, 501-518.
79.
*Zellmer-Bruhn, M.E., Maloney, M.M., Bhappu, A.D., & Salvador, R. ( 2008). When and how do differences matter? An exploration of perceived similarity in teams. Organizational Behavior & Human Decision Processes, 107, 41-59.
