Team-Member Role Characteristics as Predictors of Response Behavior on Team-Related Surveys

Abstract

Although substantive research examining work teams continues to grow, methodological research examining the collection of team survey data lags behind substantive progress. To address this research gap, we test how individual and team characteristics affect one’s likelihood of completing a team survey. Using multilevel ordinal logistic regression analysis of human resources information systems data and survey responses from 3,403 clinical staff within 900 multidisciplinary healthcare teams, we found that time dedicated to the team, leadership status, and team size relate to response behavior, with differential effects for men and women. We discuss implications for team research in real-world organizational contexts.

Keywords

survey nonresponse team composition team research methods survey research

Get full access to this article

View all access options for this article.

References

Allen

N. J.

Stanley

D. J.

Williams

H. M.

Ross

S. J.

(2007). Assessing the impact of nonresponse on work group diversity effects. Organizational Research Methods, 10(2), 262–286. https://doi.org/10.1177%2F1094428106%2F294731

Alnuaimi

O. A.

Robert

L. P.

Maruping

L. M.

(2010). Team size, dispersion, and social loafing in technology-supported teams: A perspective on the theory of moral disengagement. Journal of Management Information Systems, 27(1), 203–230. https://doi.org/10.2753/MIS0742-1222270109

Anseel

Lievens

Schollaert

Choragwicka

(2010). Response rates in organizational science, 1995–2008: A meta-analytic review and guidelines for survey researchers. Journal of Business and Psychology, 25(3), 335–349. https://doi.org/10.1007/s10869-010-9157-6

Atwater

L. E.

Carey

J. A.

Waldman

D. A.

(2001). Gender and discipline in the workplace: Wait until your father gets home. Journal of Management, 27(5), 537–561. https://doi.org/10.1177/014920630102700503

Azjen

(1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. https://doi.org/10.1016/0749-5978(91)90020-T

Barr

C. D.

Spitzmüller

Stuebing

K. K.

(2008). Too stressed out to participate? Examining the relation between stressors and survey response behavior. Journal of Occupational Health Psychology, 13(3), 232–243. https://doi.org/10.1037/1076-8998.13.3.232

Baruch

Holtom

B. C.

(2008). Survey response rate levels and trends in organizational research. Human Relations, 61(8), 1139–1160. https://doi.org/10.1177/0018726708094863

Brescoll

V. L.

Uhlmann

E. L.

(2008). Can an angry woman get ahead? Status conferral, gender, and expression of emotion in the workplace. Psychological Science, 19(3), 268–275. https://doi.org/10.1037/e514412014-379

Breugst

Preller

Patzelt

Shepherd

D. A.

(2018). Information reliability and team reflection as contingencies of the relationship between information elaboration and team decision quality. Journal of Organizational Behavior, 39(10), 1314–1329. https://doi.org/10.1002/job.2298

10.

Campion

M. A.

Medsker

G. J.

Higgs

A. C.

(1993). Relations between work group characteristics and effectiveness: Implications for designing effective work groups. Personnel Psychology, 46(4), 823–847. https://doi.org/10.1111/j.1744-6570.1993.tb01571.x

11.

Cascio

W. F.

(2012). Methodological issues in international HR management research. The International Journal of Human Resource Management, 23(12), 2532–2545. https://doi.org/10.1080/09585192.2011.561242

12.

Crawford

E. R.

Lepine

J. A.

(2013). A configural theory of team processes: Accounting for the structure of taskwork and teamwork. Academy of Management Review, 38(1), 32–48. https://doi.org/10.5465/amr.2011.0206

13.

Cycyota

C. S.

Harrison

D. A.

(2006). What (not) to expect when surveying executives: A meta-analysis of top manager response rates and techniques over time. Organizational Research Methods, 9(2), 133–160. https://doi.org/10.1177/1094428105280770

14.

Debus

M. E.

Fritz

Philipp

(2019). A story of gains and losses: Intra-individual shifts in job characteristics and well-being when transitioning to a managerial role. Journal of Business and Psychology, 34(5), 637–655. https://doi.org/10.1007/s10869-018-9604-3

15.

Demerouti

Bakker

A. B.

Nachreiner

Schaufeli

W. B.

(2001). The job demands-resources model of burnout. Journal of Applied psychology, 86(3), 499–512. https://doi.org/10.1037/0021-9010.86.3.499

16.

Den Hartog

D. N.

De Hoogh

A. H.

Keegan

A. E

. (2007). The interactive effects of belongingness and charisma on helping and compliance. Journal of Applied Psychology, 92(4), 1131–1139. https://doi.org/10.1037/0021-9010.92.4.1131

17.

Eagly

A. H.

(2004). Few women at the top: How role incongruity produces prejudice and the glass ceiling. In Knippenberg

D. V.

Hogg

M. A.

(Eds.), Leadership and power: Identity processes in groups and organizations (pp. 79–93). SAGE.

18.

Eagly

A. H.

Karau

S. J.

(1991). Gender and the emergence of leaders: A meta-analysis. Journal of Personality and Social Psychology, 60(5), 685–710. https://doi.org/10.1037/0022-3514.60.5.685

19.

Eagly

A. H.

Karau

S. J.

(2002). Role congruity theory of prejudice toward female leaders. Psychological Review, 109(3), 573–598. https://doi.org/10.1037/0033-295X.109.3.573

20.

Eagly

A. H.

Makhijani

M. G.

Klonsky

B. G.

(1992). Gender and the evaluation of leaders: A meta-analysis. Psychological Bulletin, 111(1), 3–22. https://doi.org/10.1037/0033-2909.111.1.3

21.

Eagly

A. H.

Nater

Miller

D. I.

Kaufmann

Sczesny

(2020). Gender stereotypes have changed: A cross-temporal meta-analysis of U.S. public opinion polls from 1946 to 2018. American Psychologist, 75(3), 301–315. https://doi.org/10.1037/amp0000494

22.

Earp

Haziza

(2018). Comparison of weighting procedures in the presence of unit nonresponse: A simulation study based on data from the American Time Use Survey. U.S. Bureau of Labor Statistics, Office of Survey Methods Research. https://stats.bls.gov/osmr/research-papers/2018/pdf/st180130.pdf

23.

Edmondson

C. V.

(2006). Organizational surveys: A system for employee voice. Journal of Applied Communication Research, 34(4), 307–310. https://doi.org/10.1080/00909880600908526

24.

Ene

Leighton

E. A.

Blue

G. L.

Bell

B. A.

(2015, April 26–29). Multilevel models for categorical data using SAS PROC GLIMMIX: The basics [Paper presentation]. SAS Global Forum 2015 Proceedings, Dallas, TX, (pp. 1–12). https://support.sas.com/resources/papers/proceedings15/3430-2015.pdf

25.

Fauth

Hattrup

Mueller

Roberts

(2013). Nonresponse in employee attitude surveys: A group-level analysis. Journal of Business and Psychology, 28(1), 1–16. http://doi.org/10.1007%2Fs10869-012-9260-y

26.

Frame

M. C.

Roberto

K. J.

Schwab

A. E.

Harris

C. T.

(2010). What is important on the job? Differences across gender, perspective, and job level. Journal of Applied Social Psychology, 40(1), 36–56. https://doi.org/10.1111/j.1559-1816.2009.00562.x

27.

Fulton

B. R.

(2018). Organizations and survey research: Implementing response enhancing strategies and conducting nonresponse analyses. Sociological Methods & Research, 47(2), 240–276. https://doi.org/10.1177%2F0049124115626169

28.

Gladstein

D. L.

(1984). Groups in context: A model of task group effectiveness. Administrative Science Quarterly, 29(4), 499–517. https://doi.org/10.2307/2392936

29.

Graham

J. W.

(2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576. https://doi.org/10.1146/annurev.psych.58.110405.085530

30.

Groves

R. M.

(2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 646–675. https://doi.org/10.1093/poq/nfl033

31.

Groves

R. M.

Presser

Dipko

(2004). The role of topic interest in survey participation decisions. Public Opinion Quarterly, 68(1), 2–31. https://doi.org/10.1093/poq/nfh002

32.

Guzzo

R. A.

Salas

(1995). Team effectiveness and decision making in organizations. Jossey-Bass.

33.

Hackman

J. R.

(2002). Leading teams: Setting the stage for great performances. Harvard Business Press.

34.

Heggestad

E. D.

Rogelberg

Goh

Oswald

F. L.

(2015). Considering the effects of nonresponse on correlations between surveyed variables. Journal of Personnel Psychology, 14(2), 91–103. https://doi.org/10.1027/1866-5888/a000129

35.

Hollenbeck

J. R.

Beersma

Schouten

M. E.

(2012). Beyond team types and taxonomies: A dimensional scaling conceptualization for team description. Academy of Management Review, 37(1), 82–106. https://doi.org/10.5465/amr.2010.0181

36.

Huang

J. L.

Curran

P. G.

Keeney

Poposki

E. M.

DeShon

R. P.

(2012). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology, 27(1), 99–114. https://doi.org/10.1007/s10869-011-9231-8

37.

Jussim

Eccles

Madon

(1996). Social perception, social stereotypes, and teacher expectations: Accuracy and the quest for the powerful self-fulfilling prophecy. Advances in Experimental Social Psychology, 28, 281–388. https://doi.org/10.1016/S0065-2601(08)60240-3

38.

Kidder

D. L.

(2002). The influence of gender on the performance of organizational citizenship behaviors. Journal of Management, 28(5), 629–648. https://doi.org/10.1177/014920630202800504

39.

Knudsen

H. K.

Ducharme

L. J.

Roman

P. M.

(2009). Turnover intention and emotional exhaustion” at the top”: Adapting the job demands-resources model to leaders of addiction treatment organizations. Journal of Occupational Health Psychology, 14(1), 84–95. https://doi.org/10.1037/a0013822

40.

Kozlowski

S. W.

Chao

G. T.

(2018). Unpacking team process dynamics and emergent phenomena: Challenges, conceptual advances, and innovative methods. American Psychologist, 73(4), 576–592. https://doi.org/10.1037/amp0000245

41.

Latane

Williams

Harkins

(1979). Many hands make light the work: The causes and consequences of social loafing. Journal of Personality and Social Psychology, 37(6), 822–832. https://doi.org/10.1037/amp0000245

42.

Laughlin

Anderson

Martinez

Gayfield

(2021, April 5). Who are our health care workers? U.S. Census Bureau. https://www.census.gov/library/stories/2021/04/who-are-our-health-care-workers.html

43.

LeBreton

J. M.

Senter

J. L.

(2008). Answers to 20 questions about interrater reliability and interrater agreement. Organizational Research Methods, 11(4), 815–852. https://doi.org/10.1177/1094428106296642

44.

Levine

J. M.

Moreland

R. L.

(1998). Small groups: An overview. In Gilbert

Fiske

Lindzey

(Eds.), Handbook of social psychology (pp. 415–469). McGraw-Hill.

45.

Liang

Shu

Farh

C. I. C.

(2019). Differential implications of team member promotive and prohibitive voice on innovation performance in research and development project teams: A dialectic perspective. Journal of Organizational Behavior, 40(1), 91–104. https://doi.org/10.1002/job.2325

46.

Luciano

M. M.

Bartels

A. L.

D’Innocenzo

Maynard

M. T.

Mathieu

J. E.

(2018). Shared team experiences and team effectiveness: Unpacking the contingent effects of entrained rhythms and task characteristics. Academy of Management Journal, 61(4), 1403–1430. https://doi.org/10.5465/amj.2016.0828

47.

Maloney

M. M.

Johnson

S. G.

Zellmer-Bruhn

M. E.

(2010). Assessing group-level constructs under missing data conditions: A Monte Carlo simulation. Small Group Research, 41(3), 281–307. https://doi.org/10.1177%2F1046496410363829

48.

Mathieu

J. E.

Hollenbeck

J. R.

van Knippenberg

Ilgen

D. R.

(2017). A century of work teams in the Journal of Applied Psychology. Journal of Applied Psychology, 102(3), 452–467. https://doi.org/10.1037/apl0000128

49.

Mathieu

J. E.

Wolfson

M. A.

Park

(2018). The evolution of work team research since Hawthorne. American Psychologist, 73(4), 308–321. https://doi.org/10.1037/amp0000255

50.

McCullagh

(1980). Regression models for ordinal data. Journal of the Royal Statistical Society, Series B, 42(2), 109–142. https://doi.org/10.1111/j.2517-6161.1980.tb01109.x

51.

McGrath

J. E.

(1984). Groups: Interaction and performance (Vol. 14). Prentice-Hall.

52.

Mesch

D. J.

Brown

M. S.

Moore

Z. I.

Hayat

A. D.

(2011). Gender differences in charitable giving. International Journal of Nonprofit and Voluntary Sector Marketing, 16(4), 342–355. https://doi.org/10.1002/nvsm.432

53.

Newman

D. A.

(2014). Missing data: Five practical guidelines. Organizational Research Methods, 17(4), 372–411. https://doi.org/10.1177%2F1094428114548590

54.

Okhuysen

G. A.

Bechky

B. A.

(2009). Coordination in organizations: An integrative perspective. Academy of Management Annals, 3(1), 463–502. https://doi.org/10.5465/19416520903047533

55.

O’Leary

M. B.

Mortensen

Woolley

A. W.

(2011). Multiple team membership: A theoretical model of its effects on productivity and learning for individuals and teams. Academy of Management Review, 36(3), 461–478. https://doi.org/10.5465/amr.2009.0275

56.

O’Reilly

C. A.

Roberts

K. H.

(1977). Task group structure, communication, and effectiveness in three organizations. Journal of Applied Psychology, 62(6), 674–681. https://doi.org/10.1037/0021-9010.62.6.674

57.

Porter

S. R.

Whitcomb

M. E.

(2005). Non-response in student surveys: The role of demographics, engagement and personality. Research in Higher Education, 46(2), 127–152. http://doi.org/10.1007%2Fs11162-004-1597-2

58.

Porter

S. R.

Whitcomb

M. E.

Weitzer

W. H.

(2004). Multiple surveys of students and survey fatigue. New Directions for Institutional Research, 2004(121), 63–73. https://doi.org/10.1002/ir.101

59.

Rapp

T. L.

Mathieu

J. E.

(2019). Team and individual influences on members’ identification and performance per membership in multiple team membership arrangements. Journal of Applied Psychology, 104(3), 303–320. https://doi.org/10.1037/apl0000344

60.

Raudenbush

S. W.

Bryk

A. S.

(2002). Hierarchical linear models: Applications and data analysis methods. SAGE.

61.

Rogelberg

S. G.

Conway

J. M.

Sederburg

M. E.

Spitzmüller

Aziz

Knight

W. E.

(2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88(6), 1104–1114. https://doi.org/10.1037/0021-9010.88.6.1104

62.

Rogelberg

S. G.

Luong

(1998). Nonresponse to mailed surveys: A review and guide. Current Directions in Psychological Science, 7(2), 60–65. https://doi.org/10.1111/1467-8721.ep13175675

63.

Rogelberg

S. G.

Luong

Sederburg

M. E.

Cristol

D. S.

(2000) Employee attitude surveys: Examining the attitudes of noncompliant employees. Journal of Applied Psychology, 85(2), 284–293. https://doi.org/10.1037/0021-9010.85.2.284

64.

Rogelberg

S. G.

Stanton

J. M.

(2007). Introduction: Understanding and dealing with organizational survey nonresponse. Organizational Research Methods, 10(2), 195–209. https://doi.org/10.1177/1094428106294693

65.

Roose

Lievens

Waege

(2007). The joint effect of topic interest and follow-up procedures on the response in a mail questionnaire: An empirical test of the leverage-saliency theory in audience research. Sociological Methods & Research, 35(3), 410–428. https://doi.org/10.1177/0049124106290447

66.

Rosette

A. S.

Tost

L. P.

(2010). Agentic women and communal leadership: How role prescriptions confer advantage to top women leaders. Journal of Applied Psychology, 95(2), 221–235. https://doi.org/10.1037/a0018204

67.

Rudman

L. A.

(1998). Self-promotion as a risk factor for women: The costs and benefits of counterstereotypical impression management. Journal of Personality and Social Psychology, 74(3), 629–645. https://doi.org/10.1037/0022-3514.74.3.629

68.

Rudman

L. A.

Moss-Racusin

C. A.

Phelan

J. E.

Nauts

(2012). Status incongruity and backlash effects: Defending the gender hierarchy motivates prejudice against female leaders. Journal of Experimental Social Psychology, 48(1), 165–179. https://doi.org/10.1016/j.jesp.2011.10.008

69.

Sax

L. J.

Gilmartin

S. K.

Bryant

A. N.

(2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44(4), 409–432. https://doi.org/10.1023/A:1024232915870

70.

Schafer

J. L.

Graham

J. W.

(2002). Missing data: Our view of the state of the art. Psychological Methods, 7(2), 147–177. https://doi.org/10.1037/1082-989X.7.2.147

71.

Snyder

Tanke

E. D.

Berscheid

(1977). Social perception and interpersonal behavior: On the self-fulfilling nature of social stereotypes. Journal of Personality and Social Psychology, 35(9), 656–666. https://doi.org/10.1037/0022-3514.35.9.656

72.

Spitzmüller

Glenn

D. M.

Barr

C. D.

Rogelberg

S. G.

Daniel

(2006). “If you treat me right, I reciprocate”: Examining the role of exchange in organizational survey response. Journal of Organizational Behavior, 27(1), 19–35. https://doi.org/10.1002/job.363

73.

Spitzmüller

Glenn

D. M.

Sutton

M. M.

Barr

C. D.

Rogelberg

S. G.

(2007). Survey nonrespondents as bad soldiers: Examining the relationship between organizational citizenship and survey response behavior. International Journal of Selection and Assessment, 15(4), 449–459. https://doi.org/10.1111/j.1468-2389.2007.00403.x

74.

Tannenbaum

S. I.

Mathieu

J. E.

Salas

Cohen

(2012). Teams are changing: Are research and practice evolving fast enough? Industrial and Organizational Psychology, 5(1), 2–24. https://doi.org/10.1111/j.1754-9434.2011.01396.x

75.

Thompson

L. F.

Surface

E. A.

(2007). Employee surveys administered online: Attitudes toward the medium, nonresponse, and data representativeness. Organizational Research Methods, 10(2), 241–261. https://doi.org/10.1177%2F1094428106%2F294696

76.

Tierney

Kadane

J. B.

(1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81, 82–86. https://doi.org/10.1080/01621459.1986.10478240

77.

Underwood

Kim

Matier

(2000, May 21–24). To mail or to web: Comparisons of survey response rates and respondent characteristics (AIR 2000 Annual Forum Paper). AIR. https://eric.ed.gov/?id=ED446513

78.

Van de Brake

H. J.

Walter

Rink

F. A.

Essens

P. J. M. D.

van der Vegt

G. S.

(2018). The dynamic relationship between multiple team membership and individual job performance in knowledge-intensive work. Journal of Organizational Behavior, 39(9), 1219–1231. https://doi.org/10.1002/job.2260

79.

Van de Brake

H. J.

Walter

Rink

F. A.

Essens

P. J. M. D.

van der Vegt

G. S.

(2020). Multiple team membership and job performance: The role of employees’ information-sharing networks. Journal of Occupational and Organizational Psychology, 93(4), 967–987. https://doi.org/10.1111/joop.12326

80.

Van der Vegt

G. S.

Van de Vliert

Oosterhof

. (2003). Informational dissimilarity and organizational citizenship behavior: The role of intrateam interdependence and team identification. Academy of Management Journal, 46(6), 715–727. https://doi.org/10.5465/30040663

81.

Van Knippenberg

Mell

J. N

. (2016). Past, present, and potential future of team diversity research: From compositional diversity to emergent diversity. Organizational Behavior and Human Decision Processes, 136, 135–145. https://doi.org/10.1016/j.obhdp.2016.05.007

82.

Van Knippenberg

Nishii

L. H.

Dwertmann

D. J. G

. (2020). Synergy from diversity: Managing team diversity to enhance performance. Behavioral Science & Policy, 6(1), 75–92. https://doi.org/10.1353/bsp.2020.0007

83.

Wang

J. J.

Bartlett

Ryan

(2017). On the impact of nonresponse in logistic regression: Application to the 45 and Up study. BMC Medical Research Methodology, 17(1), 1–13. https://doi.org/10.1186/s12874-017-0355-z

84.

Weiner

S. P.

Dalessio

A. T.

(2006). Oversurveying: Causes, consequences, and cures. In Kraut

A. I.

(Ed.), Getting action from organizational surveys: New concepts, methods, and applications (pp. 294–311). Jossey-Bass.

85.

Wood

R. E.

(1986). Task complexity: Definition of the construct. Organizational Behavior and Human Decision Processes, 37(1), 60–82. https://doi.org/10.1016/0749-5978(86)90044-0