Over the past 25 years, teams have become the standard for scientific endeavors. Team science is a collaborative and interdisciplinary approach to research that brings together diverse experts to solve problems that cannot be addressed by a single discipline. While disciplinary expertise is crucial, successful innovation in team science also depends on core competencies beyond individual skills. Competencies such as facilitating affect, team communication, managing research, collaborative problem-solving, and team leadership are vital for assessing both team readiness and ongoing competency development. However, evaluating these complex competencies remains a significant challenge for team leaders, members, and evaluators alike. Drawing on sensemaking as a theoretical grounding—emphasizing the adaptive use of experience in new environments—this article proposes a novel, multimodal conceptual model for evaluating team science effectiveness. The model presented offers an alternative approach to assessing these competencies by leveraging diverse observational lenses from the social sciences.
AckermanP.HeggestadE. (1997). Intelligence, personality, and interests: Evidence for overlapping traits. Psychological Bulletin, 12(2), 219–245. https://doi.org/10.1037/0033-2909.121.2.219
2.
AdamsS. K. (2007). Disciplinarily hetero-and homogeneous design team convergence: Communication patterns and perceptions of teamwork [Doctoral dissertation, Virginia Polytechnic Institute and State University].
3.
AdlerP.AdlerP. (1994). Observational techniques. In DenzinN.LincolnY. (Eds.), Handbook of qualitative research (pp. 377–392). Sage Publications, Inc.
4.
AldrupK.CarstensenB.KlusmannU. (2022). Is empathy the key to effective teaching? A systematic review of its association with teacher-student interactions and student outcomes. Educational Psychology Review, 34, 3 1177–1216. https://doi.org/10.1007/s10648-021-09649-y
5.
AlrøeH.NoeE. (2014). Second-Order science of interdisciplinary research a polyocular framework for wicked problems. Constructivist Foundations, 10(1), 65–95. https://doi.org/10.1111/soru.12078
6.
AngrosinoM. (2005). Recontextualizing observation: Ethnography, pedagogy, and the prospects for a progressive political agenda. In DenzinK.LincolnY. (Eds.), The Sage handbook of qualitative research (pp. 729–745). Sage Publications Ltd.
7.
AngrosinoM.Mays de PerezK. (2000). Rethinking observation: From method to context. In DenzinN. K.LincolnY. S. (Eds.), Handbook of qualitative research (pp. 373–702). Sage Thousand Oaks.
BadcockP.PattisonP.HarrisK. (2010). Developing generic skills through university study: A study of arts, science and engineering in Australia. Higher Education, 60(4), 441–458. https://doi.org/10.1007/s10734-010-9308-8
10.
BeebeJ. (2014). Rapid qualitative inquiry: A field guide to team-based assessment. Bloomsbury Publishing PLC.
11.
BrasierA.BurnsideE.RollandB. (2023). Competencies supporting high-performance translational teams: A review of the SciTS evidence base. Journal of Clinical and Translational Science, 7(1), E62. https://doi.org/10.1017/cts.2023.17
12.
BurkeC. S.DiazGranadosD.SalasE. (2011). Team leadership: A review and look ahead. In BrymanA. (Ed.), The Sage handbook of leadership (pp. 338–351). Sage.
13.
Cannon-BowersJ. A.TannenbaumS. I.SalasE.VolpeC. E. (1995). Defining competencies and establishing team training requirements. In Team effectiveness and decision making in organizations (pp. 333–380).
14.
Ciesielski, T. H., Aldrich, M. C., Marsit, C. J., Hiatt, R. A., & Williams, S. M. (2017). Transdisciplinary approaches enhance the production of translational knowledge. Translational Research, 182, 123–134.https://doi.org/10.1016/j.trsl.2016.11.002
15.
CreswellJ. W.PothC. N. (2018). Qualitative inquiry & research design choosing among 5 approaches. Sage.
16.
DauphineeW.BouletJ.NorciniJ. (2019). Considerations that will determine if competency-based assessment is a sustainable innovation. Advances in Health Sciences Education, 24, 413–421. https://doi.org/10.1007/s10459-018-9833-2
17.
DavenportT.ThomasR.CantrellS. (2002). The mysterious art and science of knowledge-worker performance. MIT Sloan Management Review, 44(1), 23–30.
18.
De SordiJ.AzevedoM.BianchiE.CarandinaT. (2021). Defining the term knowledge worker: Toward improved ontology and operationalization. Knowledge and Process Management, 28(1), 56–70. https://doi.org/10.1002/kpm.1647
19.
DesveauxL.HalkoR.MaraniH.FeldmanS.IversN. M. (2019). Importance of team functioning as a target of quality improvement initiatives in nursing homes: A qualitative process evaluation. Journal of Continuing Education in the Health Professions, 39(1), 21–28.
20.
De WeertE. (2007). Graduate employment in Europe: The employers’ perspective. In Careers of University Graduates: Views and experiences in comparative perspectives (pp. 225-246). Springer Netherlands.
21.
EwellP. (2007). Applying learning outcomes concepts to higher education: An overview. A report prepared for the University of Hong Kong Grants Committee. Boulder, Colorado: National Center for Higher Education Management Systems (NCHEMS).
22.
FioreS. (2008). Interdisciplinarity as teamwork: How the science of teams can inform team science. Small Group Research, 39, 251–277.
23.
FioreS.Vogel-WalcuttJ. (2010). Making metacognition explicit: Developing a theoretical foundation for metacognitive prompting during scenario-based training. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57(27), 2233–2237. https://doi.org/10.1177/154193121005402703
24.
HackmanJ. (2011). Collaborative intelligence: Using teams to solve hard problems. Berrett-Koehler Publishers, Inc.
25.
HallK.StokolsD.MoserR.TaylorB.ThornquistM.NebelingL., Ehret, C., Barnett, M., McTiernan, A., Berger, N., Goram, M., & JeffreyR. (2008). The collaboration readiness of transdisciplinary research teams and centers. American Journal of Preventive Medicine, 35(2S), S161–S181. https://doi.org/10.1016/j.amepre.2008.03.035
26.
HallK.VogelA.CroyleR. (2019). Strategies for team science success handbook of evidence-based principles for cross-disciplinary science and practical lessons learned from health researchers (1 ed.). Springer International Publishing.
27.
HartleF. (1995). Transforming the performance management process. Kogan Page.
HuberG. (1991). Organizational learning: The contributing processes and the literatures. Organization Science, 2(1), 88–115. https://doi.org/10.1287/orsc.2.1.88
30.
IanniP.SamuelsE.EakinB.PerorazioT.EllingrodV. (2021). Assessments of research competencies for clinical investigators: A systematic review. Evaluation & the Health Professions, 44(3), 268–278. https://doi.org/10.1177/0163278719896392
31.
JainR.TriandisH.WeickC. (2010). Managing research, development and innovation: Managing the unmanageable (3rd ed.). Wiley.
32.
KanferR.AckermanP. (2004). Aging, adult development, and work motivation. The Academy of Management Review, 29(3), 440–458. https://doi.org/10.2307/20159053
33.
KanferR.AckermanP. (2005). Work competence. In A. J. Elliot & C. S. Dweck (Eds.), Handbook of competence and motivation (pp. 336–353). Guilford.
KuhnC.Zlatkin-TroitschanskaiaO. (2011). Assessment of competencies among university students and graduates: Analyzing the state of research and perspectives. Johannes Gutenberg University.
36.
KulikowichM.AlexanderP. (2003). Cognitive assessment. In L. Nadel (Ed.), Encyclopedia of cognitive science (Vol. 1, pp. 526–532). Nature Publishing Group.
37.
KuziemskyC.BoryckiE.PurkisM.BlackF.BoyleM.Cloutier-FisherD., Fox, L., MacKenzie, P., Syme, A., Tschanz, C., Wainwright, W., & WongH. (2009). An interdisciplinary team communication framework and its application to healthcare ‘e-teams’ systems design. BMC Medical Informatics and Decision Making, 9(1), 43. https://doi.org/10.1186/1472-6947-9-43
38.
LafuenteE.Berbegal-MirabentJ. (2019). Contract employment policy and research productivity of knowledge workers: An analysis of Spanish universities. The International Journal of Human Resource Management, 30(16), 2360–2386. https://doi.org/10.1080/09585192.2017.1323226
LotrecchianoG. (2024). Collaboration readiness. In DarbellayF. (Ed.), Elgar encyclopedia of interdisciplinarity and transdisciplinarity (pp. 65–69). Edward Elgar Publishing.
41.
LotrecchianoG.DiazGranadosD.SprecherJ.McCormackW.RanwalaD.WootenK., … BrasierA. (2020). Individual and team competencies in translational teams. Journal of Clinical and Translational Science, 5(1), e72–e72. https://doi.org/10.1017/cts.2020.551
42.
LotrecchianoG.VovidesY.BennetL. (2023). A framework for developing team science expertise using a reflective-reflexive design method (R2DM). Nature Humanities and Social Scince Communication, 10(1), 1–12. https://doi.org/10.1057/s41599-023-02298-2
MarriageB.KinnearJ. (2016). Assessing team performance – Markers and methods. Trends in Anaesthesia and Critical Care, 7(8), 11–16. https://doi.org/10.1016/j.tacc.2016.05.002
45.
McAllisterD. (1995). Affect-based and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal, 38(1), 24–59.https://doi.org/10.2307/256727
46.
MendellA.KnerichV.RanwalaD.JonesC.PiechowskiP.StrileyC., McCormack, W., & CrossJ. (2024). Team science competencies across the career life course for translational science teams. Journal of Clinical and Translational Science, 8(1), e111. https://doi.org/10.1017/cts.2024.494
47.
Mesmer-MagnusJ. R.DeChurchL. A. (2009). Information sharing and team performance: A meta-analysis. Journal of Applied Psychology, 94(2), 535–546. https://doi.org/10.1037/a0013773
PrahaladC.BettisR. (1986). The dominant logic: A new linkage between diversity and performance. Strategic Management Journal, 7(7), 485–501. https://doi.org/10.1002/smj.4250070602
50.
Ring, P. S., & Rands, G. P. (1989). Sensemaking, understanding, and committing: Emergent interpersonal transaction processes in the evolution of 3M's micro–gravity research program. In A. H. Van de Ven, H. L. Angle, & M. S. Poole (Eds.), Research on the management of innovation: The Minnesota studies (pp. 337–366). Ballinger.
51.
RosenM.DiazGranadosD.DietzA.BenishekL. E.ThompsonD.PronovostP. J.WeaverS. (2018). Teamwork in healthcare: Key discoveries enabling safer, high-quality care. American Psychologist, 73(4), 433–450. https://doi.org/10.1037/amp0000298
52.
RychenD. (2004). Key competencies for all: An overarching conceptual frame of reference. Developing Key Competencies in Education: Some Lessons from International and National Experience. Paris: UNESCO International Bureau of Education (pp. 5–34).
53.
SackmanS. (1992). Culture and subcultures: An analysis of organizational knowledge. Administrative Science Quarterly, 37(1), 140–161. https://doi.org/10.2307/2393536
54.
Salas, E., Reyes, D., & Woods, A. (2017). The assessment of team performance: Observations and needs. In A. von Davier, M. Zhu, & P. Kyllonen (Eds.), Innovative assessment of collaboration. Methodology of educational measurement and assessment (pp. 21–36). Springer.
55.
SalasE.ReyesD.WoodsA. (2017). The assessment of team performance: Observations and needs. In von DavierA.ZhuM.KyllonenP. (Eds.), Innovative assessment of collaboration. Methodology of educational measurement and assessment (pp. 21–36). Springer.
56.
SchwandtD. (2005). When managers become philosophers: Integrating learning with sensemaking. Academy of Management Learning & Education, 4(2), 176–192. https://doi.org/10.5465/amle.2005.17268565
57.
SchwarzR.BennettL. (2021). Team effectiveness model for science (TEMS): Using a mutual learning shared mindset to design, develop, and sustain science teams. Journal of Clinical and Translational Science, 5(1), 157. https://doi.org/10.1017/cts.2021.824
58.
ShufflerM. L.DiazGranadosD.MaynardM. T.SalasE. (2018). Developing, sustaining, and maximizing team effectiveness: An integrative, dynamic perspective of team development interventions. Academy of Management Annals, 12(2), 688–724. https://doi.org/10.5465/annals.2016.0045
59.
SladeK.DaviesR.PenningtonC.PlackC.NuttallH. (2023). The impact of age and psychosocial factors on cognitive and auditory outcomes during the COVID-19 pandemic. Journal of Speech, Language, and Hearing Research, 66(9), 3689–3695. https://doi.org/10.1044/2023_JSLHR-22-00703
Sutton, L., Berdan, L. G., Bolte, J., Califf, R. M., Ginsburg, G. S., Li, J. S., McCall, J., Moen, R., Myers, B. S., Rodriquez, V., Veldman, T., & Boulware, L. E. (2019). Facilitating translational team science: The project leader model. Journal of Clinical and Translational Science, 3(4), 140–146. https://doi.org/10.1017/cts.2019.398
63.
ThomasJ. B.ClarkS.GioiaD. (1993). Strategic sensemaking and organizational performance: Linkages among scanning, interpretation, action, and outcomes. Academy of Management Journal, 36(2), 239–270. https://doi.org/10.2307/256522
64.
ThompsonJ. (1967). Organizations in action: Social science bases of administrative theory. McGraw Hill.
65.
ThompsonJ. (2009). Building collective communication competence in interdisciplinary research teams. Journal of Applied Communication Research, 37(3), 278–297. https://doi.org/10.1080/00909880903025911
66.
Van de VenA.PooleM. (1995). Explaining development and change in organizations. Academy of Management Review, 20(3), 510–540. https://doi.org/10.2307/258786
67.
WatermanA.SchwartzS.GoldbacherE.GreenH.MillerC.PhilipS. (2003). Predicting the subjective experience of intrinsic motivation: The roles of self-determination, the balance of challenges and skills, and self-realization values. Personality and Social Psychology Bulletin, 29(11), 1447–1458. https://doi.org/10.1177/0146167203256907
68.
WeaverS. J.LyonsR.DiazgranadosD.RosenM. A.SalasE.OglesbyJ.AugensteinJ. S.BirnbachD. J.RobinsonD.KingH. B. (2010). The anatomy of health care team training and the state of practice: A critical review. Academic Medicine: Journal of the Association of American Medical Colleges, 85(11), 1746–1760.
69.
WeickK. (1995). Sensemaking in organizations. In DobbinF. (Ed.), The new economic sociology: A reader (pp. 533–552). Princeton University Press.
70.
WeinertF. (2001). Concept of competence: A conceptual clarification. In SalganikD. R. L. (Ed.), Defining and selecting key competencies (pp. 45–65). Hogrefe & Huber Publishers.
71.
WengerE. (1997). Communities of practice: Learning, meaning and identity. Cambridge University Press.
ZhangC.MillerC.VolkmanK.MezaJ.JonesK. (2015). Evaluation of the team performance observation tool with targeted behavioral markers in simulation-based interprofessional education. Journal of Interprofessional Care, 29(3), 202–208. https://doi.org/10.3109/13561820.2014.982789
