The National Academies recently issued a consensus study report summarizing the state of the art and research needs relating to Human-AI teaming, especially in the context of dynamic, high-risk environments such as multi-domain military operations. This consensus study was conducted by the National Academies Board on Human-Systems Integration (BOHSI). This panel, organized by BOHSI, brings together prominent researchers, including several members of the consensus committee, to discuss the state of the art and research frontiers for development of effective human-AI teams that can operate resiliently in complex, data intensive, and dynamically paced environments.
ArrowK. J. (1974). The Limits of Organization. W. W. Norton & Company.
3.
BeedeE.BaylorE.HerschF.IurchenkoA.WilcoxL.RuamviboonsukP.VardoulakisL. (2020). A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, April 25–30, Honolulu, HI, pp. 1–12.
4.
BhaskaraA., et al. (2021). Effect of automation transparency in the management of multiple unmanned vehicles. Applied Ergonomics, 90, 103243.
5.
BisantzA.RothE.M. (2008). Analysis of Cognitive Work. Pp. 1–43 in Reviews of Human Factors and Ergonomics, vol. 3 (Boehm-DavisD.A., ed.). Santa Monica, CA: Human Factors and Ergonomics Society.
6.
Boehm-DavisD.A.DursoF.T.LeeJ.D. (2015). APA Handbook of Human Systems Integration. Washington DC: American Psychological Association.
7.
CalhounG.BartikJ.RuffH., et al. Enabling human-autonomy teaming with multi-unmanned vehicle control interfaces. Hum.-Intell. Syst. Integr. 3, 155–174 (2021). https://doi.org/10.1007/s42454-020-00020-0
ChenJ. Y.BarnesM. J. (2014). Human-agent teaming for multirobot control: A review of human factors issues. IEEE Transactions on Human-Machine Systems, 44, 13–29.
10.
ChienS.LewisM.SycaraK.KumruA.LiuJ. (2020). Influence of culture, transparency, trust, and degree of automation on automation use. IEEE Transactions on Human-Machine Systems, 50, 205–214.
11.
ChiouE. K.LeeJ. D. (2021). Trusting automation: Designing for responsivity and resilience. Human Factors. https://doi.org/10/gjvcr2
EndsleyM.R. (2020). Human-Automation Interaction and the Challenge of Maintaining Situation Awareness in Future Autonomous Vehicles. In MoulouaM.HancockP. (Eds.), Automation and Human Performance: Theory and Applications, 2nd ed. (pp. 151–168). Boca Raton, FL: CRC Press.
16.
EndsleyM.R. (2017). From here to autonomy: Lessons learned from human-automation research. Human Factors, 59(1), 5–27.
17.
EndsleyM.R.JonesD.G. (2012). Designing for Situation Awareness: An Approach to Human-Centered Design, 2nd ed.London: Taylor and Francis.
18.
EvensonS.MullerM.RothE.M. (2008). Capturing the context of use to inform system design. Journal of Cognitive Engineering and Decision Making, 2(3), 181–203
19.
FlathmannC.SchelbleB. G.ZhangR.McNeeseN. J. (2021, July). Modeling and Guiding the Creation of Ethical Human-AI Teams. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society (pp. 469-479).
IJtsmaM.MaL.M.PritchettA. R.FeighK. M. (2019). Computational methodology for the allocation of work and interaction in human-robot teams. Journal of Cognitive Engineering and Decision Making, 13(4), 221–241. doi:10.1177/1555343419869484
22.
JohnsonM.BradshawJ. M.FeltovichP. J. (2017). Tomorrow’s human–machine design tools: From levels of automation to interdependencies. Journal of Cognitive Engineering and Decision Making, 12(1), 77–82.
23.
KunzeA.SummerskillS. J.MarshallR., et al. (2019). Automation transparency: implications of uncertainty communication for human-automation interaction and interfaces. Ergonomics, 62, 345-360.
LyonsJ. B. (2013). Being Transparent About Transparency: A Model for Human-Robot Interaction. 2013 AAAI Spring Symposium Series, pp. 48–53.
26.
LyonsJ. B.WynneK. T.MahoneyS.RoebkeM. A. (2019). Trust and human-machine teaming: A qualitative study. In Artificial intelligence for the internet of everything (pp. 101-116). Academic Press.
27.
LyonsJ. B.SycaraK.LewisM.CapiolaA. (2021). Human-autonomy teaming: Definitions, debates, and directions. Frontiers in Psychology, 12, 1932.
28.
MatthewsG.LinJ.PanganibanA.LongM. (2020). Individual differences in trust in autonomous robots: Implications for transparency. IEEE Transactions on Human-Machine Systems, 50, 234–244.
29.
McDermottP.DominguezC.KasdaglisN.RyanM.TrahanI.NelsonA.2018. Human-Machine Teaming Systems Engineering Guide. Bedford, MA: MITRE.
30.
McNeeseN. J.DemirM.ChiouE. K.CookeN. J. (2021). Trust and team performance in human–autonomy teaming. International Journal of Electronic Commerce, 25(1), 51-72.
31.
National Academies of Sciences, Engineering, and Medicine (2021). Human-AI Teaming: State of the Art and Research Needs. Washington, DC: The National Academies Press. https://doi.org/10.17226/26355
32.
National Research Council (NRC). 2007. Human-System Integration in the System Development Process: A New Look. National Academy Press.
33.
NaikarN.Human–Automation Interaction in Self-Organizing Sociotechnical Systems. Journal of Cognitive Engineering and Decision Making. 2018;12(1):62-66. doi: 10.1177/1555343417731223
34.
O’NeillT.McNeeseN.BarronA.SchelbleB. (2020). Human–autonomy teaming: A review and analysis of the empirical literature. Human factors, 0018720820960865.
35.
RothE. M.DePassB.HarterJ.ScottR.WamplerJ.2018. Beyond levels of automation: Developing more detailed guidance for human automation interaction. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 62(1), 150–154.
36.
RothE. M.DePassB.ScottR.TruxlerR.SmithS.WamplerJ. (2017). Designing Collaborative Planning Systems: Putting Joint Cognitive Systems Principles to Practice. In SmithP. J.HoffmanR. R. (Eds.) Cognitive Systems Engineering: The Future for a Changing World (Pp. 247–268). Boca Raton: Taylor and Francis, CRC Press.
37.
RothE. M.SusherebaC.MilitelloL. G.DiiulioJ.ErnstK. (2019). Function allocation considerations in the era of human autonomy teaming. Journal of Cognitive Engineering and Decision Making, 13(4), 199–220.
SchelbleB. G.FlathmannC.McNeeseN. J.FreemanG.MallickR. (2022). Let’s Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams. Proceedings of the ACM on Human-Computer Interaction, 6(GROUP), 1-29.
40.
ZhangR.McNeeseN. J.FreemanG.MusickG. (2021). “ An Ideal Human” Expectations of AI Teammates in Human-AI Teaming. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3), 1-25.
41.
TrapsilawatiF.WickensC.ChenC.-H.QuX. (2017). Transparency and Conflict Resolution Automation Reliability in Air Traffic Control. 19th International Symposium on Aviation Psychology, Dayton, Ohio, pp. 419–424.
42.
USAF. (2015). Autonomous Horizons: The Way Forward. Washington, DC: Office of the U.S. Air Force Chief Scientist.
43.
van de MerweK.MallamS.NazirS. (2022). Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review. Human Factors.
44.
WickensC. D.HeltonW.S.HollandsJ. G.BanburyS. (2022). Engineering Psychology and Human Performance, (5th ed.New York: Routledge.
