Human-AI Teaming in the Automotive and Mobility Industry: Guiding Design to Support Joint Activity

Abstract

AI technologies hold the potential to improve safety, efficiency, and user experience in automotive and mobility applications, yet to make them useful tools they need to effectively team with humans. Based on field research and experiences on how people coordinate, descriptive models of joint activity propose requirements for effective coordination that can inform the design of cooperative competencies of AI technologies in this domain. Yet, the usefulness of joint activity constructs for design is not only determined by their theoretical validity but also by their practical ability to influence designers. To enable the broader adoption of joint activity constructs, our study aims to characterize the context of design in the automotive industry and develop design guidance to support joint activity. We present our ongoing work to evaluate the ability of these constructs to inform design and to understand their fit within the context of design in the automotive industry.

Keywords

Human AI Teaming Mobility Joint Activity Joint Activity Design

Get full access to this article

View all access options for this article.

References

Amodei

Olah

Steinhardt

Christiano

Schulman

Mané

(2016). Concrete Problems in AI Safety (arXiv:1606.06565). arXiv. https://doi.org/10.48550/arXiv.1606.06565

Beede

Baylor

Hersch

Iurchenko

Wilcox

Ruamviboonsuk

Vardoulakis

L. M.

(2020). A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3313831.3376718

Bisantz

Roth

(2007). Analysis of Cognitive Work. Reviews of Human Factors and Ergonomics, 3, 1–43.

Bodin

Krupenia

S. S.

(2016). Activity Prioritization to Focus the Control Task Analysis. Journal of Cognitive Engineering and Decision Making, 10(1), 91–104. https://doi.org/10.1177/1555343416629307

Cardenas

I. S.

Lenhoff

Park

T. Y.

Lin

Paladugula

P. K.

Kim

J.-H.

(2021). AARON: Assistive Augmented Reality Operations and Navigation System for NASA’s Exploration Extravehicular Mobility Unit (xEMU). In Singh

Kang

D.-K.

Lee

J.-H.

Tiwary

U. S.

Singh

Chung

W.-Y.

(Eds.), Intelligent Human Computer Interaction (Vol. 12616, pp. 406–422). Springer International Publishing. https://doi.org/10.1007/978-3-030-68452-5_42

Clark

H. H.

(1996). Using Language. Cambridge University Press. https://doi.org/10.1017/CBO9780511620539

Cornet

Kässer

Müller

Tschiesner

(2017). Smart Moves Required—The Road Towards Artificial Intelligence in Mobility. McKinsey Center for Future Mobility.

Cummings

M. L.

Bauchwitz

(2022). Safety Implications of Variability in Autonomous Driving Assist Alerting. IEEE Transactions on Intelligent Transportation Systems, 23(8), 12039–12049. https://doi.org/10.1109/TITS.2021.3109555

Cummings

M. L.

Britton

(2020). Chapter 6 - Regulating safety-critical autonomous systems: Past, present, and future perspectives. In Pak

de Visser

E. J.

Rovira

(Eds.), Living with Robots (pp. 119–140). Academic Press. https://doi.org/10.1016/B978-0-12-815367-3.00006-2

10.

Domeyer

J. E.

Lee

J. D.

Toyoda

Mehler

Reimer

(2022). Interdependence in Vehicle-Pedestrian Encounters and its Implications for Vehicle Automation. IEEE Transactions on Intelligent Transportation Systems, 23(5), 4122–4134. https://doi.org/10.1109/TITS.2020.3041562

11.

Elm

W. C.

Potter

S. S.

Gualtieri

J. W.

Roth

E. M.

(2003). Applied Cognitive Work Analysis: A Pragmatic Methodology for Designing Revolutionary Cognitive Affordances. 41.

12.

Hoffman

R. R.

Crandall

Shadbolt

(1998). Use of the Critical Decision Method to Elicit Expert Knowledge: A Case Study in the Methodology of Cognitive Task Analysis. Human Factors, 40(2), 254–276. https://doi.org/10.1518/001872098779480442

13.

Hoffman

R. R.

Woods

D. D.

(2011). Beyond Simon’s slice: Five fundamental trade-offs that bound the performance of macrocognitive work systems. IEEE Intelligent Systems, 26(6), 67–71. https://doi.org/10.1109/MIS.2011.97

14.

Johnson

Bradshaw

J. M.

Feltovich

P. J.

Jonker

C. M.

Van Riemsdijk

M. B.

Sierhuis

(2014). Coactive Design: Designing Support for Interdependence in Joint Activity. Journal of Human-Robot Interaction, 3(1), 43. https://doi.org/10.5898/JHRI.3.1.Johnson

15.

Johnson

Vera

(2019). No AI Is an Island: The Case for Teaming Intelligence. AI Magazine, 40(1), 16–28. https://doi.org/10.1609/aimag.v40i1.2842

16.

Khamis

(2021). Smart Mobility: Exploring Foundational Technologies and Wider Impacts. Apress. https://doi.org/10.1007/978-1-4842-7101-8

17.

Klein

(2007). Flexecution as a paradigm for replanning, Part 1. IEEE Intelligent Systems, 22(5), 79–83. https://doi.org/10.1109/MIS.2007.4338498

18.

Klein

G. A.

Calderwood

MacGregor

(1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19(3), 462–472. https://doi.org/10.1109/21.31053

19.

Klein

Feltovich

P. J.

Bradshaw

J. M.

Woods

D. D.

(2005). Common Ground and Coordination in Joint Activity. In Rouse

W. B.

Boff

K. R.

(Eds.), Organizational Simulation (pp. 139–184). John Wiley & Sons, Inc. https://doi.org/10.1002/0471739448.ch6

20.

Klein

Woods

D. D.

Bradshaw

J. M.

Hoffman

R. R.

Feltovich

P. J.

(2004). Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intelligent Systems, 19(6), 91–95. https://doi.org/10.1109/MIS.2004.74

21.

Murphy

R. R.

(2019). Introduction to AI Robotics, second edition. MIT Press.

22.

Patterson

E. S.

Hoffman

R. R.

(2012). Visualization framework of macrocognition functions. Cognition, Technology & Work, 14(3), 221–227. https://doi.org/10.1007/s10111-011-0208-1

23.

Scharre

(2023). Four battlegrounds: Power in the age of artificial intelligence (First edition). W.W. Norton & Company.

24.

Smith

P. J.

(2018). Conceptual Frameworks to Guide Design. Journal of Cognitive Engineering and Decision Making, 12(1), 50–52. https://doi.org/10.1177/1555343417732239

25.

Smith

P. J.

Spencer

A. L.

Billings

C. E.

(2007). Strategies for designing distributed systems: Case studies in the design of an air traffic management system. Cognition, Technology and Work, 9(1), 39–49. https://doi.org/10.1007/s10111-006-0056-6

26.

Vicente

(1999). Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work. CRC Press.

27.

Watts

L. A.

Monk

A. F.

(1998). Reasoning about tasks, activities and technology to support collaboration. Ergonomics, 41(11), 1583–1606. https://doi.org/10.1080/001401398186081

28.

Woods

D. D.

Hollnagel

(2006). Joint Cognitive Systems: Patterns in Cognitive Systems Engineering (0 ed.). CRC Press. https://doi.org/10.1201/9781420005684

29.

Woods

D. D.

Tittle

Feil

Roesler

(2004). Envisioning Human–Robot Coordination in Future Operations. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 34(2), 210–218. https://doi.org/10.1109/TSMCC.2004.826272

30.

Woods

Dekker

(2000). Anticipating the effects of technological change: A new era of dynamics for human factors. Theoretical Issues in Ergonomics Science, 1(3), 272–282. https://doi.org/10.1080/14639220110037452