Communication Metrics for Human-Autonomy Teaming: Lessons Learned from us Army Gunnery Field Experiments

Abstract

The development of more effective human-autonomy teaming (HAT) will depend on the availability of validated measures of their performance. Communication provides a critical window into a team’s interactions, states, and performance, but much remains to be learned about how to successfully carry over communication measures from the human teaming context to the HAT context. Therefore, the purpose of this paper is to discuss the implementation of three communication assessment methodologies used for two Wingman Joint Capabilities Technology Demonstration field experiments. These field experiments involved Soldiers and Marines maneuvering vehicles and engaging in live-fire target gunnery, all with the assistance of intelligent autonomous systems. Crew communication data were analyzed using aggregate communication flow, relational event models, and linguistic similarity. We discuss how the assessments were implemented, what they revealed about the teaming between humans and autonomy, and lessons learned for future implementation of communication measurement approaches in the HAT context.