Sage Journals: Discover world-class research

Abstract

Traditional unmanned vehicle and robotic displays often use the visual modality alone to provide information and warnings. In previous studies we found that multimodal (auditory and/or tactile) cues that supplement visual displays, can increase user performance and decrease workload in a variety of settings. In this latest study, we examined the use of visual, spatial auditory, and tactile presentation of geospatial and warning information in a Soldier-robotic swarm interface. Sixteen male Marines with a mean age of 19 years from a Marine Detachment at Aberdeen Proving Ground, Maryland, acted as volunteer participants. Results showed that workload decreased and performance, as measured by reduced response time, increased with multimodal displays. These results are consistent with previous studies. The findings from this study have implications for the design of multimodal interfaces in complex, data-rich domains such as the human-swarm interface.

Get full access to this article

View all access options for this article.

References

Barnes

Fields

M.A.

Valavanis

(2007). Unmanned ground vehicle swarm formation control using potential fields, Control & Automation, 2007. MED 1907. Mediterranean Conference on, vol., no., pp. 1–8, 27–29.

Burdea

Richard

Coiffet

(1996). Multimodality virtual reality: Input-output devices, systems integration, and human factors, International Journal of Human-computer Interaction: Special Issues of Human-Virtual Environment Interaction, 8, 1, 5–24.

Chen

J.Y.C.

Haas

E.C.

Barnes

M.J.

(2007). Human performance issues and user interface design for teleoperated robots. Transactions on Systems, Man, and Cybernetics, 37, 6, 1231–1245.

Dickie

(2002). Modeling Robot Swarms Using Agent-Based Simulation, Masters Thesis, Naval Postgraduate School, (2002) Monterey, CA.

Dudenhoeffer

D.D.

Bruemmer

D.J.

Davis

M.L.

(2001). Modeling and simulation for exploring human-robot team interaction requirements, Winter Simulation Conference.

Ferris

T.K.

Sarter

N.B.

(2008). Cross-modal links among vision, audition, and touch in complex environments. Human Factors, 50, 1, 17–26.

Gacy

Dahn

(2006). Commonality of control paradigms for unmanned systems. Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 2006, Salt Lake City, UT, 339–340.

Hart

Staveland

(1988). Development of NASA TLX (Task Load Index): Results of empirical and theoretical research in Hancock

Meshkati

, Eds. Human Mental Workload, Elsevier Science Publishers.

Jones

L.A.

Sarter

N.B.

(2008). Tactile Displays: Guidance for their design and application. Human Factors, 50, 1, 90–101.

10.

Lathan

C.E.

Tracey

(2002). The effects of operator spatial perception and sensory feedback on human-robot teleoperation performance. Presence: Teleoperators and Virtual Environments, 11, 4, 368–377.

11.

Shilling

R.D.

Shinn-Cunningham

(2002). Virtual auditory displays, Handbook of Virtual Environments, Stanney

, Ed. Mahwah, NJ: Erlbaum, 65–92.

12.

Sorkin

R.D.

(1987). Design of auditory and tactile displays. In Salvendy

(Ed.), Handbook of Human Factors (pp. 550). New York: John Wiley & Sons Press.

13.

Tachi

Komoriya

Sawada

Nishiyama

Itoko

Kobayashi

Inoue

(2003). Telexistence cockpit for humanoid robot control, Adv. Robotics, 17, 3, 199–217.

14.

Van Erp

J.B.

(2002). Guidelines for the Use of Vibro-Tactile Displays in Human Computer Interaction, in Eurohaptics 2002: Conference Proceedings. Ed by Wall

S.A.

, (Eds.) Edinburgh, 2002, 18–22.

Designing and Evaluating a Multimodal Interface for Soldier-Swarm Interaction

Abstract

Get full access to this article

References