Sage Journals: Discover world-class research

Abstract

The aim of this study is to define and evaluate a methodological framework for human-machine interaction (HMI) readiness evaluation in system development for complex, high risk, and task-critical environments. The long-term objective is to establish a HMI readiness evaluation framework for environments with these characteristics, in this specific case HMI development for fighter aircrafts. Based on literature studies a series of interviews were conducted to identify shortcomings of current practices and methods, and define requirements for an enhanced methodology. The results were further explored during facilitated workshops with HMI subject matter experts. The overall result is a methodological framework based on triangulation of many already established evaluation methods and techniques, combined with a set of measurable HMI criteria. Inspired by risk management practices, the result of the proposed methodology is presented in a HMI assessment matrix. This matrix is proposed to form the basis of the HMI evaluation and assessment.

Get full access to this article

View all access options for this article.

References

Albers

M. J.

Still

(2011). Usability of complex information systems: Evaluation of user interaction. New York, NY: CRC Press, Taylor & Francis Group.

Benyon

(2010). Designing Interactive Systems. A comprehensive guide to HCI and interaction design. Essex, England: Addison Wesley.

Castor

(2009). The use of structural equation modeling to describe the effect of operator functional state on air-to-air engagement outcomes (Doctoral Thesis No. 1251, Linköping University, Sweden).

Dumas

J. S.

Salzman

M. C.

(2006). Usability assessment methods. Reviews of Human Factors and Ergonomics (pp. 109-140). Santa Monica, CA: Human Factors and Ergonomics Society.

Hale

Fuchs

Carpenter

Stanney

(2011). A Scale for Assessing Human Factors Readiness Levels. Proceedings of the Human Factors and Ergonomics Society Annual Meeting: Vol. 55. pp. 2030-2034.

ISO 9241-11:1998. (1998). Ergonomic requirements for office work with visual display terminals (VDTs), Part 11, Guidance on usability. Geneva, Switzerland.

ISO 9241-210:2010. (2010). Ergonomics of human-system interaction, Part 210, Human-centred design for interactive systems. Geneva, Switzerland.

Jander

Borgvall

Castor

(2011). Brain budget – Evaluation of Human Machine Interaction in System Development for High Risk and Task Critical Environments (FOI-R–3272–SE). Retrieved from the Swedish Defence Research Agency (FOI) website: http://www2.foi.se/rapp/foir3272.pdf

Nielsen

(1993). Usability Engineering. Cambridge, MA: AP Professional

10.

Quesenbery

(2004). Balancing the 5Es: Usability. Cutter IT Journal 17(2), pp. 4-11.

11.

Sanders

M. S.

McCormick

E. J.

(1993). Human Factors in Engineering and Design. United States: McGraw-Hill, Inc.

12.

Shneiderman

(2009). Designing the User Interface: Strategies for Effective Human Computer Interaction. New York, NY: Addison & Wesley.

13.

Stanton

Hedge

Brookhuis

Salas

Hendrick

(2005). Handbook of Human Factors and Ergonomics Methods. Boca Raton, Florida: CRC Press.

14.

Tullis

Stetson

(2004). A Comparison of Questionnaires for Assessing Website Usability. Presentation at the Usability Professionals’ Association Annual Conference, Minneapolis, Minnesota.

Towards a Methodological Framework for HMI Readiness Evaluation

Abstract

Get full access to this article

References