Sage Journals: Discover world-class research

Abstract

There are statutory requirements for human systems integration (HSI) in military acquisition. Despite these requirements, usability is often neglected in the test and evaluation of military systems. The System Usability Scale (SUS) has been proven to be a reliable and valid, yet pragmatic measure of usability for commercial systems. However, there are certain differences between military systems and commercial systems. These differences include users, system complexity, and testing environments. This paper describes the impact of these differences on the use of the SUS in military test and evaluation. Research suggestions and guidance for integrating the SUS into the military acquisition process are also discussed.

Get full access to this article

View all access options for this article.

References

Bangor

Kortum

Miller

J.A.

(2009). “Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale.” Journal of Usability Studies, 4(3), pp. 114-123.

Borsci

Federici

Lauriola

(2009). On the dimensionality of the System Usability Scale: a test of alternative measurement models. Cognitive Processes, 10, 193-197.

Brooke

(1996). SUS: A ‘quick and dirty’ usability scale. In Jordan

P.W.

Thomas

Weerdmeester

McClelland

I.I.

(Eds.) Usability evaluation in industry (pp. 189-194). London, Taylor & Francis.

Brooke

(2013). SUS: A Retrospective. Journal of Usability Studies, 8, 29 – 40.

Brooks

Ciabarelli

Grier

R.A.

Morrison

J.E.

Sanders

C.G.

Wisher

R.A.

Hartman

F.E.

(2012). Analysis of system training impact for major defense acquisition programs (MDAPS): Training systems acquisition. (D-4648) Alexandria, VA: Institute for Defense Analyses.

Defense Acquisition Guidebook (2012). Fort Belvoir, VA: Defense Acquisition University.

Lewis

J.R.

Sauro

(2009). The factor structure of the system usability scale. Proceedings of the Human Computer Interaction International Conference (HCII 2009). San Diego, CA.

Ockerman

Roberts

Sciarretta

A. A.

Folds

McKee

Reynolds

R. M.

Grier

(2010). Opportunities for human factors measures in military operational test and evaluation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54, 2221-2225.

Smootz

E.R.

(2003). Human Systems Integration and Systems Acquisition Interfaces, In Booher

H. R.

(Ed). Handbook of human systems integration (pp 101-120). Wiley.

10.

Warner

Gilmore

(2012). Statistical rigor in operational test and evaluation. Paper presented at the Joint Statistical Meeting in San Diego, CA.

The Potential Utility of the System Usability Scale in U.S. Military Acquisition

Abstract

Get full access to this article

References