A Framework for Relating Head-Mounted Displays to Mixed Reality Displays

Abstract

The Head Mounted Display (HMD) is discussed as a subset of Mixed Reality (MR) displays. A definition of MR is given, in terms of image mixtures along a Reality-Virtuality (RV) Continuum, including the subclasses of augmented reality (AR) and augmented virtuality (AV). In relation to actual task execution, the relative need for local guidance information versus more global planning and navigational information is discussed. A taxonomic framework for classifying MR systems is presented, in terms of not only the RV continuum, but also the degree of centricity of the observer relative to a nominal viewpoint and the extent of control-display congruence. Several practical examples of MR systems are presented, all from the domain of surgery, and for each a volume within the MR design space is proposed.

Get full access to this article

View all access options for this article.

References

Bajura

Fuchs

Ohbuchi

(1992). Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. Computer Graphics (Proc. of SIG-GRAPH′92), 26(2), 203–210.

Blackwood

W. O.

Anderson

T. R.

Bennett

C. T.

Corson

J. R.

Endsley

M. R.

Hancock

P. A.

Hochberg

Hoffman

J. E.

Kruk

R. V.

(1997). Tactical Displays for Soldiers -Human Factors Considerations. Washington, DC: National Academy Press.

Faye

E. L.

Wickens

C. D.

(1995). Strategies for Display Integration in Navigational Guidance and Situation Awareness (ARL-95-4/NASA-95-1). Savoy, IL: Aviation Research Laboroaty, Institute of Aviation, University of Illinois at Urbana-Champaign.

Kim

Milgram

Drake

(1997). Computer assisted 3D measurements for micro-surgery. Paper presented at the 41st Annual Meeting of Human Factors and Ergonomics Society, Albuquerque, NM.

Milgram

Colquhoun

(1999). A taxonomy of real and virtual world display integration. In Tamura

Y. O. H.

(Ed.), Mixed Reality: Merging Real and Virtual Worlds. (pp. 5–30). Tokyo: Ohmsha/Springer-Verlag.

Ohta

Tamura

(Eds). (1999). Mixed Reality: Merging Real and Virtual Worlds. Tokyo: Ohmsha/Springer-Verlag.

Waterworth

J. A.

(1998). Virtual Reality in Medicine: A survey of the state of the art. (WWW Report). Umea: Dept. of Informatics, Umea University, Umea, Sweden.

Wickens

C. D.

(1995). Integration of navigational information for flight (ARL-95-11/NASA-95-5). Savoy, IL: Aviation Research Lab, Institute of Aviation, University of Illinois at Urbana-Champaign.

Wickens

C. D.

(1998). Frame of Reference for Navigation. In Koriat

D. G. A.

(Ed.), Attention and Performance, Vol. 16 (Vol. 16,). Orlando, FL: Academic Press.

10.

Zhai

Milgram

(1998). Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. Paper presented at the CHI′98, ACM Conference on Human Factors in Computing Systems, Los Angeles, Ca.