Instability of the Perceived World While Watching 3D Stereoscopic Imagery: A likely Source of Motion Sickness Symptoms

Abstract

Watching 3D content using a stereoscopic display may cause various discomforting symptoms, including eye strain, blurred vision, double vision, and motion sickness. Numerous studies have reported motion-sickness-like symptoms during stereoscopic viewing, but no causal linkage between specific aspects of the presentation and the induced discomfort has been explicitly proposed. Here, we describe several causes, in which stereoscopic capture, display, and viewing differ from natural viewing resulting in static and, importantly, dynamic distortions that conflict with the expected stability and rigidity of the real world. This analysis provides a basis for suggested changes to display systems that may alleviate the symptoms, and suggestions for future studies to determine the relative contribution of the various effects to the unpleasant symptoms.

Keywords

3D perception motion sickness stereoscopic display simulation sickness 3D display 3D television

References

Backus

B. T.

Banks

M. S.

Van Ee

Crowell

J. A.

(1999). Horizontal and vertical disparity, eye position, and stereoscopic slant perception. Vision Research, 39(6), 1143–1170. doi:10.1016/s0042-6989(98)00139-4

Banks

M. S.

Held

R. T.

Girshick

A. R.

(2009). Perception of 3-D layout in stereo displays. Information Display, 25(1), 12. doi:10.1117/12.2039939

Barbera

(2005). Uses of elastic space: The Vertigo shot. Memory of Richard B. Klein: Essays in Contemporary Philology (pp. 31–69). Oxford, Miss: Dept. of Modern Languages, University of Mississippi. doi:10.1016/j.emospa.2010.01.006

Bex

P. J.

(2010). (In) Sensitivity to spatial distortion in natural scenes. Journal of Vision, 10(2), 23, 1–15. doi:10.1167/10.2.23

Broberg

D. K.

(2011). Guidance for horizontal image translation (HIT) of high definition stereoscopic video production. Proceedings SPIE 7863, Stereoscopic Displays and Applications XXII, 78632F; International Society for Optics and Photonics. doi:10.1117/12.888016

Chen

Y. C.

Duann

J. R.

Chuang

S. W.

Lin

C. L.

L. W.

Jung

T. P.

Lin

C. T.

(2010). Spatial and temporal EEG dynamics of motion sickness. NeuroImage, 49(3), 2862–2870. doi:10.1016/j.neuroimage.2009.10.005

Cheung

Vaitkus

(1998). Perspectives of electrogastrography and motion sickness. Brain Research Bulletin, 47(5), 421–431. doi:10.1016/S0361-9230(98)00095-1

Cobb

S. V. G.

(1999). Measurement of postural stability before and after immersion in a virtual environment. Applied Ergonomics, 30(1), 45–57. doi:10.1016/S0003-6870(98)00038-6

Cutting

J. E.

Vishton

P. M.

(1995). Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In Epstein

Rogers

(Eds.), Perception of space and motion (pp. 69–117). San Diego, CA: Academic Press. doi:10.1016/B978-012240530-3/50005-5

10.

Faubert

Allard

(2004). Effect of visual distortion on postural balance in a full immersion stereoscopic environment. Proceedings SPIE 5291, Stereoscopic Displays and Virtual Reality Systems XI; International Society for Optics and Photonics. doi:10.1117/12.527017

11.

Fehn

(2004). Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. Proceedings SPIE 5291, Stereoscopic Displays and Virtual Reality Systems XI; In Electronic Imaging 2004 (pp. 93–104). International Society for Optics and Photonics. doi:10.1117/12.524762

12.

Guedry

F. E.

Jr. (1970). Conflicting sensory orientation cues as a factor in motion sickness. NASA Special Publication, 187, 45. doi:10.1002/14651858

13.

Hartley

Zisserman

(2003). Multiple view geometry in computer vision. Cambridge: Cambridge University Press. doi:10.1017/S0263574705211621

14.

Held

(1961). Exposure-history as a factor in maintaining stability of perception and coordination. The Journal of Nervous and Mental Disease, 132(1), 26–32

15.

Hill

Bruce

(1993). Independent effects of lighting, orientation, and stereopsis on the hollow-face illusion. Perception, 22, 887–887. doi:10.1068/p220887

16.

Hoffman

D. M.

Girshick

A. R.

Akeley

Banks

M. S.

(2008). Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision, 8(3), 33. doi:10.1167/8.3.33

17.

Holmes

S. R.

Griffin

M. J.

(2001). Correlation between heart rate and the severity of motion sickness caused by optokinetic stimulation. Journal of Psychophysiology, 15(1), 35. doi:10.1027//0269-8803.15.1.35

18.

Howard

Rogers

(1995). Binocular vision and stereopsis. New York: Oxford University Press. doi:10.1016/j.survophthal.2013.08.001

19.

Howarth

P. A.

(2011). Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: A review. Ophthalmic and Physiological Optics, 31(2), 111–122. doi:10.1111/j.1475-1313.2011.00822.x

20.

Grant

W. F.

Stern

R. M.

Koch

K. L.

(1991). Motion sickness severity and physiological correlates during repeated exposures to a rotating optokinetic drum. Aviation, Space, and Environmental Medicine, 62(4), 308–314

21.

Irwin

J. A.

(1881). The pathology of sea sickness. The Lancet, 118(3039), 907–909. doi:10.1016/s0140-6736(02)38129-7

22.

Iwasaki

Kubota

Tawara

(2009). The tolerance range of binocular disparity on a 3D display based on the physiological characteristics of ocular accommodation. Displays, 30(1), 44–48. doi:10.1016/j.displa.2008.11.001

23.

Jung

J. H.

Yeom

Hong

Min

S. W.

Lee

(2011). Effect of fundamental depth resolution and cardboard effect to perceived depth resolution on multi-view display. Optics Express, 19(21), 20468–20482. doi:10.1364/OE.19.020468

24.

Kaneko

Suyama

Yamamoto

(2010). Analysis of depth of field of stereoscopic cameras in lens-tilt configurations. Proceedings SPIE 7524, Stereoscopic Displays and Applications XXI, 75241I; International Society for Optics and Photonics. doi:10.1117/12.839581

25.

Kennedy

R. S.

Drexler

Kennedy

R. C.

(2010). Research in visually induced motion sickness. Applied Ergonomics, 41(4), 494–503. doi:10.1016/j.apergo.2009.11.006

26.

Kennedy

R. S.

Lane

N. E.

Berbaum

K. S.

Lilienthal

M. G.

(1993). Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3), 203–220. doi:10.1207/s15327108ijap0303_3

27.

Kennedy

R. S.

Lilienthal

M. G.

(1995). Implications of balance disturbances following exposure to virtual reality systems. In Virtual Reality Annual International Symposium, 1995. Proceedings (pp. 35–39). IEEE. doi:10.1109/VRAIS.1995.512477

28.

Kooi

F. L.

Toet

(2004). Visual comfort of binocular and 3D displays. Displays, 25(2), 99–108. doi:10.1016/j.displa.2004.07.004

29.

Kuze

Ukai

(2008). Subjective evaluation of visual fatigue caused by motion images. Displays, 29(2), 159–166. doi:10.1016/j.displa.2007.09.007

30.

Lambooij

Fortuin

Heynderickx

Ijsselsteijn

(2009). Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Science and Technology, 53(3), 30201-1. doi:10.2352/J.ImagingSci.Technol.2009.53.3.030201

31.

Lambooij

M. T.

Ijsselsteijn

W. A.

Heynderickx

(2007). Visual discomfort in stereoscopic displays: A review. Proceedings SPIE 6490, Stereoscopic Displays and Virtual Reality Systems XIV, 64900I; International Society for Optics and Photonics. doi:10.1117/12.705527

32.

Lipton

(1993). Composition for electrostereoscopic displays. In McAllister

D. F.

(Ed.), Stereo computer graphics (pp. 11–25). Princeton, NJ: Princeton University Press

33.

Mendiburu

(2012). 3D movie making: Stereoscopic digital cinema from script to screen. Oxford, UK: Focal Press, Elsevier

34.

Miller

J. W.

Goodson

J. E.

(1958). A note concerning “motion sickness” in the 2-FH-2 Hover Trainer (Research Project NM 1701 11; Subtask 3; Report I). Pensacola, FL: Naval School of Aviation Medicine

35.

Money

K. E.

(1970). Motion sickness. Physiological Review, 50, 9–17. doi:10.1037/h0058423

36.

Moodley

V. M.

Kadwa

Nxumalo

Penceliah

Ramkalam

Zama

(2011). Induced prismatic effects due to poorly fitting spectacle frames. The South African Optometrist, 70(4), 168–174. http://www.saoptometrist.co.za/previous_issues2011.html

37.

Nagata

(1993, January). How to reinforce perception of depth in single two-dimensional pictures. In Pictorial communication in virtual and real environments (2nd ed.) (pp. 527–545). Bristol, PA: Taylor & Francis, Inc

38.

Papathomas

T. V.

Bono

L. M.

(2004). Experiments with a hollow mask and a reverspective: Top-down influences in the inversion effect for 3-D stimuli. Perception, 33(9), 1129–1138. doi:10.1068/p5086

39.

Park

Jung

J. H.

Hong

Kim

Y. H.

Min

S. W.

Lee

(2009). Multi-viewer tracking integral imaging system and its viewing zone analysis. Optics Express, 17(20), 17895–17908. doi:10.1364/OE.17.017895

40.

Patterson

Silzars

(2009). Immersive stereo displays, intuitive reasoning, and cognitive engineering. Journal of the Society for Information Display, 17(5), 443–448. doi:10.1889/JSID17.5.443

41.

Peli

(1995). Real vision & virtual reality. Optics & Photonics News, 6(7), 28–34. doi:10.1364/OPN.6.7.000028

42.

Peli

(1999). Optometric and perceptual issues with head-mounted displays. In Mouroulis

(Ed.), Visual instrumentation: Optical design and engineering principles (pp. 205–276). New York: McGraw-Hill. doi:10.1117/1.1839231

43.

Peli

García-Pérez

M. A.

(2003). Motion perception during involuntary eye vibration. Experimental Brain Research, 149(4), 431–438. doi:10.1007/s00221-003-1383-y

44.

Peli

Hedges

T. R.

Tang

Landmann

(2001). 53.2: A Binocular Stereoscopic Display System with Coupled Convergence and Accommodation Demands. In SID Symposium Digest of Technical Papers (Vol. 32, No. 1, pp. 1296–1299). Oxford: Blackwell Publishing Ltd. doi:10.1889/1.1831799

45.

Piponnier

J. C.

Hanssens

J. M.

Faubert

(2009). Effect of visual field locus and oscillation frequencies on posture control in an ecological environment. Journal of Vision, 9(1), 13. doi:10.1167/9.1.13

46.

Pocket

Salmimaa

Polonen

Hakkinen

(2010). The Impact of Barrel Distortion on Perception of Stereoscopic Scenes. SID Symposium Digest, 41(1), 526–529. doi:10.1889/1.3500515

47.

Prince

S. J.

Rogers

B. J.

(1998). Sensitivity to disparity corrugations in peripheral vision. Vision Research, 38(17), 2533–2537. doi:10.1016/S0042-6989(98)00118-7

48.

Prothero

J. D.

Furness

T. A.

(1998). The role of rest frames in vection, presence and motion sickness. Doctoral Dissertation, University of Washington

49.

Reason

J. T.

(1970). Motion sickness: A special case of sensory rearrangement. Advancement of Science, 26(130), 386–393. doi:10.1007/s00773-010-0113-y.30

50.

Reason

J. T.

(1978). Motion sickness adaptation: A neural mismatch model. Journal of the Royal Society of Medicine, 71(11), 819–829

51.

Reason

J. T.

Brand

J. J.

(1975). Motion sickness. London: Academic

52.

Rushton

S. K.

Riddell

P. M.

(1999). Developing visual systems and exposure to virtual reality and stereo displays: Some concerns and speculations about the demands on accommodation and vergence. Applied Ergonomics, 30(1), 69–78. doi:10.1016/S0003-6870(98)00044-1

53.

Shibata

Kim

Hoffman

D. M.

Banks

M. S.

(2011). The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision, 11(8), 11. doi:10.1167/11.8.11

54.

Solimini

A. G.

(2013). Are there side effects to watching 3D movies? A prospective crossover observational study on visually induced motion sickness. PLoS ONE, 8(2), e56160. doi:10.1371/journal.pone.0056160

55.

Solimini

A. G.

Mannocci

Di Thiene

(2011). A pilot application of a questionnaire to evaluate visually induced motion sickness in spectators of tri-dimensional (3D) movies. Italian Journal of Public Health, 8(2), 197. doi:10.1038/nm0398-265

56.

Stevenson

Cobian

(2009). Designing a horizontal image translation algorithm for use with dynamic stereographical virtual worlds. UWEC Office of Research and Sponsored Programs

57.

Tam

W. J.

Speranza

Yano

Shimono

Ono

(2011). Stereoscopic 3D-TV: Visual comfort. Broadcasting, IEEE Transactions On, 57(2), 335–346. doi:10.1117/12.2002989

58.

Todd

J. T.

(2004). The visual perception of 3D shape. Trends in Cognitive Sciences, 8(3), 115–121. doi:http://dx.doi.org/10.1016/j.tics.2004.01.006

59.

Tuan

K. M.

Jones

(1997). Adaptation to the prismatic effects of refractive lenses. Vision Research, 37(13), 1851–1857. doi:10.1016/j.visres.2010.05.014

60.

Ujike

Watanabe

(2011). Effects of stereoscopic presentation on visually induced motion sickness. Proceedings SPIE 7863, Stereoscopic Displays and Applications XXII, 786314; International Society for Optics and Photonics. doi:10.1117/12.873500

61.

Ukai

Howarth

P. A.

(2008). Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations. Displays, 29(2), 106–116. doi:10.1016/j.displa.2007.09

62.

van Ee

Adams

W. J.

Mamassian

(2003). Bayesian modeling of cue interaction: Bistability in stereoscopic slant perception. JOSA A, 20(7), 1398–1406. doi:10.1364/JOSAA.20.001398

63.

van EE

Erkelens

C. J.

(1996). Stability of binocular depth perception with moving head and eyes. Vision Research, 36(23), 3827–3842. doi:10.1016/0042-6989(96)00103-4

64.

Wann

J. P.

Rushton

Mon-Williams

(1995). Natural problems for stereoscopic depth perception in virtual environments. Vision Research, 35(19), 2731–2736. doi:10.1016/0042-6989(95)00018-U

65.

Westheimer

(1979). Cooperative neural processes involved in stereoscopic acuity. Experimental Brain Research, 36(3), 585–597. doi:10.1016/0042-6989(94)00256-L

66.

Woods

A. J.

Docherty

Koch

(1993, September). Image distortions in stereoscopic video systems. Proceedings SPIE 1915, Stereoscopic Displays and Applications IV, 36. International Society for Optics and Photonics. doi:10.1117/12.157041

67.

Wood

M. J.

Struve

F. A.

Straumanis

J. J.

Stewart

J. J.

Wood

C. D.

(1991). The effect of motion-sickness on brain waves (EEG). Aviation, Space, and Environmental Medicine, 62, 461

68.

Wöpking

(1995). Viewing comfort with stereoscopic pictures: An experimental study on the subjective effects of disparity magnitude and depth of focus. Journal of the Society for Information Display, 3(3), 101–103. doi:10.1889/1.1984948

69.

Yang

S. N.

Schlieski

Selmins

Cooper

Doherty

Corriveau

P. J.

Sheedy

J. E.

(2011). Individual differences and seating position affect immersion and symptoms in stereoscopic 3D viewing. Proceeding of Stereoscopic Display and Application, 7863, 1–44

70.

Yano

Emoto

Mitsuhashi

(2004). Two factors in visual fatigue caused by stereoscopic HDTV images. Displays, 25(4), 141–150. doi:10.1016/j.displa.2004.09.002