Discriminability of Prediction Artifacts in a Time-Delayed Virtual Environment

Abstract

Overall latency remains an impediment to perceived image stability and consequently to human performance in virtual environment (VE) systems. Predictive compensators have been proposed as a means to mitigate these shortcomings, but they introduce rendering errors because of induced motion overshoot and heightened noise. Discriminability of these compensator artifacts was investigated by a protocol in which head tracked image stability for 35 ms baseline VE system latency was compared against artificially added (16.7 to 100 ms) latency compensated by a previously studied Kalman Filter (KF) predictor. A control study in which uncompensated 16.7 to 100 ms latencies were compared against the baseline was also performed. Results from 10 subjects in the main study and 8 in the control group indicate that predictive compensation artifacts are less discernible than the disruptions of uncompensated time delay for the shorter but not the longer added latencies. We propose that noise magnification and overshoot are contributory cues to the presence of predictive compensation.

Get full access to this article

View all access options for this article.

References

Akatsuka

Bekcy

G. A.

(1998) Compensation for end to end delays in a VR system. Proceedings, IEEE VRAIS.

Adelstein

B. D.

Johnston

E. R.

Ellis

S. R.

(1996) Dynamic response of electromagnetic spatial displacement trackers. Presence, 5(3): 302–318.

Azuma

Bishop

(1994) Improving static and dynamic registration in an optical see-through display. Proceedings, SIGGRAPH, Orlando, FL, pp. 197–204.

Brown

R. G.

Hwang

P. Y. C.

(1997) Introduction to Random Signals and Applied Kalman Filtering. John Wiley, New York.

Ellis

S. R.

Bréant

Menges

Jacoby

R. H.

Adelstein

B. D.

(1997) Operator interaction with virtual objects: effects of system latency. Proceedings, HCI′97 International, San Francisco, pp. 973–976.

Ellis

S. R.

Adelstein

B. D.

Baumeler

Jense

G. J.

Jacoby

R. H.

(1999) Sensor Spatial Distortion, Visual Latency, and Update Rate Effects on 3D Tracking in Virtual Environments. Proceedings, IEEE VR′99, Houston TX.

Ellis

Young

Adelstein

Ehrlich

(1999a) Discrimination of changes of latency during head movement. Proceedings, HCI′99, Munich, pp. 1129–1133.

Ellis

Young

Adelstein

Ehrlich

(1999b) Discrimination of changes of latency during voluntary hand movement of virtual objects. Proceedings, 43rd Ann. Meeting HFESy, Houston, TX, pp. 1182–1186.

Friedmann

Starner

Pentland

(1992) Synchronization in virtual realities. Presence, 1(1), 139–144.

10.

Held

Efsathiou

Greene

(1966). Adaptation to displaced and delayed visual feedback from the hand. J. Exp. Psychol., 72(6), 887–891.

11.

Jacoby

Adelstein

Ellis

(1996) Improved temporal response in virtual environment hardware and software. Proceedings, SPIE Conf. on Stereoscopic Displays and Applications VII, Vol. 2653, Bellingham WA, pp. 271–284.

12.

Jung

Adelstein

Ellis

(2000) Predictive Compensator Optimization for Head Tracking Lag in Virtual Environments. To appear in Proceedings, IMAGE 2000.

13.

Kiruluta

Eizenman

Pasupathy

(1997) Predictive head move movement tracking using a Kalman filter. IEEE Trans. Sys., Man, Cybernetics—B, 27(2), 326–331.

14.

Liang

Shaw

Green

(1991) On temporal-spatial realism in the virtual reality environment. Proceedings, UIST′91) 1991, Hilton Head, SC, pp. 19–25.

15.

Liu

Tharp

French

Lai

Stark

(1993) Some of what one needs to know about using head mounted displays to improve teleoperator performance. IEEE Trans. Rob. Autom., 9(5), 638–648.

16.

Mazuryk

Gervautz

(1995) Two-step prediction and image deflection for exact head tracking in virtual environments. Eurographics′95, 14(3), C-29–42.

17.

Sachs

(1984) Applied Statistics: A Handbook of Techniques. Springer-Verlag, New York.

18.

Sheridan

T. B.

Ferrell

W. R.

(1963). Remote manipulative control with transmission delay. IEEE Trans. Hum. Fact. Elect., HFE-4(1), 25–29.

19.

R. H. Y.

Griffin

M. J.

(1996) Experimental studies of the use of phase lead filters to compensate lags in head-coupled visual displays IEEE Trans. Sys., Man, Cybernetics—A, Humans and Systems, 26(4), 445–454.

20.

Ware

Balakrishnan

(1994) Reaching for Objects in VR Displays: Lag and Frame Rate, ACM Trans. Comp. Hum. Interact., 1(4) 331–356.

21.

Welch

R. B.

Blackmon

T. T.

Liu

Mellers

B. A.

Stark

L. W.

(1996) The effects of pictorial realism, delay of visual feedback, and observer interactivity on the subjective sense of presence. Presence, 5(3), 263–273.

22.

J.-R.

Ouhyoung

(1995) A 3D tracking experiment on latency and its compensation methods in virtual environments. Proceedings, UIST′95, Philadelphia, PA, pp. 41–49.