Abstract
Mixed reality technology has provided more possibilities for users to interact with both the virtual and real worlds. By integrating virtual elements with real scenes, mixed reality offers a novel immersive experience. Mixed reality also introduces complex perceptual and cognitive challenges when processing conflicting information from the virtual and real worlds. This study investigates the impact of color mismatches on response time in a mixed reality scenario. We recruited 15 participants to identify the font color of words while ignoring their meaning. The experiment included three levels of perceptual-conceptual matching. We performed a global comparison across all conditions, a within-group comparison, and a between-group comparison. Results show that in the mixed reality scenario, the processing of visual information relies on low-level physical properties (e.g., brightness and hue) and is modulated by high-level cognitive factors (e.g., conflict processing and expectation). These findings indicate that visual mismatches in mixed reality can significantly affect response time, particularly when perceptual salience is low and different from cognitive expectations. The results have implications for the design of mixed reality interfaces in complex environments where users must process information from the virtual and real worlds, such as head-up displays, warehouse management systems, and industrial instructional overlays.
Get full access to this article
View all access options for this article.
