Is a Picture Worth a Thousand Words? Investigating Structural Knowledge with Textual and Pictorial Stimuli

Abstract

The differences between the processing of textual and pictorial information have been a topic of research for some time now. Previous research concerning the modality of information has often concentrated on the speed of processing rather than the organizational differences that may exist. This experiment utilized card sorting to evaluate the changes in knowledge organization that occur when information is presented in text and picture formats. In addition to this, the structure of the elicitation task was manipulated to evaluate its effects on sharedness. It was found that textual stimuli produced a greater sharedness among participants in a free sorting task. However, for a structured sorting task, results reversed, and pictorial stimuli created a greater level of sharedness. Overall, structured sorting tasks produced a greater level of sharedness than the free sorting condition, regardless of modality.

Get full access to this article

View all access options for this article.

References

Bruner

J. S.

Olson

D. R.

(1973). Learning through experience and learning through media. Prospects, 5(1), 20–38.

Evans

A. W.

III Hitt

J. M.

II Jentsch

(2001). Mental Model Assessments: Is there convergence among different methods. Proceedings of the Human Factors and Ergonomics Society, Minneapolis, MN, 45, 293–296.

Federmeier

K. D.

Kutas

(2001). Meaning and modality: Influences of context, semantic memory organization, and perceptual predictability on picture processing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27(1), 202–224.

Guenther

R. K.

Klatzky

R. L.

(1977). Semantic classification of pictures and words. Journal of Experimental Psychology: Human Learning and Memory, 3(5), 498–514.

Harper

M. E.

Rhodenizer-VanDuyne

Jentsch

Smith-Jentsch

K. A.

Sanchez

(2002). Computerized card sort training tool: Is it comparable to manual card sorting? To appear in Proceedings of 46th Annual Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.

Hoeft

R. M.

Jentsch

Harper

M. E.

Evans

A. W.

III Berry

Bowers

C.A.

Salas

(2002). Structural knowledge assessment with the Team Performance Lab's Knowledge Analysis Test Suite (TPL-KATS). To appear in Proceedings of 46th Annual Human Factors and Ergonomics Society. Annual Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.

Job

Rumiati

Lotto

(1992). The picture superiority effect in categorization: Visual or semantic? Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(5), 1019–1028.

Lotto

Job

Rumiati

(1999). Visual effects in picture and word categorization. Memory & Cognition, 27(4), 674–684.

Paivio

(1990). Mental Representations: A Dual-Coding Approach. New York: Oxford University Press.

10.

Pellegrino

J. W.

Rosinski

R. R.

Chiesi

H. L.

Siegel

(1977). Picture-word differences in decision latency: An analysis of single and dual memory models. Memory & Cognition, 5(4), 383–396.

11.

Pylyshyn

Z. W.

(1973). What the mind's eye tells the mind's brain: A critique of mental imagery. Psychological Bulletin, 50(1), 1–24.

12.

Rao

V.R.

Katz

(1971). Alternative Multidimensional Scaling Methods for Large Stimulus Sets. Journal of Marketing Research, 8, 488–494.

13.

Rosch

(1975). Cognitive representations of semantic categories. Journal of Experimental Psychology, 104(3), 192–233.

14.

Snodgrass

J. G.

McCullough

(1986). The role of visual similarity in picture categorization. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12(1), 147–154.

15.

Snodgrass

J. G.

Vanderwart

(1980). A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory, 6(2), 174–215.