Sources of Difficulty in Deductive Reasoning: The THOG Task

Abstract

The THOG task presents four designs constructed from two shapes and two colours. Subjects are told that the experimenter has written down one of the shapes and one of the colours and are provided the rule that if, and only if, any design has either the shape or the colour, but not both, written down, then it is a THOG. Finally, they are given an exemplar and are asked to classify the remaining designs. Successful solution requires construction of hypotheses, reasoning under each hypothesis, and comparison of the results under each to reach a final conclusion. Few subjects are able to provide adequate responses on the standard version of the task. We present the results of four experiments, with 160 undergraduates each presented with one of eight versions of the task. Experiments 1 and 2 indicate that (1) some subjects think that the properties that are written down are identical to those of the exemplar, although these are not the same subjects who exhibit the modal error pattern, (2) many subjects correctly understand the disjunction of the rule but fail to consider the hypotheses, and (3) poor initial encoding of the problem is not easily corrected. Experiment 3 investigates the sufficiency of the claim of Griggs and Newstead (1982) that appropriate problem solution follows from explicit presentation of all problem information (including use of positive labels for properties that are not written down), and Experiment 4 investigates the necessity of the claim. The results of Experiments 3 and 4 show that presenting positive category labels does increase the frequency of correct solution; however, positive category labels are not necessary for such improvement. Separation of the labels of the THOG rule from those of the exemplar, or informing subjects that only one other design is a THOG, also increases the frequency of successful solution. The results suggest that many people have some fairly sophisticated reasoning skills. but application of these skills is easily discouraged when the features of the task lead to poor initial encoding.