The Transfusion Medicine Tutor: A Model for the Design and Use of Expert Systems for Teaching

Abstract

There is a long research history addressing the design of knowledge-based systems for tutoring. There exists, however, very little rigorous empirical data describing the impact of such systems on users. This paper presents the results of two studies that were conducted to investigate the effectiveness of an expert system for teaching medical technology students a complex abduction task, the identification of alloantibodies in a patient's blood. The first study, involving 30 students, showed that those students who used the system with all intelligent tutoring functions turned on and with instructor assistance available went from 0% correct on a pre-test case to 80% − 93% correct on post-tests (p < 0.001). Students in a control group, using a passive version of the system with the tutoring functions turned off, went from 7% correct on a pre-test case to 27% correct on post-tests (non significant; p > 0.05). The results of the second study found that 36 students who used the system with all intelligent tutoring functions enabled but without instructor assistance went from 19% correct on a pre-test to 83% − 86% correct on the post-tests (p < 0.001). In order to better understand the roles of the computer and the teacher in these studies, computer logs and videos collected for each student were analyzed and coded for certain key behaviors.

Get full access to this article

View all access options for this article.

References

Albanese

Mitchell

(1993) Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68, 52–81.

Anderson

J.R.

(1983) The architecture of cognition. Cambridge, MA: Harvard University Press.

Bailey

G.D.

, (ed.) (1993) Computer-Based Integrated Learning Systems. Englewood Cliffs, NJ: Educational Technology Publications.

Barrows

(1988) A taxonomy of problem-based learning. Medical Education, 61, 481–486.

Burton

R.R.

(1982) Diagnosing bugs in a simple procedural skill. In Sleeman

Brown

J. S.

(eds.), Intelligent Tutoring Systems, London: Academic Press, 157–184.

Dempsey

J.V.

Sales

G.C.

, (eds.) (1993) Interactive Instruction and Feedback. Englewood Cliffs, NJ: Educational Technology Publications.

Fox

(1993) The Human Tutorial Dialogue Project: Issues in the Design of Instructional Systems. Hillsdale, NJ: Lawrence Earlbaum.

Gagne

R.M.

(1985) The Conditions of Learning and Theory of Instruction (4th Edition). New York: Holt, Rinehart and Winston.

Galdes

D. K.

(1990) An empirical study of human tutors: The implications for intelligent tutoring systems. Dissertation. The Ohio State University.

10.

Gordon

S.E.

(1994) Systematic Training Program Design: Maximizing Effectiveness and Minimizing Liability. Englewood Cliffs, NJ: Prentice Hall.

11.

Lajoie

S.P.

Lesgold

(1989) Apprenticeship training in the workplace: Computer-coached practice environment as a new form of apprenticeship. Machine-Mediated Learning, 3, 7–28.

12.

Smith

P.J.

Galdes

Fraser

Smith

J. W.

Svirbely

J. R.

Blazina

Kennedy

Rudmann

Thomas

D. L.

(1991) Coping with the complexities of multiple-solution problems: A case study. International Journal of Man-Machine Studies, 35, 429–453.

13.

Smith

P.J.

Miller

T. E.

Fraser

Smith

J. W.

Svirbely

J. R.

Rudmann

Strohm

P. L.

Kennedy

(1991) An empirical evaluation of the performance of antibody identification tasks. Transfusion, 31, 313–317.

14.

Smith

P.J.

Miller

T. E.

Gross

Guerlain

Smith

Svirbely

Galdes

Rudmann

Strohm

(1991) The transfusion medicine tutor: Methods and results from the development of an interactive learning environment for teaching problem-solving skills. Proceedings of the 35th Annual Meeting of the Human Factors Society, 1166–1168.