Assessing Hypermedia Navigation through Pathfinder: Prospects and Limitations

Abstract

In response to the need for more dynamic forms of assessment, our primary aim was to evaluate the validity of Pathfinder for representing and comparing individuals' navigation through a computer-based hypermedia environment. Our secondary aim was to evaluate the validity of Pathfinder for generating an empirically-derived path that represents a set of individual navigational paths. Participants were divided into two groups: a Test-based group and a Problem-based group. Based on prior research, we assumed that these groups would differ with respect to navigation. Pathfinder-generated networks and the related C-measure were used to test the validity of Pathfinder for capturing differences between these groups. The results supported our hypothesis that Pathfinder would be able to distinguish between the two groups. Furthermore, it was shown that, with some modification, Pathfinder was able to generate an empirically-derived network that represented the paths of the individuals in the group from which it was derived.

Get full access to this article

View all access options for this article.

References

Landow

G. P.

, Hypertext: The Convergence of Contemporary Theory and Technology, Johns Hopkins University Press, Baltimore, Maryland, 1992.

Barab

S. A.

Bowdish

B. E.

Young

M. F.

Owen

S. V.

, Understanding Kiosk Navigation: Using Log Files to Capture Hypermedia Searches, Instructional Science, 24, pp. 377–395, 1996.

Lawless

K. A.

Kulikowich

J. M.

, Understanding Hypertext Navigation through Cluster Analysis, Journal of Educational Computing Research, 14:4, pp. 385–399, 1996.

Guthrie

J. T.

Dreher

M. J.

, Literacy as Search: Explorations Via Computer, in Cognition, Education, Multimedia: Exploring Ideas in High Technology, Nix

Spiro

(eds.), Lawrence Erlbaum Associates, Hillsdale, New Jersey, pp. 66–113, 1990.

Bransford

J. D.

Stein

B. S.

, The IDEAL Problem Solver (2nd Edition), W. H. Freeman, New York, 1993.

Roschelle

Clancey

W. J.

, Learning as Social and Neural, Educational Psychologist, 27, pp. 435–453, 1992.

Young

M. F.

Kulikowich

J. M.

Barab

S. A.

, The Unit of Analysis for Situated Assessment, Instructional Science, in press.

Bransford

J. D.

Goldman

S. R.

Vye

N. J.

, Making a Difference in People's Abilities to Think: Reflections on a Decade of Work and Some Hopes for the Future, in Influence on the Development of Children's Thinking, Okagaki

Sternberg

R. J.

(eds.), Erlbaum, Hillsdale, New Jersey, pp. 147–181, 1991.

Cognition and Technology Group at Vanderbilt, Anchored Instruction and Its Relationship to Situated Cognition, Educational Researcher, 19:6, pp. 2–10, 1990.

10.

McLellan

, Evaluation in a Situated Learning Environment, Educational Technology, 33:3, pp. 39–45, 1993.

11.

Young

M. F.

, Instructional Design for Anchored Instruction, Educational Technology Research and Development, 41, pp. 43–58, 1993.

12.

Wittrock

M. C.

, Testing and Recent Research in Cognition, in Testing and Cognition, Wittrock

M. C.

Baker

E. L.

(eds.), Prentice Hall, Englewood Cliffs, New Jersey, pp. 17–30, 1991.

13.

Rowe

A. L.

Cooke

N. J.

Hall

E. P.

Halgren

T. L.

, Toward an On-Line Assessment Methodology: Building on the Relationship between Knowing and Doing, Journal of Experimental Psychology: Applied, 2, pp. 31–47, 1996.

14.

Young

M. F.

McNeese

, A Situated Cognition Approach to Problem Solving with Implications for Computer-Based Learning and Assessment, in Advances in Human Factors/Ergonomics, 19b. Human Computer Interaction: Software and Hardware Interfaces, Salvendy

Smith

M. J.

(eds.), Elsevier Science Publishers, New York, 1993.

15.

Schvaneveldt

R. W.

(ed.), Pathfinder Associative Networks, Ablex, Norwood, New Jersey, 1990.

16.

Goldsmith

T. E.

Davenport

D. M.

, Assessing Structural Similarity of Graphs, in Pathfinder Associative Networks, Schvaneveldt

R. W.

(ed.), Ablex, Norwood, New Jersey, pp. 75–86, 1990.

17.

Gonzalvo

Cañas

J. J.

Bajo

, Structural Representations of Knowledge Acquisition, Journal of Educational Psychology, 86:4, pp. 601–616, 1994.

18.

Dearholt

D. W.

Schvaneveldt

D. M.

, Properties of Pathfinder Networks, in Pathfinder Associative Networks, Schvaneveldt

R. W.

(ed.), Ablex, Norwood, New Jersey, pp. 1–30, 1990.

19.

Rubin

D. C.

, Directed Graphs as Memory Representations: The Case of Rhyme, in Pathfinder Associative Networks, Schvaneveldt

R. W.

(ed.), Ablex, Norwood, New Jersey, pp. 121–132, 1990.

20.

Berger

Walton

Wurman

, Event Recorder, [Computer software], University of Michigan, Ann Arbor, Michigan, 1993.

21.

Goldsmith

T. E.

Johnson

P. J.

Acton

W. H.

, Assessing Structural Knowledge, Journal of Educational Psychology, 83:1, pp. 88–96, 1991.

22.

Gronlund

N. E.

Linn

R. L.

, Measurement and Evaluation in Teaching, Macmillan Publishing Company, New York, 1990.

23.

Glaser

Lesgold

Lajoie

, Toward a Cognitive Theory for the Measurement of Achievement, in The Influence of Cognitive Psychology on Testing and Measurement, Ronning

R. R.

Glover

Conoley

J. C.

Witt

J. C.

(eds.), Erlbaum, Hillsdale, New Jersey, pp. 41–85, 1985.