Increasing the transfer of simulation technology from R&D into school settings: An approach to evaluation from overarching vision to individual artifact in education
Restricted accessResearch articleFirst published online June, 2006
Increasing the transfer of simulation technology from R&D into school settings: An approach to evaluation from overarching vision to individual artifact in education
Building and evaluating artifacts specifically for K-12 education, technologists committed to design sciences are needed along with an approach to evaluation increasing the systemic transfer from research and development into school settings. The authors describe THE VIRTUAL LAB scanningelectronic microscope simulation, including (a) its development from a design and project management perspective at NASA and (b) the formative evaluation, drawing on a usability study conducted in high school science classrooms by University of Central Florida. The authors offer a four-level assessment that begins with the overarching vision that guided developers. Over time, a team of evaluators (a) verify (the artifact), (b) check variation (of content), (c) verify (in context), and (d) document value (in the field of education). THE VIRTUAL LAB usability study is offered as a specific example in the evaluation process using both quantitative and qualitative data while responding and contributing to an overarching vision for education.
Abt, C. C. (1971). Serious games. New York: Viking.
2.
Bransford, J. D., Sherwood, R. D., Hasselbring, T. S., Kinzer, C. K., & Williams, S. M. (1990). Anchored instruction:Why we need it and how technologycan help. In D. Nix & R. Spiro (Eds.), Cognition,education, & multimedia (pp. 115-142). Hillsdale, NJ: Lawrence Erlbaum.
3.
Crookall, D., & Arai, K. (1995). Simulation and gaming across disciplines and cultures: ISAGA at a watershed. Thousand Oaks, CA: Sage.
4.
Cross, R. T., & Price, R. F. (1999). The social responsibility of science and the public understanding of science. International Journal of Science Education, 21, 775-785.
5.
Dekkers, J., & Donatti, S. (1981). The integration of research studies on the use of simulation as an instructional strategy. Journal of Educational Research, 74, 424-427.
6.
Dumas, J. S., & Redish, J. C. (1993). A practical guide to usability testing. Norwood, NJ: Ablex.
7.
Ellul, J. (1954). The technological society. New York: Vintage.
8.
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (Rev. ed.). Cambridge, MA: MIT Press.
9.
Fraser, B. J. (1981). TOSRA:The Test of Science-Related Attitudes handbook. Hawthorn: Australian Council for Educational Research Limited.
10.
Geban, O., Askar, P., & Ozkan, I. (1992). Effects of computer simulations and problem-solving approaches on high school students. Journal of Educational Research, 86, 5-10.
11.
Hammersley, M. (2000). The relevance of qualitative research. Oxford Review of Education, 26, 393-405.
12.
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004).Design science in informationsystems research. MIS Quarterly, 28, 75-105.
13.
Hoban, C. (1971).Instructionas a systematic approachto instructional technology. In S. G. Tickton (Ed.), To improve learning:Anevaluationof instructionaltechnology (Vol.2,pp.131-138).New York:Bowker.
14.
Huppert, J., Lomask, S. M., & Lazarowitz, R. (2002). Computer simulations in the high school: Students’ cognitive stages, science process skills and academic achievement in microbiology. International Journal of Science Education, 24, 803-821.
15.
Klabbers, J. H. G. (2000). Learning as acquisition and learning as interaction. Simulation & Gaming, 31, 380-406.
16.
Klabbers, J. H. G. (2003a). Gaming and simulation: Principles of a science of design. Simulation & Gaming, 34, 569-591.
17.
Klabbers, J. H. G. (2003b). The gaming landscape: A taxonomy for classifying games and simulations. In M. Copier & J. Raessens (Eds.), Level up: Digital Games Research conference (pp. 54-67). Utrecht, the Netherlands: Utrecht University.
18.
Klabbers, J. H. G. (2003c). Simulation and gaming: Introduction to the art and science of design. Simulation & Gaming, 34, 488-494.
19.
Klabbers, J. H. G. (2006). A framework for artifact assessment and theory testing. Simulation & Gaming, 37(2), 155-173.
20.
Kriz, W. (2003). Creating effective interactive learning environments and learning organizations through gaming simulation design. Simulation & Gaming, 34, 495-511.
21.
Kwon, Y. J., & Lawson, A. E. (2000). Linking brain growth with the development of scientific reasoning abilityandconceptualchangeduringadolescence. Journalof Research in Science Teaching, 37, 44-62.
22.
Lohberg, R., & Lutz, T. (1968). Electronic brains. New York: Bantam Books.
23.
Moreno, R., & Mayer, R. E. (2002). Learning science in virtual reality multimedia environments: Role of methods and media. Journal of Educational Psychology, 94, 598-610.
24.
Morgan, K. (2000). Cross-cultural considerations for simulation-based learning environments. Simulation & Gaming, 31, 491-508.
25.
Scardamalia, M., & Bereiter, C. (1991). Higher levels of agency for children in knowledge building: A challenge for the design of new knowledge media. Journal of the Learning Sciences, 1, 37-68.
26.
Schank, R. C., & Jona, M. Y. (1991). Empowering the student: New perspectives on the design of teaching systems. Journal of the Learning Sciences, 1, 7-35.
27.
Spector, J. M., Christensen, D. L., Sioutine, A. V., & McCormack, D. (2001). Models and simulations for learning in complex domains: Using causal loop diagrams for assessment and evaluation. Computers in Human Behavior, 17, 517-545.
28.
Tytler, R. (2001). Dimensions of evidence: The public understanding of science and science education. International Journal of Science Education, 23, 815-832.
29.
van Aken, J. E. (2004). Management research based on the paradigm of the design sciences: The quest for field-tested and grounded technological rules. Journal of Management Studies, 41, 219-246.
30.
Wenglinsky, H. (1998). Does it compute? The relationship between educational technology and student achievement in mathematics. Princeton, NJ: Educational Testing Service.
