Formed through experience, observation, and learning, mental models are used in decision making to understand, predict, and solve problems. The investigation and application of mental models research are a growing area of scholarly inquiry in human resource development (HRD) and adult education, yet debate about how to best elicit such knowing still persists. Therefore, exemplars for eliciting the mental models of individuals are a matter of importance. The goal of this article is to address some of the issues central to mental model research and the methodological problems faced by scholars and provide an approach to mental model elicitation that holds promise for attending to some of the issues raised in the article. Multi-method Mental Model Elicitation (MMME) overcomes some of the limitations of current approaches, thus helping to increase the utility of mental models research in the field of HRD.
ArcidiaconoC.ProcenteseF. (2005). Distinctiveness and sense of community in the historical center of Naples: A piece of participatory action research. Journal of Community Psychology, 33, 631-638.
2.
AzzarelloJ.WoodD. E. (2006). Assessing dynamic mental models: Unfolding case studies. Nurse Educator, 31, 10-14.
3.
BagnoliA. (2009). Beyond the standard interview: The use of graphic elicitation and arts-based methods. Qualitative Research, 9, 547-570.
4.
BarrettJ. D.PetersonD. R.HesterK. S.RobledoI. C.DayE. A.HougenD. P.MumfordM. D. (2013). Thinking about applications: Effects on mental models and creative problem-solving. Creativity Research Journal, 25, 199-212. doi:10.1080/10400419.2013.783758
5.
BaynesJ.HerbohnJ.RussellI. (2011). The influence of farmers’ mental models on an agroforestry extension program in the Philippines. Small-Scale Forestry, 10, 377-387. doi:10.1007/s11842-010-9154-7
6.
BordageG. (1994). Elaborated knowledge: A key to successful diagnostic thinking. Academic Medicine, 69, 883-885.
7.
BordageG.LemieuxM. (1991). Semantic Structures and diagnostic thinking of experts and novices. Academic Medicine, 66(9, Suppl.), S70-S72.
8.
BostromA.WalkerA. H.ScottT.PaviaR.LeschineT. M.StarbirdK. (2015). Oil spill response risk judgments, decisions, and mental models: Findings from surveying US stakeholders and coastal residents. Human and Ecological Risk Assessment: An International Journal, 21, 581-604. doi:10.1080/10807039.2014.947865
9.
BuchananD. (1998). Representing process: The contribution of a re-engineering frame. International Journal of Operations & Production Management, 18, 1163-1188.
10.
BugentalJ. F.ZelenS. L. (1950). Investigations into the “self-concept” I: The W-A-Y technique. Journal of Personality, 18, 483-498.
11.
ByramS.FischhoffB.EmbreyM.de BruinW. B.ThorneS. (2001). Mental models of women with breast implants regarding local complications. Behavioral Medicine, 27, 4-14.
12.
CarleyK.PalmquistM. (1992). Extracting, representing, and analyzing mental models. Social Forces, 70, 601-636.
13.
ChenJ. Q.LeeS. M. (2003). An exploratory cognitive DSS for strategic decision making. Decision Support Systems, 36, 147-160.
14.
ChermackT. J. (2003). Mental models in decision making and implications for human resource development. Advances in Developing Human Resources, 5, 408-422.
15.
ChermackT. J.SongJ. H.NimonK. F.ChoiM.KorteR. F. (2012). The development and assessment of an instrument for measuring mental model styles in Korea. Learning and Performance Quarterly, 1(1), 1-20.
16.
CollierJ. (1957). Photography in anthropology: A report on two experiments. American Anthropologist, 59, 843-859.
17.
CraikK. J. (1943). The nature of explanation. Cambridge, UK: Cambridge University Press.
18.
CrandellT. L.KleidN. A.SoderstonC. (1996). Empirical evaluation of concept mapping: A job performance aid for writers. Technical Communication, 43, 157-163.
19.
DanielsK.de ChernatonyL.JohnsonG. (1995). Validating a method of mapping managers’ mental models of competitive industry structures. Human Relations, 48, 975-991.
20.
DarisiT.ThorneS.IacobelliC. (2005). Influences on decision-making for undergoing plastic surgery: A mental models and quantitative assessment. Plastic and Reconstructive Surgery, 116, 907-916.
21.
DiefenbachT. (2009). Are case studies more than sophisticated storytelling? Methodological problems of qualitative empirical research mainly based on semi-structured interviews. Quality & Quantity, 43, 875-894.
22.
DorseyD. W.CampbellG. E.FosterL. L.MilesD. E. (1999). Assessing knowledge structures: Relations with experience and posttraining performance. Human Performance, 12, 31-57.
DudzinskiD. (2010). An interpretive study of African Americans’ mental models of museums and visitation: “…you think, damn, so close, but yet so far.” (Unpublished doctoral dissertation). University of Connecticut, Storrs, CT.
25.
EckertE.BellA. A. (2005). Invisible force: Farmers’ mental models and how they influence learning and actions. Journal of Extension, 43(3). Retrieved from http://www.joe.org/joe/2005june/a2.php
26.
EckertE.BellA. A. (2006). Continuity and change: Themes of mental model development among small-scale farmers. Journal of Extension, 44(1). Retrieved from http://www.joe.org/joe/2006february/a2.php
27.
EllisS.DavidiI. (2005). After-event reviews: Drawing lessons from successful and failed experience. Journal of Applied Psychology, 90, 857-871.
28.
EricssonC. W.ChaseW. G.FaloonS. (1980). Acquisition of a memory skill. Science, 208, 1181-1182.
29.
FaroughS. D. (2006). Believing is seeing: The matrix of vision and white masculinities. Journal of Contemporary Ethnography, 35, 51-83.
30.
FeeneyA.HandleyS. J. (2006). Comparisons, mental models, and the action effect in judgments of regret. Memory & Cognition, 34, 1422-1430.
31.
FeolaG.BinderC. R. (2010). Why don’t pesticide applicators protect themselves? Exploring the use of personal protecting equipment among Colombian smallholders. International Journal of Occupational and Environmental Health, 16, 11-23.
32.
FraserK. M. (1993). Theory based use of concept mapping in organization development: Creating shared understanding as a basis for the cooperative design of work changes and changes in working relationships (Unpublished doctoral dissertation). Cornell University, Ithaca, NY.
33.
FreemanL.JessupL. (2004). The power and benefits of concept mapping: Measuring use, usefulness, ease of use, and satisfaction. International Journal of Science Education, 26, 151-169.
34.
GalloM. L. (2002). Picture this: Immigrant workers use photography for communication and change. Journal of Workplace Learning, 14, 49-57.
35.
GarnerR. (1988). Verbal-report data on cognitive and metacognitive strategies. In WeinsteinC.GoetzE.AlexanderP. (Eds.), Learning and study strategies: Issues in assessment, instruction, and evaluation (pp. 63-100). San Diego, CA: Academic Press.
36.
GentnerD. (2002). Psychology of mental models. In SmelserN. J.BatesP. B. (Eds.), International encyclopedia of the social and behavioral sciences (pp. 9683-9687). Amsterdam, The Netherlands: Elsevier.
37.
GlendonK.UlrichD. L. (1997). Unfolding cases: An experiential learning model. Nurse Educator, 22(4), 15-18.
38.
GlickM. B.ChermackT. J.LuckelH.GauckB. Q. (2012). Effects of scenario planning on participant mental models. European Journal of Training and Development, 36, 488-507.
39.
GreenD. W.McManusI. C. (1995). Cognitive structural models: The perception of risk and prevention in coronary heart disease. British Journal of Psychology, 86, 321-336.
40.
GubriumJ. F.HolsteinJ. A. (Eds.). (2002). Handbook of interview research: Context and method. Thousand Oaks, CA: SAGE.
41.
HagemannK. S.ScholdererJ. (2007). Consumer versus expert hazard identification: A mental models study of mutation-bred rice. Risk Research, 10, 449-464.
42.
HartleyW. S. (1970). Manual for the twenty statements problem. Kansas City, MO: Greater Kansas City Mental Health Foundation.
43.
HimesD. O.RavertP. K. (2012). Situated peer coaching and unfolding cases in the fundamentals skills laboratory. International Journal of Nursing Education Scholarship, 9, 265-272. doi:10.1515/1548-923X.2335
44.
HjortsøC. N.ChristensenS. M.TarpP. (2005). Rapid stakeholder and conflict assessment for natural resource management using cognitive mapping: The case of Damdoi Forest Enterprise, Vietnam. Agriculture and Human Values, 22, 149-167.
45.
HodgkinsonG. P.MauleA. J.BownN. J. (2004). Causal cognitive mapping in the organizational strategy field: A comparison of alternative elicitation procedures. Organizational Research Methods, 7, 3-26.
46.
HofstadterD. R. (2001). Analogy as the core of cognition. In GentnerD.HolyoakK. J.KokinovB. N. (Eds.), The analogical mind: Perspectives from cognitive science (pp. 499-538). Cambridge, MA: The MIT Press.
47.
HolsteinJ. A.GubriumJ. F. (1995). The active interview. Thousand Oaks, CA: SAGE.
48.
HysongS. J.BestR. G.PughJ. A.MooreF. I. (2005). Not of one mind: Mental models of clinical practice guidelines in the Veterans Health Administration. Health Services Research, 40, 829-848.
49.
IfenthalerD. (2010). Relational, structural, and semantic analysis of graphical representations and concept maps. Educational Technology Research & Development, 58, 81-97. doi:10.1007/s11423-008-9087-4
50.
JohnsonB. B. (2003). Do reports on drinking water quality affect customers’ concerns? Experiments in report content. Risk Analysis, 23, 985-998.
51.
JohnsonH. H. (2008). Mental models and transformative learning: The key to leadership development?Human Resource Development Quarterly, 19, 85-89.
52.
JohnsonS. D. (1995). Invited reaction: Measuring mental models-thoughts on a research agenda. Human Resource Development Quarterly, 6, 257-262.
53.
Johnson-LairdP. (1983). Mental Models: Towards a cognitive science of language, inference, and consciousness. Cambridge, UK: Cambridge University Press.
54.
JonesN. A.RossH.LynamT.PerezP. (2014). Eliciting mental models: A comparison of interview procedures in the context of natural resource management. Ecology and Society, 19(1), Article 13. doi:10.5751/ES-06248-190113
55.
JonesN. A.RossH.LynamT.PerezP.LeitchA. (2011). Mental models: An interdisciplinary synthesis of theory and methods. Ecology and Society, 16(1), Article 46. Retrieved from http://www.ecologyandsociety.org/vol16/iss1/art46/
56.
JungkA.ThullB.HoeftA.RauG. (2000). Evaluation of two new ecological interface approaches for the anesthesia workplace. Journal of Clinical Monitoring & Computing, 16, 243-258.
57.
KaraniR.LeipzigR. M.CallahanE. H.ThomasD. C. (2004). An unfolding case with a linked objective structured clinical examination (OSCE): A curriculum in inpatient geriatric medicine. Journal of the American Geriatrics Society, 52, 1191-1198.
KearneyA. R.KaplanS. (1997). Toward a methodology for the measurement of knowledge structures of ordinary people: The Concept Content Cognitive Map (3CM). Environment and Behavior, 29, 5, 579-617. doi: 10.1177/0013916597295001
60.
KudikyalaU. K.VaughnR. B. (2005). Software requirement understanding using Pathfinder networks: Discovering and evaluating mental models. The Journal of Systems and Software, 74, 101-108.
61.
KuhnM. H.McPartlandT. S. (1954). An empirical investigation of self-attitudes. American Sociological Review, 68-76.
62.
KvaleS. (1996). Interviews: An introduction to qualitative research interviewing. Thousand Oaks, CA: SAGE.
63.
Langan-FoxJ.CodeS.Langfield-SmithK. (2000). Team mental models: Techniques, methods, and analytic approaches. Human Factors, 43, 242-271.
64.
MarkmanA. B.GentnerD. (2001). Thinking. Annual Review of Psychology, 52, 223-247.
65.
MathieuJ. E.HeffnerT. S.GoodwinG. F.SalasE.Cannon-BowersJ. A. (2000). The influence of shared mental models on team process and performance. Journal of Applied Psychology, 85, 273-283.
66.
McGaghieW. C.McCrimmonD. R.MitchellD.ThompsonJ. A. (2004). Concept mapping in pulmonary physiology using Pathfinder scaling. Advances in Health Sciences Education, 9, 225-240.
67.
MemonT.LuJ.HussainF. K. (2013). An enhanced mental model elicitation technique to improve mental model accuracy. Neural Information Processing, 8226, 82-89.
68.
NadkarniS. (2003). Instructional methods and mental models of students: An empirical investigation. Academy of Management Learning & Education, 2, 335-351.
69.
NakamuraK. (2008). A case against giving informants cameras and coming back weeks later. Anthropology News, 49(2), 20.
70.
NathanM. J. (1991). A simple learning environment improves mathematical reasoning. Intelligent Tutoring Media, 2, 101-111.
71.
NonakaI.TakeuchiH. (1995). The knowledge-creating company: How Japanese companies create the dynamics of innovation. New York, NY: Oxford University Press.
72.
NovakJ. D.GowinD. R. (1984). Learning how to learn. New York, NY: Cambridge University Press.
73.
PaskG.ScottB. C. E. (1972). Learning strategies and individual competence. International Journal of Man-Machine Studies, 4, 217-253.
74.
PatelV. L.ArochaJ. F.DiermeierM.HowJ.Mottur-PilsonC. (2001). Cognitive psychological studies of representation and use of clinical practice guidelines. International Journal of Medical Informatics, 63, 147-167.
Porter-WenzlaffsL. J. (2013). Unfolding multicourse case study: Developing students’ administrative competencies. Nurse Educator, 38, 241-245. doi:10.1097/01.NNE.0000435263.15495.9f
77.
ReddingR. E.CannonJ. R. (1992). Expertise in air traffic control (ATC): What is it, and how can we train for it? In Proceedings of the Human Factors Society 36th Annual Meeting (pp. 1326-1330). Santa Monica, CA: Human Factors and Ergonomics Society.
78.
ReesA.NicholsonN. (1994). The Twenty Statements Test. In CassellC.SymonG. (Eds.), Qualitative methods in organizational research: A practical guide. pp. 37-54. London, England: SAGE.
79.
RookL. (2013). Mental models: A robust definition. The Learning Organization: An International Journal, 20, 38-47. doi:10.1108/09696471311288519
80.
RoweA. L.CookeN. J. (1995). Measuring mental models: Choosing the right tools for the job. Human Resource Development Quarterly, 6, 243-255.
81.
RoweA. L.CookeN. J.HallE. P.HalgrenT. L. (1996). Toward an on-line knowledge assessment methodology: Building on the relationship between knowing and doing. Journal of Experimental Psychology: Applied, 2, 31-47.
82.
RuonaW. E. A. (1999). Theory in “theory to practice:” Voices of practitioners. In KuchinkeK. P. (Ed.), AHRD conference proceedings (pp. 888-896). Bowling Green, OH: Academy of Human Resource Development.
83.
SaeedA.BlainN.ForbesD. (1999). New ethnic and national questions in Scotland: Post-British identities among Glasgow Pakistani teenagers. Ethnic and Racial Studies, 22, 821-844.
84.
SchmidtH. J. (2004). Alternative approaches to concept mapping and implications for medical education: Commentary on reliability, validity and future research directions. Advances in Health Sciences Education, 9, 251-256.
85.
SchwirianK. P. (1964). Variation in structure of the Kuhn-McPartland Twenty Statements Test and related response difference. The Sociological Quarterly, 5, 47-59.
86.
SeelN. M. (2001). Epistemology, situated cognition, and mental models: “Like a bridge over troubled water.”Instructional Science, 29, 403-427.
87.
SengeP. M. (1990). The fifth discipline: The art and practice of the learning organization. New York, NY: Doubleday.
88.
SengeP. M.KleinerA.RobertsC.RossR.RothG.SmithB. (2000). The dance of change: The challenges of sustaining momentum in learning organizations. New York, NY: Doubleday.
89.
SowaJ. (1992). Semantic networks. In ShapiroS. (Ed.), Encyclopedia of artificial intelligence (2nd ed.). New York, NY: John Wiley.
90.
StraussA. (1956). The social psychology of George Herbert Mead. Chicago, IL: University of Chicago.
91.
SwansonR. A. (1994). Analysis for improving performance: Tools for diagnosing and documenting workplace expertise. San Francisco, CA: Berrett-Koehler.
92.
TrautnerB. W.BhimaniR. D.AmspokerA. B.HysongS. J.GarzaA.KellyP. A.. . .NaikA. D. (2013). Development and validation of an algorithm to recalibrate mental models and reduce diagnostic errors associated with catheter-associated bacteriuria. BMC Medical Informatics & Decision Making, 13(1), Article 48. doi:10.1186/1472-6947-13-48
93.
Van der VeerG.Puerta MelguizoM. (2003). Mental models. In JackoJ. A.SearsA. (Eds.), The human-computer interaction handbook: Fundamentals, evolving technologies, and emerging applications (pp. 52-80). Hillsdale, MI: Lawrence Erlbaum.
94.
van RekomJ.GoF. M.CalterD. M. (2014). Communicating a company’s positive impact on society—Can plausible explanations secure authenticity?Journal of Business Research, 67, 1831-1838.
95.
WangC.BurrisM. A. (1997). Photovoice: Concept, methodology, and use for participatory needs assessment. Health Education & Behavior, 24, 369-387.
96.
WangJ.WangG. G. (2006). Exploring national human resource development: A case of China management development in a transitioning context. Human Resource Development Review, 5, 176-201.
97.
WestC.UsherK.DelaneyL. J. (2012). Unfolding case studies in pre-registration nursing education: Lessons learned. Nurse Education Today, 32, 576-580. doi:10.1016/j.nedt.2011.07.002
98.
WilsonR. S.TuckerM. A.HookerN. H.LeJeuneJ. T.DoohanD. (2008). Perceptions and beliefs about weed management: Perspectives of Ohio grain and produce farmers. Weed Technology, 22, 339-350.
99.
WilsonT. D. (1994). The proper protocol: Validity and completeness of verbal reports. Psychological Science, 5, 249-252.
100.
ZhangX.ChignellM. (2001). Assessment of the effects of user characteristics on mental models of information retrieval systems. Journal of the American Society for Information Science and Technology, 52, 445-459.
