Where occupational performance outcomes are difficult to measure, there is a tendency to associate expertise with years of experience and/or previous occupational position. Although useful, these indicators represent composite constructs that embody a number of different variables, only some of which may be strongly associated with the transition to expertise. In identifying an alternative measure of expertise, it is necessary to consider the cognitive processes associated with expert performance, in particular, the role of cue utilization. The present study, conducted in the context of software engineering, was designed to test the relationship between cue utilization and self, peer, and error management indicators of expertise. The results indicated that participants who exhibited relatively higher levels of cue utilization were significantly more likely to self-report engaging in behaviors associated with expert decision making, to be nominated as an expert by their peers, and to demonstrate superior error management when developing solutions to development problems.
AbernethyM. A.HorneM.LillisA. M.MalinaM. A.SeltoF. H. (2005). A multi-method approach to building causal performance maps from expert knowledge. Management Accounting Research, 16, 135–155. doi:10.1016/j.mar.2005.03.003
2.
AckermanP. L.KanferR.GoffM. (1995). Cognitive and noncognitive determinants and consequences of complex skill acquisition. Journal of Experimental Psychology: Applied, 1, 270–304. doi:10.1037/1076-898X.1.4.270
3.
AhmedS.WallaceK. M.BlessingL. T. M. (2003). Understanding the differences between how novice and experienced designers approach design tasks. Research in Engineering Design, 14, 1–11. doi:10.1007/S00163-002-0023-Z
4.
AnderssonP. (2004). Does experience matter in lending? A process-tracing study on experienced loan officers’ and novices’ decision behavior. Journal of Economic Psychology, 25, 471–492. doi:10.1016/S0167-4870(03)00030-8
5.
ArthurW.DoverspikeD. (2001). Predicting motor vehicle crash involvement from a personality measure and a driving knowledge test. Journal of Prevention & Intervention in the Community, 22, 35–42. doi:10.1080/10852350109511209
6.
AutonJ. C.WigginsM. W.SearleB. J.LovedayT.Xu RattanasoneN. (2013). Prosodic cues used during perceptions of nonunderstandings in radio communication. Journal of Communication, 63, 600–616. doi:10.1111/jcom.12033
7.
BartlettM. S. (1954). A note on multiplying factors for various chi-squared approximations. Journal of the Royal Statistical Society, Series B, 16, 296–298.
8.
BatraD.DavisJ. G. (1992). Conceptual data modelling in database design: Similiarities and differences between expert and novice designers. International Journal of Man–Machine Studies, 37, 83–101. doi:10.1016/0020-7373(92)90092-Y
9.
BloomB. S. (1985). Developing talent in young people. New York, NY: Ballantine Books.
10.
BrunswikE. (1955). Representative design and probabilistic theory in a functional psychology. Psychological Review, 62, 193–217. doi:10.1037/h0047470
11.
ChevalierA.IvoryM. Y. (2003). Web site designs: Influences of designer’s expertise and design constraints. International Journal of Human–Computer Studies, 58, 57–87. doi:10.1016/S1071-5819(02)00126-X
12.
CoderreS.MandinH.HarasymP. H.FickG. H. (2003). Diagnostic reasoning strategies and diagnostic success. Medical Education, 37, 695–703. doi:10.1046/j.1365-2923.2003.01577.x
13.
Department of Education, Employment, and Workplace Relations. (2011). ABS labour force survey. Canberra, Australia: Author.
14.
EnisC. R. (1995). Expert–novice judgments and new cue sets: Process versus outcome. Journal of Economic Psychology, 16, 641–642. doi:10.1016/0167-4870(95)00029-8
15.
EricssonK. A. (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 79(10), S70–S81.
16.
EricssonK. A.CharnessN.FeltovichP.HoffmanR. R. (2006). The Cambridge handbook of expertise and expert performance. New York, NY: Cambridge University Press.
EricssonK. A.LehmannA. C. (1996). Expert and exceptional performance: Evidence of maximal adaption to task constraints. Annual Review of Psychology, 47, 273–305. doi:10.1146/annurev.psych.47.1.273
19.
EttensonR.ShanteauJ.KrogstadJ. (1987). Expert judgment: Is more information better?Psychological Reports, 60, 227–238. doi:10.2466/pr0.1987.60.1.227
20.
FrederiksenC.KehoeE. J.WoodR. E. (2011). Effects of instructional aids on the acquisition of dynamic decision-making skills. Learning and Instruction, 21, 601–613. doi:10.1016/j.learninstruc.2011.01.002
21.
GaleA. G.WalkerG. E. (1993). Visual search in breast cancer screening. In BroganD.GaleA.CarrK. (Eds.), Visual search 2 (pp. 231–228). London, UK: Taylor & Francis.
22.
GobetF.SimonH. A. (1996). The roles of recognition processes and look-ahead search in time-constrained expert problem solving: Evidence from grand-master-level chess. Psychological Science, 7, 52–55. doi:10.2307/40062907
23.
GreitzerF. L.PodmoreR.RobinsonM.EyP. (2010). Naturalistic decision making for power system operators. International Journal of Human–Computer Interaction, 26, 278–291. doi:10.1080/10447310903499070
24.
GrovesM.O’RourkeP.AlexanderH. (2003). The clinical reasoning characteristics of diagnostic experts. Medical Teacher, 25, 308–313. doi:10.1080/0142159031000100427
25.
GullyS. M.PayneS. C.Kiechel KolesK. L.WhitemanJ. A. (2002). The impact of error training and individual differences on training outcomes: An attribute-treatment interaction perspective. Journal of Applied Psychology, 87, 143–155. doi:10.1037/0021-9010.87.1.143
26.
HaeremT.RauD. (2007). The influence of degree of expertise and objective task complexity on perceived task complexity and performance. Journal of Applied Psychology, 92, 1320–1331. doi:10.1037/0021-9010.92.5.1320
27.
HayesJ. R. (1989). The complete problem solver (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
28.
HeilmanM. E.StopeckM. H. (1985). Being attractive, advantage or disadvantage? Performance-based evaluations and recommended personnel actions as a function of appearance, sex, and job type. Organizational Behavior and Human Decision Processes, 35, 202–215. doi:10.1016/0749-5978(85)90035-4
29.
HiggsJ.JonesM. (2008). Clinical decision making and multiple problem spaces. In HiggsJ.JonesM.LoftusS.ChristensenN. (Eds.), Clinical reasoning in the health professions (pp. 3–18). Oxford, UK: Elsevier Health Sciences.
30.
JasperM. A. (1994). Expert: A discussion of the implications of the concept as used in nursing. Journal of Advanced Nursing, 20, 769–776. doi:10.1046/j.1365-2648.1994.20040769.x
31.
JohannaB. I.Van Der HeijdenM. (2000). The development and psychometric evaluation of a multi-dimensional measurement instrument of professional expertise. High Ability Studies, 11, 9–39. doi:10.1080/713669175
32.
KingG.BartlettD. J.CurrieM.GilpinM.BaxterD.WilloughbyC.TuckerM. A.StrachanD. (2008). Measuring the expertise of paediatric rehabilitation therapists. International Journal of Disability, Development and Education, 55, 5–26. doi:10.1080/10349120701654522
KleinG. (2008). Naturalistic decision making. Human Factors, 50, 456–460. doi:10.1518/001872008X288385
35.
KrahmerE.SwertsM.TheuneM.WeegelsM. (2001). Error detection in spoken human–machine interaction. International Journal of Speech Technology, 4, 19–30. doi:10.1023/a:1009648614566
36.
LoftS.RemingtonR. W. (2010). Prospective memory and task interference in a continuous monitoring dynamic display task. Journal of Experimental Psychology: Applied, 16, 145–157. doi:10.1037/a0018900
37.
LoftS.SmithR. E.BhaskaraA. (2011). Prospective memory in an air traffic control simulation: External aids that signal when to act. Journal of Experimental Psychology: Applied, 17, 60–70. doi:10.1037/a0022845
38.
LovedayT.WigginsM. W.FestaM.SchellD.TwiggD. (2013). Pattern recognition as an indicator of diagnostic expertise. In CarmonaP.LatorreSanchezJ. S.FredA. L. N. (Eds.), Pattern recognition: Applications and methods (Vol. 204, pp. 1–11). Berlin, Germany: Springer.
39.
LovedayT.WigginsM. W.HarrisJ. M.O’HareD.SmithN. (2013). An objective approach to identifying diagnostic expertise among power system controllers. Human Factors, 55, 90–107. doi:10.1177/0018720812450911
40.
LovedayT.WigginsM. W.SearleB. J.FestaM.SchellD. (2013). The capability of static and dynamic features to distinguish competent from genuinely expert practitioners in pediatric diagnosis. Human Factors, 55, 125–137. doi:10.1177/0018720812448475
MorrisonB. W.WigginsM. W.BondN. W.TylerM. D. (2009, June). Examining cue recognition across expertise using a computer-based task. Paper presented at the NDM9, the 9th International Conference on Naturalistic Decision Making, London, UK.
43.
MüllerS.AbernethyB.FarrowD. (2006). How do world-class cricket batsman anticipate a bowler’s intention?Quarterly Journal of Experimental Psychology, 59, 2162–2186. doi:10.1080/02643290600576595
44.
MurinsonB. B.AgarwalA. K.HaythornthwaiteJ. A. (2008). Cognitive expertise, emotional development, and reflective capacity: Clinical skills for improved pain care. Journal of Pain, 9, 975–983. doi:10.1016/j.jpain.2008.07.010
45.
NormanG. R.CoblentzG. L.BrooksL. R.BabcookC. J. (1992). Expertise in visual diagnosis: A review of the literature. Academic Medicine, 67(10 Suppl.), S78–83.
46.
O’HareD.WigginsM. W.WilliamsA.WongW. (2000). Cognitive task analysis for decision centred design and training. In AnnettJ.StantonN. A. (Eds.), Task analysis (pp. 170–190). London, UK: Taylor & Francis.
47.
PalmerD. J.StoughL. M.BurdenskiJ. T. K.GonzalesM. (2005). Identifying teacher expertise: An examination of researchers’ decision making. Educational Psychologist, 40, 13–25. doi:10.1207/s15326985ep4001_2
48.
PauleyK.O’HareD.WigginsM. W. (2009). Measuring expertise in weather-related aeronautical risk perception: The validity of the Cochran-Weiss-Shanteau (CWS) index. International Journal of Aviation Psychology, 19, 201–216. doi:10.1080/10508410902979993
49.
PostlethwaiteB.RobbinsS.RickersonJ.McKinnissT. (2009). The moderation of conscientiousness by cognitive ability when predicting workplace safety behavior. Personality and Individual Differences, 47, 711–716. doi:10.1016/j.paid.2009.06.008
50.
RasmussenJ. (1983). Skills, rules, and knowledge: Signals, signs, and symbols, and other distinctions in human performance models. IEEE Transactions on Systems, Man, and Cybernetics, SMC-13, 257–266. doi:10.1109/TSMC.1983.6313160
51.
RobillardP. N. (1999). The role of knowledge in software development. Communications of the ACM, 42, 87–92. doi:10.1145/291469.291476
52.
RoweR.HorswillM. S.Kronvall-ParkinsonM.PoulterD. R.MckennaF. P. (2009). The effect of disguise on novice and expert tennis players anticipation ability. Journal of Applied Sport Psychology, 21, 178–185. doi:10.1080/10413200902785811
53.
SavelsberghG. J. P.Van der KampJ.WilliamsA. M.WardP.BroganD. (2005). Anticipation and visual search behaviour in expert soccer goalkeepers. Ergonomics, 48, 1686–1697. doi:10.1080/00140130500101346
54.
SchriverA. T.MorrowD. G.WickensC. D.TalleurD. A. (2008). Expertise differences in attentional strategies related to pilot decision making. Human Factors, 50, 864–878. doi:10.1518/001872008X374974
55.
SchvaneveldtR. W.BeringerD. B.LamonicaJ. A. (2001). Priority and organization of information accessed by pilots in various phases of flight. International Journal of Aviation Psychology, 11, 253–280. doi:10.1207/S15327108IJAP1103_02
56.
ShanteauJ. (1992). How much information does an expert use? Is it relevant?Acta Psychologica, 81, 75–86. doi:10.1016/0001-6918(92)90012-3
57.
SimonH. A. (1981). The sciences of the artificial (2nd ed.). Cambridge, MA: MIT Press.
58.
SimonH. A.ChaseW. G. (1973). Skill in chess. American Scientist, 61, 394–403.
59.
SimonH. A.DantzigG. B.HogarthR. M.PlottC. R.RaiffaH.SchellingT. C.. . . WinterS. (1987). Decision making and problem solving. Interfaces, 17(5), 11–31. doi:10.1287/inte.17.5.11
60.
SimontonD. K. (1991). Emergence and realization of genius: The lives and works of 120 classical composers. Journal of Personality and Social Psychology, 61, 829–840. doi:10.1037/0022-3514.61.5.829
61.
SkovholtT. M.RønnestadM. H.JenningsL. (1997). Searching for expertise in counseling, psychotherapy, and professional psychology. Educational Psychology Review, 9, 361–369. doi:10.1023/A:1024798723295
62.
SonnentagS. (1998). Expertise in professional software design: a process study. Journal of Applied Psychology, 83, 703–715. doi:10.1037/0021-9010.83.5.703
63.
SullivanM. E.HitchcockM. A.DunningtonG. L. (1999). Peer and self assessment during problem-based tutorials. American Journal of Surgery, 177, 266–269. doi:10.1016/s0002-9610(99)00006-9
64.
TabachnickB. G.FidellL. S. (1996). Using multivariate statistics (3rd ed.). New York, NY: Harper Collins College.
65.
TynjäläP.NuutinenA.EteläpeltoA.KirjonenJ.RemesP. (1997). The acquisition of professional expertise: A challenge for educational research. Scandinavian Journal of Educational Research, 41, 475–494. doi:10.1080/0031383970410318
66.
WeissD. J.ShanteauJ. (2003). Empirical assessment of expertise. Human Factors, 45, 104–114. doi:10.1518/hfes.45.1.104.27233
67.
WiegmannD. A.GohJ.O’HareD. (2002). The role of situation assessment and flight experience in pilots’ decisions to continue visual flight rules flight into adverse weather. Human Factors, 44, 189–197. doi:10.1518/0018720024497871
68.
WigginsM. W. (2005). The interpretation and use of weather radar displays in aviation. Canberra, Australia: Australian Transport Safety Bureau.
69.
WigginsM. W. (2012). The role of cue utilisation and adaptive interface design in the management of skilled performance in operations control. Theoretical Issues in Ergonomics Science. Advance online publication. doi:10.1080/1463922X.2012.724725
WigginsM. W.O’HareD. (2003a). Expert and novice pilot perceptions of static in-flight images of weather. International Journal of Aviation Psychology, 13, 173–187. doi:10.1207/S15327108IJAP1302_05
72.
WigginsM. W.O’HareD. (2003b). Weatherwise: An evaluation of a cue-based training approach for the recognition of deteriorating weather conditions during flight. Human Factors, 45, 337–345. doi:10.1518/hfes.45.2.337.27246
73.
WigginsM. W.O’HareD. (1995). Expertise in aeronautical weather-related decision making: A cross-sectional analysis of general aviation pilots. Journal of Experimental Psychology: Applied, 1, 305–320. doi:10.1037/1076-898X.1.4.305
74.
WigginsM. W.O’HareD. (2006). Applications of microsimulation in cognitive skills development. In KarwowskiW. (Ed.), Encyclopaedia of ergonomics and human factors (pp. 3254–3259). London, UK: Taylor & Francis.
75.
WoodJ.CollinsJ.BurnsideE. S.AlbaneseM. A.PropeckP. A.KelczF. . . . SchmaltzL. M. (2004). Patient, faculty, and self-assessment of radiology resident performance: A 360-degree method of measuring professionalism and interpersonal/communication skills. Academic Radiology, 11, 931–939. doi:10.1016/j.acra.2004.04.016
76.
YeoG. B.NealA. (2004). A multilevel analysis of effort, practice, and performance: Effects of ability, conscientiousness, and goal orientation. Journal of Applied Psychology, 89, 231–247. doi:10.1037/0021-9010.89.2.231
