This research investigates security screeners’ knowledge and the effect that differences in knowledge have on the performance of problem-solving activities. We argue that the development of problem-solving knowledge enables security screeners to perform effective problem-solving activity, which assists search and decision-making processes.
Background
Airport security screening research has investigated the many variables that affect security screeners’ search and decision making during simulated threat-detection tasks. Although search and decision making are essential aspects of security screening, few studies have investigated the problem-solving knowledge and activities that support security screening task performance.
Method
Sixteen more-experienced and 24 less-experienced security screeners were observed as they performed x-ray screening in the field at an Australian international airport’s departure security checkpoint. Participants wore eye-tracking glasses and delivered concurrent verbal protocol.
Results
When interacting with other security screeners, more-experienced screeners demonstrated situational knowledge more than less-experienced screeners, whereas less-experienced screeners experienced more insufficient knowledge. Lag-sequential analysis using combined data from both screener groups showed that situational knowledge facilitated effective problem-solving activity to support search and decision making. Insufficient knowledge led screeners to seek assistance and defer decision making.
Conclusion
This study expands current understandings of airport security screening. It demonstrates that security screeners develop knowledge that is specific to problem solving. This knowledge assists effective problem-solving activity to support search and decision making, and to mitigate uncertainty during the x-ray screening task.
Application
Findings can inform future security screening processes, screener training, and technology support tools. Furthermore, findings are potentially transferable to other domains.
AltmannE. M.TraftonJ. G. (2002). Memory for goals: An activation-based model. Cognitive Science, 26, 39–83.
2.
AndersonC. J. (2003). The psychology of doing nothing: Forms of decision avoidance result from reason and emotion. Psychological Bulletin, 129, 139–167.
3.
AndersonJ. R. (1982). Acquisition of cognitive skill. Psychological Review, 89, 369–406.
4.
BastickT. (2003). Intuition: Evaluating the construct and its impact on creative thinking. Kingston, Jamaica: Stoneman and Lang.
5.
BiggsA. T.KramerM. R.MitroffS. R. (2018). Using cognitive psychology research to inform professional visual search operations. Journal of Applied Research in Memory and Cognition, 7, 189–198.
6.
BordiaP.HobmanE.JonesE.GalloisC.CallanV. J. (2004). Uncertainty during organizational change: Types, consequences, and management strategies. Journal of Business and Psychology, 18, 507–532.
7.
BowmanH.SuL.WybleB.BarnardP. J. (2011). Salience sensitive control, temporal attention and stimulus-rich reactive interfaces. In RodaC. (Ed.), Human attention in digital environments (pp. 114–143). Cambridge, UK: Cambridge University Press.
ChiM. T. H.GlaserR.FarrM. J. (Eds.). (1988). The nature of expertise. Hillsdale, NJ: Lawrence Erlbaum.
10.
CookeN. J. (1994). Varieties of knowledge elicitation techniques. International Journal of Human-Computer Studies, 41, 801–849.
11.
CookeN. J. (1999). Knowledge elicitation. In DursoF. T.NickersonR. S.SchvaneveldtR. W.DumaisS. T.LindsayD. S.ChiM. T. H. (Eds.), Handbook of applied cognition (pp. 479–509). Chichester, UK: John Wiley.
12.
CuomoD. L. (1994). Understanding the applicability of sequential data analysis techniques for analysing usability data. Behaviour & Information Technology, 13, 171–182.
13.
de JongT.Ferguson-HesslerM. G. M. (1996). Types and qualities of knowledge. Educational Psychologist, 31, 105–113.
14.
DreyfusS. E.DreyfusH. L. (2005). Peripheral vision: Expertise in real world contexts. Organization Studies, 25, 779–792.
15.
DruryC. G. (1975). Inspection of sheet materials—Model and data. Human Factors, 17, 257–265.
16.
EndsleyM. R. (2018). Expertise and situation awareness. In EricssonA. K.HoffmanR. R.KozbeltA.WilliamsA. M. (Eds.), The Cambridge handbook of expertise and expert performance (2nd ed.). Cambridge, MA: Cambridge University Press.
17.
EricssonA. K. (2018). Capturing expert thought with protocol analysis: Concurrent verbalizations of thinking during experts’ performance on representative tasks. In EricssonA. K.HoffmanR. R.KozbeltA.WilliamsA. M. (Eds.), The Cambridge handbook of expertise and expert performance (2nd ed., pp. 192–212). Cambridge, UK: Cambridge University Press.
18.
FlintJ. D.HaleK.GibbG.KudrickB.WilsonD. P. (2014, January). Protocol analysis for x-ray threat detection screeners. Paper presented at the Industrial and Systems and Engineering Research Conference, Montreal, Québec, Canada.
19.
GallweyT. J. (1998). Evaluation and control of industrial inspection: Part I—Guidelines for the practitioner. International Journal of Industrial Ergonomics, 22, 37–49.
20.
GhylinK. M.DruryC. G.SchwaningerA. (2006, July). Two-component model of security inspection: Application and findings. Paper presented at the 16th World Congress of Ergonomics, IEA 2006, Maastricht, The Netherlands.
21.
GhylinK. M.SchwaningerA.DruryC. G.RedfordJ.LinL.BattaR. (2008, September22–26). Screening enhancements: Why don’t they enhance performance?Paper presented at the Human Factors and Ergonomics Society 52nd Annual Meeting, New York, NY.
22.
GlöcknerA.HerboldA.-K. (2011). An eye-tracking study on information processing in risky decisions: Evidence for compensatory strategies based on automatic processes. Journal of Behavioral Decision Making, 24, 71–98.
23.
GoldbergJ. H.KotvalX. P. (1999). Computer interface evaluation using eye movements: Methods and constructs. International Journal of Industrial Ergonomics, 24, 631–645.
24.
GravesI.BataviciusM.MacLeodV.HeyerR.ParsonsK.KuesterN.. . . JohnsonR. (2011). The role of the human operator in image-based airport security technologies. In JainL. C.AidmanE. V.AbeynayakeC. (Eds.), Studies in computational intelligence: Innovations in defence support systems–2 (Vol. 338, pp. 147–181). Berlin, Germany: Springer.
25.
HalbherrT.SchwaningerA.BudgellG. R.WalesA. (2013). Airport security screener competency: A cross-sectional and longitudinal analysis. The International Journal of Aviation Psychology, 23, 113–129.
26.
HallgrenK. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8, 23–34.
27.
HammondK. R.HammR. M.GrassiaJ.PearsonT. (1997). Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment. In GoldsteinW. M.HogarthR. M. (Eds.), Research on judgement and decision making: Currents, connections and controversies (pp. 144–180). New York, NY: Cambridge University Press.
28.
HarrisD. H. (2002). How to really improve airport security. Ergonomics in Design, 10, 17–22.
29.
HättenschwilerN.MendesM.SchwaningerA. (2019). Detecting bombs in x-ray images of hold baggage: 2D versus 3D imaging. Human Factors, 61, 305–321.
30.
HayhoeM.BallardD. (2005). Eye movements in natural behavior. Trends in Cognitive Sciences, 9, 188–194.
31.
HoferF.SchwaningerA. (2004, October11–14). Reliable and valid measures of threat detection performance in X-ray screening. Paper presented at the 38th Annual 2004 International Carnahan Conference on Security Technology, Albuquerque, NM.
JohnstoneR. W. (2015). Protecting transportation. Boston, MA: Butterworth-Heinemann.
34.
KleinG. A.CalderwoodR.MacGregorD. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19, 462–473.
35.
KlockB. A. (2005, October11–14). Test and evaluation report for x-ray detection of threats using different x-ray functions. Paper presented at the CCST ’05, 39th Annual International Carnahan Conference on Security Technology, Las Palmas, Spain.
36.
KollerS. M.DruryC. G.SchwaningerA. (2009). Change of search time and non-search time in x-ray baggage screening due to training. Ergonomics, 52, 644–656.
37.
KollerS. M.HardmeierD.MichelS.SchwaningerA. (2008). Investigating training, transfer and viewpoint effects resulting from recurrent CBT of x-ray image interpretation. Journal of Transportation Security, 1, 81–106.
38.
KrügerJ. K.SuchanB. (2015). Humans are still the critical factor in aviation security. Aerospace Medicine and Human Performance, 86, 915–917.
39.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
40.
LipshitzR.StraussO. (1997). Coping with uncertainty: A naturalistic decision-making analysis. Organizational Behavior and Human Decision Processes, 69, 149–163.
41.
LiuX.GaleA. (2011, July9–14). Air passengers’ luggage screening: What is the difference between naïve people and airport screeners?Paper presented at the Engineering Psychology and Cognitive Ergonomics, Orlando, FL.
42.
LiuX.GaleA.SongT. (2007, October8–11). Detection of terrorist threats in air passenger luggage: Expertise development. Paper presented at the 41st Annual IEEE International Carnahan Conference on Security Technology, Ottawa, Ontario, Canada.
43.
MaguireR. L.McClumphaA.TatlockK. B. (2002, September). Using cognitive theory to enhance aviation security x-ray screening. Paper presented at the Human Factors and Ergonomics Society 46th Annual Meeting, Santa Monica, CA.
44.
MandlerG. (1985). Cognitive psychology: An essay in cognitive science. Hillsdale, NJ: Lawrence Erlbaum.
45.
McCarleyJ. S.KramerA. F.WickensC. D.VidoniE. D.BootW. R. (2004). Visual skills in airport-security screening. Psychological Science, 15, 302–306.
46.
MichelS.KollerS.RuhM.SchwaningerA. (2006). The effect of image enhancement functions on x-ray detection performance. Paper presented at the 4th International Aviation Security Technology Symposium, Washington, DC.
47.
MichelS.SchwaningerA. (2009, October5–8). Human-machine interaction in x-ray screening. Paper presented at the 43rd Annual International Carnahan Conference on Security Technology, Zurich, Switzerland.
48.
NickolsF. (2000). The knowledge in knowledge management. In WoodsJ. A.CortadJ. (Eds.), The knowledge management yearbook 2000-2001 (pp. 12–21). Boston, MA: Butterworth-Heinemann.
NormanD. A.ShalliceT. (1986). Attention to action: Willed and automatic control of behaviour. In DavidsonR. J.SchwartzG. E.ShapiroD. (Eds.), Consciousness and self-regulation—Advances in research and theory (1st ed., Vol. 4, pp. 1–18). New York, NY: Springer Science + Business Media.
51.
OlsonJ. R.BiolsiK. J. (1991). Techniques for representing expert knowledge. In EricssonA. K.SmithJ. (Eds.), Toward a general theory of expertise: Prospects and limits (pp. 240–285). New York, NY: Cambridge University Press.
52.
ParkS.ParkS. S.LimY.-k.LeeG.HahnM. (2009, April4–9). Designing attention-aware peripheral displays with gaze-based notification control. Paper presented at the CHI 2009, Boston, MA.
53.
PattersonK.NestorP. J.RogersT. T. (2007). Where do you know what you know? The representation of semantic knowledge in the human brain. Nature, 8, 976–988.
54.
PhyeG. D.SandersC. E. (1992). Accessing strategic knowledge: Individual differences in procedural and strategy transfer. Contemporary Educational Psychology, 17, 211–223.
55.
PohlM.WallnerG.KriglsteinS. (2016). Using lag-sequential analysis for understanding interaction sequences in visualizations. International Journal of Human-Computer Studies, 96, 54–66.
56.
PylyshynZ. W. (2003). Life and mind: Seeing and visualizing: It’s not what you think. Cambridge, MA: MIT Press.
57.
RiegelnigJ.SchwaningerA. (2006, June24–28). The influence of age and gender on detection performance and the response bias in x-ray screening. Paper presented at the 2nd International Conference on Research in Air Transportation (ICRAT) 2006, Belgrade, Serbia and Montenegro.
58.
RodaC.ThomasJ. (2005). Attention aware systems. In GhaouiC. (Ed.), Encyclopedia of HCI (pp. 38–44). Hershey, PA: IDEA Group.
59.
SalasE.RosenM. A.DiazGranadosD. (2009). Expertise-based intuition and decision making in organizations. Journal of Management, 36, 941–973.
SchrawG. (1998). Promoting general metacognitive awareness. Instructional Science, 26, 113–125.
62.
SchwaningerA. (2005, October). X-ray imagery: Enhancing the value of the pixels. Aviation Security International, pp. 16–21.
63.
SchwaningerA.BolfingA.HalbherrT.HelmanS.BelyavinA.HayL. (2008, June1–4). The impact of image based factors and training on threat detection performance in x-ray screening. Paper presented at the Third International Conference on Research in Air Transportation, Fairfax, VA.
64.
SchwaningerA.HardmeierD.HoferF. (2005). Aviation security screeners visual abilities & visual knowledge measurement. IEEE Aerospace and Electronic Systems Magazine, 20, 29–35.
65.
SchwaningerA.HardmeierD.RiegelnigJ.MartinM. (2010). Use it and still lose it? The influence of age and job experience on detection performance in x-ray screening. The Journal of Gerontopsychology and Geriatric Psychiatry, 23, 169–175.
66.
SchwaningerA.HoferF. (2004). Evaluation of CBT for increasing threat detection performance in x-ray screening. In MorganK.SpectorM. J. (Eds.), The internet society 2004, advances in learning, commerce and security (pp. 147–156). Wessex, UK: WIT Press.
67.
SchwaningerA.WalesA. J. W. (2009, April). One year later: How screener performance improves in x-ray luggage search with computer-based training. Paper presented at the Contemporary Ergonomics 2009: Proceedings of the International Conference on Contemporary Ergonomics 2009, London, England.
68.
SeeJ. E.DruryC. G.SpeedA.WilliamsA.KhalandiN. (2017). The role of visual inspection in the 21st century. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61, 262–266.
69.
ShanteauJ. (1992). Competence in experts: The role of task characteristics. Organizational Behavior and Human Decision Processes, 53, 252–266.
70.
SheridanH.ReingoldE. M. (2017). The holistic processing account of visual expertise in medical image perception: A review. Frontiers in Psychology, 8, Article 1620.
71.
SimJ.WrightC. C. (2005). The kappa statistic in reliability studies: Use, interpretation, and sample size requirements. Physical Therapy, 85, 257–268.
72.
SinclairM.AshkanasyN. M. (2005). Intuition: Myth or a decision-making tool?Management Learning, 36, 353–370.
73.
SpitzG.DruryC. G. (1978). Inspection of sheet materials—Test of model predictions. Human Factors, 20, 521–528.
74.
SwannL.PopovicV.MasonW.MacMahonB. (2017, December). Taxonomy of interactions and the design of the airport passenger screening process. Paper presented at the IASDR 2017: Re:Research, Cincinnati, OH.
75.
van GogT.PaasF.van MerriënboerJ. J. G. (2005). Uncovering expertise-related differences in troubleshooting performance: Combining eye movement and concurrent verbal protocol data. Applied Cognitive Psychology, 19, 205–221.
76.
van SomerenM. W.BarnardY. F.SandbergJ. A. C. (1994). The think aloud method: A practical guide to modelling cognitive processes. London, England: Academic Press.
77.
VicenteK. J.RasmussenJ. (1992). Ecological interface design: Theoretical foundations. IEEE Transactions on Systems, Man, and Cybernetics, 22, 589–606.
78.
WalesA. J. W.AndersonC.JonesK.SchwaningerA.HorneJ. A. (2009). Evaluating the two-component inspection model in a simplified luggage search task. Behavior Research Methods, 41, 937–943.
79.
WetterO. E. (2013). Imaging in airport security: Past, present, future, and the link to forensic and clinical radiology. Journal of Forensic Radiology and Imaging, 1, 152–160.
80.
WolfeJ. M.HorowitzT. S. (2017). Five factors that guide attention in visual search. Nature Human Behaviour, 1, 0058.
81.
WolfeJ. M.Van WertM. J. (2010). Varying target prevalence reveals two dissociable decision criteria in visual search. Current Biology, 20, 121–124.
82.
WolfeJ. M.VõM. L. H.EvansK. K.GreeneM. R. (2011). Visual search in scenes involves selective and non-selective pathways. Trends in Cognitive Sciences, 15, 77–84.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
