Research on human trust in automated systems has been frequently limited by the use of inappropriate and inaccurate scales of human-machine trust. An attempt is made here to validate a scale proposed by Jian, Bisantz, and Drury (2000) that measures trust and distrust in automated systems. Sixty participants completed a patient monitoring task with the aid of an imperfect signaling system. Confirmatory factor analyses were conducted using LISREL 8.0 to determine the best fitting measurement model. Chi-square difference tests indicated that the best fitting model was the 2-factor oblique model. These results suggest that when using the System Trust Scale, researchers should treat trust as a multi-dimensional construct comprising of two distinct, yet related, factors. Implications for future research and measurement development are discussed.
Get full access to this article
View all access options for this article.
References
1.
AllenM. J.YenW. M. (1979). Introduction to measurement theory. Long Grove, IL: Waveland Press Inc.
2.
BarberB. (1983). The logic and limits of trust. New Brunswick, NJ: Rutgers University Press.
3.
BenamatiJ.ServaM.A.FullerM.A. (2006). Are trust and distrust distinct constructs? An empirical study of the effects of trust and distrust among online banking users. Proceedings of the 39th Annual Hawaii International Conference on System Sciences, Jan., 121b.
4.
BlissJ. P.ActonS. A. (2003). Alarm mistrust in automobiles: How collision alarm reliability affects driving. Applied Ergonomics, 34, 499–509.
5.
BlissJ. P.DunnM. C. (2000). Behavioral implications of alarm distrust as a function of task workload. Ergonomics, 43, 1283–1300.
6.
BlissJ. P.GilsonR. D.DeatonJ. E. (1995). Human probability matching behaviour in response to alarms of varying reliability. Ergonomics, 38, 2300–2312.
7.
BrownR. D.GalsterS. M. (2004). Effects of reliable and unreliable automation on subjective measures of mental workload, situation awareness, trust, and confidence in dynamic flight task. In Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society, New Orleans; LA, pp 147–151.
8.
FallonC. K.BustamanteE. A.ElyK. M.BlissJ. P. (2005). Improving user trust with a likelihood alarm display. In Proceeding of the 11th International Conference on Human-Computer Interaction. (Las Vegas, NV).
9.
JianJ.BisantzA. M.DruryC. G. (2000). Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4, 53–71.
10.
JohnsJ. L. (1996). A concept analysis of trust. Journal of Advanced Nursing, 24, 76–83.
11.
JohnsonJ. D. (2004). Type of automation failure: The effects on trust and reliance in automation. Unpublished masters thesis, Georgia Institute of Technology, Georgia.
LeeJ. D.MorayN. (1994). Trust, self-confidence, and operators' adaptation to automation. International Journal of Human-Computer Studies, 40, 153–84.
14.
LeeJ. D.SeeK. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46, 50–80.
15.
MadhavanP.WiegmannD. A. (2005). Cognitive anchoring on self-generated decisions reduces operator reliance on automated diagnostic aids. Human Factors, 47 (2), 332–341.
16.
MayerR. C.DavisJ. H.SchoormanF. D. (1995). An integrative model of organizational trust. Academy of Management Review, 20, 709–734.
17.
McKnightD.H.ChervanyN.L. (2001). Trust and distrust definitions: One bite at a time. In FalconeR.SinghM.TanY.H. (Eds.), Trust in Cyber-Societies: Integrating the Human and Artificial Perspectives.Berlin: Springer, pp. 27–54.
18.
MuirB. M. (1989). Operators' trust in and percentage of time spent using the automatic controllers in a supervisory process control task. Unpublished doctoral dissertation. University of Toronto. Toronto.
19.
MuirM. B.MorayN. (1996). Trust in automation, Part II: Experimental studies of trust and human interaction in a process control simulation. Ergonomics, 39, 429–460.
20.
ParasuramanR.RileyV. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230–253.
21.
RempelJ. K.HolmesJ. G.ZannaM. P. (1985). Trust in close relationships. Journal of Personality and Social Psychology, 49, 95–112.
22.
RoviraE.McGarryK.ParasuramanR. (2007). Effects of imperfect automation on decision making in a simulated command and control task. Human Factors, 49, 78–87.
23.
SafarJ. A.TurnerC. W. (2005). Validation of a two factor structure for system trust. In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society. Orlando: FL, pp. 497–501.
24.
SanchezJ. (2006). Factors that affect trust and reliance on an automated aid. Unpublished doctoral dissertation. Georgia Institute of Technology, Atlanta.
25.
SinghI. L.MolloyR.ParasuramanR. (1993) Automation-induced complacency–Development of the complacency potential rating scale. The International Journal of Aviation Psychology, 3, 111–122.
26.
SpainR. D.BlissJ. P. (under review). The effects of sonification pulse rate and system reliability on perceived workload and trust.
27.
WickensC. D.HollandsJ. G. (2000). Engineering psychology and human performance.3rd ed. Upper Saddle River, NJ: Prentice Hall.
