Although medical mistrust (MM) may be an impediment to public health interventions, no MM scale has been validated across countries and the assessment of MM has not been explored using item response theory, which allows generalisation beyond the sampled data. We aimed to determine the dimensionality of a brief MM measure across four countries through Mokken analysis and Graded Response Modelling. Analysis of 1468 participants from UK (n = 1179), Ireland (n = 191), India (n = 49) and Malaysia (n = 49) demonstrated that MM items formed a hierarchical, unidimensional measure, which is very informative about high levels of MM. Possible item reduction and scoring changes were also demonstrated. This study demonstrates that this brief MM measure is suitable for international studies as it is unidimensional across countries, cross cultural, and shows that minor adjustments will not impact on the assessment of MM when using these items.
AdamsLBRichmondJCorbie-SmithG, et al (2017) Medical mistrust and colorectal cancer screening among African Americans. Journal of Community Health42: 1044–1061.
BenkertRCuevasAThompsonHS, et al (2019) Ubiquitous yet unclear: A systematic review of medical mistrust. Behavioral Medicine45: 86–101.
4.
BooneWJStaverJRYaleMS (2014) Fit. In: BooneWJStaverJRYaleMS (eds) Rasch Analysis in the Human Sciences. Dordrecht, The Netherlands: Springer, pp.159–190.
5.
ChenWHRevickiDALaiJS, et al (2009) Linking pain items from two studies onto a common scale using item response theory. Journal of Pain and Symptom Management38(4): 615–628.
6.
CrutzenRPetersGY (2017) Scale quality: Alpha is an inadequate estimate and factor-analytic evidence is needed first of all. Health Psychology Review11(3): 242–247.
7.
DeMarsCE (2011) A review of “the theory and practice of item response theory”. International Journal of Testing11: 211–214.
8.
DeVellisRF (2006) Classical test theory. Medical Care44(11 Suppl. 3): S50–S59.
9.
DimaAL (2018) Scale validation in applied health research: Tutorial for a 6-step R-based psychometrics protocol. Health Psychology and Behavioral Medicine6: 136–161.
10.
DohertySDolanEFlynnJ, et al (2017) Circumventing the ‘Ick’ factor: A randomized trial of the effects of omitting affective attitudes questions to increase intention to become an organ donor. Frontiers in Psychology8: 1443.
DoyleFMorganKMathewM, et al (2019) Theory content, question-behavior effects, or form of delivery effects for intention to become an organ donor? Two randomized trials. International Journal of Environmental Research and Public Health16(7): E1304.
13.
EdelenMOReeveBB (2007) Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research16: 5–18.
14.
FayersP (2004) Item response theory for psychologists. Quality of Life Research13: 715–716.
15.
FeveileHOlsenOHoghA (2007) A randomized trial of mailed questionnaires versus telephone interviews: Response patterns in a survey. BMC Medical Research Methodology7: 27.
16.
GalvanFHBogartLMKleinDJ, et al (2017) Medical mistrust as a key mediator in the association between perceived discrimination and adherence to antiretroviral therapy among HIV-positive Latino men. Journal of Behavioral Medicine40(5): 784–793.
17.
GaskinCJHappellB (2014) On exploratory factor analysis: A review of recent evidence, an assessment of current practice, and recommendations for future use. International Journal of Nursing Studies51: 511–521.
18.
GoffRRWilkARTollAE, et al. (2021) Navigating the COVID-19 pandemic: Initial impacts and responses of the Organ Procurement and Transplantation Network in the United States. American Journal of Transplantation: Official Journal of the American Society of Transplantation and the American Society of Transplant Surgeons21(6): 2100–2112.
19.
GooldSD (2002) Trust, distrust and trustworthiness: Lessons from the field. Journal of General Internal Medicine17: 79–81.
20.
GregoireJHambletonRK (2009) Advances in test adaptation research: A special issue. International Journal of Testing9: 75–77.
21.
GuadagnoloBACinaKHelbigP, et al (2009) Medical mistrust and less satisfaction with health care among native americans presenting for cancer treatment. Journal of Health Care for the Poor and Underserved20(1): 210–226.
22.
HambletonR (2004) Applications of item response theory to improve health outcomes assessment: Developing item banks, linking instruments, and computer-adaptive testing. In: LipscombJGotayCSnyderC (eds) Outcomes Assessment in Cancer: Measures, Methods and Applications. Cambridge: Cambridge University Press, pp.445–464.
23.
HardinHKMcCarthyVLSpeckBJ, et al (2018) Diminished trust of healthcare providers, risky lifestyle behaviors, and low use of health services: A descriptive study of rural adolescents. The Journal of School Nursing34(6): 458–467.
24.
HardouinJ-B (2004) MSP: Stata module to perform the Mokken Scale Procedure. The Stata Journal. Boston College Department of Economics. Available at: https://ideas.repec.org/c/boc/bocode/s439402.html (accessed 30 July 2020).
25.
HaysRDMoralesLSReiseSP (2000) Item response theory and health outcomes measurement in the 21st century. Medical Care38(9 Suppl): II28–II42.
26.
HenrichJHeineSJNorenzayanA (2010) The weirdest people in the world?The Behavioral and Brain Sciences33(2–3): 61–135.
27.
HussainAAliSAhmedM, et al. (2018) The anti-vaccination movement: A regression in modern medicine. Cureus10(7): e2919.
28.
JabrayilovREmonsWHMSijtsmaK (2016) Comparison of Classical test theory and item response theory in individual change assessment. Applied Psychological Measurement40(8): 559–572.
29.
KolvaERosenfeldBLiuY, et al (2017) Using item response theory (IRT) to reduce patient burden when assessing desire for hastened death. Psychological Assessment29(3): 349–353.
30.
LarsonHJClarkeRMJarrettC, et al (2018) Measuring trust in vaccination: A systematic review. Human Vaccines & Immunotherapeutics14: 1599–1609.
31.
LoCurtoJBergGM (2016) Trust in healthcare settings: Scale development, methods, and preliminary determinants. Sage Open Medicine4: 2050312116664224.
32.
MillerJCurrieSO’CarrollRE (2019) ‘What if I’m not dead?’ Myth-busting and organ donation. British Journal of Health Psychology24(1): 141–158.
33.
MithraPRavindraPUnnikrishnanB, et al (2013) Perceptions and attitudes towards organ donation among people seeking healthcare in tertiary care centers of coastal south India. Indian Journal of Palliative Care19(2): 83–87.
34.
MontagueE (2010) Validation of a trust in medical technology instrument. Applied Ergonomics41(6): 812–821.
35.
MorganSEHarrisonTRAfifiWA, et al (2008a) In their own words: The reasons why people will (not) sign an organ donor card. Health Communication23(1): 23–33.
36.
MorganSEStephensonMTHarrisonTR, et al (2008b) Facts versus ‘feelings’: How rational is the decision to become an organ donor?Journal of Health Psychology13(5): 644–658.
37.
OckeyGJ (2012) Item response theory. In: FulcherGDavidsonF (eds) The Routledge Handbook of Language Testing. Abingdon: Routledge.
38.
OpelDJLoBPeekME (2021) Addressing mistrust about COVID-19 vaccines among patients of color. Annals of Internal Medicine174: 698–700. DOI: 10.7326/m21-0055
39.
OzawaSSripadP (2013) How do you measure trust in the health system? A systematic review of the literature. Social Science & Medicine91: 10–14.
40.
O’CarrollREShepherdLHayesPC, et al (2016) Anticipated regret and organ donor registration: A randomized controlled trial. Health Psychology35(11): 1169–1177.
41.
PalamenghiLBarelloSBocciaS, et al (2020) Mistrust in biomedical research and vaccine hesitancy: The forefront challenge in the battle against COVID-19 in Italy. European Journal of Epidemiology35: 785–788.
42.
PallantJFTennantA (2007) An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology46: 1–18.
43.
PellowskiJAPriceDMAllenAM, et al (2017) The differences between medical trust and mistrust and their respective influences on medication beliefs and ART adherence among African-Americans living with HIV. Psychology and Health32(9): 1127–1139.
44.
PetrilloJCanoSJMcLeodLD, et al (2015) Using classical test theory, item response theory, and rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value in Health18(1): 25–34.
45.
QuinnKGKellyJADiFranceiscoWJ, et al (2018) The health and sociocultural correlates of AIDS genocidal beliefs and medical mistrust among African American MSM. AIDS and Behavior22(6): 1814–1825.
RoseAPetersNSheaJA, et al (2004) Development and testing of the health care system distrust scale. Journal of General Internal Medicine19: 57–63.
48.
RothmanAJ (2004) Guttman scale. In: KazdinAE (ed.) Encyclopedia of Psychology, vol. 4. Washington, DC: American Psychological Association, pp.44–45.
49.
RussellERobinsonDHThompsonNJ, et al (2012) Distrust in the healthcare system and organ donation intentions among African Americans. Journal of Community Health37(1): 40–47.
50.
SahayM (2019) Men are from mars, women are from venus: Gender disparity in transplantation. Indian Journal of Transplantation13(4): 237.
51.
ŞahinAAnılD (2017) The effects of test length and sample size on item parameters in item response theory. Kuram ve Uygulamada Egitim Bilimleri17: 321–335. DOI: 10.12738/estp.2017.1.0270
52.
SamejimaF (1997) Graded response model. In: van der LindenWJHambletonRK (eds) Handbook of Modern Item Response Theory. Springer. https://doi.org/10.1007/978-1-4757-2691-6_5
53.
SaundersJ (2017) Trust and mistrust between patients and doctors. In: SchrammeTEdwardsS (eds) Handbook of the Philosophy of Medicine. Dordrecht, The Netherlands: Springer, pp.487–502.
54.
SaxLJGilmartinSKBryantAN (2003) Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education44: 409–432.
55.
SheltonRCWinkelGDavisSN, et al (2010) Validation of the group-based medical mistrust scale among urban black men. Journal of General Internal Medicine25(6): 549–555.
56.
SheppardVBHuei-Yu WangJHurtado-de-MendozaA, et al (2019) Psychometric properties of the Medical Mistrust Index (MMI) in Latina immigrants. Behavioral Medicine45(2): 128–133.
57.
SijtsmaKMolenaarI (2011) Introduction to Nonparametric Item Response Theory. London: SAGE Publications, Inc.
58.
SmirnoffMWiletsIRaginDF, et al (2018) A paradigm for understanding trust and mistrust in medical research: The Community VOICES study. AJOB Empirical Bioethics9(1): 39–47.
StataCorp (2019) Stata: Software for statistics and data science. Stata Statistical Software. Available at: https://www.stata.com/ (accessed 30 July 2020).
61.
SullivanLS (2020) Trust, risk, and race in American medicine. Hastings Center Report50(1): 18–26.
62.
SwaminathanHHambletonRKRogersHJ (2006) 21 assessing the fit of item response theory models. Handbook of Statistics26: 683–718.
63.
TaberJMLeyvaBPersoskieA (2015) Why do people avoid medical care? A qualitative study using national data. Journal of General Internal Medicine30(3): 290–297.
64.
TarkaP (2018) An overview of structural equation modeling: Its beginnings, historical development, usefulness and controversies in the social sciences. Quality & Quantity52(1): 313–354.
65.
The R Foundation (2018) R: The R project for statistical computing. The R Foundation. Available at: https://www.r-project.org/ (accessed 30 July 2020).
66.
ThompsonHSValdimarsdottirHBWinkelG, et al (2004) The group-based medical mistrust scale: Psychometric properties and association with breast cancer screening. Preventive Medicine38(2): 209–218.
67.
van SchuurWH (2003) Mokken scale analysis: Between the Guttman scale and parametric item response theory. Political Analysis11: 139–163.
68.
VincentBKumarGParameswaranS, et al (2019) Barriers and suggestions towards deceased organ donation in a government tertiary care teaching hospital: Qualitative study using socio-ecological model framework. Indian Journal of Transplantation13(3): 194.
69.
WatsonREgberinkIJLKirkeL, et al (2018) What are the minimal sample size requirements for mokken scaling? An empirical example with the warwick- edinburgh mental well-being scale. Health Psychology and Behavioral Medicine6: 203–213.
70.
WatsonRvan der ArkLALinLC, et al (2012) Item response theory: How Mokken scaling can be used in clinical practice. Journal of Clinical Nursing21(19–20): 2736–2746.
71.
WilliamsDRMohammedSA (2009) Discrimination and racial disparities in health: Evidence and needed research. Journal of Behavioral Medicine32(1): 20–47.
72.
WilliamsonLDBigmanCA (2018) A systematic review of medical mistrust measures. Patient Education and Counseling101: 1786–1794.
73.
XiaJTangZWuP, et al (2019) Use of item response theory to develop a shortened version of the EORTC QLQ-BR23 scales. Scientific Reports9(1): 1–10.
74.
YangFMKaoST (2014) Item response theory for measurement validity. Shanghai Archives of Psychiatry26(3): 171–177.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
