Shame may increase HIV risk among stigmatized populations. The Personal Feelings Questionnaire–2 (PFQ-2) measures shame, but has not been validated in Spanish-speaking or nonclinical stigmatized populations disproportionately affected by HIV in resource-limited settings. We examined the psychometric properties of the Spanish-translated PFQ-2 shame subscale among female sex workers in two Mexico–U.S. border cities. From 2016 to 2017, 602 HIV-negative female sex workers in Tijuana and Ciudad Juarez participated in an efficacy trial evaluating a behavior change maintenance intervention. Interviewer-administered surveys collected information on shame (10-item PFQ-2 subscale), psychosocial factors, and sociodemographics. Item performance, confirmatory factor analysis, internal consistency, differential item functioning by city, and concurrent validity were assessed. Response options were collapsed to 3-point responses to improve item performance, and one misfit item was removed. The revised 9-item shame subscale supported a single construct and had good internal consistency (Cronbach’s α = .86). Notable differential item functioning was found but resulted in a negligible effect on overall scores. Correlations between the revised shame subscale and guilt (r = .79, p < .01), depression (r = .69, p < .01), and emotional support (r = −.28, p < .01) supported concurrent validity. The revised PFQ-2 shame subscale showed good reliability and concurrent validity in our sample, and should be explored in other stigmatized populations.
AndradeE.LeyvaR.KwanM.-P.MagisC.Stainez-OrozcoH.BrouwerK. (2019). Women in sex work and the risk environment: Agency, risk perception, and management in the sex work environments of two Mexico-U.S. border cities. Sexuality Research and Social Policy, 16(3), 317-328. https://doi.org/10.1007/s13178-018-0318-0
2.
AndrewsB.QianM.ValentineJ. D. (2002). Predicting depressive symptoms with a new measure of shame: The Experience of Shame Scale. British Journal of Clinical Psychology, 41(1), 29-42. https://doi.org/10.1348/014466502163778
3.
AverillP. M.DiefenbachG. J.StanleyM. A.BreckenridgeJ. K.LusbyB. (2002). Assessment of shame and guilt in a psychiatric sample: A comparison of two measures. Personality and Individual Differences, 32(8), 1365-1376. https://doi.org/10.1016/S0191-8869(01)00124-6
4.
BakerF. B. (2001). The basics of item response theory. ERIC.
5.
BaralS.BeyrerC.MuessigK.PoteatT.WirtzA. L.DeckerM. R.ShermanS. G.KerriganD. (2012). Burden of HIV among female sex workers in low-income and middle-income countries: A systematic review and meta-analysis. Lancet Infectious Diseases, 12(7), 538-549. https://doi.org/10.1016/S1473-3099(12)70066-X
6.
BarrP.CacciatoreJ. (2007). Problematic emotions and maternal grief. Omega: Journal of Death and Dying, 56(4), 331-348. https://doi.org/10.2190/OM.56.4.b
7.
BeckA. T.SteerR. A.BrownG. (1996). Manual for the Beck depression inventory-II (BDI-II). Psychological Corporation. https://doi.org/10.1037/t00742-000
8.
BeletskyL.MartinezG.GainesT.NguyenL.LozadaR.RangelG.VeraA.McCauleyH. L.SorensenA.StrathdeeS. A. (2012). El conflicto en la frontera norte de México: daños colaterales a la salud y los derechos humanos en grupos vulnerables [Mexico’s northern border conflict: Collateral damage to health and human rights of vulnerable groups]. Revista Panamericana de Salud Pública, 31(5), 403-410. https://doi.org/10.1590/S1020-49892012000500008
9.
BybeeJ. A.SullivanE. L.ZielonkaE.MoesE. (2009). Are gay men in worse mental health than heterosexual men? The role of age, shame and guilt, and coming-out. Journal of Adult Development, 16(3), 144-154. https://doi.org/10.1007/s10804-009-9059-x
10.
CronbachL. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/BF02310555
11.
CrossleyD.RockettK. (2005). The experience of shame in older psychiatric patients: A preliminary enquiry. Aging and Mental Health, 9(4), 368-373. https://doi.org/10.1080/13607860500131252
12.
de HoogeI. E.ZeelenbergM.BreugelmansS. M. (2011). A functionalist account of shame-induced behaviour. Cognition and Emotion, 25(5), 939-946. https://doi.org/10.1080/02699931.2010.516909
13.
DearingR. L.StuewigJ.TangneyJ. P. (2005). On the importance of distinguishing shame from guilt: Relations to problematic alcohol and drug use. Addictive Behaviors, 30(7), 1392-1404. https://doi.org/10.1038/jid.2014.371
14.
DeVellisR. F. (2016). Scale development: Theory and applications (Vol. 26). Sage.
15.
Di SarnoM.Di PierroR.MadedduF. (2019). Shame- and guilt-proneness in an italian sample: Latent structure and gender invariance of the Personal Feelings Questionnaire-2 (PFQ-2). Current Psychology. Advance online publication. https://doi.org/10.1007/s12144-019-00570-w
16.
DickersonS. S.GruenewaldT. L.KemenyM. E. (2004). When the social self is threatened: Shame, physiology, and health. Journal of Personality, 72(6), 1191-1216. https://doi.org/10.1111/j.1467-6494.2004.00295.x
17.
DorahyM. J.CorryM.ShannonM.WebbK.McDermottB.RyanM.F.w. DyerK. (2013). Complex trauma and intimate relationships: The impact of shame, guilt and dissociation. Journal of Affective Disorders, 147(1-3), 72-79. https://doi.org/10.1016/j.jad.2012.10.010
18.
EterovićM.MedvedV.BilićV.Kozarić-KovačićD.ŽarkovićN. (2019). Poor agreement between two commonly used measures of shame- and guilt-proneness. Journal of Personality Assessment, 102(4), 499-507. https://doi.org/10.1080/00223891.2019.1585361
19.
FergusonT. J.CrowleyS. L. (1997). Measure for measure: A multitrait-multimethod analysis of guilt and shame. Journal of Personality Assessment, 69(2), 425-441. https://doi.org/10.1207/s15327752jpa6902_12
20.
FortenberryJ. D.McFarlaneM.BleakleyA.BullS.FishbeinM.GrimleyD. M.MalotteC. K.StonerB. P. (2002). Relationships of stigma and shame to gonorrhea and HIV screening. American Journal of Public Health, 92(3), 378-381. https://doi.org/10.2105/AJPH.92.3.378
21.
FosterL. R.ByersE. S. (2016). Predictors of the sexual well-being of individuals diagnosed with herpes and human papillomavirus. Archives of Sexual Behavior, 45(2), 403-414. https://doi.org/10.1007/s10508-014-0388-x
22.
GambinM.SharpC. (2018). The relations between empathy, guilt, shame and depression in inpatient adolescents. Journal of Affective Disorders, 241(June), 381-387. https://doi.org/10.1016/j.jad.2018.08.068
23.
GrahamJ. M. (2006). Congeneric and (essentially) tau-equivalent estimates of score reliability: What they are and how to use them. Educational and Psychological Measurement, 66(6), 930-944. https://doi.org/10.1177/0013164406288165
24.
GuadagnoliE.VelicerW. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103(2), 265-275. https://doi.org/10.1037/0033-2909.103.2.265
25.
HarderD. H.ZalmaA. (1990). Two promising shame and guilt scales: A construct validity comparison. Journal of Personality Assessment, 55(3-4), 729-745. https://doi.org/10.1080/00223891.1990.9674108
26.
HarderD. W.CutlerL.RockartL. (1992). Assessment of shame and guilt and their relationships to psychopathology. Journal of Personality Assessment, 59(3), 584-604. https://doi.org/10.1207/s15327752jpa5903_12
27.
HarderD. W.GreenwaldD. F. (1999). Further validation of the shame and guilt scales of the harder Personal Feelings Questionnaire-2. Psychological Reports, 85(1), 271-281. https://doi.org/10.2466/pr0.1999.85.1.271
28.
HutchinsonP.DhairyawanR. (2018). Shame and HIV: Strategies for addressing the negative impact shame has on public health and diagnosis and treatment of HIV. Bioethics, 32(1), 68-76. https://doi.org/10.1111/bioe.12378
29.
KimS.ThibodeauR.JorgensenR. S. (2011). Shame, guilt, and depressive symptoms: A Meta-analytic review. Psychological Bulletin, 137(1), 68-96. https://doi.org/10.1037/a0021466
30.
LiC.-H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936-949. https://doi.org/10.3758/s13428-015-0619-7
31.
LickelB.KushlevK.SavaleiV.MattaS.SchmaderT. (2014). Shame and the motivation to change the self. Emotion, 14(6), 1049-1061. https://doi.org/10.1037/a0038235
32.
MaP. H. X.ChanZ. C. Y.LokeA. Y. (2017). The socio-ecological model approach to understanding barriers and facilitators to the accessing of health services by sex workers: A systematic review. AIDS and Behavior, 21(8), 2412-2438. https://doi.org/10.1007/s10461-017-1818-2
33.
MazzaA.PunzoA.McGuireB. (2014). KernSmoothIRT: An R package for kernel smoothing in item response theory. Journal of Statistical Software, 58(6), 1-34. https://doi.org/10.18637/jss.v058.i06
McNeishD. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412-433. https://doi.org/10.1037/met0000144
36.
MeadeA. W. (2016). Guide to IRT Invariance Using the MIRT Package in R. North Carolina State University.
37.
PattersonT. L.PitpitanE. V.PinesH. A.SempleS. J.Harvey-VeraA.DeppC.MooreD. J.MartinezG.RangelM. G.StrathdeeS. A. (2020). A randomized controlled trial of a texting intervention to maintain sexual risk reduction with clients among female sex workers in Tijuana and Ciudad Juarez, Mexico. AIDS and Behavior, 24(12), 3306-3319. https://doi.org/10.1007/s10461-020-02930-1
38.
PattersonT. L.SempleS. J.AbramovitzD.Harvey-VeraA.PinesH. A.VerdugoS.DeppC.MooreD. J.MartinezG.RangelM. G.StrathdeeS. A. (2019). Impact of time perspectives on texting intervention to reduce HIV/STI transmission among female sex workers in Tijuana and Ciudad Juarez, Mexico. Journal of Behavioral Medicine, 42(1), 111-127. https://doi.org/10.1007/s10865-018-9948-1
39.
PattersonT. L.SempleS. J.StainesH.LozadaR.OrozovichP.BucardoJ.PhilbinM. M.MinyaP.FragaM.AmaroH. (2008). Prevalence and correlates of HIV infection among female sex workers in 2 Mexico–US border cities. Journal of Infectious Diseases, 197(5), 728-732. https://doi.org/10.1086/527379
40.
PearlinL. I.MullanJ. T.SempleS. J.SkaffM. M. (1990). Caregiving and the stress process: An overview of concepts and their measures. Gerontologist, 30(5), 583-594. https://doi.org/10.1093/geront/30.5.583
41.
RahimM.PattonR. (2015). The association between shame and substance use in young people: A systematic review. PeerJ, 3, Article e737. https://doi.org/10.7717/peerj.737
42.
RamosR.Ferreira-PintoJ. B.BrouwerK. C.RamosM. E.LozadaR. M.Firestone-CruzM.StrathdeeS. A. (2009). A tale of two cities: Social and environmental influences shaping risk factors and protective behaviors in two Mexico–US border cities. Health & Place, 15(4), 999-1005. https://doi.org/10.1016/j.healthplace.2009.04.004
43.
ReiseS. P.RevickiD. A. (2014). Handbook of item response theory modeling: Applications to typical performance assessment. Routledge. https://doi.org/10.4324/9781315736013
44.
RevelleW. (2019). psych: Procedures for psychological, psychometric, and personality research. https://rdrr.io/cran/psych/
45.
RevelleW.ZinbargR. E. (2009). Coefficients alpha, beta, omega, and the glb: Comments on sijtsma. Psychometrika, 74(1), 145-154. https://doi.org/10.1007/s11336-008-9102-z
46.
RhemtullaM.Brosseau-LiardP. É.SavaleiV. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354-373. https://doi.org/10.1037/a0029315
47.
RosseelY. (2012). Lavaan: An R package for structural equation modeling and more: Version 0.5–12 (BETA). Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02
48.
RüschN.CorriganP. W.BohusM.JacobG. A.BrueckR.LiebK. (2007). Measuring shame and guilt by self-report questionnaires: A validation study. Psychiatry Research, 150(3), 313-325. https://doi.org/10.1016/j.psychres.2006.04.018
49.
ShannonK.StrathdeeS. A.GoldenbergS. M.DuffP.MwangiP.RusakovaM.Reza-PaulS.LauJ.DeeringK.PicklesM. R.BoilyM. C. (2015). Global epidemiology of HIV among female sex workers: Influence of structural determinants. Lancet, 385(9962), 55-71. https://doi.org/10.1016/S0140-6736(14)60931-4.GLOBAL
50.
SijtsmaK. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), Article 107. https://doi.org/10.1007/s11336-008-9101-0
StrathdeeS. A.Magis-RodriguezC. (2008). Mexico’s evolving HIV epidemic. Journal of the American Medical Association, 300(5), 571-573. https://doi.org/10.1038/jid.2014.371
53.
StrathdeeS. A.Magis-RodriguezC.MaysV. M.JimenezR.PattersonT. L. (2012). The emerging HIV epidemic on the Mexico-US border: An international case study characterizing the role of epidemiology in surveillance and response. Annals of Epidemiology, 22(6), 426-438. https://doi.org/10.1038/jid.2014.371
54.
StrathdeeS. A.WestB. S.ReedE.MoazanB.AzimT.DolanK. D. (2015). Substance use and HIV among female sex workers and female prisoners: Risk environments and implications for prevention, treatment, and policies. Journal of Acquired Immune Deficiency Syndromes, 69(01), S110-S117. https://doi.org/10.1016/j.physbeh.2017.03.040
55.
StreinerD. L. (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80(1), 99-103. https://doi.org/10.1207/S15327752JPA8001_18
56.
TaiharaQ.MalikJ. A. (2016). Is it adaptive or maladaptive? Elaborating conditional role of shame and guilt in development of psychopathologies. Psychological Studies, 61(4), 331-339. https://doi.org/10.1007/s12646-016-0381-7
57.
TangneyJ. P.WagnerP.GramzowR. (1992). Proneness to shame, proneness to guilt, and psychopathology. Journal of Abnormal Psychology, 101(3), 469-478. https://doi.org/10.1037/0021-843X.101.3.469
58.
TignorS. M.ColvinC. R. (2019). The meaning of guilt: Reconciling the past to inform the future. Journal of Personality and Social Psychology, 116(6), 989-1010. https://doi.org/10.1037/pspp0000216
59.
TracyJ. L.RobinsR. W.TangneyJ. P. (2007). The self-conscious emotions: Theory and research. Guilford Press.
60.
TreebyM.BrunoR. (2012). Shame and guilt-proneness: Divergent implications for problematic alcohol use and drinking to cope with anxiety and depression symptomatology. Personality and Individual Differences, 53(5), 613-617. https://doi.org/10.1016/j.paid.2012.05.011
61.
WahedT.AlamA.SultanaS.RahmanM.AlamN.MartensM.SomrongthongR. (2017). Barriers to sexual and reproductive healthcare services as experienced by female sex workers and service providers in Dhaka city, Bangladesh. PLOS ONE, 12(7), Article e0182249. https://doi.org/10.1371/journal.pone.0182249
62.
ZinbargR. E.RevelleW.YovelI.LiW. (2005). Cronbach’s α, Revelle’s β, and McDonald’s ω H: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70(1), 123-133. https://doi.org/10.1007/s11336-003-0974-7
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
