There is a paucity of validated mental health measures for assessing psychological well-being among HIV-affected youth. We sought to explore the psychometric properties and validity of the Achenbach Youth Self-Report and Child Posttraumatic Stress Disorder Symptom Scale among orphans and vulnerable children (OVC) living in Lusaka, Zambia. These scales were administered to 210 OVC aged 13 to 17 years via audio computer-assisted self-interview. Confirmatory factor analysis was used to assess scale structure, Cronbach’s alpha for internal consistency, and correlations between scales related to mental or psychosocial health for construct validity. A known-groups validation was conducted using local identifications of youth with and without significant psychosocial problems, and test–retest reliability was assessed. Scales exhibited good internal reliability (α > .80), adequate criterion validity (area under the curve > .70), and moderate test–retest reliability (.62-.68). Findings support the utility of these symptom scales for identifying OVC experiencing significant psychosocial problems in Zambia.
AchenbachT. M. (1991). Manual for the Youth Self-Report and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.
2.
AchenbachT. M.RescorlaL. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington: University of Vermont, Research Center for Children, Youth and Families.
3.
AdebajoS.ObianwuO.EluwaG.VuL.OginniA.TunW.. . . KarlynA. (2014). Comparison of audio computer assisted self-interview and face-to-face interview methods in eliciting HIV-related risks among men who have sex with men and men who inject drugs in Nigeria. PLoS ONE, 9, e81981. doi:10.1371/journal.pone.0081981
4.
AliG.-C.RyanG.SilvaM. J. D. (2016). Validated screening tools for common mental disorders in low and middle income countries: A systematic review. PLoS ONE, 11, e0156939. doi:10.1371/journal.pone.0156939
5.
AndrewsG.SkinnerD.ZumaK. (2006). Epidemiology of health and vulnerability among children orphaned and made vulnerable by HIV/AIDS in sub-Saharan Africa. AIDS Care, 18, 269-276. doi:10.1080/09540120500471861
AtwineB.Cantor-GraaeE.BajunirweF. (2005). Psychological distress among AIDS orphans in rural Uganda. Social Science & Medicine, 61, 555-564. doi:10.1016/j.socscimed.2004.12.018
9.
BeauclairR.MengF.DeprezN.TemmermanM.WelteA.HensN.DelvaW. (2013). Evaluating audio computer assisted self-interviews in urban South African communities: Evidence for good suitability and reduced social desirability bias of a cross-sectional survey on sexual behaviour. BMC Medical Research Methodology, 13, 11. doi:10.1186/1471-2288-13-11
10.
BentlerP. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246. doi:10.1037/0033-2909.107.2.238
11.
BetancourtT. S.Meyers-OhkiS. E.CharrowA.HansenN. (2013). Mental health and resilience in HIV/AIDS-affected children: A review of the literature and recommendations for future research. Journal of Child Psychology and Psychiatry, 54, 423-444. doi:10.1111/j.1469-7610.2012.02613.x
12.
BetancourtT. S.ScorzaP.KanyanganziF.FawziM. C. S.SeziberaV.CyamatareF.. . . KayiteshongaY. (2014). HIV and child mental health: A case-control study in Rwanda. Pediatrics, 134, e464-e472. doi:10.1542/peds.2013-2734
13.
BoltonP. (2001). Cross-cultural validity and reliability testing of a standard psychiatric assessment instrument without a gold standard. Journal of Nervous and Mental Disease, 189, 238-242.
14.
BoltonP.TangA. M. (2002). An alternative approach to cross-cultural function assessment. Social Psychiatry and Psychiatric Epidemiology, 37, 537-543. doi:10.1007/s00127-002-0580-5
15.
BrownD. W.RileyL.ButchartA.MeddingsD. R.KannL.HarveyA. P. (2009). Exposure to physical and sexual violence and adverse health behaviours in African children: Results from the Global School-based Student Health Survey. Bulletin of the World Health Organization, 87, 447-455. doi:10.2471/BLT.07.047423
16.
BrowneM. W.CudeckR. (1993). Alternative ways of assessing model fit. In BollenK. A.LongJ. S. (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
17.
BryantM.BeardJ. (2016). Orphans and vulnerable children affected by human immunodeficiency virus in sub-Saharan Africa. Pediatric Clinics of North America, 63, 131-147. doi:10.1016/j.pcl.2015.08.007
18.
ChiP.LiX. (2012). Impact of parental HIV/AIDS on children’s psychological well-being: A systematic review of global literature. AIDS and Behavior, 17, 2554-2574. doi:10.1007/s10461-012-0290-2
19.
ChipimoP. J.FylkesnesK. (2010). Comparative validity of screening instruments for mental distress in Zambia. Clinical Practice & Epidemiology in Mental Health, 6, 4-15. doi:10.2174/1745017901006010004
20.
ChishingaN.KinyandaE.WeissH. A.PatelV.AylesH.SeedatS. (2011). Validation of brief screening tools for depressive and alcohol use disorders among TB and HIV patients in primary care in Zambia. BMC Psychiatry, 11, 75. doi:10.1186/1471-244X-11-75
21.
CluverL.BowesL.GardnerF. (2010). Risk and protective factors for bullying victimization among AIDS-affected and vulnerable children in South Africa. Child Abuse & Neglect, 34, 793-803. doi:10.1016/j.chiabu.2010.04.002
22.
CluverL.GardnerF.OperarioD. (2007). Psychological distress amongst AIDS-orphaned children in urban South Africa. Journal of Child Psychology and Psychiatry, 48, 755-763. doi:10.1111/j.1469-7610.2007.01757.x
23.
CluverL.GardnerF.OperarioD. (2009). Poverty and psychological health among AIDS-orphaned children in Cape Town, South Africa. AIDS Care, 21, 732-741. doi:10.1080/09540120802511885
24.
CluverL.OrkinM. (2009). Cumulative risk and AIDS-orphanhood: Interactions of stigma, bullying and poverty on child mental health in South Africa. Social Science & Medicine, 69, 1186-1193. doi:10.1016/j.socscimed.2009.07.033
25.
CluverL. D.OrkinM.GardnerF.BoyesM. E. (2012). Persisting mental health problems among AIDS-orphaned children in South Africa. Journal of Child Psychology and Psychiatry, 53, 363-370. doi:10.1111/j.1469-7610.2011.02459.x
26.
DeSilvaM. B.SkalickyA.BeardJ.CakweM.ZhuwauT.QuinlanT.SimonJ. (2012). Early impacts of orphaning: Health, nutrition, and food insecurity in a cohort of school-going adolescents in South Africa. Vulnerable Children and Youth Studies, 7, 75-87. doi:10.1080/17450128.2011.648968
27.
DokuP. N.MinnisH. (2016). Multi-informant perspective on psychological distress among Ghanaian orphans and vulnerable children within the context of HIV/AIDS. Psychological Medicine, 46, 2329-2336. doi:10.1017/S0033291716000829
28.
FamiliarI.MurrayL.GrossA.SkavenskiS.JereE.BassJ. (2014). Posttraumatic stress symptoms and structure among orphan and vulnerable children and adolescents in Zambia. Child and Adolescent Mental Health, 19, 235-242. doi:10.1111/camh.12050
29.
FoaE. B.JohnsonK. M.FeenyN. C.TreadwellK. R. (2001). The child PTSD Symptom Scale: A preliminary examination of its psychometric properties. Journal of Clinical Child Psychology, 30, 376-384. doi:10.1207/S15374424JCCP3003_9
30.
GeibelS.HabtamuK.MekonnenG.JaniN.KayL.ShibruJ.. . . KalibalaS. (2016). Reliability and validity of an interviewer-administered adaptation of the Youth Self-Report for mental health screening of vulnerable young people in Ethiopia. PLoS ONE, 11, e0147267. doi:10.1371/journal.pone.0147267
31.
GillihanS. J.AderkaI. M.ConklinP. H.CapaldiS.FoaE. B. (2013). The Child PTSD Symptom Scale: Psychometric properties in female adolescent sexual assault survivors. Psychological Assessment, 25, 23-31. doi:10.1037/a0029553
32.
GoldbergR. E.ShortS. E. (2016). What do we know about children living with HIV-infected or AIDS-ill adults in sub-Saharan Africa? A systematic review of the literature. AIDS Care, 28(Suppl. 2), 130-141. doi:10.1080/09540121.2016.1176684
33.
GovenderK.ReardonC.QuinlanT.GeorgeG. (2014). Children’s psychosocial wellbeing in the context of HIV/AIDS and poverty: A comparative investigation of orphaned and non-orphaned children living in South Africa. BMC Public Health, 14, 615. doi:10.1186/1471-2458-14-615
34.
HallB. J.PufferE.MurrayL. K.IsmaelA.BassJ. K.SimA.BoltonP. A. (2014). The importance of establishing reliability and validity of assessment instruments for mental health problems: An example from Somali children and adolescents living in three refugee camps in Ethiopia. Psychological Injury and Law, 7, 153-164. doi:10.1007/s12207-014-9188-9
35.
HarderV. S.MutisoV. N.KhasakhalaL. I.BurkeH. M.RettewD. C.IvanovaM. Y.NdeteiD. M. (2014). Emotional and behavioral problems among impoverished Kenyan youth: Factor structure and sex-differences. Journal of Psychopathology and Behavioral Assessment, 36, 580-590. doi:10.1007/s10862-014-9419-0
36.
HartA. (2001). Mann-Whitney test is not just a test of medians: Differences in spread can be important. BMJ: British Medical Journal, 323, 391-393.
37.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
38.
IvanovaM. Y.AchenbachT. M.RescorlaL. A.DumenciL.AlmqvistF.BilenbergN.. . . VerhulstF. C. (2007). The generalizability of the Youth Self-Report syndrome structure in 23 societies. Journal of Consulting and Clinical Psychology, 75, 729-738. doi:10.1037/0022-006X.75.5.729
39.
KaneJ. C.BoltonP.MurrayS. M.BassJ. K.LakinD.WhettenK.. . . MurrayL. K. (2018). Psychometric evaluation of HIV risk behavior assessments using Audio Computer Assisted Self-Interviewing (ACASI) among orphans and vulnerable children in Zambia. AIDS Care, 2, 160-167. doi:10.1080/09540121.2017.1384787
40.
KaneJ. C.MurrayL. K.BassJ. K.JohnsonR. M.BoltonP. (2016). Validation of a substance and alcohol use assessment instrument among orphans and vulnerable children in Zambia using Audio Computer Assisted Self-Interviewing (ACASI). Drug and Alcohol Dependence, 166, 85-92. doi:10.1016/j.drugalcdep.2016.06.026
41.
KaneJ. C.MurrayL. K.SughrueS.DeMulderJ.Skavenski van WykS.QueenanJ.. . . BoltonP. (2016). Process and implementation of audio computer assisted self-interviewing (ACASI) assessments in low resource settings: A case example from Zambia. Global Mental Health, 3, e24.
42.
KellyC. A.HewettP. C.MenschB. S.RankinJ. C.NsobyaS. L.KalibalaS.KakandeP. N. (2014). Using biomarkers to assess the validity of sexual behavior reporting across interview modes among young women in Kampala, Uganda. Studies in Family Planning, 45, 43-58. doi:10.1111/j.1728-4465.2014.00375.x
43.
KilburnK.ThirumurthyH.HalpernC. T.PettiforA.HandaS. (2016). Effects of a large-scale unconditional cash transfer program on mental health outcomes of young people in Kenya. Journal of Adolescent Health, 58, 223-229. doi:10.1016/j.jadohealth.2015.09.023
44.
KingE.De SilvaM.SteinA.PatelV. (2009). Interventions for improving the psychosocial well-being of children affected by HIV and AIDS. Cochrane Database of Systematic Reviews, 2009, 733. doi:10.1002/14651858.CD006733.pub2
45.
KleintjesS.LundC.FisherA. J. (2010). A situational analysis of child and adolescent mental health services in Ghana, Uganda, South Africa and Zambia. African Journal of Psychiatry, 13, 132-139. doi:10.1186/1471-244X-11-127
46.
KohrtB. A.JordansM. J. D.TolW. A.LuitelN. P.MaharjanS. M.UpadhayaN. (2011). Validation of cross-cultural child mental health and psychosocial research instruments: Adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal. BMC Psychiatry, 11, 127. doi:10.1186/1471-244X-11-127
47.
KumakechE.Cantor-GraaeE.MalingS.BajunirweF. (2009). Peer-group support intervention improves the psychosocial well-being of AIDS orphans: Cluster randomized trial. Social Science & Medicine, 68, 1038-1043. doi:10.1016/j.socscimed.2008.10.033
48.
LanghaugL. F.CheungY. B.PascoeS.ChirawuP.WoelkG.HayesR. J.CowanF. M. (2011). How you ask really matters: Randomised comparison of four sexual behaviour questionnaire delivery modes in Zimbabwean youth. Sexually Transmitted Infections, 87, 165-173. doi:10.1136/sti.2009.037374
49.
LanghaugL. F.CheungY. B.PascoeS.HayesR.CowanF. M. (2009). Difference in prevalence of common mental disorder as measured using four questionnaire delivery methods among young people in rural Zimbabwe. Journal of Affective Disorders, 118, 220-223. doi:10.1016/j.jad.2009.02.003
50.
LanghaugL. F.SherrL.CowanF. M. (2010). How to improve the validity of sexual behaviour reporting: Systematic review of questionnaire delivery modes in developing countries. Tropical Medicine & International Health, 15, 362-381. doi:10.1111/j.1365-3156.2009.02464.x
51.
LeeV. C.MuriithiP.Gilbert-NandraU.KimA. A.SchmitzM. E.OdekJ.. . .GalbraithJ. S. (2014). Orphans and vulnerable children in Kenya: Results from a nationally representative population-based survey. Journal of Acquired Immune Deficiency Syndromes, 66(Suppl. 1), S89-S97. doi:10.1097/QAI.0000000000000117
52.
LittleT. D. (2013). Longitudinal structural equation modeling (1st ed.). New York, NY: Guilford Press.
53.
LiuX. (2012). Classification accuracy and cut point selection. Statistics in Medicine, 31, 2676-2686. doi:10.1002/sim.4509
54.
LowenthalE. D.Bakeera-KitakaS.MarukutiraT.ChapmanJ.GoldrathC.FerrandR. A. (2014). Perinatally acquired HIV infection in adolescents from sub-Saharan Africa: A review of emerging challenges. Lancet Infectious Diseases, 14, 627-639. doi:10.1016/S1473-3099(13)70363-3
55.
MarshH. W.BallaJ. R.McDonaldR. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391-410. doi:10.1037/0033-2909.103.3.391
56.
MbeweE. K.UysL. R.NkwanyanaN. M.BirbeckG. L. (2013). A primary healthcare screening tool to identify depression and anxiety disorders among people with epilepsy in Zambia. Epilepsy & Behavior, 27, 296-300. doi:10.1016/j.yebeh.2013.01.025
57.
MeyerR. M. L.GoldJ. I.BeasV. N.YoungC. M.Kassam-AdamsN. (2014). Psychometric evaluation of the Child PTSD Symptom Scale in Spanish and English. Child Psychiatry & Human Development, 46, 438-444. doi:10.1007/s10578-014-0482-2
58.
MurrayL. K.BassJ.ChombaE.ImasikuM.TheaD.SemrauK.. . . BoltonP. A. (2011). Validation of the UCLA Child Post-Traumatic Stress Disorder Reaction Index in Zambia. International Journal of Mental Health Systems, 5, 24. doi:10.1186/1752-4458-5-24
59.
MurrayL. K.HaworthA.SemrauK.SinghM.AldrovandiG. M.SinkalaM.. . . BoltonP. A. (2006). Violence and abuse among HIV-infected women and their children in Zambia: A qualitative study. Journal of Nervous and Mental Disease, 194, 610-615. doi:10.1097/01.nmd.0000230662.01953.bc
60.
MurrayL. K.SkavenskiS.KaneJ. C.MayeyaJ.DorseyS.CohenJ. A.. . . BoltonP. A. (2015). Effectiveness of trauma-focused cognitive behavioral therapy among trauma-affected children in Lusaka, Zambia: A randomized clinical trial. JAMA Pediatrics, 169, 761-769. doi:10.1001/jamapediatrics.2015.0580
61.
MuthénL. K.MuthénB. O. (2011). Mplus user’s guide (Version 7). Los Angeles, CA: Muthén & Muthén.
62.
Narh DokuP. (2016). Reactive attachment disorder in orphans and vulnerable children (OVC) affected by HIV/AIDS: Implications for clinical practice, education and health service delivery. Journal of Child and Adolescent Behavior, 4, 278. doi:10.4172/2375-4494.1000278
63.
NdeteiD. M.MutisoV.MusyimiC.MokayaA. G.AndersonK. K.McKenzieK.MusauA. (2016). The prevalence of mental disorders among upper primary school children in Kenya. Social Psychiatry and Psychiatric Epidemiology, 51, 63-71. doi:10.1007/s00127-015-1132-0
64.
NduwimanaE.MukunziS.NgL. C.KirkC. M.BizimanaJ. I.BetancourtT. S. (2017). Mental health of children living in foster families in rural Rwanda: The role of HIV and the family environment. AIDS and Behavior, 21, 1518-1529. doi:10.1007/s10461-016-1482-y
65.
NixonR. D. V.Meiser-StedmanR.DalgleishT.YuleW.ClarkD. M.PerrinS.SmithP. (2013). The Child PTSD Symptom Scale: An update and replication of its psychometric properties. Psychological Assessment, 25, 1025-1031. doi:10.1037/a0033324
66.
OkawaS.KabagheS. M.MwiyaM.KikuchiK.JimbaM.KankasaC.IshikawaN. (2018). Psychological well-being and adherence to antiretroviral therapy among adolescents living with HIV in Zambia. AIDS Care, 30, 624-642. doi:10.1080/09540121.2018.1425364
67.
OkelloJ.Nakimuli-MpunguE.KlasenF.VossC.MusisiS.BroekaertE.DerluynI. (2015). The impact of attachment and depression symptoms on multiple risk behaviors in post-war adolescents in northern Uganda. Journal of Affective Disorders, 180, 62-67. doi:10.1016/j.jad.2015.03.052
68.
SchenkK. D.MichaelisA.SapianoT. N.BrownL.WeissE. (2010). Improving the lives of vulnerable children: Implications of horizons research among orphans and other children affected by AIDS. Public Health Reports, 125, 325-336.
69.
SenefeldS.StrasserS.CampbellJ. (2009). Orphans and vulnerable children wellbeing tool: User’s guide. Baltimore, MD: Catholic Relief Services.
70.
SherrL.CluverL. D.BetancourtT. S.KellermanS. E.RichterL. M.DesmondC. (2014). Evidence of impact: Health, psychological and social effects of adult HIV on children. AIDS, 28(Suppl. 3), S251-S259. doi:10.1097/QAD.0000000000000327
71.
ShortS. E.GoldbergR. E. (2015). Children living with HIV-infected adults: Estimates for 23 countries in sub-Saharan Africa. PLoS ONE, 10, e0142580. doi:10.1371/journal.pone.0142580
72.
SiziyaS.RudatsikiraE.MuulaA. S. (2012). Victimization from bullying among school-attending adolescents in grades 7 to 10 in Zambia. Journal of Injury and Violence Research, 4, 30-35. doi: 10.5249/jivr.v4i1.84
73.
StataCorp. (2015). Stata statistical software (Release 14) [Computer software]. College Station, TX: Author.
74.
StewartR. W.EbesutaniC.DrescherC. F.YoungJ. (2015). The Child PTSD Symptom Scale: An investigation of its psychometric properties. Journal of Interpersonal Violence, 32, 2237-2256. doi:10.1177/0886260515596536
75.
TolW. A.KomproeI. H.JordansM. J. D.VallipuramA.SipsmaH.SivayokanS.. . . JongJ. T. D. (2013). Outcomes and moderators of a preventive school-based mental health intervention for children affected by war in Sri Lanka: A cluster randomized trial. World Psychiatry, 11, 114-122.
76.
TolW. A.KomproeI. H.SusantyD.JordansM. J. D.MacyR. D.De JongJ. T. V. M. (2008). School-based mental health intervention for children affected by political violence in Indonesia: A cluster randomized trial. Journal of the American Medical Association, 300, 655-662. doi:10.1001/jama.300.6.655
77.
Tufts University School of Medicine. (2014). Audio Computer Assisted Self-Interviewing Software [Computer software]. Boston, MA: Author.
VentevogelP.KomproeI. H.JordansM. J.FeoP.De JongJ. T. V. M. (2014). Validation of the Kirundi versions of brief self-rating scales for common mental disorders among children in Burundi. BMC Psychiatry, 14, 36. doi:10.1186/1471-244X-14-36
82.
VisserM.ZunguN.Ndala-MagoroN. (2015). ISIBINDI, creating circles of care for orphans and vulnerable children in South Africa: Post-programme outcomes. AIDS Care, 27, 1014-1019. doi:10.1080/09540121.2015.1018861
83.
WangJ. S.-H.SsewamalaF. M.HanC.-K. (2014). Family economic strengthening and mental health functioning of caregivers for AIDS-affected children in rural Uganda. Vulnerable Children and Youth Studies, 9, 258-269. doi:10.1080/17450128.2014.920119
84.
WaruruA. K.NduatiR.TylleskärT. (2005). Audio computer-assisted self-interviewing (ACASI) may avert socially desirable responses about infant feeding in the context of HIV. BMC Medical Informatics and Decision Making, 5, 24. doi:10.1186/1472-6947-5-24
85.
YoudenW. J. (1950). Index for rating diagnostic tests. Cancer, 3, 32-35.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
