Aims: This article reports on the development and psychometric properties of an instrument to evaluate school-based HIV/ AIDS interventions aimed at adolescents in three African sites. Methods: The instrument was developed in a series of steps that involved a review of existing instruments; use of empirical data and secondary literature supporting an association between the variables of interest and sexual intercourse or condom use; operationalizing the constructs of the theoretical model employed; and using the objectives of the intervention. Test—retest reliability studies were conducted at each site. Results: The questionnaire demonstrated good internal consistency and adequate test—retest reliability. Cronbach's alpha was higher than 0.50 for all the 10 psychosocial scales, while Cohen's kappa showed poor to substantial test—retest reliability on the sexual behaviour items (κ = 0.14 to 0.69). Conclusions: We conclude that the instrument had sufficient test—retest reliability and internal consistency.
Basen-Engquist K., Coyle KK, Parcel GS, Kirby D., Banspach SW, Carvajal SC, Baumler E.Schoolwide effects of a multicomponent HIV, STD, and pregnancy prevention program for high school students. Health Educ Beh2001; 28:166-85.
2.
Coyle KK, Kirby DB, Marin BV, Gomez CA, Gregorich SEDraw the Line/Respect the Line: a randomized trial of a middle school intervention to reduce sexual risk behaviors. Am J Public Health2004;94:843-51.
3.
Gallant M. , Maticka-Tyndale E.School-based HIV prevention programmes for African youth. Soc Sci Med2003;58: 1337-51.
4.
Fawole I., Asuzu M., Oduntan S., Bieger W.A school-based AIDS education programme for secondary school students in Nigeria: a review of effectiveness. Health Educ Res1999; 14:675-83.
5.
Harvey B., Stuart J., Swan T.Evaluation of a drama-in-education programme to increase AIDS awareness in South African high schools: a randomized community intervention trial. Int J STD AIDS2000;11:105-11.
6.
Kirby D.Effective approaches to reducing adolescent unprotected sex, pregnancy, and child-bearing. Int J Sex Res2002;39:51-7.
7.
Klepp K.-I, Ndeki SS, Seha AM, Hannan P., Lyimo BA, Msuya MH, et al. AIDS education for primary school children in Tanzania: an evaluation study. AIDS1994; 8:1157-62.
8.
Kaaya SF, Mũkoma W., Flisher AJ, Klepp K.-I. School-based health interventions in Sub-Saharan Africa. A review. Soc Dynamics2002;28:64-88.
9.
Mũkoma W., Flisher AJA systematic review of school-based AIDS prevention programmes in South Africa. In: Klepp K-I, Flisher AJ, Kaaya S. (Eds.). Promoting adolescent sexual and reproductive health in Eastern and Southern Africa. HSRC Press, South Africa. 2008.
10.
Plummer ML , Ross DA, Wight D., Changalucha J., Mshana G., Wamoyi J., et al. ``A bit more truthful'': the validity of adolescent sexual behaviour data collected in rural northern Tanzania using five methods. Sex Trans Inf2004; 80:49-56.
11.
Flisher AJ , Ziervogel CF, Chalton DO, Leger PH, Robertson BARisk-taking behaviour of Cape Peninsula high-school students. Part VIII. Sexual behaviour . South African Med J1993;83:495-7.
12.
Klepp KI, Ndeki SS, Leshabari MT, Hannan PJ, Lyimo BAAIDS education in Tanzania: promoting risk reduction among primary school children. Am J Public Health1997; 87:1931-6.
13.
Hearn KD, O'Sullivan LF, Dudley CDAssessing reliability of early adolescent girls' reports of romantic and sexual behaviour. Arch Sex Beh2003;32:513-21.
14.
Lintonen T., Ahlström S., Metso ALThe reliability of self-reported drinking in adolescence. Alc Alcohol2004; 39:362-8.
15.
Windsor R., Baranowki T., Clark N., Cutter G.Evaluation of health promotion. Health education and disease prevention programs , 2nd edn. California : Mayfield, 1994.
16.
Aarø LE, Flisher AJ, Kaaya S., Onya H., Fuglesang M., Klepp K.-I. Schaalma H. Promoting sexual and reproductive health in early adolescence in South Africa and Tanzania: development of a theory- and evidence-based intervention programme. Scand J Public Health2006;34:150-8.
17.
Bartholomew LK, Parcel GS, Kok G.Intervention Mapping: a process for developing theory- and evidence-based health education programmes . Health Educ Beh1998;25:564-8.
18.
Bartholomew LK , Parcel GS, Kok G., Gottlieb NHPlanning health promotion programs: an intervention mapping approach. San Francisco: Jossey-Bass, 2006 .
19.
Kok G. , Schaalma H., Ruiter RAC, van Empelen P.Intervention mapping: a protocol for applying health psychology theory to prevention programmes . J Health Psychol2004;9:85-98.
20.
Schaalma HP, Kok G., Bosker RJ, Parcel GS, Peters L., Poelman J., Reinders J.Planned development and evaluation of AIDS/STD education for secondary school students in The Netherlands: short-term effects . Health Educ Quart1996;23:469-87.
21.
Schaalma HP, Kok G., Poelman J., Reinders J.The development of AIDS education for Dutch secondary schools: a systematic approach based on theory, research and cooperation. In: Rutter DR, Quine L, editors. Social psychology and health: European perspectives . Aldershot/Brookfield: Avebury/Ashgate, 1994 . pp. 175-94.
22.
Wight D., Abraham C.From psychosocial theory to sustainable classroom practice: developing a teacher-delivered sex education programme. Health Educ Res2000 ;15:25-38.
23.
Kirby DB, Baumler E., Coyle KK, Basen-Engquist K., Parcel GS, Harrist R., Banspach SWThe ``Safer Choices'' intervention: its impact on the sexual behaviors of different subgroups of high school students. J Adolesc Health2004; 35:442-52.
24.
World Health Organization. Global School-based Student Health Survey (GSHS)2004Core questionnaire Module Rationale; 2004. http://www.who.int/school_youth_health/media/en/gshs_modules_rationale.pdf
25.
Vergnani T., Flisher AJ, Blignaut R.Factors affecting condom use by South African adolescents. 14th International AIDS Conference, Barcelona , Spain, 7-12 July 2002.
26.
Seha AM, Klepp KI, Ndeki SSScale reliability and construct validity: a pilot study among primary school children in Northern Tanzania. AIDS Education and Prevention1994;6:524-34.
27.
Kugler KC, Komro KA, Stigler MH, Mnyika KS, Masatu M., Aastrom AN, Klepp KIThe reliability and validity of self-report measures used to evaluate adolescent HIV/AIDS prevention programs in Sub-Saharan Africa. AIDS Education & Prevention2007;19:365-82.
28.
Mũkoma W., Mathews C., Flisher AJ, Seebregts C., Jansen S., Ahmed N., Klepp K-I., et al. Use of electronic questionnaires on handheld devices to evaluate the effects of a school-based HIV prevention programme on adolescent sexual behaviour. International AIDS conference, Bangkok, Thailand, 11-16 July 2004.
29.
Zwarenstein M. , Seebregts CJ, Mathews C., Fairall L., Flisher AJ, Seebregts C., et al., PDACT Working Group. Handheld computers for survey and trial data collection in resource-poor settings: development and evaluation of PDACT, a PalmTM pilot interviewing system. Int J Med Informatics. [In press.].
30.
Ware JE, Gandek B.Methods for testing data quality, scaling assumptions, and reliability: the IQOLA project approach. J Clin Epidemiol1998 ;51:945-52.
31.
Landis JR , Koch GGThe measurement of observer agreement for categorical data. Biometrics1977; 33:159-74.
32.
Bland JM, Altman D.Statistics notes: Cronbach. BMJ1997 ;314:572.
33.
Maclure M. , Willett WCMisinterpretation and misuse of the kappa statistic. Am J Epidemiol1987;126:161-9.
34.
Kaaya SF, Flisher AJ, Mbwambo JK, Schaalma H., Aarø LE, Klepp K.-I. A review of studies of sexual behaviour in school students in Sub-Saharan Africa. Scand J Public Health2002;30:148-60.
35.
Flisher AJ , Evans J., Muller M., Lombard C.Test-retest reliability of self-reported adolescent risk behaviour. J Adolesc2004;27:207-12.
