Sampling methods are an important issue in the evaluation of community-based HIV prevention initiatives because it is through responsible sampling procedures that a valid model of the population is produced and reliable estimates of behavior change determined. This article provides an overview on sampling with particular focus on the needs of community-based organizations (CBOs). As these organizations continue to improve their capacity for sampling and program evaluation activities, comparisons across CBOs can become more rigorous, resulting in valuable information collectively regarding the effectiveness of particular HIV prevention initiatives. The author reviews several probability and nonprobability sampling designs; discusses bias, cost, and feasibility factors in design selection; and presents six guidelines designed to encourage community organizations to consider these important sampling issues as they plan their program evaluations.
Get full access to this article
View all access options for this article.
References
1.
Academy for Educational Development
. (1995). Overview of HIV/AIDS prevention interventions: An approach to examining their effectiveness. Washington, DC: Author.
2.
Braverman, M. T.
, & Slater, J. K. (Eds.). (1996). Advances in survey research. San Francisco: Jossey-Bass.
3.
Burstein, L.
. & Freeman, H. E. (1985). Perspectives on data collection in evaluations. In L. Burstein, H. E. Freeman, & P. H. Rossi (Eds.), Collecting evaluation data (pp. 15-32). Beverly Hills, CA: Sage.
4.
Centers for Disease Control
. (1996a). Community-level prevention of human immunodeficiency virus infection among high-risk populations: The AIDS Community Demonstration Projects. Morbidity and Mortality Weekly Reports, 45, 1-24.
5.
Centers for Disease Control
. (1996b). HIV/AIDS Surveillance Report, 9(1), 1-37.
6.
Centers for Disease Control
. (1997). Update: Mortality attributable to HIV infection among persons aged 24-44—United States, 1994. Morbidity and Mortality Weekly Report, 45, 121-125.
7.
Centers for Disease Control AIDS Community Demonstration Projects Research Group
. (1999). Community-level HIV intervention in 5 cities: Final outcome data from the CDC AIDS Community Demonstration Projects. American Journal of Public Health, 89, 336-345.
8.
Cook, R.
, Roehl, J., Oros, C., & Trudeau, J. (1994). Conceptual and methodological issues in the evaluation of community-based substance abuse prevention coalitions: Lessons learned from the national evaluation of the Community Partnership Program. Journal of Community Psychology, CSAP special issue, 155-169.
9.
Curran, J. W.
(1996). Bridging the gap between behavioral science and public health practice in HIV prevention. Public Health Reports, 111(Suppl. 1), 3-4.
10.
DiClemente, R. J.
, & Wingood, G. M. (1995). A randomized controlled trial of an HIV sexual risk-reduction intervention for young African-American women. Journal of the American Medical Association, 274, 1271-1276.
11.
Diehr, P.
, Martin, D. C., Koepsell, T., Cheadle, A., Psaty, B. M., & Wagner, E. H. (1995). Optimal survey design for community intervention evaluations: Cohort or cross-sectional?Journal of Clinical Epidemiology, 48, 1461-1472.
12.
Ellenberg, J. H.
(1994). Selection bias in observational and experimental studies. Statistics in Medicine, 13, 557-567.
13.
Fishbein, M.
, & Guinan, M. (1996). Behavioral science and public health: A necessary partnership for HIV prevention. Public Health Reports, 111(Suppl. 1), 5-10.
14.
Fowler, F. J.
(1993). Survey research methods (2nd ed.). Newbury Park, CA: Sage.
15.
Goodman, R. M.
, & Wandersman, A. (1994). FORECAST: A formative approach to evaluating community coalitions and community-based initiatives. Journal of Community Psychology, CSAP special issue, 6-25.
16.
Gwiasda, V.
, Taluc, N., & Popkin, S. J. (1997). Data collection in dangerous neighborhoods: Lessons from a survey of public housing residents in Chicago. Evaluation Review, 21(1), 77-93.
17.
Hansen, W. B.
, & Kaftarian, S. J. (1994). Strategies for comparing multiple-site evaluations under non-equivalent design conditions. Journal of Community Psychology, CSAP special issue, 170-187.
18.
Heckathorn, D. D.
(1997). Respondent-driven sampling: A new approach to the study of hidden populations. Social Problems, 44, 174-199.
19.
Henry, G. T.
(1990). Practical sampling. Newbury Park, CA: Sage.
20.
Henry, G. T.
(1998). Practical sampling. In L. Bickman & D. J. Rog (Eds.), Handbook of applied social research methods (pp. 101-126). Thousand Oaks, CA: Sage.
21.
Kalichman, S. C.
, Carey, M. P., & Johnson, B. T. (1996). Prevention of sexually transmitted HIV infection: A meta-analytic review of the behavioral outcome literature. Annals of Behavioral Medicine, 18, 6-15.
22.
Kalton, G.
(1983). Introduction to survey sampling. Newbury Park, CA: Sage.
23.
Kelly, J. A.
, St. Lawrence, J. S., Stevenson, L. Y., Hauth, A. C., Kalichman, S. C., Diaz Y. E., Brasfield, T. L., Koob, J. J., & Morgan, M. G. (1992). Community HIV/AIDS risk reduction: The effects of endorsements by popular people in three cities. American Journal of Public Health, 82, 1483-1489.
24.
Kellow, J. T.
(1998). Beyond statistical significant tests: The importance of using other estimates of treatment effects to interpret evaluation. American Journal of Evaluation, 19, 123-124.
25.
Kish, L.
(1995). Survey sampling. New York: John Wiley. (Original work published 1965)
26.
Koepsell, T. D.
, Wagner, E. H., Cheadle, A. C., Patrick, D. L., Martin, D. C., Diehr, P. H., Perrin, E. B., Kristal, A. R., Allan-andrilla, C. H., & Dey, L. J. (1992). Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annual Review Public Health, 13, 31-57.
27.
Lauby, J. L.
, Smith, P. J., Stark, M., Person, B., & Adams, J. (1999). A community-level HIV prevention intervention for inner city women: Results of the women and infants demonstration trial. Manuscript submitted for publication.
28.
Lipsey, M.
(1990). Design sensitivity: Statistical power for experimental research. Thousand Oaks, CA: Sage.
29.
National Research Council
. (1991). Evaluating AIDS prevention programs: Expanded edition. Washington, DC: National Academy Press.
30.
Oakley, A.
, Fullerton, D., & Holland, J. (1995). Behavioral interventions for HIV/AIDS prevention. AIDS, 9, 479-486.
31.
O’Connell, A. A.
, Bol, L., & Langley, S. C. (1997). Evaluation issues and strategies for community-based organizations developing women’s HIV prevention programs. Evaluation & the Health Professions, 20, 428-454.
32.
Ostrow, D. G.
, Kessler, R. C., Stover, E., & Pequegnat, W. (1993). Design, measurement and analysis issues in AIDS mental health research. In D. G. Ostrow & R. C. Kessler (Eds.), Methodological issues in AIDS behavioral research (pp. 1-16). New York: Plenum.
33.
Rosenbaum, P.
(1995). Observational studies. New York: Springer.
34.
Rosenbaum, P.
, & Rubin, D. B. (1984). Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association, 79, 516-524.
35.
Rossi, P. H.
, & Freeman, H. E. (1993). Evaluation: A systematic approach (5th ed.). Newbury Park, CA: Sage.
36.
Shadish, W. R.
(1993). Critical multiplism: A research strategy and its attendant tactics. New Directions for Program Evaluation, 60, 13-57.
37.
Tawil, O.
, Verster, A., & O’Reilly, K. R. (1995). Enabling approaches for HIV/AIDS prevention: Can we modify the environment and minimize the risk?AIDS, 9, 1299-1306.
38.
Thomas, S. B.
, & Morgan, C. H. (1991). Evaluation of community-based AIDS education and risk reduction projects in ethnic and racial minority communities: A survey of projects funded by the U.S. Department of Public Health Service. Evaluation and Program Planning, 14, 247-255.
39.
Watters, J. K.
, & Biernacki, P. (1989). Targeted sampling: Options for the study of hidden populations. Social Problems, 36, 416-430.
40.
Weiss, C. H.
(1998). Evaluation: Methods for studying programs and policies (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.
