This project integrates elements of responsive evaluation and participatory evaluation to compare three evaluation data collection methods for use with a hard-to-find (HTF), traumatized, vulnerable population: rape victims seeking postassault medical forensic care. The first method involves on-site, in-person data collection, immediately postservices; the second, telephone follow-up assessments, 1 week postservices; and the third, private, self-administered surveys completed immediately postservices. There are significant differences in response rates across methods: 88% in-person, 17% telephone, and 41% self-administered. Across all phases, clients gave positive feedback about the services they received and about all three methods of data collection. Follow-up analyses suggested that nonresponders did not differ with respect to client characteristics, assault characteristics, or nursing care provided. These findings suggest that evaluations with HTF service clients may need to be integrated into on-site services because other methods may not yield sufficient response rates.
Abma, T.A., & Stake, R.E. (2001). Stake's responsive evaluation: Core ideas and evolution. New Directions for Evaluation, 92, 7-21.
2.
Bausell, R.B., & Rinkus, A.J. (1979). A comparison of written versus oral interviews . Evaluation & the Health Professions, 2, 477-486.
3.
Benoit, C., Jansson, M., Millar, A., & Phillips, R. (2005). Community-academic research on hard-to-find populations: Benefits and challenges. Qualitative Health Research, 15, 263-282.
4.
Birman, D. (2005). Ethical issues in research with immigrants and refugees. In J. E. Trimble & C. B. Fisher (Eds.), Handbook of ethical research with ethnocultural populations and communities (pp. 155-177). Thousand Oaks, CA: Sage.
5.
Boykins, A., & Mynatt, S. (2007) Assault history and follow-up contact of women survivors of recent sexual assault. Issues in Mental Health Nursing, 28(8), 867-881.
6.
Boykins, A., & Mynatt, S. (2007) Assault history and follow-up contact of women survivors of recent sexual assault. Issues in Mental Health Nursing, 28(8), 867-881.
7.
Campbell, R., Davidson, W.S., Dorey, H., Bennett, K., Hagstrom, J., & Bonter, F. (2000). Resources for evaluating sexual assault service delivery programs. Okemos: Michigan Public Health Institute.
8.
Campbell, R., Patterson, D., Adams, A.E., Diegel, R., & Coats, S. (2008). A participatory evaluation project to measure SANE nursing practice and adult sexual assault patients' psychological well-being . Journal of Forensic Nursing, 4, 19-28.
9.
Campbell, R., Patterson, D., Bybee, D., & Diegel, R. (2007, October). Prosecution rates for adult sexual assault cases: A ten year analysis before and after the implementation of a SANE program . Paper presented at the International Forensic Nursing Scientific Assembly, Salt Lake City, UT.
10.
Campbell, R., Patterson, D., & Lichty, L.F. (2005). The effectiveness of sexual assault nurse examiner (SANE) program: A review of psychological, medical, legal, and community outcomes . Trauma, Violence, & Abuse: A Review Journal, 6, 313-329.
11.
Campbell, R., Sefl, T., Barnes, H.E., Ahrens, C.E., Wasco, S.M., & Zaragoza-Diesfeld, Y. (1999). Community services for rape survivors: Enhancing psychological well-being or increasing trauma? Journal of Consulting and Clinical Psychology, 67, 847-858.
12.
Campbell, R., Sefl, T., Wasco, S.M., & Ahrens, C.E. (2004). Doing community research without a community: Creating safe space for rape survivors. American Journal of Community Psychology, 33, 253-261.
13.
Cousins, J.B., & Earl, L.M. (1992). The case for participatory evaluation. Educational Evaluation and Policy Analysis, 14, 397-418.
14.
Cousins, J. B., & Earl, L. M. (Eds.). (1995). Participatory evaluation in education: Studies in evaluation use and organizational learning. London: Falmer.
15.
Cousins, J.B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 80, 5-23.
16.
Derhammer, F., Lucente, V., Reed, J., & Young, M. (2000). Using a SANE interdisciplinary approach to care of sexual assault victims. Journal on Quality Improvement , 26, 488-495.
17.
Elman, R.A. (2005). Confronting the sexual abuse of women with disabilities. VAWNet Document, National Online Resource Center on Violence Against Women . Minneapolis: University of Minnesota . Retrieved from http://new.vawnet.org/Assoc_Files_VAWnet/AR_SVDisability.pdf
18.
Ericksen, J., Dudley, C., McIntosh, G., Ritch, L., Shumay, S., & Simpson, M. (2002). Clients' experiences with a specialized sexual assault service. Journal of Emergency Nursing, 28, 86-90.
19.
Fleishman, J.A., Mor, V., Cwi, J.S., & Piette, J.D. (1992). Sampling and accessing people with AIDS: Implications for program evaluation. Evaluation & the Health Professions , 15, 385-404.
20.
Garland, A.F., Saltzman, M.D., & Aarons, G.A. (2000). Adolescent satisfaction with mental health services: Development of a multidimensional scale. Evaluation and Program Planning, 23, 165-175.
21.
Gondolf, E.W., & Deemer, C. (2004). Phoning logistics in longitudinal follow-up of batterers and their partners. Journal of Interpersonal Violence , 19, 747-765.
22.
Heckathorn, D.D. (1997). Respondent-driven sampling: A new approach to the study of hidden populations. Social Problems, 44, 174-199.
23.
Heckathorn, D.D. (2002). Respondent-driven sampling II: Deriving valid population estimates from chain-referral samples of hidden populations. Social Problems, 49, 11-34.
24.
Heckathorn, D.D., Broadhead, R.S., Anthony, D.L., & Weakliem, D.L. (1999). AIDS and social networks: Prevention through network mobilization. Sociological Focus , 32, 159-179.
25.
Herman, J.L. (1992). Trauma and recovery. New York : Basic Books.
26.
Holmes, M.M., Resnick, H.S., & Frampton, D. (1998). Follow-up of sexual assault victims. American Journal of Obstetrics and Gynecology, 179, 336-342.
27.
International Association of Forensic Nurses. ( 2008). Database of the International Association of Forensic Nurses. Available from http://www.forensicnurse.org
28.
Lebow, J. (1982). Consumer satisfaction with mental health treatment . Psychological Bulletin, 91, 244-259.
29.
Lebow, J. (1983). Client satisfaction with mental health treatment: Methodological considerations in assessment. Evaluation Review , 7, 729-752.
30.
Liamputtong, P. (2007). Researching the vulnerable: A guide to sensitive research methods. London: Sage.
31.
Littel, K. (2001). Sexual assault nurse examiner programs: Improving the community response to sexual assault victims. Office for Victims of Crime Bulletin, 4, 1-19.
32.
Michael, R.P., & Zumpe, D. (1983). Sexual violence in the United States and the role of season. American Journal of Psychiatry, 140, 883-886.
33.
Miller, R.L., & Campbell, R. (2006). Taking stock of empowerment evaluation: An empirical review. American Journal of Evaluation, 27, 296-319.
34.
Miller, R.L., & Campbell, R. (2008). Methodological development for conducting research with disenfranchised, hidden, and hard-to-reach populations. Manuscript submitted for publication.
35.
Miller, R.L., Forte, D., Wilson, B.D.M., & Greene, G.J. (2006). Protecting sexual minority youth from research risks: Conflicting perspectives. American Journal of Community Psychology, 37, 341-348.
36.
Molnar, J., & Stup, B. (1994). Using clients to monitor performance. Evaluation Practice, 15, 29-35.
37.
Muhib, F.B., Lin, L.S., Stueve, A., Miller, R.L., Ford, W.L., Johnson, W.D., et al. (2001). A venue-based method for sampling hard-to-reach populations. Public Health Reports, 116, S216-S222.
38.
Neigher, W.D., & Schulberg, H.C. (1982). Evaluating the outcomes of human service programs: A reassessment. Evaluation Review , 6, 731-752.
39.
O'Connell, A.A. (2000). Sampling for evaluation: Issues and strategies for community-based HIV prevention programs. Evaluation & the Health Professions, 23, 212-234.
40.
Patterson, D., Campbell, R., & Cabral, G. (2007, October). The humanizing effect: How SANE programs are helpful to victims throughout the stages of the legal system. Paper presented at the International Forensic Nursing Scientific Assembly, Salt Lake City, UT.
41.
Pett, M.A. (1997). Nonparametric statistics for health care research . Thousand Oaks, CA: Sage.
42.
Riger, S., Bennett, L., Wasco, S.M., Schewe, P.A., Frohmann, L., Camacho, J.M., et al. (2002). Evaluating services for survivors of domestic violence and sexual assault. Thousand Oaks, CA: Sage.
43.
Rosenbaum, A., & Langhinrichsen-Rohling, J. (2006). Meta-research on violence and victims: The impact of data collection methods on findings and participants . Violence and Victims, 21, 404-409.
44.
Sanders, L.M., Trinh, C., Sherman, B.R., & Banks, S.M. (1998). Assessment of client satisfaction in a peer counseling substance abuse treatment program for pregnant and postpartum women. Evaluation and Program Planning, 21, 287-296.
Stake, R.E., & Abma, T.A. (2005). Responsive evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 376-379). Thousand Oaks, CA: Sage.
47.
Sullivan, C., & Alexy, C. (2001). Evaluation outcomes of domestic violence service programs: Some practical considerations and strategies. Harrisburg, PA: VAWNet, a project of the National Resource Center on Domestic Violence and the Pennsylvania Coalition Against Domestic Violence. Available from http://www.vawnet.org
48.
Sullivan, C.M., & Cain, D. (2004). Ethical and safety considerations when obtaining information from or about battered women for research purposes. Journal of Interpersonal Violence, 19, 603-618.
49.
Townsend, S.M., & Campbell, R. (in press). Organizational correlates of secondary traumatic stress and burnout among sexual assault nurse examiners. Journal of Forensic Nursing.
50.
Ware, J.E., & Davies, A.R. (1983). Behavioral consequences of consumer dissatisfaction with medical care. Evaluation and Program Planning, 6, 291-297.
51.
Warner, J.L., Berman, J.J., Weyant, J.M., & Ciarlo, J.A. (1983). Assessing mental health program effectiveness: A comparison of three client follow-up methods. Evaluation Review, 7, 635-658.
