Abstract
Innovative approaches are needed to increase engagement in HIV treatment and prevention services, particularly in HIV hot spots. Here, we detail our design, training approach, and early implementation experiences of a community-based HIV intervention called “health scouts.” The intervention, utilizing a novel, theory-based approach, trained 10 community residents in an HIV hot spot fishing community to use motivational interviewing strategies and a mobile phone–based counseling application. During the first 3 months, 771 residents (median 82/health scout, range 27-160) were counseled. A directly observed Motivational Interviewing Treatment Integrity scale–based evaluation found adequate performance (median score 20/25, range 11-23). The health scout intervention was feasible to implement in a high HIV-prevalence fishing community, and its impact on HIV care outcomes will be evaluated in an ongoing cluster randomized trial. If found to be effective, it may be an important strategy for responding to HIV in high-burden settings.
Introduction
Innovative approaches are needed to improve HIV prevention, treatment, and adherence to treatment, particularly in high HIV-prevalence hot spots. In Uganda, the overall HIV prevalence is ∼7.4%; however, HIV prevalence is as high as 43% in some fishing communities on Lake Victoria. 1 The complex social–structural nature of these fishing communities, which includes dangerous work conditions, mobile populations, high rates of sex work, alcohol use, drug use, and fatalism, has created challenging environments for the prevention and treatment of HIV. 2
The President’s Emergency Plan for AIDS Relief, the Joint United Nations Programme on HIV/AIDS, and the World Health Organization have recognized the risk of HIV transmission in hot spots and made hot spots a priority of their HIV response action frameworks. 3,4 In their national guidelines, the Ugandan Ministry of Health has recommended treatment for fisherfolk, regardless of their CD4 count. 5 However, evidence on effective strategies for HIV prevention, implementing, and sustaining HIV treatment in hot spots, is limited, making this is a priority research need. 6
We designed a community-based intervention to promote HIV prevention and treatment services in one of the largest fishing communities with a high HIV prevalence, in Uganda. The intervention utilized a novel, theory-based approach that enabled community health workers (CHWs), called “health scouts,” to leverage motivational interviewing (MI) strategies and mobile health technology (mHealth) tools. This article describes our experience designing and evaluating the initial implementation of the health scout intervention as part of an ongoing cluster randomized trial.
Methods
Study Setting
Lake Victoria fishing community (area ∼2 km2, adolescent/adult population ∼4400) in Rakai District in south-central Uganda is the study site. Rakai is bordered by Tanzania in the south and by Lake Victoria in the east. Rakai has 2 primary highways, one highway connecting Kampala (capital of Uganda) to Tanzania and the other the Trans-African Highway which connects Kampala to the Democratic Republic of Congo. The fishing community is ∼235 km from Kampala and is accessed via an untarmacked road off the Kampala–Tanzania highway. The intervention is being implemented and supervised by the staff of the Rakai Health Sciences Program (RHSP), a well-established community-based HIV research and health services organization.
Cluster Randomized Trial Overview
The health scout intervention is being tested in an ongoing cluster randomized trial called mHealth Lakefolk Actively Keeping Engaged (mLAKE) which is registered on ClinicalTrials.gov (NCT02556957). For this trial, the fishing community was divided into 40 clusters that were randomized, with 20 clusters allocated to the health scout intervention arm and 20 clusters to the standard-of-care control arm (see Figure 1). The intervention began on September 2015 and follow-up is planned until 2018. This article reports the process-focused evaluation of the initial 3 months of implementation which was conducted to assess intervention fidelity so that, if needed, modifications could be made early in the course of the trial.

Example mHealth Lakefolk Actively Keeping Engaged (mLAKE) trial cluster map (Intervention–red, Control–gray).
Health Scout Intervention Description
Conceptualization
The design and implementation of the health scout intervention was pragmatically oriented. 7 That is, a general framework was developed for health scout recruitment, training, tasks, quality assurance, and monitoring, but the intervention was allowed flexibility to adapt to the needs, constraints, and secular changes in the setting during implementation. The general framework included the following core components: (1) CHW (health scout)-based delivery, (2) counseling using MI strategies, (3) home based, and (4) mHealth supported.
The health scout intervention was informed by formative mixed methods research carried out in Rakai fishing communities and a broader literature review. A situated Information, Motivation, and Behavioral Skills (sIMB) theory-based conceptual framework was developed, whereby health scouts would promote relevant information, motivation, and behavioral skills to improve clients’ engagement in HIV prevention and treatment services, ultimately leading to improved HIV-related outcomes and decreased HIV incidence (Figure 2). 8 The intervention was “situated” by health scout training that took into consideration the social, cultural, and structural environment and incorporated MI strategies. An mHealth application, which tailored counseling to individual contextual considerations, was an additional situating element. Moderating factors that might influence the health scouts were also considered, for example, differential impact of males counseling males versus females.

Health scout intervention conceptual framework.
Health scout tasks
Using the conceptual framework, specific health scout tasks were outlined. Health scouts were to visit all households within their clusters within 3 months of study initiation and follow up with each “client” within their cluster every 3 months for ∼3 years. Eligible clients for counseling were any persons aged ≥15 years. During each visit, health scouts would counsel clients with assistance of an mHealth application on a smartphone. The application included an individual risk screener and tailored MI-informed counseling modules on HIV prevention and treatment based on the client’s needs and current health status. Health scouts would provide psychosocial support, encouragement, information, and education and troubleshoot barriers to HIV service uptake and treatment adherence. Each health scout would be assigned 2 clusters which together contained ∼215 potential eligible clients. Each visit would take ∼30 to 45 minutes.
Eligibility of health scouts
To become a health scout, individuals needed to have 7+ years of education, be literate, and know their HIV status. Male HIV-negative health scouts had to be circumcised, and HIV-infected health scouts needed to be actively engaged in care.
Community sensitization and health scout recruitment
Approximately 15 community leaders, such as boat owners and businesspersons (eg, landlords), were convened for a meeting by RHSP study staff through personal invitations and sensitized to the health scout intervention and mLAKE study. A subsequent meeting was held with about 30 potential health scout candidates, both self-identified and identified through community leaders. A vote was conducted by these candidates among themselves. The 10 individuals who received the most votes were selected as health scouts, and the 5 remaining individuals were named as alternates.
Training program
The conceptual framework was used to design a training program that included mHealth application/smartphone use, confidentiality, disclosure, MI-informed interaction strategies, HIV-related knowledge, mock counseling role-play, cluster boundary walk-throughs, and filling out home visit forms. A detailed training manual for health scouts was also produced. Peer mentoring during training was encouraged. Initial training consisted of 4 days of classroom work and 1 day of field activities. Training activities were led by a multidisciplinary team of RHSP staff and members of the Johns Hopkins University study team.
Incorporation of MI principles
Motivational interviewing is a communication strategy that takes considerable time, practice, and ongoing supervision to achieve optimal performance. 9 However, given its effectiveness in behavioral change and cross-cultural application, we elected to incorporate basic MI principles into the health scout training. Central to the MI-informed training was to describe, discuss, and model a nonjudgmental, nonconfrontational approach that invites and guides the client to consider behavior change. The health scout role was described as a warm, empathic, and respectful “partnership” to help the client identify strengths, barriers, and facilitators to engaging in HIV prevention or treatment. To develop this dialogue, the following 4 strategies were adopted: open-ended questions, affirmations, reflections, and summaries. We incorporated exercises described in the MI training manual such as differential effects of using close- versus open-ended questions, modeling by study staff, and role-plays of potential client situations. 10
Health scout smartphone application and Web dashboard
The custom-designed health scout smartphone application functioned as a decision support tool to guide health scouts through the sIMB-model informed counseling session (emocha Mobile Health Inc, Baltimore, Maryland, USA). The application takes the health scout (Figure 3) through 3 steps: (1) household screening—household members are screened for eligibility; (2) individualized triage—individual household members are asked a series of triage screening questions, for example, age, gender, HIV status; and (3) MI Counseling—using responses provided during the individualized triage, tailored counseling modules with MI-informed prompts and messages are provided for the health scout to review with the client.

Example screenshots from health scout application.
The application, which incorporated guided, collaborative dialogues composed of open-ended questions and exploration of pros and cons of engagement in care, was meant to further incorporate MI principles and provide health scouts with the necessary prompts to successfully complete MI-informed counseling sessions. Application queries were tailored to potential replies from clients, allowing the health scouts to provide the necessary direction and structure that is consistent with MI counseling style. The application also provided a standardized MI-informed counseling approach across the health scouts. The application contained 9 tailored counseling modules as shown in Table 1. Figure 4 provides a schematic of the counseling module content for an individual who is aware of his or her HIV-positive status but is not yet in care.
Health Scout Application Counseling Modules.
Abbreviation: ART, antiretroviral theraphy.

Example of counseling module content: HIV positive, not in care.
Application development followed the principles of agile software development—a method that emphasizes flexibility, pragmatism, and iterative testing. 11 The study team and software developers held several requirement specification meetings and maintained regular communication during the application development and testing process to identify and address bugs and make improvements to the content and flow of the application. Health scouts contributed suggestions to improve usability prior to the official start of the trial.
A browser-based dashboard was developed in conjunction with the mobile application. The dashboard provides secure access to the mobile phone data as well as analytic tools to aid in implementation, monitoring, and evaluation. Analytic features include tools to track the geographic location, number, and timing of counseling visits as well as visual and quantitative summaries of client responses (Figure 5).

Example screenshots from Web dashboard: (a) map of health scout visits and (b) summary
Support/compensation
Health scouts were provided with a mobile phone, airtime, backpacks, and uniforms. Health scouts were also provided a modest base compensation and could earn additional compensation based on the number of participants visited. Average total compensation for health scouts was about US$1 per day.
Run-In and Initial Implementation Process Evaluation
Health scout competency was assessed using multiple methods. To ensure they understood the boundaries of their assigned clusters, the study team observed health scouts as they independently walked along their clusters’ boundaries. Study staff observed and critiqued health scout performance in role-playing exercises, with a focus on their ability to adhere to the MI approach. Staff accompanied health scouts on their initial client visits. Staff observed health scouts as they approached clients, described the study, obtained oral consent, navigated the smartphone application, and completed the necessary documentation for client visits. The team noted deficiencies and provided individualized feedback and additional training as necessary.
As a run-in period, health scouts counseled 10 clients in week 1 and debriefed and troubleshot the problems with the study team prior to further counseling. After the run-in period, 2 RHSP study staff also observed and formally evaluated 1 counseling session per health scout. The evaluation included a checklist to document successful completion of each health scout task, from proper greeting to application use and visit form completion. The evaluation also included a modified Motivational Interviewing Treatment Integrity (MITI) 3.1.1 scale, an evaluation instrument used to provide structured feedback to interviewers on their use of MI. 12 The MITI is the most widely used MI fidelity instrument and has demonstrated reliability as well as concurrent and predictive validity. Counselor–client interactions are rated on an objective 5-point Likert-type scale evaluating the following MI domains: evocation, collaboration, autonomy/support, direction, and empathy. 12 An average score of 3.5 to 4.0 indicates beginning proficiency and >4.0 indicates competency. The number of visits health scouts had completed during the initial 3-month period was also analyzed descriptively.
Supervision and Continuing Education
After deployment, the RHSP staff conducted ongoing training and supervision, which included regular in-person follow-ups with the health scouts and the development of brief group and/or individualized trainings as needed. The RHSP staff were also available via mobile phone to troubleshoot problems with the smartphone, the counseling application, or to answer general questions about study protocols.
Ongoing Community Sensitization
Before deployment of the health scouts, the RHSP health education and community mobilization team conducted 3 informational public drama shows in the fishing community. These drama shows used music, short plays, and role modeling to inform the study community about the purpose of the health scouts as well as the parent study.
Results
During the first 3 months of the health scout intervention implementation, 771 community residents (median 82 per health scout, range 27-160) were approached and successfully counseled. This number was below the initial goal of ∼215 client visits by each health scout within the first 3 months of implementation. However, due to the run-in period, interruptions in further training, and technical troubleshooting, health scouts were not fully deployed and recruiting clients during significant periods of the initial start-up phase. Additionally, clients were often not at home during attempted visits due to high mobility and varied work hours.
The MITI results for 9 of the 10 health scouts are shown in Table 2. Health scouts completing the MITI evaluation mostly demonstrated beginning proficiency in most domains with a mean composite score of 18.6 of 25 (median 20, range 11-23). One MITI evaluation was not completed because the health scout was unable to properly conduct basic smartphone and visit tasks and was subsequently replaced by an alternate candidate. All health scouts successfully identified their cluster boundaries.
Health Scout MITI Scale Performance.a,b
Abbreviations: MI, motivational interviewing; MITI, Motivational Interviewing Treatment Integrity.
an = 9.
bFive-point Likert scale, with higher scores indicating greater integrity with MI principles; maximum score of 25.
Key additional training needs that arose from these evaluations were the need for additional guidance on using the smartphone application. Health scouts also needed assistance with building rapport with clients and gaining community trust. Some health scouts who did not perform well had difficulty balancing phone use and counseling and didn’t exhibit a full understanding of MI principles during their sessions. These health scouts primarily read straight from the mobile application prompts and didn’t give clients an opportunity to take control of their own health. These issues were addressed with health scouts individually following their evaluation session as well as with group-based continuing education sessions.
Discussion
This article describes the design, implementation, and initial process evaluation of the health scouts, a novel, community-based intervention for HIV prevention and treatment. Health scouts were successfully trained to beginning proficiency in MI-informed counseling through a multifaceted program and were able to complete counseling sessions with a substantial number of clients. However, a number of deficiencies and wide variability in health scout performance signal the need for continued supervision, training, and support for this intervention to fulfill its potential. 13
Several important lessons were learned from this study. First, community residents, most of whom had never used a smartphone before, can be recruited and trained to use a smartphone application to provide MI-style counseling in a very challenging and remote setting. Key to accomplishing this was a flexible, multimethod training approach. 14 Role-play, proficiency testing, peer mentoring, regular feedback sessions, and direct observations were incorporated into the health scout training process. On a cautionary note, a minority of the health scouts demonstrated marginal proficiency, an indication of how challenging it can be to rapidly train lay counselors to an acceptable standard. 15 These individuals likely need additional support or eventual replacement if they are unable to achieve proficiency. 16 More stringent selection criteria and verification of candidates’ credentials may also be helpful. Turnover of health scouts and a trial run-in period should be considered in similar programmatic deployments.
The development of an evaluation form that utilized the standardized MITI scale outlined expected performance targets and helped increase health scouts’ awareness and understanding of expectations. The creation of specific behavioral benchmarks for proficiency as well as for probation or dismissal helped to establish concrete and transparent standards. MITI scales, adapted to local settings, may be a useful tool for training and evaluation of MI approaches in international settings. 15 The MITI was originally developed and used for evaluation in resourced settings after several MI training sessions with proficient counselors. The beginning proficiency achieved by most of the health scouts appears to be a reasonable level of achievement, given the comparatively less intense training they received.
This study had a number of limitations. This study describes the initial implementation of this intervention; therefore, it is unknown how relevant the findings will be to outcomes later in the study. However, we felt it was critical to evaluate early intervention fidelity to ensure that it was being implemented as originally intended. Future evaluations will consist of formal mixed methods, incorporating individual and population-level outcomes, qualitative methods, and detailed process evaluations.
In conclusion, initial implementation of a community-based HIV treatment and prevention intervention in a hot spot fishing community was feasible and modestly successful. The impact of this intervention on HIV care outcomes will be evaluated over the ensuing trial follow-up period. If found to be effective, this may be an important strategy for the HIV response in high-burden settings.
Footnotes
Acknowledgments
The authors thank the health scouts and the participants of the Rakai Community Cohort Study (RCCS) and mHealth Lakefolk Actively Keeping Engaged (mLAKE) Study.
Declaration of Conflicting Interests
The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: emocha Mobile Health Inc. is the company that developed and supported the phone application used in this protocol. LWC is entitled to royalties on certain nonresearch revenue generated by this company and own company equity. With regard to this study, LWC has not received or will receive royalties or compensation from emocha Mobile Health Inc. This arrangement has been reviewed and approved by the Johns Hopkins University in accordance with its conflict of interest policies. All other study team members declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Grants from the National Institute of Mental Health (R01MH107275), Division of Intramural Research, National Institute for Allergy and Infectious Diseases, and Johns Hopkins University Center for AIDS Research (P30AI094189).
