Abstract
Background
Africa is labelled the world's fastest-growing ‘mobile region’. Considering such growth and the fragility of the continent's healthcare, mHealth has flourished. This review explores mHealth for community health in Africa in order to assess its still ambivalent evidence base.
Methods
Using PubMed, Web of Science, OvidSP and Google Scholar, a systematic review was conducted of one decade (2005–2015) of peer-reviewed literature on mHealth in Africa. Data analysis focused on qualifications of success and failure. Impact evaluations of project assessments (n = 65) were complemented with general analyses/overviews of mHealth's effectiveness (n = 35).
Results
Review of these texts reveals ambivalence in the appraisal of mHealth; essentially, the critical stance in general analyses/overviews is absent from project assessments. Especially weak evidence concerning sustainability and scalability is stressed in overviews. Project assessments are more optimistic. Their analysis suggests a causal connection between simplicity and success. Effective interventions are thus characterized by straightforward design and modest objectives. Greatest impediments of impact are general technology-related issues and intervention inappropriateness due to insufficient understanding of beneficiaries and specific context of use (circumstantial complications).
Conclusion
Distinguishing between these two categories of complications helps to break the deadlock that marks the mHealth debate and add nuance to claims that mHealth's evidence base is weak. Constructive realism – rather than unfounded optimism or pessimism without nuance – should guide the design of interventions. Besides anticipative of technology-related complications, such realism must lead to either basic interventions or to smart mHealth shaped by deep understanding of the context of implementation.
Introduction
Within the previous decade, Africa has witnessed the fastest growth in mobile phone subscribers in the world, estimated at 955 million in 2015. 1 Decreasing costs of technology and telecommunication along with expanding network coverage, primary causes of such growth rates, have also stirred interest in the potential of mobile phones as devices for development. Besides agriculture and education, health care in particular is considered a realm in which improved communication and innovative mobile applications can prove a cost-efficient route to progress. Accordingly, mobile health (mHealth) – defined by the WHO 2 as ‘medical and public health practice supported by mobile devices, such as mobile phones, patient monitoring devices, personal digital assistants (PDAs), and other wireless devices’ – flourishes. It has become the focus of a wide range of projects across the region that aim to address crucial inadequacies (e.g. inaccessibility and lack of information) that cripple rural African health care in particular.
Unfortunately, great enthusiasm for mobile technology is not backed by conclusive evidence of the (significant) impact of mHealth projects. In fact, despite of the availability of a growing body of research on mHealth in Africa, insight in the complexities of cost-benefit, scalability, transposability, continuity and technology adoption remains limited. Particularly striking is the apparent lack of advance that surfaces if early and more recent reflections on mHealth are compared. Indicative is the conclusion by Aranda-Jan et al. 3 in one of the latest literature reviews on mHealth in Africa. According to Aranda-Jan et al., ‘evidence [concerning the success of mHealth] remains poor […] and questions regarding impact, scalability, increase coverage, cost-effectiveness and sustainability […] are yet to be addressed’ (p.188). 3 Such a conclusion resonates with a much earlier observation of Kaplan 4 that ‘convincing evidence regarding the overall cost-effectiveness of mobile phone “telemedicine” is still limited and good-quality studies are rare’ (p.12). 4
Apart from being remarkably similar despite of the 8-year time-lapse, these two relatively critical observations concerning the evidence base of mHealth are representative of the lack of enthusiasm that characterizes the tone of most literature studies and conceptual/thematic pieces included in this systematic review. In contrast, most of the reviewed project assessments report positive results from mHealth interventions. Although virtually all texts do identify obstacles that hinder implementation, project assessments tend to emphasize successes and potential and positive impact despite the critical challenges that are (in contrast) highlighted in literature studies and conceptual/thematic articles. Virtually all reviewed project assessments concern pilots or small-scale interventions. Examples of upscaling and broad-based interventions can be found throughout the continent (particularly interesting are open-source applications like CommCare and Medic Mobile). Unfortunately, despite indications of their success in the grey literature, comprehensive research on their effectiveness at large is currently not available in peer-reviewed work. As such, they are not included here.
The aim of this review, which includes 65 project assessments and 35 conceptual/thematic articles and literature reviews, is to assess a body of scholarly literature in order to explore and explain, and eventually move beyond, the unconstructive ambiguity that marks the evidence base of 10 years of mHealth in Africa. It thus provides a systematic analysis of reported success factors as well as obstacles, with an emphasis on the latter. The particular selection of reviewed articles indicates the need for an exclusive focus. mHealth is an extremely dynamic and variegated field, with applications in data collection and disease surveillance, patient follow-up and medication adherence, communication and information for health care workers (HCWs), health promotion and disease prevention and remote monitoring. Including the entire diversity of these application categories would severely complicate opportunities for comparison.
Instead, the current review makes a careful selection to include only those application categories that are immediately related to the improvement of health care delivery services, and consequently, the enhancement of what can be called community health. This does not imply the prioritization of certain categories. Yet, comparing the assessments of mHealth as ‘remote monitoring’ or ‘data collection’ with those of mHealth ‘health promotion’ or ‘disease prevention’ will serve to obscure rather than aid systematic review. Excluded are mHealth applications for ‘remote monitoring’ and ‘data collection’, as these – albeit in different ways – both imply an outward flow of information (community –> externals). Hence, they do not immediately address patients or beneficiaries or aim to increase local knowledge and trigger behaviour change, and will only indirectly improve health outcomes. Furthermore, this review addresses mHealth through examining community health projects that use mobile (feature- or smart) phones. Studies concerning other types of mobile devices, such as PDAs and tablets, are excluded from this review. The reason for this is the highly dynamic nature of mHealth. As PDAs have already become outdated, the use of tablets is still so much in its infancy that there is insufficient material to allow proper evaluation. This means the focus in this review is entirely on assessments of the use of mobile phones to support the immediate improvement of the health status of communities in (generally rural) African areas where medical facilities are scarce and underequipped. It includes interventions/ activities pertaining essentially primary health care, addressing common medical needs, health practices and challenges of a population deprived of adequate and accessible services. Labelled ‘community health’, this focus includes the application of mHealth for the purpose of: (a) patient follow-up and medication adherence, (b) communication and information for health care workers and (c) health promotion and disease prevention.
The review also includes overviews of mHealth research (literature studies) and more general contemplations of the field and subfields of mHealth and its core concepts (conceptual/thematic articles). Apparent differences in the evaluation of mHealth's potential – the optimism of project assessment versus the critical perspectives that dominate literature studies and conceptual/thematic articles – will be analysed and explained in the final section of this review. Moving beyond such ambivalence in the evidence base, the article concludes that a distinction should be made between technology-related complications that relate to the technical nature of the interventions, and circumstantial complications that involve the multifaceted context of implementation. It is argued that, in order for mHealth to realize its potential, persistent naivety concerning common technology-related complications (e.g. connectivity issues, erratic power supply) should first be eradicated. However, more fundamental to the ultimate valuation of mHealth are circumstantial complications. Project assessments below indicate that most successful interventions are the ones least affected by contextual challenges because of their simple design and modest objectives. Complex interventions that aim for more intricate attitudinal and behavioural change prove ineffective as a result of a lack of detailed insight into, for instance, local power dynamics, socio-cultural peculiarities and communicative conventions. Comprehensive assessments are direly needed to boost the impact of these ambitious interventions. Yet, contrary to what is argued elsewhere, looking for transposable recipes for change by means of an intensification of existing (randomized controlled trial (RCT)-dominated) research strategies will not suffice. Instead, the review indicates in-depth understanding should be gained through qualitative and participatory analysis of context specific factors that determine the success of mHealth at a given time and place.
Materials and methods
An electronic systematic literature search was conducted using PubMed, Web of Science and Journals@OvidSP. Search terms used included “mHealth OR m-health AND Africa” and “Mobile phones OR cell phones OR smartphones AND health AND Africa”. In addition to these search engines, Google Scholar was used to check for missed articles that met the inclusion criteria. The searches were limited to articles published in English between 2005 and 2015. The searches were performed in 2015 by one author. All duplicated articles were removed automatically using Mendeley and a manual revision was done for verification. From the total search results, all abstracts were screened, and studies were selected for full-text review. Full-text articles were searched manually in digital sources, and studies were excluded when access to full-text articles was not available. To avoid selection bias, the two authors carried out the full-text article review and any difference in the selection was discussed and papers selected accordingly. Exclusion criteria were: not about Africa exclusively, article not peer-reviewed, and non-mHealth implementation (e.g. telemedicine, other types of eHealth). Because this review concerns contributions of mobile devices to community health exclusively, articles about mHealth as remote monitoring and data collection have been excluded. Except for project protocols, all study designs (RCTs, pilot project, literature reviews etc.) were included.
Results
From a total of 1110 search results (after removing duplicates) 159 studies were selected for full-text review, of which 99 studies were included in the review according to the inclusion criteria. On the basis of peer review of the original manuscript, one final project assessment was added, resulting in 100 included studies, published between 2005 and 2015. This encompassed 65 project assessments – 64 that solely deal with mobile phones and one that includes tablets – as well as 16 literature reviews, and 19 conceptual or thematic articles. The project assessments were further classified into topics according to the type of intervention: ‘Patient follow-up and medication adherence’ (n = 27), ‘Communication and information for HCWs’ (n = 22) and ‘Health promotion and disease prevention’ (n = 16). When a project assessment fitted two or more categories, the authors selected the dominant and classified the project as such. Figure 1 presents a flowchart detailing the inclusion/exclusion process. A large number of project assessments were pilot studies or even pre-trial investigations. Furthermore, most of the RCTs were implemented at community level and not yet scaled up. Hence evidence presented on effectiveness is limited and the long-term impact is unclear. Nonetheless, conclusions tend to stress the feasibility of projects and their potential to aid healthcare delivery in Africa. The following sections will discuss the findings of the project assessments classified per type of intervention. The discussion will assess the obstacles and barriers to mHealth for community health that seem most pertinent.
Inclusion/exclusion flowchart.
1. Patient follow-up and medication adherence
Overview of studies on patient follow-up and medication adherence (n = 27).
Pre-trials (n = 8)
Most pre-trial studies are investigations into the feasibility and acceptability of proposed interventions. Half of these studies were qualitative studies, relying on, for instance semi-structured interviews to investigate the possibilities of text message reminders for elderly people, 5 HIV patients, 6 or mental health patients 7 to take their medication. Another concerned the ‘adoption prospects’ of mHealth applications in an antiretroviral (ARV) clinic. 8 Another study 9 was a cross-sectional user requirement study of graphic texts to support TB patients in their treatment. This research used a Participatory Action Research model, including ethnographic research. A mixed-method study 10 explored the possibilities of community ownership over a text-messaging programme to improve adherence to antiretroviral therapy (ART). Two studies employed quantitative methods. The first was an investigation into the barriers of using mobile phones for paediatric HIV care. 11 The second was a cross-sectional study of the feasibility of text messaging to improve treatment adherence of children with malaria. 12 All these studies indicated a general5,7,9 to high 12 feasibility of the proposed implementation. However, four of them also outlined foreseen challenges. For instance, language illiteracy was pointed out in two studies as an important barrier to text-based reminders.10,11 Also, studies mentioned concerns about privacy6,8 and responsibility for costs.8,10 The study which included clinic workers’ perspectives 8 found that rather than mobile phones, clinic workers preferred to have more training, staff, financial support, volunteers and community involvement. In this study, 34 out of 55 clinic workers said they were not willing to contribute financially to the proposed project.
Pilots (n = 5)
Out of the five pilot studies, three used quantitative methods. One of these 13 tested a mobile direct observation system to monitor TB patients’ medication adherence. It concludes that both patients and health professionals consider it a viable option. However, further research is needed to see if it indeed improves medication adherence and to explore the cost effectiveness. Another study 14 used ‘flashing’ (i.e. generating missed calls) to improve HIV patients’ attendance for follow-up at the clinic. This intervention did not improve attendance rate at all. In contrast, a third pilot study, 15 using text message reminders, did improve adherence to anti-malarial drugs.
The two qualitative pilot studies both concerned (prevention of) mother-to-child HIV transmission.16,17 The first evaluated an interactive SMS support group, consisting of young mothers and a clinician, and measured overall satisfaction with the intervention. The second one assessed the combination of text messages and calls from a clinician as a highly feasible and acceptable form of maternal support. This study found that emotional and motivational support is most frequently cited as the greatest participation benefit.
Summarizing, it can be seen that four out of five pilots showed positive results, either in the form of (high) feasibility or acceptability13,16,17 or in the form of significant adherence improvement. 15 Nevertheless, the interactive support-group intervention 16 highlights frustration with malfunctioning phones and confidentiality challenges due to the frequent sharing of phones. It also poses the question of how it can be assured that the intervention, after scaling up, will include the most stigmatized women. The only study with negative results 14 fails to provide a solid explanation for this. Rather, it suggests that non-adherence despite flashing-reminders might be related to ‘cultural beliefs’.
Post-trials (n = 14)
Out of 14 post-trial studies, six were RCTs. Two of these concerned the monitoring of medical abortion in South Africa. The first 18 evaluated whether text messages to women who were about to have a medical abortion can reduce anxiety and better prepare them for symptoms. The results are significant. The second RCT 19 established whether women having a medical abortion could self-assess whether their abortion was ‘complete’ using an interactive mobile phone questionnaire. This, however, did not predict all cases needing additional treatment at follow-up. One RCT 20 evaluated text reminders for anti-malarial treatment. It showed significant results. The other three RCTs concerned HIV care. Two of them21,22 indicate significant improvement of ART adherence due to SMS reminders. The third study 23 provides more complicated findings, suggesting for instance that literacy is a robust predictor of success.
There were six post-trial studies that were not RCTs yet deployed a quantitative research design. Two of these were cross-sectional studies.24,25 Except for one, all were concerned with HIV care. The exception concerned a helpline meant to enhance communication between cancer patients and their doctors. The helpline proved very successful. 26 Another study 25 initiated a two-way communication system which allowed people with HIV to express needs as well as gratitude by responding to text messages sent to them to improve medication adherence. A study in Zambia found that, in the diagnosis of infant infection with HIV, turnaround times could be reduced by using an automated notification system based on texting. 27 Another study, 24 which contacted HIV patients via voice or text to remind them about their missed clinic appointments, also shows positive results. The last two quantitative studies evaluated the acceptability and barriers of SMS reminders to enhance ART adherence among patients who had previously participated in an RCT.28,29 Both studies indicated general satisfaction but various preferences with respect to content, frequency and timing of text messages.
The two qualitative post-trial studies were in-depth analyses of the experiences and responses of RCT participants.30,31 The first 30 interviewed patients of the earlier mentioned medical abortion studies.18,19 They conclude that SMS messages 18 were highly acceptable, although more women had worried about phone privacy than estimated at baseline. The self-assessment questionnaire 19 was successfully completed by 86.3% of the women. The second study 31 conducted focus groups and individual interviews to explore experiences with a text-based adherence support intervention on blood pressure control. Patients highly valued the SMS content, the respectful tone, the delivery experience (timing of reminders and frequency) and the relational aspect of trial participation (feeling cared for).
In conclusion, most post-trials have generally positive outcomes that reveal the feasibility and potential of mHealth projects for patient follow-up and medication adherence. Only two studies emphasize (literacy) challenges 23 or inadequacies 19 over potential. With respect to the barriers, privacy again turned out to be a challenge, as well as the importance of assessing the context and piloting. 30 Some studies found that patients preferred voice messages above text messages because of illiteracy. 24 With respect to cultural and gender issues, the study that set up a helpline 26 reports that three out of four married women felt that having their husband speak to the doctor made it easier to arrange for follow-up visits to the clinic, because women cannot travel to the clinic without permission of their husbands. Such permission was difficult to obtain prior to the intervention. The same study also reports that half of all participants had to borrow a phone to be able to call the doctor. With respect to the content and frequency of text messages, one study 20 suggests that, although a simple text message reminder can increase adherence to anti-malarial treatment, additional information included in messages does not have a significant impact. A second study 28 points out that although most patients were willing to receive SMS reminders to attend clinic appointments, only few expressed enthusiasm for daily SMS reminders to improve ART adherence. Finally, one study 29 argues that subsequent controlled trials in expanded settings and in-depth qualitative research are required to confirm and elucidate findings concerning determinants of (lasting) participant engagement.
Synthesis
Considering its primary objectives of reminding and informing, ‘patient follow-up and medication adherence’ can be regarded the most successful and straightforward application category. The reviewed articles suggest that, especially in the form of basic and immediate instruction – for example, text messages that simply remind patients to take their medication or attend clinics – this kind of application is realistic and effective. Complicated manifestations of patient follow-up and medication adherence seem less impactful. Evidence indicates that the success of interventions that, for instance, involve the execution of more complex tasks is limited at most. Illustrative is the failed attempt to have post-abortion women fill out an interactive mobile phone self-assessment questionnaire to see whether the abortion is indeed complete.
Challenges mentioned regardless the level of task complexity include (in order of prominence): illiteracy, securing privacy and confidentiality (due to phone sharing), financing (unwillingness of beneficiaries to contribute) and (mal)functioning of technology. Differences between pre-trial, pilots and post-trials are small. Optimism dominates all three types of assessments, although challenges are most carefully outlined in (predominantly qualitative) pre-trial studies.
2. Communication and information for (community) health care workers
Overview of studies on communication and information for health care workers (n = 22).
Pre-trials (n = 5)
Two out of five pre-trial analyses are mixed-methods studies.32,33 Another employs computer-based modelling. 34 A third uses a literature framework. 35 A final pre-trial concerns an ethnographic study. 36 The first mixed-method study 32 is a usability study that aimed to design user-friendly smartphone applications for community health workers (CHWs). It argues that unrestricted use of smartphones generated a strong sense of ownership and empowerment among the health workers. This is said to work as a strong motivator. The second mixed-method study 33 investigates the acceptability of CHWs using smartphone applications to enhance communication, clinical decisions, and to receive alerts. The aim was to improve patient care at a community-based HIV/AIDS clinic. This study reports general enthusiasm for mHealth. However, it also raises interesting concerns about possible negative consequences. For instance, research participants worried about security issues – such as potential theft – that make the CHWs insecure about walking at night. Another issue raised was the danger of CHW tasks exceeding certain limits. One CHW expressed concern that technology would be detrimental to the human side of their work, stressing that ‘physical sharing is very important’. Interestingly, participants expressed ideas on what needed to be done at a community level to prepare for the introduction of a mHealth intervention to minimize undesirable outcomes. Finally, some participants demonstrated unrealistic expectations of mHealth capabilities.
A third study 34 uses modelling software to identify priority areas for maternal and neonatal health services. This study suggest that skilled birth attendance and increased facility delivery as targets for mHealth strategies are likely to provide the biggest mortality impact relative to other intervention scenarios. A fourth study 35 compares the feasibility of a text message intervention for malaria in Burundi and Zimbabwe. It argues that while it is feasible in Zimbabwe, there are too many challenges in Burundi.
A fifth study 36 is an ethnographic usability study of a smartphone-based app that allows medical virtual volunteering. It shows that only with ‘real’ users, operating in the intended context of use, will usability problems be adequately detected. For this purpose, ethnographic research proved valuable. For instance, respondents in this study claimed they managed to finish the tasks, while the researchers observed that some had significant problems and could, in fact, not complete the tasks.
Pilots (n = 6)
Four out the six pilots targeted enhanced communication between (remote) CHWs and other medical staff.37-40 The other pilots two aimed to improve knowledge of clinicians.41,42
All four studies targeting enhanced communication distributed mobile phones to CHWs in an interactive text message-based network, using RapidSMS 40 or comparable interactive SMS networks.37-39 The results are very positive: impressive changes in the operational capacity of the hospital, saved fuel and time-consuming trips, higher resolution in data reporting, and expanded healthcare delivery capacity.37-39 in addition, CHWs benefitted from more trust and respect, and increased status in their communities, resulting in self-confidence and improved quality of care.37,38,40 On the basis of participatory evaluation, one study 37 reports that CHWs had transformed into active information agents, recipients as well as providers of information, well connected to colleagues, beneficiaries, supervisors, and district health facilities. The only challenges that surfaced in these studies were telephone maintenance and lack or limited access to electricity. 40
The remaining two pilots targeting clinicians show less positive results. The first 42 reflects on Botswana's first telemedicine and mobile learning programmes. This pilot study addresses numerous technical and social challenges, including malfunctioning phones, unreliable IT infrastructure, accidental damage to mobile devices, and cultural misalignment between IT and healthcare providers. It suggests that strategic goals of mHealth programmes should be aligned with those of national health policies and educational systems, and stresses that initiatives must be owned and led by local stakeholders. The other study 41 tests txt2MEDLINE among clinicians. It shows how clinicians' use of this service is severely undermined because of some key issues in the application design.
Post-trials (n = 11)
Both the RCTs43-45 and the mixed-methods studies46,47 present findings on attempts to improve the quality of care of CHWs (with one exception 42 where drug sellers are the ‘beneficiaries’). The quantitative studies48-50 are concerned with the design and implementation of mHealth projects. The two qualitative studies51,52 present perceptions and experiences of CHWs participating in quantitative studies. The one remaining article 50 is a cost-effectiveness study of one of the RCTs, 45 written by the same authors.
The RCT which targets drug sellers did not find indications of behaviour change. 43 Another RCT 45 succeeded in improving CHWs’ adherence to malaria treatment guidelines, and proved cost effective. 50 Findings from other studies emphasized that most challenges were not technical but related to the (mal)functioning of health care systems, such as poor motivation caused by low salaries, limited professional and career development, and lack of incentives.44,47 One study 44 argued that mobile phones will not replace the need for the ‘human face’ of support as well as the need for CHW supervision. One mixed-method study 46 showed insignificant statistical results yet qualitative indications of improvements in patient care and additional benefits such as a sense of empowerment among CHWs and improved CHWs–patient communication.
Like the RCTs, the three quantitative studies also stress non-ICT-related barriers to implementation of mHealth projects. For instance, they mention programme delivery characteristics that were not easily addressed by the additional ICT component 48 and the need for training and follow-ups which are necessary for the intervention to work. 51 One study 49 emphasizes the willingness of CHWs to learn and develop new skills as something that may contribute to improved health care. The qualitative studies show a general acceptability of mHealth projects. One study 52 calls for more research into the effects of specific SMS characteristics (e.g. frequency, delivery, and number of messages) and shows how participants expressed the view that SMS could not be used to replace training and seminars. The second study 53 again shows how – even if participants appeared motivated – there was a low uptake of technology because of the (mal)functioning of health systems and related barriers such as a lack of staff, lack of medicine, and lack of financial motivation.
Synthesis
Research on ‘communication and information for health care workers’ shows more ambiguous results than research on ‘patient follow-up and medication adherence’. The presence of non-technological barriers is more apparent in this application category. A crucial challenge concerns the fact that beneficiaries in Africa – that is, local medical staff – are positioned within generally inadequate or dysfunctional health care systems. Rather than merely individual practice, success of the intervention thus depends on the way in which these systems are organized, are able to facilitate change and, for instance, affect motivation of those involved.
Within this application category, a research type-related difference in project valuation surfaces. Whereas pilot studies show comparatively positive results, post-trial assessments indicate the presence of complications alongside accomplishments. Similar to ‘patient follow-up and medication adherence’, such difference correlates with the complexity of the intervention (rather than type of study). For instance, a pilot assessing an attempt to simply improve communication between remote HCWs and clinic-based medical staff (RapidSMS) reports straightforward successes. Yet, a post-trial research on the effectiveness of an intervention meant to improve knowledge, build competence and realize behaviour change proved challenging as a result of the complexity of aspired change and the impact of systemic flaws (e.g. lack of staff, limited treatment facilities).
3. Health promotion and disease prevention
Overview of studies on Health promotion and disease prevention (n = 16).
Pre-trials (n = 2)
Both pre-trials were qualitative and exploratory studies into the contextual factors influencing SMS interventions. The first 54 explores the potential of text messages to HIV-positive women and their partners as a means to prevent mother-to-child transmission. This study found general acceptability of the gender-tailored SMS and voice calls. However, not all types of information proved equally acceptable, and participants preferred personalized messages above generic ones. In addition, health workers emphasized the continuous need for person-to-person counselling coupled with, rather than replaced by, telecommunication. The second study 55 explored the barriers and limitations experienced by young women with respect to the use of their phones to access sexual and reproductive health services in Nigeria. Crucial barriers were cost of service, confidentiality and anonymity concerns due to requests for socio-demographic information, poor marketing and publicity, socio-cultural beliefs and expectations, power relations with male partners, and poor infrastructural/network quality. Considering these barriers, the authors expect that socio-cultural challenges will be the most difficult to overcome, especially considering the fact that young girls require permission from gatekeepers to use mobile phones and, consequentially, access the service.
Pilots (n = 6)
Out of six pilots, four were quantitative studies56–59 assessing the effectiveness of SMS messages or campaigns in providing health information. Of these, only the text-based HIV/AIDS campaign 56 reports very negative results. The project failed to increase knowledge levels on a sufficient scale, with only one-fifth of participants responding to any of the SMS questions. In addition, the programme's intended audience – those who do not have correct HIV/AIDS knowledge – were not those most likely to receive the correct knowledge through this campaign, thus reinforcing existing knowledge divides within the population. In contrast, using SMS to provide contraception information to young people 57 or family planning information 58 and as reminders for timely immunization 59 were assessed more positively. Besides addressing technical issues, 59 important recommendations were to implement mHealth as complementary to traditional health programming and not as stand-alone-interventions, 57 and to extensively engage husbands for immunization-related interventions. 59
The two remaining papers were mixed-methods studies.60,61 The first 60 concerns the MoTeCH initiative in northern Ghana; a complex system comprising several different processes and the engagement with multiple target groups. Aimed to improve community-based primary health care, MoTeCH sends weekly educational voice messages to pregnant women and young mothers. In addition, nurses send patient data to the MoTeCH system, which is then aggregated to generate monthly reports to district health managers. The authors conclude that (mainly) software changes are needed for the programme to work well. For MoTeCH to be able to address all concerns, ‘its design and implementation requires nothing less than a systemic change in Ghana's existing health information system process’. 60
The last pilot 61 concerned a mixed-methods exploration of the potential of working with community volunteers as intermediaries to extend access to mHealth for individuals with no phone. Borrowing the volunteers' phones, beneficiaries could call a toll-free hotline or receive text or voice messages on reproductive, maternal, and new-born health topics. Although the service was used by people without personal cell phones, there were significant challenges. Solar panels used to charge the phones did not function, and 70% of the low-cost phones broke down. Volunteers had received inadequate training and some did not know how to use the phones. In addition, motivation to partake (as volunteer) dropped significantly as a result of a lack of (financial) incentives. Finally, beneficiaries said it was inconvenient to travel to the volunteer, who often lived far away.
Post-trials (n = 8)
The post-trials include three RCTs that all used text messages and show significant impact. Two of them used texting to improve (infant) HIV testing and prevention of mother-to-child HIV transmission.62,63 Infant HIV testing in particular increased, while overall return rates for postpartum visits remained low. 63 In addition, it was found that the amount of text messages that were sent did not have a statistically significant effect. 62 The third RCT 64 managed to significantly increase skilled delivery attendance among urban women. However, it did not reach rural women.
Three quantitative studies65-67 present more diverse findings. Two of them employed an interactive SMS quiz design. One study 65 aimed to explore the viability of SMS as a user interface technique for untrained users, and assessed the potential impact of social factors, such as literacy, on participation rates. While, for instance, the impact of literacy remains uncertain, findings show that SMS messages can be used effectively with untrained users. However, the authors believe that it may be possible to help participants to learn more quickly how to respond correctly to the system by modifying the feedback it sends. A second study 66 was a cohort study which aimed to assess the response patterns of participants in free SMS health quizzes. Results indicated that the most important factor influencing response time and participation rate was the reliability of the network (provider). Quiz topics also influenced both participation rates and response time. The third study 67 determined the difference in delivery success of health messages through SMS, voice to personal phones, and voice retrieved from a community phone. Findings indicated that SMS was the preferred delivery method because of lower cost, higher delivery success, and higher levels of intended or actual behaviour change.
The only mixed-methods study, 68 exploring the use of text messages by pregnant women, was hindered by a substantial loss to follow-up, and failed to improve antenatal health knowledge. Nevertheless, there was some evidence of (self-reported) healthier behaviours during pregnancy.
The final study is by the same authors of the pilot on HIV/AIDS campaign that was negatively assessed. 56 In their post-trial evaluation 69 the authors present interesting lessons learned. They argue that socio-cultural, informational, and economic vulnerabilities associated with gender, illiteracy, poverty, and stigma were not considered in the SMS programme design. However, gender patterns, for instance, are a key driver of the HIV epidemic in Uganda, as women are subject to male-dominated relationships. The relationship between food insecurity, as an outcome of extreme poverty, and increased sexual risk-taking by women is an example of economic vulnerability. However, women who tend to be more affected by the stigma associated with being HIV-positive might not have benefitted from SMS campaigns due to their lower mobile phone ownership. Consequently, the campaign may have failed to reach some of the most vulnerable segments of the population (e.g. lowest-income females). Also, quiz design motivated recipients with the correct HIV/AIDS knowledge to respond (and thus become eligible for free HIV screening). In doing so, however, the more vulnerable sections of the population, such as those with limited knowledge, remained unreached. Another weakness concerned the dependency on only one telecommunication provider. Because of this exclusive partnership, subscribers of other providers were automatically ineligible. The authors recommend that, in order to address socio-cultural and informational vulnerabilities, future SMS interventions should opt for a participatory approach and include the community in designing campaigns.
Synthesis
Assessments of interventions in the realm of ‘health promotion and disease prevention’ report generally positive results. An exception concerns the pre-trials; they stress the difficult task of overcoming socio-cultural challenges. Pilots and post-trial studies are more optimistic. However, also these indicate that simplicity is a key determinant of success. Most effective is one-way text messaging (e.g. messages urging vaccination, HIV/AIDS testing or clinic delivery). Interventions that moved beyond simple instruction, or for instance require a systemic change in existing health information systems, proved less effective. Particularly interesting is the problematic distribution of information – for the sake of behavioural change – by means of SMS. Attempts to build knowledge or create awareness by means of, for instance, quizzes proved ineffective as participation is often limited to people who are already informed and aware. Reaching the most vulnerable segments of populations (e.g. women, illiterate, poor) requires project initiators to tackle the issue of access and put much more effort in the design of content. The reviewed articles unfortunately provide little indication of successful recipes to do so.
Discussion
Overview of conceptual/thematic mHealth studies.
Of the conceptual/thematic articles included in this review, seven address the general problems and general potential of mHealth.4,70-75 Four articles focus on the potential of mHealth for a specific condition or field of care: mental health, 76 sexual and reproductive health, 77 HIV care 78 and malaria. 79 Two articles assess specific target groups: midwifes 80 and field-based HCW. 81 Two other articles concern the scaling-up of mHealth projects.82,83 One article offers a conceptual framework for designing mHealth solutions, 84 one article is concerned with defining mHealth, 85 another reflects on contextual barriers, 86 and a final article provides a mHealth typology. 87
Strikingly, the majority of these studies express grave concerns about the current weak evidence base of mHealth. In fact, the dominant overall conclusion is that there is yet insufficient proof of the effectiveness of mHealth.4,73,74,76,83 Interestingly, most barriers that are highlighted go beyond mere technological challenges and are related to:
Broader systemic challenges,72,82 such as inadequate training to support HCW, conflicting health system priorities or difficulties integrating technology with existing information systems. Political issues,70,77,80,86 such as insufficient political commitment and support, or disagreements between stakeholders with different agendas. Logistical and infrastructural issues,74,80,82,86 such as a weak ICT environment with limited implementation capacity, or inconsistent access to electricity. Cultural issues,4,74,80,86 such as high illiteracy rates, hierarchical access to technology, phone sharing which complicates confidentiality, (gendered) power dynamics.
The central message is that mHealth should not be perceived as a magic bullet or stand-alone intervention which can resolve existing problems;71,72,74,81 neither can it be used to replace the role of conventional health care providers.71,72,76 Another repeatedly emphasized concern is that context matters, and that it is important to understand the (social, cultural, political and even communicative/linguistic) dynamics of phone use.71,81 There is too often a gap between how a programme was originally designed to work and how it functions in the field. 81 Hence there is need for mHealth projects which take an integrated and user-centred approach, designed with a specific target group in mind rather than being technology driven.70,71,80
Unsurprisingly, researchers thus (continue to) call for more research to provide mHealth with its much-needed evidence base: more RCTs, 78 qualitative research,71,79 cost-effective evaluations,4,72,79 and impact evaluations.73,74,79
Overview of mHealth literature studies.
All 16 studies conclude that, despite some promising initial results at a small scale, there is not enough evidence to be confident about the scalability and sustainability of most mHealth ventures. Consequently, and like the conceptual/thematic articles, also all these studies stress the urgent need for rigorous research, in particular impact evaluations91,94,98,99,101,102 cost-effectiveness studies3,90,98,99 and (qualitative) research into context of implementation.92–94,96,101
Barriers to implementation often mentioned mostly concern policy-related and cultural or contextual issues. With regards to policy-related challenges, authors stress a dependency on funding, unclear health system responsibilities, unreliable infrastructure, and a lack of evidence on cost-effectiveness. 3 Yet, they also observe a gap between what application designers do in practice and what the governments consider priorities. 98 One study 100 argues that, in this respect, a ‘national ownership’ of mHealth cannot be overemphasized.
In line with the conceptual/thematic articles, literature reviews also stress that particularly crucial to the success and failure of mHealth projects are cultural and contextual issues,92,94,96,99,101 and the careful integration of mHealth into the existing healthcare system.91,94,99 Projects have proven to be most successful when they have been adjusted to fit the local context and language, when they are backed by a government with an existing mHealth strategy and an interest in creating a system to integrate mHealth, and when they have been developed and implemented by public–private partnerships (e.g. participation of local private service providers).91,94 Absolutely crucial in this respect is to opt for a user-centric design in which, more than currently, there is a focus on the complex process of adoption.94,99,101 and an effort to collaborate with local partners.91,94
Conclusion
(Potential) benefits of mHealth projects are stressed in most project assessments discussed in this review. Despite significant limitations and challenges that surface in the majority of these texts, by and large they are characterized by an overall sense of optimism. Such optimism is in stark contrast to virtually all conceptual/thematic articles and literature studies, which continue to stress the weak evidence base of mHealth.
Systematic review of 10 years of mHealth research (2005–2015) – with an exclusive focus on community health in Africa – suggests that this contrast can be explained as the result of the difference in focus and objective of the various scholarly assessments. Project-based studies generally show an (inevitably) limited scope, not exceeding the confines of the project as defined, as well as a limited timeframe (mainly surrounding trial phase). Also, they are more likely to be biased towards validation as a result of project affinity. Such affinity is absent in conceptual/thematic articles and literature studies. They provide an aerial perspective instead, and move beyond narrowly defined project objectives in order to detect tendencies and contemplate and categorize the strengths, weaknesses, opportunities and threats that characterize practices in the field of mHealth.
All but one of these conceptual/thematic articles and literature studies (n = 34) conclude that mHealth's evidence base is at least too weak to legitimize existing confidence in mobile phones as (cost-)effective instruments of rapid advance in African health care. In particular, these texts report a lack of understanding of, or a serious reason to doubt, the sustainability and scalability of mHealth interventions. Even though project assessments report improved communication and behaviour change, the overview studies stress the presence of flaws and structural challenges that prevent broad implementation and undermine the sustainability of change.
The systematic review of research on mobile phones for community health above indicates these flaws and challenges concern two ‘categories of complication’. Distinguishing these two categories, recognizing their explanatory value in the assessment of mHealth's potential in Africa, allows us to move beyond the optimist/critic divide and add some crucial nuance to the observation that evidence remains scarce. Essentially, a distinction should be made between technology-related complications of a universal kind, and circumstantial complications that are context (time and place) specific. Technology-related complications concern the technical nature of mHealth as a developmental phenomenon: the practical difficulties that one encounters as the intervention involves the distribution of complex and vulnerable devices that require a reliable technological infrastructure to function properly. Across Sub-Sahara Africa, realization of the potential of mHealth projects is undermined by similar ‘phenomenic’ complications such as: poor network service, inconsistent access to electricity, malfunctioning phones, and a lack of resources necessary to secure maintenance and incessant subscription. The persistence of technology-related complications as one of the reasons for project failure seems naïve and suggests that, at the point of (pilot) implementation, it is too often unclear whether or how general technological preconditions are locally met. A solid pre-project assessment would at least allow more effective anticipation of technology-related challenges.
Once adequately addressed, and with the inescapable advance of information and communication technology (e.g. Google's Project Link and Project Loon), these technology-related complications – prominent in current reviews – should ultimately not determine our verdict on mHealth. Rather, the focus should be on what works and what does not work once technology-related challenges are effectively tackled. This involves a contemplation of the impact of circumstantial complications that depend on the wider context of implementation: the local organization of education, political conditions and, for instance, the socio-cultural dynamics that shape interactions, communicative practices and adaptation trajectories. As shown above, the relevance of such circumstantial complications is widely recognized. However, possibly due to the techno-centric orientation of most mHealth literature, their actual impact as determinants of success/failure seems underestimated. It is insufficient merely to acknowledge the fact that context matters. Syntheses above are illustrative. Project assessments within all three intervention categories show the effectiveness of mHealth projects depends on either (a) the success of rare efforts to address circumstantial complications, or (b) the possibility to avoid (many of) these complications through simple design and limited objective. Most successful are clearly those interventions that aim for communicative convenience (the earlier mentioned Medic Mobile initiative in Kenya is an interesting example that should be thoroughly assessed), simple instruction or notification (e.g. SMS reminders), especially if beneficiaries are experienced phone users. In order for more complicated interventions to work and thus realize development through attitudinal and behaviour change, a detailed understanding of the multifaceted context of implementation is indispensable.
In conclusion, as far as the future of mHealth in Africa is concerned, a constructive realism – rather than unfounded optimism or pessimism without nuance – should guide the design of interventions. Besides being anticipative of the harmful consequences of technology-related complications, such realism should either translate into modest aspirations and the mere facilitation of basic communication and information, or into a smarter kind of mHealth shaped by a thorough understanding of circumstantial complications. The latter inevitably requires an increased investment in research. Yet, unlike what has been concluded elsewhere, that does not just mean intensifying existing (RCT-dominated) research strategies, and looking for transposable recipes for success. Rather, it means expanding our quest for understanding in order to include careful qualitative and participatory (cyclical) explorations of exactly those local opportunities and threats that determine the realization of the undeniable potential of mHealth.
Footnotes
Contributorship
JdK and EK researched literature and conceived the study. EK wrote the first draft of the manuscript. JdK reviewed, added to, and edited the manuscript. Both authors approved the final version of the manuscript.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Ethical approval
Not applicable.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Guarantor
JdK.
Peer Review
This manuscript was reviewed by two individuals who have chosen to remain anonymous.
