Abstract
Objective
The objective of this paper is to conduct a systematic review that summarizes the cost-effectiveness of cleft lip and/or palate (CL/P) care in low- and middle-income countries (LMICs) based on existing literature.
Design
We searched eleven electronic databases for articles from January 1, 2000 to December 29, 2020. This study is registered in PROSPERO (CRD42020148402). Two reviewers independently conducted primary and secondary screening, and data extraction.
Setting
All CL/P cost-effectiveness analyses in LMIC settings.
Patients, Participants
In total, 2883 citations were screened. Eleven articles encompassing 1,001,675 patients from 86 LMICs were included.
Main Outcome Measures
We used cost-effectiveness thresholds of 1% to 51% of a country's gross domestic product per capita (GDP/capita), a conservative threshold recommended for LMICs. Quality appraisal was conducted using the Joanna Briggs Institute (JBI) checklist.
Results
Primary CL/P repair was cost-effective at the threshold of 51% of a country's GDP/capita across all studies. However, only 1 study met at least 70% of the JBI criteria. There is a need for context-specific cost and health outcome data for primary CL/P repair, complications, and existing multidisciplinary management in LMICs.
Conclusions
Existing economic evaluations suggest primary CL/P repair is cost-effective, however context-specific local data will make future cost-effectiveness analyses more relevant to local decision-makers and lead to better-informed resource allocation decisions in LMICs.
Introduction
Cleft lip and/or palate (CL/P) is the most common craniofacial congenital anomaly worldwide. Yet, CL/P is undertreated in low- and middle-income countries (LMICs). Untreated children with CL/P experience malnutrition, poor dentition, ear infections, speech deficiencies, and extreme social stigma which has resulted in abandonment or infanticide.1–4 These experiences are exacerbated by delays in care.
Economic evaluations help clinicians and policymakers make informed decisions in resource-constrained settings. 5 Cost-effectiveness analyses are used to compare the value of interventions, and prioritized interventions in LMICs are those that are cost-effective and feasible. 5 The objective of this paper is to conduct a systematic review that summarizes the cost-effectiveness of CL/P care in LMICs based on existing literature. This will consolidate existing decision-analyses for CL/P in LMICs and assess the methodologic quality of these analyses in how they can be used to help inform LMIC resource allocation decisions.
Methods
This systematic review is conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (Figure 1). The full search strategy with key terms and protocol is registered and available on PROSPERO, number CRD42020148402 (Appendix 1). The search strategy was designed and executed by an Information Specialist (JB) with expertise in systematic reviews with additional clinical input (KC).

Preferred reporting items for systematic reviews and meta-analysis (PRISMA) flow diagram.
We searched 11 electronic databases from January 1, 2000 to December 29, 2020 using keywords and medical subject headings related to the following concepts: cleft lip, cleft palate, cost-effectiveness, and economic evaluations. The search strategy was initially developed in Ovid MEDLINE, and then adapted to the syntax and subject headings of the other databases: Global Health Cost-Effectiveness Analysis Registry, Cost-Effectiveness Analysis (CEA) Registry, Ovid EMBASE, Global Index Medicus, ScHARRHUD database, Cochrane Database of Systematic Reviews database, and the Center for Reviews and Dissemination Databases, which includes the Health Technology Assessment Database (HTA), HTA Database Canadian Repository, the NHS Economic Evaluation Database (NHS EED) and the Database of Abstracts of Reviews of Effects. Additionally, we hand-searched gray literature and bibliographies of identified publications. Finally, we searched PROSPERO for ongoing or recently completed systematic reviews.
Two reviewers (KC, GH) independently assessed the titles, abstracts, and full texts for inclusion using DistillerSR. Full economic evaluations that reported cost-benefit analyses, cost-effectiveness analyses, or cost-utility analyses of primary cleft lip and/or palate repair in LMIC settings as defined by the World Bank were included. 6 Only English language studies were included due to feasibility and resource constraints. We excluded studies that were not full economic evaluations, such as studies that reported only health outcomes, or cost-minimization, cost-consequence and cost-of-illness studies.
Two reviewers (KC and AE or GH) independently extracted data and conducted the quality appraisal using the Joanna Briggs Institute (JBI) critical appraisal tool for economic evaluations. 7 These criteria are a validated international tool to evaluate evidence related to the feasibility, appropriateness, meaningfulness, and effectiveness of health care interventions. 7
Analysis
We reported costs in 2020 International Dollars (USD). Where country-specific costs were provided, these were inflated to the most recent year based on the country's consumer price index.6 For articles that provided summaries across countries and regions, we used the inflation rate for the specific region or the region with the highest volume of cleft surgeries, as appropriate. Cost-effectiveness analyses are composed of cost-utility analyses or cost-benefit analyses. Cost-utility analysis is a method of economic evaluation, where health outcomes are valued using a generic measure of health, such as Disability-Adjusted Life Years (DALYs). 8 The results are reported as an Incremental Cost-Effectiveness Ratio of dollars per DALY averted. In cost-benefit analyses, health outcomes are valued in monetary terms and can be based on the Gross National Index per capita (GNI/capita) for each country.5,9 Surgeries performed in a country with a higher GNI/capita will thus report a higher economic benefit compared to surgeries performed in a country with a lower GNI/capita. The results are reported as a ratio of costs to benefits or as a net benefit or loss, and if they were based on disability weights from the Global Burden of Disease (GBD) study then these values may be adjusted by age-weighting at 4% and discounting at 3%.9,10 We assessed the cost-effectiveness of primary CL/P repair using cost-effectiveness thresholds of 1% to 51% of a country's gross domestic product per capita (GDP/capita), a conservative estimate of health spending recommended for LMICs.11–13
Results
We screened 2883 citations and included 11 economic evaluations. The 11 studies encompassed a total of 1,001,675 patients from 86 countries.10,14–24 Four studies considered patients from a low-income country (Table 1). There were no studies that considered multidisciplinary care. None of the included studies used a model-based economic evaluation. All studies were based on a lifetime horizon. All costs came from an NGO perspective and were reported in international USD. Eight of the 11 studies conducted a cost-utility analysis using DALYs to value health outcomes, with 6 studies conducting cost-benefit analyses.
Study Demographics.
Abbreviations: SSA, Subsaharan Africa; NGO, Non-Governmental Organization.
Data Inputs
All studies used cost data from NGOs: Operation Smile (n = 3), Interplast (n = 2), Smile Train (n = 3), Smile for Children (n = 1), the Children's Surgical Center (n = 1), and Hands Across the World (n = 1). Age at surgery ranged from 142 days old to 74 years old. DALYs were derived from isolated cleft lip or isolated cleft palate disability weights produced by the GBD studies in 1990 or 2004 for ten of the 11 studies. The remaining study measured and applied disability weights based on the expertise of 5 surgeons. 24 Although studies may have included patients with combined cleft lip and cleft palate, ten of the studies did not consider a disability weight for untreated cleft lip and palate, and 1 study used isolated cleft palate as a proxy for these patients. 17
The health impact of CL/P complications, i.e. fistula or lip/nose revision, was included in 2 studies. One study cited a disability weight of 0.05 for both the palatine fistula and the lip revision. 22 The other study used isolated cleft lip as a proxy for complications and included this in the DALYs averted for CL/P. 17
Costs
All studies reported costs in international dollars (USD). Costs regarding whether NGOs used a center- or mission-based approach are outlined in Table 2. Eight articles provided an outline of cost components. Major cost components discussed in the articles were: staff salary and recruitment (88%), medical supplies (75%), staff accommodation (50%), staff transportation (50%), NGO overhead (50%), patient transportation (50%), patient hospital costs (50%), and patient food (50%). No articles reported patient or caregiver wages lost or time loss because all costs were reported from the NGO perspective. Finally, no article considered the costs associated with untreated cleft lip and/or palate.
Summary of Costs per Procedure, DALYs Averted, Cost per DALY Averted, and Cost-Effectiveness Thresholds.
*Both refers to both patients with isolated cleft lip and patients with isolated cleft palate. Abbreviations: GDP, gross domestic product; DALY, disability-adjusted life year, NGO, Non-Governmental Organization.
Outcomes
Ten of the 11 articles valued health outcomes in terms of DALYs. DALYs averted per cleft lip or palate repair ranged from 1.2 to 10.7, dependent on the country (Table 2). The cost for primary CL/P repair ranged from $33.7 to 401.8, depending on the country and NGO (Table 2). The cost per DALY associated with surgery demonstrated that primary CL/P repair was cost-effective at the threshold of 51% of GDP per capita for all studies (Table 2). Only 1 study compared CL/P repair in relation to other interventions in Vietnam and found it to be cost-effective in comparison to human immunodeficiency virus/acquired immunodeficiency syndrome or tuberculosis treatment. 20
Six cost-benefit analyses were reported, all of which used the human capital approach (Table 3). Using the human capital approach, the estimated economic benefit in USD for individual primary cleft lip repair ranged from $3191 (Indonesia) to $32,203 (Ecuador). The estimated economic benefit from individual cleft palate repair ranged from $4110 (Indonesia) to $87,393 (Ecuador).
Summary of Estimated Individual and Population Economic Benefit Using the Value of a Statistical Life Approach and Human Capital Approach.
*Age-weighting, as used in the Global Burden of Disease Study, is included.
Estimates of income elasticity of the value of a statistical life range can from 0.55 to 1.5 with evidence suggesting that larger income elasticity estimates are more appropriate when income is lower. 25
Quality Appraisal
All articles met at least 1 of the 11 JBI criteria (Figure 2). However, only 1 study met at least 70% of JBI criteria. Nine of the 11 articles did not describe subsequent complications from primary CL/P repair or consider costs for patients without primary repair. Further, 10 of the 11 articles did not consider disability weights for patients with untreated combined cleft lip and cleft palate which can be considered more severe than isolated cleft types. Furthermore, of the studies that accounted for the costs, none of the studies considered wages lost from the patient and caregiver perspective during care received. None of the studies used health outcomes from patient or societal populations in LMICs. Finally, multidisciplinary care was not considered. The data inputs for the economic evaluations make the results less relevant to local-decision makers and not generalizable to the affected patients in LMICs.

Joanna Briggs Institute (JBI) critical appraisal checklist for economic evaluations.
Discussion
This systematic review synthesizes the evidence on the economic value of CL/P repair in LMICs to date. All studies reported the costs of CL/P repair from the health care payer perspective, where the health care payer was the NGO. Local governments can assume the role of the health care payer and consider whether CL/P repair is cost-effective for their country. A cost-effectiveness threshold of up to 51% of the GDP/capita is recommended for LMICs.11–13 Based on this threshold, the cost per DALY for primary CL/P repair was cost-effective across all studies. However, several concerns were identified that could limit this implication.
First, it is suspected that GBD disability weights underestimate the disease severity and impact of treatment. Disability weights are considered ‘universal’; however, they came from international societal participants, a sample heavily skewed to those from high-income countries (HICs).26–28 Further, GBD descriptions do not include difficulties swallowing, malnutrition, and the extreme social stigma experienced by patients with CL/P in LMICs. 26 Finally, disability weights for surgically treated CL/P were last estimated in 1990, by a small panel of elite international health experts and there is no consideration of multidisciplinary management. 26 Second, all studies reported costs from the NGO perspective and thus the costs from the government perspective are unknown. Further, none of the studies considered opportunity costs for patients and their caregivers in receiving treatment. These context-specific costs can better inform cost-effectiveness analyses in these settings. Third, 10 of the 11 papers did not consider disability weights for untreated patients with combined cleft lip and palate. Cleft lip and palate is considered more severe than isolated cleft lip or cleft palate, and studies that omit this may further underestimate the burden of disease and cost-effectiveness of CL/P repair. Fourth, there was limited consideration of complications which may result from surgery, and finally, none of the articles considered multidisciplinary management.
Due to these concerns, existing CL/P cost-effectiveness analyses for LMICs may have underestimated the severity of CL/P and the impact of treatment. The main strength of this study is that it synthesizes existing evidence to highlight what is needed to better represent the cost-effectiveness of CL/P care and inform subsequent resource allocation decisions in LMICs. The main limitation of this systematic review is that we excluded 71 articles that were not published in English. However, none of these studies appeared to be relevant for CL/P economic evaluations when these articles were screened using an online translation tool.
Thanks to efforts from the Lancet Commission of Global Surgery, the 68th World Health Assembly passed the resolution on including surgery as a component of Universal Health Coverage. 29 Thus, for policy decision-makers to make informed decisions in allocating public funds, cost-effective analyses are critical. The lack of context-specific health and cost data reported from LMICs is a limitation seen with existing economic evaluations for other surgical diseases. 25 Utilities are an alternative to disability weights and are recommended for cost-effectiveness analyses for HICs.8,30 Utilities are intended to be context-specific, reported from the patient or societal perspective, and can account for health equity.30, 31 However, utilities in LMICs are scarce compared to those in HICs. This is especially the case for surgical diseases relative to pharmaceutical interventions and the lack of context-appropriate utilities for these populations can further disadvantage them in LMIC resource allocation decisions. Thus, opportunities exist for further investigations that consider utilities, costs, complications, and multidisciplinary management for CL/P from LMIC participants to provide the context-relevant data that is currently missing. Collaborations to provide this evidence can help inform decisions that can lead to a sustainable, multidisciplinary, and longitudinal standard of surgical care that is acceptable in HICs.
Conclusions
Existing economic evaluations suggest primary CL/P repair is cost-effective, however, there is a need for context-specific cost and utility data for primary CL/P repair, complications, and existing multidisciplinary management in LMICs. Context-specific local data will make future CEAs more relevant to local decision-makers and lead to better-informed resource allocation decisions in LMICs.
Supplemental Material
sj-docx-1-cpc-10.1177_10556656221111028 - Supplemental material for A Systematic Review of the Cost-Effectiveness of Cleft Care in Low- and Middle-Income Countries: What is Needed?
Supplemental material, sj-docx-1-cpc-10.1177_10556656221111028 for A Systematic Review of the Cost-Effectiveness of Cleft Care in Low- and Middle-Income Countries: What is Needed? by Karen Y. Chung, George Ho, Aysegul Erman, Joanna M. Bielecki, Christopher R. Forrest and Beate Sander in The Cleft Palate Craniofacial Journal
Footnotes
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Canada Research Chair in Economics of Infectious Diseases, Physician Services Incorporated, Canadian Institutes of Health Research (grant number CRC-950-232429, Resident Research Fellowship, Canada Graduate Scholarships—Master’s, Vanier).
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
