Sustainable assessment in digital health interventions for primary care: A scoping review

Abstract

Background:

Primary care is essential for improving healthcare access and global health, yet it faces challenges related to limited capacity and slow response times. Digital health interventions (DHI) (DHIs) are increasingly used to address these gaps by promoting healthy behaviours, patient empowerment, and health literacy. However, their implementation is challenged by insufficient regulations and infrastructure, and evaluations often overlook broader sustainability concerns. This scoping review examines how DHIs in primary care are assessed for sustainability across financial, social, and environmental domains.

Methods:

The scoping review methodology consisted of three stages: pearl-growing, keywords with operators, and reference list search. MEDLINE (PubMed and Ovid), CINAHL, IEEE Access, ScienceDirect, NICE, and TRIP databases were utilised, and the results were evaluated using qualitative content analysis.

Results:

The review highlights four aspects to consider when implementing digital health interventions: Enhancing health promotion and illness prevention through the user’s adherence to treatment, while addressing clinical risks. Examine social implications considering wellbeing, access, inclusion, participation, empowerment, and data protection. Consider financial impacts such as resource management, available funding, and appropriate infrastructure. And environmental implications that include product life cycle, resource use, and greenhouse emissions.

Conclusions:

It is recommended that guidelines for implementing DHIs in primary care prioritise improving health promotion and preventive care. Emphasising the value of building public trust by promoting well-being, ensuring human rights in data governance, addressing social determinants of health, and improving resource efficiency through interoperability and circular economy principles.

Keywords

primary care sustainability primary care sustainability digital health mhealth telemedicine health technology assessment policy-making healthcare decision-making

Introduction

The future of global health care emphasises the urgent need for sustainable healthcare systems that can adapt to the persistent problems faced by global society and maintain optimal health levels worldwide.¹ The development of primary care has positively impacted the global health care system; its service delivery model has been linked to decreased mortality rates.² Primary care was proposed as an initiative to enhance access to healthcare by establishing regional health hubs.³ At the declaration of Alma-Ata (1978), primary care was recognised as a key aspect to achieve global health, enabling populations to have socially and productive lives; it was viewed as an opportunity to provide health care as close to individuals as possible, serving as the initial element for the continuity of the health care process.⁴ Primary care also has demonstrated efficacy in enhancing population health in many locations throughout time.³ But its most noted benefit has been the reduction of hospital admissions and emergency visits.^5,6 The World Health Organisation has acknowledged that integrating a public health approach into modern primary care effectively prevents disease in local communities by enhancing prevention and promotion.² Currently, primary care represents a comprehensive societal approach to health, emphasising achieving the state of optimal health and well-being by prioritising individual needs in promotion, prevention, rehabilitation, and palliative care, while also addressing health determinants and empowering individuals.⁷

Conversely, the current state of primary care faces challenges related to accessibility and response times, which indicate a constrained capacity in comparison to high demands.^1–3,8 Efforts to address these challenges include the integration of innovative digital technologies that have impacted care delivery and transformed some healthcare treatments into digital health interventions.^1,8–10 Digital health interventions (DHIs) are typically defined by the utilisation of information and communication technology, wireless technologies, and advanced technologies, including artificial intelligence, to achieve health and wellness.^11,12 DHIs can be used by healthcare professionals, the public, health management workers, support staff, and data services to deliver effective health services¹²; indeed, the World Health Organisation views digital technologies as essential tools to enhance the quality of health systems, facilitating the promotion of healthy lives, and well-being for all individuals globally.¹³ Some countries have proposed increasing DHIs, as they have been shown to increase access to health care and its quality^1,10,13,14 by improving patient communication tools, including online assessments and digital telephony, while simplifying bureaucratic processes.¹³

Research has shown that DHIs have the potential to have positive impacts on the population’s health and well-being by promoting healthy behaviours, empowering patients, and enhancing health literacy and accessibility,^12,14,15 They also create opportunities to control symptoms and prevent the disease’s progression by minimising geographic barriers.¹⁶ DHIs have been used to ease communication between patients and professionals, enhance patients’ health information, and support decision-making by apps and teleconsultations.¹⁷ DHIs offer mental health care interventions, behavioural and medication management, post-test result reporting, post-discharge follow-ups, and standard consultations for acute concerns with either new or existing patients.^18–20

Challenges in implementing DHIs arise from inadequate regulations and infrastructure.^9,17 Various digital health evaluation frameworks aim to provide the necessary knowledge to support the development, implementation, and evaluation of DHIs.²¹ The most widely used and reliable evaluation criteria for integrating healthcare applications are accessibility, user experience, privacy, the truthfulness of information, clarity of purpose, technological functionality, interoperability, and developer credibility.²² Some argue that DHIs’ assessments have been oversimplified, focussing only on efficiency and effectiveness. Hence, it is essential to thoroughly assess digital technologies, considering social, economic, and political factors.²³ Along with this, Alajlan and Baslyman²⁴ suggest that the sustainability of DHIs entails effectively achieving health care demands by using digital technology cost-effectively; they argue that technical, organisational, physical, financial, and user engagement are essential for a realistic, sustainable evaluation. Lokmic-Tomkins et al.²⁵ also stressed the importance of evaluating DHIs for environmental sustainability to ensure responsible design and enhance their impact. Therefore, the notion of sustainability is important to map out in the literature as it seems to improve the integration DHIs.

Elkington²⁶ defined sustainability as thinking beyond financial forms of capital, including natural, human, and social capital. In this way, human activities in any sector of society can meet the needs of present and future generations.²⁷ In other words, applying sustainability to a particular process means paying attention to the well-being of all the population involved, the society, the economy, and environmental conservation.²⁸ Along with this, Mortimer et al. suggested the sustainability notion as a domain of quality in health care or sustainable quality improvement (SusQI), considering health care value broader than health outcomes relative cost and including ecological and social impacts as important resources to achieve health outcomes over time.²⁹ Therefore, in this review, sustainability is defined as a concept that encompasses economic, social, and environmental impacts within the evaluation process of DHIs.

This scoping review aims to map the extent to which evaluation approaches are used to assess the sustainability notion on DHIs that are integrated into primary care, exploring the financial, social, and environmental domains. The review is organised according to:

Definitions of sustainability domains (financial, social, and environmental) in DHIs.

Measurements or evaluation items of sustainability domains (financial, social, and environmental) for integration of DHIs into primary care.

Methods

This scoping review was developed between May 2023 and February 2024. The methodological framework for a scoping review suggested by Arksey and O’Malley³⁰ was used, including the following steps:

Identification of research question

The PCC (Population, Concept, Context) framework was used to structure the review and ensure clear congruency regarding the inclusion and exclusion criteria³¹: Population – DHIs innovators and stakeholders; Concept – sustainability (social, financial and environmental); and Context – DHIs implementation in primary care. The reviewers utilised the Sustainability in Quality Improvement (SusQI) measurement criteria as model to understand the concept of sustainability in health care.³² The term sustainability was intentionally excluded from the data charting process, as its meaning varies significantly across contexts and disciplines. To ensure conceptual clarity and alignment with the Sustainable Quality Improvement (SusQI) framework, this review sought to capture sustainability through its constituent dimensions. Accordingly, the search strategy employed separate terms – social, financial, and environmental – to reflect the multifaceted nature of sustainability as defined within the SusQI perspective.

Identification of relevant studies

The pearl-growing strategy is an iterative approach to identifying relevant literature on a research topic, utilising referenced literature and indexed keywords from relevant articles to find additional literature on the same topic.³³ Pearl-growing was used to identify search terms in relevant databases, including MEDLINE (PubMed and Ovid), Cumulative Index to Nursing and Allied Health Literature (CINAHL), IEEE Access, and ScienceDirect. Sources of unpublished studies and grey literature were searched in the Trip and NICE databases. Separate searches were conducted for the terms “environmental,” “financial,” and “social” to capture the keywords adjusted to the meaning of each term in the context of digital health technologies. The enlisted terms were used in searches by two authors (X1 and X3). In this stage, search operators such as (AND/OR) were used to expand and narrow the search. Finally, the reference list of all included sources of evidence was screened for additional studies (see Appendices I, II, and III).

Studies were included if the tool’s validation was published in the English language. To maintain feasibility and reflect only in the most current literature, only studies published from 2018 onwards were selected. On the other hand, this review extends the scope to include evaluation tool developments pre and post pandemic, as pandemic boost the adoption of technology, it was interested to know paradigm changes during this time. Along with this, 2018 seems to be relevant as the WHO resolution on global strategies for improving digital health integration was released.^34,35 Following the search, all identified citations were assembled and uploaded into EndNote 20, and duplicates were removed. Subsequently, a pilot test, titles, and abstracts were screened by one reviewer for assessment against the inclusion criteria. Meetings were held with all authors to verify their understanding of the inclusion criteria at this stage. It was agreed that due to data scarcity, it was not possible to find a tool that evaluates all three terms of sustainability (social, environmental, and financial). Therefore, the authors agreed to include articles that integrated any two terms of sustainability in their evaluation tool.

Study selection

Relevant sources were saved in full. The full text of the selected citation was assessed in detail against the inclusion and exclusion checklist shown in Appendix V. During the screening process, the PCC framework was applied as follows:

Population

Papers were included if they considered DHI innovators or stakeholders relevant to primary care.

Concept

● Papers were included if they addressed at least two of the following aspects of sustainability taken from Mortimer et al. measurement criteria of sustainability in health care³²:

○ Social indicators, factors concerning the impact of the integration of DHIs on the social circumstances of end users (access, wellbeing, quality of life, empowerment, safety, or trust).

○ Economic indicators, factors related to cost-effectiveness, financial impact, or procurement analysis.

○ Environmental indicators, factors related to the impact on natural resources planetary health, greenhouse gas emissions, or life cycle assessment.

Context

● Papers were included if they referred to evaluation frameworks or guidelines to implement DHIs in primary care.

Papers were excluded based on several criteria: (1) lack of access to the authors, (2) labelling as study protocols, (3) evaluation or guidance limited to a single aspect of sustainability, (4) focus on clinical trials for developing DHIs, (5) absence of implementation guidance for DHIs, (6) recommendations restricted to technical frameworks, and (7) implementation guidance applicable only to settings other than primary care (see Appendix V and VI).

Charting the data

The two authors conducting the literature search (X1 and X3) reviewed and screened the full text of the terms “environmental,” “financial,” and “social” in the ScienceDirect database, concluding with consensus and similar results in the screening criteria for all databases. The study inclusion process is presented in the PRISMA-ScR Flow diagram for the scoping review process in Figure 1.^36,37 Additionally, the PRISMA-ScR flow diagram for scoping review process shows the decision process, study selection and results (see Figure 1)³⁸

Figure 1.

PRISMA Flow diagram for scoping review process.

A pilot test was carried out prior to the full extraction to ensure that the extraction tool was appropriate for the scoping review’s goal. The extracted data contained specific information about the population, concept, context, study methods, and key findings pertinent to the review question. The draft data extraction tool underwent minor changes during the extraction process due to a scarcity of tools that comprehensively evaluated sustainable quality improvement (environmental, social, and financial); consequently, data was collected from each distinct concept within the extraction tool.

Collating, summarising, and reporting the results

Using a qualitative content analysis approach, the scoping review mapped the guidelines or frameworks used to implement DHIs from a sustainable view (social-environmental-financial). Therefore, the results were analysed using the three phases of qualitative content analysis (preparation, organising, and reporting) and classified into the three pre-defined terms of sustainability measurement criteria in health care (social-environmental-financial).³⁹ The PRISMA extension for scoping reviews (PRISMA-ScR) was used to plan and evaluate (see Appendix IV).

Results

The electronic searches of the databases yielded 13,962 records. After removing duplicates and ineligible records, 5242 titles and abstracts were screened, resulting in 89 full-text reports being assessed for eligibility. The studies and the reason for exclusion can be found in Appendix V. Nine studies were chosen for data extraction; six were found from database searching,^40–45 and three were found through other sources.^46–48 The study selection process is outlined in Figure 1. All studies were published from 2020 onwards. Two publications were based in the United Kingdom^43,44 and one in the United States.⁴¹ Two guidance articles incorporated inputs and comparisons from multiple countries, including the United States, the United Kingdom, Germany,⁴² and most African countries.⁴⁰ Three frameworks were developed in Geneva and intended for use worldwide.^45,46,48 The participants involved in the frameworks were experts in the integration of digital health^40,42,44,47; clinicians^41,42,44; patients or end users^42,45,46; and decision-makers.^42,44,47 Only two of the guidance are based on literature reviews.^43,48 All papers provide guidance and measurements on integrating DHIs into preventive, general healthcare services and public health. Six articles were based on frameworks that evaluate the implementation of DHIs,^40–44,47 and three studies guided the design of DHIs.^45,46,48 Four publications were governmental guidance,^44–46,48 and five studies were scientific articles which gathered primary and secondary data in their methodology.^40–43,47 Four frameworks were validated,^40,42,44,47 and one was highly used by digital health developers⁴⁴ (To see the studies’ measurements domains, Table 1).

Table 1.

Measurement items and domains used in the guidelines.

Concept	Measurement items	Domains
Social	Digital health empower population to seek⁴⁶	Inclusion
	Stakeholder engagement⁴⁰
	Participation and empowerment⁴⁶
	Accessible for children youth and other groups⁴⁶
	Ability to patients’ users to input data⁴²
	Describe strategies for communication consent and training process to allow DHT to be understood⁴⁴
	Users support⁴²
	consider health and care inequalities and bias mitigation⁴⁴
	promoting equality, eliminating unlawful discrimination and fostering good relations between people with protected characteristics⁴⁴
	NHS Digital’s guide on digital inclusion for health and social care provides information for companies and providers to understand digital inclusion and steps that can be taken to evaluate and support digital inclusion⁴⁴
	Equitable digitally enable^44,46
	Individual experience⁴¹
	Equity⁴¹
	relevance of the solution to the targeted user group⁴²
	Ease of adoption and use with minimal training⁴²
	Multi stakeholder design, development, and implementation⁴²
	Ensure the assessed context has internet access up taken by different communities⁴³
	Non-retrogression equality and non-discrimination. To ensure compliance with legal context Laws, norms, and standards Rationale for inclusion in the assessment⁴³
	User friendly⁴²
	Government and civil society should monitor whether equity and rights are embedded with in each of the digital health building blocks⁴⁶
	Public involvement in the design or incorporation of the intended user group acceptability in the design⁴⁴
	To ensure that standard operating procedures have been established for patient consent, data protection and storage, and verifying provider licencing and credentials⁴³	Data protection and rights
	Credibility with UK health care professionals⁴⁴
	Safety and data protection^42,43,45
	Health system strengthening laws, norms, and standards privacy⁴³
	To ensure that patients are aware of who owns their data and whether the data may be used by a third party, as well as to ensure their consent to such ownership and use⁴³
	Rights to information and privacy⁴³
	Privacy and informed consent future availability and access⁴³
	Information governance standards, process of data protection violation⁴²
	Privacy and confidentiality limitations⁴⁵
	Store secure⁴³
	Consent data protection⁴⁵
	Embed good data practices^42–44
	Are there privacy and confidentiality limitations in their current patterns of technology use (e.g. accessing the internet at internet cafes, sharing phones)?⁴⁵
	Data ownership⁴³
	Measuring timely access⁴¹	Access
	Affordability to the patient⁴²
	Contribution to challenge health inequalities^42,44,46
	Helps to reduce socioeconomic health inequities⁴²
	Connexion to peer support where appropriate⁴²
	Loss of work or school because of appointment⁴¹	Wellbeing
	Patient centredness⁴¹
	Individual experience⁴¹
	Monitor strategies related to promote equity and human rights empowering and building trust in digital transformation⁴⁶
	User satisfaction^42,44,48
	User feedback into the digital health in case of issues or harm⁴⁶
	User issues⁴⁰
	Evidence of stakeholder engagement appraisal process^40,44	Clinical Safety
	Clinical and social health professionals see the tool as relevant and useful⁴⁴	Clinical Safety
Financial	sustainable funding⁴³	Available funding
	Available funding⁴³
	Investing in equitable, digitally enabled health care governments, donors, and private investors should target and prioritise their investments in digitally enabled health systems and health care so that they contribute towards the realisation of UHC⁴⁶
	System affordability or support^40,42,46,47
	Technological systems functionality^{42,44,45,47,48}	Appropriate Infrastructure
	support big data^42,46,48
	interoperability⁴²
	internet coverage and connectivity^40,42,46,48
	sustainable data architecture⁴²
	management systems^40,43
	Ensure the technology is deploy in systems that can support it⁴³
	technological system stability^{41–43,45,46,48}	Resource management
	resources optimisation⁴²
	change management address⁴⁰
	Technical support^{41–43,46,48}
	current cost and later updates^42,43
	Human resources or human skills, processes, tools or technology resources^{41,43,45–47}
	Cost effectiveness related to outcomes (number of users using the services, user fees affect accessibility^{42,44,46–48}	Economic analysis
	Sustainable business case⁴⁰
	Cost consequences⁴⁰
	Cost uncertainty⁴⁰
	Long-term cost effectiveness to the system User preferences, effectiveness of care, costs, safety⁴¹
	Patient cost from miles saved from not travelling to the provider office⁴¹
	Health delivery (quality and cost)⁴¹
	Estimates of resource use should include: length of hospital or care home stay, number of hospitalisations, outpatient or primary care consultations, changes in infrastructure, use, and maintenance⁴⁴
	To consider who pays for training, ongoing support, and the cost of data: Is this sustainable?⁴³
Environmental	Doing no harm to the planet⁴⁶	To consider ecological impacts
	Industry and governments should harness digital technology and data to protect the health of our planet. Proactive measures should also be taken at local, national, and global levels to mitigate any negative environmental impacts of digital transformation through, for example, use of renewable energy sources for data storage, responsible management of e-waste, and sustainable production of digital devices⁴⁶
	Consider environmental sustainability⁴⁴
Outcomes (quality)	Challenge in access^41,43–45	Local an individual health outcome
	Contribution to inequalities mitigation^41,42,44
	Clinical benefits^42,44
	Health priorities⁴⁵
	Health strategies are aligned with ehealth^40,43
	Digital tracking of patient health status⁴³
	Contribution to Bias mitigation⁴⁴
	Health outcomes (measuring the individual or population level related to physiology, mental health, and quality of life; these measures may come from diagnostic tests and encounter records or from patient-reported outcomes), Mortality BMI and percentile⁴¹
	Safety of telehealth visits⁴¹
	All health workers, including community health workers, should have the tools, skills, and support needed to use digital technologies to assist their work in a manner complementary to the aims of quality care⁴⁶
	Have health care workers been consulted on whether the project aligns with the national health workforce strategy⁴³
	Could the project affect the number of health workers available to meet primary health care obligations or core obligations⁴³
	To ensure that the new technology-driven project will not draw health workers away from other essential services⁴³
	To ensure that state plans and strategies, health care management, and health care workers been consulted about the technology⁴³
System	Addressing the identify system challenge⁴⁸	Systemic health outcomes

Defining sustainability on digital health interventions

Clinical outcomes of digital health interventions (DHIs)

All the studies in this review illustrate the health outcome metrics and guidelines that the DHIs must achieve for successful implementation.^40–48 Regarding primary care, which is the scope of this review, the health outcomes were related to individual health improvement and illness prevention^41–44,47 as well as factors connected to the attainment of local and national health objectives.^40–48 Addressing the challenges within the health system was another necessary implication for successful implementation.^40,43,45,48 Two studies indicated that innovators require caution to ensure alignment without replacing essential components of health systems, such as health care workers.^43,46 This aligns with the findings of study,⁴² which suggested that the integration of DHIs should provide a relevant solution to the target group while decreasing bias on the health intervention. Examples of health outcomes illustrated in the studies include lowering inequalities within the current health system^41,42,44; enhancing quality of life for the end users^44,46; increasing the end users’ adherence to healthcare treatment; encouraging engagement and behaviours that promote health^42,44–46; and decreasing mortality and morbidity in the general population.^42,44 Along with this, real-time epidemiological surveillance or real-world evidence was considered the most effective method to reduce mortality and morbidity in the integration of DHIs.⁴² Another important aspect of clinical and health outcomes is clinical safety; most studies acknowledge that the health outcomes of the DHIs should be aligned with health risk control.^41–45,48 Six pieces of guidance on this review provide recommendations to prevent clinical risks from the DHIs to the end users.^41–45,48 For instance, study⁴¹ indicates that aligning digital technology with health care system plans is a strategy to mitigate clinical risk. The study⁴² laid out the implementation of a clinical risk management plan to identify activities that could represent risks to end users. Study⁴⁴ suggested that the DHIs integration requires accreditation from the healthcare workforce; thus, healthcare professionals should participate in the design, development, and testing processes. Lastly, there are three guidelines that suggest using an evidence-based approach to design and make clinical or health-related decisions on DHIs.^44,45,48

Sustainability in DHIs (social, financial, environmental impacts)

Most studies only include social and financial implications to guide DHIs implementation.^{40–43,45,47,48} Only two studies consider environmental domain as an important for integrating DHIs.^44,46 Indeed, the ESF⁴⁴ guidance included environmental sustainability in its recent update. Generally, the items or measurements within the social and economic domains were diverse.^{40–43,45,47,48} And the studies that include environmental domain did not include measurements.^44,46

Social sustainability

The definition of social sustainability is complex, given the wide variety of social issues this embraces. Studies considered that the social impacts of DHIs encompass various aspects beyond health, including the impact on end users’ broader contexts, such as family and work life.^40,41 They also include considerations of ethical and safe practices in handling data^40–43 and increasing end users’ satisfaction.⁴¹ This review categorises the prevalent social issues associated with the DHIs based on an analysis of existing studies. The majority of studies in this review indicate that digital health technologies enhance access to and usability of health services,^40–47 arguing that they foster inclusion,^40,41,46,47 and community engagement^{42–44,46,47}; they enhance overall well-being^40,46; and they have the potential to strengthen data security and privacy in the health care system^{40,42,43,45,46,48} (see Figure 2).

Figure 2.

Social domains in digital health implementation.

Access

According to four studies, the most common benefit noted in DHIs is the reduction of health disparities, arguing that they have improved universal health coverage within the current health care model.^40,42,43,46 Access to DHIs in primary care may require universal health coverage.^43,45,46 To achieve this, the development and integration of DHIs must be well-coordinated and interoperable with the healthcare system, where every element and context works harmoniously.⁴⁶

Three studies suggested that access to DHIs should be equally available to all individuals.^43,45,46 Indeed, four studies emphasised that access to health care is a human right that should be evaluated before implementing digital health technologies; two studies consider this important to avoid discrimination^43,45; one study considered it an ethical issue⁴⁰; and three studies considered that evaluation access decreases unequal delivery to vulnerable populations.^43,45,46

Inclusion

Five out of 10 articles showed the relevance of making technologies more inclusive.^40,43,45,46 A study⁴⁶ suggests that addressing issues of inclusion, equity, and human rights, along with prioritising populations with less power in the evaluation process, is essential for the successful implementation of DHIs. Along with this, study⁴⁰ argues that inclusive technology is more than allowing the population to be connected; it is about enabling an inclusive infrastructure with adequate supplies and resources, such as electricity, software, hardware, and interoperability, to support the sharing of appropriate data.⁴⁰ Along with this, inclusive technologies are also considered as the availability of resources in the workforce and access to health facilities for all, considering equality and non-discrimination as well as the use of appropriate terminology when describing users, depending on the specific context, considering legal, cultural, and health-related connotations.⁴⁵ Therefore, it is suggested that a strong analysis of equity and rights during the design of digital health technologies will help decrease discrimination and inequalities when implemented.⁴⁸

Some of the actions suggested in the studies to increase inclusion and access were related to paradigm views on the system as seen in the implementation through systemic lenses.^43,45,47,48 For instance, three studies consider that socio-cultural factors are essential in recognising the differences throughout communities when implementing DHIs.^45,47,48 Two studies consider that cultural and legal resources are important to integrate DHIs to avoid compromising the population’s human or civil rights.^43,48 Other practical recommendations for ensuring accessibility when implementing DHIs included basic infrastructure such as internet or electricity,⁴⁸ as well as meaningful community participation in all stages of digital technology development,^{43,44,46–48} including engagement with all stakeholders.⁴⁸ In addition, a human-centred design was suggested as an essential approach to inclusion.⁴⁵

Participation and empowerment

Most studies recommended that when implementing digital health technologies, it is vital to place the user as the centre of the design process, focussing not only on concern but also on the user’s engagement.^{40,41,43–47} The engagement process ensures that any expectations regarding digital health technology are considered⁴⁷ and that users actively participate in the co-creation process in which power is shared respectively and acknowledged.⁴⁵ Engaging the population means that the relevant stakeholders, such as community leaders, international partners, non-governmental organisations, and faith-based groups, are included.⁴⁷ It is essential to recognise end users’ participation, as it is necessary for success during implementation.⁴³ Empowering individuals entails improving digital literacy,⁴⁶ including skills and knowledge.^45–47 By fostering digital literacy, individuals are better equipped to make conscious decisions regarding digital technologies.^43,47 Participation is also an important feature of empowerment,⁴⁵ positioning users at the centre of the design process.^{40,41,43–47} This approach ensures that power dynamics are shared between beneficiaries and developers throughout the development of DHIs, allowing for the valuable contributions of users to be recognised and integrated into the final product.^43,45

Safety and data protection

Most publications discussed DHIs’ safety in terms of users’ data management and rights.^40,42–46 Technical safety, cybersecurity, and privacy were the most common topics related to metrics for good practices in keeping digital data and processes safe.^42–45 The studies recommended two ways to maintain the data protected by providing a strong technical and physical infrastructure^40–43 and adherence to strong data protection, privacy, and confidentiality standards.^40–46,48 Regarding technical and physical structures, studies recommended aspects related to implementing adequate information and communication technology infrastructures.^40,42,43 Information and communication technology infrastructures in data protection are related to deploying digital technologies in settings where data privacy and sensitive content sharing are considered with caution.⁴³ In other words, assure end user’s privacy and data protection through technical help.^40–43,45 For instance, study⁴² suggested cloud storage is safer and easier to back up. Along with this, two studies mentioned implementing end users’ technical control on data shared and data owned.^40,42 Alternatively, implement technical features that prevent unauthorised access to health information.^42,44,48 Most studies strongly recommended strong adherence to policies and regulations related to privacy and data protection.^{40,42,43,45,46,48} To ensure that, studies mentioned basing the DHIs’ implementation on a human rights approach.^{40,42,43,45,48} This approach includes respecting the end user’s right of privacy and information access⁴⁸ and involves end user rights of data ownership.^42,43,46 Therefore, it is recommended to have ethical, moral, and legal obligations related to data protection while adopting and enforcing policies to safeguard data.⁴⁵ Study⁴² recommended a high degree of integrity in data handling,⁴² while others highlight the relevance of strictly sticking with data handling protocols.^43,44 Study⁴² recommended ensuring regulations on end users’ data commercialisation when implementing DHIs. Building on this, three studies highlighted that end users need to have the capacity to make decisions regarding DHIs; therefore, data handling is required to be transparent, and rights on the use of DHIs and the information given need to be informed and explained. Then end users have the capacity or understanding of complex regulations to make decisions freely in regard to sharing data.^42,45,46

Wellbeing and quality of life

Most studies suggested that when implementing DHIs, it is relevant to consider their role in improving standards of living in the population.^40,41,47 It is recommended that the implementation of DHIs consider individual impacts that DHIs have on end users while using the health care system^{41,42,44,45,47,48} and the way that DHIs impact social determinants or end users’ lifestyles.^40–42,46 The study⁴⁶ emphasised that one essential item to assess when integrating DHIs is the presence of policies that embed digital wellbeing and ensure the protection and promotion of human rights on and offline.

Regarding the individual impacts, most studies focus on end users’ satisfaction, preferences, engagement with the healthcare system^{41,44,45,47,48} and improving motivation towards users’ own health.⁴² Study⁴⁷ recommends checking users’ perception in terms of ease, practicability, and quality of DHIs, which are also being compared with face-to-face models.⁴⁷ On the other hand, studies,^40–42 provide recommendations based on contextual factors such as the work or lifestyle of end users. Established systemic measurements that evaluate population wellbeing based on social determinants enable conscious decisions when implementing DHIs.⁴⁰ On the other hand, study⁴¹ measures social determinants to assess satisfaction with the health system and adherence to it by considering work or study disruptions that occur when attending a healthcare appointment. On the other hand, study⁴² includes items related to how DHIs support lifestyle changes leading to improved quality of life. A key aspect considered in the guidelines for evaluating the integration of DHIs is feedback on end-user satisfaction, which suggests updating DHIs in response to social issues, particularly for marginalised populations,⁴⁶ and determining the needs of these populations.⁴⁵ And apply contextual questions to the evaluation when implementing DHIs.⁴⁴

Financial sustainability

Financial sustainability is generally characterised by whether the investment in a particular DHI is an economically appropriate use of resources compared to other options.^40,41,44,47 Investment analysis considers various procurement resources, such as budget availability, human resources, e-health resources, and information and communication technology infrastructure.^45,47 Assessing economic value also requires considering end-user affordability relative to existing care models^40,41 and evaluating the health risk-benefit ratio.^40,44 A step forward is to recognise that the evidence for DHIs also depends on the anticipated financial risk to the system.⁴⁴ Most studies have shown that to increase the financial sustainability of DHIs, it is important to look at resource management^{41–43,45,47,48}; the reimbursement process^42,46,47; appropriate infrastructure^42,46–48; available funding^{40,43,45,47,48}; and interoperability^42,45,47,48 (see Figure 3).

Figure 3.

Financial domains in digital health implementation.

Resources management

A crucial aspect that the system must adapt to over time is the efficient management of resources or tools to measure the performance of new health investments.⁴¹ Different institutions have different resources, such as staff training^41,43,47,48 or ongoing support.⁴³ Another important aspect of resource management to be aware of is the system’s and end user’s affordability, as well as the expenses incurred by the health care system on behalf of the end user.⁴² To measure this domain, usually, an economic analysis is performed^{42,44,46–48} (see Table 1).

Appropriate infrastructure

Countries must invest in foundational infrastructures that enable populations to use DHIs.^46,48 For instance, improving technology infrastructures,^42,46–48 such as internet usage, mobile network coverage, and mobile broadband connections,⁴⁶ cybersecurity infrastructure,⁴² or pursuing interoperability.^42,45,47,48 Interoperability is defined as the ability of systems and devices to exchange and interpret data efficiently, and it is crucial for decreasing the long-term cost of digital health implementation.^42,45,47,48 This implies cooperation in policies, processes, and decision-making support systems that enable the rapid and effective adoption of digital technologies.^46,48 One example of a problem related to not including interoperability when implementing digital technologies is the following: “We currently have so many systems in place, we need to find out if they are able to speak to each other and if there is a backup system.”⁴⁷

Available funding

Most studies considered available funding as an important domain to include when implementing digital health,^{40,43,45,47,48} which is facilitated by mapping the development and incorporating the team’s capacity, time, and budget to build the intervention.⁴⁵ Studies also considered how transparency is required when defining who will be responsible for the cost of resources needed to implement digital technologies and who the investment allies are, such as donors, the government, or the private sector.^43,48

Environmental sustainability

The environmental sustainability of DHIs lies in their ability to be integrated in a way which preserves the natural world.⁴⁶ Apart from monitoring carbon footprint, evaluating the life cycle of DHIs is an essential approach to understanding the impact on the ecosystem⁴⁶ while also identifying social and financial benefits and challenges.⁴⁰ To implement a DHI in primary care in a way that promotes planetary health stewardship, it is necessary to consider and integrate relevant local, national, and international policies that prioritise environmental conservation and ecological sustainability principles.⁴⁶

Few studies mentioned environmental domains in their guidance.^44,46 When mentioned, it was advocated that any intervention developed in healthcare must consider future generations; therefore, DHI development should not deplete natural resources but rather utilise renewable energy for data storage, manage e-waste responsibly, and employ sustainable production methods for technological devices.⁴⁶ Other studies propose the use of reusable digital technologies for various services and purposes within the health care system, which also provide financial benefits to the system.^40,48 Refer to Figure 4 for a diagram illustrating the key concepts related to the environmental value of DHI use in primary care.

Figure 4.

Environmental domains in digital health implementation.

Measurements or evaluation of sustainability domains

The items or recommendations from the studies reviewed were compiled in Table 1 and classified according to each sustainability domain (social, environmental, and financial). In general, most studies contain items related to social domains, while there are a few items addressing the environmental domain, and the explanations for these items are often ambiguous. Only one study included another item related to health outcomes that incorporated a broader perspective when integrating DHIs, indicating the possible challenges it could pose to the health system.⁴⁸

The concept column illustrates each dimension of sustainability. The measurement items column displays the items extracted from the evaluation tools, while the domains column classifies each sustainability dimension based on the conceptual structure established in the initial section – Defining sustainability on digital health interventions – (See Table 1).

Discussion

This scoping review aims to map the existing evaluation frameworks related to sustainability in the integration of digital health interventions (DHIs) into primary care, while considering the main concepts and any overlaps or differences among these measurements. Nine guidelines and evaluation tools were included. The review extracted and synthesised the general meaning of the environmental, social, and financial aspects, which were based on the sustainable quality improvement measurements.³² According to Marmot,⁴⁹ access to health must be ensured for everyone, regardless of cultural, social, economic, or physical differences, since the social determinants of health significantly affect health outcomes in the general population. Most studies in this review agreed that implementing DHIs is beneficial, as it improves access and engagement in healthcare.^40,43,46,47 Highlighting the goal of achieving equitable health care for all kinds of people when implementing DHIs.^43,45,46 Additionally, the common health outcomes of DHIs suggested in the evaluation tool found in this scoping review are aligned with the primary care intentions established in the Declaration of Alma-Ata⁴ and the Primary Care Recovery Plan, which aim to encourage self-care behaviours and empower individuals while reducing the burden on clinicians by improving patient communication tools and digital technology.² Indeed, these are all positive health outcomes that digital health has already improved in healthcare.^9,12,14–18 Alongside the improvement of effective and faster responses to health problems.⁵⁰ This adheres to the recommendations of most evaluation frameworks in this review, which indicate that the integration of DHIs should focus on alleviating the burden on the healthcare system.^40,43 However, digital health still faces some issues in equal access to health treatments and health services, as studies suggested that DHIs bring potential bias and unequal treatment for people that already experience health inequalities because of a lack of representative data from some populations.^51–53 Additionally, the digital divide, caused by technological literacy and access disparities, remains a barrier to adopting digital technology in specific populations.^34,35 In summary, this highlights the relevance of broadening the approach to implementing DHIs by considering social determinants and social impacts, thereby increasing the likelihood of successful implementation.

This review emphasises that preserving trust in end users is a fundamental feature of achieving social sustainability in DHIs’ implementation. Trust has been described as improving clinical safety^41–45,48; adherence to data protection, privacy and confidentiality standards^{40,42,43,45,46}; wellbeing^40–42,46; and a human rights approach.^{40,42,43,45,48} However, other social implications could be incorporated to foster sustainable actions. For example, Mortimer et al. argues that there is no precise formula for measuring social impact due to the variety of ways healthcare delivery can influence society.³² Other studies argue that the core notion of social sustainability is that society maintain trust, fidelity and interconnectivity.⁵⁴ Indeed, recognising ecological impacts during the implementation of innovative technologies relates to social sustainability, as humans are codependent on natural resources, and their preservation contributes to social justice and wellbeing.^26,29

Mortimer et al.²⁹ suggests that social and environmental issues are interdependent with health care issues, as human activities occur within these contexts. This scoping review is showing that predominant indicators on the integration of DHIs have been those related to social and economic domains.^{40–43,45,47,48} Most social indicators have emphasised end-user engagement and the adoption of digital technology as crucial for the value of digital health integration into the health system, arguing that these indicators establish its cost-effectiveness.^{22,23,40,41,44,47} This reflects the societal perception of value in actions often defined as sustainable, which is frequently measured by the capital an organisation possesses to justify the financial benefits accumulated from investments over time that required a shift.^29,32,54

Building on this, only two evaluation frameworks recognised environmental indicators when implementing DHIs; however, the items related to environmental issues lack measurements in this dimension.^44,46 Jeurissen and Elkington⁵⁴ endorses the idea that industry must embed natural capital into its strategies to improve its actions towards more sustainable activities. Digital health technology should be integrated into the health system in harmony with preserving the ecosystem by aligning it with relevant local, national, and international environmental sustainability guidance.⁴⁶ Therefore, all renewable and non-renewable resources that benefit humans, such as water, soil or energy, need to be considered,⁵⁵ including environmentally responsible production and transport of supplies and equipment, energy usage for data storage, and e-waste management.⁴⁶ An in-depth methodology for evaluating the environmental impact of a product or process includes a life cycle assessment of various aspects of digital health technologies, such as software, hardware, imaging, writing, text, printing reports, data storage, and virtual health services.²⁵ A life cycle assessment calculates the ecosystem damage of a product or process by evaluating greenhouse gas emissions and other environmental impacts through a “cradle to grave” analysis, beginning with taking the raw materials from the Earth, through the production and transport stages, to use and waste management.⁵⁶ However, conducting a life cycle assessment requires expertise and time and is financially costly, which may not be feasible for primary care stakeholders. Therefore, a more simplified carbon foot printing, circular economy analysis, or waste audit approach may be necessary to incorporate environmental aspects when evaluating DHIs.^40,48,57

Research indicates that sustainability is achieved through the adoption of a systems-thinking approach that recognises the interconnectedness of social, environmental, and financial issues in human activities.^7,29,54 However, this review identifies a gap in evaluation tools that included sustainability as the core metric for assessing DHIs in primary care, along with limited attention to the ecological measurements. Consequently, it is essential to develop more evaluation tools that acknowledge the interconnections among social, environmental, and financial impacts and establish equal importance to each domain in the implementation of DHIs.

Strengths and limitations

The review has both strengths and limitations. This scoping review examined specific sustainable social, environmental, and financial categories for DHIs use in primary care, rather than relying solely on the ambiguous term “sustainability.” This approach acknowledges that broad perspectives on sustainability may lead to oversimplification and potentially overlook complex interconnections among various domains, as the conceptual challenge of sustainability arises from its diverse interpretations and definitions, complicating the effort to integrate these three attributes cohesively. This review analysed the interdependence of various domains to understand their diversity. Additionally, it considered government databases and extracted information from white papers, allowing a broader scope into how sustainability is seen in non-academic or governmental papers. Finally, the rigorous systematic approach enhanced transparency and replicability.

On the other hand, one of the limitations of the review is that the research selected for the review may have an inclusion bias, given that the search method predominantly relied on the English language. This may limit the incorporation of regionally unique perspectives, particularly from low- and middle-income nations where sustainability issues may differ. On the other hand, this review offers limited recommendations concerning social issues. As DHIs continue to evolve, they introduce new social dynamics and emerging challenges. Consequently, the review may not fully capture the complexity of these evolving social dimensions associated with technological advancement. Future research should build upon the foundational insights provided by this scoping review by undertaking more targeted investigations into under-explored areas and evaluating the proposed conceptual frameworks in various real-world contexts.

Conclusion

This scoping review included nine guidelines and evaluation frameworks that identify key domains on the conceptualisation of sustainability when implementing DHIs in primary care. The expected outcomes of DHIs in primary care encompass improved healthcare outcomes and preventative interventions in the population while alleviating health care system burden and increasing the access rates. The review synthesised environmental, social and economic impacts that stakeholders should consider when implementing DHIs to achieve sustainability. The implementation of sustainable DHIs upholds trust and resource management. Maintaining trust implies emphasising welfare and human rights, particularly in data management, considering social determinants, cultural, and legal factors and the wide range of communities included in the design and implementation items that are aligned to social sustainability. While resource management integrates interoperability and the circular economy, which are essential elements for reducing waste and minimising the consumption of natural resources and healthcare costs, aspects that are in line with environmental and economic sustainability. The consequence of including these aspects in the implementation of DHIs is that it simultaneously enhances societal benefits equitably for future generations.

Supplemental Material

sj-docx-1-phj-10.1177_22799036251407196 – Supplemental material for Sustainable assessment in digital health interventions for primary care: A scoping review

Supplemental material, sj-docx-1-phj-10.1177_22799036251407196 for Sustainable assessment in digital health interventions for primary care: A scoping review by Johanna Alvarez-Rodríguez, Theofanis Fotis, Bella Tomsett and Heather Baid in Journal of Public Health Research

Supplemental Material

sj-docx-2-phj-10.1177_22799036251407196 – Supplemental material for Sustainable assessment in digital health interventions for primary care: A scoping review

Supplemental material, sj-docx-2-phj-10.1177_22799036251407196 for Sustainable assessment in digital health interventions for primary care: A scoping review by Johanna Alvarez-Rodríguez, Theofanis Fotis, Bella Tomsett and Heather Baid in Journal of Public Health Research

Supplemental Material

sj-docx-3-phj-10.1177_22799036251407196 – Supplemental material for Sustainable assessment in digital health interventions for primary care: A scoping review

Supplemental material, sj-docx-3-phj-10.1177_22799036251407196 for Sustainable assessment in digital health interventions for primary care: A scoping review by Johanna Alvarez-Rodríguez, Theofanis Fotis, Bella Tomsett and Heather Baid in Journal of Public Health Research

Supplemental Material

sj-pdf-4-phj-10.1177_22799036251407196 – Supplemental material for Sustainable assessment in digital health interventions for primary care: A scoping review

Supplemental material, sj-pdf-4-phj-10.1177_22799036251407196 for Sustainable assessment in digital health interventions for primary care: A scoping review by Johanna Alvarez-Rodríguez, Theofanis Fotis, Bella Tomsett and Heather Baid in Journal of Public Health Research

Supplemental Material

sj-pdf-5-phj-10.1177_22799036251407196 – Supplemental material for Sustainable assessment in digital health interventions for primary care: A scoping review

Supplemental material, sj-pdf-5-phj-10.1177_22799036251407196 for Sustainable assessment in digital health interventions for primary care: A scoping review by Johanna Alvarez-Rodríguez, Theofanis Fotis, Bella Tomsett and Heather Baid in Journal of Public Health Research

Footnotes

Acknowledgements

This section acknowledges the contribution that each author made on the manuscript and the institutional support from the University of Brighton.

ORCID iDs

Johanna Alvarez-Rodríguez

Theofanis Fotis

Bella Tomsett

Heather Baid

Ethical considerations

All the authors declare that this research meets the ethical guidelines

Author contributions

Johanna Victoria Alvarez Rodriguez: Writing original draft; conceptualisation; methodology design; creation of figures; tables; or diagram; formal analysis. Theofanis Fotis: Supervision; reviewing; editing refining the manuscript; supervision. Bella Tomsett: Search; review; and screen the literature for one of the data bases; revising the manuscript. Heather Baid: Supervision; writing; reviewing; editing refining the manuscript; supervision.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Data availability statement

Protocol of this scoping review can be found at Figshare web page: Alvarez-Rodriguez, Johanna; Fotis, Theofanis; Tomsett, Bella; Baid, Heather (2023). The sustainable value assessment in digital health interventions for primary care: A scoping review protocol. figshare. Preprint. . Raw data is available and shared, it can be found in the appendices

Supplemental material

Supplemental material for this article is available online.

References

Braithwaite

Mannion

Matsuyama

, et al. The future of health systems to 2030: a roadmap for global progress and sustainability. Int J Qual Health Care 2018; 30(10): 823–831.

World Health Organization. Primary health care: closing the gap between public health and primary care through integration [Internet], https://iris.who.int/handle/10665/326458 (2018, accessed 13 August 2025).

Starfield

Shi

Macinko

Contribution of primary care to health systems and health. Milbank Q 2005; 83(3): 457–502.

International Conference on Primary Health Care. Declaration of Alma-Ata [Internet], https://cdn.who.int/media/docs/default-source/documents/almaata-declaration-en.pdf?sfvrsn=7b3c2167_2(1978) (1978, accessed 13 August 2025).

Tammes

Salisbury

Continuity of primary care matters and should be protected. BMJ 2017; 356: j373. DOI: 10.1136/bmj.j373.

Kane

Keckhafer

Flood

, et al. The effect of evercare on hospital use. J Am Geriatr Soc 2003; 51(10): 1427–1434.

World Health Organization, United Nations Children’s Fund (UNICEF). Towards universal health coverage and the Sustainable Development Goals: a vision for primary health care in the 21st century [Internet], https://iris.who.int/bitstream/handle/10665/328065/WHO-HIS-SDS-2018.15-eng.pdf (2018, accessed 13 August 2025).

Gray

Sanders

A reflection on the impact of COVID-19 on primary care in the United Kingdom. J Interprof Care 2020; 34(5): 672–678.

Jonnagaddala

Godinho

Liaw

S-T.

From telehealth to virtual primary care in Australia? A rapid scoping review. Int J Med Inform 2021; 151(151): 104470.

10.

NHS England. Delivery plan for recovering access to primary care [Internet], https://www.england.nhs.uk/long-read/delivery-plan-for-recovering-access-to-primary-care-2/ (2023, accessed 13 August 2025).

11.

Fatehi

Samadbeik

Kazemi

What is digital health? Review of definitions. Stud Health Technol Inform 2020; 275: 67–71. DOI: 10.3233/shti200696.

12.

World Health Organisation. Classification of digital interventions, services and applications in health: a shared language to describe the uses of digital technology for health, 2nd ed [Internet], https://www.who.int/publications/i/item/9789240081949 (2023, accessed 13 August 2025).

13.

WHO. Global strategy on digital health 2020-2025 [Internet], https://www.who.int/publications/i/item/9789240020924 (2021, accessed 13 August 2025).

14.

Corbett

d’Angelo

Gangitano

, et al. Future of health: findings from a survey of stakeholders on the future of health and healthcare in England. Rand Health Q 2018; 7(3): 1.

15.

World Health Organisation. WHO guideline recommendations on digital interventions for health system strengthening [Internet], https://iris.who.int/handle/10665/311980. (2018, accessed 13 August 2025).

16.

Marcelo

Madeiros

Ramesh

, et al. Transforming Health Systems through Good Digital Health Governance. Asian Development Bank 2018; 3(51): 1–15.

17.

Manyazewal

Woldeamanuel

Blumberg

, et al. The potential use of digital health technologies in the African context: a systematic review of evidence from Ethiopia. Npj Digit Med 2021; 4(1): 125.

18.

Mondejar

Avtar

Diaz

HLB

, et al. Digitalization to achieve Sustainable Development goals: steps towards a Smart Green Planet. Sci Total Environ 2021; 794: 148539.

19.

Nguyen

Fujioka

Wentlandt

, et al. Using the technology acceptance model to explore health provider and administrator perceptions of the usefulness and ease of using technology in palliative care. BMC Palliat Care 2020; 19(1): 138.

20.

Chiang

Halker Singh

Lalvani

, et al. Patient experience of telemedicine for headache care during the COVID-19 pandemic: an American Migraine Foundation survey study. Headache 2021; 61(5): 734–739.

21.

World Health Organization. WHO guideline: recommendations on digital interventions for health system strengthening [Internet], https://www.who.int/publications/i/item/9789241550505 (2019, accessed 2 February 2024).

22.

Hensher

Cooper

Dona

SWA

, et al. Scoping review: development and assessment of evaluation frameworks of mobile health apps for recommendations to consumers. J Am Med Inform Assoc 2021; 28(6): 1318–1329.

23.

Iandolo

Vito

Fulco

, et al. From health technology assessment to health technology sustainability, https://www.semanticscholar.org/paper/From-Health-Technology-Assessment-to-Health-Iandolo-Vito/8b108b4a4f7aca2e61270d09e6b2783cf93c3179 (2018, accessed 2024 October 7).

24.

Alajlan

Baslyman

Toward a comprehensive understanding and evaluation of the sustainability of E-Health Solutions. Appl Sci 2023; 13(9): 5811.

25.

Lokmic-Tomkins

Davies

Block

, et al. Assessing the carbon footprint of digital health interventions: a scoping review. J Am Med Inform Assoc 2022; 29(12): 2128–2139.

26.

Elkington

Cannibals with forks: the triple bottom line of 21st century business. Capstone, 1998.

27.

United Nations. Our common future [Internet], https://www.publicspaceinfo.nl/media/uploads/files/VN_1987_0001.pdf (1987, accessed 2 February 2024).

28.

Khodeir

Othman

Examining the interaction between lean and sustainability principles in the management process of AEC industry. Ain Shams Eng J 2018; 9(4): 1627–1634.

29.

Mortimer

Isherwood

Wilkinson

, et al. Sustainability in quality improvement: redefining value. Futur Heal J 2018; 5(2): 88–93.

30.

Arksey

O’Malley

Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005; 8(1): 19–32.

31.

Peters

MDJ

Marnie

Tricco

, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synth 2020; 18(10): 2119–2126.

32.

Mortimer

Isherwood

Pearce

, et al. Sustainability in quality improvement: measuring impact. Futur Heal J 2018; 5(2): 94–97.

33.

Schlosser

Wendt

Bhavnani

, et al. Use of information-seeking strategies for developing systematic reviews and engaging in evidence-based practice: the application of traditional and comprehensive pearl growing. A review. Int J Lang Commun Disord 2006; 41(5): 567–582.

34.

Zandi

Kuzmanovic

Global strategy on digital health 2020-2025 [Internet], https://www.who.int/docs/default-source/documents/gs4dhdaa2a9f352b0445bafbc79ca799dce4d.pdf (2021, accessed 2 February 2024).

35.

Organisation for economic co-operation and development (2020). Going digital integrated policy framework, OECD digital economy papers. https://doi.org/10.1787/dc930adc-en. (accessed 2 February 2024).

36.

Tricco

Lillie

Zarin

, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018; 169(7): 467–473.

37.

Page

McKenzie

Bossuyt

, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. PLoS Med. 2021; 18(3): e1003583.

38.

Alvarez-Rodriguez

Fotis

Tomsett

, et al. The sustainable value assessment in digital health interventions for primary care: a scoping review protocol. Figshare. Preprint, 2023. https://doi.org/10.6084/m9.figshare.23260283.v2

39.

Elo

Kyngäs

The qualitative content analysis process. J Adv Nurs 2008; 62(1): 107–115.

40.

Broomhead

Mars

Scott

RE.

A new eHealth Investment Appraisal Framework for Africa: validation. Int J Environ Res Public Health 2023; 20(14): 6426.

41.

Chuo

Macy

Lorch

SA.

Strategies for evaluating telehealth. Pediatrics 2020; 146(5): e20201781.

42.

Haig

Main

Chávez

, et al. A value framework to assess patient-facing digital health technologies that aim to improve chronic disease management: a Delphi approach. Value Health 2023; 26(10): 1474–1484.

43.

Williams

A health rights impact assessment guide for artificial intelligence projects. Health Hum Rights 2020; 22(2): 55–62.

44.

Unsworth

Dillon

Collinson

, et al. The NICE Evidence Standards Framework for digital health and care technologies - developing and maintaining an innovative evidence framework with global impact. Digit Health 2021; 7(24): 205520762110186.

45.

World Health Organisation. Youth-centred digital health interventions: a framework for planning, developing and implementing solutions with and for young people [Internet], https://www.who.int/publications/i/item/9789240011717 (2021, accessed 2 February 2024).

46.

Secretariat. Governing health futures 2030: Growing up in a digital world [Internet]. Growing up 2030 in a digital world, https://www.governinghealthfutures2030.org (2023, accessed 7 October 2024).

47.

Mauco

Scott

Mars

Development of a conceptual framework for e-health readiness assessment in the context of developing countries [Internet]. Studies in Health Technology and Informatics, 2021, https://www.semanticscholar.org/paper/Development-of-a-Conceptual-Framework-for-e-Health-Mauco-Scott/72e895cae2dab5eed418e3835858d12e05552dd8 (accessed 7 October 2024).

48.

World Health Organisation. Digital Implementation Investment Guide (DIIG): Integrating Digital Interventions into Health Programmes. WHO publications, https://www.who.int/publications/i/item/9789240010567(2020) .

49.

Marmot

Health Equity in England: the Marmot Review 10 Years on. BMJ 2020; 368: 693. DOI: 10.1136/bmj.m693.

50.

Choi

Oakley

A retrospective review of cutaneous vascular lesions referred to a teledermatology clinic. J Prim Health Care 2021; 13(1): 70–74.

51.

Ramasawmy

Poole

Banerjee

Learning our lesson: using past policies to improve digital and ethnic inequalities beyond the pandemic. Arch Public Health 2021; 79(1): 218.

52.

Alruwaili

Shaban

Elsayed Ramadan

OM.

Digital health interventions for promoting healthy aging: a systematic review of adoption patterns, efficacy, and user experience. Sustainability 2023; 15(23): 16503.

53.

Seifert

Reinwand

Schlomann

Designing and using digital mental health interventions for older adults: being aware of digital inequality. Front Psychiatry 2019; 10(10): 568.

54.

Jeurissen

Elkington

JOHN

. John Elkington, Cannibals with Forks: the Triple Bottom Line of 21st Century Business. J Bus Ethics 2000; 23(2): 229–231.

55.

Bateman

Mace

GM.

The natural capital framework for sustainably efficient and equitable decision making. Nat Sustain 2020; 3(10): 776–783.

56.

Rasmussen

Hauschild

Brorson

Environmentally sustainable health care: the opportunities and challenges of life cycle assessments. Lancet Planet Health 2025; 9: 101294.

57.

Morseletto

Targets for a circular economy. Resour Conserv Recycl 2020; 153(153): 104553.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.04 MB

0.03 MB

0.11 MB

0.39 MB

0.19 MB