Abstract
Background
The increasing prevalence and burden of chronic obstructive pulmonary disorder (COPD), the challenges in implementing pulmonary rehabilitation (PR) programs and the limited availability of alternatives and supportive programs to serve patients with COPD necessitate the development of pulmonary telerehabilitation (PTR) systems to provide patients with COPD with PR programs.
Objective
This study aimed to design and develop the ChestCare mobile Health app using user-centred design (UCD) approach. Thus, it provided PTR for patients with COPD, enhancing their self-management of symptoms and improving their compliance with PR programs.
Methods
In this mixed-methods sequential research, we deployed the UCD iterative design through the prototype app design and development sequence. The first phase was built based on the results of a previous needs assessment study and an analysis of related apps. This produced the initial mock-up, the foundation for the focus group discussions with physiotherapists and patients. Six physiotherapists with cardiorespiratory specialisation evaluated each app module and item of the latest mock-up using the content validity index (CVI) document. The I-CVI (S-CVI/Ave) and (S-CVI/UA) were computed. Qualitative and quantitative data were integrated, and decisions were made by comparing their results.
Results
The UCD iterative design through sequential MMR has generated four mock-up app versions. The latest version identified 13 modules through 150 items validated by six experts using a CVI document. The I-CVI calculation of 145 items was 1, while 0.83 for the remaining items, was within accepted values. The S-CVI scored 99.4, indicating an overall validity of the ChestCare app as a PTR system for patients with COPD.
Conclusions
The development and validation of the ChestCare app resulted from conducting UCD iterative design and sequential MMR, which identified 13 functionalities, including symptom assessment, tracking lung volume, functional capacity test, action plan, intervention program, COPD education, COPD community, monitoring and reminders.
Keywords
Introduction
Background
Chronic obstructive pulmonary disorder (COPD) is ‘a heterogeneous lung condition characterised by chronic respiratory symptoms (dyspnea, cough, expectoration, exacerbations) due to abnormalities of the airways (bronchitis, bronchiolitis) and/or alveoli (emphysema) that cause persistent, often progressive, airflow obstruction’. 1 It is the third most common cause of death, 2 and the sixth most common cause of disability globally. 3 It affects 4% of the global population, with higher prevalence and premature mortality in the lower- and middle-income countries (LMICs). 3 Pulmonary rehabilitation (PR) COPD is effective in enhancing physical endurance, managing breathlessness, improving patients’ quality of life (QoL) reducing hospital admission and likely enhancing survival.4–6 However, environmental, personal, professional and institutional factors limit referral, uptake, compliance and completion of PR programs.7–10 Despite its growing economic and societal burden, 2 COPD remains a low-priority issue in healthcare policy worldwide, 11 especially in LMICs.12,13 This identifies the necessity of developing user-centred PR programs, such as pulmonary telerehabilitation (PTR) programs to overcome this issue. Pulmonary telerehabilitation is also recommended by the American Thoracic Society and the European Respiratory Society. 4
Self-management is the most appropriate and successful approach for managing chronic health conditions' recurrent, long-lasting and slowly progressive nature and their progressively increasing burden. Self-management (SM) offers continuous management, motivation and monitoring, along with the utilisation of self-regulation skills.14–18 Self-management has been the common feature of most mobile health (mHealth) apps designed for COPD over the last five years.19–23 Other objectives were to monitor symptoms and medicine adherence,19,22,23 and to enhance exercise capacity. 20 These objectives were achieved by developing certain features and modules, including the diagnosis, supervised intervention, behavioural change and self-management exemplified in monitoring and education.19–23 In some cases, the apps were backed with hardware to track symptoms.19,22,23 Self-management involves the transfer of information to the patients along with fostering their ability to utilise their self-regulation skills to manipulate risk factors, engage in healthy behaviours, and therefore, control chronic disease.18,24 This requires encouraging specific skills such as reflective thinking, setting goals, self-evaluating and monitoring, decision-making, undertaking specific behaviours, implementing coping mechanisms and managing physical, emotional and mental reactions to changes in health conditions.14,18,25 The prevalence of COPD increases significantly with age, particularly above 60, 26 and the ‘grey digital divide’ challenges the integration and benefits of the digital revolution for the elderly, especially in healthcare.27,28 The elderly-associated frailty and comorbidities that would impede their ability to use the mHealth technology should be considered.
Mobile Health is defined by the World Health Organization (WHO) as the mobile-supported medicine and public health practice. 29 Mobile Health is a form of telerehabilitation (TR) system that is generally employed to deliver basic rehabilitation functionalities: evaluation including diagnosis, supervised intervention, self-management, behavioural change, psychosocial support, monitoring and follow-up.30,31 While mHealth apps have the potential to enhance patients’ health and improve QoL, there is a lack of robust evidence, as well as a lack of guidelines for the development and evaluation of the mHealth apps by the regulatory bodies worldwide.30,32 Another aspect of mHealth is the schism, which identifies the distinction between market-driven mHealth and science-driven mHealth, and highlights the necessity for developing standardised and sustainable mHealth systems, interventions and ecosystems to support science-driven mHealth. 33
The mHealth provides advantages over the conventional healthcare delivery system, including promoting and enhancing patient-centred care, patient-therapist engagement, resource-limited service delivery and patient empowerment exemplified in behavioural changes and self-management. 34 In addition to its extensive accessibility, portability, cost-effectiveness and data resourcefulness. 34 The development, evaluation and deployment of mHealth apps face challenges due to the complexity of generating evidence, interaction difficulties and a rigid ecosystem that restricts the transferability of app-related evidence. Additional challenges include the limited generalisation as different apps may yield different outcomes; the diagnostic potential associated with clinical outcomes; and the unavailability of consolidated purchasing mechanisms.32,34 Institutional challenges of mHealth deployment comprise the lack of funding, issues integrating health solutions with electronic health records and organisational, technical and human resources to support project implementation. 35 World Health Organization has provided the SMART guidelines to facilitate the localisation and deployment of digital systems, including mHealth. Developers, technologists and even countries were instructed to localise, institutionalise, integrate and upgrade digital systems in compliance with the scientific evidence. 36 The WHO has also prioritised developing and implementing the mHealth program, notably for NCDs, to foster universal health coverage. 37
The COPD burden and the challenges of managing COPD in Malaysia are aligned with those related to the worldwide situation, including underdiagnosis, 38 under-recognition11,13 and underdevelopment of PR programs. 39 There is a high prevalence of COPD in the Malay Archipelago, which equals 16–20%, 40 with moderate to severe prevalence in Malaysia, where about 448,000 cases (4.7%) were reported two decades ago and are likely to increase. 41 In 2019, Malaysia's annual management cost per patient was calculated at US$2206.68, with workplace productivity losses of 31.87% and activity limits of 17.42%. 42 The social burden was high, compromising QoL and workplace productivity, and the caregiver's social life was also limited by 21.63%. 43 Additionally, the limited accessibility to PR programs in Malaysia, the limited availability of alternatives, such as home-based PR, 44 the low referral rate to PR – in some cases, 16% – and the limited implementation of PR 45 are aligned with the worldwide challenges. 7 Limitations to PR implementations in Malaysia encompass the HCPs' lack of knowledge and awareness; lack of structured PR programs; limited resources, including trained personnel and logistics; limited accessibility and high patients' barriers to participation, such as severe illness and comorbidities to attend program requirements; and lack of awareness about PR's effects on health and activity. 45 Home-based PR programs, as a potential alternative to limited accessible PR, have demonstrated their feasibility, particularly on family roles, and promised to be upgraded to maximise patient benefits. 44 Telerehabilitation might be a practical alternative to PR. However, Malaysia's lack of urgency to change, lack of awareness and lack of participation in planning and decision-making are limiting factors in establishing PTR programs. Other limiting factors of PTR include inadequate exposure to e-health knowledge, resistance to change, lack of internet connectivity and limited experience with hardware and software use. 46 Engaging stakeholders and communities in managing respiratory disease and supporting health is promising in providing solutions; however, it is challenging, necessitating effective collaborative work, which is undervalued, underfunded and under-resourced. 47
The rationale beyond the development of the ChestCare mHealth app was the progressively increasing prevalence and burden of COPD, the challenges in implementing PR programs, and the limited availability of alternatives and supportive programs, such as PTR and mHealth apps to serve the patients with COPD despite their needs to such intervention. ‘The ChestCare mHealth app was developed to fulfil the patient's needs and bridge the current gap. This app provides unique functions through its comprehensive examinations and interventions for patients with COPD. It provides education, an interaction platform, reminders and risk factor monitoring. Other apps allow limited examination and interventions; such as daily records of symptoms and weather to plan activities, 19 exacerbation tracking,20,21 physical activity20,22 and medication tracking.19,20 Self-management is the key to ChestCare and other apps.21,23 The ChestCare also allows for tracking the lung volume changes throughout treatment, either via the desk spirometer or the forthcoming Smart OPEP. 48 Finally, the app allows passive patient engagement through examinations and monitoring functions and active engagement through the intervention and COPD community functions’.
This study aimed to design the ChestCare mHealth app using the user-centred iterative design approach. Thus, it provides holistic PTR for patients with COPD, enhances their self-management of symptoms and improves their compliance with PR programs.
Methodology
In this mixed-methods sequential research (MMR), 49 we followed the proposed Input–Process–Output (IPO) framework 31 to develop the ChestCare app. We created the initial mock-up based on the results of a study of user requirements (unpublished research), and an analysis of related apps (Figure 1). Then, we conducted qualitative research, including focus group discussions (FGD) with users to build up the complete app prototype, which was subsequently validated in quantitative research via an expert panel. The matured app should be tested in usability, feasibility and efficacy studies.
The UCD and the sequence of ChestCare prototyping; (1) the user assessment focuses on the user requirement study, which was augmented by related app analysis to produce the first mock-up (M-1). FGD with physiotherapists and patients has resulted in developing (M-2) and (M-3), respectively. Discussions among the MDT have resulted in refinement and to produce (M-4). (2) The design and development of the app prototype have continued including the validation of the latest version by an expert panel, and finally, coding has been performed.31,49–51 The resulting matured app should be tested in usability, feasibility and efficacy studies.
Phase 1: User-centred design approach
The user-centred design (UCD) highlights the end users’ needs through iterative rounds of design, development and adaptations to best respond to users’ demands.50,51 We implemented the UCD by conducting a needs assessment study and a series of FGDs with physiotherapists and patients, along with content validation by experts. 52 Each sequence resulted in the development of a version of the ChestCare prototype. Four prototype versions were developed until the actual app was developed, as shown in Figure 1. Users of the ChestCare app were patients with COPD who received physiotherapy interventions or PR, and respiratory physiotherapists providing PR. We explained all study information to the participants before data collection, and the signed informed consent was obtained from individual participants: patients signed the paper consent, while participants of the online FGDs filled in the online demographic form which included the sentence, ‘Please be informed that by filling out this form, you provide your consent to participate in this discussion. Your response will be confidential’.
Step 1: Needs assessment
In the mentioned needs assessment study (unpublished research), we asked potential users about their requirements related to the mHealth app, their willingness to collaborate through the app, and the possibility of learning therapeutic exercises and other topics related to their condition through the mHealth app. The participants were physiotherapists and patients with COPD who received in-hospital physiotherapy. All participants were recruited purposely according to the predetermined inclusion criteria, and no incentives were given at this phase.
Step2: Analysis of related apps
The IPO framework highlighted ‘analysis of related apps' as a possible method to inform the TR system design. 31 Analysis of related apps would guide the design and development more effectively than copying the app's functions. Over the last five years, five TR systems were developed to serve patients with COPD. 31 We analysed these apps based on pre-set criteria, including the app components, objectives, theory-informed development, main menu and developed modules and functionalities. Integration of the user needs from the needs assessment study and related app analysis has informed the development of the first version of the ChestCare app prototype using mockitt.wondershare website, which encompassed 11 displays.
Sequential FGD
Step 3: FGDs with physiotherapists
We conducted three sequential FGDs with potential users of ChestCare. The participants were recruited purposively according to predetermined inclusion criteria, and incentives were not provided at this step. The first FGD was conducted with respiratory physiotherapists who provided respiratory physiotherapy or PR for patients with COPD, with a minimum experience of three years. The FGD was conducted according to the pretested moderator guide, as shown in Supplemental 1. The framework method of analysing qualitative data,53,54 along with deductive coding was adopted; the coding framework was captured from the literature. 55 The content and layout were reported as essential topics of discussion, 56 and visuals were also reported as essential. 31 The visuals were interpreted by the research team as colours and icons. The first FGD was held in March 2023 online via Google Meet, and the meeting was recorded. The discussion was held in English, lasted for 107 min, moderated by SG, a female physiotherapy consultant experienced in qualitative research, and facilitated by a research assistant in physiotherapy. The information sheet was sent to the participants prior to the meeting by email, entailing the objectives of the app and the discussion, as well as the FGD timeline and ground rules. We started the session by asking the participants about their experiences with mHealth apps, followed by a discussion about their perspectives on the app prototype. Supplemental 1 identifies specific questions and the discussion's flow.
The second FGD was held with respiratory physiotherapists in July 2023, adopting the same inclusion criteria. Five therapists participated in an online discussion that lasted for 45 min. SG presented the second version of the app prototype to the participants and enquired about their perspectives regarding the app layout, content, colours and icons.
Step 4: FGD with patients
Participants of the third FGD were patients with COPD who received physiotherapy intervention or PR using the OPEP devices. The participants were recruited purposefully by calling the eligible patients from the list of appointments to the outpatient respiratory clinic. Incentives were not provided at this step. The discussion was held onsite at a hospital with three patients on 6 September 2023. SG initiated the discussion by enquiring about their experience with OPEP devices and mHealth apps; then, SG presented the second version of the app prototype. The patients were asked to provide their perspectives on the proposed app layout, content, colours and icons. The discussion was held in English, video recorded and lasted for 104 min; translation to and from Malay was done by a physiotherapy expert as required due to the participation of a monolingual patient. The analysis of this discussion has resulted in upgrading to the third version of the app prototype, with the addition of two features.
Phase 2: Design and development
Step 1: Prototyping and design concept
The mock-up app was an essential milestone of mHealth design and development. 31 SG has utilised the mockitt.wondershare website to develop the four versions of the mock-up app. At each milestone, the developed mock-up was discussed with and verified by the research team; the second version of the app mock-up is shown in Supplemental 2. Then, SG developed the storyboard, which provided a visual guide for the developer and identified the app modules, the steps in using the app and the relationship between displays along with the user journey.57,58 The storyboard also identified each step in using the app linked with the input, output and the specified role of each user. 58
Step 2: Refinement
The multidisciplinary team thoroughly discussed the third version of the app prototype in several rounds of online meetings using Google Meet in November and December, which resulted in the enhancement of the prototype and several technical criteria and features.
Step 3: Expert panel validation
Expert panel validation of the app content is an essential procedure for app development, as proposed by the IPO framework. 31 Therefore, the research team conducted the content validity evaluation according to the proposed steps.59–61 The content validity document aimed to provide the expert panel with a clear understanding of content validation and the app objectives, modules and content. SG prepared the content validity document (form) to encompass clear instructions on the rating scale and a detailed description of the app modules. Hereafter, each module's contents were transferred into items to judge its degree of relevance on a 4-level rating scale: (1) the item is not relevant to the measured domain, (2) the item is somewhat relevant to the measured domain, (3) the item is quite relevant to the measured domain and (4) the item is highly relevant to the measured domain. The research team SG, AFML, NMA and DKAS discussed and agreed on the content validity document (form). Although validating and piloting the content validity document were not essential steps,59,60 SG piloted it with one expert and discussed the proposed amendments with the team before the validation.
The selection of the experts was decided based on preset criteria, including respiratory physiotherapists who provided management for patients with COPD, and had a minimum of a bachelor's degree and five years of experience, either from academic or clinical fields. Invitations were sent to potential participants by email. Upon acceptance, the content validity document was sent to each participant by email for review. Then, an online meeting was held to clearly describe the app objectives, modules and contents and present the app prototype.
The evaluation processes encompassed reviewing modules and their items. The ChestCare app included 13 modules with a total of 155 items that covered the user profile, browse contents, assessment and evaluation, supervised intervention, education, COPD community, monitoring and reminder module. The definition and objective of the module, as well as its items, were provided to the experts and supplemented with a 4-level rating scale for each item. The experts were requested to critique each module and its items and to provide verbal comments to enhance the content validity. Then, the experts were asked to judge the degree of relevance of each item and to complete and send the content validation document within 48 h of the meeting to avoid bias. SG followed up with experts to ensure their response clarity and consistency. Finally, SG computed the I-CVI, the (S-CVI/Ave) and the (S-CVI/UA), and reviewed the results with the research team.
Step 4: Development
The ChestCare mHealth app was developed based on the findings from previous phases. The development of the ChestCare mHealth app used the programming language Typescript or Angular, and the backend used PHP and WordPress CMS.
Data analysis
User requirements and analysis of related apps
Results of the needs assessment study and related app analysis were integrated and merged to identify the content of the intended app, which informed the development of the first version of the app prototype.
Qualitative analysis
The discussions were moderated by SG and facilitated by the moderator assistant, following the pretested moderator guide. The discussions were conducted in English and recorded via video. The framework method was applied to analyse the qualitative data53,54; the recorded videos were transcribed verbatim using the Happy Scribe website, and the discussion scripts were revised, verified and reviewed line by line by SG. Deductive coding was applied, 55 initial codes were generated and grouped into codes that reflected the adopted coding frame (layout, content, colours, icons, suggestions and wish list)31,56 by using Microsoft Word. The codes were phrases that enclosed the extracts, and the codes were then discussed with DKAS, AFML and NMA until a mutual agreement was reached. The working analytic framework was developed and applied based on the adopted codes, and finally, data was charted into the framework (Table 2). The required refinements and improvements of the app prototype were identified and applied through three iterations of discussions.
Quantitative analysis
The content validation documents were transferred to Excel format, and the item content validity index (I-CVI) was computed for each item. Results of I-CVI were discussed among the research team to decide on item validation. Afterwards, the (S-CVI/Ave) and the (S-CVI/UA) were computed.
Triangulation
Credible and consistent results required a well-justified MMR design and triangulation methods.62,63 In this study, the qualitative and quantitative data were arranged and integrated by applying recommendations for triangulation and reporting of MMR,62,64 which enhanced data and validated results.
Results
The results of this study were obtained from the UCD approach, which included the needs assessment, the related app analysis and the FGDs with therapists and patients. Results were also obtained from the MDT discussions, resulting in refinements and content validation by the expert panel.
Need assessment
Based on the previous needs assessment results, we presented the users’ requirements for the TR system. Users were willing to adopt TR and collaborate through the mHealth app, which, in particular, combined diagnostic and therapeutic devices, including the OPEP and spirometer. Users preferred the visual and audio contents of the mHealth app along with the hybrid rehabilitation regime. They were willing to learn therapeutic exercises and related topics through videos, SMS and the mHealth app.
Analysis of related apps
Analysis of five TR systems entailed mHealth apps that were developed for patients with COPD.19–23 Adjoined with the identified users’ requirements has resulted in identifying the functionalities of the ChestCare app. The results of this analysis are presented in Table 1 and show the ChestCare components, objective, theory-informed development, main menu and modules. Accordingly, SG identified the app displays and discussed the content with AFML, NMA and DKAS until reaching an agreement; initial app sketches were designed, encompassing 11 displays, as shown in Figure 2.
Initial sketches of the app prototype.
Applying related apps analysis to inform the design of the ChestCare app.
Focus group discussions
Six respiratory physiotherapists with an average duration of experience of 12.4 ± 202 years participated in the first FGD; one held a PhD, three held a bachelor's degree, and two held a diploma in Physiotherapy. Their experience in mHealth apps was limited to the personal use of obesity management apps and the COVID-19 tracking app MySejahtera. Discussions with physiotherapists focused on the app prototype's layout, content, colours and icons, as shown in Figure 3. The wish list and refinements were also included, as described in Table 2. Generally, they described the app layout as simple and easy to understand, with recommendations to add more descriptive icons to the symptoms assessment module and replace words with pictures. Additionally, physiotherapists described the app content as good, with recommendations to replace the symptom screen with a more descriptive and reliable COPD Assessment Test (CAT). They also recommended adding tracking for risk factors, including smoking, and enhancing two-way communication through the app. Participants described colours as good and not distracting, and they recommended implementing colours to distinguish patients’ symptoms and motivate patients to exercise. They recommended adding descriptions to the icons and quantifying the scaling systems. The second version of the app prototype was prepared according to this discussion, formulating the basis for the second FGD.
Analysis of the FGDs with users by framework matrix.
*Representative quotes and iterative changes made throughout the three rounds of FGDs with potential users.
*Participants participating in round 1, 2 or 3 of FGDs.
The second FGD was conducted with five respiratory physiotherapists, with an average duration of work experience of 10.4 ± 3 years, holding a bachelor's degree in physiotherapy. Their experience with the mHealth app was limited to the personal use of obesity management and fitness apps, and a single experience in stroke rehabilitation app. The physiotherapists’ perspectives regarding the app prototype's layout, content, colours and icons were identified, and the related subthemes are presented in Multimedia Appendix 2. Generally, the participants have confirmed the upgraded version of the app prototype, emphasising risk factor monitoring, smoking and two-way communication.
Three patients with COPD participated in the third FGD; their mean age was 67 years, and the mean year since they were diagnosed with COPD was 3.7 years. All patients liked the app layout and described it as clear, clean and neat. They also liked the colours, icons and amount of information provided by the app, with an option to pause throughout the provided PR program. The participants suggested individualising the app by including questions about factors that trigger symptoms, living and working situations, eating and surrounding environments. The research team considered these suggestions and upgraded the app prototype to its third version.
Ultimately, the three rounds of FGDs have generated participants' perspectives on the literature-derived themes: content, layout, colours, icons and suggestions as shown in Figure 3 and Table 2. The discussion about participants’ perspectives on the layout revealed its simplicity and clarity. Discussions about the prototype content created several additions related to assessment and education topics modules. Discussions about the colours and icons demonstrated their suitability and acceptability by the participants. Finally, the inquiries about their wish list and suggestions include monitoring of risk factors and a summary of their tests’ results.
Development of mock-ups and storyboard
Through four phases of UCD iterative designs, SG developed four versions of the mock-up app or prototype. At each phase, the developed mock-up was presented to the research team AFML, NMA and DKAS before discussing with the potential users via FGDs and inquiring about their feedback and wish list. Accordingly, the mock-up version was upgraded and refined, as shown in Multimedia Appendix 3. The app storyboard was prepared after reaching a satisfactory version, providing a visual guide to the app modules. The steps in using the app related to users' inputs, outputs and roles, as well as the relationship between displays along the user flow.
Refinement
The multidisciplinary team discussed the app's functionalities, objectives, modules, contents and intended users through several online discussions. The discussions have resulted in the refinement of app functions and the addition of several technical features as shown in Table 2. The text of reminders, risk factors notifications and refinements of the monitoring risk factors, and COPD community modules have been considered, resulting in the development of the fourth version of the app prototype.
Expert panel validation
Six experts in respiratory physiotherapy were asked to complete the CVI document, with a mean year of experience of 20.3 ± 12 years, two from the clinical field and four having mixed academic and clinical experience. Results of CVI calculations showed that 145 items scored 1, and only five items scored 0.83. These items were the employee number, the phone number of the therapist sign-up module, the instructions about the BODE index and the daily reminders to perform the CAT and the Modified Medical Research Council (mMRC) tests. However, these results suggested an agreement on the inquired 150 items, and therefore, all items have remained within the app prototype. The S-CVI scored 99.4, indicating an overall validity of the ChestCare app as a PTR system for patients with COPD. See Appendix 2: Content validity of the symptom monitoring module.
Triangulation
In this sequential MMR, we integrated the results of the qualitative FGDs, exemplified in the latest version of the app prototype, with the quantitative results derived from the expert panel validation using the CVI document. Based on this integration, decisions were made to maintain the evaluated items within the app. The outputs of each mentioned phase, along with the administration of the IPO framework, are illustrated in Table 3.
Applying mixed-methods sequential research, UCD and the IPO framework in developing the ChestCare mHealth app (the added features throughout the sequences of the app design).
The ChestCare app
To achieve the main goal of developing the ChestCare app, it was essential to develop basic functionalities that serve PR, including assessment and interventions as shown in Figures 4 and 5. The assessment included symptom assessment, lung volume tracking and functional capacity testing. Intervention encompassed breathing exercises, chest clearance, staying active (physical activity) and education. These functionalities have evolved from the previous needs assessment study along with an analysis of related apps. The latter has highlighted the reminder module as well. It's worth noting that All app's figures were created by the developer unless otherwise, they were from open source and properly cited. Since the development of ChestCare was for academic and research purposes, approval is not required, and where applicable, we adhered to the required licensing conditions. We understand that obtaining approval is necessary for commercialising the app. If we proceed with this project toward commercialisation, we will do so.
Screenshot from the ChestCare app: sign-up, chest clearance and COPD education modules.
COPD community module and lung volume measure modules.
Symptom assessment module
The CAT is a patient-reported outcome measure (PROM) deployed to quantify the COPD symptom burden along with its risk exacerbation. 65 The CAT scores have been shown to correlate with mortality66,67 and risk of exacerbations.67–69 Moreover, the CAT shows high responsiveness to PR with the ability to distinguish categories of responses 70 and identify AECOPD patients who are responsive or not responsive to medical intervention. 71 The CAT has been deployed for online use by creating a digital calculator, which facilitates the assessment of COPD severity and functional capacity deterioration along with the efficiency of PR. 72
The mMRC module
Evaluation of dyspnoea is crucial to categorise functional disability and response to treatment. The mMRC is a PROM and has been deployed for decades to assess and grade dyspnoea severity and establish effective interventions. 73 It is correlated moderately with lung volume tests, 73 moderately to strongly with the cardiopulmonary fitness of patients 74 and highly correlated with the disease-specific QoL. 75 The mMRC has also been deployed for online use, which facilitates patients’ assessment and counselling. 76
6-min walk test module
The module is deployed to evaluate the effectiveness of treatments for patients with cardiopulmonary disorders, and the functional capacities for patients with frailty who cannot tolerate treadmill activities such as elderly, COPD, heart failure, arthritis and neuromuscular disorders. 77 The 6-min walk test computes reference values for a walking distance as a measure of functional status. 78 It is safer, easier to administer, more tolerated and more reflective of activity daily living than other tests. 79 Therefore, it has been deployed for online use, facilitating patients’ assessment and simplifying calculations. 80
Lung volume tracker module
Spirometer testing is crucial to confirm the COPD diagnosis. 2 However, it is underutilised in diagnosing and managing COPD. 81 Efforts to enhance its utilisation81–84 and facilitate access to it have been encouraged to provide solutions for the underutilisation and underdiagnosis of COPD in both HICs and LMICs.3,85,86 Utilisation of a spirometer can help direct the patient's admission to the emergency department, 87 guide the one-month post-discharge 88 and predict the post-discharge relapse, 89 mortality and readmissions. 90 This was the first stage of developing the Smart OPEP device, 48 which aimed at enhancing the utilisation of spirometry functionalities along with providing effective physiotherapy intervention. Thus, we started developing and validating the mHealth app and tracking lung volume using desk spirometry. Therefore, we hypothesised that tracking the lung volume, FEV1/FVC 2 during PR would guide the decisions related to patient management for better effectiveness.
The BODE index module
Survival prediction for patients with COPD, however, should not be deployed for patients with acute exacerbations or to guide therapeutic interventions. 91 It uses the body mass index, lung volume measures, dyspnoea and exercise capacity indexes to evaluate the COPD systemic symptoms. 91 The BODE index is more reliable in predicting hospitalisation 92 and acute exacerbation 93 than the FEV1. It has been deployed for online use, and it helps therapists educate their patients about prognosis and adjust the goals of the interventions. 94
In summary, the GOLD guidelines 2 have recommended the CAT and mMRC for evaluating all COPD patients. The mMRC is a component of the BODE index which predicts mortalities and risk of hospitalisation.76,91 The online experience of the CAT, mMRC, 6-min walk test and patient counselling inspired our endeavours to facilitate COPD management. Thus, we included the mentioned tests in the ChestCare app and embedded algorithms for results calculation. A patient can carry out the CAT, mMRC and 6-min walk test individually, and the app automatically shows results, with guidance and support from physiotherapists through the COPD community, and instructions provided through the education module. The BODE index will be computed automatically and shown only to physiotherapists, which will help predict exacerbations and hospitalisation, thus helping to avoid flare-ups.92,93
Breathing exercises, chest clearance and stay active module
A basic PR program for patients with COPD encompasses breathing exercises, chest clearance techniques, physical activity program and education.95,96 Additionally, OPEP devices such as Aerobika are increasingly deployed for their effectiveness, ease of use and possibility for deployment in tele-context. 48 Evaluation of the post-intervention exertion was induced by utilising the Borg CR scale (CR10). 97 We considered the recommendations for setting up a virtual PTR 98 and recommendations for HCPs for setting up PR programs. 99 The patient will independently use the intervention module and will be supplied with the necessary education through an icon embedded in each content of the intervention to direct the patient to the respective part of the education. Additionally, physiotherapists will supervise the patients’ performance and guide the COPD community.
Other related modules
The action plan
Setting up a treatment plan or ‘action plan’ is a core constituent of the PR program. It summarises the results of tests and examinations, identifies the intervention goals and strategies, and therefore helps in the early detection of flare-ups of COPD. The treatment plan identifies the actions to be carried out to manage the disease symptoms along with early detection and avoidance of flare-ups.98,99 It was reported that SM interventions that included an agreed-on action plan for exacerbating symptoms decreased the likelihood of hospitalisation for respiratory and non-respiratory related reasons. It also helps to manage improvements and monitor patients’ progress. 95 Development of the action plan within the ChestCare app has evolved from the participants’ wishes to visualise the results of their tests and examinations summarised in one display, with clear guidance on what to do in each case. Development of the treatment plan in PR aligned with the physiotherapists’ qualifications and responsibilities. 100 The plan was designed and programmed to summarise the patient's tests and examination results automatically. It was claimed that attracting patients’ visual attention would facilitate compliance with performing the tests, examinations and intervention strategies. Considering the individual nature of the treatment program and the patient's needs, physiotherapists will manually assign the treatment plan rather than making automated decisions.
The education module
Education is an essential component of PR programs, 101 and it has been recommended by the IPO framework to build a TR system to include five main functionalities; one of them is self-management support, which necessitates patient education. 31 Education was also one of the identified modules to be developed according to the analysis of related apps. It was emphasised by the UCD approach through discussion with physiotherapists and patients with clear identification of its topics.
Education, as part of self-management programs, has contributed to enhance its efficiency and effectiveness along with improving the therapeutic outcome measures.102,103 The content of the education module of the ChestCare system was developed based on the Lung Foundation Australia (LFA) guidelines, 101 its PR toolkit 104 and the patient guide. 105 Additionally, we considered the Health Service Executive of Ireland provided through the national management guidelines, 95 the HCPs’ guidelines for developing PR, 99 and the guidelines for setting up PTR. 98 The education module aims to enhance self-management of the disease symptoms by providing knowledge, teaching patients how to perform treatments and helping teach coping strategies. To achieve this goal, the education module was established to include 12 topics: (1) knowledge about the disease, (2) risk factors of COPD, (3) the importance of PR of COPD, (4) breathing exercise, (5) sputum expectoration, (6) staying active, (7) spirometry testing and lung volumes, (8) managing flare-ups, (9) psychologic support, (10) medications, (11) healthy eating and (12) living well with COPD. According to the LFA recommendations, the education module was developed to provide patients with variable modes of presentation and allow for patient interaction. 101
The COPD community
The utilisation of mHealth apps has enhanced communications between patients and HCPs, with a high potential to enhance patients’ empowerment and self-management, with an ultimate improvement of TOMs. 106 Communication through the mHealth app has been enhanced by launching channels between patients and HCPs, 107 and among patients themselves, in a peer lead form 108 ; and shown its effects on enhancing patients’ engagement, facilitating the transfer of knowledge and experience and augmenting reminders to perform self-care tasks. 107 It also facilitated problem-solving, daily management and behavioural modifications and provided patients with social and emotional support. 108 The development of the COPD community has been derived from the physiotherapists’ remarks on the good impact of two-way communication for patients. Besides that, patients have reported the importance of identifying each patient's condition and circumstances, which can be achieved only through two-way communication. Furthermore, the development of this module aligned with the LFA guidelines to deploy active participation through interaction and discussion. 101 This module includes three components that allow patients to communicate with physiotherapists and other patients in the community, thus supporting each other and exchanging information and experience. The three components are as follows: (1) ask the therapist, (2) tell your story and (3) ask your friends. All physiotherapists and patients must log into this module with their real names. Anonymous posts are not allowed, and every post has to be approved by a physiotherapist before being posted into the module. Participants are also allowed to share their contact information and arrange for shared activities, thus achieving the objectives of this module, which are to enhance communication, provide support and exchange knowledge and experience.
The risk factors monitoring module
Monitoring is an integral component of telehealth and mHealth.102,109 Tracking, a term used interchangeably with monitoring, is defined by the PubMed mesh as ‘Information relating to itemised coding of procedures and costs associated with healthcare delivery, used as a means for tracking healthcare utilisation, patterns of care and treatment outcomes'. 110 Although the PubMed definition highlighted three areas of monitoring: healthcare utilisation, the pattern of care and treatment outcomes, the current tracking module highlighted the pattern of care along with the treatment outcomes in addition to the risk factors. Development of this module has been derived from the UCD approach through discussion with the patients, as they implied that ‘it is important to understand what is the main thing that triggers the disease and how to overcome this problem … and understand the place he lives in, the lifestyle’. The reminder module asks questions to the patients, about their disease, risk factors and compliance with medications and PR programs. The notifications will be sent to the patients as a push notification following their responses to the risk factors monitoring module. A total of 11 notification messages have been developed according to the LFA guidelines, 101 the PR toolkit, 104 and the patient's guidance, 105 and have also been validated by the expert panel. The notification messages targeted monitoring of the healthy BMI, smoking, the participants' need for support to quit smoking, type of work, living situations, irritants of symptoms, exposure to irritants and air pollution, adherence to medications, vaccines and inhaler devices.
Development of the reminder module
Reminders, in variable forms, are one of the proficiency experience techniques of the mHealth apps. They enhance adherence to the intervention-targeted self-management and encourage the participants’ self-efficacy, time management and motivation toward commitment.111–113 The reminder module has been developed based on an analysis of related apps; it was also emphasised through the UCD based on FGD discussions with patients. Reminders will be sent to the patients as a push notification following their selection of reminders. Automated push notifications are inherent functionalities that are valuable since they require minimal or no input from participants and HCPs. They enhance the likelihood of gathering necessary data and serve as an effective tool for user engagement.111,112 Reminders were set to be delivered daily, weekly or monthly. Specific functions were assigned as a daily reminder, such as the CAT test, breathing exercises and staying active. Meanwhile, other functionalities were assigned for weekly reminders, such as COPD community and chest clearance. Monthly reminders include completing the QoL survey, visiting the physiotherapy department and performing the lung measure test.
Discussion
Principal findings
Under the context of this study, we outlined the fundamental functionalities of the ChestCare mHealth app that had the potential to serve patients with COPD with PR programs, thus bridging the gap of unavailable alternatives to the under-recognised, underdeveloped and underutilised PR programs. The ChestCare app ended up with 13 functionalities, including sign-up, browsing contents, symptom assessment, tracking lung volume, functional capacity test, action plan, breathing exercises, chest clearance, staying active, COPD education, COPD community, monitoring and reminders.
User-centred design and iteration
We deployed the UCD as a system design approach for ChestCare app development. User-centred design emphasised the end-users, physiotherapists and COPD patients in the case of ChestCare, along with stakeholders. Additionally, UCD adopted iteration in research, design, development and testing of the developed system. 50 The UCD allowed for translating evidence-based practice to industry along with prioritising users’ needs.114,115 Agile or iterative development, alongside UCD, involved progressive and responsive design, development and testing for rapid learning and product adaptation. 51 Agile, in contrast to the waterfall model, allowed for enhancing system features, minimising usability issues, adding new system features and responding to design changes. 116 Through the course of ChestCare development, which lasted for 12 months, we started with the first app prototype, which encompassed 11 displays and eight simple functionalities; however, after conducting two FGDs with physiotherapists, one FGD with patients, and a series of discussions with the MDT, we ended up with the final version of the app encompassing of 30 displays, two users’ pathways, with marked enhancement of the app functionalities to align with international guidelines and practice. Here, we realise that having this extent of functionalities would overwhelm users, especially old-age patients with COPD, who may have cognitive frailty. To overcome this potential challenge, we upgraded the simple messaging system of the first prototype version to the COPD community, which allowed patients to interact with and support each other and exchange experiences and knowledge related to their disease management. Additionally, the COPD community allowed for two-way interaction with the physiotherapists, which would motivate patients and allow for more engagement. 107 We also considered other measures to facilitate the use of ChestCare through the development of a detailed educational module that will be displayed to users in variable and interesting formats to enhance engagement and benefits. 101
The action plan: utilising the physiotherapists’ competencies
Development of the action plan was aimed at providing patients with a written plan on what actions to take, based on assessment results, to help manage disease symptoms and avoid flare-ups. The action plan was considered one of the general practitioners’ (GP) responsibilities. 117 However, under this developmental work, physiotherapists will be the main HCPs who supervise and guide the PTR programmes. Therefore, we adapted the action plan 117 to align with the PTs' competencies and responsibilities. Medical doctors at the hospital will refer patients with COPD to the outpatient physiotherapy department as the responsible physiotherapist will evaluate the patient and decide to refer him to the ChestCare app. The responsible PT will also decide on the embedded action plan, which does not surpass physiotherapy competencies and responsibilities. Worldwide, physiotherapy is moving toward direct access or primary contact,118,119 where patients directly access physiotherapy without a referral from medical doctors. Such a transition from secondary healthcare to an autonomous practice implicates several advantages, including cost-effectiveness due to the reduced time, cost and resources.120,121 It is associated with better outcomes in disability and QoL. 122 The referral-based PT practice has limited physiotherapists' clinical reasoning, clinical decision-making and evidence-based practice, resulting in irresponsibility and frustration. 123 The physiotherapist's independent judgement under the context of ChestCare is not a transition to the autonomous practice nor a call to surpass the medical doctor, who will be making the first decision of referring patients to PR in alignment with the referral system in Malaysia. However, this is an attempt to utilise the physiotherapists’ clinical reasoning, decision-making skills and responsibilities to evaluate the patient's symptoms and decide, under the context of the referral system, whether to receive PR interventions or to refer the patient back to doctors for medical attention. This also justifies why the decisions impeded in the action plan were not automated; we rely on the physiotherapists’ clinical reasoning, clinical decision-making skills and independent judgement responsibility.
Mhealth development and effectiveness: tackle the challenges
One of the key variables of providing PTR is the selection of its context; the mHealth app is preferred over other contexts due to its extensive accessibility, portability, cost-effectiveness and data resourcefulness. 34 However, three basic challenges may jeopardise the mHealth development and, therefore, its effectiveness; the first is the lack of rigorous evidence and guidelines for the development and evaluation of the mHealth apps by the global regularity bodies.30,32 The second is the high rate of attrition, with 43% drop-out in observational and experimental studies 124 and with adherence rate as low as 56%, 111 which endangers treatment effectiveness, might increase hospitalisations, and is a major mHealth development jeopardy. 111 The third is the lack of national guidelines for implementing a digital health innovation ecosystem. 125 Our endeavours to tackle the first challenge focus on the adoption of the IPO framework for the TR system development, which is supported by rigorous evidence. 31 Hence, we followed the IPO's recommendations in conducting mixed-methods research, working in a multidisciplinary team, identifying a budget and timeline and adopting the UCD iterative design approach50,51,114–116 and self-management.17,102,103 We also addressed our previous hypothesis of TR system development and testing to invest more effort in the design and development, which lasted 12 months, thus minimising the usability issues and enhancing the user experience. 31 Finally, we considered the STEERING model as a recommended approach to developing telemedicine, including the mHealth, 126 which emphasises self-management, tracking of TOMs, pattern of care and healthcare utilisation, education, enhanced adherence, reminders, identified usefulness, networking and generalised versus individualised features for developing mHealth that effectively enhances TOMs. 126
The reported high rate of attritions should be managed to maximise mHealth effectiveness for the NCDs management in the long term. 124 The intention to use the mHealth apps is essential to ensure adherence and maximise effectiveness. Such intention is influenced by several factors, including social encouragement, the possibility of sharing information about one's illness with a social network, concerns about patients’ digital information, perceived effort in terms of time-consuming and carrying out several tasks independently, inadequate privacy and inadequate information about the provided tool, as well as the improvement of manual records. 127 Moreover, variable intervention-related factors have shown their impact on maximising adherence, including personalisation of content to the user's need, push-up notifications, user-friendly and technically stable app design and personal support compatible with the digital intervention. 111 Social factors and gamification features have also shown their influence on adherence, patient characteristics and recruitment channels. 111 Real-time data monitoring, passive monitoring and personalised study feedback can potentially maximise long-term engagement. Other engagement strategies should incorporate technology usability, motivating elements and the necessity for personal contact with research professionals and study assistance. 112 A key factor that should be considered in developing mHealth is the significance of carrying out a digital health innovation ecosystem in HICs and LMICs, along with adopting the policy implementation guidelines. 125 Future upgrading of the ChestCare app would include the development of Key Performance Indicators to reflect the patient's compliance with the PR program in terms of adherence calculations and enhanced TOMs, along with the healthcare utilisation and patterns of care.128,129
Commercialising potentials
Malaysia is an upper middle-income economy 130 and has developed a two-tiered healthcare system: the public sector, financed and led by the government and the well-established private industry. The two systems work in good collaboration with each other. 131 Both sectors are challenged by staff shortages, along with the location of their best facilities in large cities. The public sector is equipped with excellent medical devices and diagnostic capabilities, and the cost is heavily subsidised by the government. However, it is challenged by the very long waiting time and the very basic health services provided in rural areas. 131 Currently, the private sector drives the adoption of health technology. However, to offer world-class healthcare, the public and private healthcare sectors will invest more in healthcare technology, medical devices and digital health, with a special focus on monitoring and preventing NCDs. 132 Alternatively, Malaysia aligns with the worldwide ‘triple problem of COPD’ exemplified by underdiagnosis, 38 under-recognition11,13 and the underdevelopment of PR programs 39 as well as the restricted related database, PR programme accessibility and alternative availability 44 and low referrals along with a low commitment to implementing PR. 45 The need to develop alternatives to the challenged PR programs is obvious, and a consolidated rationale was formulated to develop the ChestCare mobile app, which took place in the public sector, where health technology adoption is not a current priority. This urges us to intensify the efforts to carry out the development process and to plan for the next usability, feasibility and validity phases. However, the main challenge seems to lie in commercialising the ChestCare app. 133 Considering that the public sector lacks the commercialisation potentials, assets and means, the private sector is perfect for commercialisation due to its current adoption of health technology and the availability of assets and potential users. Therefore, the commercialisation transition, 133 as an essential commercialisation phase, should be planned to transition to the private sector.
Cross-cultural validation and adaptation
Cross-cultural adaptation and validation of an instrument are different. However, they are complementary in steps of conduction 134 ; adaptation involves selecting, translating and adjusting the instrument across languages and cultures for meaningful comparisons and appropriateness, thus providing an equivalent measure. 135 Validation determines whether instruments, usually psychological notions, from one culture are applicable, meaningful and equivalent in another in numerical values, thus confirming accuracy and reliability. 136 In that sense, we enquire whether this methodology of cross-cultural adaptation and validation of PROMs applies to mHealth; we are trying to figure out whether the mobile app that has been developed for the Malaysian population should be committed to a cross-cultural adaptation and validation when attempting to be used by non-Malaysian users. This adaptation and validation is meant to go through several steps, including translations, synthesis of the translations, back translation, six types of equivalence analysis, expert committee review to align the translated versions, pre-final version testing in pilot studies and testing for the retention of the psychometric properties, where it is essential to consider the mode and the context of administering the instrument,134,136 along with the conceptual, semantic, operational and equivalences of the instrument that should be verified. 134 mHealth development and testing are emerging knowledge, and non-to-limited information about cultural adaptation and validation is available. However, researchers should always consider that the mHealth app is designed for specific patient populations, age groups and literacy levels to improve patient engagement and health outcomes, 137 highlighting the necessity to consider cross-cultural adaptation and validation. To our knowledge, the only case that was located in the literature was the development and testing of the Advanced Symptom Management System (ASyMS), which was a mobile app deployed for remote monitoring of chemotherapy and was developed and tested on British patients.138,139 However, deploying the ASyMS for Canadian patients required conducting a new usability testing study, 140 clearly stated in the study rationale. Here, it is difficult to claim that the latest usability testing is equivalent to cross-cultural adaptation and validation, and it is equally difficult to argue that our enquiries about adapting and validating the mobile app in different cultures are an essential milestone. It might be reasonable, at this stage, to initiate this argument, and perhaps others can proceed with deep insights in future research.
Strengths and limitations of the study
We claim this work has undergone a robust design and development methodology as described previously. This may facilitate usability and feasibility studies, subsequent clinical efficacy and cross-cultural adaptations.
A considerable limitation of this work was the under-recognition of COPD, equally by medical and rehabilitation management. Finding databases, statistics and validated guidelines for COPD management in Malaysia was challenging. Similarly, patients’ responses to our invitation for FGDs were as low as 10%; 3 out of 30 eligible participants have participated. Moreover, the potential participants of this research were elderly, and the elderly-associated frailty and grey digital divide could impose the forthcoming usability testing, feasibility and effectiveness evaluation along with the actual benefit of the app. Therefore, we considered variable inclusion criteria of those participants, such as good cognitive function and ability to use the mobile apps. Additionally, we considered several design principles to facilitate the usability of this app, such as less wordy displays, and high contrast between the white background and the applied colours.
Future work
This work is the design and development of a TR system to provide management for patients with COPD. Development of the ChestCare apps is the first stage of the forthcoming Smart OPEP project 48 as the app will be connected to the Smart OPEP device. Participants will need to deploy the entire system to carry out the PR program, adhering to the regulations and registration requirements for medical devices in Malaysia. According to the consolidated evidence of TR system development, this work should proceed with usability studies, thus identifying ease of use, possible usability difficulties and issues and patients’ satisfaction. Future research should focus on testing the system's effectiveness through feasibility, disease-free cohorts and a clinical efficacy study (RCT).51,141 These studies should also consider the elderly-associated frailty and the grey digital divide. Cross-cultural validation would also be recommended for future research if non-Malaysian users use this system. The future inclusion of artificial intelligence is promising for monitoring and disease management.142,143 However, privacy, security, quality assessment, reproducibility and uncertainty related to artificial intelligence should be considered. 143
Conclusion
In this study, we identified and developed, through the UCD iterative design and by adopting the self-management theory, the essential modules and functionalities to provide PTR services for patients with COPD. We outlined the symptom assessment, lung volume measurement and functional capacity testing. We developed the action plan, breathing exercises, chest clearance and physical activity for intervention. We also outlined the education module, the COPD community, the risk factor monitoring and the reminders. Usability and feasibility testing studies will follow this development study before being available for patients’ use.
Supplemental Material
sj-docx-1-dhj-10.1177_20552076241307476 - Supplemental material for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach
Supplemental material, sj-docx-1-dhj-10.1177_20552076241307476 for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach by Suad J. Ghaben, Arimi Fitri Mat Ludin, Nazlena Mohamad Ali and Devinder Kaur Ajit Singh in DIGITAL HEALTH
Supplemental Material
sj-pdf-2-dhj-10.1177_20552076241307476 - Supplemental material for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach
Supplemental material, sj-pdf-2-dhj-10.1177_20552076241307476 for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach by Suad J. Ghaben, Arimi Fitri Mat Ludin, Nazlena Mohamad Ali and Devinder Kaur Ajit Singh in DIGITAL HEALTH
Supplemental Material
sj-pdf-4-dhj-10.1177_20552076241307476 - Supplemental material for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach
Supplemental material, sj-pdf-4-dhj-10.1177_20552076241307476 for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach by Suad J. Ghaben, Arimi Fitri Mat Ludin, Nazlena Mohamad Ali and Devinder Kaur Ajit Singh in DIGITAL HEALTH
Supplemental Material
sj-docx-5-dhj-10.1177_20552076241307476 - Supplemental material for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach
Supplemental material, sj-docx-5-dhj-10.1177_20552076241307476 for User-centred design of ChestCare: mHealth app for pulmonary rehabilitation for patients with COPD; a mixed-methods sequential approach by Suad J. Ghaben, Arimi Fitri Mat Ludin, Nazlena Mohamad Ali and Devinder Kaur Ajit Singh in DIGITAL HEALTH
Footnotes
Acknowledgements
The authors would like to acknowledge all study participants for their contributions. We thank the managers at the hospital for enabling the organisation of FGDs. We would also like to thank all colleagues involved in the mobile app modules' content validity evaluation and colleagues who facilitated the discussions and data collection.
Authors’ contributions
SG imported the data, analysed the data, prepared the FGD moderator guide and the app prototypes, prepared the content validity document, conducted the FGDs and the meeting with experts and was the primary writer of the manuscript. AFML, NMA and AKAS discussed and agreed on the moderator guide for the FGDs, content analysis document, and all versions of the app prototype and contributed to writing the manuscript. All authors read and approved the final manuscript.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Ethical approval
This study was approved by the Ethics and Research Committee (UKM PP1/111/8/JEP-2022–561).
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Guarantor
AFML.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
