Abstract
Background
People are overloaded with online health information (OHI) of variable quality. eHealth literacy is important for people to acquire and appraise reliable information to make health-related decisions. While eHealth literacy is widely studied in developed countries, few studies have been conducted among patients in low- and middle-income countries (LMICs).
Objective
We aimed to determine the level of eHealth literacy in patients attending a primary care clinic in Malaysia and its associated factors.
Methods
A cross-sectional study using a self-administered questionnaire was conducted in an urban primary care clinic. We used a systematic random sampling method to select patients aged 18 years and above who attended the clinic. The eHealth literacy scale (eHEALS) was used to measure eHealth literacy.
Results
A total of 381 participants were included. The mean eHEALS was 24.4 ± 7.6. The eHEALS statements related to skills in appraising OHI were scored lower than statements related to looking for online resources. Higher education level of attending upper secondary school (AOR 2.53, 95% CI 1.05–6.11), tertiary education (AOR 4.05, 95% CI 1.60–10.25), higher monthly household income of >US$470 (AOR 1.95, 95% CI 1.07–3.56), and those who had sought OHI in the past month (AOR 1.95, 95% CI 1.13–3.36) were associated with a higher eHealth literacy level.
Conclusions
This study found a low eHealth literacy level among primary care patients in Malaysia. While the patients were confident in searching for OHI, they lacked skills in appraising them. Our findings inform the interventions for improving eHealth literacy in LMICs, especially educating the public about OHI appraisal.
Keywords
Introduction
The pattern of health information-seeking has evolved in recent years due to the advancement of digital technology. 1 Traditionally, the public and patients searched and received health information from their healthcare providers, mainstream media, and paper-based patient education materials. With the increased availability and accessibility to the internet, facilitated by the rising use of mobile phones, the internet has become the main source of health information. 2 This change is also observed in low-middle income countries (LMICs); recent studies found that there is a rising prevalence of online health information-seeking and exposure in LMICs, including Malaysia.3–5
eHealth literacy is the ability to access, understand, and appraise health information from electronic sources and apply the knowledge gained to address a health problem. 6 eHealth literacy involves information, scientific, media, and computer literacies in evaluating the user‘s analytic and context-specific skills. 7 It has become an important skill for people to obtain reliable information to make health-related decisions. eHealth literacy has also been shown to enhance the provision of patient-centred care services and improve shared decision-making, 8 promote desirable health behaviour, 9 and improve self-care and health outcomes. 10
While the internet provides an unprecedented opportunity to access health information, the quality of health information on the internet is highly variable and unregulated; this increases the risk of people being misled by misinformation and making erroneous health decisions. Online misinformation has a significant impact on public health; for instance, internet has resulted in a rapid spread of misinformation about COVID-19 vaccines, causing widespread vaccine hesitancy and low vaccine uptake across the world.11–14 Those with low eHealth literacy are more likely to be influenced by internet misinformation, and resulting in making poor health decisions.15–16 Hence, enhancing digital health literacy levels in the population is critical to ensure proper understanding, appraisal and utilisation of online health information, particularly in the current infodemic.
So far, most studies on eHealth literacy were conducted mostly in developed and high-income countries17–19; there is a dearth of information on eHealth literacy in LMICs.20,21 A scoping review on health literacy research in Malaysia revealed only three studies examining media and eHealth literacy. 20 However, these studies focused on media, such as television, rather than internet as the source of information. Yilma et al. 22 examined the eHealth literacy in students but only focused on the searching domain. Therefore, there is a lack of studies in Malaysia to measure eHealth literacy comprehensively in terms of searching, appraising and applying online health information. Also, more research about eHealth literacy is needed to be conducted among patients because the online health information that they encounter would potentially influence their health behaviour. 23 Understanding the current level of eHealth literacy and its associated factors in LMICs is important so that tailored interventions can be designed and implemented in a resource-limited context. Therefore, we aim to determine the eHealth literacy level and its associated factors in patients attending a primary health clinic in Malaysia.
Method
Setting
We conducted a cross-sectional study in an urban outpatient primary care clinic at University of Malaya Medical Centre (UMMC), Kuala Lumpur, Malaysia from June to July 2019. The clinic served an average of 300 patients per day. Ethical approval was granted by the Medical Research Ethics Committee (MREC), University of Malaya Medical Centre (MREC ID No.: 2019227-7175).
Participants
Patients aged 18 years and above who attended the primary care clinic were recruited. We excluded patients who were unable to read Malay, English, or Chinese, and those with cognitive impairment that precluded informed consent and participation in the study.
The sample size was calculated using OpenEpi Version 3. Using high eHealth literacy skill as the primary outcome and the odds ratio of 3.48 from Shiferaw et al., 21 with an α of 0.05 and β of 80%, the estimated sample size was 157. As this study was part of a larger study, which looks at the online health information-seeking behaviour among patients in a primary care clinic, we have used the calculated sample size of 379 from the main study. 4
Study instrument
The study instrument was a self-administered questionnaire, which was developed by the research team based on literature review on eHealth literacy. An expert panel of two family medicine physicians, one public health specialist, and one computer science expert with health informatics knowledge evaluated the questionnaire for content validity.
The first section of the questionnaire captures participants’ demography (age, sex, ethnicity, marital status, educational level, and monthly household income), clinical characteristics (medical illness, long-term medication use, smoking status) and self-rated health status. For educational level, lower secondary school is Form 1–3 (equivalent to Year 7–9 UK education system) while upper secondary school means Form 4-5 (equivalent to Year 10-11 UK education system). We categorised the income groups according to national household income classification in Malaysia i.e., B40 (<US$470), M40 (US$470-950) and T20 (>US$950). 24
The second section captures the participant‘s eHealth literacy level. We used the original English version eHealth Literacy Scale (eHEALS) instrument, 7 which consists of 8 items scored on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). It assesses perceived abilities in finding, evaluating, and applying online health information to health problems. The eHEALS instrument evaluates the functional literacy (basic reading and writing skills to be able to understand health information) and critical literacy (cognitive skills to critically analyse and use the information). 25 The total score for all items ranges from 8 to 40, with higher values indicating a better level of eHealth literacy.
eHEALS has been validated in various languages in Asian countries.26–28 In our study, eHEALS was translated into Malay and Chinese languages following the Principle of Good Practice for Translation and Cultural Adaptation Process guideline. 29 For each of the language translation (Malay and Chinese), two forward translations were performed independently by two native speakers. Reconciliation of forward translations into the final translation was done by an independent native speaker who was not involved in the forward translations. Subsequently, a backward translation was performed by another native speaker who was unaware of the original English version of eHEALS. We conducted face-validation with 15 patients from the same clinic. For the validation of questionnaire internal consistency, the Cronbach alpha of the English, Malay and Chinese versions of eHEALS were 0.961, 0.970, and 0.983, respectively. This indicates a high level of internal consistency and is consistent with the original study‘s Cronbach alpha of 0.88. 7
Data collection
This study employed a systematic random sampling approach. It was estimated that about 300 patients aged 18 years and above attended the clinic every day. The first patient was selected randomly from queue number 1 to 5 every day; this was followed by enrolment of every fifth successive patient who met the criteria. A research assistant explained the study to the patient using a patient information sheet. Patients were given time to read and ask questions before giving a written consent. Once consented, patients were asked to complete the questionnaire.
Data analyses
The Statistical Package for Social Sciences (SPSS) version 23 was used for all statistical analyses. Descriptive statistics were used to describe the demographic data of participants and their eHealth literacy level. Continuous variables were reported using mean and standard deviation (SD) as the data was normally distributed. The categorical data were presented using percentages and frequencies. We divided the total score into two groups based on the mean of the total score (mean = 24.4): those with a high eHealth literacy score (mean ≥24.4) and those with a low eHealth literacy score (mean <24.4), for analysis purposes.
Patients’ demographic, socioeconomic, and technology use characteristics were compared between the low and high eHealth literacy groups using univariate analyses (unadjusted odds ratio). Variables with p-values <0.25 from the univariate analyses were included in the multiple logistic regression model to determine the independent predictors of high eHealth literacy and the results were reported as adjusted odds ratio (95% confidence intervals). A p-value of <0.05 was used as the level of significance.
Result
Out of 450 patients were eligible for the study, 69 declined to participate. Therefore, the response rate was 84.7% (381/450). Table 1 shows the sociodemographic and clinical characteristics of the study population. The mean age of participants was 57.1 ± 16.9 years and 62.7% (n = 239) of them were females. The participants were mainly Chinese (n = 163, 42.8%), followed by Malay (n = 134, 35.2%) and Indian (n = 68, 17.8%). A majority of the participants had at least secondary education (n = 337, 88.5%). Most of the participants had underlying medical illnesses (n = 307, 80.6%) and were taking long-term medications (n = 262, 68.8%). 72.4% (n = 276) of the participants used the internet for an average of 2.38 hours a day.
Sociodemographic characteristics of participants (n = 381).
eHEALS
The mean eHealth literacy score was 24.4 ± 7.6 (range of score: 8–40). Figure 1 shows the eHEALS scores for each statement. The participants achieved a higher score for items on searching for online health information (item 1–3; mean score range 3.14–3.16) but scored lower on the evaluation of the quality of online health information (item 6 & 7; mean score range: 2.91–2.95) and their application for health decision making (item 4, 5 & 8; mean score range: 2.91–3.14).

Extent of agreement and mean scores of eHEALS items.
Predictors of eHealth literacy
The multivariate logistic regression analysis (Table 2) showed that participants who had upper secondary (AOR 2.53, 95% CI 1.05–6.11) or tertiary education (AOR 4.05, 95% CI 1.60–10.25), a higher monthly household income >US$470 (AOR 1.95, 95% CI 1.07–3.56) and sought health information in the past month (AOR 1.95, 95% CI 1.13–3.36) were significantly associated with a higher eHealth literacy level. The logistic regression model was statistically significant, X2(19) = 97.749, p < 0.001. The Nagelkerke R2 was 0.314 and correctly classified 74.7% of the cases. The Hosmer-Lemeshow test with p = 0.968 (>0.05) indicates that the assumption was met, and the model fit. There was no multicollinearity or interaction among the variables.
Univariate and multivariate logistic regression analysis of the predictors of high eHealth literacy.
OR, odds ratio; AOR, adjusted odds ratio; CI, confidence interval.
Adjusted for age, ethnicity, educational level, monthly household income, presence of medical illness, long-term medication use, the need for health information, and sought health information in the past month.
Predictors that are significantly associated with eHealth literacy level after adjusting for confounders (p < 0.05).
Discussion
This study found a low eHealth literacy level among patients in a Malaysian primary care setting. While these patients were able to search for online health information from various online sources, they were not confident in evaluating the quality of health resources and using the information to assist them in decision-making. Those who had a higher eHealth literacy level tend to have a higher educational level, higher household income, and had sought online health information recently.
The eHealth literacy level reported in our study (eHEALS score: 24.4) is lower than those reported in developed countries such as the United States (eHEALS score: 30.34), 30 and Australia (eHEALS score: 27.1). 31 A lower eHealth literacy level in this study is consistent with other eHealth literacy studies conducted in LMICs, such as Ethiopia (eHEALS score: 24.6) 21 and China (eHEALS score: 17.24). 32 The eHealth literacy level in our study population was lower than those of another Malaysian study conducted by Lee et al. 33 (eHEALS score: 27.38) in an inpatient setting. The difference may be attributed to an older population in our study (mean: 57 years) as compared to those by Lee et al. 33 (mean: 47 years). Although the health literacy in Malaysian general population was reported at an acceptable status, 34 there was a high prevalence of limited health literacy among patients with diabetes and asthma,35,36 consistent with our finding of a lower eHealth literacy level. Suboptimal economic strategies such as unavailability of long-term funding and unaffordability of technology in sustaining eHealth implementation is a factor influencing the eHealth literacy in LMICs.37,38 With limited resources for developing and maintaining medical informatics technology, there is a reduction in consumers’ involvement in eHealth and online health information seeking. 39 Lacking of online health information written in the local languages, for example, Malay language in Malaysia, affects people‘s access and understanding of health information in LMICs. 40
In our study, participants were able to search for but were not confident in appraising online health information. These findings were similar to other eHealth literacy surveys, particularly among patients living with chronic obstructive pulmonary disease and patients with cardiovascular risks.33,41 Often, health information from social media, group chats, or websites was unregulated, and this increases the exposure of patients and the public to misinformation. 16 Widespread misinformation and fake news have been shown to threaten public health, especially those involving infectious diseases.42,43 Therefore, there is a need for effective eHealth literacy interventions to improve the knowledge and skills of patients, especially older adults, in evaluating health information, 44 which is necessary to empower patients in making health decisions. 45 For instance, automated credibility appraisal tools may be useful to give signals to people about possible misinformation, 46 and assist people in evaluating the quality of online health information.
Our study suggests that the key predictors of high eHealth literacy were higher educational level, higher monthly household income, and seeking health information in the past month. Higher educational levels have been associated with higher functional health literacy scores.10,21,47 Patients with a higher education background understand health information better, which sharpens their appraisal skills as compared to those with a lower education background. However, several studies in Malaysia and other populations did not find an association between educational level and health literacy.35,48,49 The predictor of high monthly household income was consistent with other studies.21,33 A study has shown that having previously searched for health information online was consistently associated with higher eHealth literacy. 19 This may be explained by the experience that they had acquired while browsing for information which polished their skills in evaluating and using the information to make health decisions. Therefore, eHealth literacy intervention should be focused on people with a lower educational level and poor economic background.
While Tennant et al. 50 found that increasing age predicts lower eHEALS scores in healthy older adults, our result was similar to the original study conducted by Norman et al., 7 where age was not a predictor of eHealth literacy. Increasingly, older people are embracing modern technology, the internet can become a valuable source of health information for the elderly with chronic diseases. It helps to promote healthy behaviour, enhance knowledge, and improve psychological wellbeing. 51 In high-income countries, a study reported that increasing age is correlated with higher eHealth literacy level. 52 Efforts are needed to improve the eHealth literacy of the elderly in LMICs in using digital resources to obtain accurate and reliable health information. 53
Strengths and limitations
This study used a systematic sampling approach to reduce selection bias. In addition, respondents’ age, ethnicity, and socioeconomic status reflect the sociodemographic background of the urban population in Malaysia. However, there are several limitations in this study. Firstly, the findings of this study could not be extrapolated to the Malaysian general population as it was undertaken in a single urban primary care setting. A larger and more diverse sampling from different areas of Malaysia will yield more representative results. Besides, the underlying medical issues and health status of the participants were self-reported data, which may not be as reliable as data collected from medical records due to recall bias.
Implications and recommendations
This study highlights a need to improve the eHealth literacy among primary care patients, especially on how to appraise the credibility of online health information. In clinical practice, we recommend using eHEALS to assess the eHealth literacy of patients, especially for those with a lower educational level and socioeconomic background, who may require more guidance in using digital resources or eHealth interventions. Our study also calls for action from the government agencies, healthcare providers and patient groups to consider an effective approach to curbing negative impact of misinformation by improving public eHealth literacy. Further qualitative research is needed to explore how people appraise and trust online health information, and how it affects their health behaviour.
Conclusion
The eHealth literacy of patients attending the primary care clinic in this study was low as compared to those in high-income countries, particularly in the aspect of information appraisal. This study highlights the need for developing tailored intervention in improving eHealth literacy focusing on the appraisal skills of online health information and those with lower educational levels and poorer economic backgrounds.
Footnotes
Acknowledgements
We thank Dr Lee Kah Hang for his assistance in proofreading and referencing this manuscript. We would like to express our gratitude to the staff of the RUKA primary care clinic, UMMC for their assistance throughout the data collection.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Contributorship
HML and CJN conceptualized and designed the study. SSW, AJZC, FWSC and KCY developed the research tools and conducted data collection. SSW, HML and CHT analyzed the data. SSW drafted the manuscript. HML, CJN, CHT and AA contributed to the writing and critically revised the manuscript. All authors reviewed and edited the manuscript and approved the final version of the manuscript.
Ethical approval
Ethical approval was granted by the Medical Research Ethics Committee (MREC), University of Malaya Medical Centre (MREC ID No.: 2019227-7175).
Funding
The author(s) received no financial support for this research project.
Guarantor
HML
