Sage Journals: Discover world-class research

Abstract

Objective: This study aims to conduct a multidimensional evaluation of non-small cell lung cancer (NSCLC)-related videos on social media platforms in China (TikTok, Bilibili, and Red).

Methods: Validated tools were used to evaluate video quality (DISCERN instrument), reliability (Journal of the American Medical Association [JAMA] benchmarks), understandability, and actionability (Patient Education Materials Assessment Tool [PEMAT]).

Results: This study included 96 videos, primarily created by medical professionals (n = 63). The median DISCERN score was 30.0 (IQR 28.5–34.4), indicating poor quality overall. Compared to videos rated as “good”, the “poor” videos had significantly shorter durations (P = 0.040). The overall median understandability and actionability scores were 81.8% (IQR 75.0–90.9%) and 0% (IQR 0.0–66.7%), respectively, indicating good understandability but extremely poor actionability. Only one met all four JAMA benchmarks. TikTok videos with the shortest durations garnered the highest numbers of “likes”, “comments”, and “bookmarks”, while Bilibili videos exhibited a relatively high overall quality.

Conclusions: To guide the public in making informed medical decisions, Chinese NSCLC videos need improvement in various aspects.

Keywords

non-small cell lung cancer online video quality health information social media

Introduction

Lung cancer is one of the most diagnosed cancers and the leading cause of cancer death around the world.¹ The annual incidence of new lung cancer cases in China is estimated to be around 820,000, causing approximately 710,000 deaths.¹ Among these cases, non-small cell lung cancer (NSCLC) accounts for the majority, comprising approximately 85% of cases.² In recent years, the emergence of novel therapies has significantly prolonged the survival rates among NSCLC patients.^3,4 The concept of the “chronification of non-small cell lung cancer” has been frequently discussed at international lung cancer conferences.^5,6 Especially with the availability of oral targeted therapies in recent years, many NSCLC patients receive treatment at home.⁷ However, this can pose challenges for patients in terms of managing adverse side effects, potentially leading to poor medication compliance and treatment efficacy.⁸ Consequently, there is an urgent need to meet the pressing demand for health education among NSCLC patients.

Internet healthcare applications are the fastest-growing application category among Chinese users in 2022.⁹ An increasing number of patients access relevant health information via the Internet.¹⁰ In China, 25% to 65% of patients have searched for health-related information online.^11–13 As an emerging medium, video can break the barriers of health knowledge dissemination with the help of various technical means and enhance the effect of information dissemination.¹⁴ The rise of online video and short video platforms has brought significant development opportunities for the production and dissemination of patient education materials.¹⁴ During the recent pandemic, videos related to COVID-19 on the short video platform TikTok collectively received 93.1 billion views.¹⁵ Video platforms are increasingly gaining popularity in disease management, serving as crucial channels for disseminating video-based patient education materials encompassing disease prevention, diagnosis, and treatment.^16–18

The video platforms TikTok, Bilibili, and Red all hold significant positions in the social media landscape of China.¹⁹ These platforms have achieved notable success across different domains, and their user base spans various age groups and social identities in China.^20–22 They have, therefore, become increasingly popular channels for disseminating health information. However, due to the absence of restrictions and thorough scrutiny of health education videos shared on online social platforms, various issues may arise, such as the lack of depth and reliability of the health information content, potentially misleading patients and negatively impacting their medical decision-making.^23–25 Therefore, assessing the quality of video-based patient education materials and exploring existing issues with this medium can provide strategies for creators to produce higher-quality health education content. However, to the best of our knowledge, there has been no previous multidimensional analysis of the quality of video content related to non-small cell lung cancer. To address this gap, our study aims to assess the quality of educational videos about NSCLC on three platforms: TikTok, Bilibili, and Red.

Methods

Video selection

This study is a cross-sectional analysis evaluating the quality of Chinese NSCLC-related videos from multiple dimensions. The term “非小细胞肺癌” (“non-small cell lung cancer” in Chinese) was searched on three social media platforms [i.e., Tiktok, Bilibili, and Red] on March 26, 2023. To minimize the influence of algorithmic recommendations, this study used newly created accounts on all three video platforms. Searches on TikTok and Bilibili were conducted on a computer using a web browser, while RED searches were done via the mobile app, as its web version does not support search functionality. The search results on TikTok and Bilibili were consistent between the web browser and the mobile app using the new accounts. The top 60 videos resulting from this search were collected in default order (most users only browse the first two pages of search results).^26,27 Videos meeting the following criteria were excluded: not related to NSCLC (e.g. videos exclusively about small cell lung cancer), not intended for patients (e.g. research progress, news about drug launches), non-video content (such as images and text), duplicate videos, non-Chinese videos (neither the audio nor the subtitles are in Chinese), and advertising videos. Figure 1 presents our video selection process.

Figure 1.

Flowchart describing the video selection process.

We collected the features and sources of all included videos, including video links, publication dates, number of likes, bookmarks, and comments; and video duration. The video publishers were categorized into four groups: medical professionals, individuals, news agencies, and organizations.

Content coverage and completeness

Following the “Oncology Society of Chinese Medical Association guideline for clinical diagnosis and treatment of lung cancer (2021 Edition)”²⁸ and “Internal Medicine (10th Edition)”,²⁹ a content checklist for video webpages was developed, covering six aspects: definition, risk factors, symptoms, examination items, disease management, and outcomes (Table 1). Following the scoring model proposed by Goobie,³⁰ we assigned scores within a range of 0–2 points, wherein a score of 0 indicated “no relevant content covered”, 1 point indicated “partial content covered”, and 2 points indicated “detailed and complete content”. Coverage rate is defined as the percentage of videos that received a score of 1 or 2 for a specific information type, indicating the proportion of videos that touched on the content but lacked detail and completeness. Completeness, on the other hand, is defined as the percentage of videos that received a score of 2 for that information type, representing the proportion of videos that provided a detailed and complete explanation of the content.

Table 1.

Evaluation criteria for content coverage and completeness of non-small cell lung cancer-related videos.

Category	Criteria
Definition	Primary bronchogenic carcinoma, primary bronchial lung cancer
	Originates from malignant tumors in respiratory epithelial cells (bronchi, bronchioles, and alveoli)
	Categorized into small cell lung cancer and non-small cell lung cancer
Risk factors	Smoking, occupational exposure to carcinogens (asbestos, arsenic, and radioactive substances like uranium and radium), air pollution, ionizing radiation, dietary and physical factors, genetics, and other contributors such as chronic lung diseases, viral infections, and fungal toxins
Signs/Symptoms	Tumor size, type, stage of development, location, presence of complications, or metastasis
Signs/Symptoms	Cough, hemoptysis, shortness of breath, wheezing, chest pain, fever, weight loss, hoarseness, difficulty swallowing, pleural effusion, pericardial effusion, superior vena cava obstruction syndrome, Horner syndrome, and various symptoms caused by distant metastasis
Examination	Imaging (X-ray, CT, MRI)
	Pathology (sputum cytology, pleural fluid cytology, bronchoscopy, needle biopsy, thoracotomy)
	Tumor marker assessment (carcinoembryonic antigen, neuron-specific enolase, cytokeratin 19)
Management	Surgery, radiation therapy, chemotherapy, targeted therapy, immunotherapy, interventional procedures, palliative care, symptomatic relief, and traditional Chinese medicine
Outcomes	Improvement, tumor progression, or death

X-ray: X-ray radiography; CT: computed tomography; MRI: Magnetic Resonance Imaging.

Quality

Video quality was evaluated using the DISCERN instrument.³¹ Although it was originally designed for evaluating written materials,^31,32 it has been widely adopted to evaluate health-related videos.^33–36 DISCERN is a validated tool that consists of 16 questions, of which questions 1–8 evaluate reliability, questions 9–15 evaluate the quality of information, and question 16 is an independent rating of the overall quality (Table S1). Each question is rated from 1 to 5 (1 = not at all; 2–4 = partially; 5 = completely). Higher total DISCERN scores indicate higher quality information on the following scale: excellent (80–63), good (62–51), fair (50–39), poor (38–27), and very poor (26–16).³⁷

Understandability and actionability

Understandability and actionability were evaluated using the Patient Education Materials Assessment Tool (PEMAT³⁸). Understandability refers to patient education materials being clear enough for individuals from diverse backgrounds and varying levels of health literacy to grasp and explain key messages. Actionability means that patient education materials allow consumers with diverse backgrounds and health literacy levels to determine specific actions they can take based on the information provided. Specifically, there are 13 items measuring understandability and 4 items measuring actionability (Table S2-3).³⁸ For each item, “agree” was scored as 1, “disagree” was scored as 0, and “not applicable” was labeled with “NA”. The final score was converted to a percentage.

Reliability

Reliability is defined as the perception by both consumers and professionals that the information is credible, reasonable, or useful, enabling them to make informed decisions on how to apply it in real-world situations.³⁹ To evaluate the reliability of the videos, we referred to the Journal of the American Medical Association (JAMA) benchmarks.³⁹ The JAMA benchmarks assess the reliability of medical information on the Internet based on four core standards: authorship, attribution, disclosure, and currency (Table S4). The score ranges from 0 (no criteria fulfilled) to 4 (all criteria fulfilled).

Statistical analysis

Two independent researchers with extensive oncological clinical pharmacy practice experience (YX and XF) evaluated the quality, reliability, understandability, and actionability of the selected videos, the final score was averaged. Kappa analysis was used to assess inter-rater agreement, with Kappa coefficients (κ) greater than 0.80, indicating strong agreement.⁴⁰ Continuous variables were reported as the median and interquartile range (IQR), while nominal variables were expressed as frequencies and percentages. The analysis between groups was performed using the Kruskal-Wallis test and Bonferroni adjustment.^41,42 Two-sided significance testing was used, and differences were considered significant at the p < 0.05 level. All statistical analyses were performed with IBM SPSS Statistics for Windows, version 25.0 (IBM Corp).

Results

Characteristics of included videos

In total, 96 videos were included in our study, including 48 on TikTok, 13 on Bilibili, and 35 on RED (Table S5). Table 2 shows the details of the video characteristics. More than half of the videos were posted by medical professionals (66%), with similar numbers for the other three categories. The duration ranged from 8 to 372 s, with a median length of 59 s. The median duration of videos on Bilibili was 208 s, which is about four times that of TikTok videos and three times that of RED videos (p < 0.001). The median duration of videos posted by medical professionals was 48 s, significantly shorter than that of the other three publisher categories (p < 0.001). As of the data collection date, the selected 96 videos had received a total of 318,576 likes, 11,114 bookmarks, and 3365 comments. The videos obtained through TikTok had the highest number of likes, bookmarks, and comments. The median number of days the videos had been posted is 265.5 days, with the earliest video having been posted on December 8, 2018.

Table 2.

Video characteristics.

Variables	Likes	Bookmarks	Comments	Days since upload (days)	Duration (seconds)
Video platform, median (IQR)
Tiktok (n = 48)	397.5(73.3–851.0)	42.5(8.3–129.8)	21(3.3–60.3)	332.5(106.8–546.0)	48.5(36.0–94.0)
Bilibili (n = 13)	10(5.0–22.0)	13(9.0–32.5)	1(0.0–1.5)	450(308.0–598.0)	208(101.5–317.0)
Red (n = 35)	6(2.0–19.0)	3(1.0–20.0)	0(0.0–2.0)	141(96.0–248.0)	70(42.0–106.0)
p	<.001^a	<.001^b	<.001^c	.070^d	<.001^e
Publisher, median (IQR)
Medical professionals (n = 63)	85(5.0–602.0)	16(2.0–74.0)	4(0.0–38.0)	181(75.0–369.0)	48(35.0–64.0)
Individuals (n = 12)	8.5(5.3–30.0)	19.5(2.3–32.8)	0(0.0–2.0)	442.5(134.3–542.5)	241(121.5–326.3)
News agencies (n = 10)	28.5(9.8–128.5)	26.5(5.5–57.8)	2(0.8–16.3)	345(78.5–1296.3)	163.5(105.3–200.0)
Organizations (n = 11)	11(5.0–19.0)	10(6.0–29.0)	1(0.0–4.0)	283(141.0–643.0)	91(67.0–163.0)
p	.172	.881	.029^f	.077	<.001^g
Total (n = 96)	26.5(6.0–401.5)	16(3.0–59.3)	2(0.0–21.0)	265.5(103.5–447.3)	59(39.0–147.3)

^aCompared with Red, p < .001.

^bCompared with Red, p < .001.

^cCompared with Bilibili and Red, p < .001 and < .001, respectively.

^dCompared with Red, p = .011.

^eCompared with Tiktok and Red, p < .001 and < .001, respectively.

^fCompared with individuals, p = .039.

^gCompared with individuals and news agencies, p < .001 and < .001, respectively.

Content coverage and completeness

The included videos covered six pre-defined content items to varying degrees, as depicted in Figure 2. The results indicate that two-thirds of the videos (67.7%) addressed disease management. The second most frequently covered topic was the definition of non-small cell lung cancer (38.5%). The least frequently covered topic was risk factors, with only 12 videos (12.5%) addressing this aspect. Among the included videos, disease management videos had the highest completeness (15.6%), while the content type with the lowest completeness was disease outcomes, with only two videos offering complete disease outcome content.

Figure 2.

Percentage stacked chart of video content coverage and completeness scores.

Quality

The DISCERN scores for video quality are presented in Table 3, showing that about 16% of videos were rated as “very poor,” the majority of the videos (74%) were rated as “poor”, 7% were rated as “fair,” and 3% were rated as “good.” No videos reached the standard of “excellent” quality. The interrater agreement of DISCERN sore was strong (κ = 0.813). There was a statistically significant difference in the duration of videos across different quality levels (p = 0.040), while no statistical differences were observed in the number of likes, bookmarks, and comments. The duration of videos rated as “good” was longer than that of those rated “very poor” and “poor” (p = 0.020 and p = 0.037, respectively).

Table 3.

Distribution of DISCERN classification according to video features.

	Very poor (<27)	Poor (27-38)	Fair (39-50)	Good (51-62)	Excellent (63-80)	p
Video features, median (IQR)
Duration (s)	53(35.0–73.0)	58(39.0–110.0)	162(91.0–172.0)	364^a	/	0.040
Number of likes	19(3.0–190.0)	30(5.0–595.0)	21(11.0–404.0)	7	/	0.473
Number of bookmarks	9(3.0–29.0)	13(2.0–89.0)	16(9.0–135.0)	32	/	0.335
Number of comments	4(0.0–12.0)	3(0.0–34.0)	2(1.0–21.0)	0	/	0.165
Number of videos, n (%)	15(17)	71(74)	7(7)	3(3)	0(0)	/

^aCompared with “Very poor” and “Poor”, p = .020 and p = .037, respectively.

The distribution of quality ratings based on video characteristics and publisher identity is outlined in Table 4, with a median overall DISCERN quality score of 30.0 (IQR, 28.5–34.4) for the included 96 videos, indicating a generally poor overall quality. Videos sourced from Bilibili achieved the highest quality scores, significantly surpassing the quality scores from videos on Red (p = 0.020). Among videos from different publishers, those originating from news agencies had the highest median quality scores, followed by those made by individual users, with both surpassing the scores of those created by medical professionals.

Table 4.

Comparison of quality, understandability, and actionability.

Variable	Quality (DISCERN)	Understandability (PEMAT-A/V, %)	Actionability (PEMAT-A/V, %)
Video platform, median (IQR)
Tiktok	30(28.5–34.4)	87.5(78.0–100.0)^b	0(0.0–50.0)
Bilibili	38(28.8–45.8)^a	77.3(65.9–81.8)	33.3(0.0–79.2)
Red	29.5(26.5–33.0)	80(68.8–90.0)	33.3(0.0–66.7)
p	.025	.004	.043
Publisher
Medical professionals	29.5(27.5–31.5)^c	85.7(75.0–100.0)	0(0–33.3)^d
Individuals	34.5(29.6–48.1)	76.1(60.2-81.8)	66.7(16.7-81.3)
News agencies	35.5(31.8–41.8)	83.4(78.2–90.9)	33.3(0–71.9)
Organization	33.5(28.5–35.5)	77.3(72.7–90.0)	33.3(0–66.7)
p	<.001	.128	.01
Total	30(28.5–34.4)	81.8(75.0–90.9)	0(0.0–66.7)

^aCompared with Red, p = .025.

^bCompared with Bilibili, p = .007.

^cCompared with individuals and news agencies, p = .015 and p = .030, respectively.

^dCompared with individuals, p = .080.

Understandability and actionability

The PEMAT scores for video understandability and actionability are presented in Table 4. The median overall understandability score for the included 96 videos was 81.8% (IQR, 75.0–0.9%), while the median overall actionability score was 0.0% (IQR, 0.0–66.7%). The interrater agreements of the PEMAT score were strong (κ = 0.835[understandability], 0.934[actionability]). This result indicates that the included videos had relatively high understandability but poor actionability. Notably, we observed that videos posted on TikTok had higher understandability scores than those posted on Bilibili (p = 0.007). Additionally, videos published by individual users demonstrated higher actionability than those published by medical professionals (p = 0.080).

Reliability

The number of videos meeting different JAMA benchmark criteria is illustrated in Figure 3. The interrater agreement of JAMA sore was strong (κ = 0.922). All included videos met the criterion of having a visible publication date or update date. Furthermore, 65% of the videos provided author information, while 5% and 15% of the videos indicated information attribution and disclosure information, respectively. Among the 96 videos, only a single video met all four JAMA benchmark criteria, while the majority of videos (56%) complied with two JAMA benchmark criteria. In videos published by medical professionals, 71% disclosed their identity information. The JAMA score of videos posted by news agencies was the highest, significantly exceeding that of videos posted by medical professionals (p = 0.002) and individual users (p = 0.012). This can be primarily attributed to the fact that news organizations predominantly disclose information in their videos (Table 5).

Figure 3.

JAMA scores of included videos. Percentage stacked chart of video JAMA scores (left). Percentages of videos that met 0–4 JAMA benchmark (right).

Table 5.

Reliability score.

	Number of JAMA benchmarks n (%)				Reliability score median (IQR)
	Authorship	Attribution	Disclosure	Currency	Reliability score median (IQR)
Total	62(65)	5(5)	14(15)	96(100)	2(1.0-2.0)
Video platform
TikTok (n = 48)	36(75)	0(0)	8(17)	48(100)	2(1.3–2.0)
Bilibili (n = 13)	6(46)	3(23)	2(15)	13(100)	2(1.0–2.0)
Red (n = 35)	20(57)	2(6)	4(11)	35(100)	2(1.0–2.0)
p	-	-	-	-	.463
Publishers
Medical professionals (n = 63)	45(71)	0(0)	0(0)	63(100)	2(1.0–2.0)
Individuals (n = 12)	3(25)	4(33)	2(17)	12(100)	1.5(1.0–2.0)
News agencies (n = 10)	8(80)	0(0)	8(80)	10(100)	3(2.5–3.0)^a
Organizations (n = 11)	6(55)	1(9)	4(36)	11(100)	2(1.0-3.0)
p	-	-	-	-	.003

^aCompared with medical professionals and individuals, p = .002 and p = .012, respectively.

Discussion

The Internet is one of the main sources of health information for many patients.⁴³ Several studies have validated its importance in patients’ decision-making and clinical outcomes.^44–46 Given the increasing complexity of NSCLC treatment options, patients are increasingly turning to social media platforms to seek assistance in supplementing unmet information needs. Videos offer an intuitive way of presenting information, making medical concepts more vivid and easily understandable. Many healthcare professionals, doctors, scientists, and institutions have started utilizing video platforms to convey health information to the public.^47,48 Videos on social media platforms play an increasingly important role in health education. We selected three influential social media platforms in China and evaluated the selected videos in terms of content completeness, quality, reliability, actionability, and understandability. This study is the first to conduct both qualitative and quantitative evaluations of NSCLC-related online videos, providing a foundation for improving patient education materials while offering insights into enhancing health information dissemination.

Major findings

The number of likes, comments, and bookmarks on social media platforms partly reflects the popularity of videos or posts.^49,50 We observed that the videos on TikTok garnered more likes, bookmarks, and comments compared to the other two video platforms. As of the data collection cutoff, there were 13 videos published in the past month, eight on TikTok, two on Bilibili, and three on Red. Notably, TikTok had a higher frequency of video updates, indicating its significant impact on NSCLC health education in China. This could be attributed to the fragmented and timely nature of TikTok videos, which aligns well with the fast-paced lifestyles of modern individuals.⁵¹ Particularly in terms of conveying concise and engaging health knowledge, many medical professionals and health experts utilize the short video format of TikTok to disseminate health information. Additionally, as of September 2023, TikTok’s monthly active users reached 743 million, significantly surpassing Bilibili’s 210 million and Red’s 199 million.⁵² This difference in user base further explains the higher engagement. The combination of its vast audience and algorithmic content delivery strengthens the reach and impact of health-related videos.

When analyzing publishers grouped by their identities, it was found that over half (66%) of the videos were published by medical professionals. These videos garnered the highest number of comments, suggesting a greater trust from the public towards professionals when seeking health information online. The interactivity of video platforms enables the public to ask questions, leave comments, and share personal experiences, fostering closer connections between doctors and patients or the general public.

The content categories with the highest coverage and completeness were both related to disease management, while the content category with the lowest coverage was risk factors, and the content category with the lowest completeness was disease outcomes. NSCLC often manifests subtly, with approximately 75% of patients being diagnosed at an advanced stage of illness, highlighting low awareness of the importance of early screening among patients.⁵³ Current NSCLC patient education materials in video format frequently overlook descriptions of risk factors, examination items, and similar aspects, thus making it challenging to contribute to disease prevention and enhanced public awareness of screening. Among the 96 included videos, only two provided comprehensive descriptions of NSCLC outcomes, likely due to prognostic complexity. Limited video duration constrains comprehensive coverage.

The overall DISCERN score for the videos was low, indicating poor quality overall. A group analysis based on different DISCERN score levels revealed that higher-scoring videos tended to be longer. However, these scores showed no correlation with video likes, comments, or bookmarks, suggesting that dissemination and impact were not directly related to video quality. This indicates a lack of discernment among the public regarding the quality of health education videos and underscores the importance of guiding the public to be able to recognize high-quality health information. Simultaneously, we found that among videos from different publisher identities, those from medical professionals had lower DISCERN scores compared with videos from other identity sources and that videos published by medical professionals were shorter. This finding aligns with results from some prior studies.^54,55 One possible explanation for this result is that DISCERN emphasizes the importance of treatment options, suggesting that patient education materials should include detailed descriptions of treatment plans to assist patients in making informed treatment decisions. Medical professionals, especially clinical doctors, often publish series of educational videos on respiratory medicine on platforms for an extended period. They tend to release multiple videos under the same topic, with each video addressing only one issue, such as “How to detect non-small cell lung cancer early?” or “Advanced non-small cell lung cancer: Targeted therapy or chemotherapy?” As a result, the duration of individual videos is relatively short, with limited coverage of treatment-related information or none at all. Similarly, the higher quality of videos on Bilibili may be attributed to longer durations, which tend to be more comprehensive. In contrast, Red’s content leans towards personal health experiences and insights into disease treatment, with a lower tendency to offer systematic treatment descriptions. This leads to lower DISCERN scores for videos on this platform.

The overall understandability of the 96 included videos was relatively high, with TikTok videos showing even higher levels, likely due to their rich visual content. These videos often utilize bold text, arrows, boxes, and emphasized fonts, coupled with clear Chinese subtitles, to attract viewers’ attention. However, the overall level of actionability for the included videos was low, indicating a significant shortfall in terms of providing practical guidance in the current NSCLC-related health education videos available in China.

All included videos provided a publication time or update time, assisting patients in determining the latest content. Over half of the videos (66%) were published by individuals identified as medical professionals, yet only 71% of those from medical professionals disclosed specific identity information (name and affiliated institution). TikTok, Bilibili, and Red lacked functionalities to verify and authenticate user information, making information about publishers unreliable and raising concerns about potential impersonation of medical professionals and dissemination of misinformation, contributing to the spread of rumors and inaccurate information.

Possible interventions

The general public faces challenges in distinguishing the authenticity and accuracy of medical video content. Currently, implementing policies and regulatory mechanisms to prevent the spread of false information poses some difficulties. However, video platforms can enhance the credibility of science communication videos by verifying the professional identity of video creators and introducing certification symbols. Simultaneously, health professionals, scientists, and institutions delivering health education via video platforms are encouraged to introduce themselves in the videos and provide corresponding evidence to enhance video reliability.

Providers of medical information and education should focus more on disseminating knowledge about disease prevention, including information on risk factors and early screening, when creating NSCLC videos. This helps raise public awareness of disease prevention methods and early screening opportunities for NSCLC. Additionally, using visual aids, breaking down content into more easily digestible main points, employing simple and understandable language, and incorporating clear voiceovers and subtitles can make abstract and complex medical concepts more accessible. Finally, presenting clear and actionable suggestions in videos, along with providing detailed step-by-step descriptions, enhances the feasibility of the recommendations provided, guiding the public toward making more informed medical decisions.

Limitations and future research

This study has several limitations. First, some videos meeting the inclusion and exclusion criteria might not have appeared within the top 60 search results. Our results, thus, might not reflect the whole situation of all NSCLC video information. However, people prefer to read websites that appear in the first several pages of search results. Second, although we collected relevant videos from specific dates and locations, the search results on social platforms may still change over time. Third, this study only evaluated Chinese video platforms, and future research could assess English video platforms (such as YouTube) for a more comparative analysis. This would provide a broader perspective on the quality of NSCLC-related health education videos across diverse audiences. Furthermore, future studies could also evaluate the actual impact of these videos on public health behaviors, such as raising awareness about early screening or improving medical decision-making.

Conclusion

After a comprehensive evaluation of videos related to NSCLC, we found that medical professionals are the main contributors to relevant content. While NSCLC-related videos on TikTok, Bilibili, and Red exhibit good understandability, they fall short in completeness, quality, and actionability, with room for improvement regarding reliability. Notably, higher-quality videos tend to be longer, contrary to the shorter and relatively lower-quality videos often published by medical professionals, deviating from expectations. Considering the increasing importance of Internet videos in health education, ensuring public access to high-quality videos is crucial for aiding them in making more informed medical decisions regarding NSCLC treatment.

Supplemental Material

Supplemental Material - Assessment of non-small cell lung cancer online videos in China: A cross-sectional study on quality, content, understandability, actionability, and reliability

Supplemental Material for Assessment of non-small cell lung cancer online videos in China: A cross-sectional study on quality, content, understandability, actionability, and reliability by Xiaoqing Feng, Yuhui Xu, Yi Yang, Yifan Zheng and Jia Li in Health Informatics Journal

Footnotes

ORCID iD

Xiaoqing Feng

Statements and declarations

Author contributions

Conceptualization, XF, YX and JL; Data curation, XF and YX; Methodology, YZ and YX; Writing - original manuscript, XF; Writing-review & editing, YZ, JL and YY; Supervision, JL and YY.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by the PSM Guangdong Pharmacy Popular Science Research Fund 2022KP88.

Conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Supplemental Material

Supplemental material for this article is available online.

References

Sung

Ferlay

Siegel

, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2021; 71: 209–249.

Zappa

Mousa

. Non-small cell lung cancer: current treatment and future advances. Transl Lung Cancer Res 2016; 5: 288–300. DOI: 10.21037/tlcr.2016.06.07.

Garon

Hellmann

Rizvi

, et al. Five-year overall survival for patients with advanced non‒small-cell lung cancer treated with pembrolizumab: results from the phase I KEYNOTE-001 study. J Clin Oncol 2019; 37: 2518–2527.

Coleman

. Metastatic bone disease: clinical features, pathophysiology and treatment strategies. Cancer Treat Rev 2001; 27: 165–176.

Bratova

Karlinova

Skrickova

, et al. Non-small cell lung cancer as a chronic disease - a prospective study from the Czech TULUNG registry. In Vivo 2020; 34: 369–379.

Hirsh

. Turning EGFR mutation-positive non-small-cell lung cancer into a chronic disease: optimal sequential therapy with EGFR tyrosine kinase inhibitors. Ther Adv Med Oncol 2018; 10: 1758834017753338.

Gong

, et al. Retrospective study of EGFR-mutant lung adenocarcinoma with bone metastatic clinical features. Cancer Rep 2023; 6: e1628.

Wood

. A review on adherence management in patients on oral cancer therapies. Eur J Oncol Nurs 2012; 16: 432–438.

Center CINI . The 51st statistical report on Internet development in China. https://www.cnnic.net.cn/n4/2023/0302/c199-10755.html (2023, accessed 02 March 2023).

10.

Gee

Greenwood

Paterniti

, et al. The eHealth enhanced chronic care model: a theory derivation approach. J Med Internet Res 2015; 17: e86.

11.

Zhou

, et al. Web-based medical information searching by Chinese patients with breast cancer and its influence on survival: observational study. J Med Internet Res 2020; 22: e16768.

12.

Liu

Zhang

, et al. Internet usage for health information by patients with epilepsy in China. Seizure 2013; 22: 787–790.

13.

, et al. Internet and WeChat used by patients with Crohn’s disease in China: a multi-center questionnaire survey. BMC Gastroenterol 2019; 19: 97.

14.

Rus

Cameron

. Health communication in social media: message features predicting user engagement on diabetes-related Facebook pages. Ann Behav Med 2016; 50: 678–689.

15.

Ostrovsky

Chen

. TikTok and its role in COVID-19 information propagation. J Adolesc Health 2020; 67: 730.

16.

Kong

Song

Zhao

, et al. TikTok as a health information source: assessment of the quality of information in diabetes-related videos. J Med Internet Res 2021; 23: e30409.

17.

Madathil

Rivera-Rodriguez

Greenstein

, et al. Healthcare information on YouTube: a systematic review. Health Inf J 2015; 21: 173–194.

18.

Wang

, et al. The current state of vascular surgery presence in Bilibili video platform of China. Front Surg. 2022; 9: 874113. DOI: 10.3389/fsurg.2022.874113.

19.

Tiktok and Kuaishou are among the top 10 short video platforms. https://www.sohu.com/a/783719478_121901402

20.

Zhao

. Visual-audio correspondence and its effect on video tipping: evidence from Bilibili vlogs. Inf Process Manag 2023; 60: 103347.

21.

Fung

. Douyin, storytelling, and national discourse. Int Commun Chin Cult 2022; 9: 139–147.

22.

Wang

Huang

Liu-Lastres

. Impact of user-generated travel posts on travel decisions: a comparative study on Weibo and Xiaohongshu. Ann Tour Res Empir I 2022; 3: 100064.

23.

Meteran

Hoj

Sigsgaard

, et al. The usefulness of YouTube videos on lung cancer. J Public Health 2023; 45: e339–e345.

24.

Barahona-Correa

Romero-Alvernia

Rueda-Ortiz

, et al. Social media as source of information for Spanish-speaking patients with systemic lupus erythematosus. Lupus 2022; 31: 953–962.

25.

Pratsinis

Babst

Langenauer

, et al. Qualitative assessment of medical information on YouTube: a multilingual comparison of common urological conditions. Urol Int 2021; 105: 757–763.

26.

Dutta

Beriwal

Van Breugel

, et al. YouTube as a source of medical and epidemiological information during COVID-19 pandemic: a cross-sectional study of content across six languages around the globe. Cureus 2020; 12: e8622.

27.

Birch

Leziak

Jackson

, et al. Content quality of YouTube videos about gestational diabetes: systematic evaluation. JMIR Diabetes 2022; 7: e30156. DOI: 10.2196/30156.

28.

Oncology Society of Chinese Medical A and Chinese Medical Association Publishing H . [Oncology Society of Chinese Medical Association guideline for clinical diagnosis and treatment of lung cancer (2021 edition)]. Zhonghua Zhong Liu Za Zhi 2021; 43: 591–621.

29.

Gek Junbo

Wang

. Internal medicine. 10th ed. Beijing, China: The People’s Health Press, 2023.

30.

Goobie

Guler

Johannson

, et al. YouTube videos as a source of misinformation on idiopathic pulmonary fibrosis. Ann Am Thorac Soc 2019; 16: 572–579.

31.

Charnock

Shepperd

Needham

, et al. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health 1999; 53: 105–111.

32.

Kaicker

Borg Debono

Dang

, et al. Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument. BMC Med 2010; 8: 59.

33.

Brissette

Alnaki

Garfinkle

, et al. The quality, suitability, content and readability of online health-related information regarding sexual dysfunction after rectal cancer surgery. Colorectal Dis 2021; 23: 376–383.

34.

Yang

Xue

Shi

, et al. The reliability, functional quality, understandability, and actionability of fall prevention content in YouTube: an observational study. BMC Geriatr 2022; 22: 654.

35.

Ozdemir

Diren

Boyali

, et al. Metric evaluation of reliability and transparency of the videos about carpal tunnel syndrome surgery in the online platforms: assessment of YouTube videos' content. Neurospine 2021; 18: 363–368.

36.

Kwak

Park

Won

, et al. Quality and reliability evaluation of online videos on carpal tunnel syndrome: a YouTube video-based study. BMJ Open 2022; 12. e059239.

37.

Olkun

Demirkaya

. Evaluation of Internet information about lingual orthodontics using DISCERN and JAMA tools. Turk J Orthod 2018; 31: 50–54.

38.

Shoemaker

Wolf

Brach

. Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ Couns 2014; 96: 395–403.

39.

Silberg

Lundberg

Musacchio

. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. JAMA 1997; 277: 1244–1245.

40.

McHugh

. Interrater reliability: the kappa statistic. Biochem Med 2012; 22: 276–282.

41.

Zhang

Han

Tang

, et al. Popular science and education of cosmetic surgery in China: quality and reliability evaluation of Douyin short videos. Health Expect 2023; 26: 1221–1226.

42.

Wang

Yao

Wang

, et al. Bilibili, TikTok, and YouTube as sources of information on gastric cancer: assessment and analysis of the content and quality.

43.

Prestin

Vieux

Chou

WYS

. Is online health activity alive and well or flat lining? Findings from 10 years of the health information national trends survey. J Health Commun 2015; 20: 790–798.

44.

Eysenbach

. The impact of the Internet on cancer outcomes. Ca-Cancer J Clin. 2003; 53: 356–371. DOI: 10.3322/canjclin.53.6.356.

45.

Sullivan

Anderson

Ahn

, et al.

Can Internet information on vertebroplasty be a reliable means of patient self-education?

Clin Orthop Relat R 2014; 472: 1597–1604.

46.

Ryhänen

Rankinen

Siekkinen

, et al. The impact of an empowering Internet-based Breast Cancer Patient Pathway program on breast cancer patients’ clinical outcomes: a randomised controlled trial. J Clin Nurs 2013; 22: 1016–1025.

47.

Han

Shi

. Assessment of videos related to lung nodules in China. Front Surg 2022; 9: 1019212. DOI: 10.3389/fsurg.2022.1019212.

48.

Eghtesadi

Florea

. Facebook, Instagram, Reddit and TikTok: a proposal for health authorities to integrate popular social media platforms in contingency planning amid a global pandemic outbreak. Can J Public Health 2020; 111: 389–391.

49.

Sabate

Berbegal-Mirabent

Cañabate

, et al. Factors influencing popularity of branded content in Facebook fan pages. Eur Manag J 2014; 32: 1001–1011.

50.

Carr

2nd Thomas

, et al. Trends in patient, physician, and public perception of ulnar collateral ligament reconstruction using social media analytics. Orthop J Sports Med 2021; 9: 2325967121990052.

51.

Song

Zhao

YXC

Yao

, et al. Short video apps as a health information source: an investigation of affordances, user experience and users’ intention to continue the use of TikTok. Internet Res 2021; 31: 2120–2142. DOI: 10.1108/Intr-10-2020-0593.

52.

QuestMobile 2023 new media ecosystem insights. https://www.digitaling.com/articles/1005199.html

53.

Marcus

Doria-Rose

Gareen

, et al.

Did death certificates and a death review process agree on lung cancer cause of death in the national lung screening trial?

Clin Trials 2016; 13: 434–438.

54.

Sun

Zheng

. Quality of information in gallstone disease videos on TikTok: cross-sectional study. J Med Internet Res 2023; 25: e39162.

55.

Bai

, et al. Quality of Internet videos related to pediatric urology in mainland China: a cross-sectional study. Front Public Health 2022; 10: 924748. DOI: 10.3389/fpubh.2022.924748.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.60 MB

Assessment of non-small cell lung cancer online videos in China: A cross-sectional study on quality,content,understandability,actionability,and reliability

Abstract

Keywords

Introduction

Methods

Video selection

Content coverage and completeness

Quality

Understandability and actionability

Reliability

Statistical analysis

Results

Characteristics of included videos

Content coverage and completeness

Quality

Understandability and actionability

Reliability

Discussion

Major findings

Possible interventions

Limitations and future research

Conclusion

Supplemental Material

Supplemental Material - Assessment of non-small cell lung cancer online videos in China: A cross-sectional study on quality, content, understandability, actionability, and reliability

Footnotes

ORCID iD

Statements and declarations

Author contributions

Funding

Conflicting interests

Supplemental Material

References

Supplementary Material