Abstract
Objective
This study evaluated the information quality and user engagement of osteoporosis-related videos on Bilibili and TikTok, and examined their associations with uploader characteristics, content topics, and video quality factors.
Methods
On October 11, 2025, we conducted a systematic evaluation of the information quality and reliability of the top 100 Chinese-language short videos related to osteoporosis on TikTok and BiliBili platforms, ultimately including 171 valid videos for analysis. Using the Global Quality Scale (GQS) and a modified DISCERN instrument, we assessed multiple dimensions of video content. Furthermore, Spearman correlation analysis and the Kruskal-Wallis test were employed to examine how platform type, uploader category, and content characteristics influence video quality.
Results
A total of 171 videos were included in the analysis, comprising 82 from Bilibili and 89 from Tiktok. Bilibili videos exhibited significantly longer durations compared to Tiktok videos (median 307.5 seconds vs. 151.0 seconds; P < 0.001). Conversely, Tiktok videos demonstrated significantly higher user engagement metrics, including median number of likes (3407.0 vs. 65.0; P < 0.001), collections (1432.0 vs. 78.0; P < 0.001), and shares (677.0 vs. 48.5; P < 0.001). Regarding uploader characteristics, professional institutions contributed only 4.1% of the total sample. Nevertheless, videos uploaded by professional institutions achieved the highest median GQS score (4.50) and mDISCERN score (4.00), significantly surpassing those uploaded by professional individuals and non-professional individuals (P = 0.011 and P < 0.001, respectively). User engagement metrics strongly intercorrelated (
Conclusions
Bilibili videos feature longer durations and more detailed content, whereas TikTok videos demonstrate superior user engagement. Videos uploaded by professional institutions attained higher quality ratings compared to other uploader types, although this finding is based on a small subsample (n=7) and should be interpreted with caution. Medication-related content attracted the greatest public attention. Nevertheless, the weak correlation between user engagement and quality scores indicates that high popularity does not equate to high informational reliability. These findings underscore the need to strengthen professional credentialing mechanisms and optimize algorithmic recommendations to enhance both the scientific accuracy and communicative reach of osteoporosis health information on short video platforms.
1. Introduction
Osteoporosis is a common metabolic bone disease characterized by reduced bone mineral density and microstructural deterioration, which contribute to increased bone fragility and susceptibility to fracture.1,2 Fragility fracture represents the most clinically significant consequence of this condition. As the global population ages, the prevalence of osteoporosis has continued to rise, establishing it as a major public health concern that substantially diminishes quality of life among middle-aged and older adults.3,4 A Canadian study reported that more than two million individuals are affected by osteoporosis, 5 underscoring its substantial global burden. However, because bone loss typically progresses asymptomatically in its early stages, many patients remain undiagnosed until they present with a fracture, at which point the optimal window for intervention has often been missed. 6 Moreover, even after diagnosis, a considerable proportion of patients fail to receive standardized and systematic treatment.1,6 Despite increasing public awareness of the disease, significant gaps persist in both early prevention and long-term treatment adherence.
In recent years, to enhance the accessibility of osteoporosis screening, researchers have begun exploring machine learning models based on routine clinical data, aiming to enable efficient risk assessment without reliance on dual-energy X-ray absorptiometry (DXA). A stacked ensemble model developed by Carvalho and Gavaia 7 achieved 93% accuracy using routine clinical data from the National Health and Nutrition Examination Survey (NHANES). Subsequent studies by the same group further validated the model’s stability across diverse populations 8 and successfully applied it to mortality prediction in orthopedic patients. 9 These advances suggest that accessibility in osteoporosis management extends beyond the dissemination of health information to include the decentralization and simplification of screening tools.
Within this context, short-video platforms such as TikTok and Bilibili have emerged as important channels through which the public—particularly younger populations—access health-related knowledge, owing to their intuitive and visually engaging content formats as well as their substantial communicative reach.10,11 As a leading short-video platform in China, TikTok has cultivated a vast user base and become deeply integrated into daily life. Bilibili, by contrast, specializes in medium-to long-format videos and hosts a large community of science communication content creators, rendering it especially popular among younger audiences. 12 Together, these platforms provide diverse avenues for the creation and dissemination of medical education content. Nevertheless, the quality of online health information has long been a subject of concern. 13 The quality of existing video content varies considerably, and many videos contain professional inaccuracies that have the potential to mislead the public. 14 Previous studies have evaluated the quality of videos related to various conditions, including hypertension, radiotherapy health information, and liver cancer, revealing significant heterogeneity across different platforms.12,15,16
Given that the prevention and treatment of osteoporosis emphasize early intervention, a systematic evaluation and comparison of the quality of osteoporosis-related information across different platforms remains an underexplored area of research. 17 While prior studies have focused on single platforms 17,18, this study provides three incremental contributions: (1) direct comparison between TikTok and Bilibili; (2) systematic analysis of uploader type differences (professional vs. nonprofessional); and (3) the first evaluation of osteoporosis content on Bilibili.
Therefore, the present study aims to conduct a cross-sectional analysis to systematically evaluate and compare the content characteristics, information quality (assessed using the Global Quality Score [GQS] and the modified DISCERN [mDISCERN] instrument18–20), and source composition of osteoporosis-related videos on TikTok and Bilibili. This study aims to investigate the following core question: how do platform affordances and algorithmic mechanisms shape the structural relationship between information quality and user engagement in short-form video health communication? By systematically evaluating the content characteristics and quality of osteoporosis-related videos on two major domestic platforms, this study seeks to provide key evidence for the development of more effective online health communication strategies.
2. Methods
2.1. Search and data collection
This study employed a cross-sectional content analysis design and was reported in accordance with the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement.
21
For the content coding and quality assessment components, the recommendations of the Standards for Reporting Qualitative Research (SRQR) were consulted. A keyword search using the term “osteoporosis” was conducted on Tiktok and Bilibili, with the top 100 ranked videos from each platform constituting the initial sample. To minimize the influence of algorithm-driven personalized recommendations and potential selection bias, the searches were performed using newly created accounts with no prior browsing history or user interaction, and access was conducted in guest mode where applicable.
22
During the screening process, duplicate videos and those irrelevant to the research topic were excluded (detailed in Figure 1: 11 videos were removed from TikTok and 18 from Bilibili). The final analytical sample was restricted to the top 100 videos per platform, a threshold consistent with prior studies suggesting that videos ranked beyond the top 100 contribute marginally to overall content analysis.
23
Search strategy and video filtering program.
For each included video, the following data were extracted and recorded: title, uploader name, video content description, duration, and user engagement metrics including number of likes, favorites, and shares. All data were systematically entered and managed using Microsoft Excel. The data collection process was completed on October 11, 2025.
2.2. Classification of videos
Based on the background and attributes of the video uploaders, they were categorized into the following four groups: (1) Professional individuals: This category includes individuals with formal medical or nursing qualifications (e.g., licensed physicians, physical therapists, etc.) or those possessing relevant academic backgrounds engaged in related research (e.g., medical researchers specializing in orthopedics). (2) Nonprofessional individuals: This group comprises individuals without systematic medical or nursing education, such as patients sharing personal experiences with the condition, or fitness enthusiasts lacking clinical credentials. (3) Professional institutions: These are organizations whose core mission is to provide medical or nursing services, including various types of hospitals, university-affiliated medical centers, and health administrative authorities. (4) Nonprofessional institutions: This category consists of organizations whose primary operations are not related to healthcare, such as general media agencies, fitness brands, and community groups unassociated with clinical practice.
Furthermore, based on the core information conveyed in the videos, they were classified into the following six mutually exclusive content themes: (1) Disease Prevention (2) Disease Diagnosis (3) Clinical Symptoms (4) General Information (5) Lifestyle Interventions (6) Medication
Each video was assigned to only one category. For videos covering multiple topics, classification was based on the topic accounting for the largest proportion of the content or representing the most prominent core theme. Discrepancies in classification were resolved by a third researcher.
2.3. Evaluating methodologies
In this study, a modified version of the mDISCERN instrument (see Supplementary File 2) was utilized to evaluate the overall reliability of the video content. The mDISCERN tool is well-established in academic research as a means to help both consumers and healthcare providers assess the quality of health-related information. It has been widely applied in numerous studies evaluating online health information across various medical fields, including cancer, arthritis, and other chronic conditions.14–16
The revised DISCERN instrument evaluates video quality based on five specific criteria. Clarity refers to whether the content is presented in a clear, concise, and understandable manner. Relevance describes the extent to which the content aligns with the topic of osteoporosis. Traceability reflects whether the information provides citations to credible sources. Comprehensiveness pertains to the depth and objectivity of the information presented. Finally, impartiality examines whether the content is free from bias. Each of these criteria was scored using a binary scale, where “yes” responses were assigned 1 point and “no” responses received 0 points. As a result, the total score for each video ranged from 0 to 5, offering a quantitative basis for assessing content reliability.22–24
In addition, the Global Quality Scale (GQS; see Supplementary File 1) was applied to evaluate the overall quality of the videos. This instrument is a recognized measure for assessing the reliability and quality of health-related information disseminated through digital video platforms. The GQS uses a 5-point scoring system, in which a score of 1 indicates poor quality content and a score of 5 represents high quality.25,26
2.4. Evaluation process
The video content evaluation was conducted by two graduate students (Rater A: S.Z.; Rater B: H.B.) affiliated with the orthopedics department of a tertiary teaching hospital. Prior to formal assessment, both raters received standardized training on the mDISCERN instrument and GQS scale. To ensure consistent interpretation of the scoring criteria, a calibration exercise involving 10 pilot videos was carried out.
All 171 videos were independently evaluated by the two raters. Each reviewer recorded scores for every video according to the mDISCERN criteria—clarity, relevance, traceability, comprehensiveness, and impartiality—as well as an overall GQS score. A discrepancy was defined as a difference of one point or more in either the total mDISCERN score or the GQS rating.
In cases where scoring discrepancies occurred, the two raters first conducted a joint reevaluation of the video content, comparing their assessments and identifying potential sources of disagreement, such as differing interpretations of specific criteria like “comprehensiveness.” If consensus could not be reached through discussion, a senior orthopedic expert (M.Z.) with over 30 years of clinical experience was consulted. This expert reviewed the video and the initial evaluations, facilitated further discussion, and made the final scoring decision based on current clinical guidelines and evidence-based practice.
2.5. Statistical analysis
Given the non-normal distribution characteristics of the data, this study will present statistical results using medians and interquartile ranges (IQR). For comparisons between two groups, the Mann-Whitney U test will be applied, while the Kruskal-Wallis H test will be employed when comparing three or more groups. For the Kruskal-Wallis test, where the result was statistically significant, Dunn’s test was further performed for post hoc pairwise comparisons, and the Bonferroni method was applied to adjust the P-values to control for type I error. In analyzing the GQS and mDISCERN scores, Fisher’s exact test will be utilized.
Inter-rater reliability analysis.
Abbreviations: GQS, Global Quality Scale; mDISCERN: modified DISCERN instrument.
2.6. Ethics statement
This study used publicly available data from TikTok and BiliBili. All data were collected in compliance with the platforms’ terms of service and applicable guidelines. No personally identifiable information was included in the analysis. As the study involved only publicly available content, institutional ethics review was waived.
2.7. Use of artificial intelligence
The authors declare that no artificial intelligence tools were used in the preparation of this manuscript.
3. Results
3.1. Video characteristics and uploader types
Characteristics of the videos on TikTok and BiliBili.
Abbreviations: M, median; Q, quartile.
Note. P-values were derived from the Mann-Whitney U test for comparisons between the two platforms.
Among all 171 videos, 160 (93.6%) were produced by professional individuals, 7 (4.1%) by professional institutions, and 4 (2.3%) by non-professional individuals. No content was published by non-professional institutions. This distribution highlights the dominant role of professional individuals in creating and disseminating osteoporosis-related videos. In terms of platform-specific distribution, 98% of the videos on TikTok were uploaded by professional individuals, with other types of uploaders accounting for only 2%, indicating a highly concentrated source of content. In contrast, Bilibili exhibited greater diversity in uploader types: although professional individuals remained the primary contributors (approximately 55%), non-professional individuals accounted for 18%, professional institutions for 17%, and non-professional institutions for 10%. The proportion of non-professional uploaders was notably higher on BiliBili than on TikTok, as illustrated in Figure 2. General characteristics of osteoporosis-related videos from TikTok and BiliBili. (a) Pie chart displaying the distribution of uploader types across all platforms. (b) Stacked bar chart illustrating the proportional distribution of uploader types on each.
Characteristics of uploader types of videos on TikTok and BiliBili.
Abbreviations: M, median; Q, quartile.
Note. P-values were derived from the Kruskal-Wallis H test for comparisons across the three uploader types.
Quality scores of osteoporosis-related videos by uploader type.
Abbreviations: GQS, Global Quality Scale; M, median; Q, quartile; mDISCERN: modified DISCERN instrument.
Note. P-values were derived from the Kruskal-Wallis test for comparing the distributions of scores across the three uploader types.
3.2. Video content analysis
Figure 3 presents a content analysis of 171 videos categorized as follows: disease prevention (n = 16, 9.4%), disease diagnosis (n = 29, 17.0%), clinical symptoms (n = 15, 8.8%), general information (n = 33, 19.3%), lifestyle interventions (n = 37, 21.6%), and medication (n = 41, 24.0%). In terms of platform distribution, TikTok showed higher proportions of medication-related and general information videos, whereas BiliBili featured substantial content not only on medication but also on disease diagnosis and clinical symptoms. Additionally, both platforms included diverse themes such as lifestyle interventions and disease prevention, indicating a relatively broad coverage of topics across platforms. Content analysis of osteoporosis-related videos on TikTok and BiliBili. (a) Donut chart presenting the distribution of content categories across both platforms; (b) Radial bar chart showing content type proportions on TikTok; (c) Radial bar chart displaying content type proportions on BiliBili.
Characteristics of content of videos on TikTok and BiliBili.
Abbreviations: M, median; Q, quartile.
Note. P-values were derived from the Kruskal-Wallis H test for comparisons across the seven content categories.
3.3. Assessment of video information quality and reliability
Comparison of high-quality video proportions between BiliBili and TikTok.
Abbreviation: GQS, Global Quality Scale; mDISCERN: modified DISCERN instrument.
Note. P-values were derived from Z-test for the difference in proportions between two independent groups.
Significant differences were observed between the two platforms in GQS scores assigned by both reviewers (both p < 0.001). According to Reviewer A’s GQS assessment, Bilibili videos were predominantly concentrated in scores of 3 (37.8%), 4 (39.0%), and 5 (23.2%). In contrast, TikTok videos exhibited a polarized distribution, with higher proportions at the lower end (score 1: 4.5%; score 2: 5.6%) and the upper end (score 5: 39.3%). A similar pattern was observed in Reviewer B’s GQS scores: Bilibili videos were primarily clustered around scores of 3 (37.8%) and 4 (50.0%), whereas TikTok videos showed notably higher proportions at score 2 (12.4%) and score 5 (36.0%).
Ratings of TikTok and Bilibili by different reviewers.
Abbreviation: GQS, Global Quality Scale; mDISCERN: modified DISCERN instrument.
Note. P-values for A_GQS and B_mDISCERN were derived from Fisher’s exact test due to expected cell counts <5; P-values for the remaining scores were derived from Pearson’s chi-square test.
Ratings by different commenters for different types of uploaders on TikTok and BiliBili.
Abbreviations: GQS, Global Quality Scale; Q, quartile.; mDISCERN: modified DISCERN instrument.
Note. P-values were derived from the Kruskal-Wallis H test for comparisons across the three uploader types.
For mDISCERN scores, both reviewers identified statistically significant differences across uploader types (both p = 0.004). Professional institutions consistently attained the highest median scores (both 4.0), followed by professional individuals (both 3.0), while non-professional individuals received the lowest median scores (both 2.5). These findings suggest that videos produced by professional institutions demonstrate superior information quality, whereas those created by non-professional individuals tend to exhibit lower quality.
The complete score distributions are detailed in Table 7. Furthermore, the box plots in Figures 4 and 5 provide additional visual evidence of the central tendencies and dispersion patterns for both reviewers’ scores. GQS distributions for osteoporosis-related videos. (a) Reviewer A’s GQS scores; (b) Reviewer B’s GQS scores; Abbreviations: GQS, Global Quality Scale. mDISCERN distributions for osteoporosis-related videos. (a) Reviewer A’s mDISCERN scores; (b) Reviewer B’s mDISCERN scores.

3.4. Spearman correlation analysis
A Spearman correlation analysis was conducted to examine the associations between video characteristics and quality assessment scores (GQS and mDISCERN) among osteoporosis-related videos. The results revealed statistically significant positive correlations among user engagement metrics. Specifically, the number of likes was strongly correlated with the number of collections (r = 0.92, p < 0.0001) and shares (r = 0.87, p < 0.001). A strong positive correlation was also observed between collections and shares (r = 0.94, p < 0.0001). In contrast, video duration demonstrated weak associations with user engagement indicators, with a modest negative correlation with likes (r = -0.41) and non-significant correlations with collections (r = -0.27) and shares (r = -0.24).
Regarding video quality assessment, both GQS and mDISCERN scores assigned by the two independent reviewers exhibited weak correlations with user engagement metrics, with all absolute correlation coefficients falling below 0.27. These findings suggest that video popularity, as reflected by user interactions, is not substantially associated with information quality. Similarly, video duration showed weak correlations with quality scores, with coefficients ranging from -0.026 to 0.30.
In terms of inter-rater consistency, moderate correlations were observed between the two scales completed by the same reviewer (Reviewer A: r = 0.56, p < 0.0001; Reviewer B: r = 0.52, p < 0.0001). Notably, strong inter-rater reliability was demonstrated for both assessment tools, with a high positive correlation for GQS scores between the two reviewers (r = 0.93, p < 0.0001) and a high positive correlation for mDISCERN scores (r = 0.96, p < 0.0001). These results indicate excellent consistency between the two reviewers in their quality assessments. Complete correlation coefficients are presented in Figure 6. Spearman correlation heatmap.
4. Discussion
Osteoporosis, a common metabolic bone disease, renders the quality of health information dissemination critical to public disease awareness and self-management. With short-video platforms emerging as a new frontier for health communication, this study systematically evaluated the content quality and user engagement of osteoporosis-related videos on two major Chinese platforms, Bilibili and Tiktok.
A total of 171 videos were analyzed. The findings revealed a marked disconnect between video popularity and information quality. Tiktok videos demonstrated significantly higher engagement metrics, indicating greater communicative reach, whereas Bilibili videos featured substantially longer durations, suggesting more detailed content. Inter-platform differences in quality assessment were complex, with uploader type emerging as a significant determinant of video quality. Although professional institutions accounted for a small proportion of the sample, their videos achieved the highest GQS and mDISCERN scores, underscoring the importance of professional background in ensuring information reliability. Unlike prior single-platform studies,17,18 our cross-platform comparison (TikTok vs. Bilibili) and analysis of uploader ecosystem differences reveal how platform affordances shape the quality-popularity disconnect.
With respect to content topics, medication-related videos garnered the highest numbers of likes and collections, reflecting substantial public interest in treatment-focused information. Correlation analyses revealed strong positive intercorrelations among user engagement metrics, collectively reflecting video popularity; however, these metrics exhibited only weak correlations with quality scores, providing robust evidence that popularity does not equate to informational accuracy or reliability. Furthermore, the two reviewers demonstrated high consistency in their quality ratings, ensuring the robustness of the assessment.
4.1. Platform-specific differences and uploader characteristics
A total of 171 videos were included in this analysis, comprising 82 from Bilibili and 89 from Tiktok. Tiktok videos demonstrated significantly higher user engagement metrics—including likes, collections, and shares—compared to those on Bilibili, whereas Bilibili videos exhibited significantly longer durations, reflecting marked differences in content presentation styles between the two platforms.
Regarding uploader composition, Tiktok showed a highly concentrated source profile, with professional individual creators accounting for 98% of videos. In contrast, Bilibili demonstrated a more heterogeneous uploader base, characterized by a significantly higher proportion of non-professional contributors. This discrepancy likely reflects divergent creator ecosystems: Tiktok employs a more stringent credentialing system, whereas Bilibili adopts relatively lenient verification standards. Such structural differences may partially account for the observed inter-platform divergence in both video quality and user engagement. However, because TikTok is composed almost entirely of professional individuals (98%) while Bilibili has a more heterogeneous uploader mix, the observed between-platform quality differences are partially confounded by uploader composition and cannot be attributed solely to platform features.
Quantitative analyses revealed a significant association between uploader credentials and video quality. Professional institutions ranked highest in quality scores, followed by professional individuals, with non-professional individuals scoring lowest, indicating that content producers with professional backgrounds are better positioned to ensure informational accuracy.16,27 Notably, despite receiving the lowest quality ratings, videos uploaded by non-professional individuals had the longest durations, suggesting that creators lacking formal training may attempt to compensate for low information density by extending video length. 27
Engagement metrics presented a more nuanced picture. Although Tiktok significantly outperformed Bilibili in user engagement, this advantage was not accompanied by correspondingly higher video quality—a finding consistent with the well-documented “quality-popularity paradox” in health communication, wherein a video’s popularity does not necessarily reflect its informational reliability.28,29 Despite producing high-quality content, professional institutions exhibited relatively low engagement levels, indicating that credible information may not receive proportionate visibility within algorithm-driven dissemination environments.29,30
From a public health perspective, these observations underscore a fundamental tension: videos with high dissemination potential often lack adequate quality, whereas high-quality content frequently fails to achieve comparable reach. 30 This finding suggests the need for multifaceted interventions, including platform-level policy guidance, engagement from professional societies, and enhanced public health literacy, to strike a balance between broad information dissemination and the assurance of content accuracy. 30
4.2. Influence of content topics
Regarding content topics, videos addressing pharmacological management demonstrated the highest levels of user engagement across all metrics, whereas those focused on disease diagnosis exhibited the lowest. 31 This discrepancy likely reflects the information preferences of the target audience: for a chronic condition such as osteoporosis, patients and the general public tend to prioritize practical information concerning treatment options that directly influence daily disease management, rather than content related to diagnostic processes, which may be perceived as more technically oriented and less immediately applicable. 32 Of note, although videos centered on lifestyle interventions did not achieve particularly high engagement, they had the longest average duration. This finding suggests that content creators may employ extended formats to comprehensively address non-pharmacological strategies—including exercise and nutrition—consistent with the practical, instructional nature of such topics.
From a platform perspective, Tiktok featured a higher proportion of videos on pharmacological management and general information, whereas Bilibili hosted substantial content related to disease diagnosis and clinical manifestations. This variation may be attributable to differences in platform-specific viewing behaviors: users on Tiktok may favor concise, actionable health information, while those on Bilibili may demonstrate greater receptivity to more knowledge-oriented content, such as discussions of disease mechanisms and diagnostic criteria.
Collectively, these observations indicate that user engagement is closely associated with the perceived practicality of the content topic. The high interaction rates observed for medication-related videos underscore a strong public demand for accessible, actionable medical information. 33 Nevertheless, prior research has consistently emphasized that high engagement does not necessarily equate to high quality. 17 Although pharmacological content attracts the most attention, its informational accuracy and reliability warrant careful scrutiny using validated assessment instruments. In future health communication practice, topic-specific strategies should be developed: for high-interest therapeutic content, enhanced professional review mechanisms are essential to ensure accuracy; for lower-engagement yet equally important topics such as diagnosis and prevention, more compelling presentation formats should be explored to improve public awareness and comprehension.
4.3. Correlation between video quality and user engagement
Correlation analysis revealed a complex relationship between user engagement and content quality in osteoporosis-related short videos. User engagement metrics demonstrated strong internal consistency, indicating that likes, collections, and shares collectively serve as indicators of video popularity 17
Notably, video quality scores exhibited only weak correlations with user engagement metrics. This finding highlights a substantial disconnect between popularity and informational reliability within the domain of osteoporosis health communication—videos with high engagement do not necessarily contain high-quality medical content, nor do high-quality videos necessarily achieve corresponding levels of popularity. This observation aligns with the well-documented “quality-popularity paradox” in health communication, wherein users may be more readily attracted to emotionally resonant content or personal narratives than to educational material rigorously grounded in evidence-based medicine. 17 Video duration demonstrated weak associations with both engagement metrics and quality scores, suggesting that duration alone is not a reliable indicator of content quality.30,32
Regarding rater reliability, the two reviewers exhibited strong consistency in their assessments using the same instruments, demonstrating that the quality evaluation employed in this study possesses high reproducibility and reliability. 17 In contrast, moderate correlations were observed when the same reviewer applied different assessment tools, indicating that although these instruments fall within the domain of quality evaluation, each emphasizes distinct dimensions of content quality. 34
These findings underscore a central challenge in short-form video health communication: popular content is not consistently reliable, nor is reliable content consistently popular.32,35 To address this gap, platforms may consider incorporating quality-sensitive strategies into their algorithmic recommendation systems, thereby ensuring that osteoporosis-related educational content achieves both broad dissemination and informational accuracy. 30
4.4. Practical implications and future directions
The findings of this study offer actionable insights for multiple stakeholders. Platform developers should optimize algorithmic recommendation mechanisms to preferentially surface high-quality content and strengthen credentialing systems to mitigate the dissemination challenges posed by the quality-popularity paradox.32,36 Medical professionals are encouraged to adopt platform-specific content strategies that balance informational accuracy with communicative reach—for instance, concise and practical formats on Tiktok versus more in-depth, structured presentations on Bilibili. Policymakers may consider establishing quality assessment standards for health-related short videos and promoting public health literacy initiatives. 32 Patients and the general public should prioritize content from verified accounts and seek confirmation of treatment-related information through clinical consultation.
Enhancing the accessibility of osteoporosis management also requires the development of convenient screening tools. Recent research has introduced machine learning models based on routine clinical data that can efficiently assess osteoporosis risk without reliance on DXA.7–9 Future efforts could explore the integration of such screening tools with short video platforms—for example, by delivering personalized educational content based on individual risk stratification—thereby establishing a seamless continuum from risk assessment to knowledge acquisition.
4.5. Strengths and limitations
This study has several methodological strengths. First, it conducted a structured cross-platform evaluation of osteoporosis-related videos on Bilibili and Tiktok, providing timely insights into the quality of bone health information within the digital health communication landscape. Second, by integrating uploader characteristics, content topics, two validated quality assessment instruments, and four user engagement metrics, the study achieved a comprehensive analysis that combined information quality with audience response; all videos were independently rated by trained reviewers, demonstrating excellent inter-rater reliability. Third, the use of predefined keyword searches, newly created platform accounts, and standardized inclusion criteria minimized potential biases arising from algorithmic recommendations and sampling procedures. These strengths offer a replicable methodological framework for future research.
Although the present study did not directly assess the impact of audiovisual formats on older audiences, the observed differences between platforms highlight the relevance of this issue. Bilibili videos featured longer durations and a more diverse composition of uploaders, whereas Tiktok videos were characterized by shorter formats and higher user engagement. Given that osteoporosis predominantly affects middle-aged and older adults—a population that tends to rely on clear structural organization and moderate information density during information processing—existing literature suggests that older viewers often exhibit lower rates of information retention and comprehension when exposed to fast-paced, information-dense short videos.37,38 Future research should further investigate the relationship between audiovisual characteristics and information comprehension across different age groups to optimize health communication strategies tailored to older populations.
Several limitations of this study should be acknowledged. First, the cross-sectional design precludes causal inferences, and data collection was completed within a single day, limiting the ability to capture the dynamic evolution of platform content. Second, the study focused exclusively on Chinese-language content and top-ranked videos, which constrains the generalizability of the findings across linguistic and cultural contexts. Third, the GQS and mDISCERN instruments were originally developed for static, text-based health information and may not fully capture dynamic features unique to short video platforms, such as audiovisual presentation and narrative techniques.35,39 Additionally, the small sample sizes for professional institutions and non-professional individuals may affect the robustness of subgroup comparisons. Although inter-rater reliability was high, potential subjective bias in the scoring process and possible misclassification of uploader identities cannot be entirely excluded. Finally, due to platform-imposed data access limitations, deeper user behavior metrics—such as view counts and completion rates—could not be incorporated into the analysis. These limitations underscore the need for future longitudinal, multi-platform research to develop a more comprehensive understanding of the dissemination patterns and public reception of osteoporosis-related health information.
5. Conclusion
This study revealed a marked divergence between content quality and communicative reach in osteoporosis-related short videos, demonstrating that high popularity does not equate to high quality. The higher quality observed for videos uploaded by professional institutions (although based on a small subsample of n=7) suggests a potential role of professional background in ensuring information reliability. The high level of public attention directed toward medication-related content reflects the strong demand for treatment-focused information among patients. These findings challenge the conventional reliance on engagement metrics as proxies for content value and highlight the need for differentiated health communication strategies. Future efforts should focus on optimizing algorithmic recommendations, strengthening professional credentialing mechanisms, and enhancing public health literacy to ensure both broad information dissemination and scientific accuracy, thereby fostering the sustainable development of the osteoporosis health communication ecosystem.
Supplemental material
Supplemental material - Evaluating the reliability and quality of osteoporosis content on TikTok and BiliBili: A cross-sectional content analysis
Supplemental material for Evaluating the reliability and quality of osteoporosis content on TikTok and BiliBili: A cross-sectional content analysis by Siyuan Zhang, Xi Yang, Haowei Bai, Haohao Wang, Yao Chen, Pengyu Liu, Can Zhou, Hao Li, Min Zhang in DIGITAL HEALTH.
Supplemental material
Supplemental material - Evaluating the reliability and quality of osteoporosis content on TikTok and BiliBili: A cross-sectional content analysis
Supplemental material for Evaluating the reliability and quality of osteoporosis content on TikTok and BiliBili: A cross-sectional content analysis by Siyuan Zhang, Xi Yang, Haowei Bai, Haohao Wang, Yao Chen, Pengyu Liu, Can Zhou, Hao Li, Min Zhang in DIGITAL HEALTH.
Footnotes
Author contributions
Siyuan Zhang: Investigation, Validation, Writing – Original Draft, Writing – Review & Editing. Xi Yang: Data Curation, Formal Analysis, Visualization, Writing – Review & Editing. Haowei Bai: Methodology, Software, Validation, Writing – Review & Editing. Haohao Wang and Pengyu Liu: Data Curation, Resources, Writing – Original Draft. Yao Chen and Can Zhou: Formal Analysis, Visualization, Writing – Review & Editing. Hao Li: Conceptualization, Funding Acquisition, Project Administration, Supervision, Writing – Review & Editing. Min Zhang: Conceptualization, Funding Acquisition, Project Administration, Supervision, Writing – Review & Editing.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Science and Technology Activity Project for Overseas Returnees in Shanxi Province, grant number: 20250050; Natural Science Foundation of Shanxi Province, grant number: 202203021221276; Natural Science Foundation of Shanxi Province, grant number: 202403021211110; Natural Science Foundation of Shanxi Province, grant number: 202403021211109.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Data Availability Statement
The authors confirm that the data supporting the findings of this study are available within the article. Further inquiries can be directed to the corresponding author.
Provenance and peer review
Not commissioned, externally peer reviewed.
Guarantor
Hao Li and Min Zhang
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
