Aim: To conduct and report on psychometric tests for a valid and reliable measurement tool for evaluating digital hospitals by healthcare professionals. Method: This psychometric study took place in a public digital hospital in Turkey. It was carried out with the participation of 355 healthcare professionals. Data were collected between September and October 2023 using an online survey and non-probability convenience sampling method. Statistical Package for Social Science Version (SPSS) 26.0 and analysis of moment structures version 24.0 were used to analyse the data. It was used for the psychometric properties and analyses of the scale (item analysis, explanatory factor analysis, confirmatory factor analysis (CFA), convergent and divergent validity statistics, Cronbach Alpha internal consistency coefficient, dependent sample t-test, and intraclass correlation). Results: The content validity index of the scale is 0.92. As a result of exploratory factor analysis (EFA) and CFA in separate samples, a total of 30 items and four sub-factors were obtained. Cronbach Alpha value of the scale is over 0.90 for both samples. In the four-factor structure, 82.64% of the total variance was explained. The 30-item and four-factor structure obtained in EFA was confirmed in CFA, and convergent and divergent validity statistics were provided. Test–retest results showed that the scale has high reliability. Conclusion: The digital hospital evaluation scale is valid and reliable for healthcare professionals to evaluate digital hospitals.
AkalınBVeranyurtÜ (2021) Sağlık Hizmetleri ve Yönetiminde Yapay Zeka. Acta Infologıca5(1): 231–240. (In Turkish)
2.
AlkanF (2022) Dijital Hastaneler. İçinde. In: ÖzgürY, editor. Sağlık Yönetiminde Yenilikçi Yaklaşımlar. İstanbul: Efeakademi Yayınları (pp. 41–58) (In Turkish).
3.
AyatMSharifiM (2016) Maturity assessment of hospital information systems based on electronic medical record adoption model (EMRAM) private hospital cases in Iran. International Journal of Communications, Network and System Sciences9(11): 471–477.
4.
BurkoskiVYoonJHutchinsonD, et al. (2019) Experiences of nurses working in a fully digital hospital: A phenomenological study. Nursing Leadership32(SP): 72–85.
5.
BurridgeLHFosterMJonesR, et al. (2020) Nurses’ perspectives of person-centered spinal cord injury rehabilitation in a digital hospital. Rehabilitation Nursing Journal45(5): 263–270.
6.
BüyüköztürkŞKılıç ÇakmakE, et al. (2018) Bilimsel araştırma yöntemleri (24. Baskı). Ankara: Pegem Akademi Yayınları. (In Turkish)
7.
CanfellOJMeshkatYKodiyattuZ, et al. (2022) Understanding the digital disruption of health care: An ethnographic study of real-time multidisciplinary clinical behavior in a New Digital Hospital. Applied Clinical Informatics13(5): 1079–1091.
8.
CanfellOJWoodsLMeshkatY, et al. (2024) The impact of digital hospitals on patient and clinician experience: Systematic review and qualitative evidence synthesis. Journal of Medical Internet Research, 26: 1–24.
9.
ÇapıkCGozümSAksayanS (2018) Intercultural scale adaptation stages, language and culture adaptation: Updated guideline. Florence Nightingale Journal of Nursing26(3): 199–210.
10.
CarriganARobertsNHanJ, et al. (2023).The Digital Hospital: A scoping review of how technology is transforming cardiopulmonary care. Heart, Lung and Circulation32: 1057–1068.
11.
ÇoklukÖŞekercioğluGBüyüköztürkŞ (2014) Sosyal bilimler için çok değişkenli istatistik: Spss ve lisrel uygulamaları, Ankara: Pegem Akademi Yayıncılık, pp. 211–275. (in Turkish)
DuncanREdenRWoodsL, et al. (2022) Synthesizing dimensions of digital maturity in hospitals: systematic review. Journal of Medical Internet Research24(3): 1–11.
14.
EdenRBurton-JonesABallantineC, et al. (2022). The digital transformation journey of a large Australian hospital: A teaching case. Communications of the Association for Information Systems51(1): 25.
15.
EngstromTMcCourtECanningM, et al. (2023) The impact of transition to a digital hospital on medication errors (TIME study). npj Digital Medicine6(1): 1–9.
16.
FornellCLarckerD (1981) Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research18(1): 39–50.
17.
HairJFBlackWCBabinBJ, et al. (2014) Multivariate Data Analysis, 7th edn. Pearson Education:Upper Saddle River.
18.
HairJFRingleCMSarstedtM (2011) PLS-SEM: Indeed a Silver Bullet. Journal of Marketing Theory and Practice19(2): 139–151.
19.
HaleemAJavaidMSinghRP, et al. (2021) Telemedicine for healthcare: Capabilities, features, barriers, and applications. Sensors International2: 100117.
HIMSS (2024b) Meet the world leaders in digital health-these facilities all reached stage 6 or 7 on our maturity models—and you’re up next! Available at: https://www.himss.org/what-we-do-solutions/maturity-models (accessed 2 April 2024).
22.
HowardMC (2016) A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve?International Journal of Human-Computer Interaction32(1): 51–62.
23.
JuddTMSloaneEBSilvaRJ (2020) The digital hospital of the 21th century, and information systems management. In: Ernesto I (Ed.) Clinical Engineering Handbook. Academic Press, pp. 530–542. https://doi.org/10.1016/B978-0-12-813467-2.00081-X
24.
JuhraC (2022) Clinic 4.0: The Digital Hospital. In: FrenzW (eds) Handbook Industry 4.0: Law, Technology, Society. Berlin, Heidelberg: Springer, pp. 843–855.
25.
KartalMBardakçıS (2018) SPSS ve AMOS uygulamalı örneklerle güvenirlik ve geçerlilik analizleri. Ankara: Akademisyen Kitabevi (in Turkish).
26.
KhanAMirMS (2021) Digital hospitals. Scholarly Journal of Biological Science10(1): 1–2.
27.
KılıçT (2016) e-Sağlık ve Teletıp Hollanda ve Dünyadan İyi Uygulama Örnekleriyle. AZ Yayınları, İstanbul (in Turkish).
28.
KlineRB (2011) Principles and Practice of Structural Equation Modeling. New York: The Guilford Press.
29.
KooTKLiMY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine15(2): 155–163.
30.
KordelP (2022) Entrepreneurial digital strategy as managerial tool for building smart hospital. Zeszyty Naukowe. Scientific Papers of Silesian University of Technology Organization and Management Series (160): 347–362.
31.
KrasuskaMWilliamsRSheikhA, et al. (2021) Driving digital health transformation in hospitals: A formative qualitative evaluation of the English Global Digital Exemplar programme. BMJ Health & Care Informatics28(1): e100429.
32.
KwonYMarzecML (2016) Does worksite culture of health (CoH) matter to employees? Empirical evidence using job-related metrics. Journal of Occupational and Environmental Medicine58(5): 448–454.
33.
LeechNBarretKCMorganGA (2015) IBMSPSS for Intermediate Statistics: Use and Interpretation, 5th edn. New Jersey: Lawrence Erlbaum Associates, Inc.
34.
LimHCAustinJAVan Der VegtAH, et al. (2022). Toward a learning health care system: a systematic review and evidence-based conceptual framework for implementation of clinical analytics in a digital hospital. Applied Clinical Informatics13(2): 339–354.
NikkhahMHeravi-KarimooiMMontazeriA, et al. (2018) Psychometric properties the Iranian version of older People’s quality of life questionnaire (OPQOL). Health and Quality of Life Outcomes16: 1–10.
37.
PaulMMaglarasLFerragMA, et al. (2023) Digitization of healthcare sector: A study on privacy and security concerns. ICT Express9(4): 571–588.
38.
PolitDF (2014) Getting serious about test–retest reliability: A critique of retest research and some recommendations. Quality of Life Research23: 1713–1720.
39.
PolitDFBeckCT (2012) Nursing Research Principles and Method, 6th ed. Philadelphia, PA: Lippincott Williams & Wilkins.
40.
RamioNDe TuriIAlbergoF, et al. (2023) The drivers of the digital transformation in the healthcare industry: An empirical analysis in Italian hospitals. Technovation121: 102558.
SerenAKHTunaRBacaksizFE (2018) Reliability and validity of the Turkish version of the Job Performance Scale instrument. Journal of Nursing Research26(1): 27–35.
43.
ShresthaN (2021) Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics9(1): 4–11.
44.
SönmezSİlgünG (2023) “Dijital Hastane” İçinde. In: ÖzlemÖOkanÖ (eds.) Sağlıkta Dijital Yaklaşımlar. Ankara: Gazi Kitapevi. (in Turkish)
WatkinsMW (2018) Exploratory factor analysis: A guide to best practice. Journal of Black Psychology44(3): 219–246.
47.
WilliamsPALovelockBCabarrusT, et al. (2019) Improving digital hospital transformation: development of an outcomes-based infrastructure maturity assessment framework. JMIR Medical Informatics7(1): 1–15.
48.
WoodsLEdenRPearceA, et al. (2022) Evaluating digital health capability at scale using the digital health indicator. Applied Clinical Informatics13(5): 991–1001.
49.
WorthingtonRLWhittakerTA (2006) Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist34(6): 806–838. https://doi.org/10.48550/arXiv.1905.05598
50.
YurdugülH (2005) Ölçek geliştirme çalışmalarında kapsam geçerliği için kapsam geçerlik indekslerinin kullanılması, XIV. Ulusal Eğitim Bilimleri Kongresi, Pamukkale Üniversitesi Eğitim Fakültesi, 15-16 Nisan 2024 tarihinde http://yunus.hacettepe.edu.tr/~yurdugul/3/indir/PamukkaleBildiri.pdf adresinden alınmıştır (In Turkish).
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
