Sage Journals: Discover world-class research

Abstract

Objectives

Our study analyzed dental nurses’ use and use behavior determinants of electronic patient IS modules in telephone triage. The modules were implemented in public oral healthcare organizations’ patient ISs to digitalize the national waiting time monitoring system.

Methods

For the cross-sectional survey, we collected data from dental nurses using convenience sampling and applied a modified UTAUT as the theoretical framework.

Results

The results indicate that using the module for different purposes varied, and the nurses used it sparsely in recording data for monitoring national waiting times. Using the module was laborious, and triage work was busy.

Conclusion

Dental nurses’ low system usage resulted in poor-quality data for waiting time monitoring. As healthcare data is increasingly used for purposes other than clinical decision making, we must ensure that healthcare professionals performing clinical tasks perceive data recording for non-clinical purposes as meaningful and have time for proper data entry.

Keywords

data quality decision-support systems healthcare policy primary care

Introduction

In healthcare, decisions are made at national, organizational, and individual levels, and varied information is required for clinical, management, internal, and external purposes.¹ In many healthcare systems, waiting time information is essential in decision making, as the length of waiting times remains an issue across the world. Combining maximum waiting times stipulated in regulation and regular waiting time monitoring with different demand- and supply-side interventions has proved successful in addressing these issues.²

For waiting time monitoring, high quality statistical data is required. The key aspects are relevance, availability, and accuracy.³ There is no single high quality statistical waiting time data, but several. For example, national-level and the organizational-level decision making require differing statistical data to establish indicators. The concept of actionable indicators⁴ emphasizes an indicator’s fitness for purpose.

Waiting time for primary care is defined as the amount of time to receive an appointment with a healthcare professional.⁵ For waiting time monitoring of these appointments, the purpose-fitting indicator for national authorities is retrospective “completed waits”.⁶ These refer to the realized waiting times of patients who already had an appointment,⁷ e.g., the average waiting time to see a dentist was 68 days. Healthcare organizations often have internal indicators to assess patients’ waiting times.⁸

The national authorities must acquire the data for waiting time monitoring from healthcare organizations. There has been speculation that self-reported information may be biased.^9,10 Therefore, investments in information systems (IS) have been made to obtain data to control organizations’ behavior.¹¹ The supposition that data extracted automatically from electronic patient ISs guarantees the validity of waiting time information is false. Interviews in the Swedish healthcare system¹² showed that sending usage guidelines written by administrative managers via email was not a successful strategy for implementing a new waiting time reporting IS. Healthcare professionals did not adhere to the guidelines, as they did not perceive the system as useful.

IS implementation requires effort in organizations. Table 1 describes a framework of the six stages of IS implementation.¹³ Technical validity,¹⁴ in other words, the development of a functional system, is insufficient. The system must be properly utilized, and users must understand that the system is the solution to a problem,¹³ which requires a simultaneous organizational change.^15–17 Process models that describe organizational changes vary regarding the number of steps, e.g., Lewin’s change model¹⁸ includes three steps (Table 1).

Table 1.

Frameworks of six stages of IS implementation¹³ and of three steps of organizational change.¹⁸

Stage	Description	Step	Description
Initiation	Based on organizational needs, technological innovation, or both	Unfreezing	Organization prepared to accept the necessity of the change
Adoption	Organization’s decision whether or not to invest in IS efforts	Change	Individuals' understanding how the change will benefit them
Adaptation	IS installed for use and users trained in the IS and the new practices	Change	Individuals' understanding how the change will benefit them
Acceptance	Users induced to commit to IS usage	Refreezing	Assurance of the regular usage of the new practices and incorporating them into everyday activities
Routinization	New system perceived as an ordinary means
Infusion	Increased effectiveness obtained using the IS to its fullest potential¹⁹

In Finland, the Healthcare Act²⁰ defines times for care guarantee, as well as maximum allowed waiting times for care in public primary oral healthcare. This waiting time is defined as the period from triage contact to an appointment to see a dentist. To monitor realized waiting times nationally, all public primary oral healthcare organizations must provide data to the Finnish Institute for Health and Welfare (hereafter the Institute).^21,22 Since 2014, data has been submitted from electronic patient ISs to the Institute.²³ Before 2014, the data was gathered from oral healthcare managers through questionnaires twice a year. The electronic monitoring system meant that each organization had to implement a new module in its electronic patient IS. Altogether, there were six electronic patient ISs in public oral healthcare. During and after the implementation, the success of the national monitoring system was not rigorously evaluated.

Digitalizing the waiting time monitoring system was a national-level decision in Finland. Specific data was required, and IS offered a new method of data acquisition. In oral healthcare organizations, there was no need to initiate this IS investment. The solutions to the waiting time problem differ, such as improving the allocation of appointment slots and reducing no-shows for scheduled appointments.²⁴ As a result of the national decision, technical implementations were completed, but the internal justifications for any change were missing in organizations. There was no understanding of how a change requiring more documentation would benefit patients and healthcare professionals in the issue of waiting time. Based on the literature, “patient-oriented” nurses²⁵ generally experience documentation as a meaningless burden that is of no benefit to the patient,²⁶ and documentation remains insufficient when nurses work in a hurry.²⁷ Nurses’ attitudes are more negative toward administrative than clinical documentation.²⁸

Our study analyzes dental nurses’ use of the electronic patient IS module in telephone triage and the determinants of this usage. The theoretical framework for the study was adapted from the United Theory of Acceptance and Use of Technology (UTAUT).²⁹ Digitalizing the national waiting time monitoring system technically enabled new data for the decision making of triage dental nurses, dentists, and the national authorities. For high quality decision making, data must also be relevant and accurate. This cannot be realized if the systems are not defined and used appropriately. In this study, we focus on analyzing dental nurses’ use of the electronic patient IS module in telephone triage. For example, nurses’ system usage contributes to the quality of data in the system, and sparse data recording results in poor-quality waiting time data for decision making at the national level. The research questions are: 1) How do dental nurses use the electronic patient IS module in triage? 2) Which factors determine this usage?

Materials and methods

Survey participants

To study dental nurses’ usage of the patient IS module and use behavior determinants in telephone triage, we conducted a cross-sectional electronic survey in 2021 of public primary oral healthcare in Finland. The Ethics Committee for Human Sciences at the University of Turku approved the study proposal in February 2021 (Permit 7/2021). Each dental nurse was required to provide informed consent to participate in the study at the beginning of the electronic questionnaire. We also submitted applications for research permits to all 135 public primary healthcare organizations in Finland. Of these, 48% had a population base of more than 20,000. We obtained permits from 105 organizations.

The research design was originally a census study, including all Finnish-speaking triage dental nurses from all public primary oral healthcare organizations in Finland. Practically, all triage dental nurses speak Finnish, but 22% of the organizations did not approve the research permit. The census study turned into convenience sampling, including all Finnish-speaking triage dental nurses who worked in the 105 organizations. The number of Finnish-speaking triage dental nurses in these organizations in May 2021 was 915.

In Finland, a triage dental nurse assesses each patient’s dental care needs in telephone triage before they can access public primary oral care. With the new patient IS module,²³ nurses received the right to access patients’ dental histories to support their treatment-priority decision making in triage. Using the module was mandatory, but the module did not force users to utilize all of its functionalities. The data concerning the triage contact of a patient was recorded into an electronic patient IS either manually by nurses or automatically. However, nurses were required to make the entries required for booking appointments. The clinical data, such as patients’ symptoms and reasons for seeking treatment, could be recorded into the system and subsequently available for dentists. Recorded triage contact data, which may be incomplete, was automatically submitted to the Institute once a day, using pre-defined content.³⁰ The systems of the Institute processed the individual-level data, including the data of each triage contact, appointment, and cancellation³⁰ into aggregated summary reports of realized waiting times. The national authorities used these reports for monitoring the care guarantee. The Institute also published reports on its public website.²³

Survey data

The theoretical framework of our study (Figure 1) was based on the UTAUT,²⁹ which has been used to study the acceptance of various technologies in healthcare through different user groups.³¹ However, its usage in analyzing the utilization of nursing information technology is minor.³²

Figure 1.

Theoretical framework of this study adapted from the UTAUT.²⁹

In the present study, we examined actual usage, as the investigated module had been in use for years. We were interested in dental nurses’ using the module for three purposes: I) Supporting decision making in triage, II) Recording data for dentists, and III) Recording data for the Institute. Using the module for the first purpose assisted triage nurses’ decision making (patient benefit), while using the module for the second and third purposes provided data for dentists’ decision making (patient and group benefit) and provided data for the national level to monitor realized waiting times (population benefit), respectively.

In the UTAUT,²⁹ the constructs effort expectancy, performance expectancy, and social influence are used to determine the construct of intention to use, which, in addition to the construct of facilitating conditions determines the construct of usage behavior. As the IS module studied had been employed for years, we did not utilize intention to use as a determinant. We rather used the four other constructs to determine directly the module usage. Each determinant was characterized by its equivalent determinant in the UTAUT. Perceived effort was defined as the degree of ease in learning and using the system, and perceived performance referred to the degree to which the system helped improve job performance. Social influence was defined as the degree to which people important to the individual communicated the individual should use the system, while facilitating conditions referred to the degree to which infrastructure existed to support using the system.

In literature, performance expectancy has been the clearest determinant of healthcare professionals’ behavioral intention.^33–37 Effort expectancy has been demonstrated as both a clear determinant of behavioral intention^33–38 and not.^39,40 Social influence has had positive effects on users’ behavior in healthcare.^38,39,41,42 Healthcare professionals may feel more social influence from peers than from top managers,³⁴ and facilitating conditions have been significant predictors of usage.^36,39,41,42

As moderators on facilitating conditions, we included age and experience in the same manner as in the UTAUT.²⁹ We defined experience as dental nurses’ proficiency in telephone triage, as studies in other healthcare areas have emphasized that the telephone as a service medium requires special skills.^43–45 Significant learning occurs while working on these tasks,^43,45 though sufficient time is also essential.⁴⁴ We supposed that these results may also prove valid in telephone triage tasks in oral healthcare, and this experience might affect the use behavior. To measure experience, we used a 5-point ordinal scale (daily or almost daily = 1, weekly or almost weekly = 2, monthly or almost monthly = 3, occasionally, e.g., during holiday seasons = 4, and very rarely or never = 5).

In the survey, we investigated each determinant construct with three items (Supplemental Appendix A) adapted from Venkatesh et al.^29,p.460 using a 5-point Likert scale (strongly disagree = 1, disagree = 2, neither agree nor disagree = 3, agree = 4, and strongly agree = 5). We chose three items in each determinant and a 5-point Likert scale to increase the response rate. For the usage behavior, we included one item for providing data for dentists, one for providing data for the Institute, and three for supporting decision making in triage. These three items were for the module usage in analyzing a patient’s health problem, improving the effectiveness of treatment assessment decisions, and enabling individualized care. We measured the usage behavior with a 5-point ordinal rating scale (not at all = 1, a little = 2, somewhat = 3, much = 4, and a great deal = 5). The questionnaire also included queries on backgrounds and for other studies. At the beginning of the questionnaire, we asked each respondent to provide informed consent to participate in the study.

We pre-tested the Finnish questionnaire to ensure its clarity and comprehensiveness. We sent the pre-survey to ten dental nurses in three organizations, and all answered. Based on the comments, we made minor changes to improve clarity. In the pre-test phase, no statistical analysis was conducted. To gather data, we used the software Webropol Survey & Reporting, Version 3.0, and an open Internet link to allow anonymous responses. We sent the Internet link to the contact persons of the oral healthcare organizations at the beginning of May 2021. The persons were named for this task in the approved research permits. Reminders for answering were sent at the end of May 2021, and the questionnaire remained available until 11^th June 2021.

Statistical analysis

We used the software IBM SPSS Statistics for Windows, Version 28.0.0.0 for our statistical analyses. The data gathered with ordinal and 5-point Likert scales was handled as interval-level data.⁴⁶ Any missing data was handled using listwise deletion. To describe the background data of dental nurses and the determinant items of the IS use behavior, we calculated measures of central tendency and variability. The distribution of the actual use behavior variables was illustrated using box plots. We compared the means of two dental nurse group variables using two-tailed Student’s t-tests assuming unequal variances. The chi-squared test of independence was employed for the categorical variables. The four use behavior determinant variables and one actual use behavior variable were summated from their three-item variables. To assess the internal consistency of the sum variables, we used Cronbach’s alpha, with a threshold of 0.6 considered acceptable.⁴⁷ We used binary logistic regression to study the associations between the use behavior determinant variables and the actual use behavior variables. The independent variables were used as continuous variables when there was a linear relationship between any continuous independent variables and the logit transformation of the outcome variable. We tested the linearity with the Box-Tidwell procedure.⁴⁸ In addition, we included two moderators on one use behavior determinant in our binary logistic regression models.

Results

Of the 915 potential respondents, 294 answered the questionnaire, a response rate of 32%. Two respondents did not provide informed consent to participate in the study. The number of dental nurses included in the analysis was 292. There was also minor data loss because not all nurses answered every question. The number of respondents answering the different questions varied from 274 to 292. The number of valid responses (n) is separately reported for each question.

Background information

Of the dental nurses (n = 292), 43.5% worked daily or almost daily in triage (hereafter frequently in triage), and the rest worked in triage less often than this (hereafter infrequently in triage). The proportions did not vary significantly between oral healthcare organizations of different sizes. The dental nurses working frequently in triage perceived their triage work-related and digital competencies to be better than nurses working infrequently in triage (Table 2).

Table 2.

Descriptive statistics of the respondents.

Attribute	All dental nurses	Infrequently in triage	Frequently in triage	df	t	p, 2-sided
Age (n)	288	164	124
Mean	46.8	45.3	48.7	266.5	−2.433	0.016
Std. Deviation	11.7	11.7	11.6
Median	48.5	44.5	51
Perceived competence in triage tasks ^a (n)	291	165	126
Mean	5.8	5.6	6.2	289.0	−5.771	<0.001
Std. Deviation	0.9	0.9	0.7
Median	6	6	6
Perceived digital competence ^a (n)	292	165	127
Mean	5.4	5.3	5.7	264.7	−3.677	<0.001
Std. Deviation	0.9	0.9	0.9
Median	5	5	6
Nurse’s assessment of patients' competence to describe their symptoms ^b (n)	288	163	125
Mean	3.7	3.6	3.8	283.2	−2.086	0.038
Std. Deviation	0.7	0.7	0.6
Median	4	4	4
				df	X²	p, 2-sided
Work experience as a dental nurse (n)	291	164	127	2	4.073	0.130
5 years or less, %	22.7	26.2	18.1
6 - 10 years, %	12.0	13.4	10.2
More than 10 years, %	65.3	60.4	71.7
Population base entitled to care (n)	289	162	127	1	1.118	0.290
Up to 20,000, %	46.0	48.8	42.5
More than 20,000, %	54.0	51.2	57.5
Electronic patient information system ^c (n)	292	165	127	2	1.685	0.431
IS A, %	13.0	12.1	14.2
IS B, %	64.7	67.9	60.6
IS C, %	22.3	20.0	25.2

^aRated on an ascending scale from 1 to 7.

^bRated on a 5-point Likert scale (1 = strongly disagree — 5 = strongly agree).

^cSix systems classified into three.

Using the electronic patient IS module in triage

Figure 2 presents triage dental nurses’ actual use of the electronic patient IS module for supporting their decision making in triage, recording data for dentists, and recording data for the Institute. The differences in the use between the dental nurses working infrequently in triage and those working frequently were statistically significant for the purposes Supporting decision making in triage (Pearson Chi-Square 11.891; df3; 0.008 two-sided) and Recording data for the Institute (Pearson Chi-Square 16.500; df3; <0.001 two-sided). The difference between the nurse groups using the module for Recording data for dentists was not statistically significant (Pearson Chi-Square 3.834; df3; 0.280 two-sided).

Figure 2.

Dental nurses’ use of the electronic patient IS module for three purposes in telephone triage using Questionnaire score: 1 = not at all, 2 = a little, 3 = somewhat, 4 = much, and 5 = a great deal.

Determinant items of using the module in triage

Table 3 presents how the respondents perceived using the module. Four items revealed differences between the dental nurses who worked infrequently and frequently in triage. The items were 1) Using the IS module improves the quality of my triage tasks, 2) Managers of my dental clinic support me on triage tasks, 3) I have the necessary knowledge to use the IS module, and 4) The IT Helpdesk can help me with IS module problems.

Table 3.

Perceptions on the determinant items of the use of the IS module using a 5-point Likert scale (strongly disagree = 1 — strongly agree = 5).

Determinant item	All dental nurses	Infrequently in triage	Frequently in triage	df	t	p, 2-tailed
Perceived effort (PE)
PE1. Learning to use the IS module has been easy. (n)	291	165	126
Mean	3.9	3.8	4.1	287.2	−2.544	0.011
Std. Deviation	0.8	0.9	0.7
Median	4	4	4
PE2. I find the IS module easy to use. (n)	291	165	126
Mean	3.6	3.4	3.8	283.5	−3.979	<0.001
Std. Deviation	0.9	0.9	0.8
Median	4	4	4
PE3. My interaction with the IS module is clear and understandable. (n)	290	165	125
Mean	3.8	3.7	4.0	275.5	−2.757	0.006
Std. Deviation	0.8	0.8	0.7
Median	4	4	4
Perceived performance (PP)
PP1. I find the IS module useful on triage tasks. (n)	286	162	124
Mean	3.7	3.6	3.8	267.8	−1.424	0.156
Std. Deviation	0.8	0.8	0.8
Median	4	4	4
PP2. Using the IS module enables me to accomplish my triage tasks more quickly. (n)	291	165	126
Mean	3.1	3.0	3.2	278.7	−1.634	0.103
Std. Deviation	1.0	1.0	0.9
Median	3	3	3
PP3. Using the IS module improves the quality of my triage tasks. (n)	290	165	125
Mean	3.5	3.4	3.6	273.9	−1.677	0.095
Std. Deviation	0.8	0.8	0.8
Median	4	3	4
Social influence (SI)
SI1. Dental nurses at my clinic think that I should use the IS module. (n)	282	161	121
Mean	3.2	3.1	3.3	265.8	−1.709	0.089
Std. Deviation	0.9	0.9	0.9
Median	3	3	3
SI2. Dentists at my clinic think that I should use the IS module. (n)	287	164	123
Mean	3.3	3.3	3.3	262.3	−0.802	0.424
Std. Deviation	0.9	0.9	0.9
Median	3	3	3
SI3. Managers of my dental clinic support me on triage tasks. (n)	286	164	122
Mean	3.5	3.4	3.6	239.1	−1.440	0.151
Std. Deviation	1.0	0.9	1.0
Median	4	3	4
Facilitating conditions (FC)
FC1. I have the necessary knowledge to use the IS module. (n)	291	165	126
Mean	4.3	4.2	4.4	277.1	−2.726	0.007
Std. Deviation	0.8	0.8	0.7
Median	4	4	5
FC2. I have the necessary means and instructions to use the IS module. (n)	291	165	126
Mean	4.0	4.0	4.2	288.2	−2.304	0.022
Std. Deviation	0.8	0.9	0.7
Median	4	4	4
FC3. The IT Helpdesk can help me with IS module problems. (n)	290	164	126
Mean	3.5	3.4	3.6	254.8	−1.616	0.107
Std. Deviation	0.9	0.9	1.0
Median	4	3	4

Determinants predicting the module usage in triage

We used binary logistic regression models to predict using the module for I) Supporting decision making in triage (n = 268), II) Recording data for dentists (n = 244), and III) Recording data for the Institute (n = 265). Cronbach’s alphas for the constructs used in the models are presented in Table 4. The Omnibus tests of model coefficients and the Hosmer-Lemeshow statistic indicated that the models fit the data.

Table 4.

Cronbach’s alphas.

Construct	Number of items	Cronbach’s alpha
Perceived effort	3	0.664
Perceived performance	3	0.755
Social influence	3	0.618
Facilitating conditions	3	0.646
Supporting decision making in triage	3	0.918

Supporting decision making in triage

The four predictor variables accounted for a 24.3% change in the outcome variable Supporting decision making in triage based on Nagelkerke’s R². The true negative rate was 67.9%, the true positive rate 61.8%, and the accuracy rate 64.9%. The association between the predictor variable perceived performance and the outcome variable was statistically very highly significant (Table 5). When perceiving the module performance as high, the odds of a dental nurse using the module for supporting decision making in triage were 2.5 times higher than perceiving the module performance as low. In addition, the association between the variable social influence and the outcome variable was statistically highly significant. When perceiving social influence as intense, the odds of a dental nurse using the module for decision making in triage were 1.9 times higher than perceiving social influence as weak.

Table 5.

Model summary for the binary logistic regression model for Supporting decision making in triage.

								95% C.I.for EXP(B)
	Independent variable	B	S.E.	Wald	df	Sig.	Exp(B)	Lower	Upper
Step1^a	Perceived performance	0.902	0.238	14.320	1	<0.001	2.464	1.545	3.931
	Social influence	0.624	0.221	7.976	1	0.005	1.866	1.210	2.876
	Facilitating conditions	0.328	0.286	1.313	1	0.252	1.388	0.792	2.431
	Experience ModFacCon^b	0.278	0.161	2.985	1	0.084	1.321	0.963	1.811
	Age ModFacCon^b	0.130	0.149	0.763	1	0.382	1.139	0.851	1.524
	Perceived effort			4.844	3	0.184
	Perceived effort(1)^c	0.365	1.017	0.128	1	0.720	1.440	0.196	10.578
	Perceived effort(2)^c	−0.600	0.579	1.074	1	0.300	0.549	0.177	1.706
	Perveiced effort(3)^c	−0.836	0.474	3.107	1	0.078	0.433	0.171	1.098
	Constant	−5.829	1.610	13.110	1	<0.001	0.003

^aAll variables entered on step 1.

^bModFacCon = Moderating Facilitating conditions.

^cReference category last.

Recording data for dentists

A 24.0% change in the outcome variable Recording data for dentists can be accounted for by the four predictors used based on Nagelkerke’s R². The true negative rate was 51.1%, the true positive rate 84.2%, and the accuracy rate 71.7%. The association between the predictor variable social influence and the outcome variable was statistically very highly significant (Table 6). When perceiving social influence as intense, the odds of a dental nurse recording data for dentists were 3.2 times higher than perceiving social influence as weak.

Table 6.

Model summary for the binary logistic regression model for Recording data for dentists.

								95% C.I.for EXP(B)
	Independent variable	B	S.E.	Wald	df	Sig.	Exp(B)	Lower	Upper
Step1^a	Perceived performance	−0.272	0.258	1.108	1	0.293	0.762	0.459	1.264
	Social influence	1.152	0.255	20.396	1	<0.001	3.166	1.920	5.220
	Facilitating conditions	0.554	0.312	3.147	1	0.076	1.740	0.944	3.207
	Age ModFacCon^b	0.178	0.150	1.401	1	0.237	1.195	0.890	1.604
	Perceived effort			6.412	3	0.093
	Perceived effort(1)^c	−0.125	1.069	0.014	1	0.907	0.882	0.109	7.166
	Perceived effort(2)^c	−1.312	0.644	4.155	1	0.042	0.269	0.076	0.951
	Perceived effort(3)^c	−0.688	0.533	1.664	1	0.197	0.503	0.177	1.430
	Experience ModFacCon(1)^b,c	−0.601	0.332	3.274	1	0.070	0.548	0.286	1.051
	Constant	−3.372	1.723	3.829	1	0.050	0.034

^aAll variables entered on step 1.

^bModFacCon = Moderating Facilitating conditions.

^cReference category last.

Recording data for the institute

Only an 8.3% change in the outcome variable Recording data for the Institute can be accounted for by the four predictors based on Nagelkerke’s R². The true negative rate was 98.4%, the true positive rate 12.3%, and the accuracy rate 72.1%. Table 7 shows that none of the associations between the predictors and the outcome variable was statistically significant.

Table 7.

Model summary for the binary logistic regression model for Recording data for the Institute.

								95% C.I.for EXP(B)
	Independent variable	B	S.E.	Wald	df	Sig.	Exp(B)	Lower	Upper
Step1^a	Perceived performance	−0.046	0.230	0.039	1	0.843	0.955	0.608	1.500
	Perceived effort	0.316	0.307	1.061	1	0.303	1.372	0.752	2.504
	Social influence	0.264	0.212	1.544	1	0.214	1.302	0.859	1.974
	Facilitating conditions	0.491	0.291	2.849	1	0.091	1.634	0.924	2.890
	Experience ModFacCon^b	−0.168	0.131	1.643	1	0.200	0.846	0.654	1.093
	Age ModFacCon^b	0.225	0.142	2.508	1	0.113	1.253	0.948	1.655
	Constant	−4.774	1.140	17.547	1	<0.001	0.008

^aAll variables entered on step 1.

^bModFacCon = Moderating Facilitating conditions.

Discussion

This cross-sectional study analyzed how dental nurses used the electronic patient IS module in telephone triage and which factors determined this usage. The modules were implemented in oral healthcare organizations’ electronic patient ISs to nationally monitor patient waiting times for public oral care in Finland. In the study, an electronic questionnaire based on a modified UTAUT model²⁹ was used. The results indicate that the dental nurses’ use of the module was positively associated with the frequency of triage work. All nurse groups used the module least for recording data for national-level purposes. Perceived performance and social influence predicted using the module for supporting nurses’ decision making in triage, and social influence also predicted using the module for recording data for dentists.

The UTAUT has been used in healthcare to study the determinants of behavioral intention.³¹ In our study, we used the model adapted from the UTAUT to analyze nurses’ actual use behavior, which has been less studied.³² Our model fitted the data. The changes in the module usage that could be accounted for by the four predictors were not high. In the binary logistic regression models, the values of Nagelkerke’s R² were 8.3, 24.0, and 24.3. The value was the lowest in predicting the usage behavior of recording data for national-level purposes.

Performance expectancy has been the clearest determinant of healthcare professionals’ behavioral intention in earlier studies.^33–37 In our study, perceived performance only determined nurses using the module for supporting their decision making in triage. The items of the determinant perceived performance may explain this. The nurses perceived that module usage increased the quality of their work in triage to assess patients’ dental care needs and to make decisions on treatment priority. On the other hand, recording data for administrative purposes for the national level might have been sparse as nurses perceived that using the module took time. Based on the literature, documentation remains insufficient when nurses work in a hurry,²⁷ and their attitude is more negative toward administrative than clinical documentation.²⁸

Social influence has demonstrated impacts on behavioral intention in earlier research.^38,39,41,42 In our study, social influence determined using the module for recording data for dentists and supporting nurses’ decision making in triage. These usages impact the functioning of the dental clinic for group benefit and the quality of care for patient benefit. Dental nurses working frequently in triage perceived that the dental clinic managers supported them more than other dental nurses and dentists. This finding is in dissonance with earlier study results.³⁴

Digitalizing the national waiting time monitoring system did not guarantee accurate data for national decision making, corresponding to the results found in the Swedish healthcare system.¹² Triage nurses used the module for recording data for national-level purposes sparsely. Insufficient data in the system did not deliver the Institute a trustworthy picture of realized waiting times. The relevance of realized waiting time data in decision making at the national, organizational, and individual levels differs. Oral healthcare managers need waiting time data to manage patient waiting times in their organizations, but most organizations have internal indicators for this purpose.⁸ Neither is the retrospective “completed wait”⁶ the indicator that fits for decision making to manage current situations. For dental nurses and dentists, the purpose-fitting data for decision making concerns individual patients’ dental histories and reasons for seeking treatment.

As there was next to no need for realized waiting time data in oral healthcare organizations, little incentive existed to invest in a new IS and to prepare for organizational changes. Dental nurses were not convinced that digitalizing the monitoring system, which meant more documentation to them, is critical to making decisions on waiting times at the national level. Without understanding this importance and without sufficient guidance to institutionalize usage, dental nurses’ data recording for the population-level purpose was not appropriate in the busy telephone triage work. In dental clinics, communication should be improved to understand changes and motivate behavior. However, dental nurses and dentists consider shortening waiting times crucial for care quality and patient satisfaction.

Practical implications

The IS requirements might be more successful if the national and organizational level actors define them together. Both groups need data on waiting times for decision making, but the purpose-fitting indicators differ. The national system was designed to analyze realized waiting times. The gathered data would have also enabled processing waiting time indicators for decision making on current situations. Participatory system design might have aroused interest among oral healthcare managers in digitalizing the system and introducing simultaneous organizational changes.

The evaluation of the progress of the implementation was neglected. At the time of our study, seven years had passed since the technical implementation, and the system was still not used to its fullest potential.¹⁹ The goals of an IS implementation can be achieved only by using the system appropriately, and assurance of the usage of the new practices is critical.

The dental nurses working frequently in triage perceived their desk- and patient-oriented competencies to be better than other nurses. Either their characteristics differed from the beginning, or their competencies developed while performing these tasks,^43,45 or both. It would be wise to organize shifts in triage so that the number of dental nurses working infrequently on these tasks is low.

Limitations and further research

Our study is not without limitations. Our research was cross-sectional, which means we cannot establish causality. We found that the data recorded for monitoring purposes was not comprehensive, leading to poor-quality data for national-level decision making. However, we cannot confirm whether poor data recording has continued since 2014.

The use of convenience sampling reduced the validity and credibility of our results.⁴⁹ Originally, the research design was a census study, but we did not receive research permits from one-fifth of the oral healthcare organizations. The triage dental nurses who responded to our study questionnaire represented all public primary oral healthcare organizations with different population bases quite well, but their responses may have been influenced by extremely positive or negative views. While we used probability sampling, the possibilities to generalize the study results are limited due to differences in healthcare practices and social and cultural aspects among countries.

The study questionnaire was not validated. The questionnaire items were adapted from analogous questions from Venkatesh et al.²⁹ that were translated into Finnish. The Finnish questionnaire clarity was pre-tested. Measurement errors may have arisen, as we investigated the actual usage of the IS module through nurses’ self-evaluation instead of using logs. The use behavior determinants were surveyed with three commonly used items, but the internal consistency of the determinants was not very high. In general, including more items in each construct improves Cronbach’s alphas but may decrease the response rate. In the spring of 2021, the coronavirus pandemic continued to cause challenges in the public oral healthcare system, which may have lowered the response rate.

We believe that the UTAUT needs further development to better explain and predict IS usage behavior in healthcare. In our opinion, the UTAUT would work better if it included determinants associated with population-level environmental issues. The healthcare system aims at the common good rather than just the individual good. The Theoretical Domains Framework⁵⁰ could help understand behavior changes in IS implementation. The framework is used for implementation in evidence-based healthcare practices, and includes several domains, such as environmental context and resources, and beliefs about consequences, that are suitable as determinants of IS usage behavior in healthcare.

Conclusion

The study results indicate that investments in IS do not necessarily guarantee the achievement of the goals set. The national authority assumed digitalizing the national monitoring system would result in accurate data to monitor waiting times. Nurses, however, did not use the system properly, as they did not understand the importance of recording data for national-level decision making for population benefit when focusing on individual patient benefit. The low system usage resulted in poor-quality data for waiting time monitoring. Healthcare data is increasingly required for national-level decision making, therefore we must ensure that healthcare professionals completing clinical tasks understand the importance of data for population benefit. They must perceive data recording for population-level purposes as meaningful and have sufficient time for data entry.

Supplemental Material

Supplemental material - National waiting time monitoring in oral healthcare – The role of triage dental nurses

Supplemental Material for National waiting time monitoring in oral healthcare – The role of triage dental nurses by Riitta Söderlund in Health Informatics Journal

Footnotes

Acknowledgements

The authors thank the Finnish public primary healthcare organizers for enabling the study.

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Ethical statement

ORCID iD

Riitta Söderlund

Data Availability

According to the privacy policy, the researcher can process the survey data for the time required for her thesis. During this time, the data will not be transferred outside the University of Turku. After that, the data without the credentials is disclosed to the Finnish Social Science Data Archive without conditions for the use of the disclosed materials.*

Supplemental Material

Supplemental material for this article is available online.

References

Connell

NAD

Young

. Evaluating healthcare information systems through an “enterprise” perspective. Inf Manag 2007; 44: 433–440.

OECD . Waiting times for health services: next in line. OECD health policy studies, 28 May 2020. Paris: OECD Publishing. DOI: 10.1787/2074319x (2020, accessed 15 October 2022).

Sundgren

. Documentation and quality in official statistics. In: International Conference on Quality in Official Statistics, Stockholm, Sweden, May 2001. https://www.researchgate.net/profile/Bo-Sundgren/publication/267862808_Documentation_and_Quality_in_Official_Statistics/links/55a55f8d08ae81aec91352f2/Documentation-and-Quality-in-Official-Statistics.pdf (2001, accessed 1 November 2023.)

Barbazza

Klazinga

Kringos

. Exploring the actionability of healthcare performance indicators for quality of care: a qualitative analysis of the literature, expert opinion and user experience. BMJ Qual Saf 2021; 30: 1010–1020.

Martin

Siciliani

Smith

. Socioeconomic inequalities in waiting times for primary care across ten OECD countries. Soc Sci Med 2020; 263: 113230.

Dixon

Siciliani

. Waiting-time targets in the healthcare sector: how long are we waiting? J Health Econ 2009; 28: 1081–1098.

Viberg

Forsberg

Borowitz

, et al. International comparisons of waiting times in health care - limitations and prospects. Health Pol 2013; 112: 53–61.

Stoop

Vrangbæk

Berg

. Theory and practice of waiting time data as a performance indicator in health care. A case study from The Netherlands. Health Pol 2005; 73: 41–51.

Siddins

Boland

Mathews

, et al. Achieving waiting list reform: a pilot program integrating waiting time, category and patient factors. Aust Health Rev 2012; 36: 248–253.

10.

Vrangbæk

Østergren

Birk

, et al. Patient reactions to hospital choice in Norway, Denmark, and Sweden. Health Econ Pol Law 2007; 2: 125–152.

11.

Eisenhardt

. Agency theory: an assessment and review. Acad Manag Rev 1989; 14: 57–74.

12.

Ebbevi

Hasson

Lönnroth

, et al. Challenges to ensuring valid and useful waiting time monitoring – a qualitative study in Swedish specialist care. BMC Health Serv Res 2021; 21: 1024.

13.

Cooper

Zmud

. Information technology implementation research: a technological diffusion approach. Manag Sci 1990; 36: 123–139.

14.

Schultz

Slevin

. Introduction: the implementation problem. In: Doktor

Schultz

Slevin

(eds). The implementation of management science. 1st ed. Amsterdam: North-Holland Publishing Company, 1979, pp. 1–15.

15.

Blumberg

Cater-Steel

Rajaeian

, et al. Effective organisational change to achieve successful ITIL implementation: lessons learned from a multiple case study of large Australian firms. J Enterp Inf Manag 2019; 32: 496–516.

16.

Scott

Sullivan

Staib

. Going digital: a checklist in preparing for hospital-wide electronic medical record implementation and digital transformation. Austr Health Rev 2019; 43: 302–313.

17.

Dwivedi

Wastell

Laumer

, et al. Research on information systems failures and successes: status update and future directions. Inf Syst Front 2015; 17: 143–157.

18.

Lewin

. Frontiers in group dynamics: concept, method and reality in social science; social equilibria and social change. Hum Relat 1947; 1: 5–41.

19.

Sullivan

. Systems planning in the information age. Sloan Manag Rev 1985; 26: 3–12.

20.

Finlex Data Bank . Health care Act 31.12.2010/1326, https://www.finlex.fi/en/laki/kaannokset/2010/en20101326 (2010, accessed 15 October 2022).

21.

Finlex Data Bank . Laki Terveyden ja hyvinvoinnin laitoksesta 31.10.2008/668. (Act on Institute for Health and Welfare 31.10.2008/668.) Laki Terveyden ja hyvinvoinnin laitoksesta 668/2008 - Ajantasainen lainsäädäntö - FINLEX ® (2008, accessed 15 October 2022). Finnish.

22.

Finlex Data Bank . Laki sosiaali- ja terveydenhuollon asiakastietojen sähköisestä käsittelystä 9.2.2007/159. (Act on electronic processing of client data in healthcare and social services 9.2.2007/159.). Laki sosiaali- ja terveydenhuollon asiakastietojen… 159/2007 - Säädökset alkuperäisinä - FINLEX ® (2007, accessed 15 October 2022). Finnish.

23.

Mölläri

Saukkonen

S-M

. Terveyden ja hyvinvoinnin laitos. Avohilmon laatuprosessi, joulukuu 2020. (Quality process of Avohilmo, December 2020.) https://yhteistyotilat.fi/wiki08/display/JULAVLA/4+Ohjeistus (2020, accessed 16 October 2022. Finnish).

24.

Naiker

FitzGerald

Dulhunty

, et al. Time to wait: a systematic review of strategies that affect out-patient waiting times. Aust Health Rev 2018; 42: 286–293.

25.

Tapp

. Inhibitors and facilitators to documentation of nursing practice. West J Nurs Res 1990; 12: 229–240.

26.

Olivares Bøgeskov

Grimshaw-Aagaard

SLS

. Essential task or meaningless burden? Nurses’ perceptions of the value of documentation. Nord J Nurs Res 2019; 39: 9–19.

27.

Mamogobo

Mbombi

Mutshatshi

, et al. Record-keeping : challenges experienced by nurses in selected public hospitals. Curationis 2018; 41: 1–6.

28.

De Groot

De Veer

AJE

Munster

, et al. Nursing documentation and its relationship with perceived nursing workload: a mixed-methods study among community nurses. BMC Nurs 2022; 21: 34.

29.

Venkatesh

Morris

Davis

, et al. User acceptance of information technology: toward a unified view. MIS Q 2003; 27: 425–478.

30.

Häkkinen

Mölläri

Saukkonen

A-M

, et al. Terveyden ja hyvinvoinnin laitos. Hilmo - sosiaali- ja terveydenhuollon hoitoilmoitus 2020: Määrittelyt ja ohjeistus: Voimassa 1.1.2020 alkaen: Ohjaus 7/2019. (Hilmo - Social and healthcare treatment notice 2020: Definitions and instructions: Valid from January 1, 2020: Guidance 7/2019.) https://www.julkari.fi/handle/10024/138288 (2019, accessed 14 September 2022). Finnish.

31.

Alqudah

Al-Emran

Shaalan

. Technology acceptance in healthcare: a systematic review. Appl Sci 2021; 11: 10537.

32.

Ovwasa

. An appraisal of nursing informatics research and the influence of the unified theory of acceptance and use of technology. Libr Philos Pract 2020; 2020: 1–18.

33.

Barchielli

Marullo

Bonciani

, et al. Nurses and the acceptance of innovations in technology-intensive contexts: the need for tailored management strategies. BMC Health Serv Res 2021; 21: 639.

34.

De Benedictis

Lettieri

Gastaldi

, et al. Electronic medical records implementation in hospital: an empirical investigation of individual and organizational determinants. PLoS One 2020; 15: e0234108.

35.

Kim

Lee

K-H

Hwang

, et al. Analysis of the factors influencing healthcare professionals’ adoption of mobile electronic medical record (EMR) using the unified theory of acceptance and use of technology (UTAUT) in a tertiary hospital. BMC Med Inf Decis Making 2016; 16: 12.

36.

Owusu Kwateng

Darko-Larbi

Amanor

. A modified UTAUT2 for the study of telemedicine adoption. Int J Healthc Manag. Epub ahead of print 11 July 2022. DOI: 10.1080/20479700.2022.2088068.

37.

Zha

Liu

Tang

, et al. Acceptance of clinical decision support system to prevent venous thromboembolism among nurses: an extension of the UTAUT model. BMC Med Inf Decis Making 2022; 22: 221.

38.

Mukred

Singh

Mohd Satar

. Examining the influence of perceived need on the adoption of information system in public hospitals in Yemen. APJITM 2020; 9: 35–49.

39.

Pan

Gao

. Determinants of the behavioral intention to use a mobile nursing application by nurses in China. BMC Health Serv Res 2021; 21: 228.

40.

Maillet

Mathieu

Sicotte

. Modeling factors explaining the acceptance, actual use and satisfaction of nurses using an Electronic Patient Record in acute care settings: an extension of the UTAUT. Int J Med Inf 2015; 84: 36–47.

41.

Zhou

Owusu-Marfo

Asante

, et al. Assessment of the social influence and facilitating conditions that support nurses' adoption of hospital electronic information management systems (HEIMS) in Ghana using the unified theory of acceptance and use of technology (UTAUT) model. BMC Med Inf Decis Making 2019; 19: 230.

42.

Barzegari

Ghazisaeedi

Askarian

, et al. Hospital information system acceptance among the educational hospitals. J Nurs Midwifery Sci 2020; 7: 186–193.

43.

Pettinari

Jessopp

. Your ears become your eyes': managing the absence of visibility in NHS Direct. J Adv Nurs 2001; 36(5): 668–675.

44.

Derkx

Rethans

J-JE

Maiburg

, et al. Quality of communication during telephone triage at Dutch out-of-hours centres. Patient Educ Couns 2009; 74(2): 174–178.

45.

Snell

Grimwood

. The recruitment, retention and development of an integrated urgent care telephone triage workforce: a small-scale study. J Integr Care 2022; 30(1): 20–27.

46.

Norman

. Likert scales, levels of measurement and the “laws” of statistics. Adv Health Sci Educ Theory Pract 2010; 15(5): 625–632.

47.

Hulin

Cudeck

Netemeyer

, et al. Measurement. J Consum Psychol 2001; 10: 55–69.

48.

Box

GEP

Tidwell

. Transformation of the independent variables. Technometrics 1962; 4(4): 531–550.

49.

Henry

. Practical sampling. 1st ed. Newbury Park, CA: Sage cop., 1990, pp. 17–32.

50.

Michie

Johnston

Abraham

, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care 2005; 14(1): 26–33.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.27 MB