Abstract
Objective
To develop and psychometrically test a new instrument, the hypoglycaemia problem-solving scale (HPSS), which was designed to measure how well people with diabetes mellitus manage their hypoglycaemia-related problems.
Methods
A cross-sectional survey design approach was used to validate the performance assessment instrument. Patients who had a diagnosis of type 1 or type 2 diabetes mellitus for at least 1 year, who were being treated with insulin and who had experienced at least one hypoglycaemic episode within the previous 6 months were eligible for inclusion in the study.
Results
A total of 313 patients were included in the study. The initial draft of the HPSS included 28 items. After exploratory factor analysis, the 24-item HPSS consisted of seven factors: problem-solving perception, detection control, identifying problem attributes, setting problem-solving goals, seeking preventive strategies, evaluating strategies, and immediate management. The Cronbach’s α for the total HPSS was 0.83.
Conclusions
The HPSS was verified as being valid and reliable. Future studies should further test and improve the instrument to increase its effectiveness in helping people with diabetes manage their hypoglycaemia-related problems.
Introduction
In Taiwan, 1.5 million adult cases of diabetes mellitus were diagnosed, and the condition accounted for 9438 deaths in 2013. 1 A goal of tightly controlling glycaemic levels during diabetes treatment encourages introducing insulin at an earlier stage and using more intensive regimens that may increase the risk of hypoglycaemic episodes and minimize the overall quality of life. 2 Approximately 30%–40% of all patients on insulin regimens experience mild or moderate hypoglycaemic episodes. 3 Hypoglycaemia is a common, potentially avoidable consequence of diabetes treatment and a major barrier to optimizing glycaemic control in people with diabetes. 4 Studies have documented the adverse effects of hypoglycaemia on health-related quality of life and treatment satisfaction including how patients with hypoglycaemia are more affected by diabetes, how they are more influenced by their physical health, impaired glycaemic control, and emotional distress, and how they are more anxious about hypoglycaemia or diabetic complications and tend to increase glycaemic levels occasionally by eating more or injecting less insulin.2,5–7 Improving patients’ self-management ability may mitigate some of the adverse consequences of hypoglycaemia. Enhancing the problem-solving ability of people with hypoglycaemia is essential for determining whether they can administer medications correctly, perform self-monitoring of blood glucose, adjust insulin doses, and know when to ask for assistance. For patients living with diabetes mellitus, symptomatic hypoglycaemia can cause poor blood glucose control and emotional distress; these conditions may affect the ability of patients to cope with hypoglycaemia and may limit their ability to self-manage their diabetes. 2 Healthcare professionals need a better patient-monitoring strategy immediately after a hypoglycaemic event in patients with diabetes. 8
Problem-solving skills and informed decisions regarding diet, exercise and medications will help patients identify hypoglycaemia. 9 Problem-solving is a core skill for self-management in patients with diabetes, involving education and skills training.10,11 Problem-solving is a learned self-management behaviour,12–14 which has long been an effective therapeutic intervention for behavioural change.15,16 Problem-solving training should help patients manage unpredicted glucose changes. 17 Therefore, assessing the problem-solving ability of patients with hypoglycaemia is important for providing better care and for enhancing patients’ ability to self-manage their diabetes.
Diabetes self-management includes skills, behavioural strategies (goal setting, problem-solving), and engagement with emotional concerns.18,19 Problem-solving refers to a mental process that involves discovering, analysing, and solving problems. 15 The strategies used to solve problems depend on the unique situation. Problem-solving is a series of cognitive and behavioural processes, composed of two dimensions: (i) problem orientation, which encompasses the general beliefs and perceptions that people have toward their own problem-solving ability; and (ii) problem-solving skills, which are the strategies that people employ to solve problems. 20 These problem-solving skills are of four major goal-oriented types: (i) problem definition and formation; (ii) generation of alternative solutions; (iii) decision making; and (iv) solution implementation and verification. 20 The problem-solving ability of patients with diabetes mellitus has been correlated with symptom management. 21
The Social Problem-Solving Inventory (SPSI) is the most commonly used instrument to assess the problem-solving abilities of patients with chronic illness (pain and cancer).20,22–25 The Diabetes-specific Problem-Solving Scale (DPSS) was developed to assess the self-management ability of patients with diabetes in terms of diet, exercise, and medication.26–28 However, adequate scales do not exist to assess problem-solving in terms of hypoglycaemia. Given the unique problem-solving skills needed by patients with diabetes faced with hypoglycaemic episodes, this study aimed to develop an objective means of quantifying problem solving in patients with hypoglycaemia and to test the validity and reliability of such an instrument.
Patients and methods
Study design
This cross-sectional, descriptive instrument development study was conducted at the Division of Endocrinology and Metabolism, Department of Internal Medicine, Chang Gung Memorial Hospital, Taoyuan City, Taiwan and the Division of Endocrinology and Metabolism, Department of Internal Medicine, Tri-Service General Hospital, Taipei City, Taiwan between August 2013 and July 2014. Face, content, and divergent validity, along with internal consistency, were measured and exploratory factor analysis done to test construct validity as described in detail below.
Ethical approval to conduct this study was provided by the Institutional Review Boards of the Chang Gung Memorial Hospital, Taoyuan City, Taiwan and The Tri-Service General Hospital, Taipei City, Taiwan (no. 102-3440B and no. 1-103-05-043, respectively). All patients provided written informed consent before data collection.
Participants and setting
A purposive sampling method was applied to recruit patients with diabetes mellitus from the metabolic clinics of the Department of Internal Medicine, Division of Endocrinology and Metabolism, Chang Gung Memorial Hospital, Taoyuan City, Taiwan and the Department of Internal Medicine, Division of Endocrinology and Metabolism, Tri-Service General Hospital, Taipei City, Taiwan. Participant eligibility for the study included the following criteria: (i) age > 20 years (because consent from their legal representative or guardian was not required above this age); (ii) physician diagnosis of type 1 (T1DM) or type 2 diabetes mellitus (T2DM) > 1 year based on the diagnostic criteria of the American Diabetes Association; 29 (iii) at least one hypoglycaemic episode within the previous 6 months (hypoglycaemic episode: blood glucose level < 70 mg/dl or mild hypoglycaemic symptoms of shaking, sweating, drowsiness or behavioural changes); and (iv) treatment with an insulin-based medication regimen. Patients were excluded if they had renal failure, blindness, a severe physical handicap, or were pregnant. A chart review was conducted by trained research staff to obtain values for the clinical outcomes of the diagnosis of diabetes mellitus and the most recent outpatient glycosylated haemoglobin (HbA1c) level. A history of hypoglycaemic episodes was recorded on the same day as the questionnaire was administered. Staff nurses from the metabolic clinics reviewed patient medical charts to identify potential study participants.
Study procedure
The process of instrument development was conducted using the following three steps: (i) construction of the instrument; (ii) testing the instrument for clarity and feasibility for use; and (iii) assessment of the instrument’s validity and reliability. 30 Each step is described in detail below.
Step 1 – construction of the instrument
An instrument was constructed based on to the problem-solving model proposed by D’Zurilla and Nezu. 20 Satisfactory psychometrics have been reported for the original SPSI 31 and its Chinese version. 32 The literature related to problem solving in people with diabetes mellitus was comprehensively reviewed by searching the MEDLINE®, Cumulative Index to Nursing and Allied Health Literature (CINAHL®), and ProQuest databases.13,16,17,27,31,33 Initially, eight interview questions were asked of 18 people with hypoglycaemia. Their responses were used to modify the 28 inventory items. Prior clinical experience, as published in a hypoglycaemia-related qualitative study, was also used to inform construction of the instrument. 2
Step 2 – testing for clarity and feasibility for use
The initial draft of the hypoglycaemia problem-solving scale (HPSS) was constructed and rated by a multidisciplinary group of 11 experts in metabolism, nutrition, healthcare and psychology (see Acknowledgements for details). The experts evaluated the HPSS for content validity. All experts (i) assessed the relevance of the included items and the representativeness of the identified constructs, and (ii) suggested revisions to wording, sequencing, and response alternatives to items.
The initial HPSS consisting of 28 items was administered. Participants used a 5-point Likert-type scale ranging from 0 to 4 to rate the applicability of each item as ‘not at all true of me’ to ‘extremely true of me’ according to their thoughts or behaviours during a hypoglycaemic episode, with higher scores indicating greater levels of problem-solving ability. From these, items were eliminated that participants reported as confusing or that during analysis of the psychometric properties were found to reduce the internal consistency of the subscales. The experts used the Content Validity Index (CVI) to evaluate the level of agreement, which was defined as the sum score of the CVI for each item as divided by the number of items. The CVI for the initial 28-item scale was 0.88. In a pilot study, the recruited participants (n = 30) agreed on the face validity of the developed HPSS, finding it easy to read and comprehend.
Step 3 – assessment of validity and reliability
The correlation between the items and the dimensions, applicability, and clarity of the content was examined by the three authors. The scale items were tested and analysed, and the questionnaires were distributed to all study participants. The construct validity of the HPSS subscale was determined through factor analysis. Cronbach’s α was calculated to demonstrate the subscale’s consistency, and the test–retest reliability over a 2-week interval was calculated to demonstrate its stability. An item analysis was conducted to determine how well each individual item related to other items on the scale, using a corrected item-total correlation of between 0.47 and 0.89 with a correlation over 0.40 as the cut-off to indicate the homogeneity of the item to the overall scale. 34
Statistical analyses
The reliability and validity of the HPSS were examined. Cronbach’s α was used to determine the internal consistency of the scale, and test–retest reliability was performed to examine the consistency and reliability of the scale. Exploratory factor analysis, specifically principal component factor analysis, was performed to extract factors with eigenvalues >1. For the rotation method, varimax, a form of orthogonal rotation, was adopted to determine factor loadings, and a factor loading of >0.5 was selected as the standard according to the concept of practical significance. 35 The Kaiser–Meyer–Olkin (KMO) measure and the Bartlett’s test of sphericity were performed to measure sampling adequacy and test the appropriateness of the factor model. The KMO measures of the scale were between 0.77 and 0.92, and the Bartlett’s test of sphericity was significant, indicating that the data were appropriate for factor analysis. Data were presented as mean ± SD, range or n of patients (%). All statistical analyses were performed using the IBM SPSS Statistics for Windows® package, Version 19.0 (IBM, Armonk, NY, USA). A P-value < 0.05 were considered statistically significant.
Results
Demographic and clinical characteristics of patients (n = 313) with diabetes mellitus who participated in a study to evaluate a new hypoglycaemia problem-solving scale.
Data presented as mean ± SD, range or n of patients (%).
HbA1c, glycosylated haemoglobin.
Results of the principal component analysis that evaluated a new hypoglycaemia problem-solving scale in patients (n = 313) with diabetes mellitus who had experienced hypoglycaemic episodes in the previous 6 months.
Items marked with ‘R’ are negatively worded items and are reversely scored.
In this present study, the reliability of the final 24-item scale was examined using internal consistency and test–retest reliability testing. As shown in Table 2, the Cronbach’s α for the total HPSS was 0.83, with α coefficients for the seven factors ranging from 0.70 to 0.86. Corrected item-total correlations of the 24 items ranged 0.403–0.761. To assess the test–retest reliability, all participants were retested 2 weeks after the initial test. The correlation between the responses of the 313 study participants was 0.81.
Discussion
The results from the current study were primarily based on self-reported symptomatic hypoglycaemia and hypoglycaemic episodes that were corroborated by a blood glucose measurement. Nevertheless, the symptoms experienced were inconsistent between individual patients, which complicated efforts to determine the cause of the hypoglycaemia, particularly in patients with T1DM. 36 These results emphasize the importance of assisting patients in clarifying the process of hypoglycaemic events and encouraging them to practice proactive self-management.
The aim of this study was to develop and test the validity and reliability of the HPSS for people with diabetes mellitus. The findings show a strong factor structure that corresponded logically with the theory and concept of the social problem-solving model developed by D’Zurilla and Goldfried 37 and D’Zurilla and Nezu. 20 Various diabetes problem-solving scales are currently available;20,26–28 however, this is the first study to develop and examine the psychometrics of the hypoglycaemia-specific HPSS. The instrument showed good internal consistency reliability. The overall test–retest reliability was 0.81, suggesting that the HPSS was generally stable.
The HPSS demonstrated satisfactory validity in measuring problem solving in patients with T1DM or T2DM who experienced hypoglycaemia. The scale is easily administered in less than 20 minutes. Instruments used with adult or elderly patients should be concise and brief because of the relatively limited attention span of the participants as well as the many demands on their time when such patients are in the healthcare setting. Although the present study included metabolic outpatients from three geographical areas, the HPSS should be tested in wider geographical areas. Moreover, although the severity of hypoglycaemia differs between inpatients and outpatients, 4 the HPSS can be applied in the future to inpatients with hypoglycaemia. The HPSS involves multiple dimensions that reflect the process of problem-solving for patients with T1DM or T2DM who experience hypoglycaemia. The seven factors involve perceptions of competencies and attitudes when facing hypoglycaemic episodes and also highlight the skill of problem-solving. Problem-solving is defined as a self-directed cognitive-behavioural process by which people attempt to cope with a difficult situation. 37 The model provides a structure for understanding the factors that influence how a person perceives a problem, the relationship between the causes of the problem and the generation of a decision, the choice of behaviours, and the influence of personal beliefs on the problem-solving needed for self-management. 38 However, construct validation is an ongoing process; further testing and expansion of the use of this instrument for people with diabetes mellitus are recommended.
The current results of the exploratory factor analysis showed generally clear factor structures across the seven factors. The highest level of variance was found in the factor ‘problem-solving perception’ (46.32%). Although this factor had a very clear factor structure with higher factor loadings in each item, some items were moderately loaded across the ‘identifying problem attributes’ and ‘evaluating strategies’ factors. These results suggest that patients may need individualized teaching strategies to clarify the causes of hypoglycaemia and evaluate the prevention strategies they may want to use. Participants who cannot identify hypoglycaemia may experience conflict between their seeking coping strategies and their evaluation strategies. Similarly, the model proposed by D’Zurilla and Nezu 20 has four major problem-solving skills: (i) problem definition; (ii) generation of alternative solutions; (iii) decision making; and (iv) solution implementation and verification. Each of these skilled tasks is assumed to contribute uniquely to the discovery or invention of effective solutions, or adaptive ways of coping with particular problematic situations. Diabetes self-management will always be recognized to have some element of trail-and-error or learn-by-doing as patients make ongoing lifestyle adjustments to maintain optimal blood glucose levels. However, healthcare professionals cannot prepare patients to identify problem attributes and generate preventive strategies before they experience a hypoglycaemic event; such strategies are more likely to generate negative attitudes in patients than develop skill sets. Thus, helping patients to identify the causes of hypoglycaemia may increase their skills in developing problem-solving strategies and evaluating problems. In the future, the HPSS can provide healthcare professionals with a rapid means of inspecting the problem-solving ability of patients with hypoglycaemia, enabling them to identify patients who require particular assistance with problem-solving skills and subsequently assisting them in providing suitable training in problem solving.
This present study had several limitations. First, the instrument was developed specifically for patients with diabetes mellitus who experience hypoglycaemia. Therefore, applicability to other symptom-related management is limited. Secondly, the psychometric characteristics of the HPSS should be tested in broader geographical areas to further confirm its validity and reliability. A longitudinal study to assess the predictive validity of the HPSS is also recommended. Thirdly, the discriminant validity and convergent validity were not measured. These may be determined in the future in order to evaluate their effect on problem solving in patients with hypoglycaemia.
In conclusion, providing diabetes education involves not only clinical skills but also skills in understanding the patient’s experience. The HPSS showed satisfactory validity and reliability. This scale may be a helpful reference for healthcare providers to understand the hypoglycaemia-related problem-solving ability of patients with diabetes mellitus and plan effective problem-solving strategies to strengthen those abilities.
Footnotes
Acknowledgements
We are sincerely grateful to the experts in metabolism, nutrition, healthcare and psychology for their content validity work: Li-Min Tsai, Sing-Rong Tsai, Meng-Han Shih, Feng-Xuan Liu, and Ci-Lin LI from the Chang Gung Memorial Hospital, Taoyuan City, Taiwan; Sih-Yu Chen and Chang-Shiun Hsieh from the Tri-Service General Hospital, Taipei City, Taiwan; En-Chang Wu, Mei Chang Yeh, and Yi-Ching Wang from the National Taiwan University Hospital, Taipei City, Taiwan; and Di Pei from the Cardinal Tien Hospital, New Taipei City, Taiwan.
Declaration of conflicting interest
The authors declares that there are no conflicts of interest.
Funding
This research was supported by a grant from the Ministry of Science and Technology, Taiwan (no. NSC 102-2314-B-255-002 -MY3).
