Abstract
Background:
The lack of specific prosthetic-related outcome instruments for Spanish amputees must be addressed.
Objective:
To elaborate a culturally equivalent version of the Prosthesis Evaluation Questionnaire in the Spanish language.
Study design:
Cross-cultural questionnaire validation.
Methods:
Two-step process for cultural adaptation: forward and backward translations of English original and Spanish translated versions; assessment of both construct and criterion validity and reliability in a group of vascular amputees.
Results:
A total of 61 patients were recruited, 44 men (72.1%) and 17 women (27.9%), with a median age of 71.1 years (standard deviation: 7.7 years; range: 51–87 years). In the Prosthesis Evaluation Questionnaire–Spanish, the lowest scores were for gait and frustration, and the highest scores were for noise and stump health. Internal consistency of the questionnaire was acceptable (>0.70) for four of the scales used in the Prosthesis Evaluation Questionnaire but poor (<0.50) for the scales relating to appearance and stump health. Correlations with the quality-of-life levels as measured by the Short Form–36 were positive and mostly significant.
Conclusion:
Prosthesis Evaluation Questionnaire–Spanish could assess the quality of life in patients who have undergone vascular amputations and then been fitted with a prosthetic limb. The questionnaire shows adequate criteria validity when compared with other instruments for measuring quality of life.
Clinical relevance
The Prosthesis Evaluation Questionnaire–Spanish could be a valid and reliable instrument for assessing adaptation to prostheses in vascular amputees. The questionnaire adds information relevant to the patient and the physician and may identify cases with poor expected adaptation to the prosthesis.
Background
Amputation is associated with greatly increased morbidity and mortality rates.1,2 The majority of amputations are carried out on patients with peripheral arterial disease, a chronic illness whose most important risk factors include male sex, advanced age, smoking, coronary disease, high blood pressure, dyslipidemia, and diabetes. 3 In the developed world, amputations with a vascular origin constitute approximately 80% of all amputation procedures performed. 4
In total, 15% of amputees die within the first year after the procedure. With regard to survivors, although 70% reportedly return home and are living independently within 1 year of the procedure, their functional level is low5,6 since very few patients display the clinical conditions necessary for regaining a normal level of autonomy.4,5 In this process, the fitting of a prosthetic limb and patient acceptance of the prosthesis both play an important role.
The most common barriers to fitting a patient with a prosthesis have been identified as death of the patient, reamputation, cerebrovascular diseases, and cognitive deficiencies, 7 along with perceived pain in the ghost limb. 8
To date, most of the tools developed for assessing prosthesis use have been written in English for use in countries within the cultural context of the English-speaking world. 9 Given the universal nature of the problem, however, these tools need to be adapted for use in diverse countries with different languages and cultural norms. 10
Recently, two questionnaires have been developed for assessing both prosthesis use and the mobility of patients who have undergone lower limb amputation, namely, the Prosthetic Profile of the Amputee (PPA)11–13 and the Prosthesis Evaluation Questionnaire (PEQ).14,15
The PPA contemplates most of the disability levels established by the World Health Organization, with an additional, exhaustive section on prosthetic and orthotic categories. Its major disadvantage is that it is cumbersome to administer. Together with the Day Scale, it alone includes how frequently the prosthesis is actually used by the patient.
The PEQ was developed by Legro et al. 15 in 1998 to evaluate patient prosthesis use, the quality of life related to having a prosthesis, and other associated categories. It was specifically designed for use in patients who had undergone lower limb amputation. The PEQ is a self-assessment tool composed of nine validated scales: ambulation, appearance, frustration, perceived response, residual limb, social burden, noise, usefulness, and ability to bear weight.
The goal of this study is to elaborate a culturally equivalent version of the PEQ in the Spanish language for use with Spanish amputees who have been fitted with a prosthesis. To do so, we have evaluated the internal consistency, the criteria validity, and the reliability of the translated PEQ.
Methods
This is a wholly descriptive and exploratory study in that it marks the first time that the PEQ has been used on a representative sample of vascular amputees in Spain. The stages used in adapting the English version to Spanish were as follows: translation and back-translation stages. We followed the recommendations of Guillemin et al. 16 for carrying out a cross-cultural adaptation of the dimensions related to quality of life.
Translator selection
First phase (translation from English to Spanish): Two bilingual translators (Spanish and English), both native speakers of Spanish, were chosen. The translators were unaware of the objective of this study. Although they were familiar with medical and health-related terminology, they were not part of the research group.
Second phase (back-translation from Spanish to English): Two bilingual translators (English and Spanish), native speakers of US English, were chosen; The translators were unaware of the goal of this study and were unfamiliar with medical and health-related terminology.
The translators worked independently, aware that they were to translate the text freely rather than literally in order to guarantee a semantic and conceptual equivalent to the original text.
Objectives and constitution of the review committee for the various translations
A committee comprising four experts in the field was established, with special importance given to bilingual members. The items which had been rated more difficult to translate and those for which no consensus was reached with regard to their semantic and conceptual equivalence were discussed with the original author of the PEQ. After this revision phase, a first draft of the PEQ-Spanish was obtained and labeled “version 1.0.”
Assessment of the validity and reliability on a sample group of patients
The final version of the questionnaire was administered to a group of patients selected on the basis of the following criteria:
Patients who had undergone a vascular amputation and who had been fitted with a prosthesis;
Patients over 18 years of age;
Patients who had given their informed consent to participate in the study;
Patients with their cognitive faculties intact;
Patients with no severe visual impairments;
Patients for whom there was a minimum amount of administrative data for categorizing each case.
Recruitment centers
Participants were recruited from the Rehabilitaion Unit of the Xativa and Ontinyent Hospitals, both in the province of Valencia.
The sample comprised 61 patients (44 men and 17 women). The procedure was carried out as follows:
Recruitment appointment: Explanation of the project and obtaining of informed consent; Collection of sociodemographic data as well as data on the type of pathology, stage, and so on.
First physical therapy (PT) appointment: Administration of the PEQ-Spanish version 1.0. Most questions on the PEQ use a visual analog scale (VAS) format, which is scored as a continuous numeric variable that measures the distance in millimeters from the left end point of the line. To rate an item, the patient must make a mark on any point of the line. This format is neither common nor easily understandable for most patients, especially the elderly and those with a lower educational background. This is a clear disadvantage since a questionnaire should be easy to complete without help. For these reasons, EVA of version 1.0 was replaced with a numerical rating from 0 to 10, where 0 was “is not able” and 10 was “no problem”; Administration of other scales to assess the construct validity and convergences (the Short Form–36 (SF-36) and Yesavage questionnaires); Collection of data from the physical examination and psychological testing carried out on the patient.
Assessment of reliability or internal consistency
The internal reliability of the questionnaire was assessed by calculating Cronbach’s alpha coefficient, with a coefficient above 0.8 indicating an adequate level of internal consistency.
Ethical approval
This study was approved by the Clinical Research Ethics Committee at our hospital prior to initiating data collection.
Analysis strategy
The associations between the various scales and dimensions (PEQ, SF-36, and Yesavage) were assessed with Spearman’s ρ coefficient for non-parametric correlations. The level of significance was established as p < 0.05. The data obtained were analyzed with the aid of the PASW 18.0 software package (SPSS, Inc.).
Results
In all, 61 patients were recruited, 44 men (72.1%) and 17 women (27.9%), with a median age of 71.1 years (standard deviation (SD): 7.7 years; range: 51–87 years).
Of the total number of study participants, two-thirds lived in rural areas (an urban area was considered to be a town with more than 30,000 inhabitants). Most of the recruited patients were retired and had only received a primary school education. Moreover, although more than half had not been born in their current town of residence, the majority said that they both understood and spoke the regional language, Valencian (Table 1).
Description of sociodemographic variables.
The predominant underlying disease was diabetes mellitus (78%), followed by arterial ischemia (20.3%). The level of amputation was mostly transfemoral (91.4%). The SF-36 questionnaire showed generally high levels, especially in Role Physical, Social Function, and Role Emotional (Table 2).
Descriptive statistics of the dimensions of the SF-36 questionnaire.
SF-36: Short Form–36.
The average and mean scores obtained with the scale for geriatric depression were 12 points, which falls within the category of “probable depression,” with values ranging between 1 and 22 points. Table 3 summarizes the nine scales included in the PEQ; the lowest scores were for the scales referring to gait and frustration, whereas the highest scores were for noise and residual limb. The internal consistency of the questionnaire was acceptable (>0.70) for four of the scales used in the PEQ but poor (<0.50) for the scales relating to appearance and residual limb (Table 4).
Descriptive statistics of PEQ scales.
PEQ: Prosthesis Evaluation Questionnaire.
Analysis of the internal consistency of PEQ scales.
PEQ: Prosthesis Evaluation Questionnaire.
The correlations of the quality-of-life levels according to the SF-36 and the corresponding scales in the PEQ were positive and mostly significant, especially with regard to the scales of utility, ability to bear weight, frustration, social burden, and ambulation (Table 5).
Non-parametric correlations between dimensions of the PEQ and the SF-36 questionnaire.
PEQ: Prosthesis Evaluation Questionnaire; SF-36: Short Form–36.
p < 0.05; **p < 0.001; Bold indicate correlations with a ρ > 0.50.
Negative correlations were obtained between the SF-36/PEQ and the Yesavage scale, that is, the higher the scores for quality of life and adaptation to the prosthetic limb, the lower the levels of depression (Table 6). Unfortunately, the test–retest reliability of the questionnaire could not be assessed as it was impossible to re-administer the questionnaire after 3 months.
Non-parametric correlations between dimensions of the PEQ and the SF-36 questionnaires with the Yesavage geriatric depression scale.
PEQ: Prosthesis Evaluation Questionnaire; SF-36: Short Form–36.
p < 0.05; **p < 0.001.
Discussion
With this study, we have elaborated a culturally equivalent questionnaire to the PEQ to assess the quality of life in patients who have undergone vascular amputations and then been fitted with a prosthetic limb. The questionnaire shows adequate criteria validity when compared with other instruments for measuring quality of life, such as the SF-36 and the Yesavage scale for geriatric depression.
This is the first study to validate a questionnaire of this type in Spanish with the author’s permission. To date, similar validation studies have only been carried out in two European countries—Italy 17 and the Netherlands 18 —and recently on an Arabic-speaking population. 19
All four studies used the same questionnaire, either for its derivation or creation 15 or for its validation.17–19 Nevertheless, some methodological differences between the studies deserve mention, especially with regard to the type of patients included, the tools or scales used to compare patients, the number of patients recruited, and the manner in which data were collected and field work was carried out.
Selection criteria used
Apart from choosing adult patients with sufficient cognitive capacity to answer the items on the questionnaire, there are more differences than similarities between the four studies with regard to subject selection. For example, our study and the study conducted in the Netherlands both focused on vascular amputees. The American and Italian studies were carried out with substantially younger populations, with the latter focusing on patients between 20 and 28 years of age. It is thus difficult to compare the results of the various studies, as they represent different study populations and underlying diseases.
The pathologies or comorbidities associated with the need for amputation were similar in all studies, with a predominance of diabetes mellitus and peripheral vascular disease. These types of pathologies were also the main reason for performing a transfemoral amputation in our study. In contrast, in the study carried out in the United States, almost two-thirds of the amputations were transtibial, due to the fact that most of the cases were trauma-related. The validation of the Arabic version of the questionnaire was also carried out on amputees, although the reason for the amputation was not specified.
With regard to distribution by sex, all four studies showed a clear predominance of men over women, with the difference ranging from 65.2% in the Dutch cohort up to 85.9% in Legro and colleagues’ initial study.
Sample sizes
The Italian study was by far the largest, with 123 patients, followed by Legro and colleagues’ study, which included 92 subjects. Our study, with 61 patients, had the third largest sample size, while the Dutch and Arabic studies only examined 23 and 7 patients, respectively. With the exception of the Arabic study, all these sample sizes are sufficiently large to test the principal hypotheses put forth in each study; however, they lose statistical power when subgroups are compared. In our study, this may explain the observed lack of significant differences in the levels of adaptation to the prosthetic limb between various sociodemographic and cultural variables.
PEQ scales used/validated
The original study validated nine scales: four on prosthesis function (utility, residual limb, appearance, and noise), one on mobility (ambulation), three on psychosocial issues (perceived response, frustration, and social burden), and one on weight bearing. The Dutch study only used, but did not validate, the mobility scale, while the Italian study only used the scales concerning ambulation and transference questions (PEQ-MS12). Our study and the Arabic version were the only ones to fully adapt and validate the PEQ in a language other than English.
Instruments used in criteria validation
In their original study, Legro et al. used several instruments for validating the PEQ, including the SF-36, currently one of the most well-established scales for assessing a patient’s general state of health. She also used the Sickness Impact Profile (SIP) as a tool to measure the general state of health as one of its domains concerns social interaction, as well as the Profile of Mood States–short form (POMS-sf.), which evaluates patient mood.
The authors of the Dutch study used the Locomotor Capabilities Index (LCI; a subscale of the PPA) and the Timed Up and Go test (TUGT). In a similar fashion, the Italian study compared the values from the PEQ with those from the PPA and the LCI, which is actually a scale of the PPA. In our study, we preferred to utilize validation instruments that were as similar as possible to those used in the original study in order to facilitate comparisons. The Yesavage scale was added because our study population consisted almost solely of geriatric subjects, and this questionnaire has demonstrated its usefulness in assessing elderly patients.20–22
Data collection
The time between carrying out the amputation and conducting the study was fairly heterogeneous among the four studies, from a mean of 12 years in the Dutch study to 38 years in the Italian study and with a wide range of between 1 and 53 years in the American study. In our study, the time between amputation and performing the study was much less; in 50% of the cases, the mean time elapsed was 21 months, while the range was between 6 and 42 months. There were also more subtle reasons for the differences in the various study results, commented on in greater detail below.
In the Dutch study, the functional use of a prosthetic limb 1 year after transtibial amputation was found to be associated with stump health and quality. A tibia length of 12–15 cm from the joint line of the knee correlated with better functionality than shorter tibia lengths. These results underscore the need for meticulous surgical technique and special attention to stump length to ensure good functional results after a transtibial amputation.
The Italian study showed high internal reliability in the test–retest process as well as convergent validity. The results indicate that the new PEQ-MS12/5 scale has psychometric properties which compare favorably with those included in the original PEQ-MS, despite the removal of one item and the simplification of the assessment scale. As expected, several of the threshold values of the 11 categories included in the PEQ-MS showed some alterations and had to be restructured in order to meet the pre-established quality criteria for the evaluation categories. The altered threshold values suggest that the questionnaire is unable to distinguish the subjects’ capabilities as precisely as suggested by the 11 response categories. Proper restructuring typically improves the mean, eliminating the repetition of underutilized assessment classification categories and ensuring that each category represents a different level of capability as compared with the next adjacent level. Thus, one item on the PEQ-MS (“Shower/Bath”) was found to be “unsuitable,” that is, inadequately related to the underlying measurement performed. This mismatch could be due, among other reasons, to the fact that it formed part of another, poorly defined construct or one that was overly sensitive to confounding variables. It was, therefore, proposed that this item be eliminated, both for statistical reasons and for content, since it is a construct that is sensitive to both cultural and environmental factors.
Finally, the Arabic validation, performed on seven patients, showed a high concordance with original English version. Unfortunately, the authors did not test either the reliability or validity of the scale.
Our study has several limitations that deserve comment. Because there were significant difficulties in administering the questionnaire in its original format, we had to make several adjustments, including changing the analog format of the scale to a numerical one and opting for an oral administration of the questionnaire. These changes were driven by the fact that most patients in our study population suffered from poor eyesight and/or did not have the necessary reading comprehension skills. There were also difficulties in having the patients fill out the questionnaires as some patients were functionally illiterate or had serious difficulty in reading the forms.
Of course, oral administration also presents several problems. Thus, in order to minimize bias, we used specially trained interviewers who made certain to use the same methodology for all patients when administering the questionnaire.
The internal consistency was moderate for several dimensions of the questionnaire. A low value for a given index may be due to the small number of items included (some dimensions only included two or three items) or to a true interrelation between items in a more heterogeneous construct. 23 Our results should thus serve as a guide to simplify and condense subsequent versions of this particular questionnaire. Although our results provide valuable information, we feel that improvements can be made in future studies in this field.
First, it would be useful to take into account a wider array of motives and underlying diseases leading to amputation and the subsequent fitting of a prosthesis. In this way, the impact of other explanatory variables could be assessed, including age (extending the range), sex (including pathologies that are not so prevalent in men), and level of amputation (which is surely a determining factor in adaptation to the prosthesis), among others.
Such studies should also be extended to other health areas and cultural environments within Spain by carrying out multicenter studies to include patients from other regions of the country. This would increase the statistical power of the results and rule out chance as a plausible explanation for the associations observed.
Conclusion
The PEQ-Spanish could be useful in assessing the quality of life in Spanish-speaking patients who have undergone amputations, above all of vascular origin, and then been fitted with a prosthetic limb. The questionnaire shows adequate criteria validity when compared with other instruments for measuring quality of life.
Footnotes
Author contribution
All authors contributed equally in the preparation of this manuscript.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
