Abstract
Objectives
The aim of this study was to investigate the reliability and responsiveness of the Feline Musculoskeletal Pain Index (FMPI) using the collective results of multiple clinical studies and iteratively refine the FMPI for future use.
Methods
Data were compiled from previously conducted studies involving client-owned cats with degenerative joint disease (DJD) and which used the FMPI. The reliability of the FMPI was assessed using the data from the initial visits of those studies. For the assessment of responsiveness of the FMPI, only placebo-controlled studies that used analgesic treatments were included. Treatment groups from each study were combined and categorized as ‘placebo’ group and ‘analgesic’ group. Then, the mean change from baseline in score of each FMPI item and across all items within and between these groups were assessed. Based on the results of the reliability and responsiveness of the FMPI, stepwise elimination was used to remove the items that were least able to distinguish between the placebo and analgesic groups. Finally, after the stepwise elimination, a proposed new FMPI-short form (FMPI-sf) was constructed and its reliability was reassessed using the data sets described above. Individual and combined data sets of the studies were also used to compare the responsiveness of the original FMPI and the FMPI-sf.
Results
The data from 180 cats from four studies were included. The original FMPI had a reasonable reliability, but low/no responsiveness. The elimination process of FMPI items refined the responsiveness of the instrument while maintaining its reliability. When the responsiveness was compared between the original FMPI (17 items) and the FMPI-sf (nine items), the treatment effect between groups was always greater when the FMPI-sf was used.
Conclusions and relevance
The proposed FMPI-sf may be able to better distinguish between placebo and analgesic effects in cats with DJD.
Keywords
Introduction
As veterinary healthcare has advanced, many companion animals are living longer and the prevalence of chronic conditions has increased. In cats, one of the most common chronic conditions is degenerative joint disease (DJD); this condition is associated with negative consequences including pain, mobility impairment and decreased quality of life. 1 Research studies investigating DJD in cats have demonstrated that this condition is common, with an estimated 30–90% of cats affected with radiographic signs, and up to 45% of all cats affected with at least moderate clinical signs associated with chronic pain.2–6 As such, assessment of chronic pain should be considered fundamental to feline medicine; however, the behavioral changes present with DJD-associated pain develop gradually, are often subtle and may be most evident in the home environment. Thus, in spite of the high prevalence of disease in cats, DJD remains underdiagnosed and undertreated. 7
Several recent studies have described the development of tools for assessing chronic pain in cats, including objective measures such as activity monitoring and gait analysis.8–11 These tools show promise, but have practical limitations for clinical use. Thus, the detection of behavioral changes still relies heavily on owner report. Clinical metrology instruments (CMIs) have been designed to standardize the collection of owner reports and facilitate clinical research. There are currently four owner-completed CMIs for use in cats with DJD;12–16 these are the Feline Musculoskeletal Pain Index (FMPI), Client Specific Outcome Measure (CSOM), Montreal Instrument for Cat Arthritis Testing (MI-CAT), and the Feline Physical Function Formula (FPFF).
The FMPI is the most widely studied of the CMIs; it has been evaluated for construct validity, internal consistency, reliability and discriminatory ability. 16 In its most recent version, 17 it consists of a series of 17 fixed items regarding individual behaviors likely to be affected by DJD-associated pain. 14 Owners are asked to rate their cat’s ability to perform each of these behaviors on a Likert scale, and summary scores are generated based on their responses. To date, one weakness of the FMPI is a relative lack of responsiveness (ability to detect the effect of an analgesic treatment) in the form of clinically relevant changes, compared with placebo treatment, after administration of analgesics, particularly when other outcome assessments such as accelerometry have shown an effect. 14
As the FMPI has been used as an outcome assessment in several recent studies, this is an appropriate time for refinement of the FMPI.14,18,19 All 17 items included in the current version of the FMPI were selected based on significant differences in answers obtained from owners of cats with DJD-associated pain compared with owners of healthy, non-painful cats; however, not all items may be responsive to treatment effects. In addition, growing awareness of DJD and associated pain in cats is likely to drive interest in owner assessments and development of novel therapeutics. Thus, the objective of this study is to investigate the reliability and responsiveness of the FMPI using the collective results of multiple clinical studies and iteratively refine the FMPI for future use.
Materials and methods
This study used data collected previously at the Translational Research in Pain (TRiP) Program (formerly the Comparative Pain Research Laboratory) at North Carolina State University (NCSU). All data were collected in accordance with the Institutional Care and Use Committee guidelines (IACUC #s 06-056; 08-124; 08-125; 11-102; 14-009; 14-043), and procedures were carried out under informed, written owner consent. The work in the original studies involved the use of only client-owned cats, and followed established internationally recognized best practice standards of individual veterinary clinical patient care.
Study overview
To investigate the reliability and responsiveness of the FMPI, we used data from three published studies14,18,19 and one unpublished study that included client-owned cats with DJD and which used the FMPI; details are shown in Table 1. These included studies focused on CMI development 14 and studies evaluating the efficacy of potential therapeutics (supplement, low-dose non-steroidal anti-inflammatory drug [NSAID; low-dose] 18 , and anti-nerve growth factor antibody [antibody] 19 ). In these studies, all cats had a history of DJD-related mobility impairment and joint pain detected during veterinary orthopedic examination. The presence of DJD was confirmed by radio-graphs and radiographic features considered indicative of the presence of DJD including osteophytes, enthesophytes, sclerosis, subluxation and mineralization. In each study, cats did not receive any analgesics for at least 2 weeks prior to study enrollment. All owners of cats that participated in the studies signed a study consent form before enrollment and agreed that patient data could be used for research. All cats enrolled in the previous studies were included in the present study; however, cats were excluded from analysis if FMPI data were not available.
Studies used to evaluate the reliability of Feline Musculoskeletal Pain Index (FMPI) items and which analyses each study was included in (internal consistency, test-retest reliability and Bland–Altman analysis). The time interval between visits and number of cats in each analysis are also shown
Four cats were excluded at the baseline visit in the CMI study because they did not meet study inclusion criteria of that study
Internal consistency, test-retest reliability and repeatability were assessed to investigate the reliability of the FMPI (see Table 2 for brief definitions of terms). For internal consistency, data from the initial visit were evaluated. In the supplement data, the FMPI was not repeated before cats started receiving treatment; therefore, this study was included only for the evaluation of internal consistency. In the other studies, the FMPI was repeated 2 weeks after the initial visit at the end of the baseline period (baseline visit), and these data were used for test-retest reliability and repeatability (Bland–Altman analysis).
Definition of validity testing terms
For the assessment of responsiveness of the FMPI, only studies that used analgesic treatments for musculoskeletal pain were included;14,18,19 therefore, the unpublished supplement trial was excluded from the analysis. The three included studies were all placebo-controlled, double-blind, randomized studies, and all cats were re-assessed 2–3 weeks after treatment (Table 3). The cats that received meloxicam [CMI and low-dose] or anti-nerve growth factor (NGF) monoclonal antibody (mAb) (antibody) were combined and categorized as having received an analgesic (‘analgesic’ group). The cats that received a placebo from each study were combined and categorized as the ‘placebo’ group. The mean change from baseline in score of each FMPI item and across all items within and between these groups were assessed to investigate the responsiveness of the FMPI. Based on the results of the reliability and responsiveness of the FMPI, stepwise elimination was used to remove the items that were least able to distinguish between placebo and analgesic groups. Finally, after the stepwise elimination, a proposed new FMPI-short form (FMPI-sf) was constructed and its reliability was reassessed using the three data sets described above. Individual and combined data sets of three studies were also used to compare the responsiveness of the original FMPI and the new FMPI-sf.
Studies used to evaluate the responsiveness of Feline Musculoskeletal Pain Index (FMPI) items. The number of cats in each study, the analgesic and route of administration and the treatment period between assessments are shown
NGF = nerve growth factor; mAb = monoclonal antibody
To assess the discriminatory ability of the FMPI-sf, FMPI data from musculoskeletally normal cats were also gathered from another published study. 20 The average FMPI score across 17 items and FMPI-sf items that were obtained at the initial visit from normal cats and DJD cats (from the above four studies) were calculated, and then they were compared.
FMPI score conversion
In the included studies, scoring of the FMPI data had been performed in various ways (for statistical reasons) as previously described. 20 To align each study, the scoring for each was converted to a 0–4 scale (0 = activity performed normally; 4 = activity was impossible to perform). For example, if the original study employed a 5 (normal) to 1 (impossible) scale for each item, the data were converted as shown in Table 4.
Example of score conversion of Feline Musculoskeletal Pain Index (FMPI) from the original study to the present study
Statistical analysis
Statistical analysis was performed using JMP software (JMP Pro 14; SAS), except for the calculation of intraclass correlation coefficient (R package version 0.84.1: available at https://cran.r-project.org/web/packages/irr/index.html). Cronbach’s α was used to investigate the internal consistency of each FMPI item and was calculated for FMPI data collected at the initial visit. Interpretation of the data was based on the following criteria: unacceptable (0.5 >α); poor (0.6 >α ⩾0.5); questionable (0.7 >α ⩾0.6); acceptable (0.8 >α ⩾0.7); good (0.9 > α ⩾ 0.8); and excellent (α ⩾0.9).
21
A score above 0.70 was taken as an indication of sufficient homogeneity of the items in the FMPI.
22
Test-retest reliability for all FMPI items was assessed using intraclass correlation coefficient (ICC) and repeatability of each FMPI item was assessed using Bland–Altman analysis. These were calculated between the initial and baseline visits. Strength of agreement was based on: poor (0.0<ICC < 0.2); fair (0.2 ⩽ICC <0.4); moderate (0.4 ⩽ICC <0.6); strong (0.6⩽ ICC <0.8); and near complete (0.8 ⩽ICC).
23
A paired
Based on the results of the reliability and responsiveness analyses, the FMPI items were eliminated in a stepwise manner. Selection of items for removal was as follows: first, an item was removed if responsiveness data showed that the placebo effect was larger than the active drug effect. If multiple items had higher placebo effects than active drug effects, we started by removing the item with a higher
Results
Animals
Demographic data are reported in the relevant publications and available from the authors on request. However, there was no difference in age, sex, body weight and scores at the initial visit between placebo and analgesic groups. In this report, we simply report on the number of cats in each evaluation.
Internal consistency of the FMPI
Across studies, 180 cats were included for the evaluation of internal consistency. Table 5 shows the α of each FMPI item and the overall FMPI. As some homes did not have stairs or other pets, the response number varies and the number of responses for each item is shown. Overall, the original FMPI had an α of 0.903, ranging from 0.891 to 0.905 for each item. Four items had an α of more than 0.90 and the others had an α of just below 0.90.
Internal consistency of each Feline Musculoskeletal Pain Index (FMPI) item (n = 180) using Cronbach’s α. Numbers of answers for each item reflect differences in the home environments for some cats (ie, absence of stairs or other pets in a home)
Test-retest reliability and repeatability of the FMPI
Across the studies, 117 cats were included for the evaluation of internal consistency. The ICC for all 17 items was 0.814 (
Bland–Altman analysis of initial to baseline agreement for each Feline Musculoskeletal Pain Index (FMPI) item (n = 117 cats)
Initial and baseline refer to the first and second (respectively) times the FMPI was administered. The difference between the initial and baseline visits were assessed using a paired t-test: a significant difference (
Responsiveness of the FMPI
In total, there were 55 and 62 cats in the placebo group and analgesic group, respectively. There were no significant differences in scores for each item and across 17 items between groups at baseline visit (Table 7).
Comparison of the mean score in each Feline Musculoskeletal Pain Index (FMPI) item between groups at baseline
Higher value = more impairment. Mann–Whitney U tests were used for each item
When compared with the baseline value, a significant treatment effect was seen across many items in both the placebo and analgesic groups (Table 8). Two types of items were of interest from this analysis: (1) items where a significant difference was found between the treatment groups; and (2) items where a significant effect was found within the analgesic group and not the placebo group. Between groups there were significant differences for ‘jump down’ and ‘get up’, favoring the analgesic group, while both ‘stretch’ and ‘grooming’ showed a significant change in the analgesic group and not the placebo group.
Comparison of the mean change (± SD) in score from baseline for each Feline Musculoskeletal Pain Index (FMPI) item within and between groups
Mann–Whitney U tests were used were used for each item when comparing within group. Wilcoxon rank-sum tests was used for each item when comparing between groups, except for the average of 17 items
Negative values = improvement *Significant difference from baseline (
Elimination of FMPI items
No significant difference was seen between the groups across the scores for 17 items.
The change in the placebo group was larger than the change in the analgesic group in six items, and these were removed one by one (Table 9). Additionally, two items were removed due to a relatively small change from baseline or a low prevalence of impairment in our population of cats. After stepwise elimination, nine FMPI items were retained. The nine items that ultimately remained were: jumping up and down; jumping up to kitchen counter; playing with toys; interaction with other pets; getting up from a resting position; sitting down; stretching; and grooming.
Elimination process of Feline Musculoskeletal Pain Index (FMPI) items, and the comparison of the mean change from baseline across the remaining items and the group difference
Wilcoxon rank-sum tests were used for each item. Negative value = improvement; NA = not applicable
Significant difference (
Comparing the 17-item FMPI and nine-item FMPI-sf
The mean FMPI score across the 17-item FMPI for the DJD cats was 1.51 ± 0.65 and for the normal cats (n = 16) was 0.004 ± 0.015. The mean FMPI score across the nine-item FMPI-sf for the DJD cats was 1.78 ± 0.76 and for the normal cats was zero. There was a significant difference between the DJD cats and the normal cats in both the 17-item FMPI (
When the original 17-item FMPI and the nine-item FMPI-sf (see the ‘Feline Musculoskeletal Pain Index – short form’ in the supplementary material) were compared in three studies, the difference in the mean change from baseline score between groups was always greater when the FMPI-sf was used (Table 10). In the antibody study (anti-NGF mAb), the significance was seen for both the original FMPI and the FMPI-sf; however, the difference between groups was greater with the FMPI-sf. In contrast, in the two studies using an NSAID, while the difference between groups was greater using the FMPI-sf, significance was not reached in either study. After the reduction of items, the ICC was 0.837 (
Comparison of the mean change from baseline in Feline Musculoskeletal Pain Index (FMPI) score between groups, when using the 17-item FMPI and nine-item FMPI
Wilcoxon rank-sum tests were used for the CMI and antibody studies, and paired t-tests were used for the Low-dose study
Significant difference (
Internal consistency of each Feline Musculoskeletal Pain Index-short form (FMPI-sf) item (n = 117) using Cronbach’s α
Discussion
In this study, we used a data-driven approach to assess the reliability and responsiveness of the original FMPI, and subsequently refined the instrument to improve the responsiveness. The original 17-item FMPI seemed to have a reasonable reliability, but low/no responsiveness. The FMPI-sf was constructed by reducing the number of items from 17 to nine, which increased the responsiveness of the instrument while maintaining its reliability. Thus, the proposed FMPI-sf may be able to better distinguish between placebo and analgesic effects in cats with DJD. However, a future prospective study is needed to further assess responsiveness.
Consistent with previous work, our results showed that the original 17-item FMPI seems to have an excellent internal consistency with an overall α of more than 0.90.16,24 Generally, better internal consistency is reflected by a higher α. However, in empirical studies, a maximum α value of 0.90 has been recommended as optimal. 22 If items have an α of more than 0.90, it suggests there may be redundancies in the questionnaire, and the number of items could be reduced. 22 The α values for each item in the original FMPI were all near or above 0.90, while those of the FMPI-sf are below 0.90.
Overall, the original 17-item FMPI seems to have a reasonable reliability. In this study, the ICC between the initial and baseline visits across the 17 FMPI items was in near-complete agreement (0.814), and this result was similar to the previous study. 14 Based on paired t-tests, there were significant differences in two items between the scores at the initial and baseline visits (ability to ‘walk/move’ and ‘stretch’). In both cases, scores for the baseline visits were higher (indicating more impairment); this may be explained by increased owner attention to the performance of these behaviors after filling out the FMPI at the initial visit. These results were corroborated by the Bland–Altman bias scores, where the bias was close to zero across each of the individual items and the total score, and the limits of agreement encompassed the majority of the points. The least agreement was seen with scores between one and two; ratings of cats at the extremes of the scale were in close agreement. However, overall differences were relatively small, suggesting that the FMPI results from the initial visit could serve as the baseline value.
Previous studies have investigated which behaviors are responsive to analgesic treatment in cats with DJD and associated pain.25,26 Although no placebo group was included for comparison, these studies showed that owner-rated positive changes were seen in some behaviors including jumping, gait stiffness, grooming habits and temperament. Indeed, in the present study, a significant treatment effect was observed in the majority of items in the 17-item FMPI in cats receiving analgesics. However, similar changes were also detected in cats receiving placebo. As a consequence, there was no significant difference in FMPI scores across 17 items between these groups. The lack of responsiveness may be explained by the caregiver placebo effects, known to be high in studies of client-owned cats with DJD. 17 This effect appears to be higher than in similar studies with dogs. Our results, showing improvement in the placebo group for most FMPI items, highlights the difficulty in developing outcome assessments for use with cats. The FMPI-sf should be tested in new clinical trials using known analgesics.
After the stepwise elimination of FMPI items, nine items were retained to construct the FMPI-sf. As shown, the FMPI-sf had an acceptable reliability, similar to the original FMPI. Therefore, the reliability of the instrument did not suffer in any way from the reduction of items and the procedures described above improved responsiveness of the instrument while maintaining the reliability.
The original FMPI was clearly able to discriminate between musculoskeletally normal cats and mildly to severely impaired DJD cats. 24 The FMPI-sf also showed good discriminatory ability when applied to our data. However, this should be confirmed in a study using a new cohort of affected animals and healthy controls. Furthermore, placebo-controlled studies using NSAIDs failed to demonstrate responsiveness of the original FMPI in cats with DJD-associated pain. When the original FMPI and the FMPI-sf were compared for the individual studies (CMI, low-dose, antibody), the difference in the mean change from baseline score between groups of cats with DJD pain that were treated with placebo or active treatment was always greater when the FMPI-sf was used. This difference (treatment effect) was significant when cats were given an anti-NGF mAb, but not when given an NSAID. We do not know if this difference in detected efficacy is due to a true difference between treatments or to features of the study design, or a combination of both. There was a difference in patient populations between the CMI study and the other studies; the CMI study included mildly to severely impaired cats, and more than half of the population were mildly impaired. In contrast, the other studies enrolled moderate to severely impaired cats (resulting in recruitment of more highly impaired cats than the CMI study). Therefore, the improvement after treatment might be less easily detected in the CMI study. Overall, the responsiveness appears to be improved when the FMPI-sf is used.
Recently, our research group proposed a clinical checklist that could be used to identify cats likely to have DJD-associated pain. 20 The checklist was derived from the FMPI and 17 items were reduced to six items based on the sensitivity and specificity of each item. All six items involved movement and included: running; jumping up; jumping down; stairs up; stairs down; and playing with toys. On the other hand, the FMPI-sf contains items that involve not only movement but also the owner’s rating of their cat’s ability to perform the activities of daily living and social relationships. While the checklist serves as an effective screening tool, this highlights that chronic pain impacts multiple dimensions in cats, and behavioral changes in those dimensions need to be assessed in outcome measures. 27
As an important limitation, this study is a retrospective design and includes data from studies that were performed in only a single site, which could result in a case selection bias. Prospective studies using the FMPI-sf will evaluate the performance of the instrument in other populations of cats. Further, future work will investigate the FMPI-sf’s relationship with objective outcome measures including activity monitoring and gait analysis.
Conclusions
The present retrospective study showed that the original FMPI seemed to have a reasonable reliability, but low/no responsiveness. The stepwise elimination of items was performed to refine the responsiveness of FMPI, and the FMPI-sf was proposed. The proposed FMP-sf seemed to have better responsiveness while maintaining its reliability. Although a future prospective study is needed, the proposed FMPI-sf may be able to better detect analgesic effects in cats with DJD.
Supplemental Material
sj-pdf-1-jfm-10.1177_1098612X211011984 – Supplemental material for Refinement of the Feline Musculoskeletal Pain Index (FMPI) and development of the short-form FMPI
Supplemental material, sj-pdf-1-jfm-10.1177_1098612X211011984 for Refinement of the Feline Musculoskeletal Pain Index (FMPI) and development of the short-form FMPI by Masataka Enomoto, B Duncan X Lascelles, James B Robertson and Margaret E Gruen in Journal of Feline Medicine and Surgery
Supplemental Material
sj-pdf-2-jfm-10.1177_1098612X211011984 – Supplemental material for Refinement of the Feline Musculoskeletal Pain Index (FMPI) and development of the short-form FMPI
Supplemental material, sj-pdf-2-jfm-10.1177_1098612X211011984 for Refinement of the Feline Musculoskeletal Pain Index (FMPI) and development of the short-form FMPI by Masataka Enomoto, B Duncan X Lascelles, James B Robertson and Margaret E Gruen in Journal of Feline Medicine and Surgery
Footnotes
Acknowledgements
The authors acknowledge all the cat owners and referring veterinarians who participated in these studies. They especially thank Andrea Thomson for her assistance in conducting these studies.
Supplementary material
The following files are available online:
Supplementary Figure 1: Bland–Altman plots for FMPI items (showing the mean difference (+/– 1.96 SD) between the initial and baseline visits.
Feline Musculoskeletal Pain Index – short form with instructions.
Conflict of interest
The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: MEG and BDXL are both paid consultants for Zoetis. This study (analysis of previously collected data) was funded by Zoetis. MEG has current funding from Zoetis for other (unrelated) research. BDXL has a $0 collaborative research agreement with Zoetis for other (unrelated) work. Zoetis did not participate in developing the concept nor design of the study, nor in the analysis of the data nor writing of the manuscript.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: this study was supported by Zoetis in the form of salary support for ME.
Ethical approval
The work described in this manuscript involved the use of non-experimental (owned or unowned) animals. Established internationally recognised high standards (‘best practice’) of veterinary clinical care for the individual patient were always followed and/or this work involved the use of cadavers. Ethical approval from a committee was therefore not specifically required for publication in
Informed consent
Informed consent (verbal or written) was obtained from the owner or legal custodian of all animal(s) described in this work (experimental or non-experimental animals, including cadavers) for all procedure(s) undertaken (prospective or retrospective studies). No animals or people are identifiable within this publication, and therefore additional informed consent for publication was not required.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
