Abstract
BACKGROUND:
Isokinetic evaluation is considered the gold standard in muscle strength measurement due to its sensitivity, intra-dynamometer reproducibility and usefulness in the injury prevention screening and follow up of subjects with musculoskeletal pathologies, neurological disease or after surgical operation. However, can one switch among different isokinetic dynamometers for the purpose of knee muscles evaluation?
OBJECTIVES:
To comprehensively evaluate the compatibility of the isokinetic short concentric and eccentric strength evaluation protocol and of the fatigability resistance evaluation between three different isokinetic devices.
METHODS:
Eighteen recreationally active men underwent three isokinetic knee testing sessions on three different isokinetic devices with 7–10 days of rest between each session. Relative (Pearson’s r product-moment correlation coefficient – PCC) and absolute (standard error of measurement – SEM, Cohen effect sizes (d) and probabilistic inferences – MBI) parameters of reproducibility were determined to assess the inter-dynamometer agreement.
RESULTS:
For the short concentric and eccentric strength evaluation protocol, the extensors in concentric mode and the flexors in eccentric mode can be compared (eventually with transposition formulas provided) between Biodex, Con-Trex and Cybex (almost all PCC
CONCLUSIONS:
Only some of the parameters derived either from the short concentric and eccentric strength evaluation protocol or the fatigability resistance evaluation protocol may be interchangeable providing transposition formulas are applied. Otherwise, isokinetic findings are largely system-dependent save some specific instances.
Keywords
Introduction
Over time, isokinetic testing became the gold standard in muscular strength evaluation due to its sensitivity and intra-dynamometer reproducibility [1, 2, 3, 4, 5] both in research and in the clinical context [6]. Because of its use in the context of longitudinal assessments in the same subject or cross-evaluation in several subjects, it may be necessary to compare data obtained on different devices since researchers and clinicians use different dynamometers. Indeed, the muscular capacities are, among others, often a key element in the follow up of subjects with musculoskeletal pathologies, neurological disease or after surgical operation. In addition to the intra-dynamometer reproducibility, which has previously been shown to be generally good for the most frequently used dynamometers [1, 2, 3, 4, 5, 6], it is also required to assess the inter-dynamometer compatibility or, in other words, the reproducibility of measurements between multiple dynamometers.
The analysis of previous articles [7, 8, 9, 10, 11, 12, 13, 14, 15] reveals non-uniform and non-generalizable conclusions: one shows a good compatibility [9], while the others show a non-uniform compatibility between parameters (PM, MW, power, ratio), muscles (knee extensors or flexors) and speed [7, 8, 10, 11, 12, 13, 14]. The apparent inconsistencies between these different studies could be explained by the disparities in protocols: different ranges of motion (ROM): 60
However, almost none of these studies has been done recently [8, 9, 10, 11, 12, 13, 14, 15] (only one in the past 10 years [7]), and one wonders whether the technological progress observed in the isokinetic evaluation field resulted in improved compatibility between dynamometers used in clinical and research environments. This question deserves to be treated rigorously and exhaustively. For example, can one freely and without constraints switch between different isokinetic dynamometers for the knee evaluation? Does this switch allow the use of same data or does it mandate the application of transposition formulas? To answer these questions we have compared three devices that cover the largest share of the market: the Biodex System 3 Pro, the Con Trex MJ PM-2 and the Cybex Humac CSMI. in performing an isokinetic concentric and eccentric strength and fatigability evaluation of the knee extensors and flexors.
Methods
Subjects
Eighteen recreationally active men, with no history of knee injury, practicing fewer than six hours of physical activity per week and not involved in specific muscle training of the lower limbs were included in this study. Any drug or medication intake was an exclusion criterion. This study, approved by the Ethics Committee of the University and Faculty Hospital, was conducted in conformity with ethical standards and international laws [16] and with the Helsinki Declaration of 1975, as revised in the year 2000. All subjects were informed about the protocol, submitted to a medical examination and signed an information and consent form. Age, size and body weight means
Experimental design
Three isokinetic testing sessions were carried out with the three isokinetic dynamometers, with seven to ten days of rest between each session, for each subject under the supervision of a single researcher. These were done in randomised order. Identical isokinetic tests were done at the same time of day. To avoid possible effects of a residual fatigue due to recent exercise, subjects were asked to refrain from physical activity for forty-eight hours before each evaluation session. In order to standardize the testing session conditions, the subjects were asked (1) to follow a stable sleep schedule in the three days before the sessions and (2) to abstain from drinking coffee, tea or any other energy drink on the day of the sessions.
Isokinetic dynamometer
The three isokinetic dynamometers were Biodex System 3 Pro (Biodex Medical Systems, Shirley, NY), Con-Trex MJ PM-2 (Con-Trex, CMV AG, Dübendorf, Switzerland) and Cybex Humac CSMI (Computer Sports Medicine Inc., Stoughton, MA). These three devices have excellent reliability: the Biodex has an ICC of 0.99 for position, PM and velocity (3), the ICC is higher than 0.99 (PM and MW) for the Con-Trex (4) and the Cybex has an ICC of at least 0.93 and 0.89 respectively for PM and MW (5).
Protocol
Only the dominant leg, defined as the kicking leg, was tested. The subject was sitting in a seat with the hip flexed at an angle of 90
To ensure familiarisation and to complete the set-up and warm-up, the subjects made submaximal but progressively intensified concentric contractions at 120
The testing protocol included exertions of both knee extensors and flexors at concentric 60
Throughout the fatigability resistance evaluation protocol, subjects were asked to perform at their best from the first repetition, and during each subsequent repetition, all along the full ROM previously determined. To motivate the subjects to develop the highest PM and MW at each repetition, the researcher intensely verbally encouraged them throughout the test [24].
Data analysis
Peak moment (PM in N
For the short concentric and eccentric strength evaluation protocol, only the best repetition was analysed. This was defined as one in which the PM was the highest and was identified separately, whether for flexors and extensors or for angular velocity. In addition to the best repetitions at each angular velocity, we computed and evaluated the inter-dynamometer compatibility of three agonist/antagonist muscle pair ratios: two conventional extensor/flexor ratios calculated for the same speed of concentric contraction (60
For the fatigability resistance evaluation protocol, as previously demonstrated [30], the derived fatigability parameters have an insufficient intra-dynamometer reproducibility for use in the clinical and/or scientific context; therefore they have not been analysed. For the extensors, eleven measured fatigability parameters were used (see Table 1). For the flexors, the total sum and partial sums of ten contractions were analysed, even if their intra-dynamometer (inter-session) reproducibility should be considered with caution [30].
Knee measured fatigability parameters with BR
x
best repetition;
cumulated performance from x
to y
repetition
Knee measured fatigability parameters with BR
The normality of the distribution of the data was verified using the Shapiro-Wilks test. When this was violated, data were log-transformed (provided that the normality of the distribution of log-transformation was verified).
Relative reliability was measured by the Pearson’s r product-moment correlation coefficient (PCC) and linear regression analyses with associated coefficients of determination (
Absolute reliability, related to the variation of the value of a parameter, was assessed by standard error of measurements (SEM) [33, 34] and magnitude-based inferences (MBI) [35]. SEM
For the results’ transposition formulas, a linear equation of the basic form “y
Statistical significance was set at a
Summary table of inter-dynamometer compatibility for short concentric and eccentric strength and fatigability resistance evaluation protocol for each pair of dynamometers analysed (
use without transposition formula;
use with transposition formula;
use without transposition formula at the users’ discretion;
use with transposition formula at the users’ discretion; X
cannot be compared)
Summary table of inter-dynamometer compatibility for short concentric and eccentric strength and fatigability resistance evaluation protocol for each pair of dynamometers analysed (
The data compatibility (PCC with CI 95% and associated
Short concentric strength evaluation protocol
Biodex and Con-Trex
The extensors presented a high relative compatibility; the PCC, whether for the PM or the MW, were almost all higher than 0.8. The criterion for acceptable absolute compatibility was met, although Con-Trex seemed to overvalue the numbers (except for the PM at 60
The flexors had a high relative compatibility, with the PCC at about 0.8 for MW and a moderate relative compatibility with the PCC at about 0.7 for PM. Except for the MW at 60
Biodex and Cybex
The extensors presented a very high relative compatibility, whether for PM or MW, with almost all PCC higher than 0.8. The criterion for acceptable absolute compatibility was met, even though Biodex seems to overvalue the numbers at 240
The flexors presented a weak relative compatibility, whether for PM or MW; the PCC are all lower or just above 0.7. The absolute compatibility was unacceptable, whether for PM or MW. Moreover, the Biodex seemed to overvalue numbers compared to Cybex at 240
Con-Trex and Cybex
The extensors presented, excePM for MW at 240
The flexors presented a high relative compatibility at 60
Short eccentric strength evaluation protocol
Biodex and Con-Trex
The extensors presented a very weak relative compatibility, whether for PM or MW, with PCC lower than 0.6. The absolute compatibility was also very weak, with Biodex values higher than those of the Con-Trex.
The flexors had a high relative compatibility, with PCC higher than 0.8 for PM and MW. Although Biodex seemed to overestimate the values compared to Cybex, the criterion for acceptable absolute compatibility was met for PM and MW.
Biodex and Cybex
The extensors had a very weak relative and absolute compatibility, with PCC lower than 0.6 for PM and MW and an unacceptable absolute compatibility according to the SEM criterion.
The flexors presented a high relative compatibility for PM and a moderate one for MW, with PCC about 0.85 and 0.74 respectively. The absolute compatibility met the acceptance criterion even though the Biodex values were higher than those of Con-Trex.
Con-Trex and Cybex
The extensors presented a very weak relative compatibility for PM and MW, with PCC about 0.5 and 0.6 respectively. The absolute compatibility was unacceptable according to the SEM criterion, whether for PM or MW, for the extensors.
With a PCC of about 0.9 and 0.8 respectively for PM and MW, the flexors had a very high relative com-
Knee extensors and flexors (PM and MW) Pearson’s r [CI 95%], SEM and MBI – Chances of (dis)similarity between dynamometers for the strength profile
Knee extensors and flexors (PM and MW) Pearson’s r [CI 95%], SEM and MBI – Chances of (dis)similarity between dynamometers for the strength profile
Knee extensors (PM and MW) Pearson’s r [CI 95%], SEM and MBI – Chances of (dis)similarity between dynamometers for the fatigability protocol
Coefficients and constants of transposition formulas for strength profile with using advices (
Coefficients and constants of transposition formulas for fatigability protocol with using advices (
patibility. The absolute compatibility met the criterion for acceptable absolute compatibility. Nevertheless, the Con-Trex values were higher than those of Cybex.
Biodex and Con-Trex
The DCR and conventional ratios had a very weak relative and absolute compatibility (unfilled SEM criterion).
Biodex and Cybex
The DCR had a moderate to high relative compatibility, with a PCC of 0.776 [0.484/0.912]; the conventional ratios (at 60
Con-Trex and Cybex
The DCR and conventional ratio at 60
The absolute compatibility was unclear for the DCR, although there seemed to be an 80% chance that the values were similar between Con-Trex and Cybex. The SEM met the criterion for acceptable absolute compatibility for DCR but not for the conventional ones.
Fatigability resistance evaluation protocol
Biodex and Con-Trex
For extensors:
the best repetition ( the first partial sum by five or ten repetitions ( the last partial sum by five or ten repetitions (
The absolute compatibility for extensors was good for the best repetition (
For flexors, the best repetition (
For extensors, the best repetition (
The absolute compatibility for extensors met the criterion to be considered as acceptable, although Biodex seemed to overestimate the values compared to those of Cybex.
ExcePM for the total sum of PM (
Con-Trex and Cybex
For extensors, all measured parameters had a high relative compatibility for PM; only two partial sums (
The SEM met the criterion for acceptable absolute compatibility for almost all parameters (except
The flexors had, whether for PM or MW, a weak relative compatibility for measured parameters, with PCC lower than 0.7 for the fatigability protocol. The absolute compatibility, whether for flexors and extensors or for PM and MW, was very weak. Con-Trex values were higher than the Cybex values for all parameters.
Transposition formulas
The normalisation of the data to allow the comparison between dynamometers, when the relative compatibility is sufficient, is the reason why transposition formulas exist. Logically, the relative reproducibility between modelling values and values of another dynamometer is the same as the relative reproducibility between real values and values of a dynamometer; only the absolute compatibility is modified.
For each pair of dynamometers, for the short concentric and eccentric strength evaluation protocol, there are two transposition formulas for the PM and two for the MW: one for concentric contraction (60
To normalise a value, it must be multiplied by the coefficient and then the constant added. For example, to transpose a partial sum by five repetitions for the extensors PM of 220 N
For the short concentric and eccentric strength evaluation protocol, the transposition formulas, if used in compliance with the recommendations (see Table 5), improve the absolute compatibility:
in 100% of cases for the recommendation “use with transposition formula” by a 45% average increase in the chances of transposed data being similar compared to measured data; in 88% of cases for the recommendation “use with (great) caution transposition formula” by a 25% average increase.
For the fatigability resistance evaluation protocol, if used in compliance with the recommendations (see Table 6), the transposition formulas improve the absolute compatibility in 68% of cases (by a 24% average increase in the chances of transposed data being similar compared to measured data) and in 70% of cases (by a 23% average increase) respectively for the recommendations “use with transposition formula” and “use with (great) caution transposition formula”.
In this study we have evaluated the compatibility of isokinetic concentric and eccentric strength and fatigue evaluation in the knee extensors and flexors amongthree devices that cover the largest share of the actual market. Our objective was not to reconsider the use of a specific brand of dynamometer, but to analyze the inter-dynamometer agreement. The major finding of our study is that compatibility problems still exist and are not yet solved.
Since 1987, a few researchers have assessed the compatibility for the knee isokinetic evaluation with Biodex, Con-Trex or Cybex [7, 8, 9, 10, 11, 12, 13, 14, 15, 42, 43]. Nevertheless, these experimentations:
related non-uniform and non-generalizable conclusions; used different protocols [heterogeneity in range of motion (from 60 to 100), heterogeneity in angular velocities (from 60/s to 300/s), different parameters computed, heterogeneity in number of subjects selected, different gravity compensation and different protocol design]; were performed “simultaneously” on two dynamometers only; Lund, Sondergaard [9] and Greenberger, Wilkowski [42], both using Biodex/Cybex/Kincom, are the only two research teams that have studied three dynamometers for the knee joint [4]; were interested only in the PM and did not analyze the maximal work (MW), with the exception of Keilani, Posch [8], Bandy and McLaughlin [12] and Gross, Huffman [5, 13]; analyzed only the short strength evaluation protocol and did not explore a fatigability resistance evaluation protocol, except for Keilani, Posch [8] in 2007; did not assess the eccentric extensors compatibility, except Araujo Ribeiro Alvares et al. [7].
These observations and conclusions are of significance to clinicians and researchers who perform knee muscles evaluations. Indeed, even if the bilateral comparison can still be realized, several problems related to the lack of compatibility may be encountered:
The DCR has been shown to have some predictive value regarding hamstring injury in different sports [17, 44, 45]. However, if the cut-offs are not calculated specifically on each dynamometer, the risk of false-positives or false-negatives is very important with all the consequences that these results can generate, in particular, a waste of precious time in the rehabilitation/training process or an increased risk of injury. Both of these have the same consequence, a decrease in performance capacity Longitudinal follow-ups during rehabilitation or for preventive objectives, should be carried out on the same dynamometer (single make) otherwiseit will not be possible to use previous data in the control process. This situation is encountered especially during the retesting, during a transfer of a player from one club to another, or if a patient changes hospitals Multicentre studies can only be carried out in locations using the same dynamometer model, otherwise the data cannot be pooled; this limits the interest in a multicentre study. By the same token, meta-analyses should compare data from identical dynamometers or at least categorize the data according to the dynamometer.
The motivation for this study was not only to assess the inter-dynamometer compatibility, but also, if applicable, to design a way to transpose data from one to another device. To our knowledge, transposition formulas have never been proposed before. Usually, the studies concluded that different dynamometers could or could not be compared, but with the present formulas some detour may be possiblelol. Obviously, the transposition formulas were computed from our data, although having avoided over-fitting to ensure the predictive accuracy [46]. They can be refined with an increase in the number of subjects, but the bases are given to all clinicians and researchers. The recommendations (see Tables 5 and 6) can guide all Biodex, Con-Trex and Cybex users, even if applying the formula remains their responsibility.
The main findings emerging from this study are that the extensors in concentric mode and flexors in eccentric mode may be compared (eventually with transposition formulas). Our observations of lower inter-dynamometer reproducibility for flexors in the concentric mode than for extensors in same mode are similar to those of Bosquet, Maquet [23] and Croisier [47] in intra-dynamometer comparison. Their explanation for this finding related to the lack of specificity of the concentric isokinetic testing relative to the physical activity: in sports, the functional role of the hamstrings is to decelerate the lower leg, by eccentric contraction during rapid concentric contractions of the knee extensors, not to produce force by concentric contraction. This specificity deficit could therefore explain a part of their lower reliability during the test. Moreover, the inter-dynamometer reproducibility seems lower for eccentric than concentric contraction, as demonstrated by Impellizzeri, Bizzini [5] and therefore this trend is not surprising in inter-dynamometer.
Due to its importance in hamstring injury [17], the DCR could be compared first between Con-Trex and Cybex (without transposition formula), and second between Biodex and Cybex (with transposition formula).
For the fatigability resistance evaluation protocol, the trends from the inter-dynamometer compatibility analysis with Biodex, Con-Trex and Cybex are that:
for the extensors, the total sum ( for the flexors, the total sum can be compared cautiously for Biodex and Cybex (PM only) and Biodex and Con-Trex (PM and MW).
Globally, Cybex seems to provide lower values than Biodex and Con-Trex. Biodex seems to provide higher values than Con-Trex in eccentric contraction, while the opposite is true for short concentric strength evaluation protocol. During the fatigability resistance evaluation protocol, the Con-Trex seems to overstate values compared to Biodex for flexors; for extensors, the value seems to be equal between the two dynamometers. These observations could be explained by (1) different data compilation processes between the brands and (2) inconsistent comfort of use for the subject between the different dynamometers (different sitting position and different foam thicknesses between the press hold and the tibia, which must absorb the pressure generated by contractions of the extensors). Obviously, an unpleasant sensation could lead (consciously or not) to sub-maximal contractions and thus explain the heterogeneity of the values obtained.
Our values of standard error of measurement [23, 48, 49] for the short concentric and eccentric strength evaluation protocol (not reported) are similar to those of a previous report [7] for extensors and flexors and for both contraction types. Nevertheless, the ICCs were higher than those we measured before (unpublished communication) even though the number of subjects was similar (18 versus 25). As we also conclude, even though the eccentric speed is not the same (60
The sample size was a limitation of this study. Despite the fact that it is in agreement with the recommendation that reliability protocols should be studied in 15–20 subjects [28, 51], further studies are warranted to confirm the present results over a larger sample size. Another limitation was that this study focused only on the knee joint. It would be highly interesting to assess the inter-dynamometer compatibility for other joints. Finally, the findings of the present study, as a precautionary measure, should not be generalized to populations other than healthy male subjects.
Fifty years after the commercial introduction of isokinetic dynamoemetry, individual systems are incompatible with each their in terms of test results. This statement is somewhat qualified by the fact that some parameters of the short concentric and eccentric strength evaluation protocol (extensors in concentric mode and flexors in eccentric mode) or of the fatigability resistance evaluation protocol (total sum for extensors) may be compared, providing transposition formulas are applied.
Despite the transposition formulas the cut-off values and normative data should be individualized for each dynamometer for the setting of parameters. With these values for the relevant parameters, multicentre research studies, meta-analysis papers, and globally multi-devices protocols may be considered with confidence. As such, the present findings can partially explain the differences observed between reported values by different studies in similar populations.
Transposition formula – general considerations
By crossing the statistical data of relative and absolute compatibilities, three major conclusions and subsequent procedures emerge:
if the relative and absolute compatibility is high, the data can be compared between the two dynamometers considered (advices if the relative compatibility is high but the absolute compatibility is insufficient, the data can be compared between the two dynamometers only after considering calculated transposed data by formulas provided (see Tables 5 and 6) (advices if the relative compatibility is insufficient, the data cannot be compared between the two dynamometers considered (advice X explained in the Statistical analysis section).
The transposition formulae are computed by using linear regression for two main reasons: first, because the other regression models do not enhance sensibly the coefficient of determination; and second, to avoid the over-fitting process, which generally reduces predictive accuracy [46].
Author contributions
CONCEPTION: Julien Paulus, Thierry Bury, Jean-François Kaux and Jean-Louis Croisier.
PERFORMANCE OF WORK: Julien Paulus, Jerome Pauls, Laurent Radizzi, Laurent Krecke, Caroline Le Goff and Arnaud Laly.
INTERPRETATION OR ANALYSIS OF DATA: Julien Paulus and Cédric Schwartz.
PREPARATION OF THE MANUSCRIPT: Julien Paulus and Cédric Schwartz.
REVISION FOR IMPORTANT INTELLECTUAL CONTENT: Julien Paulus, Arnaud Laly, Cédric Schwartz and Bénédicte Forthomme.
SUPERVISION: Julien Paulus, Jean-François Kaux and Jean-Louis Croisier.
Ethical considerations
The study was approved by the Institutional Review Board (approval number B707201628078). Informed contentment was obtained from each subject.
Funding
The authors declare no funding.
Footnotes
Acknowledgments
The authors wish to thank the Wallonia-Brussels Federation for their assistance in this study.
Conflict of interest
The authors declare no conflicts of interest in undertaking this study.
