Abstract
Background
The Wolf Motor Function Test (WMFT) and its modified versions are widely used to assess upper limb (UL) function in stroke survivors. However, comprehensive evaluations of its psychometric properties are lacking.
Objective
To perform a systematic review with meta-analysis on the psychometric properties (following the COnsensus-based Standards for the selection of health Measurement INstruments [COSMIN] taxonomy) of the WMFT and modified versions in stroke survivors.
Methods
Six databases were searched until May 2024 for studies examining at least one WMFT measurement property in stroke patients. Two independent reviewers conducted study selection, data extraction, and quality assessment using the COSMIN Risk of Bias checklist and quality of evidence (QoE) with the Grading of Recommendations Assessment, Development, and Evaluation approach. Meta-analyses synthesized psychometric properties reported in at least two studies.
Results
Twenty-five studies (N = 2044) were included. Regarding the WMFT Functional Ability Scale (FAS) and TIME scales, internal consistency (alpha ≥ .88), intra-rater (intraclass correlation coefficient [ICC] ≥ .97) and inter-rater (ICC ≥ .92) reliability, measurement error for TIME, construct validity (strong correlations [r ≥| .64|] with Fugl-Meyer Assessment and Action Research Arm Test), and responsiveness (ES ≥ 0.48) were rated sufficiently with QoE from very low to high. Measurement error for FAS was assessed as inconsistent with moderate QoE, and cross-cultural validity was rated as indeterminate with very low QoE. Content validity was not assessed. Few studies investigated the psychometric properties of the modified versions.
Conclusions
WMFT demonstrates robust psychometric properties in assessing UL function in stroke survivors. While the WMFT-modified versions showed promising properties, further research is needed to use them. Future studies should focus on WMFT measurement error, content, and cross-cultural validity.
Trial Review Registration:
PROSPERO: CRD42021237425.
Keywords
Introduction
Stroke is the second leading cause of death and the third cause of disability worldwide. 1 The majority of stroke survivors suffer from functional impairments affecting their quality of life and burden on society. 2 Upper limb (UL) sensorimotor deficits persist in ~80% of survivors, with only a small percentage showing full functional recovery within 6 months post-stroke. 3 Sensorimotor deficits that may occur following a stroke are characterized by weakness or paralysis, sensory loss, spasticity, and abnormal motor synergies 4 that impact the ability to perform daily activities. 5
Stroke rehabilitation guidelines and the Stroke Recovery and Rehabilitation Roundtable recommend utilizing psychometrically sound outcome measures.6,7 Standardized outcomes are crucial to accurately quantify post-stroke sensorimotor impairments and to support the development and monitoring of personalized treatment plans, enhancing communication among clinicians.7,8
The Wolf Motor Function Test (WMFT) 9 is widely-used to assess post-stroke UL function in clinical and research settings.7,10 According to the International Classification of Functioning, Disability, and Health (ICF) terminology, 11 the WMFT assesses both the UL function and activity domains. It was originally developed to evaluate the clinical effect of constraint-induced movement therapy in stroke and traumatic brain injury survivors with mild-to-moderate UL motor impairments. 9 The WMFT assesses 2 domains of sensorimotor function (i.e., movement quality and motor performance). 12 The original 21-item WMFT 9 was modified to a 17-item scale13,14 (15 function- and 2 strength-based) with tasks arranged by increasing difficulty involving proximal-to-distal joint movements. 15 The 15 functional tasks are scored on a 6-point Likert scale from 0 (does not attempt with involved UL) to 5 (involved UL does attempt; movement appears normal), and time to complete each task is recorded (max 120 seconds per task; when exceeded, a score of 120 is recorded). This yields 2 scores: Functional Ability Score (FAS) rates the quality of task execution out of 75 pt, and TIME reports the total time to complete all tasks. Lower FAS scores indicate greater UL activity limitation, while higher TIME scores reflect worse performance.
Other WMFT versions have been proposed. The 13-item Graded WMFT (gWMFT) was developed to assess moderate-to-severe UL impairments accurately. 16 To improve administration efficiency, a shortened 6-item Streamlined WMFT (sWMFT) version was proposed, targeting individuals at different recovery stages (subacute and chronic). 17 For a description of the WMFT versions, please refer to Supplemental Material 1.
Several studies have assessed the measurement characteristics of WMFT and its modified versions, highlighting the soundness of its psychometric properties.13,14,17 However, to our knowledge, no systematic reviews have yet been conducted to evaluate the extent, methodological quality, and findings of studies investigating WMFT measurement properties. A systematic review with meta-analysis offers the opportunity to synthesize and critically assess the existing evidence, to identify gaps, such as which properties are lacking or insufficient, to resolve inconsistencies, such as different study designs or the use of modified versions, and to provide a comprehensive overview of WMFT psychometric properties.
This review aimed to evaluate the psychometric properties (i.e., reliability, validity, and responsiveness) of WMFT versions in stroke survivors and to provide recommendations for clinical and research use.
Methods
Protocol and Registration
This study followed Cochrane Handbook guidance, 18 adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement 19 and COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines 20 and was prospectively registered on PROSPERO (No: CRD42021237425).
Search Strategy
A systematic search was performed on MEDLINE, CINAHL, EMBASE, PsycINFO, CENTRAL, and Web of Science Core Collection from their inception to May 2024, using COSMIN-based search recommendations 21 (details in Supplemental Material 2). Additional articles were identified through manual searches of reference lists of included and related studies. Google Scholar was also used to search for combinations of tool names and measurement properties. The eligibility of the first 300 titles retrieved was assessed. 22 Before performing the searches, cookies were cleared. 23 No additional limits (e.g., publication date and language) were used.
Inclusion Criteria
To be eligible, studies were required to meet the following criteria based on the PICO framework. Population (P): Post-stroke survivors; Interventions (I): Studies investigating at least one WMFT measurement property, defined according to COSMIN taxonomy, that is, reliability (internal consistency, intra- or inter-rater reliability, and measurement error), validity (content validity, structural validity, construct validity/hypothesis testing, cross-cultural validity/measurement invariance) and responsiveness 24 as defined in Table 1. Comparison (C): No restrictions were applied regarding the presence/type of comparator; studies without a comparator were also eligible. Outcome (O): assessment of one or more WMFT measurement properties. Systematic reviews, non-peer-reviewed articles, letters, and commentaries were excluded.
Measurement Property Definitions.
Note. All the psychometric (measurement) properties are defined according to the COSMIN taxonomy. 24
Study Selection
Two independent reviewers (FN and AU) performed the literature search and study selection. After removing duplicates, titles and abstracts were initially screened using Rayyan software. 25 Then, full texts were retrieved and reviewed for possible final inclusion. Reasons for exclusion were given for each excluded study. Disagreements were resolved through discussion with a third reviewer (LP).
Data Extraction
Two reviewers (FN and LSP) independently extracted the following data: publication year, sample characteristics (i.e., sample size, sex, age, type, and phase of stroke), study characteristics (i.e., country, setting, and inclusion criteria), measurement properties examined, and related results. Disagreements were resolved through consensus with a third reviewer (LP).
Risk of Bias(RoB) Assessment
The RoB assessment, reflecting the methodological quality of each included study investigating the measurement property, was conducted independently by two reviewers (AC and DP) using the COSMIN RoB checklist.26,27 This checklist consists of 10 boxes evaluating the risk of bias across three measurement domains (i.e., reliability, validity, and responsiveness). Each box contains items evaluating various aspects of design requirements and statistical methods. Each item is rated using a 4-point Likert scale, that is, very good, adequate, doubtful, and inadequate quality. The total score was calculated based on the lowest rating for all items within a box (i.e., worst score counts). If multiple measurement properties were assessed, the RoB was evaluated separately for each property. Discrepancies were resolved through a third reviewer (LP). Only boxes referring to the measurement properties of the included studies were used, that is, Box#3 (Structural Validity), Box#4 (Internal Consistency), Box#5 (Cross-Cultural Validity/Measurement Invariance), Box#6 (Reliability), Box#7 (Measurement Error), Box#9 (Hypotheses Testing for Construct Validity), and Box#10 (Responsiveness).
Data Synthesis and Analysis
Study characteristics were summarized using descriptive statistics, and a qualitative synthesis (i.e., a synthesis enabling conclusions about evidence quality) was conducted for each measurement property. Meta-analysis pooled internal consistency, intra- and inter-rater reliability indexes, construct validity correlation, and responsiveness findings. We included all studies in the meta-analysis regardless of their quality. A priori, we required at least two studies investigating the same psychometric property to proceed with the meta-analysis. We performed preliminary data processing before calculating the summary correlation across studies; specifically, multiple correlations within one study (e.g., age group) were averaged (weighted mean), or if a study assessed the same measurement property across more than one group, a weighted mean was computed, thus ensuring that a single study did not disproportionately contribute to the meta-analysis.23,28 To summarize the data, we considered Cronbach’s alpha for internal consistency and intraclass correlation coefficient (ICC), Cohen’s Kappa, weighted linear Kappa, or weighted quadratic Kappa for intra- and inter-rater reliability. Measurement error was assessed by considering the standard error of the measurement (SEM) and minimal detectable change (MDC). For construct validity, Pearson’s or Spearman’s correlation coefficients were examined. For responsiveness, we analyzed the effect sizes (ES) and standardized response means (SRM). The 95% confidence interval (CI) was computed for each statistical index.
Meta-analyses were performed using the “meta” package in R. 29 We estimated correlations using Fisher’s z transformation and applied inverse variance weighting for pooling. Metrics including Cronbach’s alpha, ICC, correlation coefficients, ES, and SRM were pooled using the “metacor” function, while parameters such as SEM and MDC were pooled using the “metamean” function. The variance was estimated using the standard error with a P-value equal to .05. 30 The random effects model, which gives more weight to studies with smaller sample sizes, was utilized to combine the pooled results. The Restricted Maximum Likelihood Estimation was used for τ2 estimation, and Q-profile for estimating confidence intervals of τ2 and τ. 31 Statistical heterogeneity was assessed using I2 statistics, which categorized the heterogeneity as not important (I2 = 0%-40%), substantial (I2 = 30%-60%), or considerable (I2 = 75%-100%). 18 The Egger test and graphical methods were used to investigate the publication bias if ≥10 studies were pooled in each meta-analysis. 32
Measurement Properties Rating
Rating of measurement properties facilitates the interpretation of the results. Measurement properties were evaluated against the Criteria for Good Measurement Properties 33 and rated as being sufficient (+), insufficient (−), or indeterminate (?) (see Supplemental Material 3 for details). To evaluate construct validity, reviewers established a set of a priori hypotheses based on anticipated correlations between constructs evaluated by WMFT and its modified versions and those assessed through comparator measures. WMFT construct validity and the comparator outcome measures were defined according to the ICF. We anticipated that correlations would be ≥.60 for outcomes assessing similar constructs and <.60 for those evaluating unrelated constructs. For responsiveness, a moderate ES (≥0.3) was expected to achieve a sufficient (+) rating. This threshold acknowledges the influence of multiple factors affecting responsiveness (e.g., study design, time points, interventions, and populations). However, it is still meaningful enough to suggest changes in scores. 34 If a study provided multiple results for a single measurement property, an overall rating was assigned based on the following criteria: if ≥75% of the results agreed on a specific rating, that rating was considered as the overall score (either sufficient [+] or insufficient [−]), otherwise, an indeterminate (?) rating was given. 27
Quality of the Evidence (QoE)
The QoE reflects the level of confidence that the pooled or summarized results of each measurement property estimate are trustworthy. For each measurement property, the QoE was independently determined by two reviewers (AC and DP) using the modified Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. 27 Evidence was evaluated as high, moderate, low, or very low considering the RoB (i.e., COSMIN methodological quality), inconsistency, imprecision (i.e., total study sample size), and indirectness (i.e., evidence derived from populations different from the one of interest). Discrepancies were resolved by discussion with a third author (LP). Table 2 shows the definitions of the quality levels. Supplemental Materials 4 reports full details.
Definitions of the Quality of the Evidence.
Note. Details are presented in Supplemental Material 4.
Results
Study Selection
Out of 4127 titles after removing duplicates, twenty-five studies were included in the qualitative synthesis14,15,35-57 and twenty-three in the meta-analysis (Figure 1). Two studies39,40 investigating the sWMFT structural validity could not be pooled due to differences in methodological approaches (i.e., Rasch model, which focuses on the Item Response Theory and assesses the fit of data to the model’s requirements). The list of excluded studies and reasons for exclusion are reported in Supplemental Material 5.

The selection process of the study inclusion.
Study Characteristics
The studies were published between 200114,15 and 2020. 54 About eleven (44.0%; 95% CI [26.3, 63.4]) studies were conducted in Asia,35,36,39,40,44-46,49-51,57 seven (28.0%; 95% CI [13.9, 48.2]) in North America,14,41-43,47,55,56 five (20.0%; 95% CI [8.6, 39.9]) in Europe,15,37,38,52,54 and two (8.0%; 95% CI [2.0, 26.9]) in South America48,53 (Table 1).
The sample size of the included studies was 8 to 360 (median = 48; sum = 2044). Participants were 53 to 71 years old (median = 60 years) and mostly men (64.0%: 95% CI [62.0, 67.0]). The prevalent setting was outpatient (52.0%; 95% CI [33.0, 71.0], Table 3).
Characteristics of the Study Included in the Systematic Review.
Abbreviations: ARAT: Action Research Arm Test; BI: Barthel Index; F: females; FIM: Functional Independence Measure; FMA-UL: Fugl-Meyer Assessment; MMSE: Mini-Mental State Examination; MRC: Medical Research Council; N: number; NIHSS: National Institutes of Health Stroke Scale; NR: not reported; SBMOC: Short Blessed Memory Orientation and Concentration; sFMA-UL: shortened Fugl-Meyer Assessment; UE-STREAM: Upper-Extremity subscale of the Stroke Rehabilitation Assessment of Movement; UL: upper limb; y: years; H, hemorrhagic stroke; I, ischemic stroke.
Outpatients included stroke participants who accessed services without being hospitalized (e.g., private clinics, general medicine clinics, outpatient clinics, or at home), while inpatients referred to patients who were hospitalized (e.g., hospitals, rehabilitation units, neurology departments, or intensive care units).
Age is reported as mean ± standard deviation unless otherwise specified.
Chronicity is reported as mean ± standard deviation in days, months, or years unless otherwise specified. Note that chronicity was classified according to the definitions provided by Bernhardt et al, 58 that is, ES: Early Subacute: 7 d mo; LS: Late Subacute: 3 to 6 mo; Ch: Chronic: >6 mo.
Demographics of the sample are reported in the primary study. 59
Nineteen studies (76.0%; 95% CI [55.8, 88.8]) evaluated the full version of the WMFT,14,15,35-38,41-43,45-47,49-53,55,56 teo (8.0%; 95% CI [2.0, 26.9]) the gWMFT,48,54 and four (16.0%; 95% CI [6.4, 35.7]) the sWMFT.39,40,44,57
Studies assessed internal consistency (N = 9),14,15,37-39,42,52,54,56 intra-rater (N = 9)15,35,37,46,49,52-55 and inter-rater reliability (N = 11),15,35,37,38,41,43,48,49,52-54 measurement error (N = 6),35,38,43,49,50,54 structural validity (N = 3),39,40,56 cross-cultural validity (N = 6),35,37-39,48,53 construct validity (N = 14),35-38,42,44-46,49-52,55,57 responsiveness (N = 7),42,44,45,47,49,50,57 and interpretability (by the minimal clinically important difference [MCID]; N = 3).47,49,50 No studies investigated content validity.
Methodological Quality
RoB assessment was conducted for each study investigating at least one psychometric property. If a study reported multiple psychometric properties, each property was evaluated. The quality of internal consistency was very good for all studies (N = 25).14,15,37-39,42,52,54,56 Studies analyzing intra- and inter-rater reliability showed very good (N = 7),9,38,41,43,49,52,54 adequate (N = 5),15,37,48,53,55 or doubtful (N = 2)35,46 quality. Studies investigating measurement error were very good (N = 4),38,43,49,54 doubtful (N = 1), 35 or inadequate (N = 1). 50 Studies on structural validity were rated as very good (N = 1), 40 adequate (N = 1), 56 and doubtful (N = 1) 39 quality. Cross-cultural validity studies were of inadequate quality (N = 6).35,37-39,48,53 Studies on construct validity had very good (N = 12)35-37,42,44,45,49-52,55,57 or adequate (N = 2)38,46 quality. Studies examining responsiveness had very good (N = 6)42,44,45,47,50,57 or inadequate (N = 1) 49 quality (Table 4).
Quality of the studies and rating of the psychometric proprieties of the studies included in the systematic review.
Abbreviations: FAS, Functional Ability Scale; FASc: Functional Ability Scale for chronic subjects; FASs: Functional Ability Scale for subacute subject.
+: sufficient rating; −: insufficient rating; ?: indeterminate rating; ±: non-consistent.
Cross-cultural transition, according to Beaton et al. 60
Psychometric Properties
Table 5 reports the individual psychometric properties for each WMFT version. Table 6 summarizes the meta-analysis summary results. Supplemental Material 6 to 17 shows the forest plots. Publication bias was not assessed as no meta-analysis included ≥10 studies. Table 7 reports the QoE based on GRADE.
Results of the Studies of the Psychometric Properties of the Wolf Motor Function Test and Its Modified Version Included in the Systematic Review.
Abbreviations: AoU of the MAL, Amount of the Use of the Motor Activity Log; ARAT: Action Research Arm Test; BI: Barthel Index; C, coefficient; ES: effect size; FAS: Functional Ability Scale; FTHUE: Functional Test for the Hemiplegic Upper Extremity; FIM: Functional Independence Measure; FMA-UL: Fugl-Meyer Assessment Upper Limb; ICC: intraclass correlation coefficient; LWK: linear weighted Kappa; mBI: modified Barthel Index; MDC: minimal detectable change; N: number of subjects; QoM of the MAL, quality of the movement of the Motor Activity Log.
G; ρ: Spearman’s rank correlation coefficient; r: Pearson’s correlation coefficient; R, rating; SEM: standard error of the measurement; sFMA-UL: shortened Fugl-Meyer Assessment; SIS: Stroke Impact Scale; SRM: standardized response mean; α:Cronbach’s alpha.
Rating rules were according to Supplemental Material 3.
Value calculated using the data reported in the article.
Value expressed as the mean of multiple values.
Time interval of 2/3 wk.
Time interval of 90 d.
Time interval of 6 mo.
For sub-acute patients.
For chronic patients.
Summary of the Meta-analyses for Each Scale and Each Psychometric Property.
Abbreviations: ARAT: Action Research Arm Test; CI: confidence interval; ES: effect size; FAS: Functional Ability Scale; FMA-UL: Fugl-Meyer Assessment Upper Limb; I2: I2 statistics; ICC, intraclass correlation coefficient; MDC: minimal detectable change; n: number of studies included in the meta-analysis; N: number of studies included; Q: Q-statistics; rho, correlation coefficient; SEM: standard error of the measurement; SRM: standardized response mean; WMFT: Wolf Motor Function Test.
Time interval of 2/3 wk.
Time interval of 90 days.
Quality of the Evidence According to Modified GRADE and Overall Rating of the Psychometric Properties.
Abbreviations: N/A, not available; FAS, Functional Ability Scale.
Not considered for content validity, structural validity, and cross-cultural validity.
No studies were available for structural validity, construct validity, and responsiveness.
No studies were available for reliability, measurement error.
Scores are given based on the modified GRADE criteria defined in Supplemental Material 4. +: sufficient rating; −: insufficient rating; ?: indeterminate rating; ±: inconsistent rating.
Wolf Motor Function Test
Internal Consistency
Six studies15,37,38,42,52,56 investigated WMFT-FAS internal consistency (N = 363) with a pooled Cronbach’s alpha of .97 (95% CI [0.95, 0.98]; I2 = 76%, Table 6, Supplemental Material 6a).
Four studies14,15,37,38 examined the internal consistency of WMFT-TIME (N = 102), with a pooled Cronbach’s alpha of .88 (95% CI [0.83, 0.92]; I2 = 0%, Table 6, Supplemental Material 6b).
The overall rating of the internal consistency was sufficient for FAS and TIME with a high QoE. (Table 7).
Reliability
Intra-rater reliability of WMFT-FAS was investigated in six studies15,46,49,52,53,55 (N = 193). The pooled ICC was 0.97 (95% CI [0.95, 0.98]; I2 = 47%, Table 6, Supplemental Material 7a).
Five studies15,35,46,53,55 explored intra-rater reliability of WMFT-TIME (N = 131), with a pooled ICC of 0.99 (95% CI [0.96, 1.00]; I2 = 86%, Table 6, Supplemental Material 7b).
Inter-rater reliability of WMFT-FAS was investigated in seven studies15,38,41,43,49,52,53 (N = 480), with a pooled ICC of 0.92 (95% CI [0.88, 0.95]; I2 = 85%, Table 6, Supplemental Material 8a).
Five articles15,35,38,43,53 (N = 185) studied the inter-rater reliability of WMFT-TIME. The pooled ICC was 0.99 (95% CI [0.97, 0.99]; I2 = 66%, Table 6, Supplemental Material 8b).
The overall rating for intra- and inter-rater reliability was sufficient for FAS and TIME with a high QoE (Table 7).
Measurement Error
Four studies explored the SEM and MDC of WMFT-FAS38,43,49,50 (N = 227). The pooled SEM was 1.42 pt (95% CI [−0.18, 3.02]; I2 = 99%, Table 6, Supplemental Material 9a), and the pooled MDC was 4.41 pt (95% CI [−0.98, 9.79]; I2 = 99%, Table 6, Supplemental Material 10a).
Four studies35,38,43,50 explored SEM and MDC of the WMFT-TIME (N = 205). The pooled SEM was 7.81 seconds (95% CI [−5.58, 21.20]; I2 = 99%, Table 6, Supplemental Material 9b), and the pooled MDC was 21.69 seconds (95% CI [−15.39, 58.77]; I2 = 99%, Table 6, Supplemental Material 10b).
The overall rating for measurement error was inconsistent for FAS and sufficient for TIME, both with moderate QoE (Table 7).
Structural Validity
Woodbury et al 56 assessed FAS structural validity using confirmatory factor analysis and Rasch analysis, supporting a single-factor structure and found to be sufficient with a moderate QoE (Table 7). The TIME structural validity was not assessed.
Cross-Cultural Validity
Following international recommendations, translation and back-translation processes did not present any major difficulties in adapting to Italian, 37 French, 38 Brazilian-Portuguese,48,53 or Nepali. 35
Overall, cross-cultural validity ratings for WMFT-FAS and TIME were indeterminate, with a very low QoE (Table 7).
Construct Validity
The correlation between the WMFT-FAS and the Action Research Arm Test (ARAT) scores was investigated in five studies42,45,49,51,52 N = 202). The pooled rank correlation coefficient was 0.86 (95% CI [0.76, 0.92]; I2 = 71%, Table 6, Supplemental Material 11a).
Three studies42,45,52 (N = 148) compared WMFT-TIME and ARAT scores. The pooled rank correlation coefficient was −0.77 (95% CI [−0.98, −0.55]; I2 = 83%), Table 6, Supplemental Material 11b).
The correlation between the WMFT-FAS and Fugl-Meyer Assessment-Upper Limb (FMA-UL) scores was assessed in seven studies35,36,38,45,46,49,55 (N = 260), with a pooled rank correlation coefficient of −0.81 (95% CI [−0.90, −0.67]; I2 = 82%, Table 6, Supplemental Material 12a).
Seven studies14,35,36,38,45,46,55 compared WMFT-TIME and FMA-UL scores (N = 260), showing a pooled rank correlation coefficient of −0.81 (95% CI [−0.90, −0.67]; I2 = 97%; Table 6, Supplemental Material 12b).
Ang and Man 36 compared WMFT-FAS and TIME scores with Brunnstrom’s stage and Brunnstrom’s scale and modified Barthel Index scores. Results showed correlations of 0.94 (95% CI [0.89; 0.97]), 0.93 (95% CI [0.88, 0.96]), and 0.53 (95% CI [0.28, 0.71]), respectively, for WMFT-FAS, and −0.90 (95% CI [−0.94, −0.82]), −0.89 (95% CI [−0.94, −0.81]), and −0.60 (95% CI [0.76, −0.37]), respectively, for WMFT-TIME. Hsieh et al 45 reported correlations between WMFT and the Functional Independence Measure scores equal to 0.29 (95% CI [0.03, 0.52]) for FAS and 0.40 (95% CI [0.16, 0,60]) for TIME. Construct validity was also examined by comparing WMFT-FAS and Functional Test for the Hemiplegic Upper Extremity scores, revealing a correlation coefficient of 0.92 (95% CI [0.73, 0.98]). 51 Additionally, a relationship was found between WMFT-FAS and Quality of Movement and Amount of Use Motor Activity Log scores (coefficients: 0.86 (95% CI [0.56, 0.96] and 0.92 (95% CI [0.73, 0.98], respectively). 51
The overall rating of construct validity for the FAS and TIME was sufficient, with a high QoE (Table 7).
Responsiveness
The meta-analysis was stratified based on the time-interval between assessments. The interventions were heterogeneous among the four included studies.42,47,49,50 In Edwards et al 42 and Lang et al, 47 participants underwent either early high-dose (90% of waking hours) or moderate-dose (6 hours) Constraint-Induced Therapy or conventional treatment (e.g., VECTORS trial). Lin et al 49 reported distributed Constraint-Induced Therapy, bilateral arm training, or traditional rehabilitation. Lin et al 50 did not describe the intervention.
All four studies42,47,49,50 reported responsiveness of WMFT-FAS (time interval between assessments, 14-21 days; N = 202) with a pooled ES of 0.76 (95% CI [0.48, 1.05]; I2 = 97%, Table 6, Supplemental Material 13a).
Three studies investigated the responsiveness of WMFT-TIME (time interval between assessments, 14-21 days)42,47,50 (N = 131), with a pooled ES of 0.48 (95% CI [0.34, 0.63]; I2 = 93%, Table 6, Supplemental Material 13b).
Two studies42,49 (N = 82) analyzed the responsiveness of WMFT-FAS (time interval between assessments, 90 days) and had a pooled ES of 1.10 (95% CI [0.07, 2.13]; I2 = 98%, Table 6, Supplemental Material 14a).
The overall responsiveness rating for the FAS and TIME was sufficient, with a high QoE (Table 7).
Feasibility
Two studies42,52 found no evidence of floor or ceiling effects for WMFT-FAS and TIME, whereas one study 49 reported a floor effect in one of four evaluations and a ceiling effect in three of four assessments.
Two studies investigated the MCID of WMFT-FAS and TIME. Lang et al 47 in acute stroke (within 14 days post-stroke) reported FAS MCID raw values of 1.0 point for the dominant UL and 1.2 points for the nondominant UL. They also observed a TIME MCID of −19.0 seconds for the dominant UL. Lin et al 50 in chronic stroke survivors (12.98 ± 87.62 months) found an MCID of 0.33 points and −1.64 seconds for the WMFT-FAS and TIME, respectively.
Graded WMFT
Inter-Rater Reliability
The inter-rater reliability of gWMFT-FAS was studied in two articles48,54 (N = 38). The meta-analysis showed an ICC of 0.98 (95% CI [0.96, 0.99]; I2 = 0%, Table 6, Supplemental Material 15a).
Two studies48,54 reported the inter-rater reliability of gWMFT-TIME (N = 38) with a pooled ICC of 0.99 (95% CI [0.97, 0.99]; I2 = 0%, Table 6, Supplemental Material 15b).
The overall inter-reliability rating was sufficient for FAS and TIME, with a low QoE (Table 4).
Measurement Error
The SEM and MDC of gWMFT-FAS and TIME were reported in one study 54 (N = 21); the SEM was 0.19 pt (95% CI [0.14, 0.23]) and 3.64 pt (95% CI [2.87, 4.41]) for gWMFT-FAS and TIME, respectively. Moreover, the MDC was 0.53 seconds (95% CI [0.42, 0.64]) and 10.09 seconds (95% CI [7.95, 12.23]) for gWMFT-FAS and TIME, respectively.
The overall rating of the measurement error for gWMFT-FAS and TIME with a low QoE was indeterminate (Table 7).
Cross-Cultural Validity
One study 48 translated the gWMFT into Brazilian-Portuguese without cross-cultural adaptation and differential item functioning (DIF) investigation.
The overall rating of cross-cultural validity for gWMFT-FAS and TIME was indeterminate, with a very low QoE (Table 7).
Other Psychometric Properties
Other gWMFT psychometric properties were not assessed.
Feasibility
Two studies48,54 investigated the presence of the ceiling/floor effects. Pereira et al 48 did not report ceiling/floor effects for the gWMFT-FAS. Turtle et al 54 found a floor effect for TIME and FAS at two different assessments.
Streamlined WMFT
Internal Consistency
One study 39 assessed the internal consistency of the sWMFT (N = 172), with a Cronbach’s alpha of .91 (95% CI [0.88, 0.93])
The overall rating of the internal consistency was sufficient for FAS, with a high QoE (Table 7).
Structural Validity
The chronic and subacute versions of sWMFT (6 items, FAS Component) 39 and the combined version (8 items) 40 have sufficient structural validity, demonstrating a one-factor structure through Rasch analysis.
The overall structural validity rating was sufficient for FAS, with a moderate QoE (Table 6).
Cross-Cultural Validity
Measurement invariance had a sufficient rating for DIF in sex, age, or stroke hemispheric location. 39
The overall rating of the cross-cultural validity was sufficient for FAS, with a very low QoE (Table 7).
Construct Validity
Two studies investigated the TIME component.44,57
The overall rating of construct validity was inconsistent for TIME with a moderate QoE (Table 7).
Responsiveness
Two studies44,57 assessed the responsiveness of sWMFT-TIME (N = 115). Fu et al 44 did not report the intervention, while in Wu et al, 57 participants received constraint-induced therapy (CIT), bilateral arm training, or conventional rehabilitation. The combined ES was 0.50 (95% CI [0.45-0.54]; I2 = 15%, Table 6, Supplemental Material 16a), whereas the pooled SRM was 0.35 (95% CI [0.31, 0.39]; I2 = 33%), Table 6, Supplemental Material 17a).
The overall rating of responsiveness was sufficient for TIME, with a high QoE (Table 7).
Other Psychometric Properties
Other sWMFT psychometric properties were not assessed.
Discussion
This study determined the quality of the evidence supporting the use of WMFT for assessing UL function in post-stroke individuals following the COSMIN methodology.20,24,26,27 The review included twenty-five studies involving 2009 participants in clinical and research settings, while the meta-analysis provided quantitative benchmarks (i.e., MDC and ES) for interpreting change scores. Most studies focused on WMFT and found sufficient psychometric properties with very low-to-high QoE. Fewer studies investigated the gWMFT and sWMFT, showing some evidence of their psychometric properties (i.e., sufficient reliability, validity, and responsiveness) with very low-to-high QoE. For WMFT, the FAS and TIME subscales demonstrated high internal consistency and inter- and intra-rater reliability with a high overall QoE. However, the measurement error for FAS and TIME was inconsistent and sufficient, respectively, supported by a moderate QoE. FAS structural validity was rated as moderate, while cross-cultural validity for both subscales was undetermined with very low QoE. Construct validity and responsiveness had high QoE for both subscales. We found sufficient internal consistency and reliability for gWMFT, supported by low QoE, undetermined measurement error and cross-cultural validity with low and very low QoE, respectively. The sWMFT showed high QoE and sufficient internal consistency (FAS) and responsiveness (TIME). Validity ratings were mixed, with structural and construct validity rated as moderate and sufficient, while QoE for cross-cultural validity was very low. Notably, no studies investigated content validity according to COSMIN standards for any version. However, the development studies9,16,17 provided an adequate theoretical framework for the constructs.
Most studies, which had very good methodological quality, supported excellent internal consistency, intra-rater reliability, and inter-rater reliability of WFMT. These findings underscore WMFT reliability, indicating that it produces stable results between assessments in the same patient when evaluated by the same or different evaluators.
FAS and TIME measurement error (i.e., SEM and MDC), however, should be further investigated, as the QoE was moderate for both, and the overall rating was inconsistent for the latter. SEM represents absolute reliability, 61 while MDC defines the margin of error for detecting true changes in the measured construct.61,62 To be rated as sufficient, SEM and MDC should demonstrate values lower than the MCID 33 (Supplemental Material 3). The rating was mostly influenced by studies of very good methodological quality, which reported higher SEM and MDC (in both FAS and TIME components 38 ; one study 50 investigating FAS) in comparison to MCID values retrieved by Lang et al 47 It should be noted that measurement error is computed through distribution-based approaches and is directly influenced by sample intra-subject variability (i.e., MDC depends on SEM, which is a function of the standard deviation of the measured outcome).62,63 Therefore, even in the presence of excellent inter-rater reliability, SEM and MDC values may still be substantial. 61 Overall, pooled results indicated that when administering WMFT-FAS and TIME, a minimum change of 4.41 points and 21.69 seconds, respectively, should be considered as true change beyond systematic and random error. 61
WMFT-FAS and TIME have been rigorously evaluated for construct validity with very good or adequate methodological quality. The a priori hypothesis tests were met for all studies, with most examining the relationship between FMA-UL and ARAT. As expected, the pooled coefficient showed a strong correlation with FMA-UL and ARAT, indicating that WMFT is closely related to both impairment (function)-level constructs (as measured by FMA-UL) and activity-level constructs (as measured by ARAT). 12
WMFT has been translated and adapted into several languages.35,37,38,48,53 Three studies35,37,38 were performed according to guideline recommendations, 60 and one study 53 used a back-to-forward translation. 64 While the reported psychometric properties were rated as sufficient, no study conducted a cross-cultural DIF analysis, 65 with no evidence that the measure is invariant across cultural contexts.61,66 Therefore, caution should be taken when comparing or pooling WMFT scores derived from other countries in secondary studies, as DIF may lead to systematic bias in scoring, 65 especially on self-reported competence (i.e., FAS). No studies investigated DIF regarding demographic or clinical characteristics. Further research is needed to determine whether dominance of the affected UL may influence scale performance, as impaired UL dominance affects functional recovery.67,68 Structural validity was assessed only for FAS, with one methodologically adequate study reporting a sufficient unidimensional construct through Rasch analysis. 56
WMFT showed sufficient ability to detect change over time, making it suitable for tracking motor recovery following interventions. Notably, the pooled results highlighted that ESs were higher in the acute compared to the acute-subacute phase of stroke. Such findings could be explained by the ES = 1.63 41 for WMFT-FAS scores derived from the VECTORS trial, 69 which involved intensive training. Responsiveness is influenced by demographic factors, clinical characteristics, intervention type, and the implementation environment.61,70 We stratified studies by the assessment time window rather than intervention type due to intervention heterogeneity. This approach could enhance the results generalizability, as the interventions ranged from conventional rehabilitation to intensive care. The pooled ES may assist researchers in estimating sample sizes and power for clinical trials and provide benchmarks for interpreting change scores while acknowledging the variability and characteristics of the original studies.
Considering feasibility, all but one study reported no floor or ceiling effects, indicating that the measurement range may be suitable for stroke survivors. The WMFT MCID was investigated in 2 studies47,50 with different stroke chronicity populations, that is, acute 47 and chronic. 50 We suggest considering MCID WMFT values provided by Lang et al, 47 as they were determined through an anchor-based approach with a global rating of perceived changes61,71 following interventions. MCID values are intimately linked to the sample from which they are derived.71,72 Therefore, caution should be used when using these thresholds, as MCID values were derived from an acute stroke population (14 days post-stroke). Individuals’ meaningful improvement expectations may vary across recovery stages.61,73
gWMFT was designed to assess individuals with moderate-to-severe UL impairment. 16 However, limited studies have evaluated its psychometric properties. gWMFT (FAS and TIME) showed sufficient internal consistency and intra- and inter-rater reliability. However, measurement error was indeterminate, and all the remaining properties have not been studied. As a result, while some psychometric properties of the modified versions have been investigated, caution is advised when administering and interpreting gWMFT scores until further evidence is available.
The sWMFT was developed in the EXCITE trial to reduce administration time. 17 Notably, intra- and inter-rater reliability and measurement error were not reported. The unidimensional factor for FAS was successfully studied, with no significant DIF reported for relevant demographic and clinical characteristics. The responsiveness for TIME was rated as sufficient. However, the MCID was not reported. Overall, the sWMFT warrants further investigation, and users should exercise caution as the SEM and MDC are unknown.
Limitations
Our study has some limitations. Publication bias could occur as we did not search study registers and excluded non-peer-reviewed studies. Additionally, we were unable to evaluate it as there were <10 studies in the meta-analysis. However, we searched 6 databases using a sensitive search string (without language or time restrictions) as recommended by COSMIN 21 and prospectively registered the review on PROSPERO. While no librarian was involved in the search process, we retrieved and adopted the search strategy specifically developed by COSMIN for identifying the measurement properties of health outcome measures. 21 Finally, studies where WMFT versions were not primary outcome measures were excluded following COSMIN recommendations. 27
Future Directions
Given the comprehensive evidence supporting its psychometric properties, WMFT is a reliable and valid tool for assessing UL function in stroke survivors. The pooled responsiveness scores may help researchers achieve more precise sample estimations. At the same time, SEM, MDC, and MCID can aid both clinicians and researchers in detecting statistical and clinical changes following interventions, considering the sample from which they were derived. However, a formal study to investigate WMFT content validity is needed, 74 involving evaluation of relevance, comprehensiveness, and comprehensibility, and including all stakeholders, and also to support TIME structural validity.
Future research should investigate complementary methods to assess motor function alongside WMFT by integrating technology that enables more granular assessment. For example, incorporating kinetic and kinematic analysis into specific WMFT items could provide valuable insights into recovery trajectories. The shift toward more detailed evaluations aligns with the growing emphasis on personalized rehabilitation.
Finally, gWMFT and sWMFT provide preliminary evidence of sufficient psychometric properties. However, the lack of more extensive evidence indicates that they should not be preferred over the full version. Future research should focus on filling these gaps in the use of WMFT scales in research and clinical practice.
Conclusions
Our findings showed that the WMFT demonstrated sufficient internal consistency and intra-/inter-rater reliability for both the FAS and TIME components, with a high QoE. Measurement error was inconsistent for WMFT-FAS but sufficient for WMFT-TIME, and both were rated as moderate QoE. Construct validity for FAS and TIME was sufficient, with high QoE. Structural validity was supported for FAS, but no evidence was available for TIME. Cross-cultural validity was rated as indeterminate with very low QoE. Content validity was not formally investigated. Responsiveness was sufficient, with a high QoE.
The gWMFT demonstrated sufficient intra-/inter-rater reliability but indeterminate measurement error and cross-cultural validity, both rated with low QoE. The sWMFT showed sufficient internal consistency, structural validity, and responsiveness for TIME, with moderate-to-high QoE, but lacked evidence on intra-/inter-rater reliability and measurement error. Further studies are needed to strengthen confidence in the full measurement properties of the sWMFT and gWMFT for clinical and research use.
Supplemental Material
sj-docx-1-nnr-10.1177_15459683251327568 – Supplemental material for Psychometric Properties of the Wolf Motor Function Test (WMFT) and Its Modified Versions: A Systematic Review With Meta-Analysis
Supplemental material, sj-docx-1-nnr-10.1177_15459683251327568 for Psychometric Properties of the Wolf Motor Function Test (WMFT) and Its Modified Versions: A Systematic Review With Meta-Analysis by Lorena Sabrina Pometti, Daniele Piscitelli, Alessandro Ugolini, Francesco Ferrarello, Francesco Notturni, Andrea Coppari, Serena Caselli, Fabio La Porta, Mindy F. Levin and Leonardo Pellicciari in Neurorehabilitation and Neural Repair
Footnotes
Author Contributions
Lorena Sabrina Pometti: Data curation; Investigation; Methodology; Writing - original draft; Writing - review & editing. Daniele Piscitelli: Conceptualization; Data curation; Methodology; Writing - original draft; Writing - review & editing. Alessandro Ugolini: Formal analysis; Software; Visualization; Writing - original draft. Francesco Ferrarello: Formal analysis; Investigation; Methodology; Writing - original draft; Writing - review & editing. Francesco Notturni: Investigation; Writing - original draft. Andrea Coppari: Formal analysis; Investigation; Writing - original draft. Serena Caselli: Methodology; Writing - review & editing. Fabio La Porta: Formal analysis; Writing - review & editing. Mindy F. Levin: Methodology; Writing - review & editing. Leonardo Pellicciari: Conceptualization; Methodology; Supervision; Writing - original draft; Writing - review & editing.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Supplementary material for this article is available on the Neurorehabilitation & Neural Repair website along with the online version of this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
