Sage Journals: Discover world-class research

Abstract

Background

Atlas-based voxel features have the potential to aid motor outcome prognostication after stroke, but are seldom used in clinically feasible prediction models. This could be because neuroimaging feature development is a non-standardized, complex, multistep process. This is a barrier to entry for researchers and poses issues for reproducibility and validation in a field of research where sample sizes are typically small.

Objectives

The primary aim of this review is to describe the methodologies currently used in motor outcome prediction studies using atlas-based voxel neuroimaging features. Another aim is to identify neuroanatomical regions commonly used for motor outcome prediction.

Methods

A Preferred Reporting Items for Systematic Reviews and Meta-Analyses protocol was constructed and OVID Medline and Scopus databases were searched for relevant studies. The studies were then screened and details about imaging modality, image acquisition, image normalization, lesion segmentation, region of interest determination, and imaging measures were extracted.

Results

Seventeen studies were included and examined. Common limitations were a lack of detailed reporting on image acquisition and the specific brain templates used for normalization and a lack of clear reasoning behind the atlas or imaging measure selection. A wide variety of sensorimotor regions relate to motor outcomes and there is no consensus use of one single sensorimotor atlas for motor outcome prediction.

Conclusion

There is an ongoing need to validate imaging predictors and further improve methodological techniques and reporting standards in neuroimaging feature development for motor outcome prediction post-stroke.

Keywords

stroke motor recovery motor outcome rehabilitation neuroimaging

Introduction

The development of stroke recovery prediction models can potentially transform stroke rehabilitation practices for the better but remains a challenge.¹ Stroke causes a variety of impairments, of which motor impairment is the most common.² Therefore, many prediction models focus on aspects of motor outcome. The neuroanatomical location of a stroke and its effects on brain connectivity are important features in stroke recovery prediction.^3,4 Despite this, a review of 13 motor outcome prediction models found that only 3 considered specific neuroimaging features as a predictive variable.⁵ To develop more accurate prediction models, it is imperative to consider neuroimaging features and how to implement them into the development pipeline.

Several measures can be derived from neuroimaging, including voxel-based, diffusion, and connectivity features. This review will focus primarily on voxel-based features, meaning that the measures are direct measurements of neuroimaging voxel data such as intensity and location. Voxel-based features can be further sub-divided into data-driven features or atlas-based voxel features.^6,7 Data-driven features refers to techniques such as voxel lesion symptom mapping, where statistical analysis methods are used to find specific relationships between a clinical outcome and imaging data. While it may appear to be that voxel lesion symptom mapping may be superior in predictive performance to atlas-based voxel features, further validation is required.^7,8 This is because voxel lesion symptom mapping methods often suffer from the “curse of dimensionality,” where model accuracy may be inflated by overfitting as every voxel in an image can be considered a feature.⁹ While it is possible to reduce the number of features using feature reduction methods such as principal component analysis, the interpretability of the new features can be challenging.⁷ Atlas-based voxel features quantify the interactions between lesions and specific brain atlases or regions, such as the spatial overlap between the lesion and the corticospinal tract. Therefore, atlas-based voxel features use a priori knowledge such as parcellations of the brain into previously defined units. Notably, data-driven feature-reduced features or atlas-based voxel features can result in different and sometimes conflicting results.¹⁰

When looking at atlas-based voxel features, the pipeline for quantifying these types of voxel-based features has many variable components, such as image acquisition, lesion segmentation, image normalization, atlas selection or creation, and lesion quantification. Each step can be approached in different ways, which could hinder the interpretability of the effectiveness of different prediction models. Therefore, it is important to identify trends and variations in methods in order to move towards a better understanding of existing methodologies for atlas-based voxel feature implementation in prediction models.

Objectives

The primary aim of this review is to describe the methodologies currently used in studies that predict motor outcomes after stroke using atlas-based voxel features. The secondary aim of this review is to identify neuroanatomical regions commonly used to predict motor outcomes after stroke.

Methods

Search Strategy

OVID Medline and Scopus electronic databases were systematically searched for all English language studies with publication/indexing dates up to 24 March 2022 using the following search terms:

Scopus: (TITLE-ABS-KEY (stroke) AND TITLE-ABS-KEY (motor OR “upper limb” OR “lower limb” OR gait OR mobilization) AND TITLE-ABS-KEY (recovery OR rehabilitation) AND TITLE-ABS-KEY (predict*)), OVID MEDLINE: (Hemorrhagic Stroke/or Stroke/OR Embolic Stroke/OR Thrombotic Stroke/ OR stroke.mp. OR Stroke, Lacunar/or Ischemic Stroke/) AND (motor.mp. OR limb.mp. OR Extremities/OR Gait/OR gait.mp. OR mobilisation.mp.) AND (recovery.mp. OR Rehabilitation/ or Rehabilitation.mp. or Stroke Rehabilitation/) AND (predict.mp. OR prediction.mp.).

Search results were collated on Mendeley for duplicate removal and then screened by title and abstract by 1 author (J.Y.) for experimental studies that predicted motor outcomes after stroke using atlas-based voxel features with clinically acquirable neuroimaging modalities. atlas-based voxel features included any features that quantified an interaction between lesion voxels and an atlas. Thus, studies that used only diffusion metrics, such as fractional anisotropy, were excluded. The included modalities were non-contrast computed tomography (CT), T1- and T2-weighted magnetic resonance imaging (MRI), and diffusion-weighted imaging (DWI). All other imaging modalities such as functional MRI or high angular resolution diffusion imaging were excluded. Other exclusion criteria were non-English studies, reviews, case series, and dissertations.

Data Extraction

Key methodological details were extracted based on the CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modeling Studies.¹¹ This included the data source, a brief description of participants, the primary prediction outcome and timepoint, predictor type, sample size, statistical analysis method employed and the results, and whether out-of-sample validation was done. Predictor type was categorized for each feature as either imaging, or other (eg, biochemical and biophysiological). Notably, only the analyses related to atlas-based voxel features were extracted from studies that performed multiple analyses. Strokes were classified as acute within 2 weeks of onset, subacute between 2 weeks and 6 months from onset, and chronic when more than 6 months since onset.

One author (J.Y.) recorded details of the neuroimaging analysis pipeline from each article. Details of the imaging modality, acquisition details, image normalization, lesion segmentation, region of interest determination, and imaging features were documented. The image acquisition details for each study was classified as being reported in full detail, partial detail, or no detail, based on the Committee On Best Practice In Data Analysis and Sharing (COBIDAS) reporting standards.¹² To receive a full detail classification, a study was required to report all of the mandatory COBIDAS standards, that is, special accommodations, scanner name, coil, pulse sequence, imaging type, sequence and imaging parameters, phase encoding, and brain coverage. Studies which reported any acquisition details in addition to the imaging modality were classified as partial detail, while studies which only reported the imaging modality were classified as no detail. Since there are no standard reporting guidelines for CT image acquisition details, we simply documented whether CT studies did or did not report any image acquisition details. Lastly, we documented the sensorimotor regions pertaining to any atlas-based voxel features used in prediction models of motor outcomes after stroke.

Results

Search Results

A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was constructed (Figure 1). 2395 studies were retrieved from the electronic databases and 292 duplicates were automatically removed via Mendeley. One duplicate was additionally removed via manual inspection. Next, 2031 studies were removed via title and abstract screening. Full-text evaluation was performed on the remaining 71 studies, which excluded another 54 studies. The remaining 17 studies were included for review, and are summarized in Tables 1 and 2.^13
-29

Figure 1.

A PRISMA flow diagram of the literature.

Table 1.

Key Details of Included Studies.

Paper	Source of data	Participants	Predicted outcome measures	Last outcome timepoint	Predictor type	Sample size	Statistical analysis	Statistical results
Blackburn et al²⁷ (2021)	RCD, CAq	Children with first arterial ischemic stroke in the MCA territory	Recurrence and Recovery Questionnaire (UE + LE)	At least 6 mo	Imaging	69	Receiver operator curve	AUC = 0.446 (0.281–0.611), P = .483
Bowren et al²⁵ (2022)	RCD, RAq	Adults with acute, first ever symptomatic stroke	Action Research Arm Test	12 mo	Imaging	133	Latent growth curve	Behavioral: R² = .277, AIC = 2603 Structural network: R² = .370, AIC = 2603 Functional network: R² = .192, AIC = 2626 All combined: R² = .379, AIC = 2605
Branco et al²³ (2018)	PCD, CAq	Adults with acute symptomatic stroke in the MCA territory	Stroke Upper Limb Capacity Scale	3 mo	1. Imaging, 2. Imaging + Other	131	1. Receiver operator curve, 2. Multivariate logistic analysis	1. AUC = 0.812 (0.739–0.866), 2. Dichotomized Classification Accuracy = 77.9%
Cassidy et al²² (2018)	RCD, RAq	Adults with subacute-chronic stroke and UE impairment	UE Fugl-Meyer	1 mo post treatment	Imaging	47	Linear regression	r = −.41, P = .004
Feng et al¹⁶ (2015)	PCD, CAq	Adults with acute, first ever ischemic stroke, and UE impairment	UE Fugl-Meyer	3 mo	1. Imaging, 2. Imaging, 3. Imaging + Other	71	1. Receiver operator curve, 2. Univariate linear regression, 3. Multivariate regression	1. Dichotomized classification accuracy = 86%*, 2. R² = .69, 3. R² = .83
Jones et al¹⁸ (2016)	PCD, RAq	Adults with acute-subacute stroke and gait impairment	Average walking speed	6 wk	Imaging + Other	49	Multiple regression	Partial r = −.079, P = .606
Kuceyeski et al¹⁹ (2015)	RCD, RAq	Adults with acute ischemic stroke	Functional Independence Measures - Motor	Time of scan	Imaging	41	Partial least squares regression (fixed-effect)	R² = .34, AIC = −14.15
Lee et al⁴ (2020)	RCD, RAq	Adults with first ever, unilateral, ischemic stroke, and severe UE impairment	UE + LE Fugl-Meyer	3 mo	Imaging + Other	42	Bivariate linear regression	UE R²= 0.233, (P ≤ .001) LE R² = 0.000
Lee et al²¹ (2022)	RCD, RAq	Adults with first ever, unilateral, stroke, and severe UE impairment	UE Fugl-Meyer	3 mo	Imaging	42	1. Univariate linear regression, 2. Multiple linear regression	1. R² = .251, P = .09; 2. R² = .598, P ≤ .001
Lin et al²⁸ (2019)	PCD, CAq	Adults with ischemic stroke and UE impairment	UE Fugl-Meyer	3 mo	Imaging	48	Receiver operator curve	AUC = 0.7–0.8**
Peters et al¹⁵ (2018)	RCD, RAq	Adults with chronic, single left hemispheric stroke	UE + LE Motricity Index	Time of scan	Imaging	1.24, 2.27^†	Multiple linear regression	M1: 1. R² = .43, F = 5.02, P = .09, β_LL = .031, 2. R² = .18, F = 1.63, P = .209, β_LL = .112
Rondina et al¹³ (2017)	RCD, RAq	Adults with chronic, first ever stroke, and severe UE motor impairment	Combined UE motor score	Time of scan	Imaging	30	Support vector machine	CST + Motor regions: Dichotomized classification accuracy = 90%, P = .0002
Salvalaggio et al²⁶ (2020)	RCD, RAq	Adults with acute, first symptomatic stroke	Motor Battery (UE + LE)	Time of scan	Imaging	1.51, 2.57^‡	Ridge regression model	1. R² = Lesion = 0.35, SDC = 0.37, FDC = 0.12; 2. R² = Lesion = 0.28, SDC = 0.42, FDC = 0.08
Saltão da Silva et al¹⁴ (2022)	RCD, CAq	Adults with first ever stroke and UE impairment	Action Research Arm Test	3 mo	Imaging + Other	34	Classification and regression tree	3-category classification accuracy = 88.2%
Stinear et al²⁹ (2017)	RCD, RAq	Adults with acute stroke and motor impairment	Action Research Arm Test	3 mo	Imaging + Clinical	207	Classification and regression tree	4-category classification accuracy = 75%
Tozlu et al²⁰ (2020)	RCD, RAq	Adults with acute-chronic, first ever stroke with motor impairment	UE Fugl-Meyer	6 wk post treatment	Imaging + Other	102	1. Elastic net model, 2. Supper vector machine, 3. Artificial neural network, 4. Classification and regression tree, 5. Random forest, and 6. Logistic Regression	AUC= 1. 0.50 (0.50, 0.61), 2. 0.50 (0.38, 0.63), 3. 0.58 (0.43, 0.71), 4. 0.52 (0.40, 0.67), 5. 0.63 (0.50, 0.75), 6. 0.50 (0.42, 0.63)
Uchiyama et al²⁴ (2021)	RCD, CAq	Adults with first ever thalamic or putaminal hemorrhagic stroke	Stroke Impairment Assessment Set—Motor (UE + LE)	At least 1 mo	Imaging	30	Spearman’s rank correlation	r = −.710

Abbreviations: RCD, retrospective cohort data; PCD, prospective cohort data; CAq, clinical acquired images; RAq, research acquired images; UE, upper extremity; LE, lower extremity; MCA, middle cerebral artery; AUC, area under curve; AIC, Akaike information criterion; R², coefficient of determination; P, P-value; F, F-statistic; r, correlation coefficient; β_LL, coefficient of lesion load measure in multivariate regression.

Validation cohort at 100% specificity.

Across different lesion quantification measures.

†

The first sample size is the upper extremity motricity index, and the second sample size is the lower extremity motricity index.

‡

The first sample size is right sided lesions, and the second sample size is left sided lesions.

Table 2.

Image Analysis Methods of Included Studies.

Paper	Image modality	Image acquisition	Hemisphere flipped	Image normalization	Lesion segmentation	Atlas selection/creation	Lesion quantification measure
Blackburn et al²⁷ (2021)	DWI	Unreported	N/A	N/A	N/A	ASPECTS	ASPECTS score
Bowren et al²⁵ (2022)	MPRAGE T1, CT	Partially reported	No	MNI152 template	Manual segmentation	Sparse canonical correlation analysis map	Structural lesion behavioral map lesion load, Structural lesion network map lesion load, Functional lesion network map lesion load
Branco et al²³ (2018)	CT	Unreported	N/A	N/A	N/A	ASPECTS	ASPECTS score
Cassidy et al²² (2018)	T1, FLAIR	Partially reported	Unreported	MNI152 template	Unreported	N = 17 CST atlas, M1 Mask	CST subsection injury, Gray matter lesion load
Feng et al¹⁶ (2015)	DWI	Unreported	Unreported	SPM5 T2 template	Manual segmentation	N = 12 CST atlas	Weighted probabilistic CST-lesion load
Jones et al¹⁸ (2016)	MPRAGE T1, FLAIR	Partially reported	Yes, to the left	MNI152 template	Manual segmentation	Feng et al N = 12 CST atlas Hammers atlas, Eickhoff et al atlas, Johns Hopkins University atlas	Probabilistic CST-lesion load
Kuceyeski et al¹⁹ (2015)	T1, T2, DWI	Partially reported	Unreported	MNI152 template	Manual segmentation	Network Modification Tool atlas	Change in connectivity score
Lee et al⁴ (2020)	T1	Partially reported	Yes, to the right	MNI152 template	Manual segmentation	Schulz et al N = 9 CST atlas,	Probabilistic CST-lesion load
Lee et al²¹ (2022)	T1	Partially reported	Yes, to the left	MNI152 template	Manual segmentation	Schulz et al N = 9 CST atlas	Probabilistic CST-lesion load
Lin et al²⁸ (2019)	DWI, CT*	Unreported	Yes, to the left	MNI152 template	Manual segmentation	N = 17 CST atlas, JHU-WM CST atlas, Eickhoff et al atlas	CST-lesion maximum slice overlap, wCST-lesion load, Probabilistic CST-lesion load, CST subsection injury, Gray matter lesion load
Peters et al¹⁵ (2018)	T1, T2	Partially reported	Unreported	MNI152 template	Manual segmentation	Cortical/Subcortical Johns Hopkins University atlas, Peters et al N = 59 white matter atlas	Gray matter lesion load, White matter disconnection
Rondina et al¹³ (2017)	T1	Partially reported	Yes, to the right	Unspecified SPM template	Automated using unified segmentation-normalization	Schulz et al N = 9 CST atlas, Automated anatomical labeling atlas	Voxel Lesion Likelihood
Salvalaggio et al²⁶ (2020)	MPRAGE T1, FLAIR	Partially reported	Unreported	MNI152 template	Manual segmentation	Structural disconnection maps	Atlas-based voxel disconnection score
Saltão da Silva et al¹⁴ (2022)	T1, DWI, T2 gradient echo	Unreported	Unreported	MNI152 template	Semi-automated	SMATT atlas, Johns Hopkins University white matter atlas	CST-lesion overlap percentage
Stinear et al²⁹ (2017)	T1, DWI	Partially reported	Unreported	CST atlas was registered to individual space	Manual segmentation	N = 85 CST atlas	CST-lesion voxel overlaps
Tozlu et al²⁰ (2020)	MPRAGE T1	Partially reported	Yes, to the right	MNI152 template	Manual segmentation	Network Modification Tool atlas	Change in connectivity score
Uchiyama et al²⁴ (2021)	CT	Reported	Unreported	MNI152 template	Manual segmentation	Johns Hopkins University white matter atlas	CST-lesion voxel overlaps

Abbreviations: DWI, diffusion weighted imaging; MPRAGE, magnetization-prepared 180 degrees radio-frequency pulses and rapid gradient-echo; CT, computed tomography; FLAIR, fluid attenuated inversion recovery; MNI152, Montreal Neurological Institute 152; SPM, Statistical Parametric Mapping; ASPECTS, Alberta Stroke Program Early Computed Tomography Score; CST, corticospinal tract; SMATT, Stroke Motor Area Tract Template.

While Lin et al used both CT and MRI images, CT was only used in one patient whose MRI was contraindicated.

Basic Methodological Summary of Studies

A basic summary of the studies’ key methodology is provided in Table 1. Design choices varied between each study widely, and notably, only one study performed out-of-sample validation.²⁵

Image Modalities and Acquisition

The image analysis pipelines for the included studies are summarized in Table 2. About 13 studies used MRI only,^{13
–22,26,27,29} 2 studies used CT only,^23,24 while 2 studies used both MRI and CT.^25,28 Of the MRI studies, most used T1-weighted imaging, while 8 used T2-weighted imaging. The T2-weighted studies used either plain T2 images,¹⁵ diffusion-weighted images,^14,27
-29 fluid-attenuated inversion recovery images,^18,22 or both T2 and diffusion-weighted images.¹⁹ One study used T2 gradient echoes to examine hemorrhagic strokes.¹⁴

With respect to reporting image acquisition details, no MRI studies described their image acquisition in full detail, 11 MRI studies gave partial detail,^{13
-16,18,20,22,25
-27,29} and 5 MRI studies did not report any acquisition details beyond imaging modality.^{14,17,19,21,28} Only one study described coil type,¹⁵ and no studies reported the extent of brain coverage or phase encoding details. For the CT studies, one study reported acquisition details,²⁴ while the other did not.²³

Spatial Normalization and Preprocessing

Twelve studies automatically registered patient images using the Montreal Neurological Institute (MNI) space,^{14
-22,25,26,28} but only 4 mentioned the specific template used.^14,15,24,28 Stinear et al²⁹ performed an inverse normalization method in which the atlas of interest was registered to each patient’s native space. Rondina et al¹³ did not report which normalization space was used, and 2 studies did not perform normalization as they visually determined the regions of interest on each patient.^23,27

Twelve of the 14 studies that performed spatial normalization reported details such as whether they used linear,²⁴ or nonlinear,^{13
-15,17,18,21,29} or both kinds of transformations.^19,20,25,26 Additionally, 4 studies reported additional details about their normalization process such as whether enantiomorphic normalization or cost function masking was performed.^{15,18,25,28,29}

Several different software tools were utilized for image analysis, of which the Functional MRI of the Brain Software Library and Statistical Parametric Mapping (SPM) programs were the most commonly used across the included studies.

Lesion Segmentation

Twelve studies performed manual lesion segmentation.^{15
–21,24
-26,28,29} Saltão da Silva et al¹⁴ used a semi-automated lesion segmentation method, although this still required considerable manual input as every axial slice had to be manually traced. Rondina et al¹³ used a fully automated lesion segmentation method which utilizes fuzzy clustering to identify outlier voxels. Cassidy et al²² did not report their lesion segmentation method, and two studies did not perform lesion segmentation^23,27 as they measured the Alberta Stroke Program Early CT Score (ASPECTS), which can be determined via visual inspection.³⁰

Lesion Quantification Measures

Several different atlas-based voxel features were derived from the corticospinal tract (CST), a descending white matter tract important for fine motor function. Many of these voxel features are similar and traditionally defined under the umbrella term “CST lesion load.” For this paper, we have further named the measures, mostly retaining the terminology used in their respective studies. These include CST lesion voxel overlap,²⁴ CST lesion overlap percentage,^14,29 CST lesion maximum slice overlap,²⁸ probabilistic CST lesion load,^17,18,21,28 weighted probabilistic CST lesion load,^16,28 and CST subsection injury.^22,28 CST lesion voxel overlap measures the number of voxels in the CST that overlap with the stroke lesion. Similarly, the CST overlap percentage measures the percentage of voxels in the CST that overlap with the stroke lesion. CST lesion maximum slice overlap identifies the largest voxel overlap between the lesion and CST in the transverse plane, out of all transverse slices. Probabilistic CST lesion load measures the overlap between the lesion and CST, weighted by a probabilistic CST template. Weighted probabilistic CST lesion load measures the voxel overlap between the lesion and CST, and multiplies the overlap by the ratio of the cross-sectional area of each slice over the maximum cross-sectional airea of the CST. This accounts for the narrowing of the CST as it descends from the motor cortex. CST subsection injury divides the CST into 16 subsections, and measures the percentage of subsections that are injured, defined as >5% slice to lesion overlap that subsection. Another entirely different measure, a voxel-lesion likelihood measure, was integrated with the unified segmentation tool.¹³ ASPECTS was used in two studies.^23,27 Other lesion features included total lesion volume and gray matter lesion load.

Four studies investigated structural connectivity measures by superimposing lesion masks onto a tractography atlas.^19,20,25,26 Two studies used the Network Modification tool,^19,20 which generates a total disconnection score based on the number of white matter streamline disconnections within a tractogram derived from 73 healthy individuals. Salvalaggio et al²⁶ used a tractography atlas derived from 176 individuals to measure the probability of a lesion crossing various white matter streamlines. Bowren et al²⁵ created their own lesion-behavior maps by using sparse canonical correlation analysis to identify clusters, then delineating the identified regions with a publicly available multimodal parcellation map of the cortex.³¹ These regions of interest were then used to calculate connectivity measures. White matter tract streamlines were also derived from the sparse canonical correlation analysis maps,²⁵ which were then used to calculate the number of streamlines disconnected by a lesion.

Regions of Interest Determination

All studies explored the CST tract.^13
–29 11 studies used a template of the CST,^{13
–18,21,22,24,28,29} 6 of which solely analyzed the CST.^{14,16
-18,21,24,29} Several different white matter atlases were utilized, including inhouse CST templates by Schulz et al,³² Feng et al,¹⁶ Cassidy et al,²² Stinear et al,²⁹ the Johns Hopkins University white matter atlas,³³ and the Sensorimotor Area Tract Template (SMATT) atlas.³⁴ The 3 studies using structural connectivity measures used tractography atlases that contained multiple white matter tracts beyond the CST. However, the two studies using the Change in connectivity score did not list which white matter tracts were significant.^19,20 Bowren et al²⁵ used the Human Connectome Project white matter atlas and only found significant associations in CST regions.

Eight studies examined gray matter regions,^{13,15,18,22,23,25,27,28} however, the exact gray matter atlases or atlases used for feature extraction differed between studies. Considerable variation exists between gray matter atlases, including the regions of interest it aims to parcellate, the MNI template to which the atlas is normalized to, and the sample size from which the atlas was derived from.^35
–37 Two studies used the ASPECTS atlas.^23,27 The studies generally did not explain the rationale for their choice of atlas. Gray matter regions considered for the prediction of motor outcomes included postcentral gyrus, precentral gyrus, premotor cortex, supplementary motor area, superior frontal gyrus, middle frontal gyrus, inferior and superior parietal regions, cerebral peduncle, red nucleus, thalamus, and other ASPECTS regions.

Discussion

Trends and Limitations in Image Preprocessing

This review identified several trends, or lack thereof, in the methodology of stroke motor outcome prediction studies that used atlas-based voxel features. MRI was the most commonly used imaging modality in the reviewed studies, likely because ischemic stroke lesions are better visualized on MRI than CT, especially in subacute and chronic settings.³⁸ Two studies investigated multimodal imaging for prediction modeling.^25,28 Multimodal imaging features could provide complementary information to prediction models and improve prediction accuracy, but at a greater resource and time cost that may not be practical for clinical implementation. However, it is important for more studies to attempt to develop their models with different imaging modalities to allow for redundancy and improve generalizability.

While image acquisition details are not as important as other methodological aspects for reproducibility, it is still valuable to report as it helps with understanding the nuances of analyzed images.¹² While most studies reported some acquisition details, no study described all the mandatory details suggested by the COBIDAS report. In future, researchers of neuroimaging studies should consult the COBIDAS report as a guideline for best reporting practice.

The analysis pipeline for atlas features usually involves spatially normalizing images, lesion masks, and atlases between native patient space and the standard template space. Various image manipulation tools can be used to normalize images between patient space and template space. Of these, the Advanced Normalized Tool’s symmetric image normalization method and the Automatic Registration Toolbox are the most consistent and accurate normalization methods for gray matter regions.³⁹ Moreover, linear normalization alone may not be fully accurate, especially for patients with significant brain atrophy. A combination of linear and nonlinear normalization can improve normalization accuracy,⁴⁰ at the cost of greater processing time. Studies should aim to report the parameters and tools that they use for image normalization.

The MNI space was the most common standard coordinate space for image normalization. While this enhances interpretability of results, only 3 studies reported the specific MNI template used.^14,15,24 It is possible to infer which MNI template was used if the software is known, but this is not always reliable as the templates used by a given software may change over time. For example, the MNI152 template has received several updates and variants since its inception.^41
–44 Moreover, some templates are created in the MNI space, such as the template by Rorden et al,¹³ which was derived from an older-aged population to better match the demographic of stroke patients.⁴⁵ In contrast, the traditional MNI152 templates were derived from relatively younger-aged adults.⁴⁶ While it is unclear whether different normalization templates affect the accuracy of stroke recovery prediction, it may be beneficial to use templates that reflect the specific population of interest (ie, an older-aged population for stroke recovery) rather than templates derived from the general population.

Another relatively common preprocessing step, performed in 6 of the reviewed studies,^{13,17,18,20,21,28} was the act of flipping the lesion masks to one hemisphere. This helps increase the signal to noise ratio, especially when the sample size is small.²⁰ However, doing this removes any hemisphere-specific associations and may affect overall prediction accuracy.

Lesion segmentation was mostly performed manually, which remains the gold standard with respect to segmentation accuracy.⁴⁷ However, while manual segmentation is viable in research settings, it is not practical for clinical use due to the extensive time and effort required. Therefore, researchers should ultimately aim to develop or test their models with automated segmentation methods. Rondina et al^13,48 utilized an automated method which uses unified segmentation-normalization and fuzzy clustering to identify outlier voxels. Other automated lesion segmentation methods are also available in SPM. Another challenge of stroke lesion segmentation is that the imaging characteristics of a stroke change over time. It is therefore important for automatic segmentation methods to be validated at different stages of stroke as most are only validated for chronic stroke lesions.⁴⁹ Furthermore, studies which utilize automated segmentation methods should examine and report their segmentation accuracy.

Variability of Atlas Choice and Use

Almost every reviewed study used a different atlas-based voxel features. While it is good to see many novel imaging features, the field generally lacks validation studies. Researchers should move toward validating and reproducing existing prediction models in new patient cohorts as a step toward implementation in clinical practice. Notably, the CST is the most commonly used white matter region of interest for stroke recovery prediction. However, several different CST atlases exist, some of which are not publicly available, making validation difficult.^16,22,29,50 Many of these CST atlases are a single binary template, which may not perfectly fit all patients at the individual level. Atlases that capture multiple related pathways such as the SMATT may better account for inter-individual anatomical variability than a single template of the CST.³⁴

Gray matter regions appear to be less useful for the prediction of stroke outcome after stroke compared to white matter regions. However, the analysis of atlas-based voxel features derived from gray matter regions can be challenging. This is because stroke lesion distribution maps in study datasets often show more strokes in non-cortical regions than cortical regions.⁴⁷ Therefore, prediction models may be more representative of people with non-cortical strokes than those with cortical strokes. Further investigation of gray matter imaging features with larger sample sizes is required to fully determine their utility in stroke outcome prediction.

Furthermore, a priori selection of imaging features relevant to the clinical outcome of interest can improve accuracy, especially when sample size is small.^8,51 Thus, future motor outcome prediction studies could focus on motor-related or motor-adjacent imaging features, rather than an ensemble of features from the whole brain.

Many studies quantified the spatial overlap between the lesion and the CST, using a variety of different methods. To allow researchers to compare and validate these lesion quantification measures, it may be useful to develop a toolbox that can calculate all of the different types of lesion quantification measures. One comparison of some of the lesion quantification measures suggests that maximum lesion overlap and percent of subsections injured are the most effective lesion quantification measures for prediction of motor outcomes after stroke.⁵² This suggests that finer information about the location of the lesion within the CST is relevant for motor outcomes after stroke.

Other types of imaging measures included voxel-lesion likelihoods and lesion connectivity measures. Lesion likelihood data can produce a large number of features which raises the risk of overfitting, so external validation is required before definitive conclusions can be drawn.⁹ Lesion connectivity measures such as white matter streamlines are a promising avenue for future feature development since white matter streamlines account for the longitudinal alignment of neuronal axons, which traditional lesion load measures do not do. More work should be done to explore the predictive potential of white matter connectivity measures.⁵³

Study Limitations and Future Direction

The literature search performed in this review was limited in scale and conducted by one author. This review was limited to imaging modalities used in routine clinical practice as prediction models based on these modalities will be the most accessible to clinical practice; however, other more advanced imaging techniques could help predict stroke motor outcomes such as diffusion spectrum imaging, diffusion kurtosis imaging, and diffusion tractography imaging.^54
–57 Furthermore, this review focused on motor outcomes, however other outcomes such as quality of life, independence, and mortality are also highly relevant for stroke patients. The low number of identified studies and their methodological heterogeneity meant that results between studies could not be meaningfully compared.

The comparison and validation of existing prediction models that utilize atlas-based voxel features is currently limited by small sample sizes, atlases which are not publicly available, and poor reporting of study methods. One solution could be to create an image-processing toolbox that includes many of the commonly used atlases and imaging measures. Currently, Neuroparc offers a collection of common human brain atlases registered into the same MNI space, although it has limitations such as inaccurate normalization and subjective labeling.⁵⁸ Future work can also look to other domain prediction studies for methodological inspiration, such as the Predicting Language Outcome and Recovery After Stroke study which validates prediction models to work with neuroimaging features derived from scans at multiple time points.⁵⁹

Atlas-based voxel features remain challenging to implement and are currently unfit for clinical practice. However, components of the image analysis and feature extraction pipeline continue to be improved, which may allow the creation of clinically feasible prediction tools in the future. Automated lesion segmentation methods, increasingly large databases of atlases, and the development and refinement of atlas-based voxel features may facilitate the development of stroke recovery prediction models. Moreover, ongoing work across feature development, atlas selection, and outcome prediction may eventually reveal particular atlases or imaging features that are optimal for predicting motor outcomes after stroke. Rondina et al⁸ identified potential regions of interest beyond the CST that could improve prediction accuracy for upper limb motor outcomes, which can be an initial guide for regions to explore.

The study designs and methodologies differed considerably between the reviewed studies. For studies investigating individualized outcome prediction, it is important to go beyond descriptive association statistics and report prediction statistics such as prediction accuracy.⁶⁰ Studies should also report uncertainty measures for their prediction results so appropriate conclusions can be drawn. This is especially important for studies that only perform in-sample validation.⁶⁰ Prediction models using atlas-based voxel features should also aim to include clinical biomarkers, since they are cheap and easy to measure, and measures of baseline performance are one of the best predictors of recovery and outcome. Furthermore, the added predictive value of imaging features can be quantified by comparing prediction models to a benchmark model of clinical features only. Not only that, but a diversity of features can help build redundancies so that models can be more resilient to missing data.

While this review focused on atlas-based voxel features, they are only one out of many different classes of neurological biomarkers.⁶¹ The abundance of different biomarkers means researchers should consider the validity, quality, and utility of potential biomarkers.⁶² Validity refers to the reliability and reproducibility of biomarker measurement. Quality is the strength of the association between a biomarker and a clinical endpoint, which is ideally validated with an out-of-sample cohort. Lastly, utility refers to how practical it is to use a biomarker in a clinical setting. Ideally, all biomarkers should have high validity, quality, and utility, but this is challenging to achieve.⁶³ Researchers may wish to consider whether the associations between biomarkers and what they predict are underpinned or explainable by feasible biological mechanisms. For instance, biomarkers derived from neuroimaging is likely to be better at predicting direct impairment than measures of activity and participation as contextual factors beyond pathophysiology impacts activity and participation outcomes.⁶³

Clinically, prediction of motor outcomes after stroke should occur at the acute stage, so that rehabilitation can be tailored during the early sub-acute stage when most recovery occurs.⁵ It is also important to consider the relevant clinical endpoints for motor recovery. Most studies included in this review examined only motor outcomes, which refers to performance at a fixed time point. However, studies may also investigate motor recovery, which refers to change in performance over time. While both variables are clinically meaningful, predicting motor outcomes may be more suitable for discharge and treatment planning, while predicting motor recovery may be useful for tracking patients longitudinally such as monitoring deterioration. Moreover, recovery can be measured in either absolute or relative terms, and it is still unclear as to which is most suitable for clinical use.

Conclusion

This review identified current trends and limitations in the use of atlas-derived methods to predict motor outcomes after stroke. We hope our findings will encourage future researchers to solve some of the existing limitations of atlas-based features, as a step toward their use in clinically feasible prediction models for stroke outcomes and recovery.

Footnotes

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was partially supported by the Health Research Council of New Zealand (grant number 21/144).

ORCID iDs

Ji-Hun Yoo

Benjamin Chong

Peter Alan Barber

Cathy Stinear

References

Rondina

Ward

. Patient-specific prediction of long-term outcomes will change stroke rehabilitation for the better. J Neurol Neurosurg Psychiatry. 2021;92(6):572.

Langhorne

Coupar

Pollock

. Motor recovery after stroke: a systematic review. Lancet Neurol. 2009;8(8):741-754.

Park

C-H

Kou

Ward

. The contribution of lesion location to upper limb deficit after stroke. J Neurol Neurosurg Psychiatry. 2016;87(12):1283-1286. doi:10.1136/jnnp-2015-312738

Lee

Park

Lee

Chang

Kim

. Prediction of motor recovery using indirect connectivity in a lesion network after ischemic stroke. Ther Adv Neurol Disord. 2020;13. doi:10.1177/1756286420925679.

Stinear

Smith

Byblow

. Prediction tools for stroke rehabilitation. Stroke. 2019;50(11):3314-3322.

Ivanova

Herron

Dronkers

Baldo

. An empirical comparison of univariate versus multivariate methods for the analysis of brain-behavior mapping. Hum Brain Mapp. 2021;42(4):1070-1101.

Kasties

Karnath

Sperber

. Strategies for feature extraction from structural brain imaging in lesion-deficit modelling. Hum Brain Mapp. 2021;42(16):5409-5422. doi:10.1002/hbm.25629

Rondina

Filippone

Girolami

Ward

. Decoding post-stroke motor function from structural brain imaging. Neuroimage Clin. 2016;12:372-380. doi:10.1016/j.nicl.2016.07.014

Mwangi

Tian

Soares

. A review of feature reduction techniques in neuroimaging. Neuroinformatics. 2014;12(2):229-244.

10.

Sperber

. Rethinking causality and data complexity in brain lesion-behaviour inference and its implications for lesion-behaviour modelling. Cortex. 2020;126:49-62. doi:10.1016/j.cortex.2020.01.004

11.

Moons

KGM

de Groot

JAH

Bouwmeester

, et al Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. 2014;11(10):e1001744. doi:10.1371/journal.pmed.1001744

12.

Nichols

Das

Eickhoff

, et al Best practices in data analysis and sharing in neuroimaging using MRI. Nat Neurosci. 2017;20(3):299-303.

13.

Rondina

Park

Ward

. Brain regions important for recovery after severe post-stroke upper limb paresis. J Neurol Neurosurg Psychiatry. 2017;88(9):737-743. doi:10.1136/jnnp-2016-315030

14.

Saltão

Silva

Baune

Belagaje

Borich

. Clinical imaging-derived metrics of corticospinal tract structural integrity are associated with post-stroke motor outcomes: a retrospective study. Front Neurol. 2022;13. doi:10.3389/fneur.2022.804133

15.

Peters

Fridriksson

Stewart

, et al Cortical disconnection of the ipsilesional primary motor cortex is associated with gait speed and upper extremity motor impairment in chronic left hemispheric stroke. Hum Brain Mapp. 2018;39(1):120-132. doi:10.1002/hbm.23829

16.

Feng

Wang

Chhatbar

, et al Corticospinal tract lesion load: an imaging biomarker for stroke motor outcomes. Ann Neurol. 2015;78(6):860-870. doi:10.1002/ana.24510

17.

Lee

Kim

Lee

Chang

Kim

. Differential early predictive factors for upper and lower extremity motor recovery after ischaemic stroke. Eur J Neurol. 2021;28(1):132-140. doi:10.1111/ene.14494

18.

Jones

Pomeroy

Wang

, et al

Does stroke location predict walk speed response to gait rehabilitation?

Hum Brain Mapp. 2016;37(2):689-703. doi:10.1002/hbm.23059

19.

Kuceyeski

Navi

Kamel

, et al Exploring the brain’s structural connectome: a quantitative stroke lesion-dysfunction mapping study. Hum Brain Mapp. 2015;36(6):2147-2160. doi:10.1002/hbm.22761

20.

Tozlu

Edwards

Boes

, et al Machine learning methods predict individual upper-limb motor impairment following therapy in chronic stroke. Neurorehabil Neural Repair. 2020;34(5):428-439. doi:10.1177/1545968320909796

21.

Lee

Kim

Chang

Kim

. Multimodal imaging biomarker-based model using stratification strategies for predicting upper extremity motor recovery in severe stroke patients. Neurorehabil Neural Repair. 2022;36(3):217-226. doi:10.1177/15459683211070278

22.

Cassidy

Tran

Quinlan

Cramer

. Neuroimaging identifies patients most likely to respond to a restorative stroke therapy. Stroke. 2018;49(2):433-438. doi:10.1161/STROKEAHA.117.018844

23.

Branco

Oliveira

Sargento-Freitas

, et al Neuroimaging, serum biomarkers, and patient characteristics as predictors of upper limb functioning 12 weeks after acute stroke: an observational, prospective study. Top Stroke Rehabil. 2018;25(8):584-590. doi:10.1080/10749357.2018.1517491

24.

Uchiyama

Domen

Koyama

. Outcome prediction of patients with intracerebral hemorrhage by measurement of lesion volume in the corticospinal tract on computed tomography. Prog Rehabil Med. 2021;6:20210050. doi:10.2490/prm.20210050

25.

Bowren

Bruss

Manzel

, et al Post-stroke outcomes predicted from multivariate lesion-behaviour and lesion network mapping. Brain. 2022;145(4):1338-1353. doi:10.1093/brain/awac010

26.

Salvalaggio

de Filippo De Grazia

Zorzi

de Schotten

Corbetta

. Post-stroke deficit prediction from lesion and indirect structural and functional disconnection. Brain. 2020;143(7):2173-2188. doi:10.1093/brain/awaa156

27.

Blackburn

D’arco

Devito

, et al Predictors of motor outcome after childhood arterial ischemic stroke. Dev Med Child Neurol. 2021;63(10):1171-1179. doi:10.1111/dmcn.14914

28.

Lin

Cloutier

Erler

, et al Corticospinal tract injury estimated from acute stroke imaging predicts upper extremity motor recovery after stroke. Stroke. 2019;50(12):3569-3577. doi:10.1161/STROKEAHA.119.025898

29.

Stinear

Byblow

Ackerley

Smith

Borges

Barber

. PREP2: a biomarker-based algorithm for predicting upper limb function after stroke. Ann Clin Transl Neurol. 2017;4(11):811-820. doi:10.1002/acn3.488

30.

Barber

Demchuk

Zhang

Buchan

. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group. Alberta Stroke Programme Early CT Score. Lancet. 2000;355(9216):1670-1674.

31.

Glasser

Coalson

Robinson

, et al A multi-modal parcellation of human cerebral cortex. Nature. 2016;536(7615):171-178.

32.

Schulz

Park

Boudrias

Gerloff

Hummel

Ward

. Assessing the integrity of corticospinal pathways from primary and secondary cortical motor areas after stroke. Stroke. 2012;43(8):2248-2251.

33.

Hua

Zhang

Wakana

, et al Tract probability maps in stereotaxic spaces: analyses of white matter anatomy and tract-specific quantification. Neuroimage. 2008;39(1):336-347. doi:10.1016/j.neuroimage.2007.07.053

34.

Archer

Vaillancourt

Coombes

. A template and probabilistic atlas of the human sensorimotor tracts using diffusion MRI. Cerebral Cortex. 2018;28(5):1685-1699. doi:10.1093/cercor/bhx066

35.

Tzourio-Mazoyer

Landeau

Papathanassiou

, et al Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage. 2002;15(1):273-289.

36.

Hammers

Allom

Koepp

, et al Three-dimensional maximum probability atlas of the human brain, with particular reference to the temporal lobe. Hum Brain Mapp. 2003;19(4):224-247. doi:10.1002/hbm.10123

37.

Eickhoff

Stephan

Mohlberg

, et al A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage. 2005;25(4):1325-1335. doi:10.1016/j.neuroimage.2004.12.034

38.

Vymazal

Rulseh

Keller

Janouskova

. Comparison of CT and MR imaging in ischemic stroke. Insights Imaging. 2012;3(6):619-627.

39.

Klein

Andersson

Ardekani

, et al Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. Neuroimage. 2009;46(3):786-802.

40.

Fan

Cao

Yap

Shen

. BIRNet: Brain image registration using dual-supervised fully convolutional networks. Med Image Anal. 2019;54:193-206.

41.

Evans

Collins

Mills

Brown

Kelly

Peters

. 3D statistical neuroanatomical models from 305 MRI volumes. In: 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference, San Francisco, CA. IEEE; 1993:1813-1817.

42.

Mazziotta

Toga

Evans

, et al A four-dimensional probabilistic atlas of the human brain. J Am Med Inform Assoc. 2001;8(5):401-430.

43.

Grabner

Janke

Budge

Smith

Pruessner

Collins

. Symmetric atlasing and model based segmentation: an application to the hippocampus in older adults. In: Larsen

Nielsen

Sporring

, eds. International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer; 2006:58-66.

44.

Fonov

Evans

Botteron

, et al Unbiased average age-appropriate atlases for pediatric studies. Neuroimage. 2011;54(1):313-327.

45.

Rorden

Bonilha

Fridriksson

Bender

Karnath

. Age-specific CT and MRI templates for spatial normalization. Neuroimage. 2012;61(4):957-965.

46.

Dickie

Shenkin

Anblagan

, et al Whole brain magnetic resonance image atlases: a systematic review of existing atlases and caveats for use in population imaging. Front Neuroinform. 2017;11:1.

47.

Ito

Kim

Liew

. A comparison of automated lesion segmentation approaches for chronic stroke T1-weighted MRI data. Hum Brain Mapp. 2019;40(16):4669-4685.

48.

Seghier

Ramlackhansingh

Crinion

Leff

Price

. Lesion identification using unified segmentation-normalisation models and fuzzy clustering. Neuroimage. 2008;41(4):1253-1266.

49.

Zhang

Liu

Wang

. Application of deep learning method on ischemic stroke lesion segmentation. J Shanghai Jiaotong Univ Sci. 2022;27(1):99-111. doi:10.1007/s12204-021-2273-9

50.

Schulz

Park

Lee

, et al Interactions between the corticospinal tract and premotor-motor pathways for residual motor output after stroke. Stroke. 2017;48(10):2805-2811. doi:10.1161/STROKEAHA.117.016834

51.

Chu

Hsu

Chou

Bandettini

Lin

. Does feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images. Neuroimage. 2012;60(1):59-70. doi:10.1016/j.neuroimage.2011.11.066

52.

Schuch

Lam

Levin

, et al A comparison of lesion-overlap approaches to quantify corticospinal tract involvement in chronic stroke. J Neurosci Methods. 2022;376:109612. doi:10.1016/j.jneumeth.2022.109612

53.

Griffis

Metcalf

Corbetta

Shulman

. Lesion Quantification Toolkit: a MATLAB software tool for estimating grey matter damage and white matter disconnections in patients with focal brain lesions. Neuroimage Clin. 2021;30:102639.

54.

Moura

Luccas

de Paiva

JPQ

, et al Diffusion tensor imaging biomarkers to predict motor outcomes in stroke: a narrative review. Front Neurol. 2019;10:445. doi:10.3389/fneur.2019.00445

55.

Granziera

Daducci

Meskaldji

, et al A new early and automated MRI-based predictor of motor improvement after stroke. Neurology. 2012;79(1):39-46. doi:10.1212/WNL.0b013e31825f25e7

56.

Spampinato

Chan

Jensen

, et al Diffusional kurtosis imaging and motor outcome in acute ischemic stroke. AJNR Am J Neuroradiol. 2017;38(7):1328-1334. doi:10.3174/ajnr.A5180

57.

Stinear

Barber

Petoe

Anwar

Byblow

. The PREP algorithm predicts potential for upper limb recovery after stroke. Brain. 2012;135(8):2527-2535. doi:10.1093/brain/aws146

58.

Lawrence

Bridgeford

Myers

, et al Standardizing human brain parcellations. Sci Data. 2021;8(1):78. doi:10.1038/s41597-021-00849-3

59.

Seghier

Patel

Prejawa

, et al The PLORAS database: a data repository for predicting language outcome and recovery after stroke. Neuroimage. 2016;124(Pt B):1208-1212. doi:10.1016/j.neuroimage.2015.03.083

60.

Varga

Niss

Estampador

Collin

Moseley

. Association is not prediction: a landscape of confused reporting in diabetes – a systematic review. Diabetes Res Clin Pract. 2020;170:108497.

61.

Kim

Winstein

. Can neurological biomarkers of brain impairment be used to predict poststroke motor recovery? A systematic review. Neurorehabil Neural Repair. 2017;31(1):3-24. doi:10.1177/1545968316662708

62.

Abramson

Burton

JPJ

, et al Methods and challenges in quantitative imaging biomarker development. Acad Radiol. 2015;22(1):25-32. doi:10.1016/j.acra.2014.09.001

63.

Langhorne

Bernhardt

Kwakkel

. Stroke rehabilitation. Lancet. 2011;377(9778):1693-1702.

Predicting Motor Outcomes Using Atlas-Based Voxel Features of Post-Stroke Neuroimaging: A Scoping Review

Abstract

Background

Objectives

Methods

Results

Conclusion

Keywords

Introduction

Objectives

Methods

Search Strategy

Data Extraction

Results

Search Results

Basic Methodological Summary of Studies

Image Modalities and Acquisition

Spatial Normalization and Preprocessing

Lesion Segmentation

Lesion Quantification Measures

Regions of Interest Determination

Discussion

Trends and Limitations in Image Preprocessing

Variability of Atlas Choice and Use

Study Limitations and Future Direction

Conclusion

Footnotes

Declaration of Conflicting Interests

Funding

ORCID iDs

References