Abstract
Background:
The ultimate validation of a clinical marker for Alzheimer’s disease (AD) is its association with AD neuropathology.
Objective:
To examine how well the Stages of Objective Memory Impairment (SOMI) system predicts intermediate/high AD neuropathologic change and extent of neurofibrillary tangle (NFT) pathology defined by Braak stage, in comparison to the Clinical Dementia Rating (CDR) Scale sum of boxes (CDR-SB).
Methods:
251 well-characterized participants from the Knight ADRC clinicopathologic series were classified into SOMI stage at their last assessment prior to death using the free recall and total recall scores from the picture version of the Free and Cued Selective Reminding Test with Immediate Recall (pFCSRT + IR). Logistic regression models assessed the predictive validity of SOMI and CDR-SB for intermediate/high AD neuropathologic change. Receiver operating characteristics (ROC) analysis evaluated the discriminative validity of SOMI and CDR-SB for AD pathology. Ordinal logistic regression was used to predict Braak stage using SOMI and CDR-SB in separate and joint models.
Results:
The diagnostic accuracy of SOMI for AD diagnosis was similar to that of the CDR-SB (AUC: 85%versus 83%). In separate models, both SOMI and CDR-SB predicted Braak stage. In a joint model SOMI remained a significant predictor of Braak stage but CDR-SB did not.
Conclusion:
SOMI provides a neuropathologically validated staging system for episodic memory impairment in the AD continuum and should be useful in predicting tau positivity based on its association with Braak stage.
Keywords
INTRODUCTION
Biomarker or pathological “staging” methods have been widely used in Alzheimer’s disease (AD) [1, 2]. The current research framework in the staging of AD requires the presence of
To identify episodic memory impairment, the International Working Group recommends using the Free and Cued Selective Reminding Test (FCSRT) [7]. Unlike most other episodic memory tests, the FCSRT begins with an encoding phase in which participants identify items (e.g., grapes) in response to category cues (fruit) [8, 9]. Controlling cognition in this way assures that participants engage in the type of semantic processing that improves learning [10]. These same category cues are then used in the test phase to prompt recall of items not retrieved by free recall. Control of cognitive processing permits measurement of retrieval impairment, defined by free recall (FR), separately from storage impairment, defined by cued recall. The earliest signs of memory impairment during the onset of AD are found in FR, indicating impaired retrieval of stored memories, progressively worsening in the early prodromal stage of the AD continuum [11]. Storage remains unimpaired until the late prodromal stage when retrieval fails despite effective cued recall shown by impaired total recall (TR), the sum of FR and cued recall [12].
This ability to measure storage and retrieval impairment separately was critical to defining the five sequential stages we proposed in the breakdown of episodic memory in the predementia phase of AD [13]. The stages of objective memory impairment (SOMI) system, the focus of the current analyses, was based on extensive literature mapping of FCSRT performance to clinical outcomes and to biological markers in longitudinal aging cohorts [11, 14–21]. Change point analyses of FR and TR informed the temporal demarcation between stages and the scores that define each stage [22, 23]. Table 1 shows the SOMI system defined by FR and TR score ranges and the estimated time to clinical dementia at each of the five stages. There are multiple versions of the FCSRT. The SOMI was based on the picture version of the FCSRT that includes immediate recall in the encoding phase (pFCSRT + IR) [9]. This abbreviation avoids confusion with the word version or the version without immediate recall whose scores are not equivalent to pFCSRT + IR scores [24].
Stages of Objective Memory Impairment (SOMI) defined by Free Recall and Total Recall score ranges and years to diagnosis
SOMI was not intended to measure episodic memory impairment of moderate severity. SOMI 5 (TR≤32) was added to accommodate participants with moderate episodic memory impairment.
Confirmation of the estimates for time to diagnosis at each stage was accomplished by analyzing the SOMI scores of 142 incident AD cases from the Einstein Aging Study (EAS), tested annually for up to 10 years [13]. The dependent measure was elapsed time, defined as the difference in years between the assessment date and the date of first AD diagnosis. We used generalized estimating equations to evaluate the association of SOMI stage and predicted time to diagnosis. The first three SOMI stages (SOMI 0–2) typically precede clinical dementia by 4 to 7 years and reflect increasing retrieval difficulty, shown by declining FR in the context of intact TR. The next two SOMI stages (SOMI 3, 4) precede clinical dementia by about 2 to 3 years; in these stages cuing fails to recover the missed items despite effective cuing. These stages define the core memory phenotype of AD [7], which in SOMI begins at stage 3 when TR ≤46 (max = 48) indicating a subtle impairment in memory storage. Using this stage as the cut-point for distinguishing persons with incipient AD (
We acknowledge that the clinical course of AD is highly variable, influenced by concomitant neuropathologies such as vascular disease among others [6], as well as by factors such as cognitive and brain reserve [25–28]. We also acknowledge other cognitive domains are affected by AD and that memory is not always the first domain to decline [29]. Despite this heterogeneity, this simple system accounts for a substantial part of episodic memory decline in the AD continuum.
The current objective was to validate the SOMI system against AD neuropathology. This was accomplished by determining how well SOMI at the evaluation closest to death predicted the likelihood of AD neuropathology on brain autopsy as defined by current guidelines [30, 31] and by how well SOMI stages align with the stages of AD neurofibrillary tangle (NFT) pathology defined by Braak and Braak [1]. These questions were addressed through the prospective clinicopathological series from the Charles F. and Joanne Knight Alzheimer Disease Research Center (Knight ADRC) at Washington University in St. Louis [32]. Since the severity of cognitive impairment correlates with the burden of neurofibrillary tangles in AD [33], we predicted that participants classified into SOMI 3 and 4 would have a higher likelihood of AD pathology than participants classified into early SOMI 1 and 2 and would be at a more advanced Braak stage than participants in SOMI 0 who have intact storage and retrieval mechanisms.
The association of the SOMI system to AD neuropathology was compared to that of the Clinical Dementia Rating (CDR) Scale sum of boxes (CDR-SB) developed at Washington University more than 35 years ago to assess cognitive and functional decline in the AD continuum [4, 5]. The CDR-SB was selected as the comparator because it was available in the entire autopsy sample, assesses a broad range of cognitive and functional domains and is highly associated with AD neuropathology [30]. In addition, the CDR-SB is widely used in clinical trials and observational studies of dementia populations and many clinicians and researchers are intimately familiar with the scale, so it provides a comparative reference for the SOMI stages. At the Knight ADRC, CDR-SB are the basis for assigning clinical diagnoses and are disclosed to the neuropathologists. The lack of independence between CDR-SB and neuropathology could inflate their association. Thus, we hypothesized that an outcome in which the SOMI system predicted the presence of AD neuropathology as accurately as CDR-SB would be considered a successful demonstration of SOMI’s validity.
METHODS
Study sample
We used clinical, cognitive, and neuropathological data from autopsied participants who had been evaluated annually at the Knight ADRC at Washington University in St. Louis. In 2004, the pFCSRT + IR was added to the neuropsychological assessment battery. Since then, 251 autopsies have been performed in persons with pFCSRT + IR data that could be classified into SOMI stages and whose available neuropathology measures could be classified according to current guidelines [24, 25]. Written informed consent was obtained from all participants.
CDR-SB [4, 5]
The CDR-SB is a summary score of the severity of impairment from 0 (none) to 3 (severe) in each of six clinical domains: memory, orientation, judgement and problem solving, community affairs, home and hobby, and personal care. For these analyses, the CDR-SB scores were divided into four stages of severity using the following score ranges: SB 0 = 0.0; SB 1 = 0.5–3.0; SB 2 = 3.5–6.0; SB 3 = 6.5–12.0 [30].
pFCSRT + IR [9]
The test begins with an encoding phase in which participants search a card containing four line drawings (e.g., grapes) for an item that goes with a unique category cue (e.g., fruit). After all-four items are identified, immediate cued recall of just those four items is tested. The encoding phase is repeated for all 16 drawings. The test phase consists of three trials of FR each followed by cued recall for items not retrieved by FR. The sum of FR and cued recall is TR. When cued recall fails, the participant is reminded of the item by saying, “The fruit was the grapes, what was the fruit?”
FR and TR scores from the pFCSRT + IR closest to death were used to classify the cases into the appropriate SOMI stage. SOMI 5 (TR≤32) was added to the model for these analyses. As designed, SOMI was not intended to measure severe episodic memory impairment. Since 28%of participants scored below SOMI’s lowest bound (TR≥32) at their last assessment, SOMI 5 classification was added (TR < 32).
Neuropathology
Details of brain autopsy and pathological processing have been described in detail previously [34]. All cases were assigned a Braak NFT stage with revised methods that adapted tissue selection and processing and introduced robust immunohistochemistry for hyperphosphorylated tau protein using monoclonal antibody PHF-1.
One outcome was the presence of AD neuropathology defined by intermediate or high AD neuropathologic change defined by “ABC” score where A reflects Thal phase for amyloid-β plaques, B reflects Braak stage, and C indicates CERAD neuritic plaque score. A positive outcome was defined by Braak stage ≥III coupled with either Thal phase ≥3 or CERAD ≥2 [30, 31]. It should be noted that a negative outcome does not necessarily indicate a lack of pathology. The second outcome was level of NFT pathology defined by Braak stage 0-VI.
Statistical methods
We performed
Prediction of AD neuropathology
Logistic regression was used for predicting AD neuropathology using SOMI and CDR-SB stage in separate models controlling for covariates including age, sex, education, time from last test to death and
Prediction of Braak stage
Ordinal logistic regression (proportional odds) was used to predict the Braak stage using SOMI and CDR-SB stage in separate models and then combined in a single model [37]. Each analysis modeled the logit transformations of the ordered Braak probabilities using simultaneous linear equations sharing the same slope coefficients. The method makes the parallel regression assumption for all variables across the levels of Braak stage which was validated by the Brant test [38] before running the regression models. Details of ordinal logistic regression and the Brant test are provided in the Supplementary Material.
We first ran models including each predictor and covariates and then ran a final full model, including SOMI, CDR-SB stage and the covariates which were significant in earlier models and satisfied the Brant test. We used delta pseudo R2 to measure the incremental explanatory power of SOMI and CDR-SB stage in predicting Braak stage which is the difference of pseudo R2 between the full model and the model excluding each predictor [31]. We also conducted a Likelihood Ratio Test to examine the incremental explanatory power of each predictor [39].
RESULTS
Group comparisons
Figure 1 shows the classification of the 251 participants by CDR and SOMI stage. Of the 69 participants with a CDR score of 0, 53 (77%) had some form of storage or retrieval impairment. 88 (93%) of CDR 0.5 participants had both storage or retrieval impairments as did 81 (99%) of participants with CDR scores of 1.0. While 23%of CDR 0 participants had no memory impairment, 8%of the entire cohort had no memory impairment.

Cross tabulations of SOMI by CDR.
The demographic and clinical characteristics of the sample classified by neuropathology status are summarized in Table 2. Two thirds of the cases were positive for AD neuropathology. On average, the positive and negative groups did not differ in age, percent female, or education. The time between last assessment and death was longer in the AD positive than negative group; this is due in part, to the termination of testing once the participant’s CDR score was 2, as at that point reliable collection of neuropsychological data is difficult. The proportion of cases with one or two
Descriptive Statistics for Individuals in the Knight ADRC Autopsy Cohort with pFCSRT + IR before Death. Mean (SD) in each group are reported for all continuous variables
The distribution of clinical diagnoses between the two neuropathological groups differed as expected with a greater percentage of clinical AD among the positive group and a greater proportion of normal cognition in the negative group. The percentage of other clinical outcomes did not differ by group.
Do cognitive assessments at the time closest to death predict AD neuropathology?
Table 3 (Model 1) shows the results of the analysis of SOMI stage predicting positive AD neuropathology. Participants with subtle (SOMI 3) or moderate (SOMI 4) storage impairment were four times as likely to have positive AD neuropathology than participants with intact storage and retrieval (SOMI 0). Participants with severely impaired storage (SOMI 5) were 36 times as likely to have positive AD neuropathology. For each yearly increase in time between last assessment and death, the odds of AD pathology increased 1.28-fold. Participants with at least one
Stage of Objective Memory Impairment (Model 1) and CDR-SB (Model 2) Predicts AD Neuropathology: Logistic Regression Models with Adjustment for Covariates
aAge < 80 is the reference group, bEDUCclass < 13 is the reference group, cMale is the reference group.
A similar relationship between the severity of cognitive impairment and AD neuropathology was obtained for CDR-SB stage (Table 3, Model 2). Participants classified as CDR-SB 1 were three times as likely to have positive AD pathology than participants classified as CDR-SB 0. Odds increased dramatically as cognitive severity increased. Both time to death and any
Figure 2 shows the AUC for SOMI and CDR-SB stage for discriminating between positive and negative AD neuropathology. The AUC was 85%for SOMI (95%CI: 0.769, 0.935) and 83%for CDR-SB stage (95%CI: 0.737, 0.918).

ROC curves for SOMI and CDR-SB stage.
Do cognitive assessments at the time closest to death predict Braak stage?
Figure 3 is a bar graph showing the number of cases at each SOMI stage by Braak NFT stage. As expected, the prevalence of storage and retrieval impairment (defined by SOMI 3 and higher stages) increased as Braak stage increased: 30%of Braak stage 0, I, II, 24%of Braak stage III, 69%of Braak stage IV, 80%of Braak stage V, and 95%of Braak stage VI cases had storage and retrieval impairment.

SOMI stage as a function of Braak stage.
The ordinal logistic model using SOMI to predict Braak stage met the proportional odds assumption (Supplementary Table 1) and showed that as SOMI stage increased so did Braak stage (Table 4, Model 1). Cases with moderate storage impairment (SOMI 4) were nearly six times more likely to have higher Braak stage than cases with no memory impairment (SOMI 0). Cases with marked memory impairments (SOMI 5) were 17 times as likely to have higher Braak stage. For each yearly increase in time between last assessment and death, the odds of AD pathology increased 1.22-fold. Cases with any
Ordinal Logistic Regression Results for predicting Braak stage using SOMI (Model 1) CDR-SB (Model 2) and both (Model 3) as predictors, adjusting for demographic covariates including age, time to death, education,
aAge < 80 is the reference group, bEDUCclass < 13 is the reference group, cMale is the reference group. dBased on the pseudo R2 value = 0.163.
Figure 4 shows the number of cases in each CDR-SB stage at each Braak stage. Most cases with no or mild cognitive impairment (CDR-SB 0 and 1) were associated with Braak stage 0-III. At Braak stage IV, there were equal numbers of participants in each cognitive severity category. At Braak stage V and VI the majority had moderate or severe impairment (CDR-SB 2 or 3).

CDR-SB stage as a function of Braak stage.
The ordinal logistic model using CDR-SB stage to predict Braak stage did not include the covariates of age and time to death because when the model included them, results violated the proportional odds assumption (Supplementary Table 1). The model without these covariates (Table 4, Model 2) demonstrated that as CDR-SB stage increased so did Braak stage. Cases with mildly impaired cognition (CDR-SB 1) were 2.6 times as likely to have higher Braak stage than cases with normal cognition (CDR-SB 0). Moderately impaired cases (CDR-SB 2) were nine times as likely to have higher Braak stage and severely impaired cases (CDR-SB 3) were ten times as likely to have higher Braak stage than cases with normal cognition. Cases with any
When comparing the incremental explanatory power of CDR-SB stage and SOMI, we considered the full model with SOMI and CDR-SB stage as predictors and
DISCUSSION
Our primary objective was to validate the SOMI system against AD neuropathology using a cohort of 251 well-characterized participants from the Knight ADRC clinicopathologic series and the assessment closest to death. Validation was assessed by how well SOMI predicted intermediate/high AD neuropathologic change according to current guidelines [30, 31] and how well SOMI stages aligned with stage of NFT pathology defined by Braak and Braak [1]. The performance of SOMI in accomplishing these objectives was compared to the CDR-SB because of its association with AD neuropathology [30] and its familiarity to clinicians and researchers. For these comparisons, the CDR-SB scores were divided into four stages of increasing clinical severity [30].
As SOMI stage increased across individuals, re-flecting greater memory impairment, AD neuropathology became more likely. Participants with subtle (SOMI 3) and moderately impaired storage mechanisms (SOMI 4) were 4 times as likely, and participants with severe impairment (SOMI 5) were 36 times as likely to have positive AD neuropathology than those with intact memory (SOMI 0). The diagnostic accuracy of SOMI for distinguishing between ‘positive’ and ‘negative’ AD neuropathology was similar to that of the CDR-SB stage (85%versus 83%). As SOMI stage increased, NFT pathology increased. Compared to participants with intact memory, those with moderate storage impairment (SOMI 4) were nearly six times as likely, and those with marked memory impairment (SOMI 5) were 17 times as likely to have more advanced Braak NFT pathology. Adding CDR+SB as a predictor of Braak stage did not improve prediction.
We found that 77%of cognitively normal participants, defined by CDR = 0, had some form of memory impairment. This is not surprising given the growing number of studies documenting the presence of memory and cognitive impairment in preclinical AD [40] up to 20 years before incident MCI is diagnosed [41]. CDR ratings are based on direct participant and informant interviews and reflect a global assessment of many functional domains. The CDR-SB, in contrast, assesses the severity of impairment in each domain and therefore is more likely to be sensitive to early impairment than the global CDR.
Recent findings suggest that SOMI 2 (moderate retrieval impairment but intact storage) has very high accuracy in identifying incident AD (personal communication). In participants from the Baltimore Longitudinal Aging Study cohort free of dementia at baseline, 85 of the 1,508 participants developed clinical AD over an average of more than 8 years of follow-up. A Bayesian joint model was used to evaluate the predictive accuracy of SOMI and estimate its sensitivity and specificity at 3, 5, and 7 years from baseline using all observed assessments and the covariates of age, education, gender, race, and
There is general agreement that the pre-dementia phase of AD can be broken down into the preMCI, early MCI, late MCI, and early dementia stages [11, 42]. Likewise, the breakdown of episodic memory in the pre-dementia phase can be viewed as stages in the impairment of storage and retrieval mechanisms. The breakdown begins in SOMI 1 with subtle decline in retrieval processes which worsens in SOMI 2 in the context of intact storage. In SOMI 3 impairment of storage mechanisms emerge and worsens in SOMI 4. This stage-sequential system can inform the design of secondary prevention trials. SOMI could be used as an eligibility criterion and potentially as an outcome measure. Table 1 shows the mean time to dementia diagnosis by SOMI stage ranging from seven years for SOMI 0 to two years for SOMI 3. This can help investigators align eligibility criteria with follow-up time on treatment in a clinical trial. Individuals in a particular SOMI stage at baseline could be targeted for biomarker evaluations, enriching the sample that receives costly or invasive biomarker testing for AD. In addition, since SOMI 3 is highly associated with AD neuropathology, progression to SOMI 3 could be used as a clinical outcome measure; such a study would enroll SOMI 0–2 participants meeting specified biomarker criteria. SOMI could provide an objective, fully operationalized endpoint, potentially reducing the duration of active treatment in clinical trials.
The current results are consistent with recent demonstrations of the clinicopathological association of NFT burden and the severity of cognitive impairment in AD. In one large study, 874 participants diagnosed with MCI during life were classified into four outcomes defined by clinical diagnosis proximate to death: no impairment, MCI Reverters, Stable MCI, and Dementia after MCI [43]. The progression of cognitive impairment in the groups from no impairment/MCI Reverters to Stable MCI to Dementia after MCI was associated with the spread of NFT pathology defined by Braak stage. Another recent study of 420 clinicopathological cases further delineated the association between NFT burden and trajectory of decline in global cognition defined by a composite [44]. As the NFT burden increased, the trajectory of change in global cognition further diverged from healthy cognitive aging. A lower level of global cognition at the last assessment during life was associated with higher counts of tangles (
A limitation of the current study was the inclusion of all autopsy cases with pFCSRT + IR data without regard to the presence of additional non-AD neuropathologies. Most cases had some degree of vascular neuropathology and at least 30%of the cohort had one or more non-AD pathologies (e.g., forms of frontotemporal lobar degeneration, Lewy body pathology, hippocampal sclerosis of aging). For a given level of AD pathology, the addition of Lewy bodies or hippocampal sclerosis amplified episodic memory declines [6]. Presumably some of the cases with low FR and TR scores had other pathologies.
CONCLUSIONS
SOMI predicted intermediate/high likelihood of AD neuropathology as well as the CDR-SB stage and outperformed the CDR-SB stage in predicting Braak stages. Since the rendering of neuropathological diagnoses may have been influenced by knowledge of CDR-SB scores, the results are particularly noteworthy. They validate the International Workgroup use of FCSRT + IR to define the core clinical phenotype of AD [7, 45]. This phenotype is observed at SOMI 3, when cued recall begins to fail. It is important to remember that the SOMI system is based on the pFCSRT + IR. Thus. the FR and TR score ranges that define the SOMI stages do not apply to the other three versions of the test.
Clinical validation of the SOMI system requires that people can be classified into the prescribed stages and that these stages predict an external referent including cognitive decline, biomarkers, incident dementia, etc. Our ultimate goal is to identify at-risk individuals in clinical settings for early intervention and to ensure a consistently and accurately characterized population for secondary AD clinical trials. The use of the pFCSRT + IR in ongoing clinical trials will permit future analyses mapping of SOMI stages onto biomarker models like the AT(N) system [46]. Based on the current results, SOMI should be useful in predicting tau positivity in clinical trials.
Footnotes
ACKNOWLEDGMENTS
Funding provided by Healthy Aging and Senile Dementia [P01 AG03991], Alzheimer’s Disease Research Center [P30 AG066444], Adult Children Study [P01 AG026276), and Einstein Aging Study (2PO1 AG003949).
We would like to acknowledge Dr. Peter Davies’ generous gift of monoclonal antibody PHF-1 which permitted robust immunohistochemistry for hyperphosphorylated tau protein.
