Abstract
Reference tissue models have gained significant traction over the last two decades as the methods of choice for the quantification of brain positron emission tomography data because they balance quantitative accuracy with less invasive procedures. The principal advantage is the elimination of the need to perform arterial cannulation of the subject to measure blood and metabolite concentrations for input function generation. In particular, the simplified reference tissue model (SRTM) has been widely adopted as it uses a simplified model configuration with only three parameters that typically produces good fits to the kinetic data and a stable parameter estimation process. However, the model's simplicity and its ability to generate good fits to the data, even when the model assumptions are not met, can lead to misplaced confidence in binding potential (BPND) estimates. Computer simulation were used to study the bias introduced in BPND estimates as a consequence of violating each of the four core SRTM model assumptions. Violation of each model assumption led to bias in BPND (both over and underestimation). Careful assessment of the bias in SRTM BPND should be performed for new tracers and applications so that an appropriate decision about its applicability can be made.
Introduction
In quantitative dynamic brain positron emission tomography studies reference tissue models, which avoid the need for arterial blood sampling, have become the methods of choice because they can achieve quantitative accuracy, while maximizing patient comfort. The methods rely on the identification of a brain region devoid of the biologic target of interest, enabling characterization of the behavior of the nondisplaceable signal in this region. These regions may be defined anatomically when
Reference tissue approaches were first developed over 20 years ago and have evolved in the intervening period with a number of compartmental configurations and estimation procedures being introduced. A full list of different reference tissue compartmental (TC) configurations and their mathematical solutions has been given previously.
5
The early method of choice was the ‘full’ reference tissue model,6, 7 which estimated four model parameters, including the binding potential of the target region (
SRTM was initially developed for application to dopamine D2 receptor quantification with [11C]raclopride and since then has become widely used, for a wide variety of brain radiotracers, as can be seen from the growing number of the citations for the two main articles (Lammertsma and Hume
8
and Gunn

Summary of simplified reference tissue model (SRTM) citations from the publications of Lammertsma and Hume
8
and Gunn
However, SRTM's simplicity and its ability to generate good fits to the kinetic data even when the assumption about equilibration of compartments (free, nonspecific and specific) is not met can lead to misplaced confidence in binding potential (BPND) estimates. SRTM is based on four key assumptions:
The reference region is devoid of specific/displaceable binding. The kinetic behavior of the tracer in both the reference and target tissue can be represented by a one TC model. The blood volume (VB) contribution to both the reference and target tissues is negligible. Reference and target tissue have the same nondisplaceable volume of distribution (VND).
Several publications have considered the consequences of violating some of these assumptions. In the original reference tissue model paper by Cunningham
The model topology has also been studied. Slifstein, Parsey, and colleagues17, 18 studied this problem previously after noticing that SRTM estimates of BPND for [11C]WAY100635 were significantly different from those derived indirectly using the volumes of distribution (VT) estimates in the target and reference regions obtained from two tissue compartment (2TC) model analyses with an arterial input function. Computer simulations showed that SRTM underestimated the value of BPND when both target and reference tissues were simulated with a 2TC model. In contrast, SRTM overestimated the BPND when the target and reference tissue kinetics were represented by a two and one tissue compartment (1TC) model, respectively. The authors also found that the full reference tissue model produced unbiased estimates of binding potential when the target and reference tissues were simulated with a 2TC and 1TC model, respectively, but it failed to converge when both target and reference tissues were simulated with a 2TC model.
There has been little consideration given to the contribution of whole blood activity in the regions of interest. Indeed, as far as blood goes, reference tissue models were by their nature developed to avoid the need for blood measurements.
Similarly, differences in nonspecific binding between the target and reference region, which can arise from different lipophilic properties between regions or as apparent differences because of a lack of tracer selectivity,19, 20 are not commonly considered.
The aim of this work was to perform a careful investigation of what happens to SRTM estimates of BPND when each of the underlying model assumptions is violated. Further, the article explores how well PRTM performs when the same model assumptions are violated. Investigations are performed on both noiseless and noisy simulated data sets.
Materials and methods
Simulations
The simplified reference tissue model characterizes the kinetic behavior of a radioligand in both the target and reference region by a 1TC model (Figure 2A). For each tissue, it is possible to derive a differential equation that describes the kinetics of the radioligand as a function of the arterial plasma input function and a set of rate constants. Rearrangement and substitution of the reference tissue equation into the target equation allows elimination of the plasma term and yields the standard operational equation for SRTM, 8

Simplified reference tissue model (SRTM) model configuration (
where R1 is the relative target to reference rate of delivery (target to reference K1 ratio), k2 is the efflux rate constant,
Computer simulations were used to assess the impact on binding potential estimation when each of the four SRTM model assumptions were violated; specific binding in the reference, incorrect model topology, blood volume contribution, and differences in nonspecific binding (Figure 2). Parameter estimation was performed using nonlinear regression with trust-region-reflective optimization algorithm and residuals weighted by frame duration.
Target and reference TACs were obtained using the exponential convolution forms of the 1TC and/or 2TC model
5
(Φ1TC and Φ2TC, respectively) and a measured arterial input function from a human [11C]PHNO scan. The value of each rate constant was chosen from perturbations around one characteristic parameter set
The VT associated with each TAC was obtained from the true value of the rate constants used to generate each scenario. For the 1TC,
For each target-reference pair of simulated TACs, the target BPND was defined via what we call the ‘indirect method’:
Displaceable Signal in the Reference Region (Assumption 1 Violation)
If the reference tissue is not completely devoid of specific signal, then theory states that the estimated binding potential in the target region will be biased 15 according to,
where
Noiseless simulations were performed to assess the effect of a specific signal in the reference region (see Appendix A for details of the implementation). Simulated TACs for the target and reference regions (with no whole blood volume contribution) were generated using a 1TC model. The values of K1 and VND were the same in both regions. A specific binding component in the reference region was simulated for three values of
Deviation from the Simplified Reference Tissue Model Topology (Assumption 2 Violation)
Noiseless simulations were performed to assess the effect of the model topology on the bias introduced into the SRTM estimates of binding potential (see Appendix A for details of the implementation). Target and reference TACs were generated using a 1TC or 2TC model with no blood volume contribution. All four combinations were explored 1TC-1TC, 1TC-2TC, 2TC-1TC, and 2TC-2TC for target and reference tissues, respectively. The values of K1 and VND were the same for target and reference regions in all simulations. Estimates of binding potential in the target region
In addition, to enable a more comprehensive evaluation of model topology-induced biases, a large number of simulations (
Model order metric was defined as
where
Blood Volume-Induced Bias (Assumption 3 Violation)
At equilibrium, the presence of a blood volume component in the target and reference tissues will bias the estimates of VT by a fraction that will depend on the blood volume fraction VB and the reciprocal of the plasma-parent to blood ratio PB. This bias in VT will be propagated into the estimates of binding potential. By assuming that the fractional blood volume was the same in both the target and reference tissues, Gunn
where
Noiseless simulations were performed to assess the bias in binding potential estimates because of a nonnegligible blood volume contribution to both tissues (see Appendix A for simulation details). A whole blood TAC, obtained from the same study as the plasma TAC, was used. TACs in the target and reference regions were simulated with the 1TC model. The value of
Target-Reference Differences in the Nondisplaceable Volume of Distribution (Assumption 4 Violation)
The nondisplaceable volume of distribution VND represents the equilibrium partition coefficient between the free plus nondisplaceable bound radiotracer and the plasma concentration and it is assumed to be the same in both target and reference tissues. Theory, derived from equilibrium conditions, states that estimates of BPND derived using a reference region that has a different VND from that in the target region will be biased according to the following equation,
where
Noiseless simulations were performed to assess the bias in binding potential estimates because of differences in nonspecific binding between the target and reference regions (see Appendix A for simulation details). The value of VND in the reference region was adjusted to achieve three different values of PND (0.8, 1, and 1.2). Estimates of binding potential in the target region
Pseudo Reference Tissue Model
The use of a pseudo reference region (assumption 1 violation) introduces a bias in the estimated target binding potential that depends on the binding potential in the reference region
This approach is referred to as the PRTM. 15
To explore the validity of this correction when the target and reference tissue uptake is represented by different model topologies, TACs were generated to simulate four different target-reference topology combinations (1TC-1TC, 1TC-2TC, 2TC-1TC, and 2TC-2TC). In all cases, a small specific signal (BPND=0.5) was added to the reference region. In all cases, the value of K1 and VND were the same for target and reference regions with no blood volume contribution (VB=0). PRTM estimates of binding potential were obtained by applying SRTM and then the appropriate correction using equation 6. Both SRTM and PRTM binding potential estimates (expressed as a percentage bias about true binding potential in the target region) were plotted against the true binding potential in the target region
Results
Displaceable Signal in the Reference Region (Assumption 1 Violation)
Figure 3 shows the bias in SRTM binding potential estimates (as a percentage of the true value

Bias in simplified reference tissue model (SRTM) binding potential estimates when specific binding is present in the reference region. The theoretical bias derived from equation 2 (dashed line) lies exactly underneath the simulation results (solid line).
Deviation from the Simplified Reference Tissue Model Topology (Assumption 2 Violation)
Figure 4A shows the bias in SRTM binding potential estimates in noiseless simulations for different target-reference model topologies. Figure 4B shows a more comprehensive simulation that investigates SRTM binding potential bias in the presence of noise across a wide range of kinetics. When one tissue accurately describes both target and reference regions (bottom left-hand corner), there is no bias as would be expected. When the model order is similar in both regions (the diagonal), the mean bias is generally small. For other topologies, the bias is more evident with the highest values being identified when there is a clear need for 2TCs in the reference tissue and only 1TC in the target region.

Simplified reference tissue model (SRTM) binding potential bias for different model topologies. (
Blood Volume-Induced Bias (Assumption 3 Violation)
Figure 5 shows the bias in SRTM binding potential estimates in a noiseless simulation for three different blood volume contribution levels (VB=0, 0.1, 0.2).

Bias introduced in the simplified reference tissue model (SRTM) estimates of binding potential because of a nonnegligible blood volume contribution. Solid lines represent the simulation results. Dashed lines represent the theoretical bias from equation 4. Only when VB is zero are non-biased estimates of binding potential obtained.
Target-Reference Differences in the Nondisplaceable Volume of Distribution (Assumption 4 Violation)
Figure 6 shows the bias in SRTM binding potential estimates from the noiseless simulations considering different target to reference VND ratios (PND=1.2, 1, 0.8).

Bias introduced in simplified reference tissue model (SRTM) binding potential estimates because of differences in nondisplaceable binding in the target and references regions. Solid lines represent the simulation results. Dashed lines represent the theoretical bias derived from equation 5. Only when VND is the same in the target and reference regions (PND=1) are nonbiased estimates of binding potential obtained.
Pseudo Reference Tissue Model
Figure 7 shows the bias in binding potential estimates derived from PRTM in noiseless simulations when the reference tissue has a binding potential of 0.5 for different target-reference topologies. PRTM is able to accurately correct for the presence of specific binding in the reference region when the kinetics are described by 1TC in both target and reference tissue. As the true model topologies increase in model order, PRTM is still able to provide a more accurate estimate of the true

Bias in pseudo reference tissue model (PRTM) estimates of binding potential for different model topologies. The solid line in each plots represent the biased simplified reference tissue model (SRTM) estimate of binding potential because of the uncorrected presence of specific binding in the reference region. The dashed line is the bias for PRTM. When one tissue compartment (1TC) is present in both reference and target regions, PRTM is able to provide an unbiased estimate of binding potential, but for more complex model configurations a bias (either positive or negative) is nearly always present.
Discussion
Since its introduction in the late nineties, the SRTM has been rapidly adopted as a parsimonious modeling approach for dynamic brain positron emission tomography imaging that aims to balance quantitative accuracy with patient comfort. By using dynamic data and a tracer compartmental description of the tracer, the approach is able to decouple delivery and binding information and has wide utility for analysis in disease understanding, drug development, and diagnostic settings.
Previous publications along with the work presented in the article have shown that SRTM produces unbiased estimates of binding potential when the model assumptions are met. Herein, we aimed to characterize the bias introduced in binding potential estimates when each of the four key SRTM model assumptions were violated, namely: (1) specific binding in the reference region; (2) more than 1TC required for the tissue kinetics; (3) nonnegligible contribution of whole blood activity to the TACs; and (4) target-reference nonspecific binding differences. We found that violation of each of the four model assumptions led to the introduction of a bias in the SRTM estimates of binding potential.
Violation of assumptions 1 and 4 introduced biases that are mathematically equivalent and can be considered as offsets in the reference tissue partition coefficient that impacts on the binding potential estimates. Nevertheless, in both of these cases the biases were accurately predicted by the mathematical expression given in equations 2 and 5. In fact, these expression could be used in the assessment of individual radiotracers and the potential application of the PRTM where knowledge of
The bias introduced when the model topology does not conform to 1TC in both the reference and target tissues is more complex and cannot be captured in a simple algebraic expression. Noiseless simulations (Figure 4A) identified the general behavior of these biases as they occur for different model topologies. For the sake of simplicity and because they have been studied elsewhere,5, 18 in the noiseless simulations we only studied the bias dependence about the true binding potential in the target region leaving out other factors such as R1 dependency. However, comprehensive Monte Carlo simulations allowed us to explore the magnitude of the introduced bias across a wide range of tracer kinetics and model configurations (Figure 4B). As the model for both reference and target tissue demands a more obvious need for a second compartment, there is clear evidence of a bias in binding potential. This bias is minimal when the model order of both reference and target tissues are well matched, intermediate when 1TC is required for the reference and 2TCs are required for the target and largest when 2TCs are required for the reference and 1TC is required for the target.
The bias introduced by blood activity contributing to both reference and target tissues can have a significant impact, particularly if the partition coefficient of the tracer is small (
The impact of SRTM assumption violations in longitudinal or cross-sectional studies will depend primarily on the nature of the assumption(s) being violated. In general, violation of assumption 3 (blood volume) will produce a bias that is more or less constant across a wide range of BPND values (Figure 5) and therefore will have little impact unless blood volume constitutes a significant portion of the total tissue signal. For the other cases, if specific binding, model topology or nonspecific binding are altered longitudinally or cross-sectionally then they could introduce confounds into the assessment of differences in BPND.
It is important to note that the bias introduced under SRTM model assumption violations is tracer dependent. Therefore, a careful assessment of the bias associated with SRTM for new tracers and applications is critical. To do this properly necessitates the acquisition of dynamic data with associated blood data at baseline conditions and after the administration of a suitable blocking agent (potentially in both a control and disease group). Plasma input function modeling of TACs to identify the most parsimonious compartmental topology will allow for an assessment of assumption 2 (1TC model topology). In addition, these data can be used to assess the impact of blood volume on BPND (model assumption 3). Calculation of VT at baseline and after a blocking dose allows for an assessment of whether there is a displaceable signal in the reference region (assumption 1) and also whether nondisplaceable binding is equal in reference and target tissues (assumption 4).
Although the focus here has been on the core model assumptions specific to SRTM, there are other factors that could lead to the introduction of bias in BPND. For example, the presence of brain-penetrant radiolabeled metabolites, partial volume effects affecting primarily small regions of interest surrounded by high uptake regions, inaccurate scatter correction particularly in reference tissues close to the edge of the field of view, and the image reconstruction algorithms themselves (e.g., filtered back projection or iterative methods) can all introduce bias. Although important, these factors have not been considered in this article.
This article has focussed on the bias in BPND that may be introduced by SRTM. Other standardized uptake value (SUV)-based reference tissue methods that calculate an SUV ratio (SUVr) between a target and reference region will also be subject to bias. For example, at true equilibrium conditions SUVr can be directly related to the unbiased binding potential estimates obtained via the SRTM
where β is the terminal washout rate in plasma. Only at an equilibrium condition (β=0) is the target to reference SUVr equal to 1+BPND. Similar biases also apply to the reference graphical method of Logan 24 but in addition there is the factor of noise-induced bias to consider that results from noise on the independent and dependent axes.25, 26
In conclusion, SRTM is a valuable tracer kinetic analysis tool for dynamic positron emission tomography data as it balances quantitative accuracy with patient comfort. However, careful assessment of the level of bias in the binding outcome measure of interest (binding potential) should be performed for new tracers and applications so that an appropriate decision about its applicability can be made.
Footnotes
The authors declare no conflict of interest.
APPENDIX A
Details of the model implementation for each of the simulations shown in Figure 2
