Abstract
Background
There is heterogeneity in conceptualizations of resiliency, and there is, to date, no established theoretically driven resiliency assessment measure that aligns with a targeted resiliency intervention. We operationalize resiliency as one’s ability to maintain adaptive functioning in response to the ongoing, chronic stress of daily living, and we use a novel resiliency measure that assesses the target components of an evidence based resiliency intervention. We present our resiliency theory, treatment model, and corresponding assessment measure (Current Experience Scale; CES).
Methods
To establish the psychometric properties of the CES, we report the factor structure and internal consistency reliability (N = 273). Among participants in our resiliency intervention (N = 151), we explored construct validity in terms of associations with theoretical model constructs, a validated resiliency measure, and sensitivity to change from before to after the intervention.
Results
Results indicated that a 23-item, 6-factor solution was a good fit to the data (RMSEA = .08, CFI = .97; TLI =.96) and internal consistency was good (α = .81 to .95). The CES showed correlations in the expected direction with resiliency model constructs (all p’s < .001) and significant post intervention improvements.
Conclusion
Our resiliency theory, treatment model, and outcome appear aligned; the CES demonstrated promise as a psychometrically sound outcome measure for our resiliency intervention and may be used in future longitudinal studies and resiliency building interventions to assess individuals’ resiliency to adapt to ongoing stress.
Background
In the U.S., there is mounting chronic stress and a growing number of daily stressors, 1 emphasizing an increasingly important need for evidence based resiliency interventions and corresponding assessments. A 2019 review depicted a lack of consensus for the conceptualization and measurement of resilience. 2 Although there is no agreed upon definition, resiliency is often characterized as one’s ability to “bounce back” following exposure to risk or to adversity.3–12 Additionally, recent reviews of resilience research revealed three core components of resilience, which include the presence of adversity, protective factors that overcome this adversity, and a subsequently more positive outcome, or growth.13,14 There is a great demand for mind-body resiliency interventions that represent conceptually driven characterizations of resiliency, with clearly defined and measurable end points and process variables.
Resilience has been conceptualized as a personality trait or cluster of traits that refer to one’s ability to adapt to adversity and restore equilibrium.15–25 Resiliency has also been conceptualized as a process or capacity that can be enhanced or taught.26–29 Specifically, individuals can develop resilient skills and perspectives, including manifesting adaptive behaviors, engaging in problem solving skills, maintaining optimistic perspectives, sustaining positive social functioning, utilizing positive emotion eliciting coping strategies (e.g., cognitive reappraisal, benefit finding, humor), and finding meaning.26,30
Resiliency is often characterized as the capacity to maintain healthy functioning after an acute stressor or traumatic event.31–33 Some conceptualize resiliency as managing adversity of daily living, as well as coping with the downstream effects from major life events (e.g., sadness from loss of a loved one, financial stress due to job loss). Importantly, current experiences of chronic stressors are associated with greater vulnerability to deleterious health and well being.34–36 Reflecting this present focus, we developed a resiliency framework that illustrates an adaptive response to chronic stress, caused by everyday stressors and major life events. Resiliency thus is, specifically, the ability to maintain adaptive functioning in response to the ongoing stress of daily living. 37
Our framework is informed by the diathesis stress model, which is a process approach that posits resiliency is the outcome of an individual’s experiences and environment in combination with one’s inherent attributes. 38 Moreover, our framework builds on conceptualizations of resiliency as a malleable construct26,27 that reflects multiple biopsychosocial factors 39 including qualities that buffer against the stress response and promote adaptive growth (e.g., spiritual connectedness, positive expectancies). It emphasizes Tedeschi’s construct of growth, which is positive development following adversity. 40
Extant measures assess resiliency as a dispositional trait, a reflection of external factors (e.g., family cohesion), or an amalgam of intrapersonal characteristics (e.g., religiosity) that are not all aligned with our resiliency theoretical model.17,26,41,42 In behavioral intervention research, it is important to have outcome assessments that specifically tap into the targeted intervention components and change processes. 43 The pairing of a theoretically driven intervention and corresponding assessment measure is critical to accurately assess intervention effects. Thus, we needed an outcome measure that captured our conceptualization of resiliency and could be relevant for other interventions and studies that conceptualize resiliency as modifiable and multidimensional. We present our resiliency theory, treatment, and corresponding assessment measure (Current Experience Scale; CES).
Resiliency Treatment Theory and Model
Our resiliency treatment model (see Figure 1) frames adjustment to ongoing, chronic stress as a dynamic process which can be demonstrated by practicing a set of core coping skills (i.e., Relaxation Response (RR) elicitation, stress awareness and management, and adaptive strategies). Based on this model, we developed the Stress Management and Resiliency Training/Relaxation Response Resiliency Program; SMART-3RP). The theoretical model emphasizes the development and effective practice of these core skills in response to chronic stressors. The Relaxation Response (RR) refers to a physical state of deep relaxation that is modulated by the parasympathetic nervous system where one experiences a sense of calm and well being that can be elicited through relaxation techniques. 44 Conceptually, Stress Management processes draw on cognitive behavior therapy and include improved coping skills and reductions in psychological symptoms (e.g., anxiety, depression), whereas Adaptive Strategies processes draw on positive psychology and include increased positive psychological states and social connectedness (e.g., positive affect, empathy). Stress Management and Adaptive Strategies processes 1) interact with each other to promote resiliency and 2) are bidirectionally related to resiliency.
Figure 1: Resiliency treatment model.
Resiliency Treatment Program
This conceptual model guides the SMART-3RP treatment program. There are three essential components to our program (see Table 1). First, participants practice RR techniques. Each session presents different strategies to elicit the RR, all of which involve creating and keeping a mental focus, by repeating a concept, maintaining an open, receptive attitude, and letting go of extraneous thoughts. Second, the program teaches Stress Awareness. We explore how stress affects thoughts, emotions, physical sensations, behaviors and relationships and examine individual responses to a stressor. Third, participants learn about Adaptive Strategies. With a new foundation of Stress Awareness, we examine and practice four types of Adaptive Strategies to buffer stress. a) Reappraisal and Coping. Our reappraisal approach is based on a blending of cognitive therapy, which recognizes the link between thoughts and emotions, and positive psychology, which promotes adaptive thoughts and emotions. Participants learn how to reframe a stressor with positive/adaptive emotions as well as review and modify the corresponding thoughts, physical sensations and behaviors. During sessions, we also regularly access adaptive coping skills, such as creativity and humor, to demonstrate how to buffer oneself against stressors. b) Positive Perspectives. Sessions emphasize the expression of positive emotions and character strengths. Challenges are observed through a lens of positive meaning and expectation. Daily appreciations are noticed and experienced, which causes a shift in one’s perspectives to focus on small, positive experiences such as smells, tastes, interactions, and surprises. c) Social Connectedness. Sessions focus on strengthening participants’ ability to assess and access social support, which includes giving and receiving. The treatment manual delves into corresponding prosocial behaviors and empathy to enhance feelings of connectedness to oneself and others. d) Healthy Behaviors. Participants are encouraged to set individual goals of physical activity, healthy and mindful eating, and recuperative sleep.
Stress Management and Resiliency Training: Relaxation Response Resiliency Program.
Current Experiences Scale Measure
The Current Experiences Scale, 45 captures our holistic, present focused resiliency framework conceptualization. The CES is a modified version of the Post Traumatic Growth Inventory (PTGI), 46 a well validated measure of growth after a traumatic event, which queries for comparative recall of previous levels of functioning. The PTGI captures the key aspects of our resiliency model and treatment program: appreciation for life, personal strengths, new possibilities, spiritual change, and relating to others. The CES scale authors added a sixth health behaviors subscale, which fits well with the behavioral components of our resiliency model and program. Furthermore, the CES measures current functioning, thus enabling computation of changes that may occur during and after exposure to resiliency interventions.
To establish the CES as a resiliency outcome measure, we investigated the CES’s psychometric properties. Specifically, we sought to: (1) confirm the intended 6-factor structure of the CES (2) establish the internal consistency reliability of the full CES measure and subscales (3) explore sensitivity to change from before to after the SMART-3RP, and (4) explore construct validity in terms of associations with our resiliency model’s Stress Management and Adaptive Strategies constructs, as well as with a validated resiliency measure (Resilience Scale-14 [RS-14]). We hypothesized that the 6-factor structure would be a good fit to the data; the CES would show acceptable internal consistency; CES scores would significantly increase from before to after the SMART-3RP; and the CES would be significantly negatively correlated with measures of stress processes and significantly positively correlated with measures of resiliency processes.
Methods
Participants
Participants were 273 adults (Mage=45.13, SD = 13.37) who completed the CES as part of a baseline assessment for clinical care as part of four research studies.47–50 These studies were randomized trials with wait-list control or wellness educational comparison groups, in-person and group based, and led by trained facilitators from a myriad of clinical backgrounds (e.g., nurse practitioners, psychologists, clinical social workers). The combined sample was predominantly female (69%), white (64%; 12% Hispanic), college educated (76%), partnered (58%), and employed (84%). To assess sensitivity for change, we analyzed a convenience sample of 151 participants who completed resiliency treatment groups from 2017–2020. Participants provided written informed consent; approval was obtained by the Partners Human Research Committee and the University of Miami Human Subjects Research Office prior to conducting study procedures.
Measures
Resiliency
Current experience scale
The CES is a 25-item measure that reflects current functioning in the domains of appreciation for life (AL), adaptive perspectives (AP), personal strength (PS), spiritual connectedness (SC), relating to others (RO), and health behaviors (HB). 45 The CES total score can range from 0–125, with higher scores indicating greater resiliency.
Construct validity
The Resilience Scale-14 (RS-14) is a well validated assessment; 17 (range 14 – 98) which is based on a perspective that resiliency is a trait that promotes adaptive functioning. Specifically, the RS measures resiliency as a function of self reflection, whereas the CES assesses resiliency through questions related to coping, perspectives, and actions to manage stress. Thus, the RS-14 assessment of resiliency has overlapping aspects, but is also distinct from our resiliency conceptualization.
Construct validity measures from our resiliency framework
Stress management, depression, generalized anxiety, and worry measurement
We measured several aspects of stress and coping using validated self-report measures. The
Adaptive strategies
Positive psychology skills specifically target adaptive strategies through the promotion of positive psychosocial processes, which were assessed with validated self-report measures. We used the
Data Analysis
Confirmatory factor analysis 60 with categorical indicators, oblique rotation, and robust weighted least squares estimation (WLSMV) was conducted using MPlus version 6.0 to assess whether the CES 25-item, 6-factor model was appropriate. Model fit was examined using a set of model fit indices according to established cut offs: comparative fit index (CFI) > .95, Tucker-Lewis Index (TLI) >.95, and root mean square error of approximation (RMSEA) <.08. 61 Individual item factor loadings were also examined to ensure substantive loadings (>.60). Modifications were made to improve model fit, item factor loadings, and modification indices that suggested changes consistent with our conceptual model. The missing data rate for these analyses was 5% (n= 14, with 11 participants missing data on one CES item, and 3 participants missing data on two CES items). Maximum likelihood estimation, MPlus’ default procedure for handling missing data, was used so that all available cases could be included in these analyses.
Once the final factor structure was identified, Cronbach’s alpha was used to assess the internal consistency reliability of the total score and identified subscale scores. To assess the measure’s sensitivity to change over time, paired-samples t-tests were used to examine changes in mean CES scores from before to after participation, complete cases, in the SMART-3RP intervention (n = 151). Construct validity was assessed with theoretically related constructs within the SMART-3RP model. Specifically, positive correlations were demonstrated between the CES and measures of self-efficacy, optimism, positive affect, empathy, acceptance, and coping; negative correlations were demonstrated between the CES and measures of emotional distress, worry, anxiety, and depression. Zero-order correlations were also examined between the CES total scores and the RS-14 in a subsample of participants (n = 79).
Results
Factor Structure
The initial 6-factor model showed acceptable model fit for some fit indices, but there was sufficient room for improvement (RMSEA = .09 [90% CI = .08 – 1.0]; CFI = .95; TLI = .94). Modification indices suggested correlating the error terms from the spiritual connectedness and appreciation for life factors. Given that spirituality is thought to involve meaning, purpose, and appreciation for life, 62 correlating these error terms seemed theoretically appropriate. Modification indices revealed substantial item overlap between two items on the relating to others subscale: item 1 (“I can count on people in times of trouble”) and item 2 (“I have a sense of closeness with others”). Based on this redundancy, the item with the higher factor loading (item 2) was retained and the item with the lower factor loading (item 1) was removed. The fourth item on the health behavior subscale (“I am good at managing stress”) was also suggested via modification indices to better represent personal strengths than health behaviors, which seemed to have face validity given that the way the item is written reflects an individuals’ perception of their skills. Lastly, the third item on the health behavior factor (“I get regular physical checkups”) demonstrated a relatively low item factor loading as compared to the factor loadings for all of the other CES items (R2 = .32) and was removed. The 6-factor model was re-specified making each of these modifications.
The final scale was a 23-item solution that was a good fit to the data (RMSEA = .08 [90% CI = .07 – .08]; CFI = .97, TLI = .96), with all items showing strong loadings on hypothesized factors (Table 2). Internal consistency reliability was good for the CES total score and all subscale scores (α = .81 to .95). Each subscale was correlated with one another and with the CES total (all p’s < .001) (data not shown).
Item Factor Loadings and Internal Consistency for the Final 23-Item Measure (N= 273).
Note. AL = appreciation for life, AP = new perspectives (‘new perspectives), PS = personal strength, SC = spiritual connectedness, RO = relating to others, HB = health behaviors.
Sensitivity to Change
Total scores on the CES significantly increased from before to after participation in the SMART-3RP (p < .001) (Table 3). Significant increases were also observed for the personal strengths (p < .001), adaptive perspectives (p < .001), health behaviors (p < .001), and appreciation for life subscales (p < .001), spiritual connectedness (p < .001), and relating to others (p = .004). The total CES effect size for statistically significant change was moderate (d = .46).
CES Changes Pre Post Resiliency Training (N = 151).
N = 151 from the BHI sample (received SMART-3RP). AL = appreciation for life, AP = adaptive perspectives, PS = personal strength, SC = spiritual connectedness, RO = relating to others, HB = health behaviors.
Validity
Table 4 shows zero-order correlations between the CES and Stress Management and Adaptive Strategies measures. The CES total score showed correlations in the expected directions with all variables (all p’s < .001). There was also a strong, positive correlation between the CES total score and RS-14 (r = .81; p < .001).
Zero-Order Correlations Between the CES Total Score and Resilience Components (N = 151).
Note. The correlation of the CES with optimism and social support is based on a subsest of N = 82 participants.
*=p < .01.
**=p < .001.
Discussion
To demonstrate an approach to pairing a resiliency outcome measure with a targeted resiliency intervention, this study presented a theoretical model of resiliency, a targeted resiliency intervention, and corresponding resiliency assessment measure and investigated the psychometric properties of the CES as a measure of resiliency. We posit that resiliency is achieved when an individual develops skills to cope with ongoing stress adaptively (i.e., returning to homeostasis after experiencing a stressor) and experiences growth enhancement (i.e., achieving a higher level of functioning). This growth, in turn, facilitates enhanced coping. Specifically, we view the process of attaining resilience as the acquisition of stress management and growth enhancement strategies, and the ability to utilize these skills and personal resources effectively in response to ongoing, often chronic, stressors.
We demonstrated the utility of a measure that captures this process and aligns with a theoretically driven resiliency intervention. The CES can be administered across multiple time points, thus capturing resiliency as a dynamic growth process. 63 In pilot work, we have seen notable post treatment improvement in the CES.48,64 Thus, by pairing a new resiliency outcome measure with an evidence based targeted resiliency intervention, this study elucidates how a theoretical model of resiliency can be translated into a targeted resiliency intervention based on a conceptual model and how the development of a corresponding resiliency assessment measure contributes to the literature on model driven, evidence based interventions.
Results of the confirmatory factor analysis of the initial 25-item CES revealed good model fit, though minor modifications were made to improve model fit based on statistical modification indices, item factor loadings, and theoretical considerations. After the final factor structure was identified, Cronbach’s alpha showed good internal consistency reliability of the total score and identified subscale scores (α = .81 – .95). We observed a strong correlation between the modified CES and the RS-14 indicating good construct validity. In other words, high levels of resiliency as measured by the CES are associated with high levels of resiliency as measured by the commonly used RS-14, directly supporting the utility of the CES as an assessment of resiliency. At the same time, the correlation between these two measures indicated an appreciable amount of unique variance, suggesting that the CES is still capturing distinct components of the resiliency construct.
We also investigated construct validity with theoretically related constructs of Stress Management and Adaptive Strategies processes within our resiliency theoretical model. The pattern of results indicated that the CES measure was indeed associated with these processes as expected. Findings demonstrated positive correlations between the CES and measures of optimism, positive affect, empathy, acceptance, and coping and negative correlations between the CES and measures of worry, anxiety, and depression. Participants reporting greater resiliency also reported high levels of trait mindfulness, social support, and dispositional optimism. High resiliency was related to higher empathy and the ability to use coping strategies and stress management techniques. As expected, high resiliency correlated with lower levels of worry, anxiety and depressive symptoms.
There are, however, limitations to the present study. First, the CES measure is subject to positive reporting or social desirability bias. Second, although we guided our changes to the CES model by empirical modification indices and theoretical considerations, future research could administer the full 25-item measure to allow for comparison and further study of our final 23-item model. Third, the results for construct validity may be influenced by shared method variance, as these analyses all focused on self-report measures. Fourth, our investigation was an amalgamation of several populations; future work should examine population characteristics and the generalizability to other diverse groups.
One of the most promising aspects of this work is the possibility of using this measure to assess change in resiliency following an intervention as well as to assist intervention participants in identifying skill areas for personal growth. The current results regarding sensitivity to change provide preliminary support for using the measure in this way. Another way that the CES might be used in future research would be as an awareness raising tool, with careful efforts paid to not prescribing growth or benefit finding, which can be detrimental, 65 but rather as a means of fine tuning people’s efforts to enhance their abilities to manage daily stressors. Future research should be done to assess the validity of the CES across diverse populations and characteristics (e.g., groups with diverse gender, socioeconomic status, racial and cultural identities).
Conclusion
The emergence of the COVID-19 pandemic highlights the need for an examination of interventions that may promote health and well-being during a critically stressful time. By promoting resiliency among at risk groups, we can mitigate the effects of the virus on people’s mental health and well-being as we have done in a wide variety of other medical conditions using the relaxation response, resiliency, and other stress management programs. Our targeted approach of using the CES to measure concepts that reflect the relaxation response theoretical model, as well as those skills that are targeted by our resiliency intervention, is a necessary step forward within the psychosocial intervention literature. Placing this study in a larger context of the growing field of positive psychology, it is our intention to add the CES to the compendium of assessment materials that focus on adaptive behaviors and personal strengths in the face of adversity. We hope that this resiliency model and psychometrically valid measure will serve to generate further discussion around specific, teachable skills that can promote resiliency and the testing of possible resiliency mechanisms.
Footnotes
Data Accessibility Statement
The data reported in this paper are human subject data from clinical services. As such, the data are not publicly available.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by funds from the National Center for Complementary and Integrative Health (NCCIH T32AT000051-16; Dr. Luberto. NCCIH K23AT010157; Dr. Hall) and the National Cancer Institute (K24 CA197382 04; Dr. Park).
