Abstract
The General Anxiety Disorder 7-Item (GAD-7) scale is commonly used in primary care as a self-report measure of general anxiety symptoms with adult populations. There is little psychometric research on this measure with adolescent populations, particularly those with persistent post-concussive symptoms (PPCS). This study examined the psychometrics properties of the GAD-7 among youth with PPCS. We used baseline data from a randomized controlled trial of collaborative care for treatment of PPCS among 200 sports-injured adolescents 11–18 years of age (Mage = 14.7 years, standard deviation = 1.7). Eligible adolescents had three or more PPCS that lasted for ≥1 month and spoke English. Adolescents reported on their anxious (GAD-7 and Revised Child Anxiety and Depression Scale–Short Version [anxiety subscale]; RCADS) and depressive (Patient Health Questionnaire-9; PHQ-9) symptoms. Parents used the RCADS to report on their adolescents' anxious symptoms. The GAD-7 had good internal validity (Cronbach's alpha = 0.87), and significant (p < 0.001) correlations were detected between the GAD-7 and youth and parent report of anxiety on RCADS (r = 0.73 and r = 0.29) and PHQ-9 (r = 0.77) scores. Confirmatory factor analysis suggested a one-factor solution. These results suggest that the GAD-7 is a valid measure of anxiety with good psychometric properties for youth experiencing PPCS. ClinicalTrials.gov identifier: NCT03034720
Introduction
Concussion is increasingly common among U.S. children and adolescents, affecting up to 1.9 million youth annually. 1 Though concussion symptoms such as headache, fatigue, difficulty concentrating, and sleep disruption typically resolve within days to weeks post-injury, an estimated 20–30% of youth experience persistent post-concussive symptoms (PPCS) defined as impairment lasting longer than 1 month.2–4 For these youth, the period subsequent to a concussion is associated with particularly high risk for the development of anxious and depressive symptoms,5–7 which can lead to disengagement within school and community settings5,8,9 and the disruption of school performance and peer relationships. 10 The high incidence of anxious and depressive symptoms is also associated with greater risk for suicidality.11–13 In addition to the linkages between PPCS and anxious and depressive outcomes, these internalizing symptoms are also risk factors for the occurrence of PPCS.7,14–17
As described by Mossman and colleagues, 18 few self-report measures of adolescent anxiety exist with demonstrated validity and reliability. Further, we are unaware of any publications that investigate the psychometric properties of this standardized measure of anxiety in a sample of youth with PPCS. Recent studies18,19 support the use of the 7-item Generalized Anxiety Disorder Scale (GAD-7) as a valid measure of adolescent anxious symptomatology in non-clinical and clinical (adolescents with generalized anxiety disorder [GAD]) samples, respectively. The GAD-7 was developed by Spitzer and colleagues 20 as a self-report screening measure for GAD to increase detection of this disorder in adults in primary care settings. Overall, earlier studies with non-psychiatric samples that assessed the structural validity of the GAD-7 revealed a unidimensional factor structure.19,21,22 However, the psychometric properties of the scale have yet to be evaluated in samples of youth with PPCS.
This study had three overarching aims within this sample of youth with PPCS. First, we assessed the reliability, factorial validity, and construct validity of the GAD-7. Second, we examined the relationship between adolescents' report on their own anxiety, using the GAD-7 and the Revised Child Anxiety and Depression Scale–Short Version (RCADS), and parents' report on their children's anxiety using the RCADS as an indicator of convergent validity. Third, given the heterogeneity of the PPCS patient population, we will also examine severity and potential differential validity of the GAD-7 by demographic factors (age and gender) and history of past trauma or mental health issues. Specifically, we sought to determine whether the mean scores and Cronbach's alphas for the GAD-7 differed on the basis of gender (female vs. male), age (11–13 vs. 14–15 vs. 16–18), past anxiety, previous mental health problems (defined as depression, attention deficit hyperactivity disorder or attention deficit disorder diagnosis, or other mental health problems), trauma history, and current depressive symptoms.
Methods
Participants
This study used baseline data from a randomized comparative effectiveness trial of a collaborative care model for treatment of PPCS among adolescents 11–18 years of age with sports-related concussions. Adolescents and their parents were recruited from specialty pediatric clinics throughout western Washington.23,24 To be eligible, adolescents were required to have three or more PPCS that lasted for ≥1 month, but <9 months, after injury and to speak English. Adolescents with spinal cord or other severe injuries that had the potential to prevent participation were excluded as were those who had a diagnosis of schizophrenia or psychosis, or who presented with acute suicidal ideation. Adolescents with a history of previous concussion and/or other pre-existing psychological disorders were considered eligible. Parent-adolescent dyads were recruited between March 2017 and May 2019, and baseline data were collected during this period.
Of the 390 eligible adolescents screened, 80 actively declined to participate, and parents gave the following reasons: “too busy” (n = 33); “not interested” (n = 31); negative life event recently experienced (n = 1); and unknown (n = 15). An additional 109 parents did not respond to research coordinator contacts, thus passively declining, and one family was excluded from the study because we were unable to obtain their written consent. This resulted in a final sample size of 200 parent-adolescent dyads. Informed consent and assent were obtained before data collection, and study procedures were approved by the Seattle Children's Research Institute Institutional Review Board (protocol no.: STUDY00000437). The study was prospectively registered at ClinicalTrials.gov (NCT03034720). The findings presented herein are from adolescent- and parent-report surveys before randomization.
Measures
At baseline, parents reported information on their child's age, race, ethnicity, insurance type (Medicaid or private), and socioeconomic status (parental education and household income). Adolescents reported on their gender identity. Parents reported on their adolescents' history of anxiety, depression, and any diagnosis of attention deficit hyperactivity disorder or attention deficit disorder. Youth trauma history was based on adolescent self-report (yes = 1, no = 0), on the 10-item Post-Traumatic Stress Disorder–Reaction Index, about specific lifetime traumatic events (possible total score of 10).25–27
Adolescents reported on their anxiety during the past 2 weeks using the GAD-7 (α = 0.87; 0 = not at all; 1 = several days; 2 = over half the days; 3 = nearly every day). 22 Past research suggests that, for adolescents, a clinical cut point of 11 optimizes sensitivity and specificity for a diagnosis of “moderate anxiety” among youth with GAD. 18 The 15-item anxiety subscale of the RCADS 28 was used to assess adolescent report and parent report on current adolescent anxiety symptoms (α = 0.86 and 0.79, respectively). Participants rated the frequency of present anxious behaviors on a 4-point scale (0 = never; 1 = sometimes; 2 = often; and 3 = always). No clinical cutoff has been published for this measure. The anxiety subscale of the RCADS 28 has been shown to be a reliable, valid measure of child and adolescent anxiety in general and clinical populations. 29 Its inclusion in this study provides an opportunity to assess the convergent validity of the GAD-7.
Adolescent depressive symptoms were assessed using adolescent self-report with the 9-item Patient Health Questionnaire (PHQ-9; α = 0.84).30,31 Participants rated their symptoms over the past 2 weeks on a 4-point scale (0 = not at all; 1 = a little of the time; 2 = more than half the time; and 3 = nearly all the time). Reliability and validity of the PHQ-9 has been established in pediatric populations. 32 Research indicates that, for adolescents, a clinical cut point of ≥11 optimizes sensitivity and specificity for detecting major depression.32,33 As a measure, the PHQ-9 can be used to assess the construct validity of the GAD-7.
Procedure
Research assistants conducted participant outreach and enrollment and collected the baseline data. All data were collected using Research Electronic Data Capture—a secure, web-based application 34 —during the interview.
Statistical analysis
With one exception, all statistical analyses were conducted using SAS software (version 9.4; SAS Institute Inc., Cary, NC). 35 Three goodness-of-fit indices for the confirmatory factor analysis (CFA) models were estimated using the standard error of the mean command in STATA software (version 16; StataCorp LLC, College Station, TX), 36 specifically, the 1) root mean square error of approximation (RMSEA) and its 90% confidence interval (CI), 2) comparative fit index (CFI), and 3) Tucker-Lewis index (TLI). For these analyses, we used the guidelines described herein: for the absolute fit index (RMSEA), excellent fit = 0.01–0.04, good fit = 0.05–0.07, mediocre fit = 0.08–0.10, and poor fit = >0.10; for the relative fit indices (CFI and TLI), excellent fit = 0.95–0.99, acceptable fit = 0.90–0.95, mediocre fit = 0.85–0.90, and poor fit = <0.85.37-39 Multiple indices were used because they provide different information for assessing model fit (i.e., fit adjusting for model parsimony, fit relative to a null model). When used together, these indices provide a more conservative, reliable evaluation of model fit. 38 For tests of differences, p values were adjusted to account for multiple comparisons using the Hochberg and Hommel adjustments. 40 Statistical significance was established at p < 0.05, and all tests were two-tailed.
Results
Table 1 summarizes the characteristics of the study participants (adolescent Mage = 14.7 years, standard deviation [SD] = 1.7). Adolescent self-reported gender identity was 59% female, 37% male, and 1% transgender. The remaining youth (3.5%) did not respond to this question (n = 6) or selected, “I do not wish to answer” (n = 1). Parents reported that 82% of adolescents were white and 67% from households with annual incomes >$100,000. Parent respondents were mostly female (83%), mothers (81%), and fathers (17%), and 60% had bachelor's degrees or higher. In this sample, 50 adolescents (25%) had GAD-7 scores >10, which reflects moderate anxiety symptoms. Further, 79 adolescents (39.5%) had PHQ-9 scores >10, which is indicative of major depressive symptoms.
Characteristics of the Adolescent and Parent Study Participants (N = 200)
Percent unless otherwise noted.
Number of all female parents in the study.
GAD-7, Generalized Anxiety Disorder 7-item Scale; (GAD-7); RCADS, Revised Child Anxiety and Depression Scale-Short Version (anxiety subscale); PHQ-9, Patient Health Questionnaire-9 (PHQ-9); SD, standard deviation.
Characteristics of the GAD-7 items, including the corrected item-total correlations and factor loadings, are shown in Table 2. At the item level, the lowest mean was for item 7, “feeling afraid as if something awful might happen” (M = 0.60, SD = 0.89), and the second lowest mean was for item 5, “becoming so restless that it is hard to sit still” (M = 0.72, SD = 0.90). The highest mean was for item 6, “becoming easily annoyed or irritated” (M = 1.56, SD = 1.05). Items 5 and 6 had the lowest corrected item-total correlations (ritem 5 = 0.54 and ritem 6 = 0.51), which suggests that they were not as internally consistent with the other items. Aligned with these findings, the factor loadings from the CFA for items 5 and 6, at 0.56 and 0.53 respectively, were the lowest of the seven items. The loadings for the other five items were somewhat comparable and ranged from 0.66 to 0.83, indicating satisfactory-to-strong association with the factor.
Characteristics of Items and Total Generalized Anxiety Disorder Scale (GAD-7)
GAD-7 Cronbach's alpha = 0.87.
Correlation between the respective item and the total scale score (without the respective item).
GAD-7, General Anxiety Disorder 7-Item Scale; CFA, Confirmatory factor analysis; SD, standard deviation.
CFA fit indices for the one- and two-factor solutions are displayed in Table 3. For the one-factor solution, the RMSEA was 0.079 (90% CI, 0.041–0.116), which indicates mediocre fit. The CFI was 0.972 and the TLI was 0.958, which provides evidence of excellent fit. For the two-factor solution, the RMSEA was 0.121 (90% CI, 0.075–0.170), indicating a poor fit. The CFI was 0.966 and the TLI was 0.899, suggesting an excellent-to-acceptable fit. The one-factor model accounted for 50.75% of the variance whereas the two-factor model accounted for 58.44% of the variance, further supporting a unidimensional factor. Cronbach's alpha for scale was 0.87, which suggests high internal consistency (good reliability). When item 5 or item 6 was removed from the analysis, Cronbach's alpha remained unchanged at 0.87, indicating that high internal consistency is also achieved without these items.
Confirmatory Factor Analysis Fit Indices for One- and Two-Factor Models of the Generalized Anxiety Disorder Scale (GAD-7)
For the absolute fit index (RMSEA), excellent fit = 0.01–0.04, good fit = 0.05–0.07, mediocre fit = 0.08–0.10, and poor fit = >0.10. For relative fit indices (CFI and TLI), excellent fit = 0.95–0.99, acceptable fit = 0.90–0.95, mediocre fit = 0.85–0.90, and poor fit = <0.85.
p < 0.001.
GAD-7, General Anxiety Disorder 7-Item Scale; CI, confidence interval; CFI, comparative fit index; Df, degrees of freedom; RMSEA, root mean square error of approximation; TLI, Tucker-Lewis index.
Correlation between adolescents' self-report of their anxious symptoms, as measured by the GAD-7 and the RCADS, was strong (r = 0.73, p < 0.001; Table 4). Magnitude of the correlation between adolescent self-report on the GAD-7 and parent-report of their child's anxiety symptoms on the RCADS was moderate (r = 0.29, p < 0.001) and consistent with literature on the correspondence between parent and adolescent ratings of adolescent internalizing symptoms.41,42 Correlation between adolescent self-report on the GAD-7 and the PHQ-9 was also robust (r = 0.77, p < 0.001).
Means, Standard Deviations, Ranges, and Intercorrelations Between Anxiety and Depression Variables
p < 0.05.
p < 0.01.
p < 0.001.
AR, adolescent report; GAD-7, Generalized Anxiety Scale-7; PHQ-9, Patient Health Questionnaire-9; PR, parent report on adolescent; RCADS, Revised Child Anxiety and Depression Scale–Short Version (anxiety subscale); SD, standard deviation.
Finally, we examined mean differences for GAD-7 scores among key subpopulations (Table 5). We found statistically significant differences across all groups. Specifically, higher anxiety was reported by females and older adolescents. Youth with a history of anxiety, other mental health problems, trauma, and current depressive symptoms also experienced greater anxiety than their peers without these mental health characteristics. With one exception (for the gender unknown category), there was relatively little variation among Cronbach's alphas, which ranged from 0.76 to 0.89.
Characteristics of the Generalized Anxiety Scale (GAD-7) Total Scores by Key Demographic, Psychological, and Stress Factors
p values that met statistical significance of p < 0.05 are in bold.
Because of the small sample size of participants who 1) identified as transgender (n = 2), 2) selected “I do not wish to answer” (n = 1), and 3) did not answer the gender identity question (n = 6), a group difference test was only conducted for the youth who identified as female or male.
Determined by parent responses about whether they had ever been told their child had anxiety problems.
Count variable determined by parent responses to individual items about whether they had ever been told their child had past health problems defined as 1) depression, 2) other mental health problems, or 3) whether their child had ever received a diagnosis of attention deficit hyperactivity disorder or attention deficit disorder before their injury.
Determined by the number of events endorsed on the trauma history portion of the Post-Traumatic Stress Disorder–Reaction Index (PTSD-RI), UCLA Trauma History Profile.
Determined by adolescent responses to the Patient Health Questionnaire-9.
GAD-7, General Anxiety Disorder 7-Item Scale; SD, standard deviation.
Discussion
The evidence base for GAD-7 as a measure with clinical utility and strong psychometric properties in youth is emerging, and this article demonstrates similar properties among adolescents with PPCS. Overall, our results indicate that a one-factor structure of the GAD-7 was supported by CFA, aligning with Tiirikainen and colleagues' results for adolescents, which was also in support of unidimensionality. Whereas the RMSEA goodness-of-fit indices from the factor analyses were in the “mediocre” range, both the CFI and TLI indicators, which are less sensitive to sample size, suggested excellent fit. Convergent validity was supported by the findings, which suggest that higher GAD-7 scores were associated with higher levels of self-reported depressive symptoms and self- and parent report of anxiety symptoms using the RCADS. These findings are consistent with results from a large, representative study of Finnish adolescents that revealed good psychometric properties for the GAD-7, with nearly identical Cronbach's alphas at 0.919 and a separate validation study based on 40 adolescents with GAD. 18
At the same time, items 5 (restlessness) and 6 (irritability) had the lowest corrected item-total correlations and factor loadings. These findings are also aligned with Tiirikainen and colleagues' study, in which these items had the lowest corrected item total correlation and factor loadings. 19 In terms of face validity, these items tap broader psychopathology symptoms that are not specific to anxiety, but also common to depression and attention disorders. Further, Cronbach's alpha remained unchanged in our study when these two items were removed, indicating that they do not contribute to the internal validity of the measure. A study by Moreno and colleagues with adult primary care patients in Spain who presented with internalizing disorders (N = 1255) found that a two-factor model (representing cognitive-emotional and somatic components of anxiety) provided a superior fit compared to the one-factor model. Specifically, items 5 and 6 in tandem with item 4 (trouble relaxing) comprised the somatic dimension, and items 1, 2, 3, and 7 (i.e., “1. feeling nervous, anxious or on edge;” “2. not being able to stop or control worrying;” “3. worrying too much about different things;” and “7. feeling afraid as if something awful might happen”) comprised the cognitive-affective dimension. 43 This same pattern of results was obtained in two studies with adult psychiatric samples.44,45 Notably, in the current study, three of the items that comprised this cognitive affective dimension (1, 2, and 3) also had the highest factor loadings. A study by Jordan and colleagues with adult German primary care patients suggested that the first four GAD-7 items discriminated anxiety severity better than the last three items. 21 These findings, considered together with ours, may indicate that the GAD-7 items that tap more physically focused complaints (items 4, 5, and 6), such as restlessness, may be secondary to emotion-focused items (items 1, 2, 3, and 7) among adolescents with PPCS.
With respect to our aim to understand whether differences exist for GAD-7 scores among key subpopulations, differences were detected for each factor examined and consistent with other studies, demonstrating higher anxiety symptoms among adolescent females, older youth, and adolescents with current depressive symptoms. 19 Not surprisingly, adolescents with a history of anxiety, other mental health problems, and trauma also reported greater anxiety than their counterparts without these mental health characteristics. We believe that these findings strengthen the evidence for the measure's construct validity considering that adolescents with higher anxiety levels, mental health challenges, and trauma histories scored higher on the GAD-7. For nearly all subgroups, Cronbach's alphas indicated acceptable-to-excellent internal consistency. The one exception to this was for the unknown gender category, which had a small sample size (n = 7).
Limitations
There are several study limitations. Our sample was primarily white (82%) and non-Hispanic (89%), limiting generalizability to other racial and ethnic groups. These findings are further constrained by the higher proportion of females relative to males and the lack of socioeconomic diversity (adolescents were predominantly from households with high incomes and parent education). Recent research documents disparities among adolescents who present for concussion care, with non-Hispanics and those with private insurance more likely to have healthcare visits. 46 Thus, our sample may be representative of adolescents who present for concussion care, but it also may be limited in generalizability for all who experience PPCS. Finally, the small number of youth who identified as transgender or who opted out of providing this information further curtails the utility of these findings for adolescents who may identify as gender non-binary and are likely at higher risk for anxiety and depression. 47
Conclusion
Our results suggest that the GAD-7 is a valid screening tool among youth experiencing PPCS and that it is a unidimensional factor. Scores are strongly correlated with youth self-report of depressive and anxious symptoms on other scales and moderately correlated with parental report, indicating the importance of obtaining youth-reported symptoms, which may not always be observed by parents. Adolescents with previous anxiety, trauma, and mental health symptoms scored higher on the GAD-7 compared to those without, as did those with current depression. Further research should explore whether the inclusion of items assessing restlessness and irritability adds to the validity of the GAD-7, or whether these non-specific items could be removed. Nevertheless, it offers a means for primary care providers and other clinicians caring for adolescents with concussion to more fully ascertain the full spectrum of problems encountered after concussion.
Footnotes
Acknowledgments
The contents of this publication are solely the responsibility of the authors and do not necessarily represent the views of the National Institute of Child Health and Human Development. The authors thank Drs. Jinguji, Quitiquit Dickason, and Osorio for referring patients to the study. We also thank the previous Study Coordinator Teah Hoopes for organizing data collection and IRB protocols as well as the Clinical Research Coordinators who spearheaded participant recruitment and data collection efforts: Lauren Fay and Lauren Stanek. Clinical Research Coordinators Tierra Gogue-Garcia, Emily Holderness, Moira O'Connor Lenth, and Michelina Tarasyuk also contributed to data collection. Finally, we thank the adolescents and families who participated in this research.
Authors' Contributions
L.A.M.: Writing–original draft (lead), methodology (lead). C.A.M.: Conceptualization (equal), writing–review and editing. S.P.D.C.: Writing–review and editing (supporting). D.F.Z.: Conceptualization (equal), writing–review and editing (supporting). A.M.J.: Writing–review and editing (equal). J.W.: Formal analysis (lead), software (lead). R.J.H.: Writing–review and editing (supporting). F.P.R.: Conceptualization (equal), writing–review and editing (equal).
Funding Information
This work was supported by the National Institute of Child Health and Human Development (grant no.: 1R01HD090230-01).
Author Disclosure Statement
No competing financial interests exist.
