Objective:This study aims to evaluate the psychometric properties of an automated version of the Patient Health Questionnaire-9 (PHQ-9) to further facilitate its use in primary care. We automated the PHQ-9 using a computer telephony modality (interactive voice response system) called telephone-linked communication (TLC).Subjects and Methods:Eighty subjects were divided into four depression categories: none, mild, moderate, and severe. The automated questionnaire, TLC-PHQ-9, was administered to all subjects five times over a 3-month period, at intervals of 0 (T1), 1, 3, 4, and 4 (T5) weeks, respectively. The Inventory of Depressive Symptomatology (IDS) was administered (paper-and-pencil) at T1 and T5. We examined (1) reliability, (2) validity, (3) sensitivity and specificity, and (4) sensitivity to change.Results:(1) Test–retest reliability showed substantial agreement between T1 and T2, with a weighted kappa of 0.76 (95% confidence interval [CI] 0.67–0.85). Cronbach's coefficient alpha values ranged from 0.913 to 0.918 for each TLC-PHQ-9 assessment. (2) The weighted kappa of 0.78 (95% CI 0.70–0.87) for T1 and 0.73 (95% CI 0.63–0.83) for T5 showed strong agreement between TLC-PHQ-9 and IDS in all depression categories. (3) TLC-PHQ-9 demonstrated good sensitivity (82.4%) and very good specificity (90.7%) for moderate-plus depression and poorer sensitivity (54.2%) but very good specificity (97.8%) for severe-plus depression. (4) The weighted kappa of 0.53 (95% CI 0.35–0.70) indicated moderate agreement between TLC-PHQ-9 and IDS.Conclusions:An automated telephony administration of the PHQ-9 appears to be a valid and reliable tool for monitoring depression symptoms and has strong fidelity across patients.
Get full access to this article
View all access options for this article.
References
1.
KroenkeK, SpitzerR, WilliamsJ. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med, 2001; 16:606–613.
2.
ChenTM, HuangFY, ChangC, ChungH. Using the PHQ-9 for depression screening and treatment monitoring for Chinese Americans in primary care. Psychiatr Serv, 2006; 57:976–981.
3.
McFeatureB, PierceTW. Primary care behavioral health consultation reduces depression levels among mood-disordered patients. J Health Disparities Res Pract, 2012; 5:36–44.
4.
KesslerRC, ChiuWT, DemlerO. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry, 2005; 62:617–627.
5.
World Health Organization. The global burden of disease: 2004 update. Geneva: WHO Press, 2008.
6.
FordDE, ErlingerTP. Depression and C-reactive protein in US adults: Data from the Third National Health and Nutrition Survey. Arch Intern Med, 2004; 164:1010–1014.
7.
OquendoMA, LizardiD, GreenwaldS. Rates of lifetime suicide attempt and rates of lifetime major depression in different ethnic groups in the United States. Acta Psychiatr Scand, 2004; 110:446–451.
8.
KesslerRC, NelsonC, McGonagleKA. Comorbidity of DSM-III-R major depressive disorder in the general population: Results from the US National Comorbidity Survey. Br J Psychiatry, 1996; 168(Suppl 30):17–30.
9.
HirschfeldRMA. The comorbidity of major depression and anxiety disorders: Recognition and management in primary care. Prim Care Companion J Clin Psychiatry, 2001; 3:244–254.
10.
ShalevAY, FreedmanS, PeriT, BrandesD, SaharT, OrrSP, PitmanRK. Prospective study of posttraumatic stress disorder and depression following trauma. Am J Psychiatry, 1998; 155:630–637.
11.
GrantBF. Comorbidity between DSM-IV drug use disorders and major depression: Results of a national survey of adults. J Subst Abuse, 1995; 7:481–487.
12.
RushAJ. The varied clinical presentations of major depressive disorder. J Clin Psychiatry, 2007; 68(Suppl 8):4–10.
13.
AlboniP, FavaronE, PaparellaN, SciammarellaM, PedaciM. Is there an association between depression and cardiovascular mortality or sudden death?. J Cardiovasc Med, 2008; 9:356–362.
14.
TaylorWD, McQuoidDR, Ranga Raman KrishnanK. Medical comorbidity in late life depression. Int J Geriatr Psychiatry, 2004; 19:935–943.
15.
CassanoP, FavaM. Depression and public health: an overview. J Psychosom Res, 2002; 53:849–857.
16.
FreemanA, EpsteinN, SimonKM. Introduction. In:FreemanA, EpsteinN, SimonKM, eds. Depression and the Family. New York: The Haworth Press, 1986:5–7.
17.
HirschfeldRMA, MontgomerySA, KellerMB, KasperS, SchatzbergAF, MollerHJ, et al.Social functioning in depression: A review. J Clin Psychiatry, 2000; 61:268–275.
18.
SimonGE. Social and economic burden of mood disorders. Biol Psychiatry, 2033; 54:208–215.
19.
BurcasaSL, LaconoWG. Risk for recurrence in depression. Clin Psychol Rev, 2007; 27:959–985.
20.
SpitzerRL, KroenkeK, WilliamsJB. Validation and utility of a self report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA, 1999; 282:1737–1744.
21.
SpitzerR, WilliamsJB, KroenkeK. Validity and utility of the PRIME-MD Patient Health Questionnaire in assessment of 3000 obstetric-gynecologic patients: The PRIME-MD Obstetric-Gynecology Study. Am J Obstet Gynecol, 2000; 183:759–769.
22.
LoweB, UnutzerJ, CallahanCM. Monitoring depression treatment outcomes with the Patient Health Questionnaire-9. Med Care, 2004; 42:1194–1201.
23.
Pinto-MezaA, Serrano-BlancoA, PenarrubiaMT. Assessing depression in primary care with the PHQ-9: Can it be carried out over the telephone?. J Gen Intern Med, 2005; 20:738–742.
24.
TurveyC, SheeranT, DindoL. Validity of the Patient Health Questionnaire, PHQ-9, administered through interactive-voice response technology. J Telemed Telecare, 2012; 18:348–351.
25.
Wikipedia. Interactive voice response. Available at http://en.wikipedia.org/wili/Interactive_voice_response (last accessed June3, 2013).
26.
FriedmanR, KazisLE, JetteA. A telecommunication system for monitoring and counseling patients with hypertension: Impact on medication adherence and blood pressure control. Am J Hypertens, 1996; 9:285–292.
27.
FriedmanR, StollermanJE, MahoneyDM, RoznblyumL. The virtual visit: Using telecommunications technology to take care of patients. J Am Med Inform Assoc, 1997; 4:413–425.
28.
FriedmanR, StollermanJE, RozenblyumL. A telecommunications system to manage patients with chronic disease. Medinfo. Seoul: International Medical Informatics Association, 1998:1330–1334.
29.
FarzanfarR, StevensA, VachonL, et al.Design and development of a workplace mental health assessment and intervention system. J Med Syst, 2007; 31:49–62.
30.
FarzanfarR, StevensA, PhamQ, FriedmanR. A formative qualitative evaluation of usability and acceptability of a workplace mental health assessment and intervention system. Int J Ment Health Promot, 2008; 10:17–25.
31.
FarzanfarR, LockeS, HeerenT, et al.Workplace tele-communications technology to identify mental health disorders and facilitate self-help or professional referrals. Am J Health Promot, 2011; 25:207–216.
32.
FarzanfarR, FinkelsteinD. Evaluation of a workplace technology for mental health assessment: A meaning-making process. Comput Hum Behav, 2012; 28:160–165.
33.
DelichatsiosH, GlanzK, TennstedtS, et al.Randomized trial of a “talking computer” to improve adults' eating habits. Am J Health Promot, 2001; 15:215–224.
34.
PintoB, MarcusBH, KelleyH. Effects of a computer-based, telephone-counseling system on physical activity. Am J Prev Med, 2002; 23:113–120.
35.
RushAJ, HiserW, GilesDE. A comparison of self-reported versus clinician-rated symptoms in depression. J Clin Psychiatry, 1987; 48:246–248.
36.
RushAJ, GullionCM, BascoMR. The Inventory of Depressive Symptomatology (IDS): Psychometric properties. Psychol Med, 1996; 26:477–486.
37.
RushAJ, TrivediMH, IbrahimHM. The 16-item Quick Inventory of Depressive Symptomatology (QIDS) Clinician Rating (QIDS-C) and Self-Report (QIDS-SR): A psychometric evaluation in patients with chronic major depression. Biol Psychiatry, 2003; 54:573–583.
38.
RushAJ, TrivediMH, CarmodyTJ. One-year clinical outcomes of depressed public-sector outpatients: A benchmark for subsequent studies. Biol Psychiatry, 2004; 56:46–53.
39.
RushAJ, TrivediMH, CarmodyTJ. Self-reported depressive symptom measures: Sensitivity to detecting change in a randomized, controlled trial of chronically depressed, nonpsychotic outpatients. Neuropsychopharmacology, 2005; 30:405–416.
40.
IBM Corp.. 2011. Available at www.IBM.com (last accessed May23, 2013).
41.
SAS Institute Inc.. 2002–2011. Available at www.SAS.com (last accessed May23, 2013).
42.
LandisJR, KochGG. The measurement of observer agreement for categorical data. Biometrics, 1977; 33:159–174.
43.
VelicerWF, FavaJL. An evaluation of the effects of variable sampling on component, image, and factor analysis. Multivar Behav Res, 1987; 22:193–209.
44.
VelicerWF, FavaJL. The effects of variable and subject sampling on factor pattern recovery. Psychol Methods, 1998; 3:231–251.
45.
FischerEH, FarinaA. Attitudes toward seeking professional psychological help: A shortened form and considerations for research. J Coll Student Dev, 1995; 36:368–373.
46.
GodinG, Belanger-GravelA, AmireaultS. The effect of mere-measurement of cognitions on physical activity behavior: A randomized controlled trial among overweight and obese individuals. Int J Behav Nutr Physiol, 2011; 8:2.
47.
JacombPA, JormAF, RodgersB. Emotional response of participants to a mental health survey. Soc Psychiatry Psychiatr Epidemiol, 1999; 34:80–84.
48.
MorwitzVG, FitzsimonsGJ. The mere-measurement effect: Why does measuring intentions change actual behavior. J Consum Psychol, 2004; 4:64–74.
49.
WilliamsP, BlockLG, FitzsimonsGJ. Simply asking questions about health behaviors increases both healthy and unhealthy behaviors. Soc Influence, 2006; 2:117–127.
