An Interactive,Graphical Tool for Retrospectively Assessing Symptom Frequency and Severity: An Illustration With Eating Disorder Behaviors,Body Weight,and Stress

Abstract

There are few assessments that gather valid, highly detailed data on short-term (i.e., weekly) symptom frequency/severity retrospectively. In particular, methodologies that provide valid data for research investigating symptom changes are typically prospective, expensive, and burdensome. The purpose of this study was to evaluate a new interactive and graphical assessment tool for gathering detailed information about eating-related symptom frequency/severity retrospectively over a 3-month period. A mixed eating disorder sample (N = 113) recruited from the community provided symptom data once weekly for 12 weeks and completed the Interactive, Graphical Assessment Tool (IGAT) assessing eating disorder symptoms on three occasions to determine the test–retest and concurrent validity of the IGAT. The IGAT performed marginally better than other measures for retrospective symptom frequency assessment in the eating disorders and did so at a greater level of detail than other available tools. Future research should evaluate the IGAT with other behaviors of interest.

Keywords

retrospective assessment symptom fluctuation interactive graphical eating disorders

Get full access to this article

View all access options for this article.

References

Akobeng

A. K.

(2006). Understanding diagnostic tests 1: Sensitivity, specificity, and predictive values. Acta Paediatrica, 96, 338-341.

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Rev.). Washington, DC: Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

Anderson

D. A.

Paulosky

C. A.

(2004). A survey of the use of assessment instruments by eating disorder professionals in clinical practice. Eating and Weight Disorders, 9, 238-241.

Bardone

A. M.

Krahn

D. D.

Goodman

B. M.

Searles

J. S.

(2000). Using interactive voice response technology and timeline follow-back methodology in studying binge eating and drinking behavior: Different answers to different forms of the same question? Addictive Behaviors, 25, 1-11.

Bradburn

N. M.

Rips

L. J.

Shevell

S. K.

(1987). Answering autobiographical questions: The impact of memory and inference on surveys. Science, 236, 157-161.

Brennan

Chan

Hini

Esslemont

(1996). Improving the accuracy of recall data: A test of two procedures. Marketing Bulletin, 7, 20-29.

Brewer

W. F.

(1994). Autobiographical memory and survey research. In Schwarz

Sudman

(Eds.), Autobiographical memory and the validity of retrospective reports (pp. 11-20). New York, NY: Springer-Verlag.

Clark

L. A.

Watson

Leeka

(1989). Diurnal variation in the positive affects. Motivation and Emotion, 13, 205-234.

10.

Clausen

(2004). Review of studies evaluating psychotherapy in bulimia nervosa: The influence of research methods. Scandinavian Journal of Psychology, 45, 247-252.

11.

Couturier

Lock

(2006). What is remission in adolescent anorexia nervosa? A review of various conceptualizations and quantitative analysis. International Journal of Eating Disorders, 39, 175-183.

12.

Eddy

K. T.

Dorer

D. J.

Franko

D. L.

Tahilani

Thompson-Brenner

Herzog

D. B.

(2008). Diagnostic crossover in anorexia nervosa and bulimia nervosa: Implications for DSM-V. American Journal of Psychiatry, 165, 245-250.

13.

Edler

Lipson

S. F.

Keel

P. K.

(2007). Ovarian hormones and binge eating in bulimia nervosa. Psychological Medicine, 37, 131-141.

14.

Erdfelder

Lang

A. G.

Buchner

(2007). G*Power 3: A flexible statistical power analysis for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175-191.

15.

Fairburn

C. G.

Beglin

(2008). Eating Disorder Examination Questionnaire (EDE-Q 6.0). In Fairburn

C. G.

(Ed.), Cognitive behavior therapy and eating disorders (pp. 309-313). New York, NY: Guilford Press.

16.

Fairburn

C. G.

Cooper

O’Connor

M. E.

(2008). Eating disorder examination (Edition 16.0D). In Fairburn

C. G.

(Ed.), Cognitive behavior therapy and eating disorders (pp. 265-308). New York, NY: Guilford Press.

17.

Friedenreich

C. M.

(1994). Improving long-term recall in epidemiological studies. Epidemiology, 5, 1-4.

18.

Gattis

Holyoak

K. J.

(1996). Mapping conceptual to spatial relations in visual reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 231-239.

19.

Goldfein

J. A.

Devlin

M. J.

Kamenetz

(2005). Eating Disorder Examination–Questionnaire with and without instructions to assess binge eating in patients with binge eating disorder. International Journal of Eating Disorders, 37, 107-111.

20.

Grilo

C. M.

Masheb

R. M.

Wilson

G. T.

(2001a). A comparison of different methods for assessing the features of eating disorders in patients with binge eating disorder. Journal of Consulting and Clinical Psychology, 69, 317-322.

21.

Grilo

C. M.

Masheb

R. M.

Wilson

G. T.

(2001b). Different methods for assessing the features of eating disorders in patients with binge eating disorder: A replication. Obesity Research, 9, 418-422.

22.

Hanley

J. A.

McNeil

B. J.

(1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 839-843.

23.

Herzog

D. B.

Dorer

D. J.

Keel

P. K.

Selwyn

S. E.

Ekeblad

E. R.

Flores

A. T.

. . . Keller

M. B.

(1999). Recovery and relapse in anorexia and bulimia nervosa: A 7.5-year follow-up study. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 829-837.

24.

Keel

P. K.

Mitchell

J. E.

(1997). Outcome in bulimia nervosa. American Journal of Psychiatry, 154, 313-321.

25.

Keel

P. K.

Mitchell

J. E.

Miller

K. B.

Davis

T. L.

Crow

S. J.

(2000). Predictive validity of bulimia nervosa as a diagnostic category. American Journal of Psychiatry, 157, 136-138.

26.

Kordy

Krämer

Palmer

R. L.

Papezova

Pellet

Richard

Treasure

(2002). Remission, recovery, relapse, and recurrence in eating disorders: Conceptualization and illustration of a validation strategy. Journal of Clinical Psychology, 58, 833-846.

27.

Krabbenborg

M. A. M.

Danner

U. N.

Larsen

J. K.

van der Deer

van Elburg

A. A.

de Ridder

D. T. D.

. . . Engels

R. C. M. E

. (2012). The Eating Disorder Diagnostic Scale: Psychometric features within a clinical population and a cut-off point to differentiate clinical patients from healthy controls. European Eating Disorders Review, 20, 315-320.

28.

Lester

N. A.

Keel

P. K.

Lipson

S. F.

(2003). Symptom fluctuation in bulimia nervosa: Relation to menstrual-cycle phase and cortisol levels. Psychological Medicine, 33, 51-60.

29.

Loftus

E. F.

Marburger

(1983). Since the eruption of Mt. St. Helens, has anyone beaten you up? Improving the accuracy of retrospective reports with landmark events. Memory & Cognition, 11, 114-120.

30.

McGraw

K. O.

Wong

S. P.

(1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46 (Correction in Psychological Methods, 1(4), 390).

31.

Means

Swan

G. E.

Jobe

J. B.

Esposito

J. L.

(1994). The effects of estimation strategies on the accuracy of respondents’ reports of cigarette smoking. In Schwarz

Sudman

(Eds.), Autobiographical memory and the validity of retrospective reports (pp. 107-119). New York, NY: Springer-Verlag.

32.

Milos

Spindler

Schnyder

Fairburn

C. G.

(2005). Instability of eating disorder diagnoses: Prospective study. British Journal of Psychiatry, 187, 573-578.

33.

Schwarz

Sudman

(1994). Autobiographical memory and the validity of retrospective reports. New York, NY: Springer-Verlag.

34.

Shiffman

Stone

A. A.

Hufford

M. R.

(2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1-32.

35.

Shrout

P. E.

(1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7, 301-317.

36.

Smyth

J. M.

Wonderlich

S. A.

Heron

K. E.

Sliwinski

M. J.

Crosby

R. D.

Mitchell

J. E.

Engel

S. G.

(2007). Daily and momentary mood and stress are associated with binge eating and vomiting in bulimia nervosa patients in the natural environment. Journal of Consulting and Clinical Psychology, 75, 629-638.

37.

Sobell

L. C.

Maisto

S. A.

Sobell

M. B.

Cooper

A. M.

(1979). Reliability of alcohol abusers’ self-reports of drinking behavior. Behaviour Research and Therapy, 17, 157-160.

38.

Sobell

L. C.

Sobell

M. B.

Leo

G. I.

Cancilla

(1988). Reliability of a timeline method: Assessing normal drinkers’ reports of recent drinking and a comparative evaluation across several populations. British Journal of Addiction, 83, 393-402.

39.

Steinhausen

H. C.

(2002). The outcome of anorexia nervosa in the 20th century. American Journal of Psychiatry, 159, 1284-1293.

40.

Stice

Telch

C. F.

Rizvi

S. L.

(2000). Development and validation of the eating disorder diagnostic scale: A brief self-report measure of anorexia, bulimia, and binge-eating disorder. Psychological Assessment, 12, 123-131.

41.

Strober

Freeman

Morrell

(1997). The long-term course of severe anorexia nervosa in adolescents: Survival analysis of recovery, relapse, and outcome predictors over 10-15 years in a prospective study. International Journal of Eating Disorders, 22, 339-360.

42.

Thompson-Brenner

Shingleton

R. M.

Sauer-Zavala

Richards

L. K.

Pratt

E. M.

(2015). Multiple measures of rapid response as predictors of remission in cognitive behavior therapy for bulimia nervosa. Behaviour Research and Therapy, 64, 9-14.

43.

Towne

T. L.

De Young

K. P.

Anderson

D. A.

(in press). Trends in professionals’ use of eating disorder assessment instruments. Professional Psychology: Research and Practice.

44.

Tozzi

Thornton

L. M.

Klump

K. L.

Fichter

M. M.

Halmi

K. A.

Kaplan

A. S.

. . . Kaye

W. H.

(2005). Symptom fluctuation in eating disorders: Correlates of diagnostic crossover. American Journal of Psychiatry, 162, 732-740.

45.

Tversky

Bauer Morrison

Betrancourt

. (2002). Animation: Can it facilitate? International Journal of Human-Computer Studies, 57, 247-262.

46.

van der Vaart

Van der Zouwen

Dijkstra

. (1995). Retrospective questions: Data quality, task difficulty, and the use of a checklist. Quality & Quantity, 29, 299-315.

47.

Watson

(1988). Intraindividual and interindividual analyses of positive and negative affect: Their relation to health complaints, perceived stress, and daily activities. Journal of Personality and Social Psychology, 54, 1020-1030.

48.

Watson

Clark

L. A.

Tellegen

(1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 1063-1070.

49.

Weir

J. P.

(2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength & Conditioning Research, 19, 231-240.

50.

Wonderlich

J. A.

Lavender

J. M.

Wonderlich

S. A.

Peterson

C. B.

Crow

S. J.

Engel

S. G.

. . . Crosby

R. D.

(2015). Examining convergence of retrospective and ecological momentary assessment measures of negative affect and eating disorder behaviors. International Journal of Eating Disorders, 48, 305-311.