Evidence That the Clinical Impairment Assessment (CIA) Subscales Should Not Be Scored: Bifactor Modelling,Reliability,and Validity in Clinical and Community Samples

Abstract

Aim: The Clinical Impairment Assessment (CIA 3.0) is the most widely used instrument assessing psychosocial impairment secondary to eating disorder symptoms. However, there is conflicting advice regarding the dimensionality and optimal method of scoring the CIA. We sought to resolve this confusion by conducting a comprehensive factor analytic study of the CIA in a community sample (N = 301) and clinical sample comprising patients with a diagnosed eating disorder (N = 209). Convergent and discriminant validity were also assessed. Method: The CIA and measures of eating disorder symptoms were administered to both samples. Results: Factor analyses indicated there is a general impairment factor underlying all items on the CIA that is reliably measured by the CIA Global score. CIA Global demonstrated good convergent and discriminant validity. Conclusions: CIA Global is a reliable and valid measure of psychosocial impairment secondary to eating disorder symptoms; however, subscale scores should not be computed.

Keywords

clinical impairment assessment eating disorders factor structure validity

Get full access to this article

View all access options for this article.

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

Andony

L. J.

Tay

Allen

K. A.

Wade

T. D.

Hay

Touyz

. . . Byrne

S. M.

(2014). Therapist adherence in the strong without anorexia nervosa (SWAN) study: A randomized controlled trial of three treatments for adults with anorexia nervosa. International Journal of Eating Disorders, 48, 1170-1175. doi:10.1002/eat.22455

Becker

A. E.

Thomas

J.J.

Bainivualiku

Richards

Navara

Roberts

A.L.

Gilman

S.E.

Striegel-Moore

R.H.

(2010). Adaptation and evaluation of the Clinical Impairment Assessment to assess disordered eating related distress in an adolescent female ethnic Fijian population. International Journal of Eating Disorders, 43, 179-186.

Berg

K. C.

Peterson

C. B.

Frazier

Crow

S. J.

(2012). Psychometric evaluation of the Eating Disorder Examination and Eating Disorder Examination-Questionnaire: A systematic review of the literature. International Journal of Eating Disorders, 45, 428-438.

Bohn

Doll

H. A.

Cooper

O’Connor

M. E.

Palmer

R. L.

Fairburn

C. G.

(2008). The measurement of impairment due to eating disorder psychopathology. Behaviour Research and Therapy, 46, 1105-1110.

Bohn

Fairburn

C. G.

(2008a). Clinical Impairment Assessment Questionnaire (CIA 3.0). In Fairburn

C. B.

(Ed.), Cognitive behavior therapy and eating disorders (pp. 315-318). New York, NY: Guildford Press.

Bohn

Fairburn

C. G.

(2008b). The Clinical Impairment Assessment Questionnaire (CIA). Retrieved from http://www.credo-oxford.com/pdfs/CIA_3.0_Instructions_for_users.pdf

Bonifay

Lane

S. P.

Reise

S. P.

(2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5, 184-186. doi:10.1177/2167702616657069

DeJong

Oldershaw

Sternheim

Samarawickrema

Kenyon

M.D.

Broadbent

Lavendar

Startup

Treasure

Schmidt

(2013). Quality of life in anorexia nervosa, bulimia nervosa, and eating disorder not otherwise specified. Journal of Eating Disorders, 1(1), 43. Retrieved from http://www.jeatdisord.com/content/1/1/43

10.

Fairburn

C. G.

Bailey-Straebler

Basden

Doll

H. A.

Jones

Murphy

. . . Cooper

(2015). A transdiagnostic comparison of enhanced cognitive behaviour therapy (CBT-E) and interpersonal psychotherapy in the treatment of eating disorders. Behaviour Research and Therapy, 70, 64-71.

11.

Fairburn

C. G.

Beglin

S. J.

(1994). Assessment of eating disorders: Interview or self-report questionnaire? International Journal of Eating Disorders, 16, 363-370.

12.

Fairburn

C. G.

Cooper

(1993). The Eating Disorder Examination. In Fairburn

C. G.

Wilson

G. T.

(Eds.), Binge eating: Nature, assessment, and treatment (pp. 317-360). New York, NY: Guilford Press.

13.

Flora

D. B.

LaBrish

Chalmers

R. P.

(2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Psychology, 3, 55. doi:10.3389/fpsyg.2012.00055

14.

Hogdahl

Levallius

Bjorck

Norring

Birgegard

(2016). Personality predicts drop-out from therapist-guided internet-based cognitive behavioural therapy for eating disorders. Results from a randomized controlled trial. Internet Interventions, 5, 44-50.

15.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.

16.

Jenkins

P. E.

(2013). Psychometric validation of the Clinical Impairment Assessment in a UK eating disorder service. Eating Behaviors, 14, 241-243.

17.

Kline

(2015). Principles and practice of structural equation modeling (4th ed.). New York, NY: Guilford Press.

18.

Martin

Padierna

Unzurrunzaga

Gonzalez

Berjano

Quintana

J. M.

(2015). Adaptation and validation of the Spanish version of the clinical impairment assessment questionnaire. Appetite, 91, 20-27.

19.

National Eating Disorders Association. (2013). Eating disorders on the college campus: A national survey of programs and resources. Retrieved from https://www.nationaleatingdisorders.org/sites/default/files/CollegeSurvey/CollegiateSurveyProject.pdf

20.

Parker

Mitchell

O’Brien

Brennan

(2015). Psychometric evaluation of disordered eating measures in bariatric surgery candidates. Eating Behaviors, 19, 39-48.

21.

Parker

Mitchell

O’Brien

Brennan

(2016). Psychometric evaluation of disordered eating measures in bariatric surgery candidates. Obesity Surgery, 26, 563-575.

22.

Reas

D. L.

Kapstad

Lask

(2010). Psychometric properties of the Clinical Impairment Assessment: Norms for young adult women. International Journal of Eating Disorders, 43, 72-76.

23.

Reeve

B. B.

Hays

R. D.

Bjorner

J. B.

Cook

K. F.

Crane

P. K.

Teresi

J. A.

. . . Cella

(2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45, S22-S31.

24.

Reise

S. P.

Bonifay

W. E.

Haviland

M. G.

(2012). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95, 129-140.

25.

Reise

S. P.

Moore

T. M.

Haviland

M. G.

(2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scores. Journal of Personality Assessment, 92, 544-559. doi:10.1080/00223891.2010.496477

26.

Reise

S. P.

Scheines

Widaman

K. F.

Haviland

M. G.

(2013). Multidimensionality and structural coefficient bias in structural equation modelling: A bifactor perspective. Educational and Psychological Measurement, 73, 5-26.

27.

Rhemtulla

Brosseau-Liard

P. É.

Savalei

(2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354-373.

28.

Bang

Reas

D.L.

Rosenvinge

J.H.

(2012). The impact of age and BMI on impairment due to disordered eating in a large female community sample. Eating Behaviours, 13, 342-346.

29.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2016a). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 223-237.

30.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2016b). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137-150. doi:10.1037/met0000045

31.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1-36. Retrieved from http://www.jstatsoft.org/v48/i02/

32.

Schmitt

T. A.

(2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29, 304-321. doi:10.1177/0734282911406653

33.

Turner

Marshall

Stopa

Waller

(2015). Cognitive-behavioural therapy for outpatients with eating disorders: Effectiveness for a transdiagnostic group in a routine clinical setting. Behaviour Research and Therapy, 68, 70-75.

34.

Vannucci

Kass

A. E.

Sinton

M. M.

Aspen

Weisman

Bailey

J. O.

. . . Taylor

C. B.

(2012). An examination of the Clinical Impairment Assessment among women at high risk for eating disorder onset. Behaviour Research and Therapy, 50, 407-414.

35.

Welch

Birgegard

Parling

Ghaderi

(2011). Eating disorder examination questionnaire and clinical impairment assessment questionnaire: General population and clinical norms for young adult women in Sweden. Behaviour Research and Therapy, 49, 85-91.

36.

White

Reynolds-Malear

Cordero

(2011). Disordered eating and the use of unhealthy weight control methods in college students: 1995, 2002 and 2008. Eating Disorders: Journal of Treatment & Prevention, 19, 323-334.