What Have the Difference Scores Not Been Telling Us? A Critique of the Use of Self—Ideal Discrepancy in the Assessment of Body Image and Evaluation of an Alternative Data-Analytic Framework
Restricted accessResearch articleFirst published online September, 2010
What Have the Difference Scores Not Been Telling Us? A Critique of the Use of Self—Ideal Discrepancy in the Assessment of Body Image and Evaluation of an Alternative Data-Analytic Framework
Difference scores are often used as a means of assessing body image satisfaction using silhouette scales. Unfortunately, difference scores suffer from numerous potential methodological problems, including reduced reliability, ambiguity, confounded effects, untested constraints, and dimensional reduction. In this article, the methodological problems are outlined and an alternative framework is discussed. The alternative consists of a minimum of testing the constraints implied by the difference score model, and at most evaluating more exact body image hypotheses by incorporating nonlinear terms in a regression and testing features of the response surface. Two empirical examples are used to illustrate the utility of these methods. The first example uses both polynomial regression and response surface methods to examine eating disorder outcomes, whereas the second example uses polynomial regression to examine the outcomes related to muscle dysmorphia. Directions for future research related to assessment of body image are discussed.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Rev.). Washington, DC: Author.
2.
Bollen, K.A. ( 1989). Structural equations with latent variables. New York: Wiley.
3.
Cafri, G., Olivardia, R., & Thompson, J.K. (2008). Symptom characteristics and psychiatric comorbidity among males with muscle dysmorphia. Comprehensive Psychiatry, 49, 374-379.
4.
Cafri, G., Roehrig, M., & Thompson, J.K. , (2004). Reliability assessment of the somatomorphic matrix. International Journal of Eating Disorders, 35, 597-600.
5.
Cafri, G., Strauss, J., & Thompson, J.K. (2002). Male body image: Satisfaction and its relationship to psychological functioning using the somatomorphic matrix. International Journal of Men’s Health, 1, 215-231.
6.
Cafri, G., & Thompson, J.K. (2004a). Measuring male body image: A review of the current methodology. Psychology of Men & Masculinity, 5, 18-29.
7.
Cafri, G., & Thompson, J.K. (2004b). Evaluating the convergence of muscle appearance attitude measures. Assessment, 11, 224-229.
8.
Cafri, G., & Thompson, J.K. (2007). Assessment of body image and body change strategies. In J. K. Thompson & G. Cafri (Eds.), Pursuit of the muscular ideal: Social, psychological and medical perspectives (pp. 107-120). Washintgton, DC: American Psychological Association .
9.
Cafri, G., van den Berg, P., & Thompson, J.K. (2006). Pursuit of muscularity in adolescent boys: Relations among biopsychosocial variables and clinical outcomes. Journal of Clinical Child and Adolescent Psychology , 35, 283-291.
10.
Choi, P.Y.L., Pope, H.G., & Olivardia, R. ( 2002). Muscle dysmorphia: A new syndrome in weightlifters. British Journal of Sports Medicine, 36, 375-377.
11.
Cohen, J. ( 1968). Multiple regression as a general data-analytic system . Psychological Bulletin, 70, 426-443.
12.
Cohen, J. ( 1988). Statistical power analysis for the behavioral sciences . Hillsdale, NJ: Lawrence Erlbaum .
13.
Cohen, J., & Cohen, P. ( 1983). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
14.
Collins, M.E. ( 1991). Body figure perceptions and preferences among preadolescent children. International Journal of Eating Disorders, 10, 199-208.
15.
Cronbach, L.J., & Furby, L. ( 1970). How we should measure "change"-or should we?Psychological Bulletin, 74, 68-80 (erratum , 74, 218).
16.
Diener, E. ( 1984). Subjective well-being. Psychological Bulletin, 95, 542-575.
17.
Edwards, J.R. ( 2002). Alternatives to difference scores: Polynomial regression and response surface methodology. In F. Drasgow & N. W. Schmitt (Eds.), Advances in measurement and data analysis (pp. 350-400). San Francisco : Jossey-Bass.
18.
Efron, B. & Tibshirani, R.J. ( 1993). An introduction to the bootstrap. New York: Chapman & Hall.
19.
Fallon, A., & Rozin, P. ( 1985). Sex differences in perceptions of desirable body shape . Journal of Abnormal Psychology, 94, 102-105.
Gruber, A.J., Pope, H.G., Borowiecki, J., & Cohane, G. ( 1999). The development of the somatomorphic matrix: A bi-axial instrument for measuring body image in men and women. In T.S., Olds, J., Dollman , & K. I. Norton (Eds.), Kinanthropometry VI (pp. 217-231). Sydney, New South Wales, Australia: International Society for the Advancement of Kinanthropometry .
22.
Higgins, E.T. ( 1987). Self-discrepancy: A theory relating self and affect. Psychological Review, 94, 319-340.
23.
Johns, G. ( 1981). Difference score measures of organizational behavior variables: A critique. Organizational Behavior & Human Performance, 27, 443-463.
24.
Mayville, S.B., Williamson, D.A., White M.A., Netemeyer, R., & Drab, D.L. ( 2002). Development of the muscle appearance satisfaction scale: A self-report measure for the assessment of muscle dysmorphia symptoms. Assessment, 9, 351-360.
25.
Myers, J.L., & Well, A.D. ( 1995). Research design and statistical analysis. Hillsdale, NJ: Lawrence Erlbaum.
26.
Nunnally, J. ( 1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
27.
Olivardia, R., Pope, H.G., & Hudson, J.I. ( 2000). Muscle dysmorphia in male weightlifters: A case-control study. American Journal of Psychiatry, 157, 1291-1296.
28.
Pedhazur, E. ( 1997). Multiple regression in behavioral research: Explanation and prediction. Orlando, FL: Harcourt Brace & College.
29.
Pope, H. G., Gruber, A., Magweth B., Bureau, B., deCol, C., Jovent, R., et al. (2000). Body image perception among men in three countries. American Journal of Psychiatry , 157, 1297-1301.
30.
Rubin, D.B. ( 1987). Multiple imputation for nonresponse in surveys. New York: Wiley.
31.
Stice, E. ( 2002). Risk and maintenance factors for eating pathology: A meta-analytic review. Psychological Bulletin, 128, 825-848.
32.
Stunkard, A.J., Sorensen, T., & Schulsinger, F. (1983). Use of the Danish adoption registrar for the study of obesity and thinness. In S. S. Kety, L. P. Rowland, R. L. Sidman, & S. W. Matthysse (Eds.), The genetics of neurological and psychiatric disorder (pp. 115-120). New York: Raven Press.
33.
Tantleff, S., & Thompson, J.K. (2000). Breast and chest satisfaction: Relation to overall body image and self-esteem. Eating Disorders: Journal of Treatment & Prevention, 8, 241-246.
34.
Thompson, J.K. ( 1990). Body image disturbance assessment and treatment. New York: Pergamon Press.
35.
Thompson, J.K. ( 1996). Assessing body image disturbance: Measures, methodology and implementation. In J. K. Thompson (Ed.), Body image, eating disorders and obesity: An integrative guide for assessment and treatment (pp. 49-81). Washington, DC: American Psychological Association.
36.
Thompson, J.K., & Altabe, M.N. ( 1991). Psychometric qualities of the Figure Rating Scale. International Journal of Eating Disorders, 10, 615-619.
37.
Thompson, J.K. & Gardner, R. ( 2002). Measuring perceptual body image in adolescents and adults . In T. F. Cash & T. Pruzinsky (Eds.), Body images: A handbook of theory, research and clinical practice (pp. 135-141). New York: Guilford.
38.
Thompson, J.K., Heinberg, L., Altabe, M., & Tantleff-Dunn, S. (1999). Exacting beauty. Washington, DC: American Psychological Association .
39.
Thompson, J.K., & Psaltis, K. ( 1988). Multiple aspects and correlates of body figure ratings: A replication and extension of Fallon and Rozin (1985). International Journal of Eating Disorders, 7, 813-817.
40.
Thompson, J.K., & Tantleff, S. ( 1992). Female and male ratings of upper torso: Actual, ideal, and stereotypical conceptions. Journal of Social Behavior and Personality, 7, 345-354.
41.
Thompson, M.A., & Gray, J.J. ( 1995). Development and validation of a new body image assessment scale. Journal of Personality Assessment, 64, 258-269.
42.
Traub, R.E. ( 1994). Reliability for the social sciences: Theory and applications . Thousand Oaks, CA: Sage.
43.
van Strien, T., Frijters, J.E., Bergers, G.P., & Defares, P.B. ( 1986). The Dutch Eating Behavior Questionnaire (DEBQ) for assessment of restrained, emotional, and external eating behavior. International Journal of Eating Disorders, 5, 295-315.
44.
Wertheim, E.H., Paxton, S.J., & Tilgner, L. ( 2004). Test-retest reliability and construct validity of Contour Drawing Rating Scale scores in a sample of early adolescent girls. Body Image, 1, 199-205.
45.
Wood, K.C., Becker, J.A., & Thompson, J.K. (1996). Body image dissatisfaction in preadolescent children. Journal of Applied Developmental Psychology, 17, 85-100.
