Differential Item Functioning Results May Change Depending On How An Item Is Scored: An Illustration With The Center For Epidemiologic Studies Depression Scale

Abstract

The present study investigated potentially biased scale items on the Center for Epidemiologic Studies Depression (CES-D). The 20-item CES-D was scored using two binary methods (presence and persistence) and one ordinal method. Gender differential item functioning (DIF) was explored using Zumbo’s OLR method with corresponding logistic regression effect size estimator with all three scoring methods. Gender DIF was found with the CES-D item “crying” for the ordinal and presence methods of scoring. The persistence scoring method identified two DIF items (effort and hopeful); however, this scoring method appears to be of limited use due to low variability on some items. Overall, the results indicate that the scoring method has an effect on DIF; thus, DIF is a property of the item, scoring method, and purpose of the instrument.

Get full access to this article

View all access options for this article.

References

Cole, S. R., Kawachi, I., Maller, S. J., & Berkman, L. F. (2000). Test of item-response bias in the CES-D scale: Experience from the New Haven EPESE study. Journal of Clinical Epidemiology, 53, 285-289.

Goldberg, D. P. (1972). The detection of psychiatric illness by questionnaire (Maudsley Monograph No. 21). Oxford, UK: Oxford University Press.

Goldberg, D., & Williams, P. (2000). A user’s guide to the General Health Questionnaire. Berkshire, UK: NFER-NELSON.

Jodoin, M. G., & Gierl, M. J. (2001). Evaluating Type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329-349.

Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 3, 385-401.

Radloff, L. S., & Locke, B. Z. (1986). The community mental health assessment survey and the CES-D Scale. In A. E. Slaby (Series Ed.), Community surveys of psychiatric disorders (pp. 177-189). New Brunswick, NJ: Rutgers University Press.

Ramsay, J. O. (2001). TestGraf: A program for the graphical analysis of multiple choice test and questionnaire data. Montreal, Canada: McGill University.

Ramsay, J. O., & Abrahamowicz, M. (1989). Binomial regression with monotone splines: A psychometric application. Journal of the American Statistical Association, 84, 906-915.

Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa, Canada: Directorate of Human Resources Research and Evaluation, Department of National Defense. Retrieved from http://www.educ.ubc.ca/faculty/zumbo/DIF/index.html

10.

Zumbo, B. D., Pope, G. A., Watson, J. E., & Hubley, A. M. (1997). An empirical test of Roskam’s conjecture about the interpretation of an ICC parameter in personality inventories. Educational and Psychological Measurement, 57, 963-969.

11.

Zumbo, B. D., Gelin, M. N., & Hubley, A. M. (in press). The construction and use of psychological tests and measures. In Encyclopedia of life support systems. Paris: United Nations Educational, Scientific and Cultural Organization Publishing (UNESCO-EOLSS Publishing).