A Psychometric Study of the Multi-Problem Screening Inventory Depression Subscale Using Item Response and Generalizability Theories

Abstract

Purpose: The purpose of this study was to assess the measurement characteristics of the Multi-Problem Screening Inventory (MPSI) depression subscale. Method: A sample of 542 responses to the MPSI was obtained from persons seeking assistance in any of several child and family service agencies. The responses on the depression subscale were analyzed using item response theory and generalizability theory methods. Results: The MPSI depression subscale produced scores with very desirable measurement properties for use in (a) monitoring a client's change in depression across time and (b) making tentative decisions concerning the clinical significance of a client's depression level. The measurement error characteristics of the MPSI depression subscale scores reach a minimum just below the clinical cutting point and then remain constant across the clinical cutting point and across the range of clinically significant depression levels. Conclusions: The results of this study suggest that the MPSI depression subscale can be used by social work practitioners to both assess and monitor their clients' problems with depression.

Get full access to this article

View all access options for this article.

References

Acock, A. (1997). Working with missing values. Family Science Review, 10(1), 76-102.

Brennan, R. (1983). Elements of generalizability theory. Iowa City, IA: American College Testing.

Brennan, R. (1984). Applications of generalizability theory. In R. A. Berk (Ed.), Criterion referenced measurement: State of the art (pp. 186-232). Baltimore, MD: Johns Hopkins Press.

Cronbach, L. , Gleser, G. , Nanda, H. , & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: John Wiley .

Cronbach, L. , Gleser, G. , & Rajaratnam, N. (1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Mathematical and Statistical Psychology, 16, 137-173.

Cuesta, M. , & Muniz, J. (1999). Robustness of item response logistic models to violations of the unidimensionality assumption. Psicothema , 11(1), 175-182.

Dawadi, B. (1998). Robustness of the polytomous IRT model to violations of the unidimensionality assumption. Dissertation Abstracts International, 58(2-A), 0416.

Downey, R. , & King, C. (1998). Missing data in Likert ratings: A comparison of replacement methods. Journal of General Psychology, 125(2), 175-191.

Drasgow, F. , & Parsons, C. (1983). Application of unidimensional item response theory models to multidimensional data. Applied Psychological Measurement , 7(2), 189-199.

10.

Hambleton, R. (1984). Test score validity and standard setting methods . In R. A. Berk (Ed.), Criterion referenced measurement: State of the art (pp. 80-124). Baltimore, MD: Johns Hopkins Press.

11.

Hambleton, R. (1989). Principles and selected applications of item response theory. In R. L. Linn (Ed.), Educational Measurement (3rd ed.) (pp. 147-200). New York: Macmillan.

12.

Hambleton, R. , & Swamanathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer/Nijhoff .

13.

Harrison, D. (1986). Robustness of IRT parameter estimates to violations of the unidimensionality assumption. Journal of Educational Statistics, 11(2), 91-115.

14.

Hudson, W.W. (1982). The clinical measurement package. Homewood, IL: Dorsey.

15.

Hudson, W.W. (1990). Multi-problem screening inventory. Tallahassee, Fl: Walmyr.

16.

Hudson, W.W. , & McMurtry, S. (1997). Comprehensive assessment in social work practice: The multi-problem screening inventory. Research on Social Work Practice, 7, 79-98.

17.

Hulin, C. , Drasgow, F. , & Parsons, C. (1983). Item response theory: Applications to psychological measurement. Homewood, IL: Dorsey .

18.

Nugent, W.R. (1994). An investigation of the dependability of clinical cutting scores using generalizability theory. Journal of Social Service Research, 18, 89-107.

19.

Nugent, W.R. , & Hankins, J.A. (1989). The use of item response theory in social work measurement and research. Social Service Review, 63, 447-473.

20.

Nugent, W.R. , & Hankins, J.A. (1992). A Comparison of Classical, Item Response, and Generalizability Theories of Measurement. Journal of Social Service Research, 16, 11-40.

21.

Nugent, W.R. , Sieppert, J. , & Hudson, W. (2001). Practice evaluation for the 21st century. Pacific Grove, CA: Wadsworth.

22.

Pike, C. , Hudson, W. , Murphy, D. , & McCuan, E. (1998). Using second order factor analysis in examining multiple problems of clients. Research on Social Work Practice, 8, 200-211.

23.

Samejima, R. (1969). Estimation of latent ability using a response pattern of graded scores (Psychometric Monograph No. 17). Iowa City, IA: Psychometric Society.

24.

Thissen, D. (1991). MULTILOG User's Guide. Lincolnwood, IL: Scientific Software.

25.

Yu, L. (1989). The robustness of ASCAL and MULTILOG to violations of the assumptions of unidimensionality of test items and normality of ability distribution. Dissertation Abstracts International, 51(2-B), 1037.