The Use of Propensity Scores as a Matching Strategy

Abstract

Objectives: This study reports on the concept and method of linear propensity scores used to obtain a comparison group from the National Longitudinal Survey of Children and Youth to assess the effects of a longitudinal, structured arts program for Canadian youth (aged 9 to 15 years) from low-income, multicultural communities. Method: This study compares 183 children in a community arts project to 183 children from a national longitudinal survey using propensity score matching. The variables included baseline scores of child-rated conduct problems, indirect aggression, emotional problems, self-esteem, and prosocial behavior and child gender, person most knowledgeable (PMK) education, PMK marital status, household income, and family functioning. Results: Mean score comparison showed that the groups were very similar on all covariates. Conclusions: Propensity score matching offers an alternative to true randomization that is cost-effective and convenient, particularly important for social work research in community-based organizations with a limited budget.

Keywords

propensity matching longitudinal studies growth curve analysis community-based arts programs

Get full access to this article

View all access options for this article.

References

Cepeda, M.S. , Boston, R. , Farrar, J.T. , & Strom, B.L. (2003). Comparison of logistic regression versus propensity score when the number of event is low and there are multiple confounders. American Journal of Epidemiology, 158, 280-287.

D'Agostino, R.B. (1998). Tutorial in biostatistics: Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Statistics in Medicine, 17, 2265-2281.

Foster, E.M. (2003). Propensity score matching: An illustrative analysis of dose response. Medical Care, 41(10), 1-11.

Kreft, I.G. , & Deleew, J. (1998). Introduction to multilevel modeling. Thousand Oaks, CA: Sage.

Nunnally, J. (1978). Psychometric theory. New York : McGraw-Hill.

Raudenbush, S. , Bryk, A. , Cheong, Y.K. , & Congdon, R. (2001). Hierarchical linear and nonlinear modeling (Rel. HLM 5.05). Lincolnwood, IL: Scientific Software International.

Richardson, J.L. , Radziszewska, B. , Dent, C.W. , & Flay, B.R. (1993). Relationship between after-school care of adolescents and substance use, risk taking, depressed mood, and academic achievement. Pediatrics, 92, 32-38.

Rosenbaum, P.R. , & Rubin, D.B. (1983). The central role of the propensity score in observational studies for casual effects. Biometrika, 70, 41-55.

Rosenbaum, P.R. , & Rubin, D.B. (1985). The bias due to incomplete matching. Biometrics, 41, 103-115.

10.

Rubin, D.B. , & Thomas, N. (1996). Matching using estimated propensity scores: Relating theory to practice. Biometrics, 52, 249-264.

11.

Statistics Canada. (1995). National Longitudinal Survey of Children: Overview of survey instruments for 1994/95, data collection, cycle 1. Retrieved November 11, 2004, from http://www.statcan.ca/english/freepub/89F0078XIE/96001.pdf

12.

Tabachnick, B.G. , & Fidell, L.S. (2007). Using multivariate statistics (5th ed.). Boston: Allyn & Bacon .

13.

Weitzen, S. , Lapane, K.L. , Toledano, A.Y. , Hume, A.L. , & Mor, V. (2004). Principles for modeling propensity scores in medical research: A systematic literature review. Pharmacoepidemiology and Drug Safety, 13, 841-853.

14.

Willett, J.B. , Singer, J.D. , & Martin, N.C. (1998). The design and analysis of longitudinal studies of development and psychopathology in context: Statistical models and methodological recommendations. Development and Psychopathology, 10, 395-426.

15.

Wright, R. , John, L. , Offord, D.R. , Duku, E. , Rowe, W. , & Ellenbogen, S. (2006). Effect of a structured arts program on the psychosocial functioning of youth from low-income communities: Findings from a Canadian longitudinal study. Journal of Early Adolescence, 26, 186-205.