This paper analyzes how variation in participant take-up rates affected the impacts of the New Hope project, a random-assignment, anti-poverty program. New Hope offered experimental members four benefits—child care subsidies, wage subsidies, health insurance, and, if needed, a temporary community service job—that were available to families working full time. Take-up of the benefits was far from universal and experimental participants who used one of the benefits rarely used all of them. Clustering and propensity score methods are used to analyze take-up sub-groups and to estimate program impacts within each. The majority of take-up patterns adopted by experimental members were associated with at least one positive program impact. However, the primary beneficiaries were those parents who used the community service jobs. They increased their employment effort, felt less parenting stress, and had children with higher teacher-related academic accomplishment scores. The implication of this method for the evaluation of other multi-benefit programs is discussed.
Get full access to this article
View all access options for this article.
References
1.
Adler, N. E., et al. (1994). Socioeconomic status & health: The challenge of the gradient. American Psychologist, 49, 15-24.
2.
Agodini, R., & Dynarski, M. (2001). Are experiments the only option? A look at dropout prevention programs. Paper presented at the Twenty-Third Annual APPAM Research Conference, Washington, DC.
3.
Becker, S. O., & Ichino, A. (2002). Estimation of average treatment effects based on propensity scores. The Stata Journal, 2, 358-377.
4.
Bergman, L. R. (1998). A pattern-oriented approach to studying individual development. In R. B. Cairns, L. R. Bergman & J. Kagan (Eds.), Methods and models for studying the individual (pp. 83-121). Thousand Oaks, CA: Sage.
5.
Bergman, L. R., & El-Khouri, B. M. (1998). SLEIPNER: A statistical package for pattern oriented analyses (Version 2). Stockholm: Department of Psychology, Stockholm University.
6.
Bergman, L. R., & Magnusson, D. (1997). A person-oriented approach in research on developmental psychology. Development and Psychopathology, 9, 291-320.
7.
Blank, R. M. (1997). It takes a nation: A new agenda for fighting poverty. New York: Russell Sage.
8.
Bloom, H. (1984). Accounting for no-shows in experimental evaluation designs. Evaluation Review, 8, 225-246.
9.
Bloom, H., & Michalopo, C. (2001). How welfare and work policies affect employment and income: A synthesis of research. New York, NY: Manpower Demonstration Research Corporation.
10.
Bos, J., Huston, A. C., Granger, R. C., Duncan, G. J., Brock, T. W., & McLoyd, V. C. (1999). New Hope for people with low incomes. New York: Manpower Demonstration Research Corporation.
11.
Brayfield, A., & Hofferth, S. L. (1995). Balancing the family budget: Differences in child care expenditures by race/ethnicity, economic status, and family structure. Social Science Quarterly, 76, 158-177.
12.
Brock, T., Doolittle, F., Fellerath, V., & Wiseman, M. (1997). Implementation of a program to reduce poverty and reform welfare. New York: Manpower Demonstration Research Corporation.
13.
Brooks-Gunn, J., Klebanov, P., Smith, J. R., & Lee, K. (2001). Effects of combining public assistance and employment on mothers and their young children. Women & Health, 32, 179.
14.
Bumpass, L., & Lu, H.-H. (2000). Trends in cohabitation and implications for children’s family contexts in the United States. Population Studies, 54, 29-41.
15.
Chase-Lansdale, P. L., & Pittman, L. (2002). Parenting and the home environment. Future of Children, 11, 167-183.
16.
Currie, J., & Yelowitz, A. S. (2000). Health insurance and less skilled workers. In D. Card & R. Blank (Eds.), Finding jobs: Work and welfare reform. New York: Russell Sage Foundation.
17.
Danziger, S., Corcoran, M., Danziger, S., Heflin, C., Kalil, A., Levine, J., Rosen, D., Seefeldt, K. S., Siefert, K., & Tolman, R. (2000). Barriers to the employment of welfare recipients. In R. Cherry & W. M. Rodgers (Eds.), Prosperity for all? The economic boom and African Americans. New York: Russell Sage Foundation.
18.
Dehejia, R. H., & Wahba, S. (1999). Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association, 94(448), 1053-1062.
19.
Dehejia, R. H., & Wahba, S. (2002). Propensity score matching methods for non-experimental causal studies. The Review of Economics and Statistics, 84, 151-161.
20.
Duncan, G. J., & Brooks-Gunn, J. (1999). Consequences of growing up poor. New York: Russell Sage Foundation.
21.
Duncan, G. J., Brooks-Gunn, J., & Klebanov, P. (1994). Economic deprivation and early childhood development. Child Development, 65, 296-319.
22.
Duncan, G. J., Brooks-Gunn, J., Yeung, W. J., & Smith, J. (1998). How much does childhood poverty affect the life chances of children?American Sociological Review, 63, 406-423.
23.
Duncan, G. J., & Chase-Lansdale, P. L. (2001). Welfare reform and child well-being. In R. Blank & R. Haskins (Eds.), The new world of welfare reform (pp. 391-417). Washington, DC: Brookings Institution.
24.
Gennetian, L. A., & Miller, C. (2002). Children and welfare reform: A view from an experimental welfare program in Minnesota. Child Development, 73, 601-621.
25.
Gibson, C., & Weisner, T. (2002). “Rational” and ecocultural circumstances of program take-up among low-income working parents. Human Organization, 61, 154-166.
26.
Gresham, F. M., & Elliott, S. N. (1990). Social Skills Rating System manual. Circle Pines, MN: American Guidance Service, Inc.
27.
Guo, G., & Harris, K. M. (2000). The mechanisms mediating the effects of poverty on children’s intellectual development. Demography, 37, 431-447.
28.
Harris, K. M. (1996). Life After welfare: Women, work, and repeat dependency. American Sociological Review, 61, 407-426.
29.
Haveman, R., & Wolfe, B. (1995). The determinants of children’s attainment: A review of methods and findings. Journal of Economic Literature, 33, 1829-1878.
30.
Heckman, J., Ichimura, H., & Todd, P. (1998). Matching as an econometric evaluation estimator. The Review of Economic Studies, 65, 261-294.
31.
Heckman, J., Ichimura, H., & Todd, P. (1997). Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme. The Review of Economic Studies, 64, 605-654.
32.
Hofferth, S. L., West, J., Henke, R. W., & Kaufman, P. (1994). Access to early childhood programs for children at risk. Washington, DC: National Center for Education Statistics.
33.
Huston, A. C., Bos, J., Granger, R., Duncan, G. J., Brock, T., McLoyd, V. C., Crosby, D., Gibson, C., Fellarath, V., Magnuson, K., Mistry, R., Poglinco, S., Romich, J., & Ventura, A. (2001). Work-based anti-poverty programs for parents can enhance the school performance and social behavior of children. Child Development, 72, 318-336.
34.
Jackson, A., Brooks-Gunn, J., Huang, C., & Glassman, M. (2000). Single mothers in low-wage jobs: Financial strain, parenting, and preschoolers’ outcomes. Child Development, 71, 1409-1423.
35.
Kalil, A., Corcoran, M., Danziger, S., Tolman, R., Seefeldt, K. S., Rosen, D., & Nam, Y. (1998). Getting jobs, keeping jobs, and earning a living wage: Can welfare reform work? Institute for Research on Poverty, Discussion Paper No. 1170-98. Madison, WI: University of Wisconsin-Madison.
36.
Katz, L., Kling, J., & Liebman, J. (2001). Moving to opportunity in Boston: Early results of a randomized mobility experiment. Quarterly Journal of Economics, 116, 607-654.
37.
Kemple, J. J., & Snipes, J. C. (2000) Career Academies: Impacts on students’ engagements and performance in high school. New York, NY: Manpower Demonstration Research Corporation.
38.
Kemple, J. J., Snipes, J. C., & Bloom, H. (2001). A regression-based strategy for defining subgroups in a social experiment. MDRC Working Papers on Research Methodology # 2001-06-01. New York: Manpower Demonstration Research Corporation.
39.
Lalonde, R. (1986). Evaluating the econometric evaluations of training programs. American Economic Review, 76, 604-620.
40.
Magnuson, K. (1999). Appendix K—The barrier indicator index. In J. Bos, A. C. Huston, R. Granger, G. J. Duncan, T. Brock, & V. C. McLoyd (Eds.), New Hope for people with low incomes: Two-year results of a program to reduce poverty and reform welfare (pp. 346-355). New York: Manpower Demonstration Research Corporation.
41.
Magnuson, K., & Duncan, G. J. (2003). Parents in poverty. In M. Bornstein (Ed.), Handbook of parenting (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
42.
Magnusson, D. (1998). The logic and implications of a person oriented approach. In R. B. Cairns, L.R. Bergman, & J. Kagan (Eds.), Methods and models for studying the individual (pp. 83-121). Thousand Oaks, CA: Sage.
43.
McGroder, S. M. (2000). Parenting among low-income, African American single mothers with preschool-age children: Patterns, predictors, and developmental correlates. Child Development, 71, 752-772.
44.
McLoyd, V. C. (1990). The impact of economic hardship on black families and children: Psychological distress, parenting, and socioemotional development. Child Development, 61, 311-346.
45.
McLoyd, V. C. (1997). The impact of poverty and low socioeconomic status on the socioemotional functioning of African-American children and adolescents: Mediating effects. In R. D. Taylor & M. C. Wang. (Eds.), Social and emotional adjustment and family relations in ethnic minority families (pp. 7-34). Mahwah, NJ: Lawrence Erlbaum.
46.
Meyer, D., & Cancian, M. (1999). Economic well-being following an exit from aid to families with dependent children. Journal of Marriage and the Family, 60, 479-492.
47.
Milligan, G. W. (1996). Clustering validation: Results and implications for applied analysis. In P. Arabie, L. J. Habert, & G. D. Soete (Eds.), Clustering and classification (pp. 341-375). River Edge, NJ: World Scientific.
48.
Morris, P., Huston, A. C., Duncan, G. J., Crosby, D., & Bos, J. (2001). How welfare and work policies affect children: A synthesis of research. New York: Manpower Demonstration Research Corporation.
49.
Morris, P., & Michalopoulos, C. (2000). The self-sufficient project at 36 months: Effects on children of a program that increased parental employment & income—Executive summary. Canada: Social Research Demonstration Corporation.
50.
NICHD. (1997). The effects of infant child care on infant-mother attachment security: Results of the NICHD study of early child care. Child Development, 68, 860-879.
51.
Olson, K. K., & Pavetti, L. (1996). Personal and family challenges to the successful transition from welfare to work: Final report. Washington, DC: Urban Institute.
52.
Parcel, T., & Menaghan, E. (1994). Early parental work, family social capital, and early childhood outcomes. American Journal of Sociology, 99, 972-1009.
53.
Parcel, T., & Menaghan, E. (1995). Parent’s jobs and children’s lives. New York: Aldine De Gruyter.
54.
Parker, S., Greer, S., & Zuckerman, B. (1988). Double jeopardy: The impact of poverty on early child development. Children at Risk, 35, 1227-1240.
55.
Pavetti, L., & Acs, G. (2001). Moving up, moving out, or going nowhere? A study of the employment patterns of young women and the implications for welfare mothers. Journal of Policy Analysis and Management, 20, 721-736.
56.
Peck, L. (2003). Subgroup analysis in social experiments: Measuring program impacts based on post-treatment choice. American Journal of Evaluation, 24, 157-187.
57.
Perry-Jenkins, M., Repetti, R. L., & Crouter, A. C. (2000). Work and family in the 1990s. Journal of Marriage and the Family, 62, 981-998.
58.
Poglinco, S. M., Brash, J., & Granger, R. C. (1998). An early look at community service jobs in the New Hope demonstration. New York: Manpower Demonstration Research Corporation.
59.
Quint, J., Bos, J., & Polit, D. (1997). New Chance: Final report on a comprehensive program for disadvantaged young mothers and their children. New York: Manpower Demonstration Research Corporation.
60.
Rosenbaum, P. R., & Rubin, D. B. (1983). Reducing bias in observational studies using subsclassification on the propensity score. Journal of the American Statistical Association, 70(387), 516-524.
61.
Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. Journal of the American Statistician, 39, 33-38.
62.
Rosenberg, M. (1979). Conceiving the self. New York: Basic Books.
63.
Royalty, A. B. (2001). Do minimum wage increases lower the probability that low-skilled workers will receive fringe benefits?Evanston, IL: Joint Center for Poverty Research.
64.
Rubin, D. (1979). Using multivariate matched sampling and regression adjustment to control bias in observational studies. Journal of the American Statistical Association, 74, 318-328.
65.
Seccombe, K. (2000). Families in poverty in the 1990s: Trends, causes, consequences, and lessons learned. Journal of Marriage and the Family, 62, 1094-1113.
66.
Simons, R. L., Lorenz, F. O., Wu, C., & Conger, R. D. (1993). Social network and marital support as mediators of the impact of stress and depression on parental behavior. Developmental Psychology, 29, 368-381.
67.
Singer, J. D., Fuller, B., Keiley, M. K., & Wolf, A. (1998). Early child-care selection: variation by geographic location, maternal characteristics, and family structure. Developmental Psychology, 34, 1129-1144.
68.
Snyder, C. R., Sympson, S. C., Ybasco, F. C., & Borders, T. F. (1996). Development and validation of the State Hope Scale. Journal of Personality and Social Psychology, 72, 321-335.
Tjaden, P., & Thoennes, N. (1998). Prevalence, incidences, & consequences of violence against women: Findings from the national violence against women survey. Washington, DC: National Institute of Justice & Centers for Disease & Prevention.
71.
Vandell, D. L., & Ramanan, J. (1992). Effects of early and recent maternal employment on children from low-income families. Child Development, 63, 938-950.
72.
Weisner, T., Bernheimer, L., Gibson, C., Howard, E., Magnuson, K., Romich, J., & Lieber, E. (1999). From the living rooms and daily routines of the economically poor: An ethnographic study of the New Hope effects on families and children. Paper presented at the Society for Research in Child Development.
73.
White, L., & Rogers, S. J. (2000). Economic circumstances & family outcomes: A review of the 1990s. Journal of Marriage & Family, 62, 1035-1052.
74.
Yoshikawa, H., Rosman, E. A., & Hsueh, J. (s2001). Variation in teenage mothers’ experiences of child care and other components of welfare reform: Selection factors and developmental consequences. Child Development, 72, 299-317.
