Evaluation Using Random Assignment Experiments: Demonstrating the Effectiveness of Earnings Supplements

Abstract

The UK is preparing to start one of the largest random assignment evaluations of a new social policy that has ever been undertaken in Europe or North America. This juncture is a useful time to examine the merits of random assignment evaluation using new results from one-of the most widely cited experimental evaluations the Self-Sufficiency Project in Canada. Random assignment experiments are the most reliable approach to measure the impacts of changes in social policy. However, they are often expensive and cannot answer all relevant research questions. The Canadian Self-Sufficiency Project demonstrates these qualities. It showed that the provision of earnings supplements to lone parents who leave welfare for full-time work can increase employment and earnings and decrease welfare receipt. The high quality of research provides credible evidence that the large, initial programme expenditure can mostly be recovered through reduced welfare payments and higher taxes.

Get full access to this article

View all access options for this article.

References

Cook, T.D. , Cook, F.L. and Mark, M.M. (1977), 'Randomized and quasi-experimental designs in evaluation research: an introduction', in Rutman, L (ed.), Evaluation Research Methods: A Basic Guide, Beverly Hills, Sage.

Fisher, R.A. (1928), Statistical Methods for Research Workers, 2nd edition, London, Oliver and Boyd.

Ford, R. , Gyarmati, D. , Foley, K. and Tattrie, D. with Jimenez, L. (2003), Can Work Incentives Pay for Themselves? Final Report on the Self-Sufficiency Project for Welfare Applicants, Ottawa, Social Research and Demonstration Corporation.

Greenberg, D. and Shroder, M. (1997), Digest of the Social Experi- ments, Washington, DC, The Urban Institute Press.

Heckman, J.J. and Smith, J.A. (1995), 'Assessing the case for social experiments', Journal of Economic Perspectives, 9, pp. 85-110.

Lise, J. , Seitz, S. and Smith, J. (2003), Equilibrium Policy Experiments and the Evaluation of Social Programmes, Ottawa, Social Research and Demonstration Corporation.

Michalopoulos, C. , Tattrie, D. , Miller, C. , Robins, P.K. , Morris, P. , Gyarmati, D. , Redcross, C. , Foley, K. and Ford, R. (2002), Making Work Pay: Final Report on Long-Term Welfare Recipients in the Self-Sufficiency Project, Ottawa, Social Research and Demonstration Corporation.

Weiss, C.H. (1998), Evaluation, 2nd edition, New Jersey, Prentice Hall.

White, M. and Lakey, J. (1992), Restart Effect: Does Active Labour Market Policy Reduce Unemployment? London, Policy Studies Institute.